reviews@spark.apache.org, 2026-04

You are viewing a plain text version of this content. The canonical link for it is here.

- [PR] [SPARK-56313][PYTHON] Add type hint for rddsampler.py [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/01 00:07:58 UTC, 4 replies.
- Re: [PR] [SPARK-56271][PYTHON] Fix type hint and remove unused method for _globals.py [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/01 00:09:37 UTC, 4 replies.
- [PR] [SPARK-56189][PYTHON] Refactor SQL_WINDOW_AGG_ARROW_UDF to use ArrowStreamSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/01 00:17:56 UTC, 0 replies.
- Re: [PR] [SPARK-56125][SQL] Simplify schema calculation for Merge Into Schema Evolution [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/04/01 00:23:38 UTC, 10 replies.
- Re: [PR] [SPARK-56123][PYTHON][FOLLOWUP] Avoid using concat_batches for old version of pyarrow [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/01 00:43:27 UTC, 1 replies.
- Re: [PR] [SPARK-56253][PYTHON][CONNECT] Make spark.read.json accept DataFrame input [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/01 00:55:11 UTC, 44 replies.
- Re: [PR] [SPARK-55306] Add ability to run Kafka tests in Python [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/04/01 01:21:22 UTC, 5 replies.
- Re: [PR] [SPARK-56311][PYTHON] Add type hints for daemon.py [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/01 01:23:34 UTC, 1 replies.
- [PR] [SPARK-54938][TEST][FOLLOW-UP] Fix `test_pyarrow_array_type_inference` for pandas >= 3 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/01 02:16:31 UTC, 1 replies.
- Re: [PR] [SPARK-49543][SQL] Add SHOW COLLATIONS command [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/04/01 02:52:55 UTC, 1 replies.
- Re: [PR] [SPARK-56034][SQL] Push down Join through Union when the right side is broadcastable [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/01 02:56:02 UTC, 1 replies.
- [PR] [SPARK-56314][SQL][TESTS] Avoid uncessary RDD->DataFrame conversion in `SQLTestData` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/01 03:35:46 UTC, 2 replies.
- [PR] [SPARK-43752][SQL] Support column DEFAULT values in V2 write commands [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/01 03:40:30 UTC, 7 replies.
- [PR] [SPARK-56177][SQL] V2 file bucketing write support [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/01 03:54:50 UTC, 1 replies.
- [PR] [SPARK-56178][SQL] MSCK REPAIR TABLE for V2 file tables [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/01 03:57:34 UTC, 1 replies.
- Re: [PR] [SPARK-56306][SQL] Fix collation-aware PIVOT [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/01 04:05:19 UTC, 3 replies.
- Re: [PR] [SPARK-55568][SQL] Separate schema construction from field stats collection [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/01 04:33:24 UTC, 12 replies.
- Re: [PR] [SPARK-56092][SS] Fix NPE in StreamingQueryException.toString() when cause is null [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2026/04/01 05:04:52 UTC, 3 replies.
- [PR] [SPARK-56315][SQL] Pre-aggregate before `Expand` to reduce data amplification for multiple `COUNT(DISTINCT)` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/01 05:20:21 UTC, 10 replies.
- Re: [PR] [SPARK-56302] Free task result memory eagerly during serialization on executor [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2026/04/01 06:27:49 UTC, 0 replies.
- Re: [PR] [SPARK-54938][PYTHON][TEST][FOLLOW-UP] Fix `test_pyarrow_array_type_inference` for pandas >= 3 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/01 06:35:42 UTC, 1 replies.
- Re: [PR] [SPARK-56296][SQL] Pivot createTableLike to pass full TableInfo including schema, partitioning, constraints, and owner [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/04/01 06:39:20 UTC, 3 replies.
- [PR] [SPARK-54055][CONNECT][PYSPARK] Clean up per-session PythonWorkerFact… [spark] - posted by "kumbham (via GitHub)" <gi...@apache.org> on 2026/04/01 06:51:15 UTC, 0 replies.
- [PR] [SPARK-56158][CORE] Support limitActiveProcessorCount in local mode [spark] - posted by "jzhuge (via GitHub)" <gi...@apache.org> on 2026/04/01 06:52:56 UTC, 2 replies.
- Re: [PR] [SPARK-55689] Skip unsupported column changes during schema evolution [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/04/01 07:52:08 UTC, 7 replies.
- Re: [PR] [SPARK-56302][CORE] Free task result memory eagerly during serialization on executor [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/01 08:15:41 UTC, 14 replies.
- Re: [PR] [SPARK-55888][K8S] Parallel pod creation for Kubernetes executor allocation [spark] - posted by "DenineLu (via GitHub)" <gi...@apache.org> on 2026/04/01 08:16:00 UTC, 0 replies.
- [PR] [SPARK-56318][BUILD] Upgrade jackson to 2.18.6 [spark] - posted by "manuzhang (via GitHub)" <gi...@apache.org> on 2026/04/01 09:10:54 UTC, 0 replies.
- [PR] [SPARK-56317] GetJsonObjectEvaluator should reuse output buffer [spark] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2026/04/01 09:11:09 UTC, 1 replies.
- [PR] [SPARK-56318][BUILD][4.1] Upgrade jackson to 2.21.2 [spark] - posted by "manuzhang (via GitHub)" <gi...@apache.org> on 2026/04/01 09:17:23 UTC, 18 replies.
- [PR] [SPARK-56319] ShuffleExternalSorter should reuse write buffer [spark] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2026/04/01 09:33:39 UTC, 2 replies.
- Re: [PR] [SPARK-53840][SQL] Add AS JSON output support for SHOW TABLES and SHOW TABLE EXTENDED [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/01 10:02:13 UTC, 4 replies.
- Re: [PR] [SPARK-56054][SQL] Fix aliased nested fields ignored for schema evolution in MERGE [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/01 10:25:58 UTC, 6 replies.
- Re: [PR] [SPARK-55278] Introduce core abstraction for UDF worker. [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/01 10:39:21 UTC, 2 replies.
- [PR] [SPARK-56321][SQL] Pass function catalog to toCatalystOrdering in V2ScanPartitioningAndOrdering [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/04/01 11:21:56 UTC, 0 replies.
- [PR] [SPARK-56316][SQL] Support static partition overwrite for V2 file tables [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/01 11:38:54 UTC, 1 replies.
- Re: [PR] [SPARK-55441][SQL] Types Framework - Phase 1c - Client Integration [spark] - posted by "dejankrak-db (via GitHub)" <gi...@apache.org> on 2026/04/01 11:45:24 UTC, 26 replies.
- Re: [PR] [SPARK-56001][SQL] Add INSERT INTO ... REPLACE ON/USING syntax [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/01 12:17:27 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-55715][SQL] Keep `outputOrdering` when `GroupPartitionsExec` coalesces partitions [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/04/01 12:51:52 UTC, 0 replies.
- Re: [PR] [SPARK-56295][PYTHON] Add Java error classes to Python side [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/04/01 13:15:05 UTC, 6 replies.
- [PR] [SPARK-56221][SQL][PYTHON][FOLLOWUP] Fix CachedTable API and rename CatalogTablePartition [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/01 13:29:42 UTC, 5 replies.
- [PR] [SPARK-XXXXX][CONNECT][PYTHON] Fix TypeError when self-joining observed DataFrames [spark] - posted by "mwojtyczka (via GitHub)" <gi...@apache.org> on 2026/04/01 14:36:21 UTC, 0 replies.
- Re: [PR] [SPARK-56277][SQL] Add missing toString() to NamespaceChange property classes [spark] - posted by "anshulbaliga7 (via GitHub)" <gi...@apache.org> on 2026/04/01 15:26:52 UTC, 1 replies.
- Re: [PR] [SPARK-55278] Introduce module and core abstraction for language-agnostic UDF worker. [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2026/04/01 15:55:12 UTC, 7 replies.
- Re: [PR] [SPARK-56321][SQL] Pass function catalog to `toCatalystOrdering` in `V2ScanPartitioningAndOrdering` [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/04/01 16:29:02 UTC, 9 replies.
- [PR] [WIP] Add operation metrics for UPDATE queries in DSv2 [spark] - posted by "ZiyaZa (via GitHub)" <gi...@apache.org> on 2026/04/01 17:40:37 UTC, 55 replies.
- Re: [PR] [SPARK-56222][PYTHON] Create ArrowStreamGroupSerializer and ArrowStreamCoGroupSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/01 17:49:32 UTC, 2 replies.
- [PR] [SPARK-56323][SQL] Propagate ROW FORMAT / STORED AS to v2 catalog in CREATE TABLE LIKE [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/04/01 17:50:13 UTC, 3 replies.
- Re: [PR] [SPARK-56310][PYTHON] Handle pandas 3 dtype in DataFrame.toPandas [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/04/01 18:13:00 UTC, 1 replies.
- Re: [PR] [SPARK-56219][PS][FOLLOW-UP] Keep legacy groupby idxmax and idxmin skipna=False behavior for pandas 2 [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/04/01 18:15:21 UTC, 1 replies.
- [PR] [SPARK-40328][PS] Implement DataFrame.compare [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/04/01 18:20:34 UTC, 5 replies.
- [PR] [SPARK-56313][PYTHON][FOLLOWUP] Remove the generic for rddsampler methods [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/01 18:36:21 UTC, 10 replies.
- [PR] [SPARK-56325][SDP] Refactor FlowSystemMetadata.flowCheckpointsDirOpt to avoid scala.Option [spark] - posted by "jaceklaskowski (via GitHub)" <gi...@apache.org> on 2026/04/01 19:40:22 UTC, 6 replies.
- Re: [PR] [SPARK-54055][CONNECT][PYSPARK] Clean up per-session PythonWorkerFactory [spark] - posted by "kumbham (via GitHub)" <gi...@apache.org> on 2026/04/01 19:54:54 UTC, 0 replies.
- [PR] [SPARK-56327][PYTHON][TESTS] Fix grouped map pandas tests for pandas 3 [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/04/01 22:06:46 UTC, 3 replies.
- Re: [PR] [SPARK-55978][SQL] Add TABLESAMPLE SYSTEM block sampling with DSv2 pushdown [spark] - posted by "stanyao (via GitHub)" <gi...@apache.org> on 2026/04/01 22:36:44 UTC, 37 replies.
- [PR] [SPARK-55579][PYTHON][4.1] Rename PySpark error classes to be eval-type-agnostic [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/01 22:42:36 UTC, 2 replies.
- Re: [PR] [SPARK-56276] Fix file descriptor leak in SparkAppResourceSpecFactory [spark-kubernetes-operator] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/04/01 23:18:05 UTC, 2 replies.
- Re: [PR] [SPARK-56322][CONNECT][PYTHON] Fix TypeError when self-joining observed DataFrames [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/04/01 23:40:40 UTC, 13 replies.
- [PR] [SPARK-56275][K8S] Set appProtocol on spark-connect service port [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/04/01 23:48:58 UTC, 4 replies.
- [PR] [SPARK-56313][PYTHON][FOLLOWUP] Use old way to label generic for a class [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/02 00:05:42 UTC, 5 replies.
- Re: [PR] [SPARK-51731][Core][WIP] Introduce a new callback "onQueryExecutionStart" to StreamingQueryListener [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/02 00:40:37 UTC, 1 replies.
- Re: [PR] [SPARK-54415][SQL] CREATE GLOBAL TEMPORARY VIEW / TEMPORARY VIEW supports IF NOT EXISTS clause [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/02 00:40:39 UTC, 1 replies.
- Re: [PR] [SPARK-56190][SQL] Support nested partition columns for DSV2 PartitionPredicate [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/02 01:22:00 UTC, 1 replies.
- Re: [PR] [SPARK-55981][SQL] Allow Geo Types with SRID's from the pre-built registry [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/02 01:23:43 UTC, 1 replies.
- Re: [PR] [SPARK-56318][BUILD][4.0] Upgrade jackson to 2.18.6 [spark] - posted by "manuzhang (via GitHub)" <gi...@apache.org> on 2026/04/02 01:26:46 UTC, 5 replies.
- Re: [PR] [SPARK-56189][PYTHON] Refactor SQL_WINDOW_AGG_ARROW_UDF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/02 01:41:25 UTC, 9 replies.
- Re: [PR] [SPARK-56260][INFRA] Pin third-party GitHub Actions to commit SHA [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/02 01:52:59 UTC, 1 replies.
- [PR] [SPARK-56329][PYTHON] Unify the datatype check in python/pyspark/sql/pandas/types.py [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/02 02:02:23 UTC, 2 replies.
- Re: [PR] [SPARK-55657][BUILD] Bump Hadoop 3.5.0 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/04/02 02:13:44 UTC, 8 replies.
- Re: [PR] [SPARK-56251][SQL] Add default fetchSize for postgres to avoid loading all data in memory [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2026/04/02 02:30:46 UTC, 2 replies.
- [PR] Add TaskInterruptListener to TaskContext for interrupt notifications [spark] - posted by "sadikovi (via GitHub)" <gi...@apache.org> on 2026/04/02 03:40:51 UTC, 0 replies.
- [PR] Revert "[SPARK-56189][PYTHON] Refactor SQL_WINDOW_AGG_ARROW_UDF" [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/02 03:41:24 UTC, 2 replies.
- [PR] [SPARK-56304][SQL] Support IF NOT EXISTS for V2 file table INSERT OVERWRITE [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/02 05:34:31 UTC, 1 replies.
- Re: [PR] [SPARK-56243][SS] Throw detailed error on malformed Kafka record timestamps [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/04/02 06:14:13 UTC, 3 replies.
- [I] `spark.conf.get("non-existent-key", "my_default")` incorrectly raises AnalysisException [spark] - posted by "Julian-J-S (via GitHub)" <gi...@apache.org> on 2026/04/02 06:17:25 UTC, 0 replies.
- [PR] [SPARK-56331][UI] Truncate long node labels in SQL plan visualization [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/04/02 07:12:56 UTC, 9 replies.
- Re: [PR] [SPARK-54775][Core] Add logging for the execution steps of Spark shutdown hooks [spark] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2026/04/02 07:31:39 UTC, 1 replies.
- [PR] [SPARK-54938][PYTHON][TEST][FOLLOW-UP] Fix inferred time unit for pandas >= 3 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/02 08:02:54 UTC, 3 replies.
- [PR] [SPARK-56320] Introduce JIT compilation metrics [spark] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2026/04/02 08:26:19 UTC, 1 replies.
- [PR] temp [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2026/04/02 09:48:42 UTC, 2 replies.
- [PR] [TEST] debugging k8s-integration-test failures [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2026/04/02 10:12:03 UTC, 4 replies.
- [PR] [SPARK-56332][SQL][TESTS] Use `sql.SparkSession` in `trait SQLTestData` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/02 11:52:49 UTC, 15 replies.
- [PR] [SPARK-56333][SQL] Use multiset intersection for NATURAL JOIN column matching [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2026/04/02 12:58:39 UTC, 6 replies.
- Re: [PR] [SPARK-56030] [SQL] Normalize inner Project when below Project -> Filter [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/04/02 13:33:52 UTC, 8 replies.
- [PR] [SPARK-48275][SQL] Improve array_sort default comparator documentation [spark] - posted by "maoli67660 (via GitHub)" <gi...@apache.org> on 2026/04/02 13:55:40 UTC, 0 replies.
- Re: [PR] [SPARK-55109][SQL] Enhance RaiseError to generate valid SQL [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/02 15:39:32 UTC, 5 replies.
- [PR] [WIP][SPARK-56284] Adding UDF worker specification protobuf definition [spark] - posted by "sven-weber-db (via GitHub)" <gi...@apache.org> on 2026/04/02 16:21:39 UTC, 0 replies.
- [PR] [SPARK-56326] Include streaming query and batch ids in scheduling logs [spark] - posted by "BrooksWalls (via GitHub)" <gi...@apache.org> on 2026/04/02 16:51:17 UTC, 1 replies.
- Re: [PR] [SPARK-56321][SQL] Fix `AnalysisException` when scan reports transform-based ordering via `SupportsReportOrdering` [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/04/02 17:03:20 UTC, 2 replies.
- [PR] [SPARK-56321][SQL][3.5] Fix `AnalysisException` when scan reports transform-based ordering via `SupportsReportOrdering` [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/04/02 17:55:18 UTC, 3 replies.
- Re: [PR] [SPARK-56273][SQL] Simplify extracting fields from DataSourceV2ScanRelation [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/04/02 18:05:55 UTC, 13 replies.
- [PR] [SPARK-56338][INFRA] Support Maven mirrors for build [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/02 19:19:32 UTC, 2 replies.
- Re: [PR] [SPARK-56277][SQL] Add missing toString() to NamespaceChange and TableChange property classes [spark] - posted by "anshulbaliga7 (via GitHub)" <gi...@apache.org> on 2026/04/02 19:23:16 UTC, 3 replies.
- Re: [I] `spark.conf.get("non-existent-key", "my_default")` incorrectly raises AnalysisException (pyspark) [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/02 19:24:38 UTC, 3 replies.
- [PR] [SPARK-55579][PYTHON][4.0] Rename PySpark error classes to be eval-type-agnostic [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/02 21:15:44 UTC, 2 replies.
- Re: [PR] [SPARK-56280][SS] normalize NaN and +/-0.0 in streaming dedupe node [spark] - posted by "richardc-db (via GitHub)" <gi...@apache.org> on 2026/04/02 21:29:34 UTC, 2 replies.
- [PR] [SPARK-56340] Move input_type schema to eval conf [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/02 21:31:47 UTC, 0 replies.
- [PR] [SPARK-56313][PYTHON][FOLLOWUP] Remove rddsampler from mypy exception list [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/02 21:41:32 UTC, 2 replies.
- [PR] [SPARK-56341][PYTHON][DOCS] Fix outdated PyArrow minimum version in arrow_pandas.rst [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/02 21:51:46 UTC, 5 replies.
- [PR] [SPARK-56343][SQL][TESTS] Add MERGE INTO schema evolution tests for cross-column assignment with type mismatch [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/04/02 22:02:43 UTC, 0 replies.
- [PR] [SPARK-56339][SQL] Fix BatchScanExec canonicalization to enable ReuseSubquery for DSv2 scans [spark] - posted by "vitaliili-db (via GitHub)" <gi...@apache.org> on 2026/04/02 22:16:57 UTC, 4 replies.
- [PR] [SPARK-56345][PYTHON][TESTS] Use `pd.Series.__name__` in Arrow UDF type-hint test [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/04/02 22:18:52 UTC, 3 replies.
- [PR] [SPARK-56344][PYTHON][DOCS] Fix outdated PyArrow minimum version in arrow_pandas.rst [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/02 22:22:59 UTC, 0 replies.
- [PR] [SPARK-49793][PYTHON][TESTS][FOLLOWUP] Fix test_caching in connect mode [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/02 22:28:37 UTC, 0 replies.
- Re: [PR] [SPARK-56344][PYTHON][DOCS][4.1] Fix outdated PyArrow minimum version in arrow_pandas.rst [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/02 22:31:55 UTC, 2 replies.
- [PR] [SPARK-56342][PYTHON] Tighten type hints for refactored eval type functions in worker.py [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/02 22:33:15 UTC, 5 replies.
- Re: [PR] [SPARK-56329][PYTHON] Fix all E721 type comparison violations [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/02 23:57:36 UTC, 2 replies.
- [PR] [SPARK-56346][SQL] Use PartitionPredicate in DSV2 Metadata Only Delete [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/04/02 23:59:04 UTC, 12 replies.
- Re: [PR] [SPARK-54823] Add SupportsUpdateV2 and UpdateTableExec [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/03 00:43:04 UTC, 1 replies.
- Re: [PR] [SPARK-56216][SS] Integrate checkpoint V2 with auto-repair snapshot [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2026/04/03 04:57:26 UTC, 12 replies.
- [PR] [MINOR][PYTHON] Fix PySparkException failing when messageParameters i… [spark] - posted by "fangchenli (via GitHub)" <gi...@apache.org> on 2026/04/03 06:07:59 UTC, 0 replies.
- Re: [PR] [SPARK-55902][PYTHON] Refactor SQL_ARROW_BATCHED_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/03 06:43:11 UTC, 2 replies.
- Re: [PR] [SPARK-55715][SQL] Keep `outputOrdering` when `GroupPartitionsExec` coalesces partitions [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/04/03 08:07:34 UTC, 29 replies.
- [PR] [SPARK][TEST] Fix TOCTOU race in DockerJDBCIntegrationSuite port allocation [spark] - posted by "vladanvasi-db (via GitHub)" <gi...@apache.org> on 2026/04/03 08:21:24 UTC, 0 replies.
- [PR] [SPARK-55969][SQL][3.5][FOLLOW-UP][TESTS] Update `SQLQueryTestSuite` golden files [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/04/03 09:32:40 UTC, 7 replies.
- Re: [PR] [SPARK-46741][SQL] Cache Table with CTE won't work [spark] - posted by "MEDSMEDS (via GitHub)" <gi...@apache.org> on 2026/04/03 09:56:28 UTC, 0 replies.
- Re: [PR] [SPARK-56275] Set appProtocol on spark-connect service port [spark-kubernetes-operator] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/04/03 12:57:45 UTC, 2 replies.
- Re: [PR] [SPARK-56328][SQL] Fix inline table collation handling for INSERT VALUES and DEFAULT COLLATION [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/03 13:46:08 UTC, 6 replies.
- Re: [PR] [SPARK-55330][K8S] Make spark.kubernetes.legacy.useReadWriteOnceAccessMode a public config [spark] - posted by "nitrajen (via GitHub)" <gi...@apache.org> on 2026/04/03 15:30:03 UTC, 0 replies.
- Re: [PR] [SPARK-56347][TEST] Fix TOCTOU race in DockerJDBCIntegrationSuite port allocation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/03 15:39:41 UTC, 1 replies.
- [PR] [SPARK-56348][PYTHON] Remove unused ArrowBatchUDFSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/03 15:59:00 UTC, 2 replies.
- [PR] [SPARK-56349][PYTHON] Remove unused ArrowStreamAggArrowUDFSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/03 16:11:53 UTC, 2 replies.
- [I] Webpage for downloading binaries is broken [spark] - posted by "albertoandreottiATgmail (via GitHub)" <gi...@apache.org> on 2026/04/03 16:53:17 UTC, 2 replies.
- [PR] Test fix maven daily test failed [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/03 17:41:21 UTC, 1 replies.
- Re: [PR] [SPARK-56209][BUILD][FOLLOWUP] Exclude Netty transitive dependencies from Vert.x in Kubernetes modules [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/03 17:44:50 UTC, 2 replies.
- Re: [PR] [SPARK-56207][SQL] Replace legacy error codes with named errors in DSv2 connector API [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/04/03 17:57:34 UTC, 5 replies.
- [PR] [SPARK-55667][PYTHON][CONNECT][FOLLOWUP] Remove arguments in check_dependencies [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/03 22:50:29 UTC, 0 replies.
- [PR] [SPARK-56157][CORE] Support limitActiveProcessorCount in standalone mode [spark] - posted by "jzhuge (via GitHub)" <gi...@apache.org> on 2026/04/04 00:07:37 UTC, 1 replies.
- Re: [PR] [SPARK-54836][SQL] Include timestamp value in ArithmeticException for timestamp overflow errors [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/04 00:39:59 UTC, 1 replies.
- Re: [PR] [SPARK-54831][SQL] Add COMMENT ON COLUMN support to set and remove column comments [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/04 00:40:06 UTC, 1 replies.
- Re: [PR] [PYTHON] Add intersectByKey method to RDD [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/04 00:40:10 UTC, 1 replies.
- Re: [PR] [SPARK-55450][SS][PYTHON][DOCS] Document admission control in PySpark streaming data sources [spark] - posted by "jiteshsoni (via GitHub)" <gi...@apache.org> on 2026/04/04 00:40:59 UTC, 9 replies.
- [PR] [SPARK-56353][BUILD][TESTS] Generate Java-based test JARs dynamically instead of storing pre-built binaries [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/04/04 06:01:14 UTC, 7 replies.
- [PR] [SPARK-56354][WEBUI] Lazy-load vis-timeline resources only on pages that use timeline views [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/04/04 07:36:04 UTC, 4 replies.
- [PR] Test sb 1.12.8 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/04 08:42:36 UTC, 0 replies.
- [PR] [SPARK-56355][SQL] Improve join stats estimation when equi-join keys lack column statistics [spark] - posted by "wecharyu (via GitHub)" <gi...@apache.org> on 2026/04/04 11:23:35 UTC, 4 replies.
- [PR] [SPARK-55242][PYSPARK] Handle np.ndarray elements in list-valued columns when converting from pandas [spark] - posted by "azmatsiddique (via GitHub)" <gi...@apache.org> on 2026/04/04 11:42:16 UTC, 3 replies.
- [PR] [WIP][HUMAN-REVIEW-NEEDED] Better error on stream-stream join NPE [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/04/04 12:22:40 UTC, 1 replies.
- [PR] [SPARK-56356][BUILD] Fix an issue in release build caused by error on fetching artifacts [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/04/04 13:52:43 UTC, 2 replies.
- Re: [PR] [SPARK-54832][UI] Spark executor page show driver gc times [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/05 00:45:40 UTC, 1 replies.
- Re: [PR] [MINOR] Raise exception if no active Spark context [spark] - posted by "Shrividya (via GitHub)" <gi...@apache.org> on 2026/04/05 02:13:33 UTC, 0 replies.
- Re: [PR] [SPARK-56007][CONNECT] Fix ArrowDeserializer to use positional binding for rows [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/04/05 05:31:12 UTC, 1 replies.
- Re: [PR] [SPARK-55665][PYTHON] Unify how workers establish connection with the executor [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/04/05 05:33:12 UTC, 0 replies.
- [PR] [SPARK-53759][PYTHON][4.1] Fix missing flush in simple-worker path [spark] - posted by "anblanco (via GitHub)" <gi...@apache.org> on 2026/04/05 05:36:31 UTC, 23 replies.
- [PR] [FEAT] Add Dtypes method to DataFrame [spark-connect-go] - posted by "piyushka-ally (via GitHub)" <gi...@apache.org> on 2026/04/05 10:44:34 UTC, 0 replies.
- Re: [I] Add Support for Additional DataFrame Functionality [spark-connect-go] - posted by "piyushka-ally (via GitHub)" <gi...@apache.org> on 2026/04/05 10:45:46 UTC, 0 replies.
- [I] [PYTHON] Allow `PathLike` path objects as input to `readwriter` [spark] - posted by "Ivernoerve (via GitHub)" <gi...@apache.org> on 2026/04/05 11:41:38 UTC, 3 replies.
- [PR] [SPARK-56358][BUILD] Add gson version override to SBT build to align with Maven [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/05 12:18:12 UTC, 5 replies.
- [PR] [MINOR][DOCS][FOLLOWUP] Document supported SRIDs in geospatial types [spark] - posted by "pratham76 (via GitHub)" <gi...@apache.org> on 2026/04/05 16:00:32 UTC, 6 replies.
- Re: [PR] [SPARK-56286][PYTHON] Add DataFrame.dataQuality API for column profiling [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/04/05 22:21:45 UTC, 0 replies.
- Re: [PR] [MINOR][DOCS] Fix a typo of "KLL" initialism. [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/04/05 22:35:38 UTC, 1 replies.
- Re: [PR] [SPARK-56317][SQL] GetJsonObjectEvaluator should reuse output buffer [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/04/05 22:45:18 UTC, 1 replies.
- Re: [PR] [SPARK-49793][PYTHON][TESTS][FOLLOW-UP] Fix test_caching in connect mode [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/04/05 22:53:34 UTC, 1 replies.
- Re: [PR] [MINOR][PYTHON] Fix PySparkException failing when messageParameters is omitted [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/04/05 22:55:18 UTC, 1 replies.
- Re: [PR] [SPARK-55667][PYTHON][CONNECT][FOLLOW-UP] Remove arguments in check_dependencies [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/04/05 22:57:06 UTC, 1 replies.
- Re: [PR] [SPARK-55242][PYTHON] Handle np.ndarray elements in list-valued columns when converting from pandas [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/04/05 23:00:03 UTC, 11 replies.
- Re: [PR] [SPARK-54841][SQL] Make EstimationUtils#numBinsHoldingRange more accurate [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/06 00:45:00 UTC, 1 replies.
- [PR] [SPARK-55115][INFRA][FOLLOW-UP] Fix release workflow log tailing for base Docker image build [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/04/06 01:40:04 UTC, 4 replies.
- Re: [PR] [SPARK-56092][SS][CONNECT] Fix NPE in StreamingQueryException.toString() when cause is null [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/04/06 02:02:20 UTC, 11 replies.
- [PR] [SPARK-56359][PYTHON] Remove unused ArrowStreamArrowUDFSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/06 02:31:35 UTC, 2 replies.
- [PR] [SPARK-56360][INFRA] Wait for base and RM Docker logs in release workflow; avoid hang on early failure [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/04/06 03:28:39 UTC, 2 replies.
- Re: [I] [PYTHON] Support path-based table reference in `DataFrame.mergeInto` [spark] - posted by "simolanayak (via GitHub)" <gi...@apache.org> on 2026/04/06 05:35:19 UTC, 0 replies.
- [PR] [SPARK-56361][SS] Provide better error with logging on NPE in stream-stream join [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/04/06 05:47:35 UTC, 2 replies.
- [PR] [SPARK-56351][PYTHON][DOCS] Add dedicated documentation page for Arrow Python UDFs [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/06 05:54:28 UTC, 16 replies.
- [PR] [SPARK-55330][INFRA] Add cmake to release Docker base image [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/04/06 06:24:07 UTC, 3 replies.
- [PR] Add remotes in Spark release image [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/04/06 06:55:05 UTC, 0 replies.
- Re: [PR] [SPARK-56363][INFRA] Add remotes in Spark release image [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/04/06 07:02:25 UTC, 2 replies.
- Re: [PR] [SPARK-56330][CORE] Add TaskInterruptListener to TaskContext for interrupt notifications [spark] - posted by "sadikovi (via GitHub)" <gi...@apache.org> on 2026/04/06 08:49:40 UTC, 8 replies.
- Re: [PR] [SPARK-56357][BUILD] Upgrade sbt to 1.12.8 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/04/06 08:49:43 UTC, 6 replies.
- [PR] [SPARK-56364][BUILD][TESTS] Generate Scala-based test JARs dynamically instead of storing pre-built binaries [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/04/06 11:38:07 UTC, 7 replies.
- Re: [PR] [SPARK-31561][SQL] Add QUALIFY Clause [spark] - posted by "xiaoxuandev (via GitHub)" <gi...@apache.org> on 2026/04/06 18:18:53 UTC, 25 replies.
- Re: [PR] [SPARK-56340][PYTHON] Move input_type schema to eval conf [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/06 18:22:42 UTC, 2 replies.
- Re: [PR] [SPARK-56248][PYTHON][SS] Optimize python stateful processor serialization to skip unnecessary list/dict/row construction. [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/04/06 20:11:00 UTC, 1 replies.
- [PR] [MINOR] [CORE] [TESTS] Fix flaky DAGSchedulerSuite test for push-based shuffle [spark] - posted by "dbtsai (via GitHub)" <gi...@apache.org> on 2026/04/06 21:22:15 UTC, 1 replies.
- Re: [PR] [SPARK-56326][SS] Include streaming query and batch ids in scheduling logs [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/04/06 22:01:36 UTC, 22 replies.
- [PR] [SPARK-55608][PYTHON] Refactor SQL_GROUPED_MAP_ARROW_UDF and SQL_GROUPED_MAP_ARROW_ITER_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/06 22:58:46 UTC, 10 replies.
- [PR] [SPARK-53759][PYTHON] Add SimpleWorkerTests for non-daemon worker path [spark] - posted by "anblanco (via GitHub)" <gi...@apache.org> on 2026/04/06 23:24:27 UTC, 2 replies.
- [PR] [SPARK-53759][PYTHON][4.0] Fix missing close in simple-worker path [spark] - posted by "anblanco (via GitHub)" <gi...@apache.org> on 2026/04/07 00:22:59 UTC, 4 replies.
- [PR] [SPARK-53759][PYTHON][3.5] Fix missing close in simple-worker path [spark] - posted by "anblanco (via GitHub)" <gi...@apache.org> on 2026/04/07 00:23:11 UTC, 2 replies.
- Re: [PR] [SPARK-54321] Add Kafka 4.x Share Groups support for Structured Strea… [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/07 00:43:58 UTC, 1 replies.
- [PR] [SPARK-56369][SS] Introduce a new API "scan/scanWithMultiValues" in StateStore [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/04/07 05:38:18 UTC, 2 replies.
- [PR] [SPARK-56367][SS][PYTHON][DOCS] Fix latestOffset docstring and tutorial to use correct field name and signature [spark] - posted by "jiteshsoni (via GitHub)" <gi...@apache.org> on 2026/04/07 05:57:23 UTC, 2 replies.
- [PR] [SPARK-56368] Make the number of rows per custom metrics update configurable [spark] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2026/04/07 06:35:50 UTC, 0 replies.
- [PR] [SPARK-56231][SQL] Bucket pruning and bucket join optimization for V2 file read path [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/07 06:41:06 UTC, 1 replies.
- [PR] [SPARK-56370] Optimize Platform.copyMemory with a fast path for small copies [spark] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2026/04/07 06:46:43 UTC, 9 replies.
- Re: [PR] [SPARK-56013][SPARK-56024][BUILD] Upgrade `jaxb-runtime` from 4.0.5 to 4.0.6 and `jakarta.xml.bind-api` from 4.0.2 to 4.0.5 [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2026/04/07 06:56:24 UTC, 2 replies.
- [PR] [SPARK-56232][SQL][SS] V2 streaming read for FileTable (MICRO_BATCH_READ) [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/07 06:59:24 UTC, 1 replies.
- [PR] [SPARK-56233][SQL][SS] V2 streaming write for FileTable (STREAMING_WRITE) [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/07 07:03:11 UTC, 1 replies.
- [PR] [SPARK-56372][INFRA] Add cmake to CI Docker images for R fs package compilation [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/07 09:08:34 UTC, 5 replies.
- [PR] [SPARK-56373][PYSPARK] Add docstring annotations to classify PySpark APIs for Spark Connect compatibility [spark] - posted by "garlandz-db (via GitHub)" <gi...@apache.org> on 2026/04/07 09:18:10 UTC, 0 replies.
- [I] KLL_INVALID_INPUT_SKETCH_BUFFER error when empty KLL sketch is read [spark] - posted by "code-mc (via GitHub)" <gi...@apache.org> on 2026/04/07 09:53:06 UTC, 2 replies.
- [I] NullPointerException in KafkaMicroBatchStream.metrics when latestPartitionOffsets is uninitialized [spark] - posted by "lnagel (via GitHub)" <gi...@apache.org> on 2026/04/07 11:13:48 UTC, 1 replies.
- Re: [PR] [SPARK-55890] Check arrow memory at end of tests [spark] - posted by "garlandz-db (via GitHub)" <gi...@apache.org> on 2026/04/07 13:36:37 UTC, 2 replies.
- Re: [PR] [SPARK-56284] Adding UDF worker specification protobuf definition [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/07 14:20:06 UTC, 24 replies.
- [PR] Operator Helm Chart: suppot additionalContainers, volumes, volumeMoun… [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2026/04/07 15:17:46 UTC, 0 replies.
- [PR] Remove Java 17 support [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2026/04/07 15:21:41 UTC, 0 replies.
- [PR] [SPARK-56338][INFRA] Support MAVEN_MIRROR_URL in SBT launcher bootstrap [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/07 16:14:46 UTC, 0 replies.
- Re: [PR] [SPARK-56338][INFRA][FOLLOWUP] Support MAVEN_MIRROR_URL in SBT launcher bootstrap [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/07 16:16:05 UTC, 5 replies.
- [PR] [SPARK-56054][SQL] Add test for MERGE INTO schema evolution with aliased assignments [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2026/04/07 16:58:53 UTC, 7 replies.
- [PR] [SPARK-55278] Add shading rule for udf/worker protobuf as for core and connect. [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2026/04/07 17:18:19 UTC, 0 replies.
- Re: [PR] [SPARK-56366] Update `README.md` by removing `17` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/07 17:27:08 UTC, 1 replies.
- Re: [PR] [SPARK-54731][SQL] Fix Reverse expression to handle BinaryType by performing raw byte-level reversal [spark] - posted by "xiaoxuandev (via GitHub)" <gi...@apache.org> on 2026/04/07 17:31:56 UTC, 3 replies.
- Re: [PR] [SPARK-53640] Operator Helm Chart: support additionalContainers, volumes, volumeMounts as array [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/07 18:02:26 UTC, 1 replies.
- Re: [I] Cannot use deploy mode: cluster from python code. [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/07 18:30:58 UTC, 1 replies.
- Re: [PR] [SPARK-55278] Add shading rule for udf/worker protobuf as for core and connect [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/07 19:02:05 UTC, 2 replies.
- [PR] [SPARK-56377][PYTHON] Add type hint for shuffle.py [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/07 19:07:45 UTC, 4 replies.
- [PR] [MINOR] Add PR description guidelines to AGENTS.md [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/04/07 19:08:52 UTC, 0 replies.
- Re: [PR] [SPARK-56378] Add PR description guidelines to AGENTS.md [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/04/07 19:17:09 UTC, 4 replies.
- [PR] [SPARK-56379] Upgrade `Hadoop` to 3.5.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/07 19:20:41 UTC, 3 replies.
- [PR] [SPARK-56375][PS] Implement DataFrame.set_axis and Series.set_axis [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/04/07 19:33:04 UTC, 0 replies.
- [PR] [SPARK-56380] Use `4.2.0-preview4` RC1 for Spark 4.2 integration tests [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/07 19:33:40 UTC, 3 replies.
- Re: [PR] [SPARK-46161][PS] Add axis=1 support for DataFrame.diff [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/04/07 19:59:30 UTC, 0 replies.
- [PR] [SPARK-56381][PYTHON][TEST] Add ASV microbenchmark for SQL_COGROUPED_MAP_ARROW_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/07 20:08:34 UTC, 3 replies.
- [PR] [SPARK-56382][INFRA] Add cmake for 'fs' package of R [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/07 20:57:09 UTC, 2 replies.
- [I] Build base image CI is failing because of 'fs' package of R [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/07 20:59:44 UTC, 4 replies.
- [PR] Avoid throwing away resolved child when constructing V1 command variants of ShowColumns and DescribeRelation [spark] - posted by "dhruvarya-db (via GitHub)" <gi...@apache.org> on 2026/04/07 21:54:35 UTC, 0 replies.
- [PR] [SPARK-56383][SQL] Add tests for partition filter extraction from mixed predicates [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/04/07 22:05:21 UTC, 0 replies.
- [PR] [SPARK-56384][SS] Support stream-stream non-outer join in Update mode [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/04/07 22:20:10 UTC, 34 replies.
- [PR] [WIP][NEED-HUMAN-REVIEW] Support Multiple Stateful Operators in Update Mode [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/04/07 22:26:11 UTC, 1 replies.
- Re: [PR] [SPARK-55769][UI] Replace browser alert() with Bootstrap 5 Toast notifications [spark] - posted by "chenyuan99 (via GitHub)" <gi...@apache.org> on 2026/04/07 23:12:38 UTC, 0 replies.
- [PR] Refactor ProfileResults to a dict of dict [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/07 23:49:30 UTC, 0 replies.
- [PR] [SPARK-56385][SQL] Track pushed filter expressions on DataSourceV2ScanRelation [spark] - posted by "yyanyy (via GitHub)" <gi...@apache.org> on 2026/04/08 01:22:16 UTC, 14 replies.
- Re: [PR] [SPARK-54774][CORE] Submit failed should keep same exit code with app exit code in K8s mode [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2026/04/08 02:04:42 UTC, 3 replies.
- Re: [PR] [SPARK-54651][CORE] Driver should delete temporary files when exiting during commit process [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2026/04/08 02:05:27 UTC, 0 replies.
- [I] Spark 4.0.0 Hadoop 3.4.1 client JARs incompatible with Hive Metastore 3.1.x [spark] - posted by "mrhaoqi (via GitHub)" <gi...@apache.org> on 2026/04/08 02:31:31 UTC, 2 replies.
- Re: [PR] [SPARK-56369][SS] Introduce a new API "rangeScan/rangeScanWithMultiValues" in StateStore [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2026/04/08 04:26:56 UTC, 10 replies.
- [PR] Bump addressable from 2.8.7 to 2.9.0 in /docs [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/04/08 04:30:11 UTC, 2 replies.
- Re: [PR] [SPARK-56390][SQL] Avoid throwing away resolved child when constructing V1 command variants of ShowColumns and DescribeRelation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/08 06:53:07 UTC, 6 replies.
- [PR] [SPARK-56391] [SQL] Support unwrap string type to date type in UnwrapCastInBinaryComparison [spark] - posted by "daijy (via GitHub)" <gi...@apache.org> on 2026/04/08 06:57:51 UTC, 1 replies.
- Re: [PR] [SPARK-56147][SQL] `spark-sql` cli correctly handles SQL Scripting compound blocks [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/08 09:40:29 UTC, 4 replies.
- Re: [PR] [SPARK-56328][SQL][FOLLOWUP] Handle SubqueryAlias-wrapped inline tables in INSERT VALUES collation fix [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/08 11:45:52 UTC, 1 replies.
- [PR] Implement `SET` command in single-pass analyzer [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2026/04/08 12:50:29 UTC, 0 replies.
- [PR] [SPARK-56392][SQL] Make Sample.seed Optional to distinguish user-specified vs random seeds [spark] - posted by "rahulketch (via GitHub)" <gi...@apache.org> on 2026/04/08 13:09:18 UTC, 2 replies.
- Re: [PR] [SPARK-55278][FOLLOWUP] Add shading rule for udf/worker protobuf as for core and connect [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/08 13:09:53 UTC, 1 replies.
- [PR] [SPARK-56388][CONNECT] Add XML support to Spark Connect Parse protocol [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2026/04/08 14:29:59 UTC, 0 replies.
- [PR] [SPARK-56393] Drop K8s v1.33 Support [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/08 16:53:41 UTC, 0 replies.
- Re: [PR] [SPARK-56221][SQL][PYTHON][FOLLOWUP] Rename TablePartition and remove SHOW CACHED TABLES / listCachedTables [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/08 16:59:48 UTC, 2 replies.
- [PR] [SPARK-56394] Upgrade the minimum K8s version to v1.34 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/08 17:02:22 UTC, 4 replies.
- Re: [PR] [SPARK-56393][K8S][DOCS] Drop K8s v1.33 Support [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/08 17:11:52 UTC, 3 replies.
- Re: [PR] [SPARK-56387][PYTHON] Refactor ProfileResults to a dict of dict [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/08 17:56:43 UTC, 3 replies.
- [PR] [SPARK-56396] Support `dependencyUpdates` Gradle task [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/08 18:51:29 UTC, 4 replies.
- [PR] [SPARK-56397] Upgrade `ICU4J` to 78.3 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/08 18:55:39 UTC, 0 replies.
- Re: [PR] [SPARK-56350][SQL] Skip ColumnarToRow for Arrow-backed input to Python UDFs [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/04/08 19:26:28 UTC, 10 replies.
- Re: [PR] [SPARK-39660][SQL] Support v2 DESCRIBE TABLE .. PARTITION [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/08 19:36:56 UTC, 19 replies.
- Re: [PR] [SPARK-56399][PYTHON] Add SimpleWorkerTests for non-daemon worker path [spark] - posted by "anblanco (via GitHub)" <gi...@apache.org> on 2026/04/08 20:08:10 UTC, 3 replies.
- [PR] [SPARK-56401] Use `setup-gradle` GitHub Actions in CIs [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/08 21:18:29 UTC, 3 replies.
- Re: [PR] [SPARK-48275][SQL][DOCS] Improve array_sort default comparator documentation [spark] - posted by "maoli67660 (via GitHub)" <gi...@apache.org> on 2026/04/08 21:20:40 UTC, 0 replies.
- [PR] [SPARK-56400][SS] Apply rangeScan API in transformWithState Timer/TTL [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/04/08 21:23:16 UTC, 17 replies.
- [PR] [SPARK-56403] Refactor kafka test so it's skipped when dependency is not available [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/08 22:14:50 UTC, 11 replies.
- Re: [PR] [SPARK-56343][SQL][TESTS] Add MERGE INTO test for type mismatch without schema evolution trigger condition [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/04/08 22:30:10 UTC, 0 replies.
- Re: [PR] [SPARK-56397][BUILD] Upgrade `ICU4J` to 78.3 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/09 00:33:03 UTC, 1 replies.
- Re: [PR] [SPARK-33737][K8S] Support getting pod state using Informers + Listers [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/09 00:36:41 UTC, 1 replies.
- [PR] [SPARK-56405] Enable `Gradle` configuration cache [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/09 01:07:33 UTC, 3 replies.
- [PR] [SPARK-56402][SS] Apply rangeScan API in stream-stream join format version 4 [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/04/09 02:05:44 UTC, 19 replies.
- [PR] update [spark] - posted by "sadikovi (via GitHub)" <gi...@apache.org> on 2026/04/09 02:57:13 UTC, 0 replies.
- Re: [PR] [SPARK-56019][SQL] Close JDBC connection on task kill to unblock native socket reads [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/09 03:12:29 UTC, 3 replies.
- Re: [PR] [SPARK-55324][PYTHON] Make convert_numpy support ArrayType [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/09 03:29:16 UTC, 1 replies.
- Re: [PR] [SPARK-55748][SQL] Use `DSv2` for `avro|csv|json|kafka|orc|parquet|text` by default [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/09 03:34:09 UTC, 3 replies.
- [PR] [SPARK-55910][SQL][TESTS] Merge `SQLTestUtils` into `QueryTest` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/09 03:56:17 UTC, 1 replies.
- [PR] [SPARK-XXXXX][PYTHON][TESTS] Skip Kafka streaming RTM tests when dependencies are not installed [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/09 04:32:17 UTC, 0 replies.
- [PR] [SPARK-56406][SS] Stream-stream join v4: skip writing secondary index if the operator will not evict from that side [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/04/09 04:53:43 UTC, 7 replies.
- Re: [PR] [SPARK-55306][PYTHON][TESTS][FOLLOW-UP] Skip Kafka streaming RTM tests when dependencies are not installed [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/04/09 04:59:37 UTC, 6 replies.
- [PR] [SPARK-56407][BUILD][TESTS] Remove pre-built class files and JARs used in artifact transfer tests [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/04/09 05:30:04 UTC, 5 replies.
- [PR] [SPARK-56408] Introduce `OwnerResourceDecorator` and use it instead `(Driver|Cluster)Decorator` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/09 06:02:18 UTC, 3 replies.
- [PR] [SPARK-56409] Consolidate `Netty` exclusions into root `build.gradle` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/09 06:10:29 UTC, 3 replies.
- [PR] [SQL] Add ParquetFormatVersion enum and writer version option [spark] - posted by "divjotarora (via GitHub)" <gi...@apache.org> on 2026/04/09 07:05:48 UTC, 1 replies.
- [PR] [SPARK-56255][PYTHON][CONNECT] Make spark.read.csv accept DataFrame input [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/09 07:07:53 UTC, 8 replies.
- [PR] [WIP][SPARK-56410][SQL][CORE] Add bounded k-way merge support in UnsafeExternalSorter to reduce OOM risk [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2026/04/09 07:37:28 UTC, 0 replies.
- [I] Document how SDP datasets are stored and refreshed [spark] - posted by "moomindani (via GitHub)" <gi...@apache.org> on 2026/04/09 08:06:37 UTC, 2 replies.
- [PR] [SPARK-55276][DOCS] Document how SDP datasets are stored and refreshed [spark] - posted by "moomindani (via GitHub)" <gi...@apache.org> on 2026/04/09 08:07:13 UTC, 0 replies.
- Re: [PR] [SPARK-56175][SQL] FileTable implements SupportsPartitionManagement and V2 catalog table loading [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/09 09:30:27 UTC, 0 replies.
- Re: [PR] [SPARK-56372][INFRA][4.0] Add cmake to CI Docker images for R fs package compilation [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/09 10:01:34 UTC, 1 replies.
- [PR] [WIP][SQL][DML] DSv2 Transaction API [spark] - posted by "andreaschat-db (via GitHub)" <gi...@apache.org> on 2026/04/09 12:08:43 UTC, 0 replies.
- [PR] [PROTOTYPE][DO_NOT_MERGE] Streaming write schema evolution [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2026/04/09 13:29:01 UTC, 0 replies.
- [PR] [SPARK-xxxx][SQL] Per-write options should take precedence over session config in Parquet and Avro [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/09 13:51:01 UTC, 0 replies.
- [PR] [SPARK-56415][INFRA] Simplify create_spark_jira.py for LLM-driven JIRA ticket creation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/09 14:18:53 UTC, 7 replies.
- [PR] [SPARK-56417] Consolidate Lombok and JUnitPlatform configurations into root `build.gradle` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/09 16:42:41 UTC, 0 replies.
- Re: [PR] [SPARK-55939][SQL] Add built-in DataSketches ItemsSketch (Frequent Items) functions [spark] - posted by "xiongbo-sjtu (via GitHub)" <gi...@apache.org> on 2026/04/09 16:47:36 UTC, 0 replies.
- [PR] [SPARK-56418] Unify `getOrCreateLocalFileFor(Driver|Executor)Spec` to `getOrCreateLocalFileForSpec` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/09 16:51:25 UTC, 4 replies.
- Re: [PR] [SPARK-56417] Consolidate `Lombok` and `JUnitPlatform` configurations into root `build.gradle` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/09 16:57:30 UTC, 3 replies.
- [PR] [SPARK-56365] Remove hard-coded `APP_VERSION` from Dockerfile [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/09 17:10:56 UTC, 4 replies.
- Re: [PR] [SPARK-56065][SQL] Add AQE fallback from failed broadcast joins to shuffle joins [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/04/09 17:39:23 UTC, 12 replies.
- [PR] [SPARK-56419] Use consistent `CaseInsensitiveDictionary` initialization style [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/09 17:44:56 UTC, 3 replies.
- [PR] [SPARK-56420] Introduce `toExpression` method to deduplicate literal conversions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/09 17:49:15 UTC, 3 replies.
- [PR] [SPARK-56421] Introduce `IntervalType` protocol for `(DayTime|YearMonth)Interval` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/09 18:22:49 UTC, 3 replies.
- [PR] [SPARK-56422] Introduce `createPlan` method to deduplicate `Plan` creation pattern [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/09 18:30:03 UTC, 4 replies.
- [PR] [SPARK-56423] Remove manual `Equatable` implementation from `StorageLevel` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/09 18:40:31 UTC, 4 replies.
- [PR] [SPARK-56425] Split `DataFrame.swift` into extension-based files [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/09 19:03:49 UTC, 3 replies.
- [PR] [SPARK-56426][SQL] Fix LATERAL VIEW column alias with dot in name [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/04/09 20:23:08 UTC, 2 replies.
- [PR] [SPARK-56427][PYTHON][INFRA] Remove six and py from requirements.txt [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/09 20:24:46 UTC, 2 replies.
- [PR] [SPARK-56428][PYTHON] Move eval type specific data to eval_conf for UDTF [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/09 21:18:18 UTC, 2 replies.
- Re: [PR] [SPARK-56372][INFRA][4.1] Add cmake to CI Docker images for R fs package compilation [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/10 00:22:43 UTC, 1 replies.
- Re: [PR] [SPARK-50186][CORE] Clarify executor OutOfMemoryError handling docs [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/10 00:44:15 UTC, 1 replies.
- [PR] [SPARK-52709][SQL] Fix parsing of STRUCT<> [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/04/10 00:57:30 UTC, 5 replies.
- Re: [PR] [SPARK-52709][SQL] Fix parsing of STRUCT<> [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/04/10 00:57:42 UTC, 0 replies.
- [PR] [SPARK-56430][PYTHON] Remove unnecessary .keys() in dict iterations [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/10 07:11:51 UTC, 1 replies.
- [PR] [SPARK-56411][SQL] SPARK-56411: Register Decimal in KryoSerializer so cached-batch spill works [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/10 11:53:04 UTC, 1 replies.
- Re: [PR] [SPARK-56411][SQL] Register Decimal in KryoSerializer so cached-batch spill works [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/10 12:06:41 UTC, 3 replies.
- [PR] [SPARK-56431][SQL] Fix NPE in FilterExec CSE when notNull columns are null before short-circuit [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/10 12:09:39 UTC, 2 replies.
- Re: [PR] [SPARK-55959][SQL] Optimize Map Key Lookup for `GetMapValue` and `ElementAt` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/10 12:18:30 UTC, 11 replies.
- Re: [PR] [SPARK-56171][SQL] Enable V2 file write path for non-partitioned DataFrame API writes and delete `FallBackFileSourceV2` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/10 12:23:48 UTC, 9 replies.
- Re: [PR] [SPARK-56414][SQL] Per-write options should take precedence over session config in file source writes [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/10 12:27:03 UTC, 1 replies.
- Re: [PR] [WIP][SQL][DML] DSv2 Transaction Management [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/10 12:54:09 UTC, 25 replies.
- Re: [PR] [SPARK-56033][SQL] Support whole-stage codegen for `ArrayTransform` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/10 13:13:16 UTC, 0 replies.
- [PR] [SPARK-56432] Use `4.2.0-preview4` instead of `RC1` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/10 13:17:18 UTC, 4 replies.
- [PR] [SPARK-56433] Upgrade `operator-sdk` to 5.3.3 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/10 13:47:46 UTC, 3 replies.
- [I] Can't install prerelease using pip because version check doesn't like the version number. [spark] - posted by "IMarvinTPA (via GitHub)" <gi...@apache.org> on 2026/04/10 13:58:28 UTC, 4 replies.
- [PR] [SPARK-56434] Add `Deployment Topology` diagram [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/10 14:09:13 UTC, 3 replies.
- [PR] [SPARK-56435] Upgrade `Spark` to 4.2.0-preview4 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/10 14:23:15 UTC, 3 replies.
- [PR] [SPARK-56436] Upgrade `databricks-jdbc` to 3.3.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/10 14:45:46 UTC, 0 replies.
- [PR] [SPARK-56437] Upgrade Jetty to 12.1.8 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/10 14:59:28 UTC, 0 replies.
- Re: [PR] [SPARK-56437][BUILD] Upgrade Jetty to 12.1.8 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/10 15:10:34 UTC, 2 replies.
- Re: [PR] [SPARK-56436][TESTS] Upgrade `databricks-jdbc` to 3.3.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/10 15:10:55 UTC, 2 replies.
- [PR] [SPARK-56330][CORE][FOLLOWUP] Use dedicated loop for TaskInterruptListeners to avoid blocking completion listeners [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/10 15:14:29 UTC, 3 replies.
- [PR] [SPARK-56439] Upgrade joda-time to 2.14.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/10 15:15:52 UTC, 0 replies.
- [PR] [SPARK-56440] Upgrade `ammonite` to 3.0.9 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/10 15:26:14 UTC, 1 replies.
- [PR] [SPARK-56441] Upgrade `lz4-java` to 1.11.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/10 15:34:29 UTC, 1 replies.
- [PR] [SPARK-56438][SQL][CORE] Optimize `VectorizedPlainValuesReader.readBinary` for direct ByteBuffer by eliminating intermediate byte[] copy [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/10 16:04:47 UTC, 10 replies.
- [PR] [SPARK-56442] Use Java-friendly APIs of `JavaMainAppResource` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/10 16:06:16 UTC, 3 replies.
- [PR] [SPARK-56443] Use Java-friendly API of `KubernetesDriverSpec` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/10 16:23:19 UTC, 4 replies.
- Re: [PR] [SPARK-53848] Add ability to support Alpha family in Theta Aggregates [spark] - posted by "karuppayya (via GitHub)" <gi...@apache.org> on 2026/04/10 17:31:03 UTC, 3 replies.
- [PR] [SPARK-XXXXX][SQL] Fix equals/hashCode contract violations in BatchSc… [spark] - posted by "anton5798 (via GitHub)" <gi...@apache.org> on 2026/04/10 18:15:34 UTC, 0 replies.
- [PR] [SPARK-56445] Exclude LoosePackageCoupling PMD rule [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/10 18:34:20 UTC, 0 replies.
- [PR] [SPARK-56446] Use Java `Optional` in `SparkAppDriverConf.create` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/10 18:49:20 UTC, 0 replies.
- Re: [PR] [SPARK-56445] Exclude unused `LoosePackageCoupling` PMD rule [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/10 18:50:08 UTC, 2 replies.
- Re: [PR] [SPARK-56446] Use Java `Optional` in `SparkAppDriverConf.create` method signature [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/10 18:53:59 UTC, 3 replies.
- Re: [PR] [SPARK-56227][CORE] Fix GcmTransportCipher to correctly handle multiple messages per channel [spark] - posted by "roczei (via GitHub)" <gi...@apache.org> on 2026/04/10 19:29:57 UTC, 7 replies.
- [PR] [WIP][SPARK-40193][SQL] Merge subplans with different filter conditions [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/04/10 19:30:29 UTC, 0 replies.
- Re: [PR] [SPARK-44571][SQL] Merge subplans with one row result [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/04/10 19:33:00 UTC, 0 replies.
- [PR] [SPARK-56353][BUILD][TESTS][FOLLOWUP] Fix resource loading to work when resources are inside JARs [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/04/10 19:36:51 UTC, 4 replies.
- Re: [PR] [SPARK-56444][SQL] Fix equals/hashCode contract violations in BatchScanExec [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/04/10 21:17:01 UTC, 2 replies.
- [PR] [SPARK-56253][PYTHON][CONNECT][FOLLOW-UP] Reject multi-column DataFrame input in spark.read.json [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/10 22:09:30 UTC, 3 replies.
- [PR] [SPARK-56125][SQL] Refactor MERGE INTO schema evolution to use assignment-based approach [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/04/10 23:36:37 UTC, 11 replies.
- [PR] [SPARK-56449][INFRA] Skip pre-flight checks for code questions in AGENTS.md [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/04/11 00:23:25 UTC, 10 replies.
- [PR] [SPARK-56450][SQL] Add merge into schema evolution test with source subquery alias [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/04/11 00:40:15 UTC, 3 replies.
- [PR] [SPARK-56447][SHELL] Fix spark-shell REPL classpath initialization error [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/04/11 00:41:50 UTC, 1 replies.
- Re: [PR] [SPARK-56451][DOCS] Document how SDP datasets are stored and refreshed [spark] - posted by "moomindani (via GitHub)" <gi...@apache.org> on 2026/04/11 00:50:41 UTC, 2 replies.
- [PR] [SPARK-56374][BUILD] Align SBT assembly shade rules with Maven [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/04/11 02:20:15 UTC, 14 replies.
- [PR] [SPARK-54293][SQL] Disable SNI host check in ThriftHttpCLIService [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/04/11 03:50:24 UTC, 1 replies.
- [I] 【资源分享】Gemini Pro 1年高级稳定号（已反重力配置）——高频并发测试必备 [spark] - posted by "NilaCarlo5582 (via GitHub)" <gi...@apache.org> on 2026/04/11 05:28:32 UTC, 2 replies.
- [PR] [SPARK-52669][PYSPARK] Improve Python executable selection for YARN client mode #51357 [spark] - posted by "gwdgithubnom (via GitHub)" <gi...@apache.org> on 2026/04/11 08:13:24 UTC, 0 replies.
- Re: [PR] [SPARK-56441][BUILD] Upgrade `lz4-java` to 1.11.0 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/04/11 10:35:15 UTC, 2 replies.
- Re: [PR] [SPARK-56439][BUILD] Upgrade `joda-time` to 2.14.1 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/04/11 10:36:26 UTC, 2 replies.
- [PR] [SPARK-56452][PYTHON] Fix pip install failure for prerelease versions [spark] - posted by "kiyeonjeon21 (via GitHub)" <gi...@apache.org> on 2026/04/11 12:26:08 UTC, 5 replies.
- [PR] [SPARK-XXXXX][SS] Add ResolveEventTimeWatermark to HiveSessionStateBuilder [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/04/11 22:19:05 UTC, 0 replies.
- Re: [PR] [SPARK-53652][SQL]Codegen for MergeRowExec [spark] - posted by "karuppayya (via GitHub)" <gi...@apache.org> on 2026/04/12 02:07:41 UTC, 19 replies.
- Re: [PR] [SPARK-56454][DOCS][FOLLOWUP] Document supported SRIDs in geospatial types [spark] - posted by "pratham76 (via GitHub)" <gi...@apache.org> on 2026/04/12 05:14:50 UTC, 18 replies.
- Re: [PR] SPARK-782 Clean up for ASM dependency. [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/12 07:00:11 UTC, 17 replies.
- Re: [PR] [SPARK-56453][SS] Add ResolveEventTimeWatermark to HiveSessionStateBuilder [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2026/04/12 18:46:55 UTC, 0 replies.
- [PR] [SPARK-56455][SQL] Add test coverage for maxBroadcastTableSize config enforcement [spark] - posted by "pratham76 (via GitHub)" <gi...@apache.org> on 2026/04/12 19:39:35 UTC, 2 replies.
- [PR] [SPARK-55787][SQL] Add is_struct_empty and is_struct_non_empty built-in functions [spark] - posted by "Kino1994 (via GitHub)" <gi...@apache.org> on 2026/04/12 20:19:21 UTC, 0 replies.
- Re: [PR] [SPARK-56451][DOCS][SDP] Document how SDP datasets are stored and refreshed [spark] - posted by "moomindani (via GitHub)" <gi...@apache.org> on 2026/04/13 00:30:11 UTC, 1 replies.
- [I] 12/042026 [spark] - posted by "hanriya9-cmd (via GitHub)" <gi...@apache.org> on 2026/04/13 01:55:15 UTC, 2 replies.
- Re: [PR] [SPARK-54055][CONNECT][PYTHON] Clean up per-session PythonWorkerFactory [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/04/13 02:20:55 UTC, 0 replies.
- Re: [PR] [SPARK-56383][SQL][TEST] Add tests for partition filter extraction from mixed predicates [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/13 03:03:28 UTC, 1 replies.
- [PR] [SPARK-56424][PYTHON] Add ASV benchmark for SQL_SCALAR_PANDAS_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/13 03:09:34 UTC, 0 replies.
- [PR] [SPARK-56456] Improve checkError() diagnostics [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/04/13 03:37:42 UTC, 5 replies.
- [PR] [SPARK 55879] [Web UI] copy sql to clipboard [spark] - posted by "Shekharrajak (via GitHub)" <gi...@apache.org> on 2026/04/13 03:55:23 UTC, 0 replies.
- Re: [PR] [SPARK-55979][SQL] Required input attributes are missing from PartialMerge / Final BaseAggregateExec.references [spark] - posted by "zhztheplayer (via GitHub)" <gi...@apache.org> on 2026/04/13 04:19:09 UTC, 2 replies.
- Re: [PR] [SPARK-56415][INFRA] Refactor create_spark_jira.py for LLM use and extract shared utilities [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/13 05:31:25 UTC, 4 replies.
- Re: [PR] [SPARK-56410][SQL][CORE] Add bounded k-way merge support in UnsafeExternalSorter to reduce OOM risk [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2026/04/13 06:09:09 UTC, 37 replies.
- Re: [PR] [SPARK-56455][SQL][TESTS] Add test coverage for maxBroadcastTableSize config enforcement [spark] - posted by "pratham76 (via GitHub)" <gi...@apache.org> on 2026/04/13 06:25:54 UTC, 5 replies.
- [PR] [SPARK-56457][SQL] Fix Avro V2 formatName to match V1 FileFormat.toString [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/13 06:39:53 UTC, 3 replies.
- [PR] [SPARK-56335][SQL] Implement SupportsMetadataColumns in FileTable [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/13 07:04:53 UTC, 1 replies.
- Re: [I] Expose `preOptimizerRules` in session extensions API [spark] - posted by "kiyeonjeon21 (via GitHub)" <gi...@apache.org> on 2026/04/13 07:12:13 UTC, 0 replies.
- Re: [I] dropDuplicates(columns) followed by ExceptAll results in INTERNAL_ERROR_ATTRIBUTE_NOT_FOUND [spark] - posted by "kiyeonjeon21 (via GitHub)" <gi...@apache.org> on 2026/04/13 07:12:21 UTC, 0 replies.
- [PR] [SPARK-56371][SQL] Support _metadata.row_index for V2 Parquet reads [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/13 07:12:29 UTC, 1 replies.
- [PR] [SPARK-56337][SQL] Propagate analyzed sizeInBytes to V2 FileScan estimates [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/13 07:17:19 UTC, 0 replies.
- Re: [PR] [SPARK-52965][BUILD] Upgrade gRPC to 1.76.0 on branch-4.0 [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/04/13 11:14:03 UTC, 3 replies.
- [PR] [SPARK-56459][SQL] Fix MatchError in FileDataSourceV2.attachFilePath for fatal errors [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/04/13 12:43:53 UTC, 5 replies.
- [PR] [SPARK-56034][SQL][FOLLOWUP] Disable PushDownJoinThroughUnion by default; add non-deterministic guard and move after Join Reorder [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/13 13:48:32 UTC, 12 replies.
- Re: [PR] [DO NOT MERGE] define configs in text files [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/13 14:27:00 UTC, 0 replies.
- Re: [PR] [SPARK-56444][SQL] Fix hashCode contract violation in BatchScanExec [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/13 15:02:49 UTC, 1 replies.
- Re: [PR] [SPARK-53848][SQL] Add ability to support Alpha family in Theta Aggregates [spark] - posted by "cboumalh (via GitHub)" <gi...@apache.org> on 2026/04/13 15:37:51 UTC, 2 replies.
- Re: [PR] [SPARK-34914][CORE] Local scheduler backend support update token [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/04/13 16:04:52 UTC, 1 replies.
- Re: [PR] [SPARK-56455][SQL][TESTS] Add test for broadcast failure when exceeding maxBroadcastTableSize [spark] - posted by "pratham76 (via GitHub)" <gi...@apache.org> on 2026/04/13 17:23:25 UTC, 7 replies.
- [PR] [SPARK-55444][SQL] Types Framework - Phase 3a - Storage Formats (Parquet) [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2026/04/13 17:35:49 UTC, 0 replies.
- [PR] [SQL] Update grammar/TableChange to allow CLUSTER BY expressions [spark] - posted by "itsbilal (via GitHub)" <gi...@apache.org> on 2026/04/13 18:46:42 UTC, 0 replies.
- [PR] [SS] Disable File Checksum for Checkpoint Format Version 1 [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2026/04/13 20:50:29 UTC, 0 replies.
- [PR] [SPARK-56462][SQL]Fix UPDATE/INSERT schema evolution when source col contains dot [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/04/13 22:54:25 UTC, 1 replies.
- [PR] [SPARK-56463][PYTHON] Disallow unpickling UDT [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/13 23:36:21 UTC, 5 replies.
- [PR] [SPARK-56464][SS] Reset numRowsRemoved to 0 properly on the progress event for no batch triggers [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/04/14 03:20:59 UTC, 16 replies.
- [PR] [SPARK-56254][PYTHON][CONNECT] Make spark.read.xml accept DataFrame input [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/14 04:13:07 UTC, 2 replies.
- [PR] [SPARK-56466][CONNECT] Make SparkSession.close() idempotent [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/14 05:54:21 UTC, 2 replies.
- [PR] [SPARK-56415][INFRA][FOLLOWUP] Fix `ruff format` violations in `dev/` JIRA scripts [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/04/14 06:28:49 UTC, 3 replies.
- Re: [PR] [SPARK-56054][SQL] Undo handling aliased assignments in MERGE INTO schema evolution and add tests [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2026/04/14 06:33:02 UTC, 6 replies.
- [PR] [SPARK-56467][SQL] Route scalar subquery partition filters into DSv2 runtime filtering [spark] - posted by "anton5798 (via GitHub)" <gi...@apache.org> on 2026/04/14 08:41:38 UTC, 9 replies.
- Re: [PR] [SPARK-55440][SQL] Types Framework - Phase 1a - Core Type System Foundation [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/04/14 08:53:32 UTC, 1 replies.
- [PR] [SPARK-56469][SQL][TESTS] `BufferedRowsReader` lifecycle hardening [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/04/14 09:49:50 UTC, 6 replies.
- [PR] [SPARK-56471][BUILD][INFRA] Remove release-time binary deletion workaround and CI JAR/class checks [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/04/14 09:57:33 UTC, 6 replies.
- Re: [PR] [SPARK-56470] Schema evolution for DSv2 sinks during streaming write [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2026/04/14 10:04:12 UTC, 0 replies.
- [PR] [SPARK-52818][SQL] Fix MergeSubplans creating nested WithCTE with cross-scope CTE references [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/14 12:53:28 UTC, 3 replies.
- [PR] [SPARK-XXXXX][SQL] Remove unnecessary asInstanceOf[classic.Dataset] casts in QueryTest [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/14 13:06:46 UTC, 0 replies.
- [PR] [SPARK-56472] Fix MERGE schema evolution with WHEN MATCHED THEN DELETE [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2026/04/14 15:28:46 UTC, 3 replies.
- [PR] [SPARK-56473] Rename `create_spark_jira.py` to `create_jira_and_branch.py` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/14 16:19:48 UTC, 3 replies.
- [PR] [SPARK-56474] Rename `create_spark_jira.py` to `create_jira_and_branch.py` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/14 16:22:57 UTC, 4 replies.
- Re: [PR] [SPARK-56461][SS] Disable File Checksum for Checkpoint Format Version 1 [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2026/04/14 18:10:30 UTC, 2 replies.
- [PR] [SPARK-56476][SS] Fix invalid stamp error when upgrading read store to write store [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2026/04/14 21:57:37 UTC, 1 replies.
- Re: [PR] [SPARK-54731][SQL] Support Reverse expression to handle BinaryType by performing raw byte-level reversal [spark] - posted by "xiaoxuandev (via GitHub)" <gi...@apache.org> on 2026/04/14 23:02:13 UTC, 2 replies.
- [PR] [SPARK-56478][INFRA] Remove hamcrest-core-1.3 in the Maven local as a workaround [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/04/14 23:31:35 UTC, 6 replies.
- [PR] [MINOR][INFRA] Fix bash newline strip for precondition output in build_and_test workflow [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/04/15 00:22:21 UTC, 2 replies.
- [PR] [SPARK-56480][TESTS] Fix flaky SparkLauncherSuite due to race conditions in cleanup [spark] - posted by "dbtsai (via GitHub)" <gi...@apache.org> on 2026/04/15 00:26:24 UTC, 1 replies.
- Re: [PR] [SPARK-56424][PYTHON][TESTS] Add ASV benchmark for SQL_SCALAR_PANDAS_UDF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/15 00:47:54 UTC, 2 replies.
- Re: [PR] [SPARK-54890][PYTHON] Allow users to enforce timezone match for timestamp conversion [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/15 00:48:29 UTC, 1 replies.
- Re: [PR] [SPARK-54450][INFRA][FOLLOW-UP] Support unittest style string in run-tests [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/15 00:48:33 UTC, 1 replies.
- Re: [PR] [SPARK-56153][SQL][TESTS][FOLLOWUP] Remove unnecessary asInstanceOf[classic.Dataset] casts in QueryTest [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/15 02:12:15 UTC, 1 replies.
- Re: [PR] [SPARK-54449][CORE] Storage Memory off heap size should be considered only when off heap is enabled [spark] - posted by "VindhyaG (via GitHub)" <gi...@apache.org> on 2026/04/15 03:22:47 UTC, 0 replies.
- [PR] [SPARK-56478][INFRA][FOLLOW-UP] Remove hamcrest-core-1.3 in the Maven local as a workaround within Docker run [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/04/15 06:45:05 UTC, 2 replies.
- [PR] [SPARK-56483][SQL][TESTS] Use abstract SparkSession/DataFrame in SQLTestUtilsBase [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/15 07:56:58 UTC, 2 replies.
- [PR] [SPARK-38101] Make metadata fetch failure repeat the task, not restart stages [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2026/04/15 11:54:46 UTC, 0 replies.
- Re: [I] [SPARK-38101] execuors fail fetching map statuses with `INTERNAL_ERROR_BROADCAST` [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2026/04/15 11:58:45 UTC, 0 replies.
- [PR] [SPARK-43752][SQL] Remove dead code for column DEFAULT in V2 write commands [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/15 11:59:35 UTC, 0 replies.
- Re: [PR] revert [SPARK-43752] and add test [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/15 12:01:40 UTC, 6 replies.
- [PR] IS NOT NULL should not increase sizeInBytes over child [spark] - posted by "JkSelf (via GitHub)" <gi...@apache.org> on 2026/04/15 12:56:01 UTC, 1 replies.
- [PR] Incorrect RowCount Estimation in CBO leads to unintended BroadcastHashJoin [spark] - posted by "JkSelf (via GitHub)" <gi...@apache.org> on 2026/04/15 13:12:15 UTC, 3 replies.
- Re: [PR] Filter IS NOT NULL expression 's sizeInBytes should not increase over child [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/15 14:02:52 UTC, 0 replies.
- Re: [PR] Filter's sizeInBytes estimation should not inflate over child's sizeInBytes when CBO is on. [spark] - posted by "JkSelf (via GitHub)" <gi...@apache.org> on 2026/04/15 14:54:35 UTC, 0 replies.
- Re: [PR] [SPARK-56399][PYTHON][TESTS] Add SimpleWorkerTests for non-daemon worker path [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/15 15:13:13 UTC, 1 replies.
- Re: [PR] [SPARK-56401] Use `setup-gradle` v6.1.0 GitHub Actions in CIs [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/15 15:41:33 UTC, 5 replies.
- Re: [PR] [SPARK-56485][SQL]Incorrect RowCount Estimation in CBO leads to unintended BroadcastHashJoin [spark] - posted by "JkSelf (via GitHub)" <gi...@apache.org> on 2026/04/15 15:48:31 UTC, 1 replies.
- Re: [PR] [SPARK-56484][SQL]Filter's sizeInBytes estimation should not inflate over child's sizeInBytes when CBO is on. [spark] - posted by "JkSelf (via GitHub)" <gi...@apache.org> on 2026/04/15 15:49:02 UTC, 2 replies.
- [PR] [SPARK-56487] Update `spotbugs-gradle-plugin` to 6.5.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/15 17:24:35 UTC, 4 replies.
- Re: [PR] [SPARK-56241][SQL] Derive `outputOrdering` from `KeyedPartitioning` key expressions [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/04/15 17:41:53 UTC, 0 replies.
- [PR] [SPARK-56490] Add Java-friendly `KubernetesConf.createDriverConf` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/15 17:51:59 UTC, 0 replies.
- [PR] [SPARK-56491] Add `ReadOnlySparkConf.getAllAsJavaMap` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/15 18:17:26 UTC, 0 replies.
- Re: [PR] [SPARK-56491][CORE] Add `ReadOnlySparkConf.getAllAsJavaMap` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/15 18:42:48 UTC, 2 replies.
- Re: [PR] [SPARK-56490][K8S] Add Java-friendly `KubernetesConf.createDriverConf` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/15 18:43:00 UTC, 2 replies.
- [PR] [SPARK-56492][CORE][SQL] Add `SparkStringUtils.digestToHexString` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/15 18:47:43 UTC, 0 replies.
- Re: [PR] [SPARK-56484][SQL] Filter's sizeInBytes estimation should not inflate over child's sizeInBytes when CBO is on [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/15 18:52:07 UTC, 2 replies.
- [PR] [SPARK-56489][SQL] Add CURRENT_PATH() builtin expression and keywords [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/04/15 19:12:29 UTC, 11 replies.
- [PR] [SPARK-56238][K8S] Fix app ID propagation in KubernetesClusterSchedulerBackend [spark] - posted by "xiaoxuandev (via GitHub)" <gi...@apache.org> on 2026/04/15 19:15:49 UTC, 10 replies.
- [PR] [WIP] SharedSparkSession provides sql.SparkSession, add SharedClassicSparkSession, ClassicSQLTestUtils [spark] - posted by "fwc (via GitHub)" <gi...@apache.org> on 2026/04/15 19:31:40 UTC, 0 replies.
- [PR] [SPARK-56493][K8S] Replace `GzipCompressorOutputStream` with Java `GZIPOutputStream` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/15 19:51:30 UTC, 4 replies.
- Re: [PR] [SPARK-56238][K8S] Fix app ID propagation in KubernetesClusterSchedulerBackend for `client` mode submission [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/15 20:57:05 UTC, 1 replies.
- Re: [PR] [SPARK-56470][SQL] Schema evolution for DSv2 sinks during streaming write [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/04/15 21:07:37 UTC, 7 replies.
- [PR] [SPARK-56495] Remove `CountingOutputStreamin` overhead from `SparkConnectAddArtifactsHandler` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/15 22:12:46 UTC, 0 replies.
- [PR] [SPARK-56497] Upgrade the minimum `Swift` requirement to 6.3 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/15 22:23:03 UTC, 3 replies.
- Re: [PR] [WIP][SPARK-56479][SQL] df.cache() with DSv2 interfaces to enable V2ScanRelationPushDown optimizer rules [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/04/15 22:31:49 UTC, 2 replies.
- [PR] [SPARK-56496][CORE] Unify stage retry limit checks into canRetryStage helper in DAGScheduler [spark] - posted by "jiangxb1987 (via GitHub)" <gi...@apache.org> on 2026/04/15 22:48:20 UTC, 7 replies.
- [PR] [SPARK-56499][CORE] Deduplicate RDD graph BFS traversal pattern in DAGScheduler [spark] - posted by "jiangxb1987 (via GitHub)" <gi...@apache.org> on 2026/04/15 23:30:14 UTC, 9 replies.
- [PR] [SPARK-56500][R] Replace devtools to remotes in SparkR [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/04/15 23:52:15 UTC, 5 replies.
- Re: [PR] [SPARK-56492][CORE][SQL] Support `digestToHexString/md5Hex/sha256Hex` in `JavaUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/16 00:46:38 UTC, 4 replies.
- Re: [PR] [SPARK-54908] Apply dateFormat option during JSON schema inference [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/16 00:50:08 UTC, 1 replies.
- Re: [PR] Fix buildFileDescriptor for any proto [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/16 00:50:12 UTC, 1 replies.
- Re: [PR] [SPARK-54367][Connect]Propagate close() from SessionState to CatalogPlugins to prevent leak [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/16 00:50:16 UTC, 1 replies.
- Re: [PR] [SPARK-56326][SS][CORE] Include streaming query and batch ids in scheduling logs [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/04/16 01:31:38 UTC, 2 replies.
- [PR] [SPARK-56502][CORE] Fix integer overflow in DirectByteBufferOutputStream capacity check [spark] - posted by "timlee0119 (via GitHub)" <gi...@apache.org> on 2026/04/16 01:33:01 UTC, 14 replies.
- [PR] [SPARK-56501] SET PATH syntax [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/04/16 01:58:22 UTC, 17 replies.
- [PR] [SPARK-56492][SQL][TEST][FOLLOWUP] Use hardcoded expected values in HashExpressionsSuite sha2 tests [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/04/16 02:24:11 UTC, 7 replies.
- Re: [PR] [SPARK-56505][SQL][TESTS] SharedSparkSession provides sql.SparkSession, add SharedClassicSparkSession, ClassicSQLTestUtils [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/16 03:23:58 UTC, 1 replies.
- [PR] [SPARK-56506][PROJECT INFRA] Use PR author's GitHub identity as the commit author in merge script [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/16 05:28:13 UTC, 1 replies.
- [PR] [SPARK-56507][ML][PYTHON][TESTS] Reduce maxIter in CrossValidator test to speed up CI [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/16 06:23:22 UTC, 2 replies.
- [PR] [SPARK-XXXXX][INFRA] Pin meson<1.11.0 for PyPy pandas source build in CI Dockerfiles [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/16 06:58:57 UTC, 7 replies.
- Re: [PR] [SPARK-55325][PYTHON] Introduce ArrowArrayToPandasConversion.convert_pyarrow [spark] - posted by "fangchenli (via GitHub)" <gi...@apache.org> on 2026/04/16 07:34:27 UTC, 4 replies.
- [PR] [SPARK-XXXXX][INFRA] Pin `meson<1.11.0` and `lxml==4.9.4` to recover CI. [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/04/16 08:23:07 UTC, 0 replies.
- Re: [PR] [SPARK-56485][SQL] Fix RowCount Estimation in CBO to avoid unintended BroadcastHashJoin [spark] - posted by "JkSelf (via GitHub)" <gi...@apache.org> on 2026/04/16 08:51:09 UTC, 3 replies.
- [PR] [SPARK-47741][SQL][TESTS] Add `VectorizedRleValuesReaderBenchmark` for `VectorizedRleValuesReader` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/16 12:55:50 UTC, 0 replies.
- Re: [PR] [SPARK-40193][SQL] Merge subplans with different filter conditions [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/04/16 13:39:23 UTC, 20 replies.
- Re: [PR] [SPARK-47741][SQL][TESTS] Add `VectorizedRleValuesReaderBenchmark` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/16 13:58:35 UTC, 1 replies.
- Re: [PR] [SPARK-54680][SQL] Rename TABLESAMPLE-related legacy error conditions to descriptive names [spark] - posted by "ycli12 (via GitHub)" <gi...@apache.org> on 2026/04/16 13:59:50 UTC, 0 replies.
- Re: [PR] [SPARK-XXXXX][INFRA] Pin `meson<1.11.0` and `lxml==4.9.4` in Dockerfile for PyPy to recover CI. [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/04/16 14:52:55 UTC, 0 replies.
- [PR] [SPARK-56509] SparkSQL Last Attempt Metrics [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2026/04/16 16:29:53 UTC, 1 replies.
- [PR] [SQL] Fix ReplaceData DML without metadata attributes not projecting out the operation column [spark] - posted by "ZiyaZa (via GitHub)" <gi...@apache.org> on 2026/04/16 16:39:31 UTC, 0 replies.
- Re: [PR] [SPARK-40193][SQL] Merge subquery plans with different filters [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/04/16 17:26:04 UTC, 0 replies.
- [PR] [SPARK-56511][CORE] Fix NPE in ShuffleInMemorySorter.getMemoryUsage after failed reset [spark] - posted by "timlee0119 (via GitHub)" <gi...@apache.org> on 2026/04/16 17:42:01 UTC, 11 replies.
- [PR] [SPARK-56512][CORE] Avoid redundant BlockId parsing in ShuffleBlockFetcherIterator [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/16 17:45:51 UTC, 5 replies.
- Re: [PR] [SPARK-56513][INFRA] Pin `meson<1.11.0` and `lxml==4.9.4` in Dockerfile for PyPy to recover CI [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/04/16 18:54:46 UTC, 10 replies.
- [PR] [SPARK-56514][SQL] Allow catalog Table objects to be passed directly to read.table() and writeTo() [spark] - posted by "dbtsai (via GitHub)" <gi...@apache.org> on 2026/04/16 18:58:59 UTC, 0 replies.
- [PR] [SQL] Add column ID support to DSv2 for detecting drop-and-re-add col… [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/16 19:43:31 UTC, 2 replies.
- [PR] [SPARK-56515] Upgrade `grpc-swift-2` to 2.4.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/16 19:49:53 UTC, 3 replies.
- [PR] [SPARK-56516] Upgrade `gRPC Swift Protobuf` to 2.3.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/16 19:54:19 UTC, 3 replies.
- [PR] [SPARK-56517] Upgrade `gRPC Swift NIO Transport` to 2.7.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/16 19:58:23 UTC, 3 replies.
- Re: [PR] [WIP][SPARK-56514][SQL] Allow catalog Table objects to be passed directly to read.table() and writeTo() [spark] - posted by "lakechd (via GitHub)" <gi...@apache.org> on 2026/04/16 20:18:18 UTC, 2 replies.
- Re: [PR] [SPARK-53440][PYTHON] Allow Column.transform() to accept SQL lambda expression strings [spark] - posted by "lakechd (via GitHub)" <gi...@apache.org> on 2026/04/16 20:37:19 UTC, 0 replies.
- Re: [PR] [SPARK-55869][SQL] Extended Predicate Pushdown for DataSource V2 [spark] - posted by "lakechd (via GitHub)" <gi...@apache.org> on 2026/04/16 20:39:35 UTC, 1 replies.
- Re: [PR] [MINOR][SQL] SQL state code change from XX000 to 42704 for MISSING_ATTRIBUTES [spark] - posted by "lakechd (via GitHub)" <gi...@apache.org> on 2026/04/16 20:42:59 UTC, 0 replies.
- [PR] [SPARK-56312][PYTHON] Refactor SQL_COGROUPED_MAP_ARROW_UDF to be self-contained in read_udfs [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/16 21:10:28 UTC, 0 replies.
- Re: [PR] [SPARK-56495][CONNECT] Remove `CountingOutputStream` overhead from `SparkConnectAddArtifactsHandler` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/16 21:25:38 UTC, 3 replies.
- [PR] Bump org.bouncycastle:bcpkix-jdk18on from 1.83 to 1.84 [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/04/16 21:54:15 UTC, 2 replies.
- Re: [PR] [SPARK-56510][SQL] Fix ReplaceData DML without metadata attributes not projecting out the operation column [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/04/16 21:57:42 UTC, 11 replies.
- [PR] [SC-56518] Add current_path support to builtin.py etc [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/04/16 22:02:09 UTC, 0 replies.
- [PR] [SPARK-56519][PYTHON] Isolate communication part from python udf worker [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/16 22:20:21 UTC, 1 replies.
- Re: [PR] [SPARK-56518][PYTHON] Add current_path to PySpark functions [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/04/16 22:36:04 UTC, 4 replies.
- Re: [PR] [SPARK-56509][SQL] SparkSQL Last Attempt Metrics [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/04/16 23:43:25 UTC, 17 replies.
- Re: [PR] [SPARK-56508][SQL][TESTS] Add `VectorizedRleValuesReaderBenchmark` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/17 00:38:40 UTC, 0 replies.
- [PR] Sql merge utils into query [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/17 00:44:17 UTC, 0 replies.
- Re: [PR] [SPARK-54876][SQL] The splitSemiColon function should correctly split SQL statements [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/17 00:48:05 UTC, 1 replies.
- [PR] [SPARK-56521][SQL] Support PartitionPredicate in runtime filters [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/04/17 01:22:53 UTC, 10 replies.
- [PR] [SPARK-56520][SQL] Persist SQL PATH in views and SQL functions, expose in DESCRIBE [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/04/17 01:23:08 UTC, 18 replies.
- Re: [PR] [SPARK-56506][INFRA] Use PR author's GitHub identity as the commit author in merge script [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/17 02:11:12 UTC, 1 replies.
- [PR] [MINOR][INFRA] AGENTS.md: require ASCII-only source files [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/17 02:39:43 UTC, 3 replies.
- Re: [I] Why didn't the Executor fail after the Shuffle connection timeout? [spark] - posted by "qiqi0818 (via GitHub)" <gi...@apache.org> on 2026/04/17 02:40:24 UTC, 0 replies.
- [PR] [SPARK-56256][PYTHON][DOCS][FOLLOWUP] Document SparkSession.emptyDataFrame in API reference [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/17 02:56:09 UTC, 2 replies.
- [PR] [SPARK-56522][SQL] Batch PACKED null/non-null runs in `VectorizedRleValuesReader` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/17 03:22:41 UTC, 18 replies.
- [I] Fetching of blocks of cache table may cause high memory pressure [spark] - posted by "jiangjiangtian (via GitHub)" <gi...@apache.org> on 2026/04/17 04:01:28 UTC, 2 replies.
- [PR] reformat [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/04/17 05:18:35 UTC, 0 replies.
- Re: [PR] [SPARK-56506][INFRA][FOLLOW-UP] Reformat dev/merge_spark_pr.py‎ [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/04/17 05:20:31 UTC, 1 replies.
- Re: [PR] [SPARK-56472][SQL] Fix MERGE schema evolution with WHEN MATCHED THEN DELETE [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2026/04/17 06:50:56 UTC, 2 replies.
- [PR] [SPARK-XXXXX][INFRA] Add ubuntu mirror repositories for redundancy [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/04/17 07:07:24 UTC, 0 replies.
- [PR] [SPARK-38101][CORE] Retry INTERNAL_ERROR_BROADCAST when fetching map statuses [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2026/04/17 07:23:03 UTC, 0 replies.
- Re: [PR] [SPARK-38101][CORE] Make metadata fetch failure repeat the task, not restart stages [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2026/04/17 07:30:58 UTC, 0 replies.
- [PR] [SPARK-56523][SS] RocksDB memory leak [spark] - posted by "planga82 (via GitHub)" <gi...@apache.org> on 2026/04/17 12:09:11 UTC, 1 replies.
- Re: [PR] [SPARK-55535][SPARK-55092][SQL] Refactor `KeyGroupedPartitioning` and Storage Partition Join [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/04/17 13:29:04 UTC, 9 replies.
- [I] UNBOUND_SQL_PARAMETER in pyspark 4.1.1 when using named parameters [spark] - posted by "postatum (via GitHub)" <gi...@apache.org> on 2026/04/17 15:00:57 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-54647][PYTHON] Support User-Defined Aggregate Functions (UDAF) [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/04/17 16:43:19 UTC, 1 replies.
- Re: [PR] [SPARK-56440][BUILD] Upgrade `ammonite` to 3.0.9 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/17 17:27:17 UTC, 1 replies.
- [PR] [SQL] Format SqlScriptingCursorE2eSuite [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2026/04/17 17:48:59 UTC, 0 replies.
- [PR] [SPARK-56488][BUILD] Bump Scala 2.13 to 2.13.9 on branch-3.5 [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/04/17 17:54:14 UTC, 0 replies.
- [PR] [SPARK-56527] Rename internal config name `spark.ui.(jettyS -> jetty.s)topTimeout` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/17 18:07:47 UTC, 0 replies.
- [PR] [SPARK-XXXXX][UI] Make Jetty SniHostCheck configurable [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/17 18:11:58 UTC, 0 replies.
- Re: [PR] [SPARK-56488][BUILD][3.5] Bump Scala 2.13 to 2.13.9 on branch-3.5 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/17 18:17:20 UTC, 6 replies.
- [PR] [SPARK-56529][PYTHON] Fix SCALAR_ARROW_ITER_UDF perf regression from enforce_schema refactor [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/17 18:18:13 UTC, 2 replies.
- Re: [PR] [SPARK-56527][CORE] Rename internal config name `spark.ui.(jettyS -> jetty.s)topTimeout` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/17 18:19:09 UTC, 4 replies.
- Re: [PR] [SPARK-56526][SQL] Format SqlScriptingCursorE2eSuite [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2026/04/17 20:50:17 UTC, 2 replies.
- [PR] [SPARK-56530][BUILD] Upgrade Maven to 3.9.15 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/17 21:00:55 UTC, 4 replies.
- [PR] [SPARK-56531][BUILD][TESTS] Upgrade `bouncycastle` to 1.84 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/17 21:12:16 UTC, 2 replies.
- Re: [PR] [SPARK-56523][SS] Fix RocksDB to close Statistics native handle [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/17 21:56:12 UTC, 1 replies.
- [PR] [SPARK-56532][CORE] Add `closeQuietly(AutoCloseable)` overload to `SparkErrorUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/17 22:12:01 UTC, 2 replies.
- Re: [PR] [SPARK-54947][CORE] Refactor block mapping with BlockInfoGroup for better block management [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/18 00:43:55 UTC, 1 replies.
- Re: [PR] [SPARK-54928] Add shuffle migration statistics to MigrationInfo [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/18 00:43:59 UTC, 1 replies.
- Re: [PR] [SPARK-54921][CORE] Add parentIds to StageData [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/18 00:44:04 UTC, 1 replies.
- Re: [PR] [SPARK-54918][SQL] Normalize -0.0 to 0.0 in array operations [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/18 00:44:08 UTC, 3 replies.
- [PR] [SPARK-56538][CONNECT] Add per-RPC deadlines to Spark Connect client [spark] - posted by "pranavdev022 (via GitHub)" <gi...@apache.org> on 2026/04/18 00:54:04 UTC, 22 replies.
- [PR] Bump org.bouncycastle:bcprov-jdk18on from 1.83 to 1.84 [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/04/18 01:14:59 UTC, 2 replies.
- [PR] [SPARK-56535][INFRA] Fix base image build when Docker cache is cold [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/04/18 05:15:53 UTC, 1 replies.
- [PR] [SPARK-56429][DOCS] Clarify differences between nullValue and emptyValue CSV options [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/04/18 05:25:36 UTC, 4 replies.
- Re: [PR] [SPARK-56525][INFRA] Add ubuntu mirror repositories for redundancy [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/18 05:50:17 UTC, 2 replies.
- [PR] [SPARK-56412] Implement DirectWorkerDispatcher that spawns UDF workers as local callable. [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2026/04/18 09:32:38 UTC, 25 replies.
- [PR] [SPARK-56018][INFRA][FOLLOWUP] Install black for older branches in Python CodeGen check [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/18 19:24:47 UTC, 0 replies.
- [PR] [SPARK-55830][SQL] Fix JDBC predicate pushdown dropping driver properties [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/04/18 22:59:19 UTC, 0 replies.
- Re: [PR] [DRAFT][SQL][PYTHON][CONNECT] Enable xxhash64 with seed parameter [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/19 00:49:51 UTC, 1 replies.
- Re: [PR] [SPARK-54974][SQL] Always propagate static confs to views/UDFs from active session [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/19 00:49:55 UTC, 1 replies.
- Re: [PR] [SPARK-54342][BUILD] Unify scalatest format reports between SBT and maven builds [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/19 00:50:00 UTC, 1 replies.
- Re: [PR] [SPARK-54282][BUILD] Read bom version from pom in SBT [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/19 00:50:04 UTC, 1 replies.
- [PR] [SPARK-56511][CORE][TESTS][FOLLOWUP] Disable off-heap memory in ShuffleExternalSorter cleanupResources test [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/04/19 05:42:24 UTC, 3 replies.
- [PR] [SPARK-44462][CONNECT] Fix the session passed to foreachBatch in Spark Connect [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/19 05:49:26 UTC, 1 replies.
- [PR] Vandana ibm 3.5.4 [spark] - posted by "VandanaSah (via GitHub)" <gi...@apache.org> on 2026/04/19 06:30:02 UTC, 3 replies.
- [PR] [SPARK-51961][SQL] Fix from_avro to handle union schemas [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/04/19 06:57:47 UTC, 0 replies.
- [PR] [SPARK-52382][PYTHON] Fix TypeError when collecting MapType with ArrayType keys [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/04/19 07:08:36 UTC, 0 replies.
- [PR] [SPARK-56540][INFRA] Add libuv1-dev to CI Docker images to fix R package fs build failure [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/19 07:14:37 UTC, 2 replies.
- [PR] Adding time field suport to spark [spark] - posted by "VandanaSah (via GitHub)" <gi...@apache.org> on 2026/04/19 07:22:28 UTC, 1 replies.
- [PR] [SPARK-54216][SQL] Add regression tests for V2 table cache refresh with immutable Table instances [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/04/19 10:01:38 UTC, 0 replies.
- [PR] [SPARK-54908][SQL] Support dateFormat option during JSON schema inference [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/04/19 10:21:43 UTC, 17 replies.
- [I] [Notice] Maintained version over at caldempsey/spark-connect-go [spark-connect-go] - posted by "caldempsey (via GitHub)" <gi...@apache.org> on 2026/04/19 13:54:53 UTC, 0 replies.
- [PR] [SPARK-56541][SQL][TESTS] Add test coverage for try_to_date() in DateFunctionSuite [spark] - posted by "pratham76 (via GitHub)" <gi...@apache.org> on 2026/04/19 15:46:34 UTC, 8 replies.
- [PR] [SPARK-56542][BUILD] Upgrade Guava to 33.6.0-jre [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/19 17:02:37 UTC, 1 replies.
- [PR] refactor: trim typed API to edge-wrapper shape only [spark-connect-go] - posted by "caldempsey (via GitHub)" <gi...@apache.org> on 2026/04/19 21:42:45 UTC, 2 replies.
- Re: [PR] [SPARK-56528][CORE] Make Jetty SniHostCheck configurable [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/19 23:30:54 UTC, 1 replies.
- [PR] [SPARK-56544] Update `gradle-versions-plugin` to 0.54.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/19 23:39:19 UTC, 4 replies.
- [PR] [SPARK-56545] Update `spotbugs-gradle-plugin` to 6.5.1 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/19 23:41:29 UTC, 3 replies.
- Re: [PR] [SPARK-56018][INFRA][FOLLOW-UP] Install black for older branches in Python CodeGen check [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/20 00:09:56 UTC, 1 replies.
- Re: [PR] [WIP] SELECT FROM INSERT [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/20 00:48:44 UTC, 1 replies.
- Re: [PR] [SPARK-45846][SQL] optimizeNullAwareAntiJoin should respect autoBroadcastJoinThreshold [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/20 00:48:46 UTC, 1 replies.
- Re: [PR] SPARK-34519 ExecutorPodsAllocator applies exponential backoff delays … [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/20 00:48:49 UTC, 1 replies.
- Re: [PR] [SPARK-33863][PYTHON] Respect session timezone in udf workers [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/20 00:48:52 UTC, 1 replies.
- [PR] [SPARK-56543] Add RTM stateless benchmark [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/04/20 01:09:09 UTC, 10 replies.
- Re: [PR] [SPARK-55910][SQL][TESTS] Merge SQLTestUtilsBase/SQLTestUtils into QueryTestBase/QueryTest [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/20 05:27:11 UTC, 6 replies.
- [PR] Better error message [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/20 06:05:17 UTC, 0 replies.
- [PR] [WIP][SPARK-56546][SQL] Block-chunked segment-tree window frame for non-invertible sliding aggregates [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/04/20 06:38:10 UTC, 10 replies.
- [PR] [SPARK-56548][CORE] Replace modulo with bitmask in BloomFilter hot paths [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/20 07:34:11 UTC, 2 replies.
- [PR] [SPARK-34914][CORE] Local mode supports Hadoop Delegation Token [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/04/20 09:09:36 UTC, 15 replies.
- [PR] [SPARK-56482][SQL] Support whole-stage codegen for `UnionExec` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/20 11:51:17 UTC, 1 replies.
- [PR] [WIP][SPARK-55951][SPARK-55952][SPARK-55953][SQL] Add post-processing for CDC changelog tables [spark] - posted by "SanJSp (via GitHub)" <gi...@apache.org> on 2026/04/20 12:53:56 UTC, 23 replies.
- [PR] [SPARK-56550][SQL] Support filling missing nested struct fields in INSERT INTO WITH SCHEMA EVOLUTION [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/04/20 14:51:03 UTC, 0 replies.
- [PR] [SPARK-56551][SQL] Add operation metrics for DELETE queries in DSv2 [spark] - posted by "ZiyaZa (via GitHub)" <gi...@apache.org> on 2026/04/20 15:59:52 UTC, 10 replies.
- [PR] [SPARK-56552] Update `cyclonedx` to 3.2.4 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/20 16:10:54 UTC, 4 replies.
- [PR] [MINOR][SQL] Fix duplicated word typos in code comments [spark] - posted by "Bojun-Vvibe (via GitHub)" <gi...@apache.org> on 2026/04/20 16:13:32 UTC, 0 replies.
- [PR] [WIP][SPARK-56551][SQL] Add operation metrics for metadata-only DELETE queries in DSv2 [spark] - posted by "ZiyaZa (via GitHub)" <gi...@apache.org> on 2026/04/20 17:04:52 UTC, 7 replies.
- [PR] [SPARK-56553] Upgrade `extra-enforcer-rules` to 1.12.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/20 17:46:14 UTC, 0 replies.
- [PR] [WIP][SPARK-56535][BUILD] Fix base image build [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/04/20 18:32:24 UTC, 0 replies.
- Re: [I] Spark map lookup is O(n) [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/20 19:04:07 UTC, 0 replies.
- [PR] Docs/readme refresh [spark-connect-go] - posted by "caldempsey (via GitHub)" <gi...@apache.org> on 2026/04/20 19:17:33 UTC, 1 replies.
- Re: [PR] [SPARK-56524][SQL] Add operation metrics for UPDATE queries in DSv2 [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/04/20 20:30:27 UTC, 21 replies.
- Re: [PR] [SPARK-55626][SQL][4.1] Don't load metadata columns on Table unless needed in V2TableUtil [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/20 20:38:44 UTC, 1 replies.
- Re: [PR] [SPARK-44462][SS][CONNECT] Fix the session passed to foreachBatch in Spark Connect [spark] - posted by "xiaoxuandev (via GitHub)" <gi...@apache.org> on 2026/04/20 21:17:20 UTC, 8 replies.
- [PR] [SPARK-56554][SQL] Respect inferSchema option when parsing XML as variant [spark] - posted by "xiaonanyang-db (via GitHub)" <gi...@apache.org> on 2026/04/20 22:16:25 UTC, 2 replies.
- [PR] [SPARK-56475][PYTHON][TESTS] Add ASV benchmark for SQL_SCALAR_PANDAS_ITER_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/20 22:55:29 UTC, 2 replies.
- [PR] [SPARK-56387][PYTHON][FOLLOWUP] Use namedtuple instead of dict to have be backward compatible [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/21 02:40:23 UTC, 2 replies.
- [PR] [SPARK-56555][K8S] Add ubuntu mirror repositories to K8s Dockerfile for redundancy [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/04/21 05:37:11 UTC, 3 replies.
- Re: [PR] [SPARK-56553][BUILD] Upgrade `extra-enforcer-rules` to 1.12.0 [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/04/21 06:03:13 UTC, 1 replies.
- [PR] [SPARK-56556][INFRA] Reject `.jar` and `.class` files in CI [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/04/21 06:29:34 UTC, 5 replies.
- [PR] [SPARK-56540][INFRA][4.1] Add libuv1-dev to CI Docker images to fix R package fs build failure [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/21 06:58:47 UTC, 4 replies.
- [PR] [SPARK-56540][INFRA][4.0] Add libuv1-dev to CI Docker images to fix R package fs build failure [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/21 07:12:12 UTC, 4 replies.
- [PR] [MINOR][CONNECT] Fix user_agent length error message in Python Connect client [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/04/21 07:34:31 UTC, 2 replies.
- [PR] [SPARK-54710][SQL] Show Partitions As Json [spark] - posted by "ashutosh-jindal (via GitHub)" <gi...@apache.org> on 2026/04/21 08:17:24 UTC, 2 replies.
- [PR] [SPARK-55910][SQL][TESTS][FOLLOWUP] Move compareAnswers into object QueryTest [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/21 08:21:48 UTC, 2 replies.
- [PR] [SPARK-56557][SQL][TESTS] Use abstract SparkSession in SparkPlanTest [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/21 08:31:01 UTC, 2 replies.
- Re: [PR] [SPARK-56550][SQL] Support source with fewer columns/fields in INSERT INTO WITH SCHEMA EVOLUTION [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2026/04/21 09:03:49 UTC, 9 replies.
- Re: [PR] [SPARK-54819][SQL][TESTS] Refactor basic test classes [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/21 09:24:05 UTC, 0 replies.
- [PR] [SPARK-56558][SQL] CTAS IF NOT EXISTS bypasses non-empty location check when table does not exist in catalog [spark] - posted by "planga82 (via GitHub)" <gi...@apache.org> on 2026/04/21 10:48:38 UTC, 1 replies.
- [PR] [SPARK-55910][SQL][TESTS][FOLLOWUP] Replace SQLTestUtils/SQLTestUtilsBase with QueryTest/QueryTestBase [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/21 11:33:18 UTC, 0 replies.
- [PR] [SPARK-55689][SQL] Add withSchemaEvolution() in dataframe writer API [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2026/04/21 12:56:31 UTC, 2 replies.
- [PR] [SQL] Enable dual runs for single-pass analyzer [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2026/04/21 13:00:40 UTC, 0 replies.
- [PR] [SPARK-56549][SQL] Dynamically enable k-way merge in `GroupPartitionsExec` only when parent requires ordering [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/04/21 13:14:27 UTC, 22 replies.
- [PR] [SPARK-XXXXX][SQL][Metric View] Extend V2 TableInfo for view definitions and dependencies [spark] - posted by "chenwang-databricks (via GitHub)" <gi...@apache.org> on 2026/04/21 13:49:48 UTC, 0 replies.
- Re: [PR] [SPARK-56546][SQL] Block-chunked segment-tree window frame for non-invertible sliding aggregates [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/04/21 14:19:14 UTC, 21 replies.
- Re: [PR] [SPARK-56013][SPARK-56024][BUILD] Upgrade `jaxb-runtime` to 4.0.6 and `jakarta.xml.bind-api` to 4.0.5 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/21 17:56:57 UTC, 0 replies.
- [PR] [SPARK-XXXXX][SQL] Add DSv2 table refresh infrastructure and temp vie… [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/21 20:21:26 UTC, 1 replies.
- [PR] Dsv2 pr2 repeated sql [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/21 20:22:21 UTC, 1 replies.
- [PR] Dsv2 pr3 joins [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/21 20:24:35 UTC, 1 replies.
- [PR] Dsv2 pr4 dataframe pinning [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/21 20:24:56 UTC, 1 replies.
- [PR] [SPARK-XXXXX][SQL][TESTS] Add DSv2 CACHE TABLE and write validation t… [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/21 20:27:32 UTC, 0 replies.
- [PR] [SPARK-XXXXX][CONNECT][TESTS] Add Connect temp view refresh tests [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/21 20:30:35 UTC, 0 replies.
- [PR] [SPARK-XXXXX][CONNECT][TESTS] Add Connect repeated SQL refresh tests [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/21 20:30:48 UTC, 0 replies.
- [PR] [SPARK-XXXXX][CONNECT][TESTS] Add Connect join refresh tests [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/21 20:31:01 UTC, 0 replies.
- [PR] [SPARK-XXXXX][CONNECT][TESTS] Add Connect DataFrame pinning tests [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/21 20:31:13 UTC, 0 replies.
- [PR] [SPARK-XXXXX][CONNECT][TESTS] Add Connect CACHE TABLE tests [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/21 20:31:22 UTC, 1 replies.
- [PR] [SPARK-55948][SQL][FOLLOWUP] Clarify rowVersion contract in DSv2 Changelog interface [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/04/21 20:37:58 UTC, 7 replies.
- [PR] [SPARK-XXXXX][SQL][TESTS] Add DSv2 table refresh infrastructure and t… [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/21 20:48:00 UTC, 0 replies.
- [PR] [SPARK-XXXXX][SQL][TESTS] Add DSv2 repeated SQL access refresh tests [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/21 20:48:21 UTC, 0 replies.
- [PR] [SPARK-XXXXX][SQL][TESTS] Add DSv2 join and set operation refresh tests [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/21 20:51:04 UTC, 0 replies.
- [PR] [SPARK-XXXXX][SQL][TESTS] Add DSv2 DataFrame version pinning tests [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/21 20:51:22 UTC, 1 replies.
- [PR] [SPARK-54560] Safe type filtering in QueryPlan._subqueries to prevent ClassCastException in AQE [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/04/21 21:07:12 UTC, 0 replies.
- [PR] [SPARK-54876][SQL] Fix splitSemiColon dropping statement ending with block comment [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/04/21 21:19:28 UTC, 0 replies.
- Re: [PR] [SPARK-56560][SQL][TESTS] Replace SQLTestUtils/SQLTestUtilsBase with QueryTest/QueryTestBase [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/04/21 22:01:32 UTC, 1 replies.
- [PR] [SPARK-56562][PYTHON][TESTS] Add ASV microbenchmark for SQL_GROUPED_AGG_PANDAS_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/21 22:23:36 UTC, 2 replies.
- Re: [I] Spark Declarative Pipelines and Unity Catalog [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/04/21 23:10:08 UTC, 3 replies.
- [PR] [SPARK-56539][SS] Add state row format validation to prefixScan and rangeScan [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/04/22 00:34:23 UTC, 0 replies.
- [PR] [SPARK-52729][SQL] Add MetadataOnlyTable in DS v2 API [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/22 01:32:55 UTC, 1 replies.
- [I] [SPARK] V2 DataSource write path throws SparkException instead of CommitDeniedException, causing spurious stage failures with speculation [spark] - posted by "wudanzy (via GitHub)" <gi...@apache.org> on 2026/04/22 01:59:58 UTC, 0 replies.
- [PR] [SPARK-55469][SQL] Fix V2 write path to use CommitDeniedException for proper speculation handling [spark] - posted by "wudanzy (via GitHub)" <gi...@apache.org> on 2026/04/22 02:00:49 UTC, 0 replies.
- [PR] [SPARK-56032][SQL][FOLLOWUP] Emit FilterExec CSE precomputes per-predicate to preserve short-circuit [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/22 02:54:20 UTC, 3 replies.
- [PR] [SPARK-56563][SQL][TESTS] Merge SparkPlanTest into QueryTest/QueryTestBase [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/22 03:53:51 UTC, 2 replies.
- [PR] [CONNECT][TESTS] Retry flaky python foreachBatch termination test [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/22 05:27:17 UTC, 0 replies.
- [PR] [SPARK-56566][SS] Stop applying prev lower bound to transformWithState timer scans [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/04/22 06:04:36 UTC, 2 replies.
- [PR] [SPARK-46367][SQL] Fix KeyedPartitioning not remapped through column aliases in ProjectExec [spark] - posted by "naveenp2708 (via GitHub)" <gi...@apache.org> on 2026/04/22 06:27:09 UTC, 6 replies.
- Re: [PR] [SPARK-7008][CONNECT][TESTS] Retry flaky python foreachBatch termination test [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/22 06:50:19 UTC, 0 replies.
- [PR] [SPARK-56567] Fix array_insert `Int.MinValue` pos overflow [spark] - posted by "aknayar (via GitHub)" <gi...@apache.org> on 2026/04/22 08:46:10 UTC, 2 replies.
- Re: [PR] [SPARK-56482][SQL] [SPARK-56482][SQL] Enable whole-stage codegen fusion for `UnionExec` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/22 08:51:29 UTC, 0 replies.
- [PR] [SPARK-56385][SQL][FOLLOWUP] Fix FIELD_NOT_FOUND when remapping pushed filters after nested schema pruning [spark] - posted by "anton5798 (via GitHub)" <gi...@apache.org> on 2026/04/22 10:01:59 UTC, 0 replies.
- [PR] [SPARK-56569] Add WINDOW_FUNCTION_FRAME_NOT_ORDERED error to replace _LEGACY_ERROR_TEMP_1037 [spark] - posted by "pnikic-db (via GitHub)" <gi...@apache.org> on 2026/04/22 10:28:59 UTC, 2 replies.
- [PR] [SPARK-XXXXX][CONNECT] Add DSv2 CACHE TABLE cross-session tests for S… [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/22 13:10:34 UTC, 0 replies.
- Re: [PR] [SPARK-46830][SQL] Fix collation strength for parameter markers in EXECUTE IMMEDIATE [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/22 13:24:58 UTC, 5 replies.
- [PR] [SPARK-56568][SQL] Add additional column ID test coverage for DSv2 Column.id() [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/22 15:31:58 UTC, 0 replies.
- [PR] [SPARK-56565][CONNECT][TESTS] Retry flaky python foreachBatch termination test [spark] - posted by "Feelitx (via GitHub)" <gi...@apache.org> on 2026/04/22 16:14:39 UTC, 6 replies.
- [PR] [SPARK-XXXXX] Upgrade Apache DataFusion Comet to 0.15.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/22 16:14:48 UTC, 1 replies.
- Re: [PR] [SPARK-52729][SQL] Add MetadataOnlyTable and CREATE/ALTER VIEW support for DS v2 catalogs [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/22 16:18:18 UTC, 8 replies.
- [PR] Introduce crds.install to Helm Chart [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2026/04/22 17:20:57 UTC, 0 replies.
- [PR] [SPARK-56570][SQL] `PlanMerger` code cleanup [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/04/22 18:00:36 UTC, 3 replies.
- Re: [PR] [SPARK-56115] Support `crds.install` in Helm Chart [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/22 18:09:06 UTC, 7 replies.
- [PR] [SPARK-56574] Add Java-friendly `KubernetesDriverSpec.getSystemPropertiesAsJavaMap` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/22 19:04:17 UTC, 0 replies.
- [PR] [SPARK-56576] Upgrade `dev.ludovic.netlib` to 3.2.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/22 19:17:20 UTC, 0 replies.
- [PR] [SPARK-56577] Upgrade `ap-loader` to 4.3-13 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/22 19:26:31 UTC, 0 replies.
- [PR] [SPARK-56578][BUILD] Upgrade `versions-maven-plugin` to 2.21.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/22 19:37:06 UTC, 4 replies.
- [PR] [Draft] Support METRIC_VIEW creation on V2 catalogs (stacks on #51419) [spark] - posted by "chenwang-databricks (via GitHub)" <gi...@apache.org> on 2026/04/22 19:38:09 UTC, 1 replies.
- [PR] [SPARK-56579] Upgrade `scala-maven-plugin` to 4.9.10 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/22 19:42:17 UTC, 0 replies.
- [PR] [SPARK-56580] Upgrade `netty-tcnative` to 2.0.76.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/22 19:47:44 UTC, 0 replies.
- [PR] [SPARK-56581] Upgrade `maven-jar-plugin` to 3.5.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/22 19:55:55 UTC, 0 replies.
- [PR] [SPARK-56582] Upgrade `snowflake-jdbc` to 4.1.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/22 20:03:16 UTC, 0 replies.
- Re: [PR] [SPARK-56567][SQL] Fix array_insert `Int.MinValue` pos overflow [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/22 20:18:14 UTC, 8 replies.
- [PR] [SPARK-56583][K8S] Use `--break-system-packages` to avoid PEP 668 error in PySpark Dockerfile [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/22 20:46:40 UTC, 1 replies.
- [PR] [SPARK-56572][SDP] Inject Spark session into Python files [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/04/22 20:51:23 UTC, 0 replies.
- Re: [PR] [SPARK-56583][K8S] Skip `pip` upgrade and use `--break-system-packages` to avoid PEP 668 error in PySpark Dockerfile [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/22 21:06:18 UTC, 22 replies.
- Re: [PR] [SPARK-56574][K8S] Add Java-friendly `KubernetesDriverSpec.getSystemPropertiesAsJavaMap` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/22 21:16:40 UTC, 2 replies.
- Re: [PR] [SPARK-56576][BUILD] Upgrade `dev.ludovic.netlib` to 3.2.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/22 21:17:31 UTC, 2 replies.
- Re: [PR] [SPARK-56577][BUILD] Upgrade `ap-loader` to 4.3-13 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/22 21:17:51 UTC, 3 replies.
- Re: [PR] [SPARK-56579][BUILD] Upgrade `scala-maven-plugin` to 4.9.10 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/22 21:18:16 UTC, 3 replies.
- Re: [PR] [SPARK-56580][BUILD] Upgrade `netty-tcnative` to 2.0.76.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/22 21:18:27 UTC, 3 replies.
- Re: [PR] [SPARK-56581][BUILD] Upgrade `maven-jar-plugin` to 3.5.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/22 21:18:36 UTC, 3 replies.
- Re: [PR] [SPARK-56582][BUILD][TESTS] Upgrade `snowflake-jdbc` to 4.1.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/22 21:18:45 UTC, 3 replies.
- Re: [PR] [SPARK-56547][SQL][CONNECT] Improve error message when DataFrame column is referenced from a wrong DataFrame [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/04/22 21:47:19 UTC, 1 replies.
- [PR] [SPARK-56584][PYTHON] Generalize RESULT_TYPE_MISMATCH_FOR_ARROW_UDF error class and remove dead SCHEMA_MISMATCH_FOR_ARROW_PYTHON_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/23 00:15:32 UTC, 0 replies.
- Re: [PR] [SPARK-56584][PYTHON] Generalize `RESULT_TYPE_MISMATCH_FOR_ARROW_UDF` error class and remove dead `SCHEMA_MISMATCH_FOR_ARROW_PYTHON_UDF` [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/23 00:29:18 UTC, 2 replies.
- [PR] [SPARK-56477][PYTHON] Refactor SQL_GROUPED_MAP_PANDAS_UDF to be self-contained in read_udfs [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/23 00:30:36 UTC, 0 replies.
- Re: [PR] [SPARK-53758] Fix EXIT handler not exiting properly if triggered from another EXIT handler [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/23 00:50:18 UTC, 1 replies.
- Re: [PR] [SPARK-54985][CORE] Show memory usage when task memory manager can't allocate memory page [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/23 00:50:19 UTC, 1 replies.
- Re: [PR] Prototype: support eager analysis inside Pipelines query functions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/23 00:50:22 UTC, 1 replies.
- Re: [PR] [SPARK-54919][SQL] Remove AgnosticExpressionPathEncoder usage tech-debt [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/23 00:50:24 UTC, 1 replies.
- Re: [PR] [CORE][SPARK-49788] Add optional TTL based cleaning for blocks to better support notebooks [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/23 00:50:27 UTC, 1 replies.
- [PR] [SPARK-56585][SQL][TESTS] Replace SparkPlanTest with QueryTest [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/23 01:10:37 UTC, 2 replies.
- Re: [PR] [SPARK-56586][CONNECT][TESTS] Retry flaky python foreachBatch termination test [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/23 02:34:10 UTC, 0 replies.
- [PR] [SPARK-56508][SQL][TESTS][FOLLOWUP] Stabilize VectorizedRleValuesReaderBenchmark Group `runBooleanBenchmark/runIntegerBenchmark` with a pre-warm pass [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/23 02:34:29 UTC, 1 replies.
- [PR] [SPARK-55959][SQL][FOLLOWUP] Gate map-lookup hash optimization on foldable input [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/23 02:39:51 UTC, 10 replies.
- [PR] [SPARK-56522][SQL][TESTS][FOLLOWUP] Replace em-dash with ASCII in `VectorizedRleValuesReaderSuite` docstring [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/23 03:55:33 UTC, 3 replies.
- [PR] [SPARK-40193][SQL][FOLLOWUP] Restrict cached-side If wrapping to original cached range [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/23 05:35:16 UTC, 3 replies.
- [PR] [SPARK-56590] Add Java-friendly getters for driver resources of `KubernetesDriverSpec` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/23 05:47:31 UTC, 0 replies.
- [PR] [SPARK-56589][CORE] Use Virtual Threads for BlockManagerMasterEndpoint ask thread pool [spark] - posted by "moomindani (via GitHub)" <gi...@apache.org> on 2026/04/23 05:49:58 UTC, 2 replies.
- [PR] [SPARK-XXXXX][SQL][TESTS] Remove redundant QueryTest mixin from SharedSparkSession subclasses [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/23 06:25:37 UTC, 0 replies.
- Re: [PR] [SPARK-56571] Upgrade `Apache DataFusion Comet` to 0.15.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/23 06:27:35 UTC, 3 replies.
- Re: [PR] [SPARK-55882][SQL] Rename `_LEGACY_ERROR_TEMP_1048` to `INVALID_COALESCE_HINT_PARAMETER` [spark] - posted by "anshulbaliga7 (via GitHub)" <gi...@apache.org> on 2026/04/23 06:31:39 UTC, 0 replies.
- [PR] [SPARK-56592][K8S] Skip upgrading setuptools in K8s PySpark Dockerfile [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/04/23 07:02:13 UTC, 2 replies.
- [PR] [SPARK-56186][PYTHON][INFRA][FOLLOWUP] Cleanup remaining PyPy related code [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/04/23 07:22:39 UTC, 3 replies.
- Re: [PR] [SPARK-56385][SQL][FOLLOW-UP] Fix FIELD_NOT_FOUND when remapping pushed filters after nested schema pruning [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/23 07:35:00 UTC, 3 replies.
- [PR] [SPARK-56032][SQL][FOLLOWUP] Defer throw-capable notNullPreds past guard otherPreds in FilterExec CSE codegen [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/23 09:10:55 UTC, 6 replies.
- [PR] [SPARK-55668][SQL] Add ChangelogTable schema validation and INVALID_CHANGELOG_SCHEMA error class [spark] - posted by "SanJSp (via GitHub)" <gi...@apache.org> on 2026/04/23 11:17:16 UTC, 0 replies.
- [PR] [SPARK-55668][SQL] Add ResolveChangelogTable analyzer rule for batch CDC post-processing [spark] - posted by "SanJSp (via GitHub)" <gi...@apache.org> on 2026/04/23 11:21:58 UTC, 0 replies.
- [PR] [SQL][TESTS] Move non-anyfun helpers from QueryTest to QueryTestBase [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/23 11:42:23 UTC, 0 replies.
- Re: [PR] [SPARK-56568][SQL] Add id() to DSv2 Column to detect drop-and-re-add columns at refresh time [spark] - posted by "andreaschat-db (via GitHub)" <gi...@apache.org> on 2026/04/23 12:27:31 UTC, 21 replies.
- Re: [PR] [SPARK-55951][SQL] Add ChangelogTable schema validation and INVALID_CHANGELOG_SCHEMA error class [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2026/04/23 13:40:42 UTC, 12 replies.
- Re: [PR] [SPARK-55952][SPARK-55953][SQL] Add ResolveChangelogTable analyzer rule for batch CDC post-processing [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2026/04/23 14:01:03 UTC, 26 replies.
- [PR] [SPARK-56587][SQL] Show table names for V2 write nodes in UI [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2026/04/23 14:05:03 UTC, 6 replies.
- [PR] [SQL] Custom metrics support for TruncatableTable [spark] - posted by "ZiyaZa (via GitHub)" <gi...@apache.org> on 2026/04/23 14:49:57 UTC, 0 replies.
- Re: [PR] [SPARK-56590][K8S] Add Java-friendly getters for driver resources of `KubernetesDriverSpec` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/23 15:35:46 UTC, 1 replies.
- [PR] [SPARK-56600] Promote `SparkPod` to `Stable` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/23 16:10:26 UTC, 0 replies.
- Re: [PR] [SPARK-56600][K8S] Promote `SparkPod` to `Stable` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/23 16:14:10 UTC, 2 replies.
- [PR] [SPARK-56601] Promote `KubernetesClientUtils` to `Stable` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/23 16:54:02 UTC, 0 replies.
- Re: [PR] [SPARK-56570][SQL] `PlanMerger` correctness fix and code cleanup [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/04/23 16:55:39 UTC, 3 replies.
- Re: [PR] [SPARK-56601][K8S] Promote `KubernetesClientUtils` to `Stable` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/23 16:59:49 UTC, 2 replies.
- [PR] [SPARK-56602] Promote `KubernetesVolumeUtils` to `Stable` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/23 17:11:40 UTC, 0 replies.
- [PR] [WIP][SPARK-56324] Introducing ZeroCopyByteStream for PySpark message-base… [spark] - posted by "sven-weber-db (via GitHub)" <gi...@apache.org> on 2026/04/23 17:15:27 UTC, 0 replies.
- Re: [PR] [SPARK-56602][K8S] Promote `KubernetesVolumeUtils` to `Stable` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/23 17:22:49 UTC, 4 replies.
- [PR] [SPARK-56551][SQL][FOLLOWUP] Add DSv2 DML tests with always true/false filters [spark] - posted by "ZiyaZa (via GitHub)" <gi...@apache.org> on 2026/04/23 17:32:26 UTC, 0 replies.
- [PR] [SPARK-56604] Promote `KubernetesDriverBuilder` to `Stable` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/23 17:41:33 UTC, 0 replies.
- Re: [PR] [SPARK-56604][K8S] Promote `KubernetesDriverBuilder` to `Stable` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/23 17:45:03 UTC, 4 replies.
- [PR] [SPARK-56599][SQL] Add scan narrowing for column-level UPDATEs in DSv2 [spark] - posted by "anuragmantri (via GitHub)" <gi...@apache.org> on 2026/04/23 18:30:06 UTC, 1 replies.
- [PR] [SPARK-46367][SQL] Support narrowing projection of `KeyedPartitioning` in `PartitioningPreservingUnaryExecNode` [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/04/23 18:44:28 UTC, 8 replies.
- [PR] [SPARK-54810][SQL] Improve error context in CheckAnalysis for view body resolution [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/04/23 20:02:15 UTC, 1 replies.
- [PR] [SPARK-56605][SQL] Improve error context in CheckAnalysis for view body resolution [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/04/23 20:22:05 UTC, 2 replies.
- [PR] [SPARK-54090][PYTHON] Fix cascading diff in assertDataFrameEqual when row counts differ [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/23 20:33:57 UTC, 3 replies.
- [PR] [SPARK-56605][SQL] Wire resolution engine to use SQL PATH for table, function, and variable lookup [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/04/23 20:45:53 UTC, 21 replies.
- [PR] [SPARK-56387][PYTHON][FOLLOWUP] Keep the original profiler result and create v2 for new format [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/23 22:48:21 UTC, 2 replies.
- [PR] [SPARK-56606][SQL] Bump embedded SRS registry to PROJ 9.8.1 [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/04/23 23:05:33 UTC, 2 replies.
- [PR] [SPARK-56607][PYTHON] Remove unnecessary __new__ and __init__ [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/24 00:40:47 UTC, 4 replies.
- Re: [PR] [WIP][FOLLOW-ON][SPARK-55014][SQL] Split projection with splitting complex non-pushable filters [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/24 00:50:50 UTC, 1 replies.
- Re: [PR] [SPARK-56595][SQL][TESTS] Move non-anyfun helpers from QueryTest to QueryTestBase [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/24 03:52:38 UTC, 1 replies.
- Re: [PR] [SPARK-56591][SQL][TESTS] Remove redundant QueryTest mixin from SharedSparkSession subclasses [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/24 04:44:03 UTC, 1 replies.
- [PR] [SPARK-55726][PYTHON][TEST][FOLLOW-UP] Write grouped benchmark data as one Arrow IPC stream per DataFrame [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/24 04:50:34 UTC, 2 replies.
- [PR] [SPARK-56610][INFRA] Make JIRA connect timeout configurable in merge_spark_pr.py [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/24 07:19:30 UTC, 2 replies.
- [PR] [SPARK-56609][SQL][TESTS] Remove redundant SparkFunSuite mixin from QueryTest/PlanTest subclasses [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/24 07:25:23 UTC, 2 replies.
- [PR] [SPARK-56608][PYTHON] Migrate grouped/cogrouped map Arrow UDF verify checks into enforce_schema [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/24 07:41:01 UTC, 0 replies.
- [PR] [SQL] Add config for strict DataFrame column resolution [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/24 08:02:07 UTC, 0 replies.
- [PR] [SPARK-56612][PYTHON] Unify verify_result and container-type checks into verify_return_type helper [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/24 08:20:11 UTC, 9 replies.
- [PR] [SPARK-56613][CORE] Supports displaying all partition parameters [spark] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2026/04/24 08:37:12 UTC, 1 replies.
- [I] Support Catalog Store [spark] - posted by "melin (via GitHub)" <gi...@apache.org> on 2026/04/24 11:08:02 UTC, 2 replies.
- [PR] [SPARK-56594][SQL] Add time_bucket scalar function [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/04/24 11:17:26 UTC, 16 replies.
- [PR] [SPARK-54022][SQL][TESTS] Add CACHE TABLE scenario 3, 4, 5 tests and reorganize cache tests [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/24 12:27:25 UTC, 0 replies.
- [PR] [SPARK-56616] [SQL] Make `UnresolvedPipeAggregateOrdinal` extend `NamedExpression` directly [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/04/24 12:47:53 UTC, 3 replies.
- [PR] [SPARK-56615][SQL] Clarify `KeyedPartitioning` `satisfies0()` and `nonGroupedSatisfies()`/`groupedSatisfies()` contract [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/04/24 13:20:40 UTC, 8 replies.
- Re: [PR] Enable -Xsource:3 compiler flag [spark] - posted by "joan38 (via GitHub)" <gi...@apache.org> on 2026/04/24 14:56:00 UTC, 0 replies.
- [PR] [SPARK-56620][SQL] Fix stale entries in RuleIdCollection [spark] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2026/04/24 15:40:20 UTC, 2 replies.
- [PR] [SPARK-56621] Update CI to test K8s 1.36 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/24 15:44:54 UTC, 4 replies.
- [PR] [SPARK-XXXXX][SQL][TESTS] Add DSv2 temp view with stored plan tests [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/24 15:51:00 UTC, 0 replies.
- [PR] [SPARK-56622][K8S][INFRA] Update K8s IT CI to use K8s 1.36 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/24 16:01:23 UTC, 3 replies.
- [PR] [SPARK] Strengthen array_position collation coverage [spark] - posted by "aknayar (via GitHub)" <gi...@apache.org> on 2026/04/24 16:10:51 UTC, 0 replies.
- [PR] [SPARK-56623][K8S] Promote `KubernetesDriverSpec` to `Stable` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/24 16:14:07 UTC, 2 replies.
- [PR] [SPARK-56624] Promote `KubernetesUtils` to `Stable` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/24 16:45:43 UTC, 1 replies.
- [PR] [SPARK-46160][PYTHON] Add axis parameter to DataFrame.shift in pandas API on Spark [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/04/24 16:49:19 UTC, 0 replies.
- Re: [PR] [SPARK-56624][K8S] Promote `KubernetesUtils` to `Stable` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/24 17:18:29 UTC, 2 replies.
- [PR] [SPARK-XXXXX][SQL] Introduce SupportsReportCatalogStatistics mixin for Table [spark] - posted by "anton5798 (via GitHub)" <gi...@apache.org> on 2026/04/24 19:19:32 UTC, 0 replies.
- Re: [PR] [SPARK-56626][SQL] Introduce SupportsReportCatalogStatistics mixin for Table [spark] - posted by "yyanyy (via GitHub)" <gi...@apache.org> on 2026/04/24 19:41:24 UTC, 2 replies.
- [PR] [SPARK-56611][SQL] Fix ALTER TABLE RENAME TO with catalog-qualified and table-only targets [spark] - posted by "lunar-shadow (via GitHub)" <gi...@apache.org> on 2026/04/24 19:58:46 UTC, 11 replies.
- [PR] [SPARK-56628] Update `lombok` to 1.18.46 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/24 22:39:19 UTC, 3 replies.
- Re: [PR] [SPARK-54921][CORE] Add parentIds in StageData [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/25 00:46:06 UTC, 1 replies.
- Re: [PR] [SPARK-54725][SQL] Add inferring transitive join conditions in CostBasedJoinReorder [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/25 00:46:11 UTC, 1 replies.
- [PR] [SPARK-56630][INFRA] Surface javadoc crash culprit in unidoc failure output [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/25 03:39:48 UTC, 3 replies.
- [PR] [SPARK-56561][DOCS] Document order preservation for array_distinct, array_intersect, array_union, array_except [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/04/25 03:49:39 UTC, 2 replies.
- [PR] [SPARK-47444][SQL] Validate numeric table stats in ALTER TABLE SET TBLPROPERTIES [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/04/25 07:17:20 UTC, 2 replies.
- [PR] [SPARK-56629][PYTHON][TESTS] Add ASV microbenchmark for SQL_COGROUPED_MAP_PANDAS_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/25 14:20:01 UTC, 2 replies.
- Re: [PR] [SPARK-37328][SQL] Fix bug that OptimizeSkewedJoin may not work after it was moved from queryStageOptimizerRules to queryStagePreparationRules. [spark] - posted by "boryaferz (via GitHub)" <gi...@apache.org> on 2026/04/25 21:14:31 UTC, 0 replies.
- [PR] [SPARK-XXXXX][SQL] Add pipelined JVM-Python UDF data transfer [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/04/26 06:20:12 UTC, 1 replies.
- Re: [PR] [SPARK-56625][SPARK][SQL][TESTS] Strengthen array_position collation coverage [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/26 17:15:41 UTC, 1 replies.
- Re: [PR] [SPARK-56614][SQL][CONNECT] Add config for strict DataFrame column resolution [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/04/26 22:53:38 UTC, 1 replies.
- [I] [GRAPHX] Fix sccWorkGraph cache leak in StronglyConnectedComponents [spark] - posted by "dkranchii (via GitHub)" <gi...@apache.org> on 2026/04/27 01:32:03 UTC, 0 replies.
- [PR] [SPARK-55553][GRAPHX] Unpersist sccWorkGraph in StronglyConnectedComponents [spark] - posted by "dkranchii (via GitHub)" <gi...@apache.org> on 2026/04/27 02:42:45 UTC, 0 replies.
- [PR] [SPARK-56631][DOC] Update `addressable` gem version to 2.9.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/27 03:06:23 UTC, 3 replies.
- [PR] [SPARK-XXXXX][SQL][CONNECT] Prefer output match over hidden-column match in DataFrame column resolution [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/27 05:51:06 UTC, 0 replies.
- Re: [PR] [SPARK-56482][SQL] Enable whole-stage codegen fusion for `UnionExec` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/27 06:35:56 UTC, 18 replies.
- [PR] [SPARK-56591][SQL][TESTS][FOLLOWUP] Remove redundant QueryTest mixin from SharedSparkSession subclasses [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/27 07:14:00 UTC, 2 replies.
- [PR] [SPARK-56633][SQL][TESTS] Add comprehensive Parquet vectorized-reader benchmark coverage [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/27 07:59:11 UTC, 1 replies.
- [PR] [MINOR][PS] Replace curly quotes with ASCII in pandas-on-Spark index comments [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/27 08:58:20 UTC, 0 replies.
- [PR] [SPARK-56634][PYTHON][TESTS] Add __main__ block to pyspark.sql.tests.connect.test_session [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/27 09:23:23 UTC, 2 replies.
- [PR] [SPARK-47998][PS] Support native pandas inputs in pandas-on-Spark concat [spark] - posted by "hvph-uyen (via GitHub)" <gi...@apache.org> on 2026/04/27 10:31:36 UTC, 2 replies.
- Re: [PR] [MINOR][PS][DOCS] Replace curly quotes with ASCII in pandas-on-Spark index comments [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/27 12:41:38 UTC, 1 replies.
- [PR] [MINOR][PS][DOCS] Replace ellipsis with ASCII in pandas-on-Spark DataFrame docstrings [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/27 12:46:53 UTC, 2 replies.
- [PR] [SPARK-56636][INFRA] Surface scalastyle, unidoc and compile errors as PR annotations [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/27 13:11:24 UTC, 0 replies.
- [PR] [SPARK-56364][BUILD][TESTS][FOLLOWUP] Expand pathing JARs in createJarWithScalaSources [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/27 14:10:23 UTC, 3 replies.
- [PR] [SPARK-56640] Upgrade `commons-io` to 2.22.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/27 17:37:24 UTC, 0 replies.
- [PR] [SPARK-56641][BUILD] Upgrade `commons-codec` to 1.22.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/27 17:39:39 UTC, 4 replies.
- Re: [PR] [DO NOT MERGE][SPARK-55951][SQL] Add ChangelogTable schema validation and INVALID_CHANGELOG_SCHEMA error class [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/04/27 19:04:40 UTC, 2 replies.
- [PR] Spark 56639 frozen path semantics [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/04/27 19:42:36 UTC, 0 replies.
- Re: [I] [SPARK-52428] Column missing comparison methods (gt, lt, ge, le) [spark-connect-rust] - posted by "sjrusso8 (via GitHub)" <gi...@apache.org> on 2026/04/27 19:54:17 UTC, 0 replies.
- Re: [PR] [SPARK-56640][BUILD] Upgrade `commons-io` to 2.22.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/27 20:01:33 UTC, 4 replies.
- Re: [PR] [SPARK-56643][SQL][TESTS] Add DSv2 temp view with stored plan tests [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/27 21:13:11 UTC, 7 replies.
- [PR] [SPARK-56643][SQL][TESTS] Add DSv2 temp view with stored plan tests-clone [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/27 21:21:27 UTC, 0 replies.
- [PR] [SPARK-56643][CONNECT][TESTS] Add DSv2 temp view with stored plan tests using Spark Connect mode [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/27 21:21:42 UTC, 3 replies.
- [PR] [SPARK-56619][CONNECT][TESTS] Add DSv2 repeated table access tests with internal/external changes in Spark Connect-clone [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/27 21:39:12 UTC, 1 replies.
- Re: [PR] [SPARK-56619][CONNECT][TESTS] Add DSv2 repeated table access tests with internal/external changes in Spark Connect [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/27 21:39:21 UTC, 1 replies.
- [PR] [SPARK-56644] Support periodic GC [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/27 21:58:50 UTC, 3 replies.
- [PR] [WIP][CONNECT][PYTHON] Add SQLContext wrapper for Spark Connect [spark] - posted by "dbtsai (via GitHub)" <gi...@apache.org> on 2026/04/27 22:05:30 UTC, 8 replies.
- [I] PushPredicateThroughNonJoin assertion failure when pushing filter through Project into Union (Hive view) [spark] - posted by "arthurli-dotcom (via GitHub)" <gi...@apache.org> on 2026/04/28 03:16:45 UTC, 1 replies.
- Re: [PR] [SPARK-56636][INFRA] Decouple style checks from compile and surface scalastyle violations as PR annotations [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/28 04:59:43 UTC, 0 replies.
- Re: [PR] [SPARK-56632][SQL][CONNECT] Fix AMBIGUOUS_COLUMN_REFERENCE regression for reused DataFrame in natural join [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/28 07:25:28 UTC, 8 replies.
- [PR] [SPARK-56551][SQL][FOLLOW-UP] Fix setting numDeletedRows metric as -1 [spark] - posted by "ZiyaZa (via GitHub)" <gi...@apache.org> on 2026/04/28 07:51:39 UTC, 6 replies.
- Re: [PR] [SPARK-54022][SPARK-56617][CONNECT][TESTS] Add DSv2 CACHE TABLE tests using Spark Connect [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/28 08:15:24 UTC, 1 replies.
- [PR] [SPARK-56645][CORE] Fix History Server serving stale UI after app completes [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2026/04/28 08:29:37 UTC, 0 replies.
- [PR] [SPARK-30628][SQL] Support DPP and subquery partition pruning for V2 file sources [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/28 08:59:03 UTC, 0 replies.
- [PR] Project DSv2 leaf node to Scan's schema [spark] - posted by "PorridgeSwim (via GitHub)" <gi...@apache.org> on 2026/04/28 09:42:35 UTC, 0 replies.
- [PR] [SPARK-56630][INFRA][FOLLOWUP] Make unidoc surface real javadoc failures [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2026/04/28 09:50:01 UTC, 3 replies.
- [PR] [SPARK-55953][SQL] Compute net changes in ResolveChangelogTable for batch CDC reads [spark] - posted by "SanJSp (via GitHub)" <gi...@apache.org> on 2026/04/28 12:55:12 UTC, 11 replies.
- Re: [PR] [SPARK-56551][SQL][FOLLOW-UP] Add DSv2 DML tests with always true/false filters [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/04/28 14:41:15 UTC, 0 replies.
- Re: [PR] [SPARK-56598][SQL] Custom metrics support for TruncatableTable [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/04/28 16:03:17 UTC, 8 replies.
- Re: [PR] [SPARK-56642][SQL] Add pipelined JVM-Python UDF data transfer [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/28 16:11:10 UTC, 19 replies.
- [PR] [SPARK-56646] Document K8s executor resize and recovery mode configs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/28 16:44:32 UTC, 0 replies.
- Re: [PR] [SPARK-56646][K8S][DOCS] Document K8s executor resize and recovery mode configs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/28 16:50:50 UTC, 3 replies.
- [PR] [SPARK-56647][SQL] Optimize storage of SparkSQL Last Attempt Metrics [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2026/04/28 17:29:12 UTC, 3 replies.
- Re: [PR] [SPARK-54119] Support METRIC_VIEW creation on V2 catalogs [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/28 17:58:06 UTC, 1 replies.
- [PR] [WIP][SQL] DSv2 INSERT and Insert-Only MERGE Metrics [spark] - posted by "ZiyaZa (via GitHub)" <gi...@apache.org> on 2026/04/28 17:59:30 UTC, 0 replies.
- Re: [PR] [SPARK-54647][PYTHON] Support User-Defined Aggregate Functions (UDAF) [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/04/28 18:45:33 UTC, 1 replies.
- [PR] [SPARK-52729][SQL][FOLLOWUP] Rename MetadataOnlyTable to MetadataTable and RelationCatalog to TableViewCatalog [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/04/28 20:02:07 UTC, 1 replies.
- [PR] [SPARK-56650][SDP|CONNECT] Add AutoCDC Spark Connect APIs [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/04/28 21:40:14 UTC, 0 replies.
- [PR] [SPARK-XXXXX][SQL] Always emit RELY/NORELY in DESCRIBE EXTENDED constraint output [spark] - posted by "yyanyy (via GitHub)" <gi...@apache.org> on 2026/04/28 22:16:35 UTC, 0 replies.
- Re: [PR] [SPARK-56652][SQL] Always emit RELY/NORELY in DESCRIBE EXTENDED constraint output [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/04/29 00:02:01 UTC, 3 replies.
- [PR] [SPARK-56653] Document `spark.kubernetes.(allocation.maxPendingPodsPerRp|driver.annotateExitException|executor.useDriverPodIP)` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/29 00:50:30 UTC, 0 replies.
- Re: [PR] [SPARK-56653][K8S][DOCS] Document `spark.kubernetes.(executor.useDriverPodIP|allocation.maxPendingPodsPerRp|driver.annotateExitException)` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/29 01:08:56 UTC, 3 replies.
- [PR] Spark 54810 final polish [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/04/29 02:07:34 UTC, 0 replies.
- Re: [PR] [SPARK-56134][SQL] Make BufferedRowIterator.unsafeRow public to avoid IllegalAccessError. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2026/04/29 02:19:40 UTC, 2 replies.
- [PR] [SPARK-56655][SQL] Implement remaining v2 view DDL and inspection commands [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/29 03:52:52 UTC, 2 replies.
- [PR] docs: suggest documentation improvements for better user experience [spark] - posted by "myhearwillgoon (via GitHub)" <gi...@apache.org> on 2026/04/29 04:09:41 UTC, 12 replies.
- [PR] [SPARK-52857] Add is_valid_variant expression. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2026/04/29 06:02:26 UTC, 2 replies.
- [PR] [SPARK-56649][PYTHON][TESTS] Add ASV microbenchmark for SQL_GROUPED_MAP_PANDAS_ITER_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/29 07:02:09 UTC, 2 replies.
- [PR] [SPARK-56657][PYTHON][TESTS] Add ASV microbenchmark for SQL_MAP_PANDAS_ITER_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/29 07:14:09 UTC, 2 replies.
- [PR] [SPARK-56659][SQL] Show function resources in DESCRIBE FUNCTION output [spark] - posted by "TongWei1105 (via GitHub)" <gi...@apache.org> on 2026/04/29 07:15:41 UTC, 1 replies.
- [PR] [SPARK-56658][PYTHON][TESTS] Add ASV microbenchmark for SQL_WINDOW_AGG_PANDAS_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/29 07:16:07 UTC, 2 replies.
- Re: [PR] [SPARK-55855][SQL][DML] DSv2 Transaction API foundations [spark] - posted by "andreaschat-db (via GitHub)" <gi...@apache.org> on 2026/04/29 07:36:14 UTC, 0 replies.
- [PR] [SPARK-56614][SQL][CONNECT][TESTS][FOLLOWUP] Pin strictDataFrameColumnResolution=true for lazy column validation test [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/29 08:39:58 UTC, 2 replies.
- Re: [PR] [SPARK-56639][SQL] frozen path semantics [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/29 09:28:30 UTC, 7 replies.
- Re: [PR] [SPARK-56634][PYTHON][TESTS] Enable and fix pyspark.sql.tests.connect.test_session [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/29 10:16:41 UTC, 3 replies.
- Re: [PR] [SPARK-56636][INFRA] Decouple scalastyle from compile + clean up unidoc log noise [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/29 11:30:05 UTC, 1 replies.
- [PR] [DO NOT MERGE] Test PR #55581's unidoc diagnostic banner [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/29 11:40:43 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-56586][CONNECT][TESTS] Retry flaky python foreachBatch termination test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/04/29 11:49:10 UTC, 1 replies.
- [PR] [SPARK-55794][SQL] Wrap outer star expansion results in Alias in ResolveReferences [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2026/04/29 12:40:11 UTC, 0 replies.
- [PR] [SPARK-56662][PYTHON][TESTS] Fix mixin/base inheritance order in PySpark test classes [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/29 13:00:55 UTC, 3 replies.
- Re: [PR] [SPARK-55855][SQL][DML] DSv2 Transaction Management [spark] - posted by "andreaschat-db (via GitHub)" <gi...@apache.org> on 2026/04/29 13:05:48 UTC, 13 replies.
- [PR] [PYTHON][TESTS] Drop legacy `(object)` base from PySpark test mixins [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/29 13:28:19 UTC, 0 replies.
- [I] [SPARK] Memory pressure during block fetching of cached tables causes excessive memory usage [spark] - posted by "nellaivijay (via GitHub)" <gi...@apache.org> on 2026/04/29 13:29:55 UTC, 1 replies.
- Re: [PR] [SPARK-54810] PATH final polish [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/04/29 15:18:36 UTC, 1 replies.
- [PR] [SPARK-56663][SQL] Restore fast path for date_trunc MINUTE/HOUR/DAY [spark] - posted by "Licht-T (via GitHub)" <gi...@apache.org> on 2026/04/29 15:51:44 UTC, 0 replies.
- [PR] [SPARK-56665] Use `gradle:9.4.1-jdk26-noble` Docker image for builder stage [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/29 17:20:10 UTC, 3 replies.
- [PR] [WIP][SPARK-56661] Adding language-agnosic UDF logical and physical planning nodes [spark] - posted by "sven-weber-db (via GitHub)" <gi...@apache.org> on 2026/04/29 17:29:48 UTC, 0 replies.
- Re: [PR] [SPARK-56666][INFRA] Reduce unidoc CI log noise with -Xdoclint:-missing and -verbose post-filter [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/29 18:32:36 UTC, 2 replies.
- [PR] [SPARK-56667] Upgrade `Gradle` to 9.5.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/29 18:34:57 UTC, 3 replies.
- Re: [PR] [SPARK-54119][SQL] Extend V2 TableInfo for view definitions and dependencies [spark] - posted by "chenwang-databricks (via GitHub)" <gi...@apache.org> on 2026/04/29 19:34:03 UTC, 0 replies.
- [PR] [SPARK-56668] Upgrade `actions/setup-java` to v5 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/29 20:36:06 UTC, 3 replies.
- [PR] [SPARK-56669][SQL] Implement group filtering for WriteDelta row level operations [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/04/29 21:04:45 UTC, 10 replies.
- [PR] [SPARK-56648][PYTHON] Refactor SQL_SCALAR_PANDAS_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/04/29 21:24:52 UTC, 0 replies.
- [PR] [SPARK-56575][CORE] Extract scheduleResubmit() helper to remove identical code blocks [spark] - posted by "jiangxb1987 (via GitHub)" <gi...@apache.org> on 2026/04/29 23:10:27 UTC, 2 replies.
- Re: [PR] [MINOR][PYTHON][TESTS] Drop legacy `(object)` base from PySpark test mixins [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/30 00:40:56 UTC, 1 replies.
- Re: [PR] [SPARK-49110][SQL] Fix reading metadata columns for tables with CHAR columns [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/30 00:54:34 UTC, 1 replies.
- [PR] [SPARK-56670][K8S] Restrict `ExecutorResizePlugin` to `direct` pods allocator [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/30 01:16:15 UTC, 4 replies.
- Re: [PR] [SPARK-56477][PYTHON] Refactor SQL_GROUPED_MAP_PANDAS_UDF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/30 02:13:11 UTC, 2 replies.
- Re: [PR] [SPARK-56312][PYTHON] Refactor SQL_COGROUPED_MAP_ARROW_UDF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/30 02:13:46 UTC, 0 replies.
- [PR] [SPARK-56672][SQL] Rename TableViewCatalog.listRelationSummaries to listTableAndViewSummaries [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/04/30 03:04:15 UTC, 3 replies.
- [PR] [PYTHON][TESTS] Merge connect.test_session into connect.test_connect_session [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/30 04:48:29 UTC, 0 replies.
- [PR] [MINOR][PYTHON][TESTS] Rename `test_resources` to `test_parity_resources` for Connect parity convention [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/30 04:48:50 UTC, 2 replies.
- [PR] [INFRA] Document test base class hierarchy in AGENTS.md [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/30 04:48:55 UTC, 0 replies.
- [PR] [SPARK-56674][SS] Add streaming shuffle wire protocol [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/04/30 06:15:31 UTC, 0 replies.
- [PR] [SPARK-56588][CORE] Fix PathOutputCommitProtocol dynamic partition overwrite [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/04/30 10:08:37 UTC, 1 replies.
- Re: [PR] [SPARK-56673][PYTHON][TESTS] Merge connect.test_session into connect.test_connect_session [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/04/30 10:38:52 UTC, 1 replies.
- [I] Helm chart renders invalid YAML for config map [spark-kubernetes-operator] - posted by "gregory-ludwinski (via GitHub)" <gi...@apache.org> on 2026/04/30 10:59:42 UTC, 3 replies.
- Re: [PR] [SPARK-56588][CORE] Fix `PathOutputCommitProtocol` dynamic partition overwrite [spark] - posted by "steveloughran (via GitHub)" <gi...@apache.org> on 2026/04/30 11:10:55 UTC, 9 replies.
- [PR] [WIP][SQL][DML] DSv2 Transaction API Improvements [spark] - posted by "andreaschat-db (via GitHub)" <gi...@apache.org> on 2026/04/30 11:57:07 UTC, 0 replies.
- Re: [PR] [SPARK-54022][SPARK-56617][SQL][TESTS] Add more CACHE TABLE tests and reorganize CACHE TABLE tests [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/04/30 12:25:14 UTC, 0 replies.
- [PR] [SPARK-56675][BUILD] Make sbt publishLocal work [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/04/30 13:12:57 UTC, 0 replies.
- [PR] [SPARK-XXXXX][SQL] Use structured Catalog/Namespace/Table rows in DESCRIBE TABLE EXTENDED for v2 tables and views [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/04/30 14:07:16 UTC, 0 replies.
- Re: [PR] [SPARK-56661] Introducing logical and physical planning nodes for language-agnostic Spark UDFs [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2026/04/30 14:40:32 UTC, 9 replies.
- [PR] [SPARK-55810][UI] Fix missing spacing between table and pagination controls in Jobs and Stages page [spark] - posted by "XdithyX (via GitHub)" <gi...@apache.org> on 2026/04/30 15:29:03 UTC, 1 replies.
- [PR] [WIP][SQL][DML] Forbid Multi-catalog operations in Transactional Writes [spark] - posted by "andreaschat-db (via GitHub)" <gi...@apache.org> on 2026/04/30 15:30:32 UTC, 0 replies.
- [PR] [SPARK-56677][SQL] Propagate filter conditions through `Join` nodes in `PlanMerger` [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/04/30 16:16:52 UTC, 10 replies.
- [PR] [SPARK-56679] Fix Helm chart to render valid YAML for operator ConfigMap [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/30 16:38:07 UTC, 3 replies.
- [PR] [SPARK-56395][SQL] Add NEAREST BY top-K ranking join (catalyst-side) [spark] - posted by "dilipbiswal (via GitHub)" <gi...@apache.org> on 2026/04/30 16:49:52 UTC, 1 replies.
- [PR] [SPARK-56607][PYTHON][FOLLOWUP] Use pyspark.sql.DataFrame to support connect-only [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/30 18:04:47 UTC, 1 replies.
- Re: [PR] [SPARK-56324] Add ZeroCopyByteStream to enable PySpark <-> Spark message-based communication [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/30 19:01:33 UTC, 0 replies.
- [PR] [SPARK-56682][Geo][CONNECT][PYTHON][SQL] Extend the ST_AsBinary function to take optional endianness [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/04/30 19:04:20 UTC, 0 replies.
- [I] Feature request: infer field names in json_tuple [spark] - posted by "jxu (via GitHub)" <gi...@apache.org> on 2026/04/30 19:07:57 UTC, 2 replies.
- [PR] [SPARK-40193][SQL][FOLLOWUP] Rename `spark.sql.optimizer.mergeSubplans.( -> filterPropagation.)symmetricFilterPropagation.enabled` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/30 19:08:08 UTC, 7 replies.
- [PR] [SPARK-56684] Expose `KubernetesClusterSchedulerBackend.kubernetesClient` to `k8s` package [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/30 20:07:20 UTC, 0 replies.
- [PR] [SPARK-56686][SQL] Support streaming row-level CDC post-processing [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/04/30 20:16:32 UTC, 2 replies.
- [PR] [SPARK-56687][SQL] Support netChanges for DSv2 CDC streaming reads [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/04/30 20:53:08 UTC, 1 replies.
- Re: [PR] [SPARK-56684][K8S] Expose `KubernetesClusterSchedulerBackend.kubernetesClient` to `k8s` package [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/30 21:21:30 UTC, 3 replies.
- [PR] [SPARK-56688][INFRA][PYTHON] Reorganize pyspark tests to empty a CI slot [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/04/30 22:12:17 UTC, 0 replies.
- [PR] [SPARK-56689][K8S] Improve `ExecutorResizePlugin` to reuse `KubernetesClusterSchedulerBackend.kubernetesClient` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/04/30 22:28:18 UTC, 2 replies.
- [PR] [SPARK-56690][SQL] - Expose common `TaskMemoryManager` API on `HashedRelation` to avoid code duplication [spark] - posted by "erenavsarogullari (via GitHub)" <gi...@apache.org> on 2026/04/30 22:41:10 UTC, 0 replies.