reviews@spark.apache.org, 2026-08

You are viewing a plain text version of this content. The canonical link for it is here.

- Re: [PR] [SPARK-56498][SS] Implement decoupled state store maintenance [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2026/08/01 00:28:57 UTC, 1 replies.
- Re: [PR] [SPARK-58391][SDP] Validate AutoCDC sequencing-type and SCD2 track-history drift [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/08/01 00:32:00 UTC, 3 replies.
- Re: [PR] [SPARK-56568][SQL] Add additional column ID test coverage for DSv2 Column.id() [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/01 00:44:53 UTC, 1 replies.
- Re: [I] [SPARK-56564] V2 DataSource write path throws SparkException instead of CommitDeniedException, causing spurious stage failures with speculation [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/01 00:44:58 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-56551][SQL] Add operation metrics for metadata-only DELETE queries in DSv2 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/01 00:45:00 UTC, 1 replies.
- Re: [PR] [SPARK-58409][SDP] Add SCD2 AutoCDC end-to-end test suites [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/08/01 00:46:25 UTC, 12 replies.
- Re: [PR] [WIP] Stack/pipelined shuffle pr7 rtm [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/08/01 00:49:34 UTC, 0 replies.
- [PR] [WIP] Stack/pipelined shuffle pr8 rtm [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/08/01 00:50:20 UTC, 0 replies.
- Re: [PR] [SPARK-58366][SQL] Support JSON_TABLE table-valued function [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2026/08/01 01:13:14 UTC, 17 replies.
- Re: [PR] [SPARK-58490] Support collection functions in `CollectionFunctions` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/01 01:25:16 UTC, 2 replies.
- Re: [PR] [SPARK-58489] Support datetime functions in `DateTimeFunctions` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/01 01:25:33 UTC, 2 replies.
- [PR] [SPARK-58491] Support `expr` in `Functions` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/01 01:46:08 UTC, 3 replies.
- Re: [I] Upgrades for SparkApp / SparkCluster CRDs [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/01 01:50:25 UTC, 2 replies.
- [PR] [SPARK-58488][PYTHON] Fix type annotations for DataFrameWriter and DataStreamWriter partitionBy/clusterBy/bucketBy/sortBy [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/01 01:52:22 UTC, 2 replies.
- Re: [I] 1.0 release with Spark 3.5 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/01 01:55:47 UTC, 1 replies.
- Re: [I] sparkcluster resource master starts with port 7070 instead of 7077 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/01 01:59:12 UTC, 3 replies.
- [PR] [SPARK-58492] Support window functions with `Window`, `WindowSpec` and `Column.over` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/01 02:16:37 UTC, 3 replies.
- [PR] [SPARK-58493] Support aggregate functions in `AggregateFunctions` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/01 02:18:58 UTC, 3 replies.
- [PR] Add CodeJT project scaffold and API [spark] - posted by "Jonathancombs782 (via GitHub)" <gi...@apache.org> on 2026/08/01 03:30:04 UTC, 1 replies.
- Re: [PR] [SPARK-58378][SQL] Fuse compatible approximate percentile sketches [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/08/01 03:30:46 UTC, 14 replies.
- Re: [PR] [SPARK-45900][SQL][PYTHON] Add xxh3_64 and xxh3_128 functions [spark] - posted by "SreeramaYeshwanthGowd (via GitHub)" <gi...@apache.org> on 2026/08/01 03:54:16 UTC, 23 replies.
- Re: [PR] [SPARK-58295][SQL][PYTHON] Add `to_base32` and `from_base32` functions [spark] - posted by "SreeramaYeshwanthGowd (via GitHub)" <gi...@apache.org> on 2026/08/01 03:55:22 UTC, 7 replies.
- Re: [PR] [SPARK-40945][SQL][PYTHON] Add truncate function [spark] - posted by "SreeramaYeshwanthGowd (via GitHub)" <gi...@apache.org> on 2026/08/01 03:55:24 UTC, 18 replies.
- Re: [PR] [SPARK-58307][SQL][PYTHON] Add json_typeof function [spark] - posted by "SreeramaYeshwanthGowd (via GitHub)" <gi...@apache.org> on 2026/08/01 03:55:26 UTC, 8 replies.
- Re: [PR] [SPARK-51975][SQL] Add variant_from_arrays and variant_from_entries [spark] - posted by "SreeramaYeshwanthGowd (via GitHub)" <gi...@apache.org> on 2026/08/01 03:55:28 UTC, 11 replies.
- [PR] [SPARK-58494] Upgrade spotless-plugin-gradle to 8.9.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/01 04:45:56 UTC, 3 replies.
- Re: [PR] [SPARK-57594][SDP] Add spark_confs support to create_auto_cdc_flow [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/08/01 04:57:59 UTC, 3 replies.
- Re: [PR] [MINOR][DOCS] Document CSV read behaviour when multiLine is disabled [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/08/01 05:58:19 UTC, 8 replies.
- Re: [PR] [SPARK-58437][SQL] Fix invalid Java constructs in generated code [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/01 06:00:01 UTC, 3 replies.
- Re: [PR] [SPARK-58265][SQL] Reuse projected broadcast values for dynamic partition pruning [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/08/01 07:56:43 UTC, 3 replies.
- [PR] [WIP] Port Tests to SessionQueryTest [spark] - posted by "fwc (via GitHub)" <gi...@apache.org> on 2026/08/01 09:02:31 UTC, 0 replies.
- Re: [PR] [SPARK-57897][BUILD][CORE] Create `connector/credential-aws` module with CI/release integration [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/08/01 09:23:01 UTC, 2 replies.
- Re: [PR] [SPARK-58420][SQL] Normalize map values in distinct aggregates [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2026/08/01 11:29:10 UTC, 35 replies.
- Re: [PR] [SPARK-58469][PS] Use native expressions for NumPy rint [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/01 12:16:29 UTC, 2 replies.
- Re: [PR] [SPARK-58443][SQL] Fix wrong results/exception in instr and substring_index for an Integer.MIN_VALUE position or count [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/01 12:16:38 UTC, 2 replies.
- Re: [PR] [SPARK-58471][ML][CONNECT] Improve TrainValidationSplitModel size estimation [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/01 12:16:41 UTC, 2 replies.
- Re: [PR] [SPARK-58447][CONNECT] Preserve operation tags in Python foreachBatch callbacks [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/08/01 13:28:28 UTC, 1 replies.
- [PR] [MINOR][SQL] Make in-limit SQL test deterministic [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2026/08/01 13:43:34 UTC, 3 replies.
- Re: [PR] [SPARK-58389][SQL] Pass all options while loading tables [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/08/01 13:57:59 UTC, 2 replies.
- Re: [PR] [SPARK-57933][CONNECT] Map Spark Connect client failures to SQLException in the JDBC driver [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/08/01 13:58:34 UTC, 6 replies.
- Re: [PR] [SPARK-58457][SQL][DOCS] Correct the PERMISSIVE mode claim that corrupt records are dropped [spark] - posted by "Joorgem (via GitHub)" <gi...@apache.org> on 2026/08/01 15:02:20 UTC, 7 replies.
- Re: [PR] [SPARK-57832][SQL] Support timestamp - timestamp subtraction for nanosecond-precision timestamps [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/01 16:00:50 UTC, 13 replies.
- [PR] [WIP][SPARK-57837][SQL] Support the precision argument in current_timestamp(p) and localtimestamp(p) [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/01 16:09:07 UTC, 2 replies.
- Re: [PR] [SPARK-57841][SQL][TEST] Add cross-precision and nested-type test coverage for nanosecond-precision timestamps [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/01 16:37:07 UTC, 2 replies.
- Re: [PR] [SPARK-58458][SQL][TESTS] Add coverage for the record split when multiLine is disabled [spark] - posted by "Joorgem (via GitHub)" <gi...@apache.org> on 2026/08/01 17:25:45 UTC, 2 replies.
- [PR] [WIP][SPARK-57460][SQL] Support nanosecond-precision timestamp types in the JDBC datasource [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/01 20:24:05 UTC, 0 replies.
- [PR] [WIP][SPARK-57161][CONNECT][SQL] Convert nanosecond-capable timestamp types and literals between proto and Catalyst in Spark Connect [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/01 20:24:58 UTC, 0 replies.
- [PR] [WIP][SPARK-57835][SQL] Read persisted nanosecond-typed tables when the preview flag is off [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/01 20:28:51 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-57823][SQL] Support ORC predicate pushdown for nanosecond-precision timestamps [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/01 20:42:57 UTC, 0 replies.
- [PR] [SPARK-58495] Use 7077 for `spark` named container port in master StatefulSet [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/01 22:01:04 UTC, 7 replies.
- [PR] [SPARK-58496] Support field-name-based access in `Row` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/01 22:20:20 UTC, 3 replies.
- [PR] [SPARK-58497] Support `createDataFrame` in `SparkSession` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/01 22:37:45 UTC, 3 replies.
- Re: [PR] [SPARK-58472][CORE] Add `AutoCloseable` lifecycle to `CredentialProvider` SPI [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/01 22:44:28 UTC, 4 replies.
- [PR] [SPARK-58482][SQL] Fix NaN bounds in cached column statistics [spark] - posted by "marcuslin123 (via GitHub)" <gi...@apache.org> on 2026/08/01 22:55:10 UTC, 1 replies.
- [PR] [SPARK-58498] Support `geometry/geography` types in `DataType.simpleString` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/01 23:20:02 UTC, 3 replies.
- Re: [PR] [SPARK-56589][CORE] Use Virtual Threads for BlockManagerMasterEndpoint ask thread pool [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/02 00:46:41 UTC, 1 replies.
- Re: [PR] [SPARK-56065][SQL] Add AQE fallback from failed broadcast joins to shuffle joins [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/02 00:47:51 UTC, 1 replies.
- Re: [PR] [SPARK-55882][SQL] Rename `_LEGACY_ERROR_TEMP_1048` to `INVALID_COALESCE_HINT_PARAMETER` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/02 00:47:55 UTC, 1 replies.
- Re: [PR] [SPARK-48290][CORE] Record skewed shuffle block sizes by default so that AQE can detect skew [spark] - posted by "Vivek1106-04 (via GitHub)" <gi...@apache.org> on 2026/08/02 05:01:01 UTC, 10 replies.
- Re: [PR] [SPARK-47232][UI] Fix Spark UI tab links and inline scripts in Standalone mode with reverse proxy [spark] - posted by "Nflrijal (via GitHub)" <gi...@apache.org> on 2026/08/02 05:34:49 UTC, 0 replies.
- Re: [PR] [SPARK-58203][K8S] Support configuring spark-managed UI service to work with spark.ui.port=0 [spark] - posted by "zhengchenyu (via GitHub)" <gi...@apache.org> on 2026/08/02 06:19:05 UTC, 10 replies.
- Re: [PR] [SPARK-57460][SQL] Support nanosecond-precision timestamp types in the JDBC datasource [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/02 10:41:15 UTC, 11 replies.
- Re: [PR] [SPARK-57835][SQL] Read persisted nanosecond-typed tables when the preview flag is off [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/02 10:43:10 UTC, 3 replies.
- Re: [PR] [SPARK-57161][CONNECT][SQL] Convert nanosecond-capable timestamp types and literals between proto and Catalyst in Spark Connect [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/02 11:46:36 UTC, 3 replies.
- [PR] [SPARK-58500][PYTHON] Accept tuple in DataFrame.describe and selectExpr [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/02 11:58:34 UTC, 8 replies.
- [PR] [SPARK-58501][SQL] Eliminate common subexpressions in ExpandExec [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/08/02 14:37:11 UTC, 5 replies.
- [PR] [SPARK-58503][SQL] Evaluate HAVING before window functions with generators [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2026/08/02 15:28:16 UTC, 4 replies.
- [PR] [SPARK-58486][SQL] Use collation-aware hashes for runtime Bloom filters [spark] - posted by "marcuslin123 (via GitHub)" <gi...@apache.org> on 2026/08/02 16:20:24 UTC, 1 replies.
- Re: [PR] [SPARK-58459][INFRA] Manage build_main.yml per-branch instead of gating on github.ref [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/02 17:23:20 UTC, 1 replies.
- Re: [PR] [SPARK-58459][4.x][INFRA] Manage build_main.yml per-branch instead of gating on github.ref [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/02 17:24:10 UTC, 1 replies.
- Re: [PR] [SPARK-58348][PYTHON][DOCS] Move PySpark error doc header into global variable [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/02 17:27:03 UTC, 1 replies.
- Re: [PR] [MINOR][PYTHON] Fix wrong expected_type in DataFrame.sort ascending type error [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/02 17:28:01 UTC, 4 replies.
- Re: [PR] [SPARK-58450][SQL] Add single-pass analyzer support for ASOF JOIN [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/08/02 18:36:57 UTC, 2 replies.
- Re: [PR] [SPARK-58358][SQL] Add tag validation to removeTag [spark] - posted by "jubins (via GitHub)" <gi...@apache.org> on 2026/08/02 19:10:51 UTC, 8 replies.
- Re: [PR] [SPARK-57823][SQL] Support ORC predicate pushdown for nanosecond-precision timestamps [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/02 22:36:21 UTC, 10 replies.
- Re: [PR] [SPARK-58170][SQL][TESTS] Provide sql shorthand in SparkSessionProvider [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/02 22:40:51 UTC, 5 replies.
- Re: [PR] [SPARK-56626][SQL] Introduce SupportsReportCatalogStatistics mixin for Table [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/03 00:45:22 UTC, 1 replies.
- Re: [PR] [SPARK-46160][PYTHON] Add axis parameter to DataFrame.shift in pandas API on Spark [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/03 00:45:24 UTC, 1 replies.
- Re: [PR] [SPARK-57805][SQL] Support TimestampNTZ, ANSI interval, and TIME in CBO estimation [spark] - posted by "johntomcat7408-cmyk (via GitHub)" <gi...@apache.org> on 2026/08/03 01:19:47 UTC, 0 replies.
- Re: [PR] [SPARK-58454][CORE] Fully decouple pipelined shuffles from the MapOutputTracker [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/03 01:45:40 UTC, 2 replies.
- Re: [PR] [SPARK-54879][CORE] Add final status to Spark History Server for failed executions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/03 02:15:39 UTC, 1 replies.
- Re: [PR] [SPARK-58386][SS] Restore backward compatibility of SupportsRealTimeRead.nextWithTimeout [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/08/03 02:17:57 UTC, 13 replies.
- [PR] [SPARK-58504][CORE] Make FileTokenIngestor cache thread-safe [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/03 02:21:03 UTC, 3 replies.
- Re: [PR] [SPARK-56842][SQL] Short-circuit AQE when materialized stages are empty [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/03 03:03:30 UTC, 10 replies.
- Re: [PR] [SPARK-58013][PS] Fix loc setitem dropping writes for reordered columns on pandas 3 [spark] - posted by "Vivek1106-04 (via GitHub)" <gi...@apache.org> on 2026/08/03 03:14:09 UTC, 3 replies.
- Re: [PR] [SPARK-58404][SQL] Support bypassing partial WindowGroupLimit [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/08/03 03:20:59 UTC, 10 replies.
- Re: [PR] [SPARK-57878][CORE] Add task assignment strategy to support binpack/balance task scheduling [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/03 03:38:57 UTC, 0 replies.
- Re: [PR] [SPARK-58201][SQL] Optimize sliding window MIN/MAX aggregate function using monotonic deque [spark] - posted by "pavan51 (via GitHub)" <gi...@apache.org> on 2026/08/03 04:15:13 UTC, 16 replies.
- Re: [PR] [SPARK-57830][SS] Support event-time watermark on nanosecond-precision timestamp columns [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/08/03 04:16:33 UTC, 0 replies.
- [PR] [SPARK-58506][SQL][TEST] Assert Spark's own error contract in codegen compile failure tests [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/03 04:52:43 UTC, 5 replies.
- [PR] [SPARK-58505][CORE] Attach a bounded per-consumer memory breakdown to UNABLE_TO_ACQUIRE_MEMORY errors [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2026/08/03 04:59:14 UTC, 14 replies.
- [PR] [SPARK-58502] [SQL] Add order by for in-limit tests to make it deterministic [spark] - posted by "VindhyaG (via GitHub)" <gi...@apache.org> on 2026/08/03 05:37:47 UTC, 1 replies.
- [PR] [SPARK-58507][CORE] Avoid redundant closure-class parsing in ClosureCleaner's indylambda path [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2026/08/03 05:53:24 UTC, 6 replies.
- Re: [PR] [SPARK-58066][SQL] Hoist streamed-side predicates in outer/anti/existence joins [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/03 07:02:03 UTC, 1 replies.
- [PR] Correct terminology from 'uber jar' to 'user jar' [spark] - posted by "Mahikolhe23 (via GitHub)" <gi...@apache.org> on 2026/08/03 07:09:25 UTC, 4 replies.
- Re: [PR] [SPARK-56898][SQL] Rewrite COUNT(DISTINCT IF) to COUNT(DISTINCT) FILTER for Expand reduction [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/03 07:23:19 UTC, 1 replies.
- Re: [PR] [SPARK-57898][CORE] Implement AwsStsCredentialProvider (OIDC to STS credential exchange) [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/08/03 08:01:17 UTC, 16 replies.
- Re: [PR] [SPARK-58508][CORE][SS] Activate pipelined shuffles for Real-Time Mode streaming queries to support Stateful Queries [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/03 08:22:54 UTC, 13 replies.
- [PR] [SPARK-54879][CORE][FOLLOWUP] Move exclusions to v43excludes in MimaExcludes [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/03 08:25:16 UTC, 3 replies.
- Re: [PR] [SPARK-58464][PS] Use native functions for NumPy bitwise shifts [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/03 08:26:48 UTC, 1 replies.
- Re: [PR] [SPARK-58502][SQL] Make in-limit SQL test deterministic [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/03 08:27:35 UTC, 10 replies.
- Re: [PR] [SPARK-58395][ML][CONNECT] Include LDA metadata in size estimates [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/03 08:29:25 UTC, 1 replies.
- Re: [PR] [SPARK-58470][PS] Use native expressions for NumPy trunc [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/03 08:47:17 UTC, 1 replies.
- [PR] Add new tests [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2026/08/03 08:56:21 UTC, 0 replies.
- [PR] [SPARK-58509][ML][CONNECT] Exclude OneVsRest classifier from model size estimation [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/03 09:15:49 UTC, 3 replies.
- Re: [PR] [SPARK-58465][PS] Use native expressions for NumPy reciprocal of floating-point columns [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/03 09:16:57 UTC, 2 replies.
- Re: [PR] [MINOR][SQL] Remove redundant trailing semicolons in the SQL module [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/03 09:34:48 UTC, 3 replies.
- Re: [PR] [SPARK-58221][SQL] Add `try_variant_set` expression [spark] - posted by "bojana-db (via GitHub)" <gi...@apache.org> on 2026/08/03 09:37:42 UTC, 0 replies.
- Re: [PR] [SPARK-xxxxx][SQL] Make variant path functions raise `INVALID_VARIANT_PATH` consistently in interpreted and codegen execution [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/03 09:38:52 UTC, 0 replies.
- Re: [PR] [SPARK-58510][SQL] Make variant path functions error consistently on malformed constant paths across execution modes [spark] - posted by "bojana-db (via GitHub)" <gi...@apache.org> on 2026/08/03 09:41:23 UTC, 3 replies.
- [PR] [SPARK-58513][CORE] Init UnifiedMemeoryManager should check driver config in driver , check executor config in executor [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2026/08/03 10:58:36 UTC, 2 replies.
- Re: [PR] [SPARK-57353][SQL] Fix single-pass resolver crash on GROUPING SETS with HAVING/ORDER BY [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/03 11:18:34 UTC, 6 replies.
- Re: [PR] Add new tests for JDBC DS Join pushdown [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/03 11:44:24 UTC, 0 replies.
- [PR] [SPARK-58514][PS] Restore native NumPy log2 mapping [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/03 11:48:32 UTC, 3 replies.
- [PR] [MINOR][BUILD] Fix branch-4.x project loading [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2026/08/03 11:56:21 UTC, 1 replies.
- [PR] [SPARK-58463][INFRA][FOLLOWUP] Format merge summary output [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/03 11:59:57 UTC, 5 replies.
- Re: [PR] [SPARK-47017][SQL] Show internal SQL plans for RDDScanExec [spark] - posted by "alexandrefimov (via GitHub)" <gi...@apache.org> on 2026/08/03 13:23:17 UTC, 3 replies.
- [PR] [SPARK-58515] Exclude MySQL permission and limit errors from syntax error cla… [spark] - posted by "alekjarmov (via GitHub)" <gi...@apache.org> on 2026/08/03 13:27:22 UTC, 0 replies.
- Re: [PR] [SPARK-57225][SQL] Reject batch writes for DSv2 sources without write capability [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/03 14:01:51 UTC, 3 replies.
- Re: [PR] [SPARK-58423][SQL] Raise MISSING_ATTRIBUTES for missing input after single-pass hidden-output insertion [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/03 14:02:06 UTC, 3 replies.
- Re: [PR] [SPARK-58248][SQL] Reuse single-line inference path for JSON/XML archive inference [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/03 14:15:52 UTC, 4 replies.
- Re: [PR] [SPARK-58504][CORE] Simplify FileTokenIngestor cache and detect rotation by content [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/03 14:21:18 UTC, 3 replies.
- Re: [PR] [SPARK-58515][SQL] Exclude MySQL permission and limit errors from syntax error classification [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/03 14:23:20 UTC, 2 replies.
- [PR] [SPARK-58449][SQL] Only push a Join through a Union when the right side is the broadcast side [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/03 14:36:16 UTC, 6 replies.
- Re: [PR] [SPARK-58096][SQL] Fix approx_top_k wrong counts/items for UNICODE-collated non-ASCII strings [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/03 14:41:19 UTC, 1 replies.
- Re: [PR] [SPARK-58411][SQL] Preserve ORDER BY in LIMIT decorrelation when correlation references only the outer table [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/03 14:50:59 UTC, 2 replies.
- [PR] [SPARK-58517][SDP] Honor spark.sql.caseSensitive in table schema evolution [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/08/03 16:04:49 UTC, 33 replies.
- [PR] [SPARK-58516][SQL] Extend AbstractIterator in ColumnarIterator instead of mixing in Iterator [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/03 16:11:17 UTC, 5 replies.
- Re: [PR] [SPARK-55206][PYTHON][SQL] Transpilation minimal functional implementation with python [spark] - posted by "asf-gitbox-commits (via GitHub)" <gi...@apache.org> on 2026/08/03 16:13:58 UTC, 1 replies.
- Re: [PR] [SPARK-57938][INFRA] Add new `SKIP_` flags to doc build script [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/03 16:35:37 UTC, 2 replies.
- Re: [PR] [SPARK-57555][FOLLOWUP][SQL] Add TimeType support to PostgresDialect [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/08/03 17:25:38 UTC, 0 replies.
- Re: [PR] [SPARK-58521][UI] Forward `X-Forwarded-Context` header and skip Master CSP on reverse-proxied UI requests [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/03 17:26:40 UTC, 6 replies.
- [PR] [SPARK-58520][SQL] Document dynamic table options in SQL reference [spark] - posted by "marcuslin123 (via GitHub)" <gi...@apache.org> on 2026/08/03 17:29:34 UTC, 6 replies.
- [PR] [SPARK-58519][SQL] Document UPDATE and DELETE FROM statements [spark] - posted by "marcuslin123 (via GitHub)" <gi...@apache.org> on 2026/08/03 17:39:47 UTC, 4 replies.
- Re: [PR] [SPARK-57370][SQL] Add a JDK (javac) compiler backend for whole-stage codegen [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/03 17:44:13 UTC, 2 replies.
- Re: [PR] [SPARK-58206][CORE][SQL] Add custom write metrics to the pluggable shuffle framework [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/08/03 18:10:57 UTC, 0 replies.
- [PR] [SPARK-58522][PYTHON] Accept a single tuple of columns in Window and TableArg partitionBy/orderBy [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/03 18:11:33 UTC, 2 replies.
- Re: [PR] [SPARK-57894][SPARK-57895][CORE][K8S] Implement `UpdateUserCredentials` RPC, backend integration, and initial credential delivery [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/03 18:12:28 UTC, 8 replies.
- Re: [PR] [SPARK-58322][CORE] Validate executor app ID before returning credentials and at registration [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/08/03 18:18:58 UTC, 0 replies.
- [PR] [SPARK-58523][SQL] Add Catalyst runtime filter pushdown interface for DSv2 scans [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/08/03 19:38:11 UTC, 0 replies.
- [PR] [SPARK-58524] Add `SHA256` struct [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/03 19:46:28 UTC, 3 replies.
- Re: [PR] [SPARK-58426] Render each JVM option as its own command element [spark-kubernetes-operator] - posted by "nicholasbarton-nominal (via GitHub)" <gi...@apache.org> on 2026/08/03 19:48:36 UTC, 4 replies.
- Re: [PR] [WIP] Port low-hanging suites to SessionQueryTest [spark] - posted by "fwc (via GitHub)" <gi...@apache.org> on 2026/08/03 19:49:28 UTC, 0 replies.
- [PR] [SPARK-58526] Fix `VariableBufferBuilder` to handle large first value and offsets truncation [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/03 20:06:17 UTC, 4 replies.
- Re: [PR] [SPARK-54945][PYTHON] Add tests for pa.Array.to_pandas with zero copy [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/03 20:26:29 UTC, 8 replies.
- Re: [PR] [SPARK-58272][SQL] Enable runtime Bloom filters for materialized cached inputs [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/08/03 20:29:48 UTC, 1 replies.
- Re: [PR] [SPARK-58161][PYTHON] Standardize PySpark UDF row count mismatch error to use RESULT_ROWS_MISMATCH [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/03 20:32:05 UTC, 1 replies.
- [PR] [SPARK-58527] Update `cyclonedx` to 3.3.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/03 20:35:55 UTC, 4 replies.
- Re: [PR] [SPARK-57640] Implement gRPC WorkerSession and test it against an echo server. [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/03 20:44:39 UTC, 3 replies.
- Re: [PR] [SPARK-57425][CONNECT][PYTHON] Make reattach iterator recover from short-TTL credential expiry [spark] - posted by "vgkowski (via GitHub)" <gi...@apache.org> on 2026/08/03 21:39:07 UTC, 0 replies.
- Re: [PR] [SPARK-58451][CONNECT] Filter null extension elements returned by GetStatus plugins [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/03 21:55:42 UTC, 4 replies.
- [PR] [SPARK-58528] Support cache artifact upload in `SparkConnectClient` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/03 22:04:06 UTC, 3 replies.
- [PR] [SPARK-58529][PYTHON] Unify RESULT_ROWS_MISMATCH message and consolidate row count verification in worker.py [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/03 22:15:18 UTC, 4 replies.
- [PR] [SPARK-58530] Support large local data in `createDataFrame` via `CachedLocalRelation` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/03 22:29:05 UTC, 3 replies.
- [PR] [SPARK-58015][INFRA][FOLLOWUP] Make dependency group names compliant with the PyPA specification [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/08/03 22:47:42 UTC, 5 replies.
- [PR] [SPARK-58531][SQL][CONNECT] Make spark.sql.artifact.copyFromLocalToFs.allowDestLocal a static conf [spark] - posted by "haoyangeng-db (via GitHub)" <gi...@apache.org> on 2026/08/03 22:52:45 UTC, 5 replies.
- [PR] [SPARK-58463][INFRA][FOLLOWUP] Restore merge summary comment spacing [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/03 23:48:32 UTC, 2 replies.
- [PR] [SPARK-56573][SQL] Use a full-range non-negative random seed for unseeded sampling [spark] - posted by "stanyao (via GitHub)" <gi...@apache.org> on 2026/08/04 00:37:07 UTC, 3 replies.
- Re: [I] Support Catalog Store [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/04 00:43:41 UTC, 0 replies.
- [PR] [SPARK-58525][SQL] Propagate caseSensitive into nested field merges in n StructType.merge [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/08/04 01:07:44 UTC, 6 replies.
- [PR] [SPARK-58533][PS] Use native Spark function for NumPy float_power [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/04 01:31:22 UTC, 3 replies.
- Re: [PR] [SPARK-38983][SQL][TESTS] Add grouping boolean error regression test [spark] - posted by "superdiaodiao (via GitHub)" <gi...@apache.org> on 2026/08/04 01:38:01 UTC, 1 replies.
- Re: [PR] [SPARK-57897][BUILD][4.x][FOLLOWUP] Fix branch-4.x project loading [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/04 03:01:50 UTC, 2 replies.
- [PR] [SPARK-58535][ML] Create StringIndexer lookup maps during transformation [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/04 03:30:42 UTC, 2 replies.
- [PR] [SPARK-58536] Fix getDefaultFinalStatus to return SUCCEEDED in cluste… [spark] - posted by "Lobo2008 (via GitHub)" <gi...@apache.org> on 2026/08/04 03:37:20 UTC, 0 replies.
- [PR] [SPARK-58534][BUILD] Change version in branch-4.x to 4.4.0 [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/08/04 03:53:45 UTC, 2 replies.
- [PR] [SPARK-58534][BUILD][FOLLOWUP] Add 4.4 MiMa excludes section to master [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/08/04 04:04:13 UTC, 3 replies.
- [PR] [SPARK-58537][INFRA][4.x] Make maven_test.yml default to branch-4.x on branch-4.x [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/08/04 04:31:51 UTC, 3 replies.
- [PR] [SPARK-58538][INFRA][4.3] Fix branch-4.3 workflow titles and default branch [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/08/04 04:33:53 UTC, 2 replies.
- [PR] [SPARK-58538][INFRA] Add branch-4.3 CI scheduler and release integration [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/08/04 04:35:39 UTC, 3 replies.
- [PR] [SPARK-58539] Support error details in `SparkConnectError` using gRPC `ErrorInfo` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/04 04:48:43 UTC, 3 replies.
- Re: [PR] [SPARK-58461][CORE] Convert unreachable `_LEGACY_ERROR_TEMP_3021-3042` invariants in `SparkCoreErrors` to internal errors [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/04 05:10:45 UTC, 2 replies.
- Re: [PR] [SPARK-58359][SQL] Require the arguments field in built-in function documentation [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/04 05:27:02 UTC, 3 replies.
- [PR] [SPARK-58511][SQL] Bypass ineffective pre-shuffle partial aggregation at runtime [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/08/04 05:41:57 UTC, 73 replies.
- Re: [PR] [SPARK-54945][PYTHON][TEST] Add tests for pa.Array.to_pandas with zero copy [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/04 05:44:02 UTC, 1 replies.
- [PR] [SPARK-58541] Support retry with exponential backoff in `SparkConnectClient` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/04 05:51:20 UTC, 3 replies.
- Re: [PR] [SPARK-57640][UDF] Implement gRPC WorkerSession and test it against an echo server [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/04 05:59:28 UTC, 1 replies.
- Re: [PR] [SPARK-58523][SQL] Add Catalyst runtime filtering interface for DSv2 scans [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/04 06:00:44 UTC, 26 replies.
- [PR] Bump fast-uri from 3.1.4 to 3.1.5 in /dev [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/08/04 06:00:56 UTC, 2 replies.
- [PR] [SPARK-58542] Upgrade `gRPC Swift NIO Transport` to 2.9.1 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/04 06:01:23 UTC, 3 replies.
- Re: [PR] [SPARK-28587][SQL] Route JDBC partition bound literals through JdbcDialect.compileValue [spark] - posted by "ghost (via GitHub)" <gi...@apache.org> on 2026/08/04 06:04:52 UTC, 0 replies.
- Re: [PR] [SPARK-58534][BUILD][4.x] Change version in branch-4.x to 4.4.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/04 06:47:30 UTC, 2 replies.
- Re: [PR] [SPARK-57091][SQL] Add BroadcastNearestByJoinExec to avoid cross-product materialization [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/04 06:55:42 UTC, 13 replies.
- [PR] [SPARK-58543] Support reattachable execution with `ReattachExecute` and `ReleaseExecute` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/04 07:07:24 UTC, 3 replies.
- [PR] [MINOR][PYTHON] Add TaskContext tests for scalar Arrow UDFs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/04 07:16:52 UTC, 0 replies.
- [PR] [SPARK-58546][ML] Avoid redundant StringIndexer label lookups [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/04 07:17:28 UTC, 2 replies.
- [PR] [SPARK-58544][SQL] Fix vector distance and norm functions returning wrong results from intermediate float overflow [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/08/04 07:21:05 UTC, 8 replies.
- Re: [PR] [SPARK-38719][SQL] Test the error class: CANNOT_CAST_DATATYPE [spark] - posted by "deepujain (via GitHub)" <gi...@apache.org> on 2026/08/04 07:53:18 UTC, 12 replies.
- Re: [PR] [SPARK-38743][SQL] Test the error class: MISSING_STATIC_PARTITION_COLUMN [spark] - posted by "deepujain (via GitHub)" <gi...@apache.org> on 2026/08/04 07:53:23 UTC, 12 replies.
- [PR] [SPARK-58547][CONNECT] Expose operation IDs for end-to-end request attribution [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/04 07:59:48 UTC, 5 replies.
- [PR] [SPARK-36284][CORE][SHUFFLE] Add shuffle checksum support for push-based shuffle [spark] - posted by "Dreamstick9 (via GitHub)" <gi...@apache.org> on 2026/08/04 08:04:36 UTC, 2 replies.
- [PR] [SPARK-58548][PS] Use native Spark function for NumPy heaviside [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/04 08:41:59 UTC, 3 replies.
- [PR] [SPARK-58550][MLLIB] Delay GaussianMixture aggregation allocations [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/04 08:43:41 UTC, 0 replies.
- [PR] [SPARK-58552][SQL] Add total task time column to the SQL / DataFrame tab [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/08/04 08:53:01 UTC, 0 replies.
- [PR] [SPARK-58551][PYTHON] Python Data Sources Limit Pushdown API [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2026/08/04 08:54:16 UTC, 9 replies.
- [PR] [SPARK-58549][SQL] Preserve key-grouped partitioning and ordering across a DSv2 scan merge [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/08/04 09:00:38 UTC, 17 replies.
- [PR] [CONNECT] Show ML cache status in Spark Connect UI [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/04 09:00:54 UTC, 0 replies.
- Re: [PR] [WIP][ML][CONNECT] Show ML cache status in Spark Connect UI [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/04 09:04:24 UTC, 2 replies.
- [PR] [WIP][MLLIB] Rewrite CountVectorizer fitting with DataFrame APIs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/04 09:10:35 UTC, 0 replies.
- Re: [PR] [SPARK-58393][PYTHON][INFRA] Smart select tests for PySpark test framework [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/04 09:28:56 UTC, 5 replies.
- [PR] [SQL] Block MySQL double cast pushdown [spark] - posted by "alekjarmov (via GitHub)" <gi...@apache.org> on 2026/08/04 09:29:29 UTC, 0 replies.
- [PR] [WIP][MLLIB] Reuse ML vector data type [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/04 09:30:30 UTC, 0 replies.
- Re: [PR] [MINOR][PYTHON][TESTS] Add TaskContext tests for scalar Arrow UDFs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/04 09:32:33 UTC, 1 replies.
- [PR] [SPARK-58553][PS] Use native Spark functions for NumPy fmax and fmin [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/04 09:33:15 UTC, 3 replies.
- Re: [PR] [SPARK-58555] Add new tests for JDBC DS Join pushdown [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2026/08/04 09:59:35 UTC, 3 replies.
- [PR] [SPARK-49828][SQL] Make Column(expression) usable outside of the org.apache.spark package [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/08/04 10:24:17 UTC, 10 replies.
- Re: [PR] [SPARK-49828][SQL] Expose ColumnNode to/from Expression utils as developer APIs [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/08/04 10:43:32 UTC, 0 replies.
- [PR] [SPARK-58207][SQL][FOLLOWUP] Skip runtime filter pushdown for nondeterministic filters [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/08/04 10:46:24 UTC, 4 replies.
- Re: [PR] [SPARK-58554][SQL] Block MySQL double cast pushdown [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/04 11:21:09 UTC, 1 replies.
- Re: [PR] [SPARK-58552][SQL][UI] Add total task time column to the SQL / DataFrame tab [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/08/04 12:11:59 UTC, 5 replies.
- Re: [PR] [SPARK-58394][SQL] Use ZipFile instead of ZipArchiveInputStream for zip archives [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/04 12:14:20 UTC, 1 replies.
- [PR] [WIP][ML] Avoid duplicate StringIndexer skip lookups [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/04 13:00:30 UTC, 0 replies.
- Re: [PR] [SPARK-58536] Fix getDefaultFinalStatus to return SUCCEEDED in cluster mode [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/04 13:13:08 UTC, 0 replies.
- [PR] [SPARK-58558][SQL] Remove requireAllClusterKeysForCoPartition as a gate for SPJ [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/04 13:13:33 UTC, 2 replies.
- Re: [I] [K8S][CORE] Heartbeat-timeout executor replacement may be classified as ExecutorKilled and skip task failure counting [spark] - posted by "lan1994 (via GitHub)" <gi...@apache.org> on 2026/08/04 13:18:27 UTC, 0 replies.
- Re: [PR] [CONNECT] Skip redundant DSv2 table refreshes in Spark Connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/04 13:31:10 UTC, 0 replies.
- [PR] [PYTHON] Package all of sbin in PySpark classic distribution [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/08/04 13:38:38 UTC, 0 replies.
- Re: [PR] [SPARK-57870][ML][PYTHON] Apply HasIntermediateStorageLevel to tree ensemble estimators (GBT, RandomForest) [spark] - posted by "maoli67660 (via GitHub)" <gi...@apache.org> on 2026/08/04 13:42:38 UTC, 0 replies.
- Re: [PR] [SPARK-58559][PYTHON] Package all of sbin in PySpark classic distribution [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/08/04 13:53:30 UTC, 14 replies.
- [PR] [SPARK-58560] Use Apache Spark `4.0.4` and `4.1.3` in CI [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/04 14:15:16 UTC, 3 replies.
- Re: [PR] [SPARK-58322][CORE] Verify executor driver identity via per-instance token [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2026/08/04 14:18:46 UTC, 7 replies.
- [PR] [SPARK-58561][INFRA] Support backporting a PR merged into a non-default branch in `merge_spark_pr.py` [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/04 14:33:01 UTC, 0 replies.
- Re: [PR] [SPARK-58558][SQL] Make requireAllClusterKeysForCoPartition check key coverage instead of exact match for SPJ [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/04 14:48:37 UTC, 17 replies.
- [PR] [SPARK-58563] Support server-side error chain in `SparkConnectError` via `FetchErrorDetails` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/04 14:56:01 UTC, 3 replies.
- Re: [PR] [SPARK-58557][ML] Reuse ML vector data type singleton [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/04 14:56:07 UTC, 2 replies.
- Re: [PR] [SPARK-58561][INFRA] Support backporting a PR merged into a non-default branch [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/04 14:56:23 UTC, 14 replies.
- Re: [PR] [SPARK-58435][SQL] Use named containsNull argument in KLL sketch ArrayType results [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/04 15:20:03 UTC, 1 replies.
- [PR] [SPARK-58562][SQL][DOCS] Document subplan merging in the SQL performance tuning guide [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/08/04 15:29:17 UTC, 6 replies.
- Re: [PR] [SPARK-55968][SQL] Do not treat vectorized reader capacity overflow a… [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/08/04 15:37:55 UTC, 0 replies.
- [PR] [SPARK-58565] Run every assertion in the Helm RBAC test hooks [spark-kubernetes-operator] - posted by "snicholasbarton (via GitHub)" <gi...@apache.org> on 2026/08/04 15:45:41 UTC, 5 replies.
- Re: [PR] [SPARK-57512][SQL] Introduce DelegateExpression, a logical-plan wrapper stripped before planning [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/08/04 15:49:05 UTC, 5 replies.
- [PR] [SPARK-58566][SQL] Add tests for QuotingUtils.quoteIdentifier and escapeSingleQuotedString [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/04 15:53:36 UTC, 0 replies.
- Re: [PR] [SPARK-57487][SQL] Support distributed map join for medium-sized tables via SQL hint [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/08/04 15:55:46 UTC, 6 replies.
- [PR] [https://issues.apache.org/jira/browse/SPARK-58567][SQL] Use nonEmpty/isEmpty instead of length comparisons in StateDataSource [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/04 15:56:20 UTC, 0 replies.
- [PR] [SPARK-57370][SQL][FOLLOWUP] Route codegen referencing an unnameable class to Janino when narrowing is unsound [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/04 16:15:03 UTC, 10 replies.
- [PR] [SPARK-58518][SQL] Do not duplicate input paths when globbing is disabled [spark] - posted by "Joorgem (via GitHub)" <gi...@apache.org> on 2026/08/04 16:24:08 UTC, 2 replies.
- Re: [PR] [SPARK-57928][SQL] Collapse redundant Partial+Final aggregate pair when shuffle is skipped [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/08/04 16:25:11 UTC, 1 replies.
- [PR] [INFRA][BUILD] Replace defunct Jenkins test grouping with modern GitHub Actions grouping [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/08/04 16:39:52 UTC, 0 replies.
- [PR] [SPARK-58568] Support `TIME` type in `DataType.simpleString` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/04 17:19:59 UTC, 3 replies.
- [PR] [SPARK-58571] Support `TIME` type values in `DataFrame.collect` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/04 17:59:24 UTC, 3 replies.
- Re: [PR] [SPARK-58232][SQL] Simplify cached-batch column-index resolution with a map lookup [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/04 18:38:09 UTC, 8 replies.
- Re: [PR] [SPARK-58274][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1068 [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/08/04 19:00:27 UTC, 0 replies.
- Re: [PR] [SPARK-58267][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1059 [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/08/04 19:01:32 UTC, 4 replies.
- Re: [PR] [SPARK-58129][SQL] Assign a name to the error class _LEGACY_ERROR_TEMP_0031 [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/08/04 19:02:58 UTC, 1 replies.
- Re: [PR] [SPARK-58228][SQL] Convert unreachable error condition _LEGACY_ERROR_TEMP_1058 to an internal error [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/08/04 19:04:11 UTC, 3 replies.
- Re: [PR] [SPARK-58567][SQL] Use nonEmpty/isEmpty instead of length comparisons in StateDataSource [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/04 19:04:31 UTC, 2 replies.
- [PR] [SPARK-58545][PYTHON][TEST] Add tests for pa.Array.to_pandas with types_mapper [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/04 19:05:44 UTC, 4 replies.
- Re: [PR] [SPARK-58212][SQL] Replace _LEGACY_ERROR_TEMP_1052 with UNSUPPORTED_FEATURE.TABLE_OPERATION [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/08/04 19:08:36 UTC, 1 replies.
- [PR] [SPARK-58574] Support `TIME` type literals in `lit` and SQL parameter binding [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/04 19:40:15 UTC, 3 replies.
- Re: [PR] [SPARK-58569][SDP][DOCS] Add documentation for Auto CDC (SCD Type 1 and Type 2) [spark] - posted by "suhuruli (via GitHub)" <gi...@apache.org> on 2026/08/04 20:07:43 UTC, 2 replies.
- [PR] [SPARK-58529][PYTHON][4.0] Relax RESULT_ROWS_MISMATCH assertion for cross-version old-client compatibility [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/04 20:12:15 UTC, 2 replies.
- Re: [PR] [SPARK-58573][INFRA][BUILD] Replace defunct Jenkins test grouping with modern GitHub Actions grouping [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/08/04 20:23:20 UTC, 8 replies.
- Re: [PR] [SPARK-58480][PYTHON][TEST] Declare DataFrame golden test cases as methods of a test class [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/08/04 20:39:38 UTC, 12 replies.
- [PR] [SPARK-58575][PYTHON] Inline redundant error_class parameter in worker.py verify helpers [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/04 21:22:40 UTC, 2 replies.
- [PR] [SPARK-58576][PYTHON][TESTS] Add tests for pa.Array.to_pandas with integer_object_nulls [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/04 22:08:16 UTC, 6 replies.
- Re: [PR] [SPARK-58410][PYTHON] Remove unnecessary type: ignore comments in the DataFrame read/write API [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/04 22:34:55 UTC, 4 replies.
- Re: [PR] [SPARK-58389][SQL] Pass all options while loading tables for reads [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/08/04 22:54:12 UTC, 1 replies.
- Re: [PR] [SPARK-58205][SQL] Mark JSON/CSV/XML expressions stateful to prevent shared-evaluator data races [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/04 23:00:02 UTC, 1 replies.
- Re: [PR] [SPARK-58204][SQL] Fix unprotected mutable state in RegExpReplace, RegExpExtractBase, StringTranslate, FormatNumber, and NamedLambdaVariable by marking them stateful [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/04 23:01:19 UTC, 1 replies.
- [PR] [SPARK-58577][PYTHON] Inline wrap_udf into the batched UDF dispatch branch in worker.py [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/04 23:19:58 UTC, 2 replies.
- [PR] [SPARK-XXXXX] Support `TIME` type in `SparkSession.createDataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/05 00:34:43 UTC, 1 replies.
- Re: [PR] [SPARK-56558][SQL] CTAS IF NOT EXISTS bypasses non-empty location check when table does not exist in catalog [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/05 00:39:59 UTC, 11 replies.
- [PR] [SPARK-58529][PYTHON][4.1] Relax RESULT_ROWS_MISMATCH assertion for cross-version old-client compatibility [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/05 00:45:33 UTC, 2 replies.
- [PR] [SPARK-58529][PYTHON][4.2] Relax RESULT_ROWS_MISMATCH assertion for cross-version old-client compatibility [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/05 00:45:41 UTC, 2 replies.
- Re: [PR] [SPARK-58579] Support `TIME` type in `SparkSession.createDataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/05 00:58:07 UTC, 3 replies.
- [PR] harden: spark connect client's reattachment mechanism a... in... [spark] - posted by "anupamme (via GitHub)" <gi...@apache.org> on 2026/08/05 01:39:29 UTC, 4 replies.
- Re: [PR] [SPARK-58118][SDP] Allow user-specified AUTO CDC schema to omit the reserved metadata column [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/05 01:57:29 UTC, 35 replies.
- [PR] fix: upgrade com.squareup.okhttp3:okhttp to 4.9.2 (CVE-2021-0341) [spark] - posted by "anupamme (via GitHub)" <gi...@apache.org> on 2026/08/05 02:18:56 UTC, 3 replies.
- Re: [PR] [SPARK-57591][SQL] Read and infer ORC schema from archives [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/05 02:51:11 UTC, 2 replies.
- Re: [PR] [SPARK-58536] Fix stale docstring for getDefaultFinalStatus in cluster mode [spark] - posted by "Lobo2008 (via GitHub)" <gi...@apache.org> on 2026/08/05 03:03:21 UTC, 0 replies.
- [PR] [SPARK-58580][PS] Use native Spark function for NumPy ldexp [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/05 03:22:09 UTC, 2 replies.
- Re: [PR] [SPARK-54449][CORE] Storage Memory off heap size should be considered only when off heap is enabled [spark] - posted by "VindhyaG (via GitHub)" <gi...@apache.org> on 2026/08/05 03:27:59 UTC, 0 replies.
- [PR] [WIP][PYTHON] Optimize PySpark broadcast serialization with Arrow [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/05 04:17:12 UTC, 1 replies.
- Re: [PR] [SPARK-58569][SDP][DOCS] Add documentation for Auto CDC (SCD Type 1) [spark] - posted by "suhuruli (via GitHub)" <gi...@apache.org> on 2026/08/05 04:48:00 UTC, 12 replies.
- Re: [PR] [SPARK-58111][SQL] Scan and write schema narrowing for column-level UPDATE in DSv2 [spark] - posted by "anuragmantri (via GitHub)" <gi...@apache.org> on 2026/08/05 05:25:45 UTC, 30 replies.
- Re: [PR] [SPARK-58218][SQL] Replace generic RuntimeException with typed exceptions in AvroDeserializer [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/05 05:28:09 UTC, 2 replies.
- [PR] [SPARK-58583][ML] Construct squared Euclidean silhouette stats on executors [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/05 05:52:01 UTC, 3 replies.
- Re: [PR] [SPARK-58231][GRAPHX][TESTS][FOLLOW UP] Add regression test for SVD++ aggregateMessages combiner [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/05 06:59:36 UTC, 0 replies.
- Re: [PR] [SPARK-58177][GRAPHX][TEST][FOLLOWUP] Add regression test for SVD++ aggregateMessages combiner [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/05 07:01:34 UTC, 1 replies.
- [PR] [SPARK-58581][PS] Use native Spark function for NumPy floor_divide [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/05 07:04:37 UTC, 5 replies.
- [PR] [SPARK-58582][PS] Use native Spark function for NumPy fmod [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/05 07:06:48 UTC, 4 replies.
- Re: [PR] [SPARK-58566][SQL][TESTS] Add tests for QuotingUtils.quoteIdentifier and escapeSingleQuotedString [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/05 07:18:57 UTC, 2 replies.
- [I] [SQL][CONNECT] SparkConnectClient may drop metadata (auth headers) on retried/reattached RPCs if metadata is a non-list iterable [spark] - posted by "anupamme (via GitHub)" <gi...@apache.org> on 2026/08/05 07:31:08 UTC, 1 replies.
- [PR] [SPARK-58585][SQL] Extract a helper for INVALID_EXTERNAL_VALUE errors in CatalystTypeConverters [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/05 07:36:05 UTC, 2 replies.
- [PR] [SPARK-58586][DOCS] Use a supported Python version in the RDD guide PYSPARK_PYTHON example [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/05 07:36:16 UTC, 2 replies.
- [PR] [WIP][MLLIB] Use spillable sort for final IsotonicRegression pass [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/05 08:16:24 UTC, 0 replies.
- Re: [PR] [SPARK-57785][SQL][CONNECT] harden: spark connect client's reattachment mechanism a... in... [spark] - posted by "anupamme (via GitHub)" <gi...@apache.org> on 2026/08/05 08:41:20 UTC, 7 replies.
- Re: [PR] [SPARK-58550][ML] Delay GaussianMixture aggregation allocations [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/05 08:48:08 UTC, 2 replies.
- Re: [PR] [CONNECT] Demonstrate stale cached plan without DSv2 refresh [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/05 08:51:02 UTC, 0 replies.
- [PR] [SPARK-58578][SQL]Mark ApplyFunctionExpression stateful to prevent reusedRow data races under concurrent evaluation [spark] - posted by "MrHappyEnding (via GitHub)" <gi...@apache.org> on 2026/08/05 09:21:07 UTC, 0 replies.
- [PR] [SPARK-58588][SQL] Return the broadcast hash join build side from JoinSelectionHelper instead of a Boolean [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/05 09:54:10 UTC, 6 replies.
- [PR] [SPARK-58384][SQL] Preserve null semantics in OptimizeJoinCondition [spark] - posted by "MrHappyEnding (via GitHub)" <gi...@apache.org> on 2026/08/05 10:03:51 UTC, 5 replies.
- Re: [PR] [SPARK-58587][ML] Move final IsotonicRegression PAV pass to executor [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/05 10:49:54 UTC, 2 replies.
- Re: [PR] [SPARK-58578][SQL] Mark ApplyFunctionExpression stateful to prevent reusedRow data races under concurrent evaluation [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/05 10:51:20 UTC, 6 replies.
- [PR] [SPARK-58589][SS] Drop redundant .apply on Function1 encoders in StateTypesEncoderUtils [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/05 11:00:14 UTC, 3 replies.
- [PR] [SPARK-58590][PS] Remove obsolete pandas 0.24.0 version notes from datetime accessor docstrings [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/05 11:06:42 UTC, 2 replies.
- [I] [SPARK] Upgrade okhttp to 4.12.0 and okio to 3.9.x [spark] - posted by "anupamme (via GitHub)" <gi...@apache.org> on 2026/08/05 12:32:42 UTC, 0 replies.
- Re: [PR] [SPARK-57794][BUILD] Upgrade okhttp to 4.12.0 and okio to 3.9.x [spark] - posted by "anupamme (via GitHub)" <gi...@apache.org> on 2026/08/05 13:00:05 UTC, 1 replies.
- [PR] [SPARK-56738][SQL] Make Oracle bare NUMBER default scale configurable [spark] - posted by "ruchi-mish90 (via GitHub)" <gi...@apache.org> on 2026/08/05 14:59:04 UTC, 1 replies.
- Re: [PR] [SPARK-57737][SQL] Speed up date_trunc zone offset resolution with a per-task cache [spark] - posted by "Licht-T (via GitHub)" <gi...@apache.org> on 2026/08/05 15:36:51 UTC, 1 replies.
- [PR] [SPARK-58592][CORE] Redact secrets in persisted Master recovery state [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2026/08/05 15:40:50 UTC, 2 replies.
- [PR] [SPARK-58593][CONNECT] Add extension Any field to AnalyzePlanResponse [spark] - posted by "mehdi-gharam-db (via GitHub)" <gi...@apache.org> on 2026/08/05 16:49:54 UTC, 2 replies.
- [PR] [SPARK-58594][SQL] Union output partitioning should merge KeyedPartitioning in PartitioningCollection children [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/08/05 17:44:24 UTC, 0 replies.
- [PR] [SPARK-58596] Remove `spark.dynamicAllocation.shuffleTracking.enabled` from examples and docs [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/05 20:37:27 UTC, 3 replies.
- [PR] [SPARK-58597] Add `ExecutorPVCResizePlugin` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/05 21:09:50 UTC, 3 replies.
- Re: [PR] [SPARK-58392][SQL] Pass all options while loading relations [spark] - posted by "yyanyy (via GitHub)" <gi...@apache.org> on 2026/08/05 21:38:29 UTC, 7 replies.
- [PR] [SPARK-58599] Add `Recovery-mode Executor` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/05 21:42:42 UTC, 3 replies.
- [PR] [SPARK-58389][SQL][FOLLOWUP] Pin DSv2 table instances by state options during analysis [spark] - posted by "yyanyy (via GitHub)" <gi...@apache.org> on 2026/08/05 21:53:08 UTC, 14 replies.
- [PR] [SPARK-58601][PYTHON] Tighten mapInPandas return-value contract to require a strict Iterator [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/05 22:18:44 UTC, 11 replies.
- Re: [PR] [SPARK-58021][CONNECT] Generalize local Connect server launching [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/08/05 23:01:34 UTC, 3 replies.
- [PR] [SPARK-58603][PYTHON] Make _with_origin re-entrant so nested PySpark API calls keep the outermost call site [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/06 00:01:26 UTC, 0 replies.
- [PR] [SPARK-58604][SQL] Preserve viewDependencies when rebuilding a View for ALTER VIEW [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/08/06 00:25:33 UTC, 3 replies.
- [PR] [MINOR][DOC] Suggest where to place new class members in AGENTS.md [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/08/06 00:43:38 UTC, 4 replies.
- [PR] [SPARK-27052][SQL][PYTHON] Support Python UDFs inside higher-order function lambdas [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/06 00:44:38 UTC, 22 replies.
- [PR] [SPARK-58605][SQL] Verify parent-archive _metadata for archive reads [spark] - posted by "akshatshenoi-db (via GitHub)" <gi...@apache.org> on 2026/08/06 01:30:30 UTC, 3 replies.
- [PR] [SPARK-58606][ML] Use a DataFrame join in FPGrowthModel transform [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/06 01:33:04 UTC, 0 replies.
- Re: [PR] [SPARK-58603][PYTHON] Expand DataFrame query context coverage to pyspark.sql.functions [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/06 01:42:19 UTC, 0 replies.
- [PR] [SPARK-58607][BUILD] Upgrade `Netty` to 4.2.17.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/06 01:46:20 UTC, 4 replies.
- [PR] [SPARK-58608] Support `Observation` to retrieve observed metrics [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/06 01:50:46 UTC, 3 replies.
- [PR] [SPARK-58609][SQL] Add archivePathFilter option to select inner archive entries [spark] - posted by "akshatshenoi-db (via GitHub)" <gi...@apache.org> on 2026/08/06 02:37:01 UTC, 7 replies.
- [PR] [SPARK-57659][SQL] Make SchemaPruning idempotent after variant pushdown [spark] - posted by "goutamadwant (via GitHub)" <gi...@apache.org> on 2026/08/06 02:56:51 UTC, 8 replies.
- Re: [I] [SQL] SchemaPruning is not idempotent when a query reads `_metadata` and a VARIANT column is only referenced below a nondeterministic filter [spark] - posted by "goutamadwant (via GitHub)" <gi...@apache.org> on 2026/08/06 02:58:54 UTC, 1 replies.
- [PR] [SPARK-58192][CORE][FOLLOWUP] Clarify fractional CPU documentation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/06 03:13:07 UTC, 3 replies.
- [PR] [SPARK-58610] Support `cloneSession` in `SparkSession` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/06 03:55:27 UTC, 3 replies.
- Re: [PR] [SPARK-57794][BUILD] Remove hadoop-huaweicloud and its okhttp/okio dependencies [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/06 03:55:44 UTC, 14 replies.
- [PR] [SPARK-58485] [SQL] Broadcast hash joins with scalar subquery as join key [spark] - posted by "VindhyaG (via GitHub)" <gi...@apache.org> on 2026/08/06 04:28:16 UTC, 1 replies.
- [PR] [WIP] Stack/pipelined shuffle pr9 rtm aggregation [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/08/06 04:57:40 UTC, 0 replies.
- [PR] [SPARK-58611][SS] Left anti stream-stream join [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2026/08/06 05:02:21 UTC, 11 replies.
- Re: [PR] [SPARK-58592][CORE] Redact secrets in Standalone Master RequestMasterState RPC [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2026/08/06 05:20:56 UTC, 3 replies.
- [PR] [SPARK-58612][SQL] Recurse into archives nested inside archives [spark] - posted by "akshatshenoi-db (via GitHub)" <gi...@apache.org> on 2026/08/06 05:45:01 UTC, 2 replies.
- [PR] [SPARK-58614][SQL] Support DISTINCT aggregates in unbounded preceding window frames [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2026/08/06 06:39:39 UTC, 18 replies.
- Re: [PR] [SPARK-58606][ML] Move association-rule collection and preparation in FPGrowthModel transform from driver to executors [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/06 07:23:02 UTC, 1 replies.
- [PR] [SPARK-58615][ML] Avoid FPGrowthModel temporary column conflicts [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/06 07:35:59 UTC, 2 replies.
- [PR] [SPARK-58429][SQL] Uncorrelated IN-subquery selected with a global aggregate returns false/NULL instead of true when the input is empty [spark] - posted by "MrHappyEnding (via GitHub)" <gi...@apache.org> on 2026/08/06 07:55:06 UTC, 0 replies.
- Re: [PR] [SPARK-57956][SQL] Fix AQE incorrectly eliminating a global LIMIT over a non-materialized query stage [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/06 08:04:17 UTC, 3 replies.
- [PR] [MINOR][INFRA] Clarify JIRA reuse for follow-up PRs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/06 08:08:17 UTC, 15 replies.
- [PR] [SPARK-58553][PS][FOLLOWUP] Preserve signed zero in NumPy fmax and fmin [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/06 08:49:48 UTC, 2 replies.
- [PR] [SPARK-58580][PS][FOLLOWUP] Preserve ldexp zero and infinity inputs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/06 09:06:30 UTC, 2 replies.
- [PR] [SPARK-58618][BUILD] Fix duplicated path in lint-scala scalafmt failure message [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/06 10:21:09 UTC, 2 replies.
- Re: [PR] [SPARK-58513][CORE] Init UnifiedMemoryManager should check driver config in driver , check executor config in executor [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/06 10:26:55 UTC, 1 replies.
- [PR] [SPARK-58620][EXAMPLES] Fix incorrect comments and stale usage docs in the custom receiver examples [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/06 10:48:09 UTC, 3 replies.
- [PR] [SPARK-58621][ML] Add descriptive messages to SummarizerBuffer metric accessor require checks [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/06 10:48:11 UTC, 2 replies.
- [PR] [SPARK-58616][CORE][PYTHON] Attribute a reason for context-wide job cancellation in cancelAllJobs [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2026/08/06 12:29:03 UTC, 3 replies.
- Re: [PR] [MINOR][DOCS] Fix typos and add missing references to standalone and YARN deployment docs [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/06 13:30:09 UTC, 1 replies.
- Re: [PR] [MINOR][BUILD] Drop retired oro dependency [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/06 13:35:01 UTC, 0 replies.
- [PR] [MINOR][DOC] Check both AGENTS.md and CLAUDE.md for nested project instructions [spark] - posted by "gatorsmile (via GitHub)" <gi...@apache.org> on 2026/08/06 15:51:37 UTC, 3 replies.
- [PR] [SPARK-58623][SQL] Extend ExpandBenchmark with CSE/rewrite matrix [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/08/06 15:52:42 UTC, 10 replies.
- [PR] Add `recursive` flag to `variant_explode` [spark] - posted by "bojana-db (via GitHub)" <gi...@apache.org> on 2026/08/06 16:36:36 UTC, 0 replies.
- Re: [PR] [SPARK-58192][CORE][FOLLOWUP] Preserve exact task CPU amounts in PySpark [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/06 16:37:33 UTC, 2 replies.
- [PR] [SPARK-38954][CORE][FOLLOWUP] Isolate credential provider requirement failures [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/06 16:40:02 UTC, 10 replies.
- Re: [PR] [SPARK-58350][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1228 [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/06 16:45:21 UTC, 1 replies.
- Re: [PR] [SPARK-57699][DOCS] Update docs/control-flow/leave-stmt.md [spark] - posted by "mingjialiu (via GitHub)" <gi...@apache.org> on 2026/08/06 17:10:52 UTC, 0 replies.
- Re: [PR] [SPARK-46164][PYTHON] Add include/exclude parameters to DataFrame.describe in pandas API on Spark [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/08/06 20:28:23 UTC, 0 replies.
- [PR] [SPARK-58625][PYTHON] Support pa.ChunkedArray columns in PandasToArrowConversion [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/06 20:43:22 UTC, 3 replies.
- [PR] [SPARK-58602][PYTHON][TESTS] Add tests for pa.Array.from_pandas with default arguments [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/06 21:42:39 UTC, 4 replies.
- Re: [PR] [SPARK-58275][SQL][PYTHON] Add `normalize` Unicode normalization SQL function [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/06 22:32:50 UTC, 8 replies.
- Re: [PR] Project DSv2 leaf node to Scan's schema [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/07 01:19:37 UTC, 1 replies.
- Re: [PR] [SPARK-47998][PS] Fix misleading error message in pandas-on-Spark concat [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/07 01:19:41 UTC, 1 replies.
- Re: [PR] [SPARK-54647][PYTHON] Support User-Defined Aggregate Functions (UDAF) [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/07 01:19:46 UTC, 1 replies.
- [PR] [SPARK-58619][CORE][CONNECT][PYTHON] Support sub-condition level SQLSTATE in the error condition framework [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/08/07 01:41:51 UTC, 6 replies.
- [PR] [SPARK-58631][SQL] Fix inconsistent array size limit errors in array_repeat and array_insert codegen [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/08/07 02:07:40 UTC, 1 replies.
- [I] 【资源分享】Gemini Pro 1年高级稳定号（已过反重力可直登）——高频开发测试必备 [spark] - posted by "jonathanlopez5494ov-netizen (via GitHub)" <gi...@apache.org> on 2026/08/07 02:57:47 UTC, 3 replies.
- [PR] [SPARK-58632][CONNECT] Send Spark Connect operation ID in gRPC metadata [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/07 03:12:15 UTC, 10 replies.
- [PR] [SPARK-54958][PYTHON][ML][TEST] Revert test_cv_io_pipeline.py parallelization [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/07 03:12:28 UTC, 1 replies.
- [PR] [SPARK-58630][PS] Use native Spark expressions for NumPy copysign [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/07 03:24:18 UTC, 5 replies.
- Re: [PR] [SPARK-58556][CONNECT][UI] Show ML cache status in Spark Connect UI [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/07 04:41:52 UTC, 10 replies.
- [PR] [SPARK-58629][CONNECT] Avoid empty fallback gRPC errors [spark] - posted by "haoyangeng-db (via GitHub)" <gi...@apache.org> on 2026/08/07 05:06:39 UTC, 4 replies.
- [PR] [SPARK-58633][ML] Use integer label indexes in StringIndexerModel [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/07 05:11:32 UTC, 2 replies.
- [PR] [SPARK-58634][ML] Avoid caching VectorIndexer transformation state [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/07 05:22:05 UTC, 2 replies.
- [PR] [MINOR][INFRA][4.3] Enable post-merge Build on branch-4.3 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/07 05:25:50 UTC, 3 replies.
- [PR] [MINOR][INFRA][4.X] Run post-merge Build every ten commits [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/07 05:34:28 UTC, 4 replies.
- [PR] [WIP] Rtm default configs [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/08/07 07:07:48 UTC, 2 replies.
- [PR] [SPARK-58636][PYTHON] Remove unnecessary type: ignore[union-attr] in streaming MLlib trainers [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/07 07:09:52 UTC, 4 replies.
- [PR] [SPARK-56998][FOLLOWUP][DOCS] Refine SECURITY.md reporting instructions and add known non-findings [spark] - posted by "ppkarwasz (via GitHub)" <gi...@apache.org> on 2026/08/07 07:32:15 UTC, 1 replies.
- Re: [PR] [SPARK-56413][SQL][UDF] gRPC implementation of the UDF worker protocol dispatcher [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2026/08/07 09:32:39 UTC, 1 replies.
- [PR] [SPARK-58637][ML] Optimize HashingTF transform closure [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/07 09:54:44 UTC, 4 replies.
- Re: [PR] [SPARK-58513][CORE] Init UnifiedMemoryManager should only check executor config in executor [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/07 09:59:36 UTC, 0 replies.
- Re: [PR] [SPARK-58062][SQL] Add `variant_strip_nulls` expression [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/07 10:31:32 UTC, 28 replies.
- [PR] [SPARK-58639][DOCS] Replace stale listCachedTables reference in the SQL performance tuning guide [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/07 11:03:06 UTC, 3 replies.
- [PR] [SPARK-58640][SQL] Align getBool with the sibling option accessors in CSVOptions and XmlOptions [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/07 11:03:08 UTC, 3 replies.
- [PR] [SPARK-58638][INFRA] Recognize Examples as a primary component tag in the merge script [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/07 11:08:56 UTC, 2 replies.
- [PR] [MINOR][SQL][TESTS] Add sql shorthand to SparkSessionProvider [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/07 11:28:42 UTC, 2 replies.
- Re: [PR] [SPARK-58174][BUILD] Fetch maven plugins from mirror if MAVEN_MIRROR_URL is set [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/07 11:29:17 UTC, 1 replies.
- [PR] [SQL] Add identifier clause function resolution tests [spark] - posted by "vladanvasi-db (via GitHub)" <gi...@apache.org> on 2026/08/07 11:37:05 UTC, 0 replies.
- [PR] [MINOR][BUILD] Mark spark-deps manifest as auto-generated [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/07 12:37:02 UTC, 5 replies.
- [PR] [MINOR][INFRA] Restore branch-4.x Build status badge [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/07 12:44:28 UTC, 2 replies.
- [PR] [MINOR][INFRA][4.X] Explain skipped post-merge Build runs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/07 12:58:57 UTC, 3 replies.
- Re: [PR] [SPARK-58407][SQL][TESTS][CONNECT] Fix connect.SessionQueryTest beforeAll, afterAll [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/07 12:59:08 UTC, 2 replies.
- [PR] [SPARK-57787][CONNECT][FOLLOWUP] Harden persistent local Connect server management [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/07 14:15:03 UTC, 8 replies.
- [PR] [SPARK-58643][SQL] Require a constant `create_if_missing` in `variant_set/try_variant_set` [spark] - posted by "bojana-db (via GitHub)" <gi...@apache.org> on 2026/08/07 16:37:09 UTC, 3 replies.
- [PR] [SPARK-58644] Document intentional ignore of `queryStartedEventJson` in `DataStreamWriter` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/07 16:39:44 UTC, 3 replies.
- [PR] [SPARK-58646][PS] Use native expressions for NumPy reciprocal on integer columns [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/07 17:01:50 UTC, 3 replies.
- [PR] [SPARK-58647] Add public `DataType` and `StructType` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/07 17:35:48 UTC, 3 replies.
- [PR] [MLLIB] Exclude zero-weight observations from KMeans initialization [spark] - posted by "Israelobuk (via GitHub)" <gi...@apache.org> on 2026/08/07 18:21:01 UTC, 0 replies.
- [PR] [SPARK-58648] Support StructType in schema, createDataFrame, and to APIs [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/07 18:22:29 UTC, 3 replies.
- [PR] [SPARK-48973][SQL] Fix mask to handle characters outside the BMP [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/08/07 18:39:45 UTC, 0 replies.
- [PR] [SPARK-58649] Allow SparkApplication drivers ingress to SparkCluster workers [spark-kubernetes-operator] - posted by "YGoetschel (via GitHub)" <gi...@apache.org> on 2026/08/07 18:52:34 UTC, 2 replies.
- [PR] [SPARK-58651] Support `parseDDL` in `SparkSession` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/07 19:27:48 UTC, 3 replies.
- [PR] [SPARK-58652] Update `Spark Connect`-generated `Swift` source code with `branch-4.3 (2026-08-07)` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/07 19:48:19 UTC, 3 replies.
- [PR] [SPARK-58210][SQL][FOLLOWUP] Extend CombineAdjacentAggregation to partial merge [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/07 19:52:06 UTC, 8 replies.
- [PR] [SPARK-58653] Support typed `StreamingQueryProgress` in `(last|recent)Progress` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/07 19:59:31 UTC, 3 replies.
- [PR] [SPARK-58654] Upgrade Apache DataFusion Comet to 1.0.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/07 20:32:34 UTC, 0 replies.
- Re: [PR] [SPARK-48973][SQL] Fix mask to handle characters outside the BMP [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/08/07 20:35:33 UTC, 4 replies.
- [PR] [SPARK-58655] Upgrade `Gradle` to 9.7.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/07 20:38:02 UTC, 5 replies.
- [PR] [SPARK-58656][PYTHON][TESTS] Centralize the to_pandas golden test inventory into a shared base [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/07 20:53:36 UTC, 4 replies.
- [PR] [SPARK-58657][PYTHON][TESTS] Add tests for pa.Array.from_pandas with the mask argument [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/07 21:02:16 UTC, 5 replies.
- [PR] [SPARK-58658][CONNECT] Do not return spark.connect.authenticate.token from the Config RPC [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/08/07 21:25:56 UTC, 2 replies.
- [PR] [SPARK-58602][PYTHON][TESTS][FOLLOWUP] Fix the test entry point of test_pyarrow_array_from_pandas_default [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/07 22:41:46 UTC, 5 replies.
- Re: [I] [SPARK] Memory pressure during block fetching of cached tables causes excessive memory usage [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/08 00:23:18 UTC, 0 replies.
- Re: [PR] [SPARK-54908][SQL] Support dateFormat option during JSON schema inference [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/08 00:23:20 UTC, 1 replies.
- Re: [PR] [SPARK-56157][CORE] Support limitActiveProcessorCount in standalone mode [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/08 00:23:23 UTC, 1 replies.
- Re: [PR] [SPARK-56158][CORE] Support limitActiveProcessorCount in local mode [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/08 00:23:25 UTC, 1 replies.
- [PR] [SPARK-58389][SQL] Pass all options while loading tables for writes [spark] - posted by "yyanyy (via GitHub)" <gi...@apache.org> on 2026/08/08 02:10:00 UTC, 2 replies.
- [PR] [SPARK-57896][CORE][TESTS] Add Kerberos coexistence and per-user token integration tests [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/08/08 06:28:37 UTC, 9 replies.
- [PR] [SPARK-58660][INFRA] Self-heal the PR Build check when the notify workflow fails to create it [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2026/08/08 07:43:14 UTC, 9 replies.
- [PR] [SPARK-58661][SQL][DOCS] Document return values and fix stale column references in DataFrameStatFunctions [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/08 10:12:16 UTC, 3 replies.
- [PR] [SPARK-58662][SS] Remove redundant toString in RocksDBStateStoreProvider state transition messages [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/08 10:12:19 UTC, 3 replies.
- [PR] [SPARK-58663][BUILD] Fix typos and grammar in root pom.xml comments [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/08 10:12:21 UTC, 3 replies.
- [PR] [SPARK-58664][PYTHON] Factor out repeated paths in PySpark Classic's setup.py [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/08/08 17:07:47 UTC, 3 replies.
- [PR] [BUILD] Remove hadoop-huaweicloud and its okhttp/okio dependencies [spark] - posted by "zhangxinyao88 (via GitHub)" <gi...@apache.org> on 2026/08/08 17:19:24 UTC, 0 replies.
- [PR] [MINOR][DOCS] Fix missing subject in event log compaction note in mon… [spark] - posted by "Tankdoggo (via GitHub)" <gi...@apache.org> on 2026/08/08 20:12:28 UTC, 1 replies.
- Re: [PR] [SPARK-58654] Upgrade `Apache DataFusion Comet` to 1.0.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/08 20:50:46 UTC, 2 replies.
- [PR] [SPARK-XXXXX][BUILD] Upgrade `lz4-java` to 1.11.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/08 22:32:58 UTC, 1 replies.
- [PR] [SPARK-XXXXX][BUILD] Upgrade `zstd-jni` to 1.5.7-13 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/08 22:35:21 UTC, 0 replies.
- [PR] Bump json from 2.21.1 to 2.21.2 in /docs [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/08/09 00:12:51 UTC, 5 replies.
- Re: [PR] [SPARK-56690][SQL] - Expose common `TaskMemoryManager` API on `HashedRelation` to avoid code duplication [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/09 00:24:50 UTC, 1 replies.
- Re: [I] Feature request: infer field names in json_tuple [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/09 00:24:53 UTC, 0 replies.
- Re: [PR] [SPARK-XXXXX][SQL][TESTS] Add DSv2 CACHE TABLE and write validation t… [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/09 00:24:54 UTC, 1 replies.
- Re: [I] Fetching of blocks of cache table may cause high memory pressure [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/09 00:24:57 UTC, 0 replies.
- [PR] [SPARK-52746] Test `isLocal` behavior explicitly for Spark 4.0 and 4.1+ servers [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/09 00:32:48 UTC, 3 replies.
- [PR] [SPARK-52747] Test timezone variations [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/09 00:46:13 UTC, 3 replies.
- [PR] [SPARK-58667] Upgrade `swift-system` to 1.8.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/09 00:50:08 UTC, 3 replies.
- [PR] [SPARK-58668] Upgrade `operator-framework` to 5.5.1 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/09 00:51:12 UTC, 7 replies.
- [PR] [SPARK-57894][SPARK-57895][CORE][K8S][DOCS] Add documentation comments and `@volatile` fix for credential delivery [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/08/09 02:28:26 UTC, 1 replies.
- Re: [PR] [SPARK-54999] Re-enable `ConstraintTests` by moving into `IcebergTests` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/09 03:31:38 UTC, 0 replies.
- Re: [PR] [SPARK-58665][BUILD] Upgrade `lz4-java` to 1.11.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/09 03:39:39 UTC, 4 replies.
- Re: [PR] [SPARK-58666][BUILD] Upgrade `zstd-jni` to 1.5.7-13 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/09 03:39:49 UTC, 5 replies.
- [PR] [SPARK-58669] Upgrade `spotbugs-gradle-plugin` to 6.5.10 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/09 04:38:45 UTC, 3 replies.
- [PR] [SPARK-58670] Upgrade JUnit to 6.1.3 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/09 04:45:25 UTC, 4 replies.
- Re: [PR] [SPARK-58671][BUILD] Remove hadoop-huaweicloud and its okhttp/okio dependencies [spark] - posted by "anupamme (via GitHub)" <gi...@apache.org> on 2026/08/09 05:25:26 UTC, 6 replies.
- [PR] [SPARK-58672][SQL] Reject CHAR/VARCHAR map keys in variant_get [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/08/09 07:32:08 UTC, 1 replies.
- Re: [PR] [MINOR][DOCS] Fix missing subject in event log compaction note [spark] - posted by "Tankdoggo (via GitHub)" <gi...@apache.org> on 2026/08/09 11:00:13 UTC, 0 replies.
- [PR] [SPARK-58674][CORE] Assign a name to the error condition `_LEGACY_ERROR_TEMP_3021-3029` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/09 11:59:31 UTC, 0 replies.
- [PR] [SPARK-58675][R] Add SparkR Support for json_typof function [spark] - posted by "pratham76 (via GitHub)" <gi...@apache.org> on 2026/08/09 16:39:32 UTC, 2 replies.
- [PR] [SPARK-58676] Upgrade `cyclonedx-gradle-plugin` to 3.4.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/09 18:57:26 UTC, 4 replies.
- [PR] [SPARK-58678][CORE][TESTS] Add `OpenHashMapBenchmark` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/09 19:31:55 UTC, 6 replies.
- [PR] [SPARK-58679][DOCS] Fix typos and grammar in the SQL name resolution reference doc [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/09 21:08:46 UTC, 3 replies.
- [PR] [SPARK-58680][CORE] Use isEmpty/nonEmpty for emptiness checks in ExternalAppendOnlyMap [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/09 21:08:49 UTC, 3 replies.
- Re: [PR] fix: remove bare excepts and clean up lint issues (quantum-local-fixer) [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/10 00:25:59 UTC, 1 replies.
- [PR] [SPARK-58681][SQL][TESTS] Fix race in SparkSession job cancellation test [spark] - posted by "manuzhang (via GitHub)" <gi...@apache.org> on 2026/08/10 01:43:18 UTC, 1 replies.
- [PR] [SPARK-58682][DOCS] Update outdated `OpenHashMap`/`OpenHashSet` performance claims [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/10 01:48:55 UTC, 5 replies.
- Re: [PR] [SPARK-58674][CORE] Assign a name to the error condition `_LEGACY_ERROR_TEMP_3021-3023,3026,3029` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/10 03:44:09 UTC, 3 replies.
- Re: [PR] [SPARK-58513][CORE] UnifiedMemoryManager wrongly reports INVALID_DRIVER_MEMORY on the executor side [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/10 03:46:44 UTC, 3 replies.
- Re: [PR] [SPARK-58659][SS] Set Real-Time Mode config defaults [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/10 03:52:25 UTC, 12 replies.
- [PR] [SPARK-58683][ML] Avoid capturing NGram transformation state [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/10 05:10:02 UTC, 1 replies.
- [PR] [SPARK-58684][PYTHON] Make get_sqlstate fall back to the main error class's sqlState [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/08/10 05:42:34 UTC, 3 replies.
- Re: [PR] [SPARK-58594][SQL] Revise KeyedPartitioning handling in UnionExec output partitioning [spark] - posted by "naveenp2708 (via GitHub)" <gi...@apache.org> on 2026/08/10 05:43:42 UTC, 0 replies.
- Re: [PR] [SPARK-57894][SPARK-57895][CORE][K8S][DOCS][FOLLOWUP] Add documentation comments and `@volatile` fix for credential delivery [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/08/10 05:56:54 UTC, 2 replies.
- [PR] [SPARK-58685][SQL] Support the ANSI SQL/JSON JSON_VALUE scalar function [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2026/08/10 06:00:25 UTC, 9 replies.
- Re: [PR] [SPARK-58635][SS] Support for streaming aggregation in Real-Time Mode (RTM) [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/08/10 06:04:12 UTC, 6 replies.
- Re: [PR] [SPARK-57665][SQL] Fix slice() returning empty for large length in the interpreted path [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/08/10 06:55:34 UTC, 8 replies.
- [PR] [SPARK-58688][ML] Avoid capturing DCT transformation state [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/10 07:03:43 UTC, 1 replies.
- Re: [I] [SPARK] Remove hadoop-huaweicloud and its okhttp/okio dependencies [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/10 07:59:52 UTC, 1 replies.
- [PR] [SPARK-58689][CORE][TESTS] Add tests for SparkStringUtils padding and abbreviation helpers [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/10 08:46:56 UTC, 5 replies.
- [PR] [SPARK-58690][CORE] Fix typos in storage package comments [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/10 08:46:59 UTC, 3 replies.
- Re: [PR] [SPARK-58439][BUILD][INFRA] Add dedicated validation script for distributions [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/10 09:08:26 UTC, 0 replies.
- [PR] [SPARK-58658][CONNECT] Do not return redacted configurations from the Config RPC [spark] - posted by "alexandrefimov (via GitHub)" <gi...@apache.org> on 2026/08/10 09:42:08 UTC, 8 replies.
- [PR] [SPARK-41246][CORE] Parse RDD block ids whose RDD id overflowed to negative [spark] - posted by "giriprakash (via GitHub)" <gi...@apache.org> on 2026/08/10 10:56:50 UTC, 1 replies.
- [PR] [Spark-56413] Direct dispatcher to manage grpc-based udf server. [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2026/08/10 11:54:21 UTC, 0 replies.
- Re: [PR] [SPARK-56907][SQL] Reduce per-value allocation in DELTA_LENGTH_BYTE_ARRAY Parquet vectorized reader [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/10 11:57:18 UTC, 2 replies.
- Re: [PR] [SPARK-58688][ML] Optimize DCT transform closure [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/10 12:12:48 UTC, 1 replies.
- Re: [PR] [SPARK-58683][ML] Optimize NGram transform closure [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/10 12:14:10 UTC, 1 replies.
- [PR] [SPARK-58692][ML] Optimize PolynomialExpansion transform closure [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/10 12:19:25 UTC, 3 replies.
- Re: [PR] [MINOR][DOC] Suggest grouping code into sections when adding class members in AGENTS.md [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/10 12:43:22 UTC, 3 replies.
- Re: [PR] [SPARK-57837][SQL] Support the precision argument in current_timestamp(p) and localtimestamp(p) [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/10 12:47:05 UTC, 4 replies.
- [PR] [SPARK-58691] Allow metrics scraping ingress to SparkCluster worker web port [spark-kubernetes-operator] - posted by "yalindogusahin (via GitHub)" <gi...@apache.org> on 2026/08/10 12:47:43 UTC, 3 replies.
- [PR] harden: the shuffleblockfetcheriterator uses unbounded ... in... [spark] - posted by "anupamme (via GitHub)" <gi...@apache.org> on 2026/08/10 12:48:13 UTC, 3 replies.
- [I] [PYTHON][PIPELINES] dataflowgraph does not handle materalized views dependencies correctly [spark] - posted by "wilhelm-ubm (via GitHub)" <gi...@apache.org> on 2026/08/10 13:15:40 UTC, 1 replies.
- [PR] [SPARK-58694][PS] Use native Spark functions for NumPy logaddexp and logaddexp2 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/10 13:40:44 UTC, 3 replies.
- [PR] [SPARK-58695][SQL][PYTHON] Support scalar pandas and Arrow UDFs inside higher-order function lambdas [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/10 13:51:58 UTC, 13 replies.
- [PR] [WIP][SPARK-XXXXX][SQL] Make initcap use collation locale [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2026/08/10 15:15:27 UTC, 0 replies.
- [PR] [SPARK-58696][SQL] Fix CTE pushdown discarding injected filters [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/08/10 15:27:44 UTC, 4 replies.
- [PR] [WIP][SQL] Apply default collation to implicit casts [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2026/08/10 16:05:33 UTC, 0 replies.
- Re: [PR] [SPARK-58697][SQL] Make initcap use collation locale [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/10 17:31:57 UTC, 6 replies.
- [PR] [WIP] Stack/pipelined shuffle pr10 kafka rtm tests [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/08/10 17:38:55 UTC, 0 replies.
- [PR] [WIP] Stack/pipelined shuffle rtm docs [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/08/10 17:39:12 UTC, 0 replies.
- [PR] [SPARK-58693][K8S] Skip unlistable directories in K8s shuffle data recovery [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/10 18:07:23 UTC, 3 replies.
- [PR] [MINOR][PYTHON][DOCS] Fix PySpark SQL function documentation [spark] - posted by "wilhelmagren (via GitHub)" <gi...@apache.org> on 2026/08/10 18:07:29 UTC, 1 replies.
- Re: [PR] [SPARK-56907][SQL] Reduce per-value skip in DELTA_LENGTH_BYTE_ARRAY Parquet vectorized reader [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/08/10 20:00:53 UTC, 7 replies.
- [PR] [SPARK-58021][CONNECT] Add local server pool member claiming [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/08/10 20:19:43 UTC, 5 replies.
- [I] [PIPELINES] Support partition transforms in SDP partition_cols [spark] - posted by "wilhelmagren (via GitHub)" <gi...@apache.org> on 2026/08/10 20:43:46 UTC, 0 replies.
- [PR] [SPARK-58656][PYTHON][TESTS][FOLLOWUP] Add tests for pa.ChunkedArray.to_pandas [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/10 21:26:24 UTC, 3 replies.
- [PR] [PIPELINES] Support partition transforms in Declarative Pipelines partition_cols [spark] - posted by "wilhelmagren (via GitHub)" <gi...@apache.org> on 2026/08/10 22:30:07 UTC, 2 replies.
- [PR] [SPARK-58699][PYTHON] Short-circuit identity conversion for string and binary in LocalDataToArrowConversion [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/10 23:26:04 UTC, 20 replies.
- [PR] [SPARK-58630][PS] Use native Spark function for NumPy copysign [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/11 00:18:12 UTC, 2 replies.
- [PR] [SPARK-58700][ML] Optimize ALSModel transform closure [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/11 00:50:18 UTC, 3 replies.
- Re: [PR] [WIP][INFRA] Run post-merge build every ten commits [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/11 01:25:38 UTC, 0 replies.
- [PR] [SPARK-58701][SQL] Preserve original SQL text in QueryExecution [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2026/08/11 02:50:29 UTC, 0 replies.
- Re: [PR] [SPARK-58684][PYTHON] Make PySpark error sub-conditions inherit the parent condition error state [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/08/11 03:36:15 UTC, 3 replies.
- [PR] [SPARK-41246][CORE] Detect RDD id overflow instead of silently wrapping [spark] - posted by "giriprakash (via GitHub)" <gi...@apache.org> on 2026/08/11 03:38:03 UTC, 0 replies.
- [PR] [SPARK-58704][ML] Optimize LSH transform closure [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/11 03:47:48 UTC, 3 replies.
- [PR] [SPARK-58703][SQL] SQL DAG and Physical Plan Node Mapping Implementation [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2026/08/11 03:49:36 UTC, 0 replies.
- Re: [PR] [SPARK-57523][SQL] Declarative Pipelines should not retry flows that fail due to streaming source changes [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/11 03:50:15 UTC, 3 replies.
- [PR] [SPARK-58705][ML] Optimize AFTSurvivalRegressionModel transform closure [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/11 04:06:26 UTC, 2 replies.
- Re: [I] [SQL] EXTRACT and DATE_PART function for 'SECOND' parameter returns decimal(8,6), otherwise SECOND function returns integer [spark] - posted by "zhangxinyao88 (via GitHub)" <gi...@apache.org> on 2026/08/11 04:06:35 UTC, 0 replies.
- [PR] [SPARK-58706][ML] Use SQL aggregation in OneHotEncoder fitting [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/11 04:22:54 UTC, 2 replies.
- Re: [PR] [SPARK-41246][CORE] Fail-fast RDD id overflow with optional 64-bit continue [spark] - posted by "giriprakash (via GitHub)" <gi...@apache.org> on 2026/08/11 04:28:10 UTC, 1 replies.
- Re: [PR] [SPARK-58619][CORE][CONNECT] Support sub-condition level SQLSTATE in the error condition framework [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/08/11 05:07:41 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-58698][SS] Add additional tests for RTM [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/08/11 06:11:51 UTC, 0 replies.
- [PR] [SPARK-58687][SQL] Support the ANSI SQL/JSON JSON_EXISTS function [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2026/08/11 06:13:42 UTC, 6 replies.
- [PR] [WIP][PYTHON] Sort import for python files [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/08/11 06:18:43 UTC, 0 replies.
- [PR] [SPARK-58708][SQL] Fix out-of-range length handling in substring/lpad/rpad [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/08/11 07:25:52 UTC, 2 replies.
- [PR] [SPARK-58702][CORE] Assign a name to the error condition `_LEGACY_ERROR_TEMP_3033,3035-3037` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/11 07:58:26 UTC, 7 replies.
- [PR] [SPARK-58707][SQL] Do not prune a JSON schema down to the corrupt record column [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/11 08:50:04 UTC, 6 replies.
- Re: [PR] [SPARK-57822][SQL] Support Parquet predicate pushdown for nanosecond-precision timestamps [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/11 10:45:34 UTC, 2 replies.
- [PR] [WIP][SPARK-57403][INFRA] Add a daily build with the JDK codegen backend [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/11 10:58:14 UTC, 0 replies.
- Re: [PR] [SPARK-58555][SQL] Add new tests for JDBC DS Join pushdown [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/11 11:02:07 UTC, 0 replies.
- Re: [PR] [SPARK-56897][SQL] Reduce per-value allocations in DELTA_BYTE_ARRAY Parquet decoder [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/08/11 11:44:21 UTC, 1 replies.
- [PR] [SPARK-43940][SQL] Test the error class: BATCH_METADATA_NOT_FOUND [spark] - posted by "deepujain (via GitHub)" <gi...@apache.org> on 2026/08/11 11:45:00 UTC, 9 replies.
- [PR] [SPARK-58709][CORE][TESTS] Use assert(!x) instead of assert(x === false) in SecurityManagerSuite [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/11 11:56:08 UTC, 5 replies.
- [PR] [SPARK-58710][MLLIB] Remove unused members from the decision tree Node classes [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/11 11:56:12 UTC, 3 replies.
- [PR] [SPARK-58711][SQL] Use StructType.getFieldIndex in Parquet and ORC aggregate push down [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/11 11:56:37 UTC, 3 replies.
- [PR] [SPARK-58712][EXAMPLES] Fix incorrect usage strings in four examples [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/11 11:56:39 UTC, 3 replies.
- [PR] [SPARK-58713][SQL] Fix integer overflow in overlay() position arithmetic [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/08/11 13:07:42 UTC, 1 replies.
- [PR] [SPARK-58715][ML] Use explicit fields for clustering model size estimation [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/11 14:34:57 UTC, 0 replies.
- Re: [PR] [SPARK-41246][CORE] Fail fast on RDD id overflow; parse negative block ids as safety net [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/11 14:55:29 UTC, 3 replies.
- Re: [PR] [SPARK-58716][SQL] Apply default collation to implicit casts [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2026/08/11 15:32:55 UTC, 2 replies.
- Re: [PR] [SPARK-58715][ML][CONNECT] Use explicit fields for clustering model size estimation [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/11 15:41:11 UTC, 2 replies.
- Re: [PR] [SPARK-58698][SS] Add additional tests for RTM [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/11 16:07:32 UTC, 1 replies.
- Re: [PR] [SPARK-58093][SQL] Add ASOF JOIN SQL syntax with MATCH_CONDITION [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/08/11 16:10:24 UTC, 0 replies.
- Re: [PR] [SPARK-58698][SS][TESTS] Add additional tests for RTM [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/11 16:11:37 UTC, 10 replies.
- [PR] [SPARK-44426][SQL] Add support for ExistenceJoin to AQE [spark] - posted by "vanekjar (via GitHub)" <gi...@apache.org> on 2026/08/11 17:59:49 UTC, 1 replies.
- [PR] [CORE][SPARK-49788] Add optional TTL based cleaning for blocks to better support notebooks [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/08/11 18:01:33 UTC, 1 replies.
- [PR] [SPARK-58717][PYTHON] Add Python tests for xxh3_64 and xxh3_128 hash functions [spark] - posted by "pratham76 (via GitHub)" <gi...@apache.org> on 2026/08/11 18:30:53 UTC, 3 replies.
- Re: [PR] [SPARK-57793][CONNECT] Add PathAwareChannelBuilder for SparkConnect python client [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/08/11 19:21:01 UTC, 4 replies.
- [PR] [SPARK-58484][SQL] Fix ArrayIndexOutOfBoundsException in OrderedFilte… [spark] - posted by "AbhinavBattu (via GitHub)" <gi...@apache.org> on 2026/08/11 19:48:21 UTC, 0 replies.
- [PR] [SPARK-58718][PS] Fix signbit for -0.0 and nullable dtypes [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/11 20:52:24 UTC, 3 replies.
- [PR] [SPARK-58719][CORE][K8S] Fix hexadecimal IPv6 RPC address normalization [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/08/11 22:29:58 UTC, 3 replies.
- [PR] [SPARK-58720][PYTHON][TESTS] Add tests for pa.Table.to_pandas [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/11 23:15:10 UTC, 8 replies.
- Re: [PR] [SPARK-58021][CONNECT] Add local server pool filesystem storage [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/08/11 23:17:56 UTC, 5 replies.
- [PR] [DO-NOT-MERGE][SQL][PYTHON] Support Python UDFs in nested higher-order function lambdas and in aggregate [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/12 00:01:45 UTC, 0 replies.
- [PR] [WIP][SS][PYTHON] Stop leaking Python workers and isolation sandboxes on TransformWithState init failure [spark] - posted by "jon-gao-db (via GitHub)" <gi...@apache.org> on 2026/08/12 00:09:21 UTC, 0 replies.
- [PR] [SPARK-57787][CONNECT][PYTHON][FOLLOWUP] Fix syntax error in `local_server.py` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/08/12 00:49:26 UTC, 0 replies.
- [PR] [SPARK-49442][SS][FOLLOWUP] Use monotonic clock for Kafka partition cache TTL [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/12 01:02:11 UTC, 4 replies.
- [PR] [SPARK-58721][K8S] Add tests for ClientArguments.fromCommandLineArgs [spark] - posted by "vrjdev (via GitHub)" <gi...@apache.org> on 2026/08/12 01:27:01 UTC, 5 replies.
- [PR] [WIP] dedup incremental cleanup [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/08/12 01:35:06 UTC, 0 replies.
- Re: [PR] [SPARK-57235][DOCS][SS] Add documentation for stateful queries in RTM [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/08/12 01:37:35 UTC, 2 replies.
- [PR] [SPARK-58389][SQL] Pass options to catalog-backed streaming writes [spark] - posted by "yyanyy (via GitHub)" <gi...@apache.org> on 2026/08/12 01:54:25 UTC, 0 replies.
- [PR] [SPARK-58722][CORE] Bump OIDC credential propagation version annotations from `4.3.0` to `4.4.0` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/08/12 01:58:43 UTC, 5 replies.
- [PR] [SPARK-58725][K8S] Resolve the pod before deciding whether --kill found it [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/12 02:33:54 UTC, 8 replies.
- [PR] [SPARK-58726][INFRA][TEST] Fix npm vulnerabilities in dev and ui-test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/12 03:30:50 UTC, 4 replies.
- [PR] [SPARK-58727][DOC] Update `json` gem version to 2.21.2 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/12 03:30:58 UTC, 4 replies.
- Re: [PR] [SPARK-58728][SQL][PYTHON] Support Python UDFs in nested higher-order function lambdas [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/12 03:34:33 UTC, 3 replies.
- Re: [PR] [SPARK-57787][CONNECT][PYTHON][FOLLOWUP][4.3] Fix syntax error in `local_server.py` [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/08/12 04:01:21 UTC, 2 replies.
- [PR] [WIP][SQL][PYTHON] Support incremental Python aggregators via Arrow [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/12 05:32:29 UTC, 0 replies.
- Re: [PR] [SPARK-58484][SQL] Fix ArrayIndexOutOfBoundsException in OrderedFilters when the required schema is empty [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/12 05:45:57 UTC, 1 replies.
- [PR] [SPARK-58714][SS] Fix AdminClient leak in KafkaTokenUtil.obtainToken [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/12 06:01:36 UTC, 5 replies.
- Re: [PR] [DO-NOT-MERGE][SQL][PYTHON] Support incremental Python aggregators via Arrow [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/12 06:40:46 UTC, 4 replies.
- [PR] [SPARK-58472][CORE][FOLLOWUP] Scope credential providers to manager lifecycle [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/12 07:00:14 UTC, 16 replies.
- [PR] [SPARK-58732][ML] Avoid MLlib vector conversion in Normalizer [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/12 07:05:32 UTC, 3 replies.
- [PR] [SPARK-58089][SQL][FOLLOWUP] Preserve join extraction semantics [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/12 08:19:17 UTC, 21 replies.
- [PR] [SPARK-58723][SQL] Support the ANSI SQL/JSON_QUERY function [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2026/08/12 08:23:54 UTC, 9 replies.
- Re: [PR] [SPARK-58733][PYTHON][ML][TEST] Revert test_cv_io_pipeline.py parallelization [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/12 08:28:11 UTC, 1 replies.
- [PR] [SPARK-58731][SQL] Exempt empty sketches from the hll_union lgConfigK check [spark] - posted by "joelrobin18 (via GitHub)" <gi...@apache.org> on 2026/08/12 08:36:47 UTC, 5 replies.
- Re: [PR] [MINOR][SS] Use filterNot in HDFSBackedStateStoreProvider snapshot filtering [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/12 08:57:38 UTC, 3 replies.
- [PR] [SPARK-58734][INFRA] Skip a declined cherry-pick instead of aborting the merge in merge_spark_pr.py [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/12 10:05:35 UTC, 5 replies.
- Re: [PR] [SPARK-58037] [PYTHON] [TESTS] Add DataFrame API golden file test framework for PySpark [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/12 10:48:30 UTC, 2 replies.
- [PR] [SPARK-58737] Support nanosecond-precision timestamps in ColumnarRow/ColumnarBatchRow copy() and get() [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/12 11:27:09 UTC, 4 replies.
- [PR] [SPARK-58739][SQL][TEST] Test UnsafeRow nested struct/map round-trip for nanos timestamps [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/12 12:28:28 UTC, 3 replies.
- [PR] [SPARK-58738][SQL] Add parse_command function for SQL statement JSON analysis [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/08/12 12:31:14 UTC, 1 replies.
- [PR] [WIP][SPARK-58740][SQL][TESTS] Add to_xml test coverage for nanosecond-precision timestamp types [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/12 12:40:05 UTC, 0 replies.
- [PR] [WIP][SPARK-58741][SQL][TESTS] Add nanosecond-timestamp coverage for collect_list [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/12 12:57:30 UTC, 0 replies.
- [PR] [SPARK-58742][SQL][TESTS] Add nanosecond-timestamp coverage for collect_set [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/12 12:58:56 UTC, 6 replies.
- [PR] [SPARK-58743][SQL][TESTS] Add nanosecond-timestamp coverage for mode [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/12 13:00:40 UTC, 5 replies.
- Re: [PR] [WIP][SPARK-58739][SQL][TEST] Test UnsafeRow nested struct/map round-trip for nanos timestamps [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/12 13:03:00 UTC, 0 replies.
- [PR] [ML] Avoid VectorUDT deserialization in Summarizer [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/12 13:28:44 UTC, 0 replies.
- Re: [PR] [SPARK-58740][SQL][TESTS] Add to_xml test coverage for nanosecond-precision timestamp types [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/12 13:45:50 UTC, 4 replies.
- Re: [PR] [SPARK-58741][SQL][TESTS] Add nanosecond-timestamp coverage for collect_list [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/12 13:46:07 UTC, 5 replies.
- [PR] [SPARK-58744][CORE] Assign a name to the error condition `_LEGACY_ERROR_TEMP_3008-3010` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/12 13:52:55 UTC, 4 replies.
- [PR] [WIP][SPARK-20711][ML] Fix min and max for all-NaN dimensions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/12 13:53:06 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-20711][ML] Use infinities as min and max initial values [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/12 14:05:43 UTC, 0 replies.
- [PR] [MINOR][DOCS][SQL] Mention sbin/stop-thriftserver.sh in Thrift server docs [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/08/12 14:55:38 UTC, 3 replies.
- Re: [PR] [SPARK-58736][SQL][PYTHON][CONNECT] Support incremental Python aggregators via Arrow [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/12 15:42:39 UTC, 11 replies.
- [PR] [SPARK-58745][DOCS] Document missing JSON and XML data source options [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/12 16:31:05 UTC, 3 replies.
- [PR] [SPARK-58746][INFRA] Remove a dead lsof workaround and fix stale references in release tooling [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/12 16:31:08 UTC, 3 replies.
- [PR] [SPARK-58747][PYTHON] Trim unnecessary commands from MANIFEST.in [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/08/12 16:49:43 UTC, 1 replies.
- Re: [PR] [MINOR][DOCS][SQL] Fix minor gaps and problems in Thrift server docs [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/12 17:13:18 UTC, 3 replies.
- Re: [PR] [SPARK-58167][SPARK-57393][3.5] Build: PySpark and SparkR source distributions are missing LICENSE and NOTICE files [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/08/12 18:45:58 UTC, 2 replies.
- Re: [PR] [SPARK-46161][PS] Add axis=1 support for DataFrame.diff [spark] - posted by "asf-gitbox-commits (via GitHub)" <gi...@apache.org> on 2026/08/12 18:50:21 UTC, 3 replies.
- [PR] [SPARK-58428][SQL] Fix optimizer hang in DSv2 expression pushdown [spark] - posted by "AbhinavBattu (via GitHub)" <gi...@apache.org> on 2026/08/12 18:56:42 UTC, 6 replies.
- [PR] Spark 58627 mark raise error throwable [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/08/12 19:09:09 UTC, 0 replies.
- [PR] [SPARK-58750][CORE] Tolerate FileAlreadyExistsException from checkpoint part file rename [spark] - posted by "james-willis (via GitHub)" <gi...@apache.org> on 2026/08/12 19:59:41 UTC, 9 replies.
- [PR] [DO NOT MERGE] Import Spark Connect Gateway reference implementation [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/08/12 22:03:32 UTC, 2 replies.
- [PR] [SPARK-58748][CORE][K8S] Preserve advertised driver host for wildcard bind addresses [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/08/12 22:31:45 UTC, 5 replies.
- [PR] [SPARK-58553][PS][FOLLOWUP] Match fmax/fmin signed-zero tie-break to installed NumPy [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/12 22:33:37 UTC, 3 replies.
- Re: [PR] [SPARK-58672][SQL] Reject CHAR/VARCHAR map keys in variant conversions [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/08/12 22:40:44 UTC, 2 replies.
- [PR] [WIP][SPARK-57228][SS] Support transformWithState in Real-Time Mode [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/08/12 22:49:16 UTC, 0 replies.
- Re: [PR] [SPARK-58751][SS][PYTHON] Stop leaking Python workers on TransformWithState init failure [spark] - posted by "jiateoh (via GitHub)" <gi...@apache.org> on 2026/08/12 22:50:41 UTC, 4 replies.
- Re: [PR] [SPARK-58209][SQL] Mark stateful expressions to prevent data races [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/08/12 22:58:32 UTC, 2 replies.
- [PR] [SPARK-58753] Add Cargo workspace skeleton, vendored protos, and genproto crate [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/08/13 00:02:40 UTC, 2 replies.
- [PR] [SPARK-58208][SQL] Deep-copy stateful expressions before optimization [spark] - posted by "marcuslin123 (via GitHub)" <gi...@apache.org> on 2026/08/13 03:13:09 UTC, 7 replies.
- Re: [PR] [SPARK-55077][CORE][K8S] Support `spark.kubernetes.archives.avoidDownloadSchemes` for K8s Cluster Mode [spark] - posted by "xumanbu (via GitHub)" <gi...@apache.org> on 2026/08/13 03:17:21 UTC, 0 replies.
- [PR] [SPARK-58754][INFRA] Update JIRA fix versions for separately backported pull requests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/13 03:54:24 UTC, 1 replies.
- [PR] [SPARK-58755][BUILD] Upgrade 6 third-party dependencies to fix 29 sec… [spark] - posted by "anoopamS (via GitHub)" <gi...@apache.org> on 2026/08/13 05:07:57 UTC, 5 replies.
- [PR] [MINOR][INFRA] Skip JIRA prompt when merging MINOR PRs [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/13 05:43:21 UTC, 3 replies.
- Re: [PR] [SPARK-56532][CORE] Add `closeQuietly(AutoCloseable)` overload to `SparkErrorUtils` [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/13 05:50:20 UTC, 2 replies.
- Re: [PR] [SPARK-58724][SS] Incremental state cleanup for streaming dropDuplicates [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/08/13 06:19:54 UTC, 10 replies.
- Re: [PR] [SPARK-58619][CONNECT] Split the INVALID_HANDLE session sub-conditions into a new SESSION_UNAVAILABLE error condition with SQLSTATE 08003 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/13 06:29:21 UTC, 6 replies.
- Re: [PR] [SPARK-58134][BUILD] Upgrade janino to 3.1.12 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/13 06:39:57 UTC, 4 replies.
- Re: [PR] [SPARK-57411][INFRA] Add a daily build with the JDK codegen backend [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/13 06:52:31 UTC, 8 replies.
- Re: [PR] [SPARK-XXXXX][CORE] Add IO_URING transport mode [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/13 07:03:02 UTC, 0 replies.
- [PR] [MINOR][INFRA] Add spacing before JIRA update prompt [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/13 07:42:10 UTC, 2 replies.
- Re: [PR] [SPARK-57228][SS] Support transformWithState in Real-Time Mode [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/08/13 07:50:59 UTC, 4 replies.
- [PR] [SPARK-58756][BUILD][CORE][4.3] Revert OIDC credential propagation from `branch-4.3` (moved to `4.4.0`) [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/08/13 08:22:41 UTC, 4 replies.
- Re: [PR] [SPARK-58349][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1081 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/13 08:52:50 UTC, 1 replies.
- [PR] [SPARK-58757][SQL] Allow CollapseWindow to merge windows with an empty order spec [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/08/13 08:58:10 UTC, 14 replies.
- Re: [PR] [MINOR][DOCS] Fix typo 'commited' in state data source docs [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/13 08:59:26 UTC, 1 replies.
- Re: [PR] [MINOR][ML] Fix doubled word in HasTrainingSummary scaladoc [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/13 09:00:07 UTC, 1 replies.
- Re: [PR] [MINOR][DOCS] Fix grammar in spark.speculation.efficiency.processRateMultiplier doc [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/13 09:00:43 UTC, 1 replies.
- Re: [PR] [SPARK-58351][CORE] Assign a name to the error condition _LEGACY_ERROR_TEMP_3014 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/13 09:00:44 UTC, 1 replies.
- Re: [PR] [MINOR][SQL] Simplify redundant boolean ternary in visitDeclareCursorStatement [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/13 09:01:14 UTC, 1 replies.
- Re: [PR] [MINOR][INFRA] Fix doubled braces in structured logging style-check hint [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/13 09:01:44 UTC, 1 replies.
- Re: [PR] [MINOR][BUILD] Fix duplicated word in spark-profiler POM description [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/13 09:02:22 UTC, 1 replies.
- Re: [PR] [MINOR][PYTHON][DOCS] Fix session window example usage [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/13 09:04:06 UTC, 1 replies.
- [PR] [SPARK-58758][DOCS] Remove the stale Highlights in 3.0 section from the ML guide [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/13 09:06:18 UTC, 2 replies.
- [PR] [SPARK-58759][BUILD] Fix grammar in build file comments [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/13 09:06:22 UTC, 2 replies.
- Re: [PR] [SPARK-58184][CORE] Remove dead ExternalBlockStore executor exit codes [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/13 09:06:28 UTC, 1 replies.
- [PR] [SPARK-58760][SQL] Use consistent colName interpolation in CatalogColumnStat [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/13 09:15:09 UTC, 2 replies.
- Re: [PR] [SPARK-58352][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_2070 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/13 09:15:37 UTC, 1 replies.
- [PR] [WIP][SQL][PYTHON] Observe-backed accumulator (SparkSession.accumulator) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/13 09:35:07 UTC, 0 replies.
- Re: [PR] [SPARK-58446][CORE] Prevent late task events from corrupting pending task state [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/08/13 11:18:44 UTC, 5 replies.
- Re: [PR] [SPARK-58738][SQL] Add parse_sql function for SQL statement JSON analysis [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/08/13 12:01:22 UTC, 17 replies.
- [PR] [WIP][SPARK-58761][SQL][TESTS] Add DESCRIBE / SHOW CREATE TABLE tests for nanosecond-timestamp columns [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/13 13:31:18 UTC, 0 replies.
- [PR] [WIP][SPARK-56822][SQL][TEST] Add dedicated e2e test coverage for GROUP BY over nanosecond-precision timestamp keys [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/13 13:51:47 UTC, 0 replies.
- [PR] [SPARK-58761][SQL][TEST] Add dedicated e2e test coverage for DISTINCT over nanosecond-precision timestamp columns [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/13 13:53:51 UTC, 4 replies.
- [PR] [SPARK-51830][SQL] Fix partition type mismatch when validatePartitionColumns is disabled [spark] - posted by "pratham76 (via GitHub)" <gi...@apache.org> on 2026/08/13 16:16:44 UTC, 6 replies.
- Re: [PR] [SPARK-58761][SQL][TESTS] Add DESCRIBE / SHOW CREATE TABLE tests for nanosecond-timestamp columns [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/13 16:45:36 UTC, 2 replies.
- Re: [PR] [SPARK-58761][SQL][TEST] Add dedicated e2e test coverage for GROUP BY over nanosecond-precision timestamp keys [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/13 16:45:41 UTC, 3 replies.
- [PR] Bump org.apache.logging.log4j:log4j-api from 2.26.0 to 2.26.1 [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/08/13 18:30:19 UTC, 2 replies.
- Re: [PR] [SPARK-58747][PYTHON] Move include commands from MANIFEST.in into setup.py files [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/08/13 20:45:50 UTC, 6 replies.
- [PR] [SPARK-58765][PYTHON][TEST] Add tests for pa.Array.from_pandas with the type and safe arguments [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/13 22:55:19 UTC, 4 replies.
- [PR] [SPARK-XXXX][UI] Fix filter and min,med,max table interaction [spark] - posted by "wjgan7 (via GitHub)" <gi...@apache.org> on 2026/08/13 23:03:14 UTC, 0 replies.
- [PR] [SPARK-57899][CORE] Add SparkOidcAwsCredentialsProvider for executor-side S3A access [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/08/13 23:13:28 UTC, 8 replies.
- [PR] [SPARK-58720][PYTHON][TESTS][FOLLOWUP] Move the pandas DataFrame golden repr into GoldenFileTestMixin [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/13 23:47:31 UTC, 4 replies.
- [PR] [SPARK-58766][PYTHON][TESTS] Represent out-of-range temporal PyArrow scalars in golden files [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/14 00:27:59 UTC, 9 replies.
- Re: [I] Support Filter pushdown in Spark Structured Streaming [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/14 00:31:09 UTC, 0 replies.
- Re: [PR] [SPARK-58389][SQL] Pass table-state options while loading write targets [spark] - posted by "yyanyy (via GitHub)" <gi...@apache.org> on 2026/08/14 02:10:31 UTC, 7 replies.
- Re: [PR] [POC][SQL][PYTHON] Observe-backed accumulator (SparkSession.accumulator) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/14 02:36:13 UTC, 5 replies.
- [PR] [SPARK-58768][PYTHON][TESTS] Fix monkey-patch in test_parity_udf and test_parity_udtf [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/08/14 02:36:34 UTC, 3 replies.
- [PR] [SPARK-58769][SQL] Compare TransformExpression by the function's canonical name rather than its instance [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/08/14 03:11:24 UTC, 0 replies.
- [PR] [WIP][SQL] [SPARK-58767][SQL]. Fixing the canonicalization of TableCacheQueryStageExec,… [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2026/08/14 03:57:26 UTC, 0 replies.
- [PR] [SPARK-58770][CORE] Assign a name to the error condition `_LEGACY_ERROR_TEMP_3016-3020` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/14 04:43:04 UTC, 8 replies.
- [PR] [SPARK-58730][SQL] Support the ANSI SQL/JSON JSON_ARRAY constructor function [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2026/08/14 04:43:26 UTC, 23 replies.
- [PR] [SPARK-58771][INFRA] Clean up the dependency list for classic-only docker image [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/08/14 05:20:41 UTC, 5 replies.
- [PR] [SPARK-58772]Make SelectedField pass column metadata [spark] - posted by "zsxwing (via GitHub)" <gi...@apache.org> on 2026/08/14 05:45:51 UTC, 1 replies.
- [PR] [SPARK-58773] Add scg-routing crate [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/08/14 06:28:19 UTC, 2 replies.
- [PR] [SPARK-33235][FOLLOWUP] Make stale push-based shuffle fallback chunk-granular and opt-in [spark] - posted by "gaoyajun02 (via GitHub)" <gi...@apache.org> on 2026/08/14 10:03:56 UTC, 0 replies.
- Re: [PR] [SPARK-57491][FOLLOWUP] Make stale push-based shuffle fallback chunk-granular and opt-in [spark] - posted by "gaoyajun02 (via GitHub)" <gi...@apache.org> on 2026/08/14 10:11:20 UTC, 5 replies.
- Re: [PR] [SPARK-58619][CORE][CONNECT] Assign SQLSTATE 08003 to the INVALID_HANDLE session sub-conditions [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/08/14 13:11:54 UTC, 6 replies.
- [PR] [MINOR][SQL][DOCS] Mention bin/spark-connect-shell in docs [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/08/14 15:51:11 UTC, 3 replies.
- [PR] [SPARK-58776][K8S] Propagate spark.ssl.rpc.* passwords to executors [spark] - posted by "sweb (via GitHub)" <gi...@apache.org> on 2026/08/14 18:16:45 UTC, 3 replies.
- [PR] [SPARK-58778][DOCS] Document authority-based routing for Spark Connect behind a shared ingress [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/08/14 18:17:37 UTC, 5 replies.
- [PR] [SPARK-58779][SQL] Make InlineCTE tolerate a CTE reference without its definition during analysis [spark] - posted by "AveryQi115 (via GitHub)" <gi...@apache.org> on 2026/08/14 19:42:03 UTC, 5 replies.
- [PR] [SPARK-58783][SQL][4.1] Fix SPJ with runtime filtering when join keys are a subset of partition keys [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/08/14 21:35:24 UTC, 6 replies.
- [PR] [SPARK-58777][SQL] Guard shuffle row-based checksum against invalid UnsafeRow memory [spark] - posted by "markj-db (via GitHub)" <gi...@apache.org> on 2026/08/14 22:49:40 UTC, 2 replies.
- [PR] [SPARK-58784][PYTHON] Merge the batched-UDF mapper into an explicit SQL_BATCHED_UDF branch in read_udfs [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/14 23:14:13 UTC, 3 replies.
- [PR] [SPARK-58785][CORE] Add tests for FilteredObjectInputStream resolveClass allow-list [spark] - posted by "vrjdev (via GitHub)" <gi...@apache.org> on 2026/08/14 23:33:17 UTC, 0 replies.
- Re: [PR] [SPARK-56734][CORE] Optimize RocksDBPersistenceEngine with Column Families and zero-allocation prefix matching [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/15 00:17:37 UTC, 1 replies.
- [PR] [SPARK-58686][SQL] Add the TRIM_ARRAY array function [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/08/15 02:30:27 UTC, 0 replies.
- Re: [PR] [SPARK-57926][SQL] Add IPv4 address functions: inet_aton, inet_ntoa, try_inet_aton [spark] - posted by "jiangxt2 (via GitHub)" <gi...@apache.org> on 2026/08/15 03:20:18 UTC, 0 replies.
- Re: [PR] [SPARK-57924][SQL] Add bitmap_xor_agg aggregation function [spark] - posted by "jiangxt2 (via GitHub)" <gi...@apache.org> on 2026/08/15 03:20:21 UTC, 6 replies.
- Re: [PR] [SPARK-58213][SQL] corr should return NULL when a column has zero variance [spark] - posted by "jiangxt2 (via GitHub)" <gi...@apache.org> on 2026/08/15 03:20:23 UTC, 4 replies.
- Re: [PR] [SPARK-58186][SQL] Add bitmap_contains function [spark] - posted by "jiangxt2 (via GitHub)" <gi...@apache.org> on 2026/08/15 03:20:25 UTC, 5 replies.
- Re: [PR] [SPARK-58217][SQL] CAST(DECIMAL AS TIMESTAMP) silently produces garbage timestamps on overflow [spark] - posted by "jiangxt2 (via GitHub)" <gi...@apache.org> on 2026/08/15 03:20:27 UTC, 0 replies.
- Re: [PR] [SPARK-58235][SQL] Fix Double/Float to Timestamp silent overflow clamping in non-ANSI mode [spark] - posted by "jiangxt2 (via GitHub)" <gi...@apache.org> on 2026/08/15 03:20:30 UTC, 2 replies.
- [PR] [SPARK-58789][CORE] Add CredentialProvider.additionalSparkProperties() SPI and auto-config wiring [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/08/15 07:52:41 UTC, 6 replies.
- [PR] [SPARK-58553][PS][FOLLOWUP] Gate native fmax/fmin/reciprocal to verified platform, else pandas_udf [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/15 09:42:59 UTC, 4 replies.
- [PR] [MINOR][DOC] Fix broken submitting-applications link in Kafka guide [spark] - posted by "daviddallakyan2005 (via GitHub)" <gi...@apache.org> on 2026/08/15 09:43:10 UTC, 3 replies.
- Re: [PR] [SPARK-58788][SQL] Add the TRIM_ARRAY array function [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/15 10:21:08 UTC, 4 replies.
- [PR] [SPARK-58790][PS] Use native Spark function for NumPy modf [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/15 10:50:22 UTC, 9 replies.
- Re: [PR] Build: Test Apache Parquet 1.18.0 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/15 12:19:57 UTC, 0 replies.
- [PR] [SPARK-58619][FOLLOWUP][CONNECT] Map JDBC connection errors by SQLSTATE class 08 instead of hard-coded condition names [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/08/15 13:53:32 UTC, 8 replies.
- [PR] [SPARK-58782][SQL] Fix DSv2 pushdown null literal serialization bug [spark] - posted by "pratham76 (via GitHub)" <gi...@apache.org> on 2026/08/15 17:18:26 UTC, 9 replies.
- Re: [PR] [SPARK-58126][CORE] Support a pluggable root pool comparator via configuration [spark] - posted by "ChrisMuki (via GitHub)" <gi...@apache.org> on 2026/08/15 20:08:35 UTC, 1 replies.
- Re: [I] Error: Illegal Parquet type: FIXED_LEN_BYTE_ARRAY (UUID) [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/16 00:18:39 UTC, 0 replies.
- Re: [PR] Predicate Pushdown in Spark Structured Streaming (DataSource V2). [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/16 00:18:41 UTC, 1 replies.
- Re: [PR] [SPARK-56705][PYSPARK][SS] Introduce a JVM-bridged MemoryStream wrapper for PySpark tests (Part 1 of 4) [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/16 00:18:45 UTC, 1 replies.
- Re: [PR] [SPARK-55872][UI] Highlight long-running SQL queries by duration [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/16 00:18:50 UTC, 1 replies.
- Re: [PR] [SPARK-XXXXX][SQL] Public Column.toJson / Column.fromJson on the V2 catalog interface [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/16 00:18:54 UTC, 1 replies.
- [PR] [SPARK-58793][SQL] Support ANSI SQL `IS [NOT] JSON` predicate [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/08/16 03:34:48 UTC, 1 replies.
- [PR] [SPARK-58792][SQL] Isolate Hive GenericUDF evaluator instances [spark] - posted by "marcuslin123 (via GitHub)" <gi...@apache.org> on 2026/08/16 06:04:47 UTC, 0 replies.
- [PR] [SPARK-58792][SQL] Clone Hive GenericUDF per copy [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/08/16 06:08:42 UTC, 4 replies.
- [PR] [SPARK-58217][SQL] Fix silent garbage timestamps on decimal-to-timestamp overflow [spark] - posted by "jiangxt2 (via GitHub)" <gi...@apache.org> on 2026/08/16 07:22:39 UTC, 14 replies.
- Re: [PR] [SPARK-58769][SQL] Document the BoundFunction equality contract and drop the name-based transform comparison [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/16 09:28:33 UTC, 11 replies.
- Re: [PR] [SPARK-58627][SQL] Mark raise error Throwable & fix sequence throwable [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/16 09:41:06 UTC, 2 replies.
- Re: [PR] [SPARK-58785][CORE][TESTS] Add tests for FilteredObjectInputStream resolveClass allow-list [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/16 09:46:09 UTC, 1 replies.
- [PR] [SPARK-38794][K8S] Create executor ConfigMap before requesting executors [spark] - posted by "HwangDongJun (via GitHub)" <gi...@apache.org> on 2026/08/16 12:06:07 UTC, 8 replies.
- Re: [PR] [SPARK-57109][SQL] Fix exchange reuse failure when a VIEW is referenced in both UNION ALL branches via a CTE [spark] - posted by "kush2439p (via GitHub)" <gi...@apache.org> on 2026/08/16 14:17:44 UTC, 0 replies.
- [PR] [MINOR][PYTHON] Collapse check-then-create pattern using `os.makedirs(..., exist_ok=True)` [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/08/16 15:35:16 UTC, 0 replies.
- [PR] [SPARK-58794][SQL] Add standardSemantics foundation for CHAR/VARCHAR [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/08/16 18:26:44 UTC, 11 replies.
- Re: [PR] Add test coverage for DSv2 table refresh and pinning [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/17 00:17:33 UTC, 1 replies.
- [PR] [SPARK-58729][SQL] Support the ANSI SQL/JSON JSON_OBJECT constructor function [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2026/08/17 02:20:59 UTC, 1 replies.
- [PR] [SPARK-58817][DOCS] Eliminate absolute line references for `literalinclude` [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/08/17 02:44:25 UTC, 4 replies.
- Re: [PR] [MINOR][PYTHON] Collapse check-then-create-dir pattern into single call [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/08/17 02:54:10 UTC, 2 replies.
- [PR] [SPARK-57926][SQL] Add IPv4 conversion functions [spark] - posted by "jiangxt2 (via GitHub)" <gi...@apache.org> on 2026/08/17 03:37:01 UTC, 1 replies.
- [PR] [SPARK-34254][SQL][DOCS] Document CREATE EXTERNAL TABLE for data source tables [spark] - posted by "Vamsi-klu (via GitHub)" <gi...@apache.org> on 2026/08/17 04:05:20 UTC, 6 replies.
- [PR] [SPARK-47397][SQL][DOCS] Document that COUNT(DISTINCT) skips nulls [spark] - posted by "Vamsi-klu (via GitHub)" <gi...@apache.org> on 2026/08/17 04:05:22 UTC, 7 replies.
- [PR] [SPARK-57696][PYTHON] Preserve TIME precision in the PySpark Arrow/pandas type mapping [spark] - posted by "Vamsi-klu (via GitHub)" <gi...@apache.org> on 2026/08/17 04:05:25 UTC, 5 replies.
- Re: [PR] [SPARK-58772][SQL] Make SelectedField pass column metadata [spark] - posted by "zsxwing (via GitHub)" <gi...@apache.org> on 2026/08/17 04:22:41 UTC, 1 replies.
- [PR] [SPARK-58000][CONNECT][TESTS] Increase listener events termination timeout [spark] - posted by "kckoh (via GitHub)" <gi...@apache.org> on 2026/08/17 04:54:21 UTC, 1 replies.
- [PR] [SPARK-57898][CORE][TESTS][FOLLOWUP] Clean up AwsStsCredentialProvider tests [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/08/17 05:03:46 UTC, 7 replies.
- [PR] [SPARK-58000][CONNECT][TESTS] Increase listener events termination ti… [spark] - posted by "kckoh (via GitHub)" <gi...@apache.org> on 2026/08/17 05:05:22 UTC, 4 replies.
- Re: [PR] [WIP][SPARK-49634][SQL] Remove the ANSI config suggestion in NUMERIC_VALUE_OUT_OF_RANGE.WITH_SUGGESTION [spark] - posted by "rpnkv (via GitHub)" <gi...@apache.org> on 2026/08/17 05:24:10 UTC, 0 replies.
- [PR] [SPARK-58774][SS] Support topic-level earliest/latest values in the Kafka source startingOffsets/endingOffsets JSON [spark] - posted by "Kino1994 (via GitHub)" <gi...@apache.org> on 2026/08/17 07:13:37 UTC, 7 replies.
- [PR] [SPARK-58819][SQL] UnionExec outputPartitioning should ignore partition key nullability [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/08/17 09:01:59 UTC, 6 replies.
- [PR] [SPARK-58818][SQL] Pre-evaluate a nondeterministic common expression in a conditional branch [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/17 09:15:59 UTC, 7 replies.
- [PR] [SPARK-58383][SQL] Bind the right filter by expression id in ReplaceExceptWithFilter [spark] - posted by "Vivek1106-04 (via GitHub)" <gi...@apache.org> on 2026/08/17 09:58:45 UTC, 1 replies.
- [PR] [SPARK-58821][SQL] Return the recomputed length instead of an internal error in Sequence [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/08/17 10:10:33 UTC, 1 replies.
- [PR] [SPARK-58822][SQL][TESTS] Extract a nonEmptyLines helper in LogicalPlanDifferenceSuite [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/17 10:32:09 UTC, 3 replies.
- [PR] [SPARK-56822][SQL][TESTS] Add nanos-timestamp tests for scalar subquery / EXISTS / NOT IN (SELECT) [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/17 12:08:33 UTC, 3 replies.
- Re: [PR] [SPARK-58775][UI] Fix SQL metrics filter and min,med,max table interaction [spark] - posted by "wjgan7 (via GitHub)" <gi...@apache.org> on 2026/08/17 16:39:42 UTC, 0 replies.
- [PR] [SPARK-55817][SQL] Enable Parquet row-group skipping for shredded Variant columns [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/08/17 17:32:29 UTC, 26 replies.
- [PR] [SPARK-57897][BUILD][FOLLOWUP] Add `credential-aws` profile to `assembly/pom.xml` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/08/17 18:05:11 UTC, 4 replies.
- [PR] [MINOR][SQL] Hoist repeated session.implicits imports in AutoCDC tests [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/08/17 21:22:04 UTC, 0 replies.
- Re: [PR] [SPARK-58826][SQL] Hoist repeated session.implicits imports in AutoCDC tests [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/08/17 21:31:47 UTC, 5 replies.
- [PR] [SPARK-58827][DOCS] Document SPARK_LOCAL_IP for local RemoteClassLoaderError test failures [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/08/17 21:37:45 UTC, 5 replies.
- [PR] [SPARK-58828][CORE] Support holding and resuming an application via graceful executor decommission [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/17 22:05:14 UTC, 53 replies.
- [PR] Spark 58572 cross scd fuzz testing [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/08/17 22:54:18 UTC, 0 replies.
- Re: [PR] [SPARK-58389][SQL][FOLLOWUP] Pass table-state options while loading write targets [spark] - posted by "yyanyy (via GitHub)" <gi...@apache.org> on 2026/08/17 23:00:23 UTC, 14 replies.
- Re: [PR] [SPARK-55452][ML][CONNECT] Fix MLWriter.overwrite for Spark Connect [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/18 00:17:05 UTC, 1 replies.
- [PR] [SPARK-58829][PYTHON][TESTS] Add tests for pa.Table.cast [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/18 00:20:30 UTC, 4 replies.
- [PR] [SPARK-58802][SQL] Dual-run coverage for CHAR/VARCHAR standardSemantics [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/08/18 00:23:43 UTC, 2 replies.
- [PR] [SPARK-51356][SQL] Emit IsNotNull on a complex child before the FilterExec predicate that uses it [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/08/18 00:42:43 UTC, 3 replies.
- [PR] [SPARK-58803][SQL] Dataset/encoder/UDF CHAR/VARCHAR under standardSemantics [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/08/18 01:50:28 UTC, 2 replies.
- [PR] [SPARK-58832] Cleanup the dependency list for minimum docker image [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/08/18 03:23:56 UTC, 2 replies.
- [PR] [SPARK-58833][INFRA] Make the build, pyspark and docker job timeouts callable inputs [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/18 03:24:56 UTC, 5 replies.
- [PR] [SPARK-58830][CORE] Add MapStatus checksum to detect metadata corruption between mapper and reducer [spark] - posted by "wang-haihua (via GitHub)" <gi...@apache.org> on 2026/08/18 03:37:17 UTC, 0 replies.
- [PR] [SPARK-58834][INFRA] Bump docker CI actions to latest ASF-allowlisted versions [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/08/18 03:41:47 UTC, 4 replies.
- [PR] [SPARK-28173][SS] Support obtaining Kafka delegation token for proxy user [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/18 03:48:08 UTC, 8 replies.
- [PR] [SPARK-58385][SQL] Do not strip a GlobalLimit whose cap is not statically known in LimitPushDown [spark] - posted by "Vivek1106-04 (via GitHub)" <gi...@apache.org> on 2026/08/18 03:51:52 UTC, 2 replies.
- [PR] [SPARK-58831][SQL] Add bitmap scalar set operation functions [spark] - posted by "jiangxt2 (via GitHub)" <gi...@apache.org> on 2026/08/18 03:53:31 UTC, 8 replies.
- [PR] [SPARK-58835] Enable `spark.shuffle.service.enabled` by default in `SparkCluster` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/18 05:03:39 UTC, 3 replies.
- [PR] [SPARK-58836][WEBUI] Respect UI root when loading thread dump flame graph resources [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2026/08/18 06:32:23 UTC, 2 replies.
- Re: [PR] [SPARK-58572][SDP] AutoCDC Cross SCD Convergence Suite [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/18 06:56:33 UTC, 16 replies.
- [PR] [SPARK-58834][4.2][FOLLOWUP][INFRA] Bump remaining docker build-push-action pins to allowlisted version [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/08/18 07:13:28 UTC, 3 replies.
- [PR] [SPARK-58834][4.1][FOLLOWUP][INFRA] Bump docker CI actions to latest ASF-allowlisted versions [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/08/18 07:13:44 UTC, 1 replies.
- [PR] [SPARK-58834][4.0][FOLLOWUP][INFRA] Bump docker CI actions to latest ASF-allowlisted versions [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/08/18 07:14:03 UTC, 1 replies.
- [PR] [SPARK-58834][3.5][FOLLOWUP][INFRA] Bump docker CI actions to latest ASF-allowlisted versions [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/08/18 07:14:18 UTC, 1 replies.
- [PR] [SPARK-58771][INFRA][FOLLOWUP] Add build-context for classic-only image [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/08/18 07:52:39 UTC, 2 replies.
- [PR] [SPARK-58838][PYTHON][TESTS] Add tests for pa.RecordBatch.from_pandas [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/18 08:21:22 UTC, 7 replies.
- Re: [PR] [SPARK-57467][SCHEDULER] Reuse identical resource profiles when available [spark] - posted by "psavalle (via GitHub)" <gi...@apache.org> on 2026/08/18 08:39:32 UTC, 10 replies.
- [PR] [SPARK-58839] Update `README.md` with YuniKorn 1.9.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/18 08:47:09 UTC, 3 replies.
- [PR] [SPARK-58840] Update `word-count-celeborn` example to use Celeborn 0.7.0 and Spark 4.2.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/18 08:52:59 UTC, 3 replies.
- [PR] [SPARK-58841][K8S][DOCS] Update `YuniKorn` docs with `1.9.0` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/18 09:04:31 UTC, 4 replies.
- [PR] [SPARK-58842][ML] Add descriptive messages to bare require checks in ALS [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/18 09:47:02 UTC, 3 replies.
- [PR] [SPARK-58843][DOCS] Fix grammar errors in the SQL tuning, GraphX and MLlib clustering guides [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/18 09:47:12 UTC, 3 replies.
- Re: [PR] [SPARK-58823][SQL][TESTS] Add nanos-timestamp tests for scalar subquery / EXISTS / NOT IN (SELECT) [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/18 09:52:37 UTC, 1 replies.
- [PR] [SPARK-58481][SQL] Fix InSubqueryExec.nullable to account for subquery output nullability [spark] - posted by "anshulbaliga7 (via GitHub)" <gi...@apache.org> on 2026/08/18 10:04:03 UTC, 25 replies.
- [PR] SPARK-25078 Standalone does not work with spark.authenticate.secret a… [spark] - posted by "shubhluck (via GitHub)" <gi...@apache.org> on 2026/08/18 11:45:19 UTC, 1 replies.
- Re: [PR] [SPARK-58282][PYTHON][DOCS] Refresh PySpark README and clarify project scope [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/08/18 13:34:20 UTC, 2 replies.
- [PR] [MINOR][TESTS] Fix a Cancel-after-Finish flake in the UDF worker prot… [spark] - posted by "mohamed-gallab-db (via GitHub)" <gi...@apache.org> on 2026/08/18 13:42:44 UTC, 0 replies.
- [PR] [SPARK-58794][SQL] Fix collated CHAR LCT and cover compare/IN/set-ops [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/08/18 13:44:13 UTC, 11 replies.
- Re: [PR] [SPARK-58834][4.1][INFRA] Bump docker CI actions to latest ASF-allowlisted versions [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/18 14:10:08 UTC, 3 replies.
- Re: [PR] [SPARK-58834][4.0][INFRA] Bump docker CI actions to latest ASF-allowlisted versions [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/18 14:11:10 UTC, 3 replies.
- Re: [PR] [SPARK-58834][3.5][INFRA] Bump docker CI actions to latest ASF-allowlisted versions [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/08/18 14:29:32 UTC, 4 replies.
- [PR] [SPARK-58673][BUILD] Upgrade Avro to 1.12.2 [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/08/18 14:41:38 UTC, 0 replies.
- Re: [PR] [SPARK-58844] Fix a Cancel-after-Finish flake in the UDF worker protocol test client [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2026/08/18 15:04:22 UTC, 3 replies.
- [PR] [SPARK-58825][SQL] Support TimestampNTZType as a JDBC partition column [spark] - posted by "aleksandar-trajkovic-db (via GitHub)" <gi...@apache.org> on 2026/08/18 15:45:48 UTC, 4 replies.
- [PR] [WIP] Collation-aware hash aggregation [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2026/08/18 16:04:48 UTC, 0 replies.
- [PR] [SPARK-58816][SQL] Fix nested struct resolution in arrays and maps f… [spark] - posted by "AnhTtis (via GitHub)" <gi...@apache.org> on 2026/08/18 16:30:09 UTC, 9 replies.
- [PR] [SPARK-58846][CONNECT][PYTHON] Add a client-side deadline to the RemoveRemoteCachedRelation release RPC [spark] - posted by "kishor-rkrishnan (via GitHub)" <gi...@apache.org> on 2026/08/18 17:45:30 UTC, 4 replies.
- [PR] [SPARK-58816][SQL] Fix INSERT with column list to resolve structs inside arrays and maps positionally [spark] - posted by "anshulbaliga7 (via GitHub)" <gi...@apache.org> on 2026/08/18 18:04:23 UTC, 7 replies.
- [PR] [SPARK-58794][SQL] Preserve CHAR/VARCHAR on language surfaces under standardSemantics [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/08/18 18:58:15 UTC, 1 replies.
- [PR] [SPARK-58021][CONNECT][FOLLOWUP] Strip launcher-owned binding address from seed configuration [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/18 19:16:49 UTC, 5 replies.
- Re: [PR] [SPARK-57783][DOCS][R] Document the TIME data type as unsupported in SparkR [spark] - posted by "ApurvaKusum (via GitHub)" <gi...@apache.org> on 2026/08/18 19:42:24 UTC, 0 replies.
- Re: [PR] [SPARK-57849][SQL] Support the TIME data type in DataFrame approxQuantile, summary and describe [spark] - posted by "iRakson (via GitHub)" <gi...@apache.org> on 2026/08/18 20:14:37 UTC, 4 replies.
- Re: [PR] [SPARK-57818][SQL]Support nanosecond-precision and LTZ timestamps in convert_timezone [spark] - posted by "iRakson (via GitHub)" <gi...@apache.org> on 2026/08/18 20:32:49 UTC, 1 replies.
- Re: [PR] [SPARK-58202][K8S] Skip driver containerPort declaration when the por… [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/08/18 20:35:51 UTC, 1 replies.
- Re: [PR] [SPARK-58082][SQL] Add DSv2 relation and row-level command tree patterns [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/08/18 20:52:09 UTC, 1 replies.
- [PR] [SPARK-58848] Prevent unbounded shuffle reader connection waits [spark] - posted by "zeruibao (via GitHub)" <gi...@apache.org> on 2026/08/18 21:11:57 UTC, 6 replies.
- Re: [PR] [SPARK-58645] Add `recursive` flag to `variant_explode` [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2026/08/18 21:31:10 UTC, 8 replies.
- [PR] Rtm stateful latency benchmarks [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/08/18 21:47:08 UTC, 0 replies.
- [PR] [SPARK-58766][PYTHON][TESTS][FOLLOWUP] Render non-UTF-8 binary->string casts in golden files and narrow the cell try/except [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/18 22:04:39 UTC, 4 replies.
- [PR] [MINOR][SQL] Make DESCRIBE TABLE resilient to corrupt partition metadata [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/08/18 23:34:26 UTC, 0 replies.
- [PR] [MINOR][INFRA] Add Cursor Cloud Agent development environment [spark] - posted by "Vamsi-klu (via GitHub)" <gi...@apache.org> on 2026/08/19 00:39:12 UTC, 3 replies.
- [I] [DOC] HTML Table broken in sql-error-conditions [spark] - posted by "mika-data (via GitHub)" <gi...@apache.org> on 2026/08/19 01:12:22 UTC, 1 replies.
- Re: [PR] [SPARK-25078][DEPLOY] Standalone does not work with spark.authenticate.secret and deploy-mode=cluster [spark] - posted by "shubhluck (via GitHub)" <gi...@apache.org> on 2026/08/19 01:24:15 UTC, 0 replies.
- [PR] [SPARK-58850][SQL] Update stale plan node names in AQE test comments [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/19 01:40:29 UTC, 5 replies.
- [PR] [SPARK-58851][SS] Add missing scaladoc for streaming progress parameters [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/19 01:40:32 UTC, 7 replies.
- Re: [PR] [SPARK-58202][K8S] Skip driver containerPort declaration when the port is 0. [spark] - posted by "zhengchenyu (via GitHub)" <gi...@apache.org> on 2026/08/19 01:45:13 UTC, 2 replies.
- Re: [PR] [SPARK-58849][SQL] Make DESCRIBE TABLE resilient to corrupt partition metadata [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/19 02:12:06 UTC, 9 replies.
- [PR] [SPARK-57399][CORE][SQL] Local repartition: in-process pipelined channel shuffle for a single executor [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/08/19 02:30:24 UTC, 30 replies.
- [PR] [SPARK-58852][INFRA] Replace archived test report action [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/08/19 02:33:18 UTC, 7 replies.
- [PR] [SPARK-58853][ML] Optimize IDFModel transform closure [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/19 03:09:16 UTC, 2 replies.
- [PR] [SPARK-58854][ML] Optimize GeneralizedLinearRegressionModel transform closure [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/19 03:40:46 UTC, 2 replies.
- [PR] [SPARK-58855][ML] Optimize IsotonicRegressionModel transform closure [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/19 04:20:22 UTC, 2 replies.
- [PR] [SPARK-58387][SQL] Do not pre-aggregate under an Expand when a duplicate-sensitive aggregate is present [spark] - posted by "Vivek1106-04 (via GitHub)" <gi...@apache.org> on 2026/08/19 05:02:25 UTC, 2 replies.
- [PR] [SPARK-58857][K8S] Bind the result of Utils.randomize in LocalDirsFeatureStep [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/19 05:59:44 UTC, 4 replies.
- [PR] [SPARK-58858] Add scg-config crate [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/08/19 06:20:34 UTC, 2 replies.
- [PR] [SPARK-58658][3.5][CONNECT] Do not return redacted configurations from the Config RPC [spark] - posted by "alexandrefimov (via GitHub)" <gi...@apache.org> on 2026/08/19 06:48:26 UTC, 5 replies.
- [PR] [SPARK-58859][PYSPARK][TESTS] Add BarrierTaskContext negative tests for SQL map APIs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/19 07:14:44 UTC, 2 replies.
- [PR] [SPARK-58860][SQL] Support PartialMerge mode in adaptive partial aggregation [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/08/19 07:39:33 UTC, 10 replies.
- [PR] [SPARK-58815][SQL] Handle name conflicts in row-level operations [spark] - posted by "MrHappyEnding (via GitHub)" <gi...@apache.org> on 2026/08/19 07:44:24 UTC, 1 replies.
- [PR] [SPARK-58862][INFRA] Recognize UDF as a primary component tag in the merge script [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/19 07:53:01 UTC, 2 replies.
- Re: [PR] [SPARK-58844][UDF] Fix a Cancel-after-Finish flake in the UDF worker protocol test client [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/19 07:56:02 UTC, 3 replies.
- [PR] [MINOR][ML] Make tree leaf attribute uncached [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/19 07:56:52 UTC, 0 replies.
- [PR] [SPARK-58438][CORE] Close FileSystem cache after token renewal [spark] - posted by "MrHappyEnding (via GitHub)" <gi...@apache.org> on 2026/08/19 08:48:34 UTC, 2 replies.
- [PR] [SPARK-20711][MLLIB] Make summarizer min/max return NaN for NaN input [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/19 09:09:55 UTC, 0 replies.
- [PR] [SPARK-58867][BUILD] Add Scala initialization checks to build [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/19 09:10:00 UTC, 0 replies.
- [PR] [SPARK-58864][SQL] Add remediation hint to UNRECOGNIZED_SQL_TYPE error [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2026/08/19 09:29:19 UTC, 3 replies.
- [PR] [SPARK-58865][SQL] Add an example to the JDBC hint option error message [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2026/08/19 09:37:15 UTC, 3 replies.
- [PR] [SPARK-51356][SQL] Fix incorrect IsNotNull predicate reordering for n… [spark] - posted by "AnhTtis (via GitHub)" <gi...@apache.org> on 2026/08/19 09:51:32 UTC, 4 replies.
- [PR] [SPARK-58861][BUILD] Upgrade Jackson to 2.22.1 [spark] - posted by "madsager-db (via GitHub)" <gi...@apache.org> on 2026/08/19 10:02:00 UTC, 6 replies.
- [PR] [SPARK-58868][ML] Optimize KMeansModel transform closure [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/19 11:26:15 UTC, 0 replies.
- [PR] [SPARK-58866][SQL] Add expression-level entry points to optimizer rules [spark] - posted by "matvei-zamiatin-db (via GitHub)" <gi...@apache.org> on 2026/08/19 11:55:04 UTC, 24 replies.
- [PR] [SPARK-58869][BUILD] Upgrade Parquet to 1.18.0 [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/08/19 11:57:59 UTC, 3 replies.
- [PR] [MINOR][INFRA] Add timeout to disk cleanup steps [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/19 12:36:37 UTC, 0 replies.
- [PR] [SPARK-58870][MLLIB] Make KMeans distance measures singleton [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/19 12:41:52 UTC, 0 replies.
- Re: [PR] [SPARK-58845][PYTHON] Collapse check-then-create-dir pattern into single call [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/08/19 13:04:26 UTC, 4 replies.
- [PR] [SPARK-58873][SQL] Fix HAVING on outer grouping expressions [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2026/08/19 13:10:43 UTC, 1 replies.
- [PR] [SPARK-58875][ML][SQL] Add WrapUDT expression for vector UDT conversion [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/19 13:56:30 UTC, 0 replies.
- [PR] [SPARK-58872][K8S] Warn when driver credentials drop the driver service account [spark] - posted by "zahed1994 (via GitHub)" <gi...@apache.org> on 2026/08/19 14:44:25 UTC, 11 replies.
- [PR] [SPARK-58362][CORE] Fix resource profile ID collision with default profile ID [spark] - posted by "zahed1994 (via GitHub)" <gi...@apache.org> on 2026/08/19 15:16:58 UTC, 2 replies.
- [PR] [SPARK-58877][BUILD] Upgrade Log4j from 2.26.0 to 2.26.1 [spark] - posted by "anoopamS (via GitHub)" <gi...@apache.org> on 2026/08/19 16:05:46 UTC, 6 replies.
- [PR] [SPARK-58878][BUILD] Upgrade Apache Ivy from 2.5.3 to 2.6.0 [spark] - posted by "anoopamS (via GitHub)" <gi...@apache.org> on 2026/08/19 16:15:26 UTC, 2 replies.
- [PR] [SPARK-58880][INFRA] Make precompile a hard requirement [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/19 16:46:08 UTC, 2 replies.
- [PR] [SPARK-58794][SQL] Implement R1 CHAR/VARCHAR promotion via ImplicitTypeCasts [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/08/19 16:48:32 UTC, 0 replies.
- [PR] [SPARK-58879][CORE] Avoid decommissioning executors that became busy [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/08/19 16:53:24 UTC, 7 replies.
- Re: [PR] [SPARK-57254][INFRA] Put CI-unrelated files in a module so CI won't be triggered [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/08/19 17:28:21 UTC, 1 replies.
- [PR] [SPARK-58794][SQL] Expose CHAR/VARCHAR metadata to SQL clients [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/08/19 17:35:56 UTC, 4 replies.
- Re: [PR] [SPARK-58848][SS] Prevent unbounded shuffle reader connection waits [spark] - posted by "funrollloops (via GitHub)" <gi...@apache.org> on 2026/08/19 17:40:56 UTC, 5 replies.
- Re: [PR] [SPARK-57818][SQL] Support nanosecond-precision NTZ timestamps in convert_timezone [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/19 17:58:51 UTC, 2 replies.
- [PR] [SPARK-55271][SS] Fix NullPointerException in Kafka micro-batch streaming metrics reporting [spark] - posted by "zahed1994 (via GitHub)" <gi...@apache.org> on 2026/08/19 18:28:48 UTC, 9 replies.
- Re: [PR] [SPARK-55271][SS] The error originates in KafkaMicroBatchStream.metrics() at line 520, where the code attempts to call .get() on a Scala Option that contains null, then immediately invokes .map() on the null result [spark] - posted by "zahed1994 (via GitHub)" <gi...@apache.org> on 2026/08/19 18:31:51 UTC, 1 replies.
- [PR] [SPARK-58629][CONNECT][FOLLOWUP] Avoid empty INTERNAL gRPC error messages [spark] - posted by "haoyangeng-db (via GitHub)" <gi...@apache.org> on 2026/08/19 18:43:52 UTC, 3 replies.
- [PR] [SPARK-52589][K8S] Fix Dynamic Allocation Hangs on Kubernetes (minExe… [spark] - posted by "zahed1994 (via GitHub)" <gi...@apache.org> on 2026/08/19 19:16:10 UTC, 3 replies.
- Re: [PR] [SPARK-58794][SQL] Promote CHAR/VARCHAR to STRING via ImplicitTypeCasts [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/08/19 19:43:38 UTC, 12 replies.
- [PR] [SPARK-58885][BUILD][INFRA] Refactor handling of ignored patterns in module test detection [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/08/19 19:46:14 UTC, 10 replies.
- Re: [PR] [SPARK-57819][SQL] Support nanosecond-precision timestamps in months_between [spark] - posted by "iRakson (via GitHub)" <gi...@apache.org> on 2026/08/19 20:11:40 UTC, 2 replies.
- [PR] [SPARK-58886][CORE] Guard executor request bookkeeping against huge requested totals [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/19 20:20:35 UTC, 0 replies.
- [PR] [SPARK-58887][CORE] Fix barrier job to be cancellable during slot check retries [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/19 20:23:35 UTC, 7 replies.
- Re: [PR] [SPARK-58886][CORE] Fix Int overflow in `CoarseGrainedSchedulerBackend.requestExecutors` [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/08/19 21:22:34 UTC, 5 replies.
- [PR] [SPARK-57897][BUILD][FOLLOWUP][4.X] Add `credential-aws` profile to `assembly/pom.xml` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/08/19 21:35:04 UTC, 4 replies.
- [PR] [SPARK-58765][PYTHON][TEST][FOLLOWUP] Regenerate the type-scalar from_pandas golden for the temporal-overflow repr [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/19 21:53:55 UTC, 3 replies.
- Re: [PR] [SPARK-58863][ML] Make tree leaf attribute uncached [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/19 22:12:14 UTC, 2 replies.
- [PR] [SPARK-58889][SS] Clean up cached kafkaParams in InternalKafkaConsumerPool after invalidateKey()/reset() [spark] - posted by "jiateoh (via GitHub)" <gi...@apache.org> on 2026/08/19 22:27:27 UTC, 2 replies.
- [PR] [SPARK-58890][SQL][PYTHON][CONNECT] Support incremental Python aggregators over window functions [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/19 22:56:15 UTC, 7 replies.
- Re: [PR] [SPARK-58794][SQL][CONNECT] Expose CHAR/VARCHAR metadata and decode result schemas [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/08/20 00:00:25 UTC, 1 replies.
- [PR] [SPARK-58765][PYTHON][TEST][FOLLOWUP] Add tests for pa.Array.from_pandas with nested target types [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/20 00:11:23 UTC, 3 replies.
- Re: [PR] [SPARK-58871][INFRA] Add timeout to disk cleanup steps [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/20 00:12:04 UTC, 1 replies.
- Re: [PR] [SPARK-56429][DOCS] Clarify differences between nullValue and emptyValue CSV options [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/20 00:21:35 UTC, 1 replies.
- [PR] [SPARK-58891][SQL] Reorder Window stacks to minimize exchanges [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/08/20 00:26:51 UTC, 9 replies.
- Re: [PR] [SPARK-58870][ML] Make KMeans distance measures singleton [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/20 00:27:54 UTC, 1 replies.
- [PR] [SPARK-58892][SQL] Allow DSv2 sources to report additional inferred Catalyst filters [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/08/20 01:39:02 UTC, 1 replies.
- Re: [PR] [SPARK-58819][SQL] UnionExec outputPartitioning should compare children in the union's attribute space [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/08/20 02:46:08 UTC, 6 replies.
- [PR] [SQL] Detect cyclic view references in nested subqueries [spark] - posted by "manuzhang (via GitHub)" <gi...@apache.org> on 2026/08/20 03:14:44 UTC, 0 replies.
- Re: [PR] [SPARK-58681][CORE][SQL][TESTS] Fix race in job cancellation tests [spark] - posted by "manuzhang (via GitHub)" <gi...@apache.org> on 2026/08/20 03:34:42 UTC, 3 replies.
- [PR] [SPARK-58896][ML] Compute decision tree model stats in one traversal [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/20 04:06:25 UTC, 4 replies.
- Re: [PR] [SPARK-58806][SQL][CONNECT] Expose CHAR/VARCHAR metadata and decode result schemas [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/08/20 04:21:20 UTC, 3 replies.
- [PR] [WIP][SQL][PYTHON] Support Python UDFs in aggregate/reduce higher-order functions [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/20 04:51:34 UTC, 1 replies.
- [PR] [SPARK-58897][SQL] Propagate NaN through the infinity norm in vector_norm [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/08/20 05:01:00 UTC, 1 replies.
- [PR] [SPARK-58880][INFRA][4.x] Make precompile a hard requirement [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/20 05:01:20 UTC, 2 replies.
- [PR] [SPARK-58898][MLLIB] Use Identifiable for temporary ML column names [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/20 05:08:04 UTC, 0 replies.
- Re: [PR] [SPARK-52589][K8S] Fix Dynamic Allocation Hangs on Kubernetes (minExecutors=0) Due to Stale Ghost Executors [spark] - posted by "zahed1994 (via GitHub)" <gi...@apache.org> on 2026/08/20 05:15:13 UTC, 1 replies.
- [PR] [SPARK-58899][BUILD] Upgrade scalapb-runtime from 0.11.17 to 0.11.20 [spark] - posted by "anoopamS (via GitHub)" <gi...@apache.org> on 2026/08/20 05:27:05 UTC, 0 replies.
- [PR] [SPARK-34586][SQL] Support declaring a write distribution and ordering in CREATE/REPLACE TABLE [spark] - posted by "anuragmantri (via GitHub)" <gi...@apache.org> on 2026/08/20 05:30:54 UTC, 4 replies.
- Re: [PR] [SPARK-57205][SQL] Add SupportsScanMerging to merge equivalent V2 file scans [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/20 05:43:37 UTC, 1 replies.
- [PR] [SPARK-58888][SQL] Do not pre-aggregate under an Expand when the pre-aggregate would have no grouping [spark] - posted by "Vivek1106-04 (via GitHub)" <gi...@apache.org> on 2026/08/20 05:50:17 UTC, 0 replies.
- [PR] [SPARK-58900][BUILD] Upgrade Apache Parquet from 1.17.1 to 1.18.0 [spark] - posted by "anoopamS (via GitHub)" <gi...@apache.org> on 2026/08/20 06:23:12 UTC, 1 replies.
- [PR] [SPARK-58901] Add scg-auth crate [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/08/20 06:31:55 UTC, 2 replies.
- [PR] [SPARK-54694][K8S] Fail app on ConfigMap size over limit [spark] - posted by "HwangDongJun (via GitHub)" <gi...@apache.org> on 2026/08/20 06:34:34 UTC, 0 replies.
- [PR] [SPARK-50698][SQL] Refactor CreateUserDefinedFunction command to extend from UnaryRunnableCommand [spark] - posted by "zahed1994 (via GitHub)" <gi...@apache.org> on 2026/08/20 07:07:03 UTC, 3 replies.
- [PR] [MINOR][DOCS] Fix broken HTML table in sql-error-conditions [spark] - posted by "hulincup (via GitHub)" <gi...@apache.org> on 2026/08/20 07:23:30 UTC, 5 replies.
- [PR] [WIP][PYTHON] Avoid extra row materialization in local Arrow conversion [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/20 07:33:28 UTC, 0 replies.
- [PR] [WIP][PYTHON] Remove identity converter flag [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/20 07:33:30 UTC, 1 replies.
- Re: [PR] [SPARK-58894][SQL] Detect cyclic view references in nested subqueries [spark] - posted by "manuzhang (via GitHub)" <gi...@apache.org> on 2026/08/20 07:47:48 UTC, 4 replies.
- Re: [PR] [SPARK-58392][SQL] Pass table state options while loading relations [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/20 08:34:20 UTC, 10 replies.
- [PR] [SPARK-58895][SQL] Route custom session view catalogs through V2 commands [spark] - posted by "manuzhang (via GitHub)" <gi...@apache.org> on 2026/08/20 08:37:29 UTC, 1 replies.
- Re: [PR] [SPARK-58798][SQL] Fix collated CHAR LCT and cover compare/IN/set-ops [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/08/20 10:09:21 UTC, 2 replies.
- [PR] [MINOR][PYTHON][TESTS] Retry PySpark logger UDF log assertion [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/20 10:29:31 UTC, 2 replies.
- Re: [PR] [SPARK-58898][ML] Use Identifiable for temporary ML column names [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/20 10:30:34 UTC, 1 replies.
- Re: [PR] [SPARK-58875][SQL][ML][PYTHON][CONNECT] Add WrapUDT expression for zero-copy linalg conversion [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/20 11:12:39 UTC, 7 replies.
- [PR] [SPARK-58903][SQL][TESTS] Add BIN BY tests for ORDER BY resolution on re-output DISTRIBUTE columns [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/08/20 11:57:10 UTC, 0 replies.
- [PR] [SPARK-58905][INFRA] Allow merge script to update resolved JIRA fix versions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/20 12:19:58 UTC, 9 replies.
- [PR] [SPARK-58906][ML][PYTHON] Make vector and matrix UDTs singletons [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/20 12:46:23 UTC, 3 replies.
- [PR] [SPARK-58883][CORE] Detect truncated checkpoint directory on read via persisted partition count [spark] - posted by "anshulbaliga7 (via GitHub)" <gi...@apache.org> on 2026/08/20 12:54:04 UTC, 11 replies.
- Re: [PR] [WIP][PYTHON] Measure PySpark session lifecycle [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/20 13:21:09 UTC, 0 replies.
- Re: [PR] [SPARK-58088][INFRA] Extract checkout-and-sync pattern into composite GitHub Action [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/08/20 13:26:35 UTC, 1 replies.
- Re: [PR] [INFRA] Support multi-branch backports with per-pick confirmation in merge_spark_pr.py [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/20 13:36:19 UTC, 0 replies.
- [PR] [SPARK-58908][K8S] Do not report ExecutorKilled for heartbeat-timeout executor kills [spark] - posted by "AbhinavBattu (via GitHub)" <gi...@apache.org> on 2026/08/20 13:51:47 UTC, 1 replies.
- Re: [PR] [SPARK-58903][SQL][TESTS] Add BIN BY tests for resolving re-output DISTRIBUTE and metadata columns [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/20 14:46:55 UTC, 2 replies.
- [PR] [SPARK-58909][SQL][TESTS] Move heavy suites out of the sql-other GHA shard [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/08/20 14:47:52 UTC, 4 replies.
- [PR] [SPARK-58912][ML] Use integer counts in CountVectorizer transform [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/20 15:16:54 UTC, 3 replies.
- [PR] [SPARK-58913][CORE] Add `TaskSchedulerImpl.hasPipelinedTaskSets` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/20 15:29:28 UTC, 4 replies.
- [PR] [SPARK-58914][CORE][WEBUI] Add a reusable `confirm-link` for Web UI links [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/20 15:46:40 UTC, 5 replies.
- [PR] [SPARK-51816][SQL][FOLLOWUP] Handle infinite relativeError in approxQuantile [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/20 15:49:46 UTC, 0 replies.
- [PR] [SPARK-58915][CORE] Add `supportsExecutorHold` to the scheduler backends [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/20 16:02:45 UTC, 1 replies.
- Re: [PR] [SPARK-58915][CORE][K8S][YARN] Add `supportsExecutorHold` to the scheduler backends [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/20 16:38:18 UTC, 2 replies.
- Re: [PR] [SPARK-58807][SQL] Preserve CHAR/VARCHAR on language surfaces under standardSemantics [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/08/20 17:20:03 UTC, 7 replies.
- [PR] Add options to respect the inferSchema option when reading CSV as var… [spark] - posted by "ghanse (via GitHub)" <gi...@apache.org> on 2026/08/20 18:28:00 UTC, 0 replies.
- [PR] [SPARK-55968][SQL] Do not treat vectorized reader capacity overflow as corrupt file exception when ignoreCorruptFiles is enabled [spark] - posted by "zahed1994 (via GitHub)" <gi...@apache.org> on 2026/08/20 19:38:43 UTC, 2 replies.
- [PR] [SPARK-58918][SQL] Push column pruning into the Arrow cache read path [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/08/20 19:40:14 UTC, 4 replies.
- [PR] [SPARK-58919][PYTHON][TESTS] Add tests for pa.Schema.from_pandas [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/20 20:58:40 UTC, 4 replies.
- [PR] [SPARK-58920][DOC] Fix typos in the Quick Start and Security docs [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/20 22:30:31 UTC, 2 replies.
- [PR] [SPARK-58921][CONNECT][PYTHON] Fix misspelled messageParameters argument in Spark Connect tag validation [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/20 22:30:35 UTC, 2 replies.
- [PR] [SPARK-58922][CORE] Extract a null/empty MDC-array check in SparkLogger [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/20 22:30:40 UTC, 2 replies.
- [PR] [SPARK-58923][PYTHON] Bound applyInPandas output Arrow batch size [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/20 22:45:57 UTC, 8 replies.
- Re: [PR] [SPARK-58916][SQL] Handle infinite relativeError in approxQuantile [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/20 23:04:25 UTC, 2 replies.
- Re: [PR] [SPARK-57980][SQL] Extract the HashAggregateExec hash-map spill machinery into a shared helper [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/08/20 23:39:35 UTC, 3 replies.
- [PR] [SPARK-58925][STREAMING] Document maxOpenFiles troubleshooting guidance [spark] - posted by "liviazhu (via GitHub)" <gi...@apache.org> on 2026/08/20 23:52:51 UTC, 0 replies.
- Re: [PR] [SPARK-56826][SQL] Skip PushVariantIntoScan for VariantGet with null-evaluating path [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/21 00:18:57 UTC, 1 replies.
- Re: [I] Pandas On Spark crashing on Windows when applying a custom function. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/21 00:19:00 UTC, 0 replies.
- Re: [PR] [SPARK-56819][SQL] Add option to trim CHAR trailing spaces on read [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/21 00:19:02 UTC, 1 replies.
- Re: [PR] [SPARK-54419][SQL] Avoid expanding expensive alias chains in optimizer [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/21 00:19:05 UTC, 1 replies.
- Re: [PR] [SPARK-55203][PYTHON] Support PathLike in readwriter paths [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/21 00:19:07 UTC, 1 replies.
- Re: [PR] [SPARK-54560] Safe type filtering in QueryPlan._subqueries to prevent ClassCastException in AQE [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/21 00:19:11 UTC, 2 replies.
- Re: [PR] [SPARK-57471][SQL] Populate input/output size metrics for JDBC reads and writes [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/21 00:42:30 UTC, 0 replies.
- Re: [PR] [SPARK-58415][TESTS] Regenerate benchmark results [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/21 00:49:47 UTC, 0 replies.
- Re: [PR] [SPARK-58911][ML] Use DataFrame aggregations in CountVectorizer fit [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/21 00:51:07 UTC, 1 replies.
- [PR] [SPARK-55206][PYTHON][FOLLOWUP] Preserve Python semantics in UDF transpilation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/21 01:45:53 UTC, 11 replies.
- [PR] [SPARK-58442][SQL] Don't rewrite IN subquery to ExistenceJoin where NULL is observable [spark] - posted by "vboo123 (via GitHub)" <gi...@apache.org> on 2026/08/21 02:09:46 UTC, 2 replies.
- [PR] [SPARK-38079][K8S] Create the driver's config maps and mounted secret as pre-resources to avoid a mount race [spark] - posted by "HwangDongJun (via GitHub)" <gi...@apache.org> on 2026/08/21 02:17:09 UTC, 3 replies.
- [PR] [WIP][SPARK-58650][PYTHON][SQL] Improve source extraction during transpilation [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/08/21 02:21:56 UTC, 0 replies.
- [PR] [WIP][SPARK-58626][PYTHON][SQL] Optimize evaluating inputs to transpiled UDFs [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/08/21 02:28:19 UTC, 0 replies.
- Re: [PR] [SPARK-58892][SQL] Allow DSv2 sources to report advisory Catalyst filters [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/21 02:31:29 UTC, 13 replies.
- [PR] [SPARK-58926][K8S] SPARK_USER on Kubernetes driver should honor --proxy-user [spark] - posted by "otterc (via GitHub)" <gi...@apache.org> on 2026/08/21 02:40:02 UTC, 12 replies.
- Re: [PR] [SPARK-58907][PYTHON] Reduce memory in local data to Arrow conversion [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/21 03:15:30 UTC, 1 replies.
- Re: [PR] [SPARK-58925][SS][DOCS] Document maxOpenFiles troubleshooting guidance [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/08/21 03:28:38 UTC, 2 replies.
- [PR] [SPARK-55805][PYTHON] Align simple stream reader wrapper read() with the ABC [spark] - posted by "Vamsi-klu (via GitHub)" <gi...@apache.org> on 2026/08/21 03:30:31 UTC, 13 replies.
- [PR] [SPARK-58212][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1052 [spark] - posted by "Vamsi-klu (via GitHub)" <gi...@apache.org> on 2026/08/21 03:30:33 UTC, 1 replies.
- [PR] [WIP][ML] Add vector posexplode function [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/21 03:56:27 UTC, 0 replies.
- [PR] [SPARK-58928][SQL] WindowGroupLimitExec uses binary equality for collated PARTITION BY keys [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/08/21 03:57:13 UTC, 0 replies.
- Re: [PR] [SPARK-58856][ML] Avoid per-leaf map for tree predictions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/21 04:59:04 UTC, 2 replies.
- [PR] [SPARK-57743][SQL] Support hash-based aggregation for collated groupi… [spark] - posted by "Shinoaki0145 (via GitHub)" <gi...@apache.org> on 2026/08/21 05:07:32 UTC, 3 replies.
- [PR] [SPARK-58927][SQL] Support hash-based aggregation for collated grouping keys [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2026/08/21 05:13:25 UTC, 2 replies.
- Re: [PR] [SPARK-58927][SQL] Support hash-based aggregation for collated groupi… [spark] - posted by "Shinoaki0145 (via GitHub)" <gi...@apache.org> on 2026/08/21 05:20:09 UTC, 1 replies.
- [PR] [SPARK-58929][INFRA] Add a dry-run mode to merge_spark_pr.py [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/21 06:04:48 UTC, 10 replies.
- [PR] Bump jsonwebtoken from 9.3.1 to 10.3.0 [spark-connect-gateway] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/08/21 07:30:11 UTC, 0 replies.
- [PR] [SPARK-58930] Add scg-observability crate [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/08/21 07:34:56 UTC, 2 replies.
- Re: [PR] [SPARK-58928][SQL] Fix collation-aware grouping in WindowGroupLimitExec [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/21 07:36:46 UTC, 0 replies.
- Re: [PR] [SPARK-58896][ML][4.x] Compute decision tree model stats in one traversal [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/21 07:39:11 UTC, 2 replies.
- Re: [PR] [SPARK-58884][SS] Add stateful benchmarks for Real-Time Mode [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/21 07:41:48 UTC, 1 replies.
- [PR] [SPARK-58765][PYTHON][TEST][FOLLOWUP] Override ARM float-to-int results in the from_pandas type-scalar test [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/21 07:51:46 UTC, 4 replies.
- [PR] [SPARK-58931][SQL] Reject negative randstr length during analysis [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/21 07:57:21 UTC, 8 replies.
- [PR] [SPARK-47672] Mark PythonUDF expensive to avoid double evaluation [spark] - posted by "psavalle (via GitHub)" <gi...@apache.org> on 2026/08/21 09:41:58 UTC, 4 replies.
- [PR] [SPARK-40259][SQL][FOLLOWUP] Add cross-table DSv2 scan merge regression test [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/21 11:53:51 UTC, 5 replies.
- Re: [PR] [SPARK-53471] Correct entrypoint.sh for Openshift [spark-docker] - posted by "Reamer (via GitHub)" <gi...@apache.org> on 2026/08/21 12:53:18 UTC, 0 replies.
- [PR] [SPARK-58876][SQL] Map Oracle DATE and TIMESTAMP to TimestampNTZType [spark] - posted by "aleksandar-trajkovic-db (via GitHub)" <gi...@apache.org> on 2026/08/21 13:02:38 UTC, 7 replies.
- [PR] [SPARK-58933][SQL] Resolve IDENTIFIER clauses in DML target tables [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/21 13:21:11 UTC, 3 replies.
- Re: [PR] [SPARK-47010][K8S] Support csi driver for volume type [spark] - posted by "SamWheating (via GitHub)" <gi...@apache.org> on 2026/08/21 13:32:07 UTC, 0 replies.
- [PR] [SPARK-58932][SS] Close the accepted socket in TransformWithStateInPySparkStateServer [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/08/21 13:43:25 UTC, 8 replies.
- [PR] [SPARK-58934][BUILD] Tolerate apt-get remove failures directly [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/08/21 14:05:12 UTC, 3 replies.
- Re: [PR] [SPARK-56486][SQL] Add XSDToSchema.extendDecimalPrecision to prevent silent decimal truncation [spark] - posted by "vboo123 (via GitHub)" <gi...@apache.org> on 2026/08/21 15:40:59 UTC, 0 replies.
- Re: [PR] [SPARK-58847] Collation-aware hash aggregation [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2026/08/21 15:47:32 UTC, 1 replies.
- [PR] When agents create worktrees, point to origin, not upstream! [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/08/21 15:53:04 UTC, 3 replies.
- [PR] [SPARK-58936][SQL] Add partial view updates to ViewCatalog [spark] - posted by "manuzhang (via GitHub)" <gi...@apache.org> on 2026/08/21 16:02:38 UTC, 3 replies.
- [PR] [SPARK-58937] Consider unified timeline when determining affected rows for SCD2 [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/08/21 16:40:53 UTC, 11 replies.
- [PR] [MINOR][CONNECT] Convert metadata to list to prevent silent metadata loss on retry/reattach [spark] - posted by "zainmirzaaa (via GitHub)" <gi...@apache.org> on 2026/08/21 17:06:56 UTC, 1 replies.
- [I] [SQL] Stateful operations fail in non-streaming mode when StreamingQueryManager hasn't been initialized [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2026/08/21 17:44:54 UTC, 1 replies.
- [PR] [MINOR][SS][TEST] Use a managed temp dir for the checkpoint in KafkaRealTimeIntegrationSuite [spark] - posted by "Kino1994 (via GitHub)" <gi...@apache.org> on 2026/08/21 17:47:57 UTC, 1 replies.
- [PR] [SPARK-58938][SS] Add Real-Time Mode test coverage for streaming source evolution [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/08/21 17:55:46 UTC, 1 replies.
- [PR] [INFRA] Complete cherry pick as part of merge script [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/08/21 18:07:05 UTC, 0 replies.
- [PR] [SPARK-58918][SQL][TESTS][FOLLOWUP] Cover deeply nested types in the Arrow cache column-pruning read [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/08/21 18:26:39 UTC, 4 replies.
- [PR] [SPARK-58935][CORE] Expose numDroppedExecutorManagementEvents metric [spark] - posted by "HwangDongJun (via GitHub)" <gi...@apache.org> on 2026/08/21 18:48:29 UTC, 2 replies.
- [PR] Fix/spark 58751 listener shutdown [spark] - posted by "nahtonaj (via GitHub)" <gi...@apache.org> on 2026/08/21 19:35:22 UTC, 1 replies.
- [PR] [SPARK-58646][PS][FOLLOWUP] Fix NumPy reciprocal parity for decimal, boolean, and narrower integer columns [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/21 20:36:39 UTC, 2 replies.
- [PR] [SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_2033 [spark] - posted by "dkling-it (via GitHub)" <gi...@apache.org> on 2026/08/21 20:48:22 UTC, 1 replies.
- [PR] [SPARK-57980][SQL][4.3] Extract the HashAggregateExec hash-map spill machinery into a shared helper [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/08/21 20:52:47 UTC, 2 replies.
- Re: [PR] Refactor AGENTS pre-flight checks and add worktree-specific guidance [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/08/21 21:34:43 UTC, 2 replies.
- [PR] [SPARK-58939][PYSPARK] Move Arrow collect batch reordering into ArrowCollectSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/21 22:53:22 UTC, 1 replies.
- Re: [PR] [SPARK-55553][GRAPHX] Unpersist sccWorkGraph in StronglyConnectedComponents [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/22 00:17:17 UTC, 1 replies.
- Re: [PR] [SPARK-52382][PYTHON] Fix TypeError when collecting MapType with ArrayType keys [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/22 00:17:22 UTC, 1 replies.
- Re: [PR] [SPARK-51961][SQL] Fix from_avro to handle union schemas [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/22 00:17:29 UTC, 1 replies.
- Re: [PR] [SPARK-55830][SQL] Fix JDBC predicate pushdown dropping driver properties [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/22 00:17:36 UTC, 1 replies.
- [PR] [SPARK-58940][SDP][DOC] Add migration notes for Declarative Pipelines case sensitivity [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/08/22 00:36:56 UTC, 5 replies.
- [PR] [SPARK-58941][SDP] Sort schema inference flows by quoted identifier to avoid dotted-name collisions [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/08/22 07:03:14 UTC, 3 replies.
- Re: [PR] [SPARK-54698][SQL] Support hashing for all data types for array set like operations [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/22 14:58:12 UTC, 0 replies.
- Re: [PR] [SPARK-58937][SDP] Consider unified timeline when determining affected rows for SCD2 [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/08/22 15:44:49 UTC, 1 replies.
- [PR] [SPARK-58942][DOCS] Document CHAR/VARCHAR as a character string type family [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/08/22 21:56:45 UTC, 0 replies.
- Re: [PR] [MINOR][MLLIB] Exclude zero-weight observations from KMeans initialization [spark] - posted by "Israelobuk (via GitHub)" <gi...@apache.org> on 2026/08/22 23:26:49 UTC, 0 replies.
- Re: [I] Github issues for spark bootstrap list [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/23 00:18:48 UTC, 0 replies.
- Re: [PR] [SPARK-53790][SQL] Support generic beans in Arrow Encoder [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/23 00:18:49 UTC, 1 replies.
- Re: [PR] [SPARK-54698][SQL] Support hashing for all data types for ArraySetLike operations [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2026/08/23 00:35:00 UTC, 3 replies.
- Re: [PR] [MINOR][INFRA] Instruct agents to use `--no-track` when creating worktrees or branches [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/08/23 02:50:53 UTC, 1 replies.
- Re: [PR] [SPARK-58200][BUILD] Add a scala-3 build profile and make the version switch reversible [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/23 04:35:00 UTC, 2 replies.
- Re: [PR] [SPARK-58935][CORE][DOCS] Document the executorManagement and shared LiveListenerBus queue metrics [spark] - posted by "HwangDongJun (via GitHub)" <gi...@apache.org> on 2026/08/23 09:13:47 UTC, 1 replies.
- [PR] [SPARK-58945][SQL] Fix mismatched `messageParameters` keys that cause `INTERNAL_ERROR` [spark] - posted by "subhramit (via GitHub)" <gi...@apache.org> on 2026/08/23 11:06:39 UTC, 20 replies.
- Re: [PR] [SPARK-58944][INFRA] Complete cherry pick as part of merge script [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/23 11:50:52 UTC, 2 replies.
- [PR] [SPARK-58946][SQL] Reject invalid CSV file extensions [spark] - posted by "subhramit (via GitHub)" <gi...@apache.org> on 2026/08/23 12:31:59 UTC, 3 replies.
- Re: [PR] [SPARK-58847][SQL] Collation-aware hash aggregation [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/23 12:50:54 UTC, 4 replies.
- [PR] [SPARK-58947][CORE][TEST] Add tests for SparkCollectionUtils [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/23 13:18:07 UTC, 1 replies.
- Re: [PR] [SPARK-57548][SQL] Avoid eager scala.reflect.runtime.universe initialization in ScalaReflection [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/23 13:36:45 UTC, 6 replies.
- Re: [PR] [SPARK-58169][SQL] Use java reflection for finding the SparkSession companions [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/23 13:38:43 UTC, 1 replies.
- Re: [PR] [SPARK-58168][SQL] Do no use Array[Nothing] in Flatten [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/23 13:40:09 UTC, 1 replies.
- Re: [PR] [SPARK-58166][SQL] Replace TypeTag on PhysicalDataType with ClassTag [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/23 13:41:14 UTC, 1 replies.
- [PR] [SPARK-58948][SQL] Deduplicate nulls-buffer creation in columnar decompressors [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/23 14:01:12 UTC, 5 replies.
- [PR] [SPARK-58950][SQL] Materialize repeated view references as one CTE [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/08/23 15:25:31 UTC, 3 replies.
- [PR] [SPARK-58951][SQL] Support non-binary collations in collect_set [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/08/23 18:08:50 UTC, 2 replies.
- [PR] [SPARK-58952] Upgrade `Gradle` to 9.7.1 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/23 18:51:36 UTC, 4 replies.
- [PR] [SPARK-58953] Upgrade `spotbugs-gradle-plugin` to 6.5.11 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/23 18:52:39 UTC, 4 replies.
- [PR] [SPARK-58954][BUILD] Upgrade `commons-codec` to 1.22.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/23 18:54:10 UTC, 4 replies.
- [PR] [SPARK-58955][BUILD] Upgrade `commons-collections4` to 4.6.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/23 18:55:36 UTC, 3 replies.
- [PR] [SPARK-58956] Upgrade `swift-system` to 1.8.1 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/23 18:56:55 UTC, 4 replies.
- [PR] [SPARK-58957] Upgrade `gRPC Swift NIO Transport` to 2.9.2 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/23 18:57:42 UTC, 3 replies.
- [PR] [SPARK-48701][SQL] Make PandasMode collation-aware [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/08/23 19:44:42 UTC, 3 replies.
- [PR] [SPARK-39031][SQL] Match NaN pivot values in PivotFirst [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/08/23 20:03:18 UTC, 0 replies.
- [PR] [SPARK-58958] Remove stale entries from `verification-metadata.xml` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/23 20:04:33 UTC, 3 replies.
- Re: [PR] [SPARK-58947][CORE] Add tests for SparkCollectionUtils and handle Char in createArray [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/23 21:27:58 UTC, 1 replies.
- [PR] [SPARK-58959][SQL] Duplicate PIVOT values corrupt the aggregation buffer on the PivotFirst fast path [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/08/24 00:16:49 UTC, 1 replies.
- Re: [PR] [SPARK-56468][UDF] Validate required worker capabilities in direct dispatcher [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/24 00:18:15 UTC, 1 replies.
- Re: [PR] [SPARK-44734][PYTHON][DOCS] Expand PySpark type conversion guide [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/24 00:18:18 UTC, 1 replies.
- Re: [PR] [SPARK-56698][PYTHON] Add Spark MCP (Model Context Protocol) server [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/24 00:18:21 UTC, 2 replies.
- [PR] Adopt pyspark-client-fast as the standard: Rust core client + Python wrapper [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/24 00:34:49 UTC, 0 replies.
- [PR] Bump opentelemetry_sdk from 0.31.0 to 0.32.1 [spark-connect-gateway] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/08/24 01:13:22 UTC, 0 replies.
- [PR] [SPARK-58961] Add scg-audit and scg-ratelimit crates [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/08/24 01:21:03 UTC, 2 replies.
- Re: [PR] [SPARK-58960] Rust core Spark Connect client with a drop-in Python (pyspark) wrapper [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/24 03:45:36 UTC, 3 replies.
- [PR] [SPARK-58960][PART 1] Rust core Spark Connect client [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/24 03:57:33 UTC, 0 replies.
- [PR] [SPARK-58960] Drop-in Python (pyspark) wrapper over the Rust core [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/24 04:03:08 UTC, 10 replies.
- Re: [PR] [SPARK-58960] Rust core Spark Connect client [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/24 04:10:42 UTC, 17 replies.
- [PR] [MINOR][ML] Simplify SummarizerBuffer branching [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/24 04:20:59 UTC, 0 replies.
- [PR] [SPARK-58904][SS] Enforce correct watermark placement for stream-stream left semi and left outer joins [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2026/08/24 05:42:16 UTC, 5 replies.
- [PR] [SPARK-58949][CORE] Use unsigned UTF-8 byte ordering for Variant object fields [spark] - posted by "peterxcli (via GitHub)" <gi...@apache.org> on 2026/08/24 05:44:16 UTC, 9 replies.
- [PR] [SPARK-58962][MLLIB] Use zero-copy UDT conversion in MLUtils [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/24 07:24:32 UTC, 3 replies.
- Re: [PR] [SPARK-58650][PYTHON][SQL] Improve source extraction during transpilation [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/24 09:00:34 UTC, 2 replies.
- [PR] [SPARK-58964][ML] Consolidate matrix UDT column conversion [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/24 09:14:09 UTC, 0 replies.
- [PR] [SPARK-58965][SQL][PYTHON] Add gcd and lcm math functions [spark] - posted by "Vivek1106-04 (via GitHub)" <gi...@apache.org> on 2026/08/24 10:58:00 UTC, 0 replies.
- [PR] [SPARK-58893][UI] Fix Spark UI multi-cluster reverse proxy: propagate… [spark] - posted by "Nflrijal (via GitHub)" <gi...@apache.org> on 2026/08/24 11:56:12 UTC, 8 replies.
- [PR] [SPARK-58966][SQL] Resolve SQL variables in UPDATE and MERGE INTO conditions [spark] - posted by "joelrobin18 (via GitHub)" <gi...@apache.org> on 2026/08/24 12:07:26 UTC, 4 replies.
- [PR] [SPARK-58968][SQL] Fix data correctness issue when SPJ allowKeysSubsetOfPartitionKeys [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/08/24 12:58:07 UTC, 6 replies.
- [PR] [SPARK-58917][SQL] Respect inferSchema for variant ingestion in CSV parser [spark] - posted by "pratham76 (via GitHub)" <gi...@apache.org> on 2026/08/24 17:07:09 UTC, 2 replies.
- [PR] [SPARK-58021][CONNECT] Reap orphaned local pool members [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/08/24 17:19:04 UTC, 6 replies.
- [PR] [SPARK-58021][CONNECT] Add forceful local pool purge [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/08/24 17:19:19 UTC, 0 replies.
- [PR] [SPARK-46167][PS] Add pct, na_option, and axis parameters to Series.rank and DataFrame.rank [spark] - posted by "jzhan-2026 (via GitHub)" <gi...@apache.org> on 2026/08/24 17:56:52 UTC, 0 replies.
- Re: [PR] [SPARK-58939][PYTHON] Move Arrow collect batch reordering into ArrowCollectSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/24 18:20:52 UTC, 1 replies.
- Re: [PR] [SPARK-58941][SDP] Sort schema inference flows by identifier parts to avoid dotted-name collisions [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/08/24 18:28:43 UTC, 1 replies.
- [PR] [MINOR][INFRA] Upgrade actions/setup-java to v6 [spark] - posted by "brunoborges (via GitHub)" <gi...@apache.org> on 2026/08/24 18:43:51 UTC, 2 replies.
- [PR] [SPARK-58975][CORE] Add failure messages to MemoryPool require checks [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/24 19:07:06 UTC, 0 replies.
- [PR] [SPARK-58976][UI] Remove unused generateOutputOperationStatusForUI in BatchPage [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/24 19:07:37 UTC, 3 replies.
- [PR] [SPARK-58972][SQL][PROTOBUF] from_protobuf unwrapped primitive wrappers follow wrapper presence, not emit.default.values [spark] - posted by "bhollis-dbx (via GitHub)" <gi...@apache.org> on 2026/08/24 19:16:05 UTC, 2 replies.
- [PR] SPARK-58971][PS] Add pct, na_option, and axis parameters to Series.rank and DataFrame.rank [spark] - posted by "jzhan-2026 (via GitHub)" <gi...@apache.org> on 2026/08/24 19:31:26 UTC, 1 replies.
- Re: [PR] [SPARK-58971][PS] Add pct, na_option, and axis parameters to Series.rank and DataFrame.rank [spark] - posted by "jzhan-2026 (via GitHub)" <gi...@apache.org> on 2026/08/24 19:31:38 UTC, 8 replies.
- [PR] [SPARK-58794][SQL] Empty2Null, text, and Hive prune fallback for CHAR/VARCHAR [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/08/24 19:35:02 UTC, 0 replies.
- [PR] [SPARK-XXXXX][SQL] Reuse AttributeSeq when normalizing a sequence in QueryPlan canonicalization [spark] - posted by "yifei-yang-db (via GitHub)" <gi...@apache.org> on 2026/08/24 19:53:31 UTC, 0 replies.
- [PR] [SPARK-58553][PS][TESTS][FOLLOWUP] Skip NumPy comparison tests where NumPy's own result is platform-dependent [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/24 20:21:52 UTC, 3 replies.
- [PR] [SPARK-58973][SS] Fix state store batch read failure when StreamingQueryManager is not initialized [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/08/24 20:22:19 UTC, 3 replies.
- [PR] [SPARK-46161][PS][FOLLOWUP] Validate periods type in DataFrame.diff axis=1 branch [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/24 21:20:47 UTC, 2 replies.
- [PR] [SPARK-58978][PYTHON] Simplify Arrow collect empty-batch handling [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/24 21:21:40 UTC, 5 replies.
- [PR] [SPARK-58979][SS] Preserve event time through streaming dedup pruning [spark] - posted by "nahtonaj (via GitHub)" <gi...@apache.org> on 2026/08/24 21:40:17 UTC, 0 replies.
- Re: [PR] [SPARK-58848][CORE][SS] Prevent unbounded shuffle reader connection waits [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/08/24 21:45:11 UTC, 2 replies.
- [PR] [SPARK-58968][SQL] Fix SPJ allowKeysSubsetOfPartitionKeys correctness for non-join operators [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/08/24 22:21:13 UTC, 19 replies.
- [PR] [MINOR][PS] Correct the null-handling comment on the numpy signbit mapping [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/24 22:35:59 UTC, 1 replies.
- Re: [PR] [WIP][CONNECT] Support directory uploads in Spark Connect copyFromLocalToFs [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/25 00:17:42 UTC, 1 replies.
- Re: [I] [GRAPHX] Fix sccWorkGraph cache leak in StronglyConnectedComponents [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/25 00:17:46 UTC, 0 replies.
- [PR] [SPARK-58752][CONNECT] Deliver session environment variables to Python UDF workers [spark] - posted by "RamonZhou (via GitHub)" <gi...@apache.org> on 2026/08/25 00:33:10 UTC, 8 replies.
- Re: [PR] [MINOR][PS][DOC] Correct the null-handling comment on the numpy signbit mapping [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/25 00:41:12 UTC, 2 replies.
- [PR] [WIP][SQL][PYTHON] Prototype inline JVM UDF source registration [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/25 01:06:11 UTC, 1 replies.
- Re: [PR] [INFRA] Set up default rulesets for default and release branches [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:35:16 UTC, 0 replies.
- Re: [PR] [SPARK-52428] Fix show() to print table directly instead of double-wrapping [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:39:53 UTC, 1 replies.
- Re: [PR] [SPARK-52428] Add ergonomic convenience methods for catalog and config APIs [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:39:56 UTC, 1 replies.
- Re: [PR] [SPARK-52428] Add Column comparison methods (gt, lt, ge, le) [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:39:58 UTC, 1 replies.
- Re: [PR] [SPARK-52428] Add higher-order functions with lambda expression support [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:40:02 UTC, 1 replies.
- Re: [PR] [SPARK-52428] Add comprehensive CI workflow with unit and integration tests [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:40:04 UTC, 1 replies.
- Re: [PR] [SPARK-52428] Add UDF registration and invocation support [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:40:06 UTC, 1 replies.
- Re: [PR] [SPARK-53317] Add SparkSession::create_dataframe_from_polars() [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:40:09 UTC, 1 replies.
- Re: [PR] [SPARK-52428] Add DataFrame::merge_into() builder for MERGE INTO operations [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:40:11 UTC, 1 replies.
- Re: [PR] [SPARK-52428] Add SparkSession::add_artifact() for uploading files to the cluster [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:40:13 UTC, 1 replies.
- Re: [PR] [SPARK-52428] Extract structured error info from gRPC status metadata [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:40:15 UTC, 1 replies.
- Re: [PR] [SPARK-52428] Add DataFrame::observe() for metric collection [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:40:17 UTC, 1 replies.
- Re: [PR] [SPARK-52428] Add DataFrame::checkpoint() and local_checkpoint() [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:40:20 UTC, 1 replies.
- Re: [PR] [SPARK-52428] Add DataFrame::to_local_iterator() for batch-by-batch results [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:40:22 UTC, 1 replies.
- Re: [PR] [SPARK-53315] Add Column::get_item() and Column::get_field() [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:40:24 UTC, 1 replies.
- Re: [PR] [SPARK-52428] Add parameterized SQL support (named and positional args) [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:40:27 UTC, 1 replies.
- Re: [PR] [SPARK-52428] Add SparkSession::stop() for resource cleanup [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:40:30 UTC, 1 replies.
- Re: [PR] [SPARK-52428] Add configurable gRPC connection and request timeouts [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:40:33 UTC, 1 replies.
- Re: [PR] [SPARK-52428] Harden miscellaneous module error handling [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:40:35 UTC, 1 replies.
- Re: [PR] [SPARK-52428] Harden streaming and session error handling [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:40:37 UTC, 1 replies.
- Re: [PR] [SPARK-52428] Harden DataFrame error handling [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:40:40 UTC, 1 replies.
- Re: [PR] [SPARK-52428] Harden client module error handling [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:40:42 UTC, 1 replies.
- Re: [PR] [SPARK-53316] Add Map and Struct literal types [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:40:45 UTC, 1 replies.
- Re: [PR] [SPARK-53313] Add JDBC Reader and Writer support [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:40:47 UTC, 1 replies.
- Re: [PR] [SPARK-53314] Add DataStreamReader and DataStreamWriter convenience methods [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:40:50 UTC, 1 replies.
- Re: [PR] [SPARK-53316] Add DayTimeInterval literal type [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:40:52 UTC, 1 replies.
- Re: [PR] [SPARK-53316] Add YearMonthInterval literal type [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:40:54 UTC, 1 replies.
- Re: [PR] [SPARK-53316] Add CalendarInterval literal type [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:40:56 UTC, 1 replies.
- Re: [PR] [SPARK-53316] Add Decimal literal type [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:40:59 UTC, 1 replies.
- Re: [PR] [SPARK-53316] Add Byte literal type [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:41:02 UTC, 1 replies.
- Re: [PR] [SPARK-53316] Add Null literal type and improve from_str_name [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:41:04 UTC, 1 replies.
- Re: [PR] [SPARK-53315] Add missing Column API methods [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:41:07 UTC, 1 replies.
- Re: [PR] [SPARK-55941] - Clean up CI Steps [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:41:09 UTC, 1 replies.
- Re: [PR] Add Spark 4 protobuf definitions and basic working [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:41:12 UTC, 1 replies.
- [PR] [SPARK-58983][INFRA] Use ASF-allowlisted GitHub Actions in CI [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 01:57:26 UTC, 0 replies.
- [PR] [SPARK-58766][PYTHON][TEST][FOLLOWUP] Render NaT-sentinel time64 scalars in golden files [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/25 02:15:56 UTC, 3 replies.
- Re: [PR] [SPARK-48701][SQL][PS] Make PandasMode collation-aware [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/08/25 02:16:47 UTC, 0 replies.
- [PR] [SPARK-58984] Add scg-tenant crate [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/08/25 02:18:20 UTC, 2 replies.
- Re: [PR] [SPARK-58832][INFRA] Cleanup the dependency list for minimum docker image [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/08/25 03:27:21 UTC, 1 replies.
- Re: [PR] [SPARK-58818][SQL] Fix wrong results from evaluating a common expression once per reference in a conditional branch [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/25 05:15:21 UTC, 6 replies.
- [PR] [SPARK-58982][PYTHON] Remove PYSPARK_ENABLE_NAMEDTUPLE_PATCH namedtuple monkey-patch [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/25 05:41:26 UTC, 0 replies.
- [PR] [MINOR][INFRA] Skip JIRA updates for minor, trivial, and follow-up PRs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/25 06:28:34 UTC, 2 replies.
- Re: [PR] [SPARK-58983][INFRA] Fix CI so all workflows run and pass [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 07:21:17 UTC, 0 replies.
- [PR] [SPARK-58006][SQL][FOLLOWUP] Reject escaping outer refs in forceSkipInline defs [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/08/25 07:26:14 UTC, 5 replies.
- [PR] [SPARK-58970]Add SupportsReportCatalogStatistics to fix computeStats on pre-pushdown DSv2 relations [spark] - posted by "hemanthboyina (via GitHub)" <gi...@apache.org> on 2026/08/25 07:43:34 UTC, 3 replies.
- [PR] [SPARK-58988][SQL] Fix PartitioningCollection invariant violation exception when allowKeysSubsetOfPartitionKeys [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/08/25 07:46:23 UTC, 8 replies.
- [PR] [SPARK-58989][PYTHON][TESTS] Replace pyspark-install with pyspark-scheduled [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/08/25 07:48:14 UTC, 7 replies.
- [PR] [SPARK-58990] Add a MkDocs documentation site and slim the README [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 08:03:28 UTC, 9 replies.
- Re: [PR] [SPARK-58963][ML][SQL] Add internal ML-specific vector posexplode function [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/25 08:42:01 UTC, 1 replies.
- [PR] [SPARK-58991][PYTHON] Remove dead and broken AutoSerializer class [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/25 08:53:01 UTC, 2 replies.
- [PR] [SPARK-58987][INFRA] Faster Connect parity CI (ours-only + skip manifest) and a Rust coverage gate [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 09:16:02 UTC, 0 replies.
- [PR] [MINOR][ML] Avoid repeated MLP weight copies across layers [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/25 09:32:19 UTC, 3 replies.
- [PR] [SPARK-58992][INFRA] Trigger CI workflows on master only [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 09:43:39 UTC, 2 replies.
- [PR] [MINOR][ML] Fix prediction column metadata in GBTRegressionModel [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/25 10:01:48 UTC, 0 replies.
- Re: [PR] [MINOR][INFRA] Add .editorconfig for consistent coding style [spark] - posted by "arijitroy003 (via GitHub)" <gi...@apache.org> on 2026/08/25 10:15:27 UTC, 0 replies.
- [PR] [SPARK-58995][INFRA] Cancel superseded CI runs with a concurrency group [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 10:16:49 UTC, 2 replies.
- [PR] [SPARK-58993][ML] Use OpenHashMap for CountVectorizer vocabulary lookup [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/25 10:21:42 UTC, 2 replies.
- [PR] [SPARK-58996][SQL] Fix SPJ partially clustered data correctness when EnsureRequirements re-runs [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/08/25 10:44:24 UTC, 4 replies.
- [PR] [MINOR][SQL][PYTHON][TEST] Add tests for dependent columns in withColumns [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/25 10:52:54 UTC, 2 replies.
- [PR] [MINOR] Point the repo homepage at the documentation site [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/25 10:55:23 UTC, 1 replies.
- Re: [PR] [SPARK-58986][PYTHON] Sort import for python files [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/08/25 11:39:29 UTC, 1 replies.
- [PR] [SPARK-XXXXX][SQL] Add `variant_pick` expression [spark] - posted by "bojana-db (via GitHub)" <gi...@apache.org> on 2026/08/25 11:41:21 UTC, 0 replies.
- Re: [PR] [SPARK-58641][SQL][TESTS] Add identifier clause function resolution tests [spark] - posted by "vladanvasi-db (via GitHub)" <gi...@apache.org> on 2026/08/25 12:38:24 UTC, 3 replies.
- [PR] [SPARK-58999][SPARK] Allow a bare error class when it defines sub-classes [spark] - posted by "ala (via GitHub)" <gi...@apache.org> on 2026/08/25 12:48:47 UTC, 6 replies.
- [PR] [SPARK-58967][KUBERNETES] Use FQDN with configurable cluster domain for driver hostname [spark] - posted by "shazebkhan1 (via GitHub)" <gi...@apache.org> on 2026/08/25 12:53:38 UTC, 2 replies.
- [PR] [SPARK-59000][SQL] Use java.util.Arrays.compareUnsigned for BinaryType comparison [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/08/25 13:54:14 UTC, 1 replies.
- Re: [PR] [SPARK-58947][CORE] Handle Char in createArray and add tests for SparkCollectionUtils [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/25 15:47:59 UTC, 1 replies.
- Re: [PR] [SPARK-59001][SQL] Empty2Null, text, and Hive prune fallback for CHAR/VARCHAR [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/08/25 16:20:52 UTC, 8 replies.
- Re: [PR] [SPARK-58938][SS][TEST] Add Real-Time Mode test coverage for streaming source evolution [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/08/25 17:22:25 UTC, 2 replies.
- [PR] [SPARK-59002] Upgrade `Netty` to 4.2.17.Final [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/25 17:27:12 UTC, 3 replies.
- [PR] [SPARK-59003] Upgrade `spotless-plugin-gradle` to 8.10.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/25 17:28:43 UTC, 3 replies.
- [PR] [SPARK-59004][CORE] Use vectorized Arrays.compare for ComparableByteArray.compareTo [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/08/25 17:43:32 UTC, 0 replies.
- Re: [PR] [SPARK-58021][CONNECT] Add local pool server retirement [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/08/25 17:46:45 UTC, 6 replies.
- Re: [PR] [SPARK-58935][DOCS] Document `executorManagement` and `shared` queue metrics of `LiveListenerBus` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/25 18:01:16 UTC, 2 replies.
- [PR] [SPARK-58601][PYTHON][TESTS] Guard mapInPandas/mapInArrow list-return tests with the legacy acceptAnyIterable flag [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/25 18:37:15 UTC, 0 replies.
- [PR] [SPARK-59006][CORE] Generalize `checkAndGetSparkContext` to take a feature name [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/25 18:42:38 UTC, 5 replies.
- [PR] [SPARK-59005][INFRA] Offer to update the JIRA Affects Version from the fix version in the merge script [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/25 18:45:49 UTC, 19 replies.
- Re: [PR] [SPARK-58987][INFRA][PYTHON] Faster parity CI, Rust coverage gate, and drop-in pyspark API fidelity [spark-connect-rust] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/08/25 18:48:05 UTC, 12 replies.
- [PR] [SPARK-59007][PYTHON][TESTS] Fix flaky Arrow grouped map worker logging tests [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/25 19:07:00 UTC, 3 replies.
- [I] Github workflow for scanning CVEs [spark] - posted by "kevinjqliu (via GitHub)" <gi...@apache.org> on 2026/08/25 19:28:28 UTC, 1 replies.
- [PR] [SPARK-59008][K8S] Fix NPE in ExecutorPodsLifecycleManager when pod is deleted between get() calls [spark] - posted by "venkata91 (via GitHub)" <gi...@apache.org> on 2026/08/25 20:40:53 UTC, 4 replies.
- Re: [PR] [SPARK-58994][ML] Fix prediction column metadata in GBTRegressionModel [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/25 20:43:02 UTC, 2 replies.
- [PR] fix(jdbc): make Oracle bare NUMBER scale configurable [spark] - posted by "shoemoney (via GitHub)" <gi...@apache.org> on 2026/08/25 20:50:30 UTC, 2 replies.
- [PR] [SPARK-59009][SQL] Re-map outputOrdering in InMemoryRelation.newInstance() [spark] - posted by "james-willis (via GitHub)" <gi...@apache.org> on 2026/08/25 21:38:47 UTC, 11 replies.
- [PR] [SPARK-59010][CORE] Expose the application hold status through the REST API [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/25 21:39:50 UTC, 5 replies.
- [PR] [SPARK-XXXXX][SQL] Reject a data column that hides a captured metadata column during DSv2 refresh validation [spark] - posted by "yyanyy (via GitHub)" <gi...@apache.org> on 2026/08/25 23:17:31 UTC, 0 replies.
- [PR] [SPARK-59012][SQL] Improve test coverage for SupportsRuntimeCatalystFiltering [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/08/25 23:49:38 UTC, 3 replies.
- [PR] [SPARK-59013][PYTHON] Remove redundant Python 3 boilerplate in PySpark serializers [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/25 23:53:28 UTC, 3 replies.
- [PR] [WIP][SPARK-XXXXX][SQL] Rebind refreshed DSv2 relations to the current table schema [spark] - posted by "yyanyy (via GitHub)" <gi...@apache.org> on 2026/08/26 00:17:39 UTC, 0 replies.
- [PR] [SPARK-59016][SQL] Keep CHAR/VARCHAR through SimplifyCasts, V2 prune, and inventory [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/08/26 01:14:35 UTC, 5 replies.
- [PR] [SPARK-59017][INFRA] Merge script skips or hangs at the Fix Version prompt when no version can be inferred [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/08/26 01:15:31 UTC, 2 replies.
- [PR] [SPARK-58926] Driver pod SPARK_USER should reflect --proxy-user [spark-kubernetes-operator] - posted by "otterc (via GitHub)" <gi...@apache.org> on 2026/08/26 01:55:45 UTC, 6 replies.
- [PR] [SPARK-XXXXX][SQL] Add variant_array_length expression [spark] - posted by "WangGuangxin (via GitHub)" <gi...@apache.org> on 2026/08/26 02:13:28 UTC, 0 replies.
- [PR] [WIP][GRAPHFRAMES] Add GraphFrames as an in-tree Spark module [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/26 03:06:57 UTC, 0 replies.
- Re: [PR] [SPARK-58964][ML] Consolidate vector and matrix UDT column conversion [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/26 03:27:32 UTC, 1 replies.
- Re: [PR] [SPARK-58977][SS][PYTHON] Handle state server shutdown before Python connects [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/08/26 04:05:48 UTC, 2 replies.
- Re: [PR] [SPARK-58993][ML] Use Java HashMap for CountVectorizer vocabulary lookup [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/26 04:25:41 UTC, 5 replies.
- Re: [PR] [SPARK-40259][SQL] Support merging equivalent DataSource V2 scans in MergeSubplans [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/26 05:38:05 UTC, 3 replies.
- Re: [PR] [SPARK-58601][PYTHON][TESTS][4.0] Guard mapInPandas/mapInArrow list-return tests with the legacy acceptAnyIterable flag [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/26 06:59:10 UTC, 1 replies.
- [PR] [SPARK-59020][SQL] Support DSv2 Parquet shredded Variant predicate pushdown [spark] - posted by "WangGuangxin (via GitHub)" <gi...@apache.org> on 2026/08/26 07:03:24 UTC, 1 replies.
- [PR] [SPARK-58601][PYTHON][TESTS][4.1] Guard mapInPandas/mapInArrow list-return tests with the legacy acceptAnyIterable flag [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/26 07:04:58 UTC, 2 replies.
- [PR] [SPARK-58601][PYTHON][TESTS][4.2] Guard mapInPandas/mapInArrow list-return tests with the legacy acceptAnyIterable flag [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/26 07:05:01 UTC, 2 replies.
- [PR] [SPARK-58581][PS][FOLLOWUP] Fix NumPy floor_divide rounding and integer precision [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/26 08:05:13 UTC, 6 replies.
- Re: [PR] [SPARK-58767][SQL]. Fixing the canonicalization of TableCacheQueryStageExec,… [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/08/26 08:14:51 UTC, 4 replies.
- Re: [PR] [WIP][POC][GRAPHFRAMES] Add GraphFrames as an in-tree Spark module [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/26 08:35:58 UTC, 4 replies.
- [PR] [SPARK-59021] Add scg-store-memory and scg-pool-static crates [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/08/26 08:41:07 UTC, 2 replies.
- [I] [PYTHON][PANDAS API ON SPARK] pandas-on-Spark floordiv returns incorrect results for unrepresentable quotients and int64 above 2^53 [spark] - posted by "kokhlo (via GitHub)" <gi...@apache.org> on 2026/08/26 09:59:20 UTC, 2 replies.
- [PR] [SPARK-58932][SS][4.2] Close the accepted socket in TransformWithStateInPySparkStateServer [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/08/26 10:06:28 UTC, 4 replies.
- [PR] [SPARK-58932][SS][4.1] Close the accepted socket in TransformWithStateInPySparkStateServer [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/08/26 10:06:44 UTC, 2 replies.
- [I] [K8S] Executor pods cannot access --files uploaded to S3 via spark.kubernetes.file.upload.path [spark] - posted by "WonYong-Jang (via GitHub)" <gi...@apache.org> on 2026/08/26 11:47:13 UTC, 0 replies.
- Re: [PR] [SPARK-59018][SQL] Add variant_array_length expression [spark] - posted by "WangGuangxin (via GitHub)" <gi...@apache.org> on 2026/08/26 11:54:32 UTC, 0 replies.
- [PR] [SPARK-59022][SQL] Keyed shuffle must follow the declared partition key order [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/08/26 13:07:20 UTC, 5 replies.
- [PR] [SPARK-58985][CORE] Fix HistoryServerDiskManager double-counting store size on concurrent release and makeRoom [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/26 14:01:14 UTC, 3 replies.
- [PR] [SPARK-59023][SQL] Support none mode in spark.sql.ui.explainMode to skip plan description in SQL events [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/26 14:54:28 UTC, 4 replies.
- Re: [PR] [SPARK-58917][SQL] Add option to respect `inferSchema` when reading CSV as variant [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/26 15:00:22 UTC, 2 replies.
- [PR] [SPARK-59024][SQL] Support sequential cached name for anonymous cached tables [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/26 15:22:39 UTC, 4 replies.
- Re: [PR] [SPARK-47672][SQL][PYTHON] Mark PythonUDF expensive to avoid double evaluation [spark] - posted by "psavalle (via GitHub)" <gi...@apache.org> on 2026/08/26 15:39:07 UTC, 3 replies.
- [PR] [SPARK-59025][SQL] Fix subset join key grouping when the keyed side reports a PartitioningCollection [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/26 16:13:18 UTC, 11 replies.
- [PR] [SPARK-59026][SQL] Propagate isNarrowed in KeyedPartitioning.toGrouped and KeyedShuffleSpec.createPartitioning [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/26 16:23:30 UTC, 7 replies.
- [PR] [SPARK-58814][SQL] Cover CHAR/VARCHAR round-trips and stop ORC truncating scans [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/08/26 16:58:18 UTC, 5 replies.
- [PR] [SPARK-59027][SQL] Ensure `createShuffleSpec` and `GroupPartitionsExec` sort grouped partition keys identically [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/26 17:09:03 UTC, 2 replies.
- Re: [PR] [SPARK-59016][SQL] Expand CHAR/VARCHAR leak inventory to nested shapes [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/08/26 17:36:42 UTC, 1 replies.
- [PR] [SPARK-58582][PS][FOLLOWUP] Keep integral operands in integer space for NumPy fmod [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/26 18:28:06 UTC, 4 replies.
- [PR] [SPARK-56889][PYTHON][DOCS][FOLLOWUP] Note Python 3.10 support drop in the migration guide [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/26 18:45:30 UTC, 1 replies.
- Re: [PR] [SPARK-59027][SQL] Share grouped partition key ordering between `createShuffleSpec` and `GroupPartitionsExec` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/26 18:46:37 UTC, 4 replies.
- [PR] [SPARK-59030][SQL] Support DSv2 Join pushdown for DB2 connector [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/08/26 19:12:43 UTC, 0 replies.
- [PR] [SPARK-59031][CONNECT][PYTHON] Support best-effort commands that no-op on servers missing the API [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/26 20:31:08 UTC, 0 replies.
- Re: [PR] [SPARK-59017][INFRA] Prevent merge script skipping or hanging at the Fix Version prompt when no version can be inferred [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/08/26 20:34:01 UTC, 2 replies.
- [PR] [SPARK-59019][SQL] Make RewriteWithExpression non-excludable [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/08/26 20:45:04 UTC, 6 replies.
- [PR] [SPARK-58987][INFRA][FOLLOWUP] Stop the arrow-python-udf parity file hanging on CI [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/26 20:52:09 UTC, 0 replies.
- [PR] [SPARK-58987][INFRA][FOLLOWUP] Publish coverage badges at the badges-branch root [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/26 21:43:44 UTC, 0 replies.
- [PR] [MINOR][PYTHON] Coerce the JVM error message to str in ArrowCollectSerializer.load_stream [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/26 23:03:05 UTC, 0 replies.
- Re: [PR] [SPARK-59033][INFRA][DOCS] Coverage badges at branch root + fix udfs page rendering [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/26 23:46:41 UTC, 0 replies.
- [PR] [SPARK-59034][INFRA] Use connect-rust-* fix versions in merge_connect_rust_pr.py [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/27 00:01:33 UTC, 1 replies.
- Re: [PR] [SPARK-59012][SQL] Improve SupportsRuntimeCatalystFiltering test coverage and reject nested filter attributes [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/08/27 00:13:35 UTC, 5 replies.
- [PR] [MINOR][INFRA][DOCS] Fix coverage badges (root publish + Rust 0.0% parser) and the UDFs page [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/27 00:49:57 UTC, 0 replies.
- Re: [PR] [MINOR][INFRA] Fix Rust coverage badge stuck at 0.0% (wrong llvm-cov JSON key) [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/27 01:06:07 UTC, 0 replies.
- [PR] [MINOR][INFRA] Fix coverage badge publish aborting at `git checkout badges` [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/27 01:13:59 UTC, 1 replies.
- Re: [PR] Add recursive read for partition [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/27 01:46:39 UTC, 1 replies.
- Re: [PR] [SPARK-56918][CORE] Add ManagedConsumer SPI for shrinkable external storage memory [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/27 01:46:42 UTC, 1 replies.
- Re: [I] Pyspark: `from_json` is missing `MapType` as a type hint for `schema` argument [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/27 01:46:44 UTC, 0 replies.
- Re: [I] UNBOUND_SQL_PARAMETER in pyspark 4.1.1 when using named parameters [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/27 01:46:46 UTC, 0 replies.
- Re: [PR] [SPARK-54586][SQL] Validate UTF-8 when casting Binary to String [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/27 01:46:48 UTC, 1 replies.
- [PR] [MINOR] Remove unused Rust imports and redundant StandardScalerModel fields [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/27 01:54:23 UTC, 2 replies.
- [PR] [FOLLOWUP][ML] Avoid intermediate collections in CountVectorizer transform [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/27 02:37:43 UTC, 0 replies.
- [PR] [SPARK-58846][CONNECT][PYTHON][FOLLOWUP] Preserve RpcDeadlines positional arguments [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/27 02:39:59 UTC, 4 replies.
- [PR] [FOLLOWUP][ML] Validate effective CountVectorizer DF range [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/27 02:55:20 UTC, 0 replies.
- [PR] [SPARK-58856][ML][FOLLOWUP] Assign tree leaf indices in place [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/27 03:02:14 UTC, 1 replies.
- [PR] [SPARK-59036][SQ] Support codegen for array_sort when it is default comparator [spark] - posted by "WangGuangxin (via GitHub)" <gi...@apache.org> on 2026/08/27 03:36:22 UTC, 0 replies.
- Re: [PR] [SPARK-59032][CORE] Apply gRPC keepalive so a wedged Connect stream recovers instead of hanging [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/27 03:36:56 UTC, 0 replies.
- [PR] [SPARK-59037][CORE] Apply the gRPC max message size (raise tonic's 4 MiB default) [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/27 03:47:38 UTC, 4 replies.
- [PR] [SPARK-58856][ML][FOLLOWUP] Assign leaf indices during tree construction [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/27 04:06:40 UTC, 0 replies.
- [PR] [SPARK-59038][ML] Avoid unused broadcasts when transform has no output columns [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/27 04:16:10 UTC, 2 replies.
- [PR] Revert "[SPARK-58856][ML] Avoid per-leaf map for tree predictions" [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/27 05:34:27 UTC, 2 replies.
- [PR] [SPARK-59040][SQL] Assign a name to the error condition `_LEGACY_ERROR_TEMP_1166,1167` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/27 05:40:37 UTC, 8 replies.
- [PR] [BUILD] Extract common build env setup into composite action [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/08/27 06:37:32 UTC, 0 replies.
- [PR] [SPARK-59045][SQL] Fix SPJ throw ClassCastException with different data type transforms [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/08/27 06:45:43 UTC, 2 replies.
- [PR] [SPARK-59046] Add scg-store-redis and scg-healthcheck crates [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/08/27 07:02:04 UTC, 2 replies.
- Re: [PR] [SPARK-58441][SQL] Fix wrong results in instr and substring_index for ICU collations caused by inconsistent StringSearch iteration [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/08/27 07:09:35 UTC, 0 replies.
- Re: [PR] [SPARK-58392][SQL] Use loadTable for RelationCatalog reads with table-state options [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/27 07:40:22 UTC, 2 replies.
- [PR] [SPARK-59048][ML] Reduce classification transform closure sizes [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/27 08:09:49 UTC, 1 replies.
- [PR] [SPARK-59011][PS] Fix descending rank first tie ordering [spark] - posted by "namviet157 (via GitHub)" <gi...@apache.org> on 2026/08/27 09:09:56 UTC, 3 replies.
- [PR] [SPARK-58974][SQL] Apply the narrowed-partitioning skew guard regardless of requireAllClusterKeysForDistribution [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/08/27 09:15:16 UTC, 12 replies.
- Re: [PR] [SPARK-59045][SQL] Fix SPJ ClassCastException when reducer changes partition key data type [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/08/27 12:15:58 UTC, 16 replies.
- [PR] [SPARK-59050][SQL] SPJ one-side shuffle with out-of-set keys produces wrong results in multi-joins [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/08/27 12:32:02 UTC, 12 replies.
- [PR] [SPARK-57205][SQL] Declare SCAN_MERGING on the built-in file sources [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/27 13:26:56 UTC, 21 replies.
- [PR] [SPARK-59052][ML] Reduce LinearSVCModel transform closure size [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/27 13:46:39 UTC, 0 replies.
- Re: [PR] [SPARK-52589][K8S] Prune `schedulerKnownNewlyCreatedExecs` entries unknown to the scheduler backend [spark] - posted by "zahed1994 (via GitHub)" <gi...@apache.org> on 2026/08/27 13:59:48 UTC, 0 replies.
- [PR] [MINOR][INFRA] Allow "Squash and merge" only [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/08/27 14:05:07 UTC, 6 replies.
- [PR] [SPARK-58910][K8S] Keep the executor pod template's service account [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/27 14:17:13 UTC, 3 replies.
- [PR] [SPARK-59054][CORE][SQL] Fix KeyGroupedPartitioner to compare partition keys by value in storage-partitioned join shuffles [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/27 14:39:50 UTC, 5 replies.
- [PR] [SPARK-59055][CORE] Report the application hold status to Spark Master [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/27 14:52:31 UTC, 8 replies.
- Re: [PR] [SPARK-49580][CONNECT] Add config to limit concurrent executions [spark] - posted by "psavalle (via GitHub)" <gi...@apache.org> on 2026/08/27 15:04:11 UTC, 0 replies.
- [PR] [SPARK-50569][CONNECT]: clean up data cached by individual sessions [spark] - posted by "psavalle (via GitHub)" <gi...@apache.org> on 2026/08/27 15:41:54 UTC, 0 replies.
- [PR] [SPARK-59042][SQL] Fix PushProjectionThroughUnion failure on correlated scalar subquery over UNION ALL [spark] - posted by "zahed1994 (via GitHub)" <gi...@apache.org> on 2026/08/27 16:13:05 UTC, 1 replies.
- [PR] [SPARK-59056][SQL] Pre-size HashSets in ParquetFilters IN/InSet pushdown [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/08/27 16:22:02 UTC, 1 replies.
- [PR] Sqt backport 4.2 [spark] - posted by "fwc (via GitHub)" <gi...@apache.org> on 2026/08/27 16:46:48 UTC, 0 replies.
- [PR] [SPARK-59057][SQL] Make KeyedPartitioning.isNarrowed mean actual key collapse, and rename it to isCollapsed [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/08/27 16:52:53 UTC, 21 replies.
- Re: [PR] [SPARK-59058] Backport SessionQueryTest to Spark 4.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/27 17:14:21 UTC, 4 replies.
- Re: [PR] [SPARK-59055][CORE] Report the application hold status to `Spark Master` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/27 17:28:12 UTC, 5 replies.
- Re: [PR] [SPARK-59054][CORE][SQL] Fix `KeyGroupedPartitioner` to compare partition keys by value in storage-partitioned join shuffles [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/27 17:30:22 UTC, 9 replies.
- [PR] [MINOR][BUILD] Give run-in-container a shebang [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/08/27 17:48:33 UTC, 2 replies.
- [PR] [SPARK-59060][PYTHON] Add missing cpuAmount to the benchmark mock task context [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/08/27 17:58:32 UTC, 3 replies.
- [PR] [SPARK-XXXXX][CORE] Word-at-a-time single-byte search for UTF8String.contains [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/08/27 19:02:09 UTC, 0 replies.
- [PR] [SPARK-58750][CORE][4.3] Tolerate FileAlreadyExistsException from checkpoint part file rename [spark] - posted by "james-willis (via GitHub)" <gi...@apache.org> on 2026/08/27 19:03:18 UTC, 2 replies.
- [PR] [SPARK-59012][SQL][4.3] Improve SupportsRuntimeCatalystFiltering test coverage and reject nested filter attributes [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/08/27 19:05:01 UTC, 4 replies.
- [PR] [SPARK-58750][CORE][4.2] Tolerate FileAlreadyExistsException from checkpoint part file rename [spark] - posted by "james-willis (via GitHub)" <gi...@apache.org> on 2026/08/27 19:13:43 UTC, 2 replies.
- [PR] [SPARK-58750][CORE][4.1] Tolerate FileAlreadyExistsException from checkpoint part file rename [spark] - posted by "james-willis (via GitHub)" <gi...@apache.org> on 2026/08/27 19:13:45 UTC, 2 replies.
- [PR] [SPARK-58750][CORE][4.0] Tolerate FileAlreadyExistsException from checkpoint part file rename [spark] - posted by "james-willis (via GitHub)" <gi...@apache.org> on 2026/08/27 19:13:48 UTC, 2 replies.
- [PR] [SPARK-58750][CORE][3.5] Tolerate FileAlreadyExistsException from checkpoint part file rename [spark] - posted by "james-willis (via GitHub)" <gi...@apache.org> on 2026/08/27 19:13:53 UTC, 2 replies.
- [PR] [SPARK-59061][CORE] Hold and resume an application from the Master UI [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/27 19:43:35 UTC, 4 replies.
- [PR] [SPARK-XXXXX][SQL] Use a byte-length guard in LikeSimplification for 'prefix%suffix' [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/08/27 21:24:53 UTC, 0 replies.
- [PR] [SPARK-59064] Update CI to test K8s 1.37 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/27 21:49:05 UTC, 3 replies.
- [PR] [SPARK-58769][SQL][FOLLOWUP] Clarify the BoundFunction equality contract [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/08/27 22:02:22 UTC, 4 replies.
- [PR] [SPARK-59065][K8S][INFRA] Update K8s IT CI to use K8s 1.37 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/27 22:21:26 UTC, 3 replies.
- Re: [PR] [SPARK-59004][CORE] Use vectorized Arrays.compare for ComparableByteArray/Int/Long.compareTo [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/27 22:36:58 UTC, 1 replies.
- Re: [PR] [SPARK-49634][SQL] Remove the ANSI config suggestion in NUMERIC_VALUE_OUT_OF_RANGE.WITH_SUGGESTION [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/27 22:39:00 UTC, 1 replies.
- [PR] [SPARK-59059][CORE] Support per-logger log level configuration with static Spark conf [spark] - posted by "jzhuge (via GitHub)" <gi...@apache.org> on 2026/08/27 23:47:59 UTC, 0 replies.
- Re: [PR] [SPARK-59032][CORE] Fix arrow-parity hang: bound ReleaseExecute so HTTP/2 streams can't accumulate [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/27 23:51:04 UTC, 0 replies.
- [PR] [SPARK-58553][PS][FOLLOWUP] Do not cast NumPy fmax/fmin results to double [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/27 23:57:52 UTC, 3 replies.
- [PR] [SPARK-58021][CONNECT] Recover abandoned local pool launches [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/08/28 00:20:06 UTC, 0 replies.
- [PR] [SPARK-59066][CORE] Fix History Server Event Log Download button to use a Bootstrap 5 class [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/28 00:30:04 UTC, 1 replies.
- [PR] [SPARK-59067][CORE] Fix `Download` to be a button aligned with the other buttons [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/28 01:25:15 UTC, 4 replies.
- [PR] [SPARK-59068][SQL] Restore support for nested runtime filter attributes [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/08/28 01:29:37 UTC, 12 replies.
- Re: [PR] [SPARK-58912][ML][FOLLOWUP] Avoid intermediate collections in CountVectorizer transform [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/28 01:57:37 UTC, 1 replies.
- Re: [PR] [SPARK-58911][FOLLOWUP][ML] Validate effective CountVectorizer DF range [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/28 01:59:19 UTC, 1 replies.
- Re: [PR] [SPARK-58933][SQL] Resolve expressions in INSERT target IDENTIFIER clauses [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/28 02:21:24 UTC, 2 replies.
- [PR] [SPARK-59047][ML] Avoid retaining random forest tree weights [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/28 02:28:03 UTC, 2 replies.
- Re: [PR] [SPARK-58982][PYTHON] Remove unused _is_namedtuple_ attribute in serializers [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/28 02:33:52 UTC, 0 replies.
- Re: [I] Spark Declarative Pipelines: enable primary key check as expectation [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/28 03:09:10 UTC, 0 replies.
- Re: [PR] [WIP] Fixing PySpark benchmark build & install [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/28 03:09:11 UTC, 1 replies.
- Re: [I] User Defined Functions crash Spark Dataframes created directly, but not for ones made from Pandas on Spark. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/28 03:09:14 UTC, 0 replies.
- Re: [I] Optimizer failure: NormalizeCTEIds brakes CTE references for queries with nested CTEs [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/28 03:09:15 UTC, 0 replies.
- [PR] [SPARK-58933][SQL][4.3] Resolve expressions in INSERT target IDENTIFIER clauses [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/28 03:12:50 UTC, 3 replies.
- [PR] [SPARK-58933][SQL][4.2] Resolve expressions in INSERT target IDENTIFIER clauses [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/28 03:12:58 UTC, 3 replies.
- [PR] [WIP][DO-NOT-MERGE] bisect: revert parity-harness (SPARK-58987 arrow-udf hang) [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/28 03:16:39 UTC, 2 replies.
- [PR] [WIP][DO-NOT-MERGE] bisect: revert vendored-python (SPARK-58987 arrow-udf hang) [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/28 03:18:55 UTC, 2 replies.
- [PR] [WIP][DO-NOT-MERGE] bisect: revert rust-transport (SPARK-58987 arrow-udf hang) [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/28 03:19:15 UTC, 2 replies.
- [PR] [WIP][DO-NOT-MERGE] bisect: revert python drop-in API (SPARK-58987 arrow-udf hang) [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/28 03:19:31 UTC, 2 replies.
- [PR] [WIP][DO-NOT-MERGE] bisect: revert DataType serde (SPARK-58987 arrow-udf hang) [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/28 03:20:22 UTC, 2 replies.
- [PR] [WIP][DO-NOT-MERGE] bisect: old-harness pytest cwd/abs-path (arrow-udf hang) [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/28 03:43:57 UTC, 1 replies.
- Re: [PR] [SPARK-58767][SQL] Fixing the canonicalization of TableCacheQueryStageExec which otherwise prevents re-use of exchange for in memory cached plans [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/08/28 05:11:38 UTC, 3 replies.
- [PR] [WIP][DO-NOT-MERGE] Experiment A: fresh Connect server before parity (SPARK-59032) [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/28 05:20:33 UTC, 2 replies.
- [PR] [WIP][DO-NOT-MERGE] Experiment B: run behavioral e2e in a separate job (SPARK-59032) [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/28 05:20:37 UTC, 2 replies.
- Re: [PR] [SPARK-59032][INFRA] Run behavioral e2e in a separate job so the parity gate gets a clean Connect server [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/28 05:36:17 UTC, 0 replies.
- [PR] [SPARK-59063][SQL] Use byte-length guard in LikeSimplification [spark] - posted by "marcuslin123 (via GitHub)" <gi...@apache.org> on 2026/08/28 05:38:28 UTC, 0 replies.
- [PR] [SPARK-59071][INFRA] Measure Rust coverage against a live Connect server [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/28 05:48:26 UTC, 1 replies.
- [PR] [INFRA] Run resource & artifact tests against a local-cluster Connect server [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/28 06:01:08 UTC, 0 replies.
- [PR] [SPARK-59074] Add scg-pool-k8s crate [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/08/28 06:11:51 UTC, 5 replies.
- [PR] [SPARK-59075][INFRA] Wire e2e_streaming + e2e_new_methods into the coverage job [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/28 06:14:53 UTC, 0 replies.
- [PR] [SPARK-59070][PYTHON][ML] Guard TorchDistributor log socket getpeername() against OSError [spark] - posted by "TomeHirata (via GitHub)" <gi...@apache.org> on 2026/08/28 06:19:59 UTC, 1 replies.
- [PR] [SPARK-59076][INFRA] Fix all Rust compiler warnings and deny warnings in CI [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/28 06:25:16 UTC, 1 replies.
- [PR] [MINOR][DOCS] Document the connect-rust-x.y.z JIRA version convention in AGENTS.md [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/28 06:25:49 UTC, 1 replies.
- [PR] [MINOR][INFRA] Remove accidentally-committed .isaac/ tooling state [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/28 06:26:51 UTC, 1 replies.
- [PR] [MINOR][INFRA] Make the release workflow safe for a direct release [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/28 06:30:41 UTC, 0 replies.
- [I] Adding support in Apache Airflow [spark-kubernetes-operator] - posted by "btealatte (via GitHub)" <gi...@apache.org> on 2026/08/28 07:04:43 UTC, 2 replies.
- [PR] [SPARK-59043][SQL] Fix SimplifyCaseConversionExpressions to preserve Unicode case-conversion semantics [spark] - posted by "AnhTtis (via GitHub)" <gi...@apache.org> on 2026/08/28 07:16:29 UTC, 4 replies.
- [PR] [SPARK-58902][SQL] Evaluate multi-referenced common expressions lazily instead of eager pre-evaluation [spark] - posted by "AnhTtis (via GitHub)" <gi...@apache.org> on 2026/08/28 07:31:20 UTC, 2 replies.
- Re: [PR] [SPARK-58856][ML] Assign leaf indices during tree construction [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/28 07:37:37 UTC, 1 replies.
- [PR] [SPARK-58933][SQL] Address dynamic INSERT review follow-ups [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/28 07:45:54 UTC, 0 replies.
- Re: [PR] [SPARK-59073][INFRA] Run resource & artifact tests against a local-cluster Connect server [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/28 07:49:24 UTC, 0 replies.
- Re: [PR] [SPARK-59075][INFRA] Raise Rust test coverage above 90% [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/28 07:49:56 UTC, 0 replies.
- Re: [PR] [SPARK-59077][INFRA] Make the release workflow safe for a direct release [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/28 07:52:19 UTC, 0 replies.
- [PR] Don't shadow errors or panic on nil [spark-connect-go] - posted by "KastenMike (via GitHub)" <gi...@apache.org> on 2026/08/28 08:04:11 UTC, 1 replies.
- [PR] [SPARK-59078][INFRA] Fix master build broken by a SPARK-59075/59076 semantic conflict [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/28 08:11:04 UTC, 2 replies.
- Re: [PR] [SPARK-59052][ML] Optimize ClassificationModel by reducing closure size and accelerating transform [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/28 08:11:57 UTC, 1 replies.
- [PR] [SPARK-59069][PYSPARK] Transpile Python UDFs with explicit positional-only parameters [spark] - posted by "charliec05 (via GitHub)" <gi...@apache.org> on 2026/08/28 08:17:09 UTC, 1 replies.
- [PR] [SPARK-59072] Close remaining pyspark v4.2.0 public API gaps in the Rust Spark Connect client drop-in [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/28 09:14:25 UTC, 1 replies.
- [PR] [SPARK-49485][CORE] Request additional executor for speculative tasks when active executors equal maxNeeded [spark] - posted by "zahed1994 (via GitHub)" <gi...@apache.org> on 2026/08/28 09:51:15 UTC, 7 replies.
- [PR] [SPARK-59079][CORE] Use Option.when in LiveEntity [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/28 10:33:18 UTC, 0 replies.
- Re: [PR] [SPARK-50593][SQL] SPJ: Support truncate transform via generalized ReducibleFunction API [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/08/28 11:16:12 UTC, 1 replies.
- [PR] [MINOR][ML][TEST] Add tests for vector UDFs with null inputs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/28 12:18:18 UTC, 2 replies.
- [PR] [WIP][SPARK-XXXX][SQL] HiveSessionStateBuilder does not apply injectHintResolutionRule [spark] - posted by "s-maling-celonis (via GitHub)" <gi...@apache.org> on 2026/08/28 12:27:23 UTC, 0 replies.
- [PR] [SPARK-59052][ML][FOLLOWUP] Refine ClassificationModel column expressions and documentation [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/28 13:35:46 UTC, 0 replies.
- [PR] [SQL] Document public configs affecting SQL functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/28 14:02:05 UTC, 0 replies.
- Re: [PR] [SPARK-59066][CORE] Fix History Server Event Log `Download` button to use a Bootstrap 5 class [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/28 14:40:20 UTC, 2 replies.
- Re: [PR] [SPARK-59024][SQL] Use the physical plan id as the cached name for anonymous cached tables [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/28 14:49:25 UTC, 5 replies.
- [PR] [SPARK-59084][CORE] Fix anchors styled as buttons to keep the button hover style [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/28 15:36:44 UTC, 5 replies.
- [PR] [SPARK-59085][CORE] Render the web UI's inline `(kill)`, `(hold)`, and `(resume)` links as buttons [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/28 16:23:18 UTC, 4 replies.
- [PR] [SPARK-59009][SQL][4.1] Re-map outputOrdering in InMemoryRelation.newInstance() [spark] - posted by "james-willis (via GitHub)" <gi...@apache.org> on 2026/08/28 16:34:04 UTC, 3 replies.
- [PR] [SPARK-59009][SQL][4.0] Re-map outputOrdering in InMemoryRelation.newInstance() [spark] - posted by "james-willis (via GitHub)" <gi...@apache.org> on 2026/08/28 16:34:08 UTC, 3 replies.
- Re: [PR] [SPARK-58933][SQL] Simplify and fix parsed INSERT target handling [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/28 16:39:11 UTC, 2 replies.
- [PR] [SPARK-54918][SQL][4.0] Normalize floating numbers in array set operations [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/08/28 20:34:45 UTC, 5 replies.
- [PR] [SPARK-54918][SQL][4.1] Normalize floating numbers in array set operations [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/08/28 20:35:04 UTC, 2 replies.
- [PR] [SPARK-59087][CONNECT] Authenticate before the other gRPC interceptors run- #54 [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/08/28 20:50:55 UTC, 0 replies.
- [PR] [SPARK-52832][SQL][3.5] Fix JDBC dialect identifier quoting [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/08/28 20:54:35 UTC, 5 replies.
- [I] State-store instance metrics are shipped in every task result [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2026/08/28 20:55:49 UTC, 0 replies.
- Re: [I] [SQL] State-store instance metrics are shipped in every task result [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2026/08/28 20:57:20 UTC, 0 replies.
- [PR] [SPARK-59069][PYTHON] Transpile Python UDFs with positional-only params [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/08/28 20:58:04 UTC, 0 replies.
- [PR] [SPARK-55326][CONNECT][FOLLOWUP] Skip exit cleanup after session release [spark] - posted by "RamonZhou (via GitHub)" <gi...@apache.org> on 2026/08/28 21:12:59 UTC, 0 replies.
- Re: [PR] [SPARK-58926][K8S] `SPARK_USER` on Kubernetes driver should honor `--proxy-user` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/28 21:38:29 UTC, 1 replies.
- Re: [PR] [SPARK-58926][K8S] Set the driver pod's `SPARK_USER` from `--proxy-user` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/28 21:43:41 UTC, 0 replies.
- [PR] [SPARK-59092] Honor Retry-After when retrying secondary resource creation on Kubernetes API errors [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2026/08/28 22:09:21 UTC, 4 replies.
- [PR] [SPARK-59093][PS] Fix incorrect results and arithmetic errors in floor division [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/28 22:40:51 UTC, 1 replies.
- [PR] Bump org.mariadb.jdbc:mariadb-java-client from 3.5.7 to 3.5.9 [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/08/28 22:43:55 UTC, 3 replies.
- [PR] [SPARK-59090][SQL] Drop unresolved transpiled Python UDF options [spark] - posted by "charliec05 (via GitHub)" <gi...@apache.org> on 2026/08/28 22:58:39 UTC, 4 replies.
- [PR] [SPARK-59028][PYSPARK] Make UDF category inference linear [spark] - posted by "charliec05 (via GitHub)" <gi...@apache.org> on 2026/08/28 23:04:20 UTC, 1 replies.
- [PR] [SPARK-58969][K8S] Preserve URI fragments for uploaded dependencies [spark] - posted by "charliec05 (via GitHub)" <gi...@apache.org> on 2026/08/28 23:12:00 UTC, 6 replies.
- [PR] [WIP][CORE] Ignore late successes from invalidated barrier shuffle attempts [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/08/28 23:53:26 UTC, 0 replies.
- [PR] [SPARK-55014][SQL] Split projection for expensive filters [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/08/28 23:55:18 UTC, 0 replies.
- Re: [PR] [SPARK-59082][SQL] Document public configs affecting SQL functions [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/08/29 00:01:07 UTC, 1 replies.
- Re: [PR] [SPARK-59094][CORE] Ignore late successes from invalidated barrier shuffle attempts [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/08/29 00:24:40 UTC, 6 replies.
- Re: [PR] [SPARK-56726][CONNECT] Add Dataset.getNumPartitions to Spark Connect client [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/29 00:38:13 UTC, 1 replies.
- Re: [PR] [SPARK-53996][SQL] Improve InferFiltersFromConstraints to infer filters from complex join expressions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/29 00:38:18 UTC, 1 replies.
- [PR] [SPARK-59096] Fully vendor pyspark.pandas with a drift check and keep tests out of the wheel [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/29 03:19:52 UTC, 1 replies.
- [PR] [SPARK-36082][SQL][FOLLOWUP] Keep optimized NAAJ when fallback also broadcasts [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/29 04:57:30 UTC, 2 replies.
- [PR] [SPARK-55294][PYTHON] Add support for PyArrow-backed dtypes in pandas API [spark] - posted by "zahed1994 (via GitHub)" <gi...@apache.org> on 2026/08/29 05:34:37 UTC, 1 replies.
- [PR] [SPARK-59099] Bump master development version to 4.3.0 after cutting branch-4.2 [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/29 06:37:53 UTC, 1 replies.
- [PR] [MINOR][INFRA] Release from a chosen apache upstream branch on manual dispatch [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/29 06:46:05 UTC, 0 replies.
- [PR] [SPARK-59100] Publish release candidates as GitHub pre-releases [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/29 06:47:42 UTC, 2 replies.
- [PR] [SPARK-58969][K8S] Preserve URI fragment aliases for local dependency uploads [spark] - posted by "malware27 (via GitHub)" <gi...@apache.org> on 2026/08/29 07:03:19 UTC, 0 replies.
- Re: [PR] [SPARK-59101][SPARK-59100] Release from a chosen apache upstream branch on dispatch, and publish release candidates as GitHub pre-releases [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/29 07:34:23 UTC, 5 replies.
- [PR] [SPARK-59103] Add scg-proxy crate [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/08/29 07:53:38 UTC, 0 replies.
- [PR] [SPARK-59104] Fix connect-rust fix-version resolution for backport branches in the PR merge script [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/29 08:21:16 UTC, 2 replies.
- [PR] [SPARK-59105][INFRA] Push release tags and GitHub Releases to the apache repo, not the fork [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/29 08:29:18 UTC, 2 replies.
- [PR] [SPARK-59106] Use RELEASE_GITHUB_TOKEN for the release-tag pushes to apache [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/29 08:50:52 UTC, 2 replies.
- Re: [PR] [SPARK-56907][SQL] Fail fast instead of an unkillable spin when skipping truncated DELTA_LENGTH_BYTE_ARRAY pages [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/08/29 12:36:26 UTC, 0 replies.
- [PR] [SPARK-59097][SQL] Null-check nested values in UnsafeProjection codegen [spark] - posted by "joelrobin18 (via GitHub)" <gi...@apache.org> on 2026/08/29 12:54:00 UTC, 2 replies.
- [PR] [SPARK-59098][SQL] Format decimal arguments in format_string/printf as java.math.BigDecimal [spark] - posted by "joelrobin18 (via GitHub)" <gi...@apache.org> on 2026/08/29 12:57:51 UTC, 0 replies.
- [PR] [SPARK-59108][SQL] Fix Avro positional matching under column pruning [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/29 14:12:09 UTC, 2 replies.
- [PR] [SPARK-59111][CORE] Add libbid Java support [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/08/29 14:50:21 UTC, 2 replies.
- [PR] [SPARK-59107][SQL] Do not widen a projection-sensitive V1 file read [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/29 15:18:58 UTC, 4 replies.
- [PR] [SPARK-59068][4.3][SQL] Restore support for nested runtime filter attributes [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/08/29 16:00:32 UTC, 6 replies.
- [PR] [SPARK-59112][SQL] Treat CHAR/VARCHAR as string family at exact StringType matches [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/08/29 19:52:18 UTC, 1 replies.
- Re: [PR] [SPARK-56966][SPARK-56967][CORE] Auto-create missing event log directories [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/30 00:45:59 UTC, 1 replies.
- Re: [PR] [WIP][SQL] DSv2 Write Timing Metrics [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/30 00:46:04 UTC, 1 replies.
- Re: [PR] [SPARK-56940][SQL] Extend OptimizeRand optimizer to support arithmetic expressions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/30 00:46:08 UTC, 1 replies.
- [PR] [SPARK-59117][PYTHON] Set __module__ on the PyO3 classes to the reference pyspark path [spark-connect-rust] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/08/30 01:46:14 UTC, 3 replies.
- [PR] [SPARK-59118][SQL] Error when doAs is used and not supported [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/08/30 04:28:06 UTC, 0 replies.
- [PR] [WIP][SPARK-59114][SQL] ClassCastException while CachedRDDBuilder builds the buffers, with vectorized read flag toggled [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2026/08/30 06:02:38 UTC, 0 replies.
- [PR] [SPARK-46306][PS] Fix LocIndexer to raise KeyError when index keys ar… [spark] - posted by "caotranbadat2011 (via GitHub)" <gi...@apache.org> on 2026/08/30 11:10:29 UTC, 5 replies.
- [PR] [SPARK-48685][ML] Fix MinHashLSH to handle empty sparse vectors without crashing [spark] - posted by "ngtanvan (via GitHub)" <gi...@apache.org> on 2026/08/30 11:16:53 UTC, 1 replies.
- Re: [PR] [SPARK-46306][PS] Fix `LocIndexer` to work properly when the key is missing [spark] - posted by "caotranbadat2011 (via GitHub)" <gi...@apache.org> on 2026/08/30 11:28:51 UTC, 1 replies.
- [PR] [SPARK-57462][PYTHON][SQL] Add PySpark support for nanosecond-precision timestamp types [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/08/30 13:46:43 UTC, 0 replies.
- [PR] [SPARK-59122][SQL] Take UnionExec's plain-union decision once instead of re-deriving it per caller [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/30 16:00:21 UTC, 0 replies.
- Re: [PR] [SPARK-49933][SQL] Push WHEN NOT MATCHED BY SOURCE predicates to target [spark] - posted by "Visorgood (via GitHub)" <gi...@apache.org> on 2026/08/30 18:57:22 UTC, 2 replies.
- [PR] [SPARK-59120][SQL] Fix ClassCastException in a storage-partitioned join whose partition keys were reduced [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/08/30 19:18:38 UTC, 4 replies.
- [PR] [SPARK-59123][SQL] Avoid per-key intermediate collections in KeyedPartitioning.projectKeys and reduceKeys [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/08/30 20:09:59 UTC, 1 replies.
- Re: [PR] [SPARK-59063][SQL] Use a byte-length guard in LikeSimplification for 'prefix%suffix' [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/08/30 23:38:43 UTC, 1 replies.
- Re: [PR] [SPARK-53053][PYTHON][PANDAS] Support Pandas Extension Properties [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/31 00:46:56 UTC, 1 replies.
- Re: [PR] [SPARK-56952][CORE] Preserve heartbeat timeout executor loss reason [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/31 00:46:58 UTC, 1 replies.
- [PR] [WIP][GRAPHX] Prototype GraphFrames GraphX fork changes [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/08/31 02:54:14 UTC, 0 replies.
- [PR] [WIP][SPARK-59124][CORE][K8S] Support spark.kubernetes.files. avoidDownloadSchemes for K8s cluster mode [spark] - posted by "WonYong-Jang (via GitHub)" <gi...@apache.org> on 2026/08/31 02:56:46 UTC, 0 replies.
- [PR] [Draft][SQL] Rewrite existence-only inequality self-joins as COUNT(DISTINCT) [spark] - posted by "hhr293 (via GitHub)" <gi...@apache.org> on 2026/08/31 03:12:04 UTC, 0 replies.
- [PR] [SPARK-58000][CONNECT][SS][TESTS] Mitigate flakiness between `streaming query listener` and `listener event` in `ClientStreamingQuerySuite` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/08/31 05:26:12 UTC, 2 replies.
- [PR] [SPARK-57900][K8S][TESTS] Add OIDC credential propagation E2E tests on Minikube with moto [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/08/31 06:13:44 UTC, 0 replies.
- Re: [PR] [SPARK-59125][CONNECT] Skip exit cleanup after session release [spark] - posted by "RamonZhou (via GitHub)" <gi...@apache.org> on 2026/08/31 06:55:32 UTC, 0 replies.
- [PR] [SPARK-58790][PS][FOLLOWUP] Fix NumPy modf on a DataFrame with no columns [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/31 07:28:27 UTC, 2 replies.
- [PR] [SPARK-57130][BUILD][FOLLOWUP] make-distribution.sh copies the generated pyspark.zip into the distribution [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/08/31 08:04:57 UTC, 5 replies.
- [PR] [SPARK-58837][CONNECT] Use per-module Python loggers [spark] - posted by "psavalle (via GitHub)" <gi...@apache.org> on 2026/08/31 08:17:35 UTC, 1 replies.
- Re: [PR] [SPARK-59124][CORE][K8S] Support `spark.kubernetes.files.avoidDownloadSchemes` for K8s Cluster Mode [spark] - posted by "WonYong-Jang (via GitHub)" <gi...@apache.org> on 2026/08/31 09:20:57 UTC, 0 replies.
- Re: [PR] [SPARK-58967][K8S] Use FQDN with configurable cluster domain for driver hostname [spark] - posted by "shazebkhan1 (via GitHub)" <gi...@apache.org> on 2026/08/31 09:23:40 UTC, 0 replies.
- [PR] [SPARK-46306][PS] Fix LocIndexer to raise KeyError when index keys are missing [spark] - posted by "caotranbadat2011 (via GitHub)" <gi...@apache.org> on 2026/08/31 09:37:34 UTC, 1 replies.
- [PR] [SPARK-59120][SQL][4.2] Fix ClassCastException in a storage-partitioned join whose partition keys were reduced [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/08/31 10:38:15 UTC, 4 replies.
- [PR] [SPARK-59128][BUILD] Upgrade mariadb-java-client from 3.5.7 to 3.5.10 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/08/31 11:48:39 UTC, 0 replies.
- Re: [PR] [SPARK-59129][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_2033 [spark] - posted by "dkling-it (via GitHub)" <gi...@apache.org> on 2026/08/31 13:33:36 UTC, 3 replies.
- [PR] [SPARK-59133][PYTHON][TESTS] Add tests for pa.Table.from_pandas [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/31 18:34:25 UTC, 1 replies.
- Re: [PR] [SPARK-59068][4.3][SQL] Correct runtime filter attribute handling [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/08/31 19:21:14 UTC, 0 replies.
- Re: [PR] [SPARK-36082][SQL][FOLLOWUP] Preserve NAAJ broadcast fallback behavior [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/08/31 19:26:43 UTC, 1 replies.
- [PR] [SPARK-59134][PS] Use native Spark function for NumPy frexp [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/08/31 19:32:54 UTC, 1 replies.
- [PR] ®[WIP][CONNECT][PYTHON] Handle metadata in command response streams [spark] - posted by "haoyangeng-db (via GitHub)" <gi...@apache.org> on 2026/08/31 20:15:23 UTC, 0 replies.
- [PR] [SPARK-58601][PYTHON][FOLLOWUP] Default mapInBatch acceptAnyIterable to true [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/08/31 20:20:48 UTC, 0 replies.
- [PR] [SPARK-59136][CONNECT][PYTHON] Make the active Spark Connect client identifiable (pyspark-client-rust vs the reference client) [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/31 22:08:03 UTC, 4 replies.
- [PR] [SPARK-59137][PYTHON][TESTS] Update offline tests for the reference __module__ on catalog classes and PythonEvalType [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/31 22:26:17 UTC, 2 replies.
- [PR] [SPARK-XXXXX][CORE] Preserve reliably-stored shuffle map outputs on executor loss [spark] - posted by "venkata91 (via GitHub)" <gi...@apache.org> on 2026/08/31 22:54:15 UTC, 0 replies.
- [PR] [SPARK-59118][SQL] Warn when doAs is enabled but not enforced [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/08/31 23:21:11 UTC, 0 replies.
- [PR] [SPARK-59139][CORE] Fix Rust client connection to TLS + token-auth Spark Connect servers [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/08/31 23:33:27 UTC, 0 replies.