reviews@spark.apache.org, 2026-09

You are viewing a plain text version of this content. The canonical link for it is here.

- Re: [PR] [SPARK-58893][UI] Fix Spark UI multi-cluster reverse proxy: propagate… [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/09/01 00:09:58 UTC, 32 replies.
- Re: [PR] [SPARK-59139] Fix Rust client connection to TLS + token-auth Spark Connect servers [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/01 00:10:34 UTC, 1 replies.
- Re: [PR] [SPARK-59082][PYTHON][SQL][DOC] Document public configs affecting SQL functions [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/09/01 00:10:47 UTC, 8 replies.
- Re: [PR] [SPARK-58446][CORE] Prevent late task events from corrupting pending task state [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/09/01 00:11:42 UTC, 0 replies.
- [PR] [SPARK-59139][FOLLOWUP] Reject bearer token sent over a cleartext connection [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/01 00:40:40 UTC, 3 replies.
- Re: [PR] [SPARK-59136][CONNECT] Make the active Spark Connect client identifiable (pyspark-client-rust vs the reference client) [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/01 00:44:27 UTC, 2 replies.
- Re: [PR] [SPARK-59138][CORE] Preserve reliably-stored shuffle map outputs on executor loss [spark] - posted by "venkata91 (via GitHub)" <gi...@apache.org> on 2026/09/01 00:52:35 UTC, 22 replies.
- Re: [PR] [SPARK-59048][ML] Optimize ProbabilisticClassificationModel by reducing closure size and accelerating transform [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/01 01:02:48 UTC, 1 replies.
- Re: [PR] [SPARK-59052][ML][FOLLOWUP] Refine ClassificationModel column expressions and documentation [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/01 01:04:16 UTC, 1 replies.
- Re: [PR] [SPARK-58582][PS][FOLLOWUP] Keep integral operands in integer space for NumPy fmod [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/01 01:06:40 UTC, 1 replies.
- Re: [PR] [SPARK-58790][PS][FOLLOWUP] Fix NumPy modf on a DataFrame with no columns [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/01 01:08:28 UTC, 1 replies.
- Re: [PR] [SPARK-59093][PS] Fix incorrect results and arithmetic errors in floor division [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/01 01:10:27 UTC, 1 replies.
- Re: [PR] [SPARK-59134][PS] Use native Spark function for NumPy frexp [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/01 01:12:00 UTC, 1 replies.
- [PR] [SPARK-XXXXX] Close PySpark 4.2.0 public-API parity gaps in the Rust drop-in [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/01 01:29:55 UTC, 0 replies.
- Re: [PR] [SPARK-58752][CONNECT] Deliver session environment variables to Python UDF workers [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/01 01:34:08 UTC, 1 replies.
- Re: [PR] [SPARK-59045][SQL] Fix SPJ ClassCastException when reducer changes partition key data type [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/09/01 02:16:40 UTC, 11 replies.
- Re: [PR] [SPARK-58730][SQL] Support the ANSI SQL/JSON JSON_ARRAY constructor function [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2026/09/01 02:31:42 UTC, 3 replies.
- Re: [PR] [SPARK-59068][4.3][SQL] Correct runtime filter attribute handling [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/09/01 02:50:08 UTC, 13 replies.
- Re: [PR] [SPARK-59087][CONNECT] Authenticate before the other gRPC interceptors run [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2026/09/01 02:51:20 UTC, 7 replies.
- Re: [PR] [SPARK-58439][BUILD][INFRA] Add dedicated validation script for distributions [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/09/01 02:59:13 UTC, 0 replies.
- [PR] [SPARK-59068][SQL][FOLLOWUP] Validate fully pushed runtime filter attributes [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/09/01 03:05:27 UTC, 5 replies.
- Re: [PR] [SPARK-59128][BUILD] Upgrade mariadb-java-client from 3.5.7 to 3.5.10 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/01 03:22:55 UTC, 2 replies.
- Re: [PR] [SPARK-59040][SQL] Assign a name to the error condition `_LEGACY_ERROR_TEMP_1166,1167` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/01 03:32:22 UTC, 2 replies.
- Re: [PR] [SPARK-59133][PYTHON][TESTS] Add tests for pa.Table.from_pandas [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/01 03:43:21 UTC, 1 replies.
- Re: [PR] [SPARK-57205][SQL] Declare SCAN_MERGING on the built-in file sources [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/01 03:44:42 UTC, 2 replies.
- Re: [PR] [SPARK-59140] Close PySpark 4.2.0 public-API parity gaps in the Rust drop-in [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/01 03:45:30 UTC, 0 replies.
- Re: [PR] [SPARK-58926][K8S] Set the driver pod's `SPARK_USER` from `--proxy-user` [spark] - posted by "otterc (via GitHub)" <gi...@apache.org> on 2026/09/01 04:18:32 UTC, 4 replies.
- Re: [PR] [SPARK-58601][PYTHON][FOLLOWUP] Default mapInBatch acceptAnyIterable to true [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/09/01 04:51:04 UTC, 1 replies.
- Re: [PR] [SPARK-58118][SDP] Allow user-specified AUTO CDC schema to omit the reserved metadata column [spark] - posted by "naveenp2708 (via GitHub)" <gi...@apache.org> on 2026/09/01 04:52:42 UTC, 4 replies.
- [PR] [SPARK-59143] Close remaining PySpark 4.2.0 Spark Connect public-API parity gaps [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/01 05:47:07 UTC, 1 replies.
- Re: [PR] [SPARK-59028][PYTHON] Make UDF category inference linear [spark] - posted by "charliec05 (via GitHub)" <gi...@apache.org> on 2026/09/01 06:00:32 UTC, 4 replies.
- Re: [PR] [SPARK-58969][K8S] Preserve URI fragments for uploaded dependencies [spark] - posted by "charliec05 (via GitHub)" <gi...@apache.org> on 2026/09/01 06:00:34 UTC, 0 replies.
- [PR] [SPARK-59142][CORE] Verify streamId when matching stream fetch responses to callbacks in TransportResponseHandler [spark] - posted by "ChuckLin2025 (via GitHub)" <gi...@apache.org> on 2026/09/01 06:05:30 UTC, 15 replies.
- Re: [PR] [SPARK-59014][SQL] Reject a data column that hides a captured metadata column during DSv2 refresh validation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/01 06:10:59 UTC, 3 replies.
- Re: [PR] [SPARK-58917][SQL] Add option to respect `inferSchema` when reading CSV as variant [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/01 06:13:09 UTC, 8 replies.
- [PR] [SPARK-59019][SQL][4.0] Make RewriteWithExpression non-excludable [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/09/01 06:42:10 UTC, 2 replies.
- Re: [PR] [SPARK-58481][SQL] Fix InSubqueryExec.nullable to account for subquery output nullability [spark] - posted by "anshulbaliga7 (via GitHub)" <gi...@apache.org> on 2026/09/01 06:53:57 UTC, 20 replies.
- [PR] [SPARK-59019][SQL][4.1] Make RewriteWithExpression non-excludable [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/09/01 07:00:26 UTC, 2 replies.
- [PR] [SPARK-59019][SQL][4.2] Make RewriteWithExpression non-excludable [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/09/01 07:08:39 UTC, 2 replies.
- Re: [PR] [SPARK-59057][SQL] Make KeyedPartitioning.isNarrowed mean actual key collapse, and rename it to isCollapsed [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/01 07:15:02 UTC, 4 replies.
- Re: [PR] [SPARK-59103] Add scg-proxy crate [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/01 07:15:17 UTC, 2 replies.
- [PR] [SPARK-59145] Add gateway binary crate [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/01 07:25:15 UTC, 3 replies.
- Re: [PR] [SPARK-57399][CORE][SQL] Local repartition: in-process pipelined channel shuffle for a single executor [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/01 07:28:22 UTC, 18 replies.
- Re: [PR] [SPARK-58203][K8S] Support configuring spark-managed UI service to work with spark.ui.port=0 [spark] - posted by "zhengchenyu (via GitHub)" <gi...@apache.org> on 2026/09/01 07:37:57 UTC, 0 replies.
- Re: [PR] [SPARK-58847][SQL] Collation-aware hash aggregation [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/01 08:10:49 UTC, 1 replies.
- [I] [SQL] Support fallback resolver for unknown V2 catalog names [spark] - posted by "jarredhj0214 (via GitHub)" <gi...@apache.org> on 2026/09/01 08:41:28 UTC, 2 replies.
- Re: [I] [SQL] State-store instance metrics are shipped in every task result [spark] - posted by "Diveyam-Mishra (via GitHub)" <gi...@apache.org> on 2026/09/01 08:55:40 UTC, 0 replies.
- [PR] [SPARK-59141][SQL] Interleave partitions in columnar UnionExec [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/01 09:03:17 UTC, 10 replies.
- Re: [PR] [SPARK-56907][SQL] Fail fast instead of an unkillable spin when skipping truncated DELTA_LENGTH_BYTE_ARRAY pages [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/09/01 09:15:09 UTC, 9 replies.
- Re: [PR] [SPARK-59079][CORE] Use Option.when in LiveEntity [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/01 10:20:10 UTC, 2 replies.
- Re: [PR] [SPARK-53368][SQL] Support reading Parquet TIME data with isAdjustedToUTC=true [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/01 10:42:03 UTC, 25 replies.
- Re: [PR] [SPARK-58775][UI] Fix SQL metrics filter and min,med,max table interaction [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/01 10:48:52 UTC, 1 replies.
- Re: [PR] [SPARK-58970]Add SupportsReportCatalogStatistics to fix computeStats on pre-pushdown DSv2 relations [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/01 10:52:22 UTC, 5 replies.
- Re: [PR] [SPARK-47397][SQL][DOCS] Document that COUNT(DISTINCT) skips nulls [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/01 10:54:16 UTC, 1 replies.
- Re: [PR] [SPARK-58387][SQL] Do not pre-aggregate under an Expand when a duplicate-sensitive aggregate is present [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/01 10:57:25 UTC, 0 replies.
- Re: [PR] [SPARK-58447][CONNECT] Preserve operation tags in Python foreachBatch callbacks [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/01 10:58:28 UTC, 3 replies.
- Re: [PR] [SPARK-58968][SQL] Fix SPJ allowKeysSubsetOfPartitionKeys correctness for non-join operators [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/01 10:59:35 UTC, 5 replies.
- Re: [PR] [SPARK-58793][SQL] Support ANSI SQL `IS [NOT] JSON` predicate [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/01 11:03:21 UTC, 7 replies.
- [PR] [SPARK-59148][PYTHON][CONNECT][TEST][4.0] Skip test_nested_dataframes in the Spark Connect compatibility test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/01 11:17:30 UTC, 3 replies.
- Re: [PR] [SPARK-49485][CORE] Request additional executor for speculative tasks when active executors equal maxNeeded [spark] - posted by "zahed1994 (via GitHub)" <gi...@apache.org> on 2026/09/01 11:21:26 UTC, 5 replies.
- Re: [PR] [SPARK-44462][SS][CONNECT] Fix the session passed to foreachBatch in Spark Connect [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/01 11:24:34 UTC, 8 replies.
- [PR] [SPARK-59121][SQL] Fix wrong results when a storage-partitioned join reduces the partition keys of both sides [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/01 11:39:48 UTC, 8 replies.
- [PR] [SPARK-57242][CORE][4.2] Avoid unbounded page allocation retries after allocator OOM [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/01 11:59:55 UTC, 5 replies.
- [PR] [SPARK-59149][SQL] Use isEmpty instead of size == 0 in OrcUtils [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/01 12:01:28 UTC, 1 replies.
- [PR] [SPARK-59144][SQL] Route plain SQL/JSON constructor calls through routine resolution [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2026/09/01 12:16:58 UTC, 33 replies.
- [PR] [SPARK-55968][SQL] Do not treat vectorized reader capacity overflow as corrupt file exception when ignoreCorruptFiles is enabled [spark] - posted by "zahed1994 (via GitHub)" <gi...@apache.org> on 2026/09/01 12:26:30 UTC, 10 replies.
- [PR] [SPARK-59045][4.2][SQL] Fix SPJ ClassCastException when reducer changes partition key data type [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/09/01 13:02:06 UTC, 2 replies.
- Re: [PR] [SPARK-59098][SQL] Format decimal arguments in format_string/printf as java.math.BigDecimal [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/01 13:03:42 UTC, 20 replies.
- Re: [PR] [SPARK-59086][SPARK-54466][BUILD] Extract common build env setup into composite action [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/09/01 13:22:14 UTC, 4 replies.
- Re: [PR] [SPARK-59036][SQL] Support codegen for array_sort when it is default comparator [spark] - posted by "WangGuangxin (via GitHub)" <gi...@apache.org> on 2026/09/01 13:24:46 UTC, 0 replies.
- Re: [PR] [SPARK-59118][SQL] Warn when doAs is enabled but not enforced [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/01 13:29:15 UTC, 0 replies.
- Re: [PR] [SPARK-59050][SQL] SPJ one-side shuffle with out-of-set keys produces wrong results in multi-joins [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/01 13:32:50 UTC, 48 replies.
- Re: [PR] [WIP][SPARK-57462][PYTHON][SQL] Add PySpark support for nanosecond-precision timestamp types [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/01 13:35:08 UTC, 1 replies.
- Re: [PR] [SPARK-58818][SQL] Fix wrong results from evaluating a common expression once per reference in a conditional branch [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/01 13:37:46 UTC, 11 replies.
- Re: [PR] [SPARK-58892][SQL] Allow DSv2 sources to report advisory Catalyst filters [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/01 13:39:28 UTC, 5 replies.
- Re: [PR] [SPARK-43847][PYTHON] Throw structured error when reading Protobuf descriptor file fails [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/09/01 13:51:13 UTC, 23 replies.
- Re: [PR] [SPARK-59123][SQL] Avoid per-key intermediate collections in KeyedPartitioning.projectKeys and reduceKeys [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/01 14:49:25 UTC, 3 replies.
- Re: [PR] [SPARK-58996][SQL] Fix SPJ partially clustered data correctness when EnsureRequirements re-runs [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/01 14:51:36 UTC, 21 replies.
- Re: [PR] [SPARK-58814][SQL] Cover CHAR/VARCHAR round-trips and stop ORC truncating scans [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/09/01 15:05:22 UTC, 47 replies.
- [PR] [SPARK-59152][ML] Create CountVectorizer broadcast per transform [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/01 15:17:07 UTC, 3 replies.
- [I] docs: Add Spark SQL join examples [spark] - posted by "a18-n03 (via GitHub)" <gi...@apache.org> on 2026/09/01 15:19:34 UTC, 0 replies.
- [PR] [SPARK-59154][ML] Optimize tree classification model transform closures [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/01 15:46:04 UTC, 0 replies.
- Re: [PR] [SPARK-57900][K8S][TESTS] Add OIDC credential propagation E2E tests on Minikube with moto [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/01 15:46:06 UTC, 7 replies.
- Re: [PR] [SPARK-59112][SQL] Treat CHAR/VARCHAR as string family at exact StringType matches [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/09/01 16:16:14 UTC, 7 replies.
- Re: [PR] [SPARK-48685][ML] Fix MinHashLSH to handle empty sparse vectors without crashing [spark] - posted by "tdcmeehan (via GitHub)" <gi...@apache.org> on 2026/09/01 16:16:42 UTC, 5 replies.
- [PR] Spark 59151 [spark] - posted by "aleksandr-chernousov-db (via GitHub)" <gi...@apache.org> on 2026/09/01 16:23:56 UTC, 0 replies.
- Re: [PR] [SPARK-58945][SQL] Fix mismatched `messageParameters` keys that cause `INTERNAL_ERROR` [spark] - posted by "subhramit (via GitHub)" <gi...@apache.org> on 2026/09/01 16:45:11 UTC, 51 replies.
- Re: [PR] [SPARK-49580][CONNECT] Add config to limit concurrent executions [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2026/09/01 17:30:31 UTC, 1 replies.
- [PR] [SPARK-59155] Support `TIME(p)` precision in `createDataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/01 17:36:26 UTC, 3 replies.
- [PR] [SPARK-58735][SQL] Prune nested fields when computing size of an array of structs [spark] - posted by "hemanthboyina (via GitHub)" <gi...@apache.org> on 2026/09/01 17:54:51 UTC, 8 replies.
- Re: [PR] [SPARK-59026][SQL] Propagate isNarrowed in KeyedPartitioning.toGrouped and KeyedShuffleSpec.createPartitioning [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/01 17:55:27 UTC, 3 replies.
- Re: [PR] [SPARK-58645] Add `recursive` flag to `variant_explode` [spark] - posted by "gene-db (via GitHub)" <gi...@apache.org> on 2026/09/01 18:06:03 UTC, 5 replies.
- [PR] [SPARK-59156] Add `MacOS` integration test with Apache Spark `4.3.0` RC1 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/01 18:11:19 UTC, 3 replies.
- Re: [PR] [SPARK-58785][CORE][TESTS] Add tests for FilteredObjectInputStream resolveClass allow-list [spark] - posted by "vrjdev (via GitHub)" <gi...@apache.org> on 2026/09/01 18:18:11 UTC, 11 replies.
- Re: [PR] [SPARK-58111][SQL] Scan and write schema narrowing for column-level UPDATE in DSv2 [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/01 18:23:45 UTC, 10 replies.
- [PR] [SPARK-59157] Upgrade `grpc-swift-2` to 2.4.3 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/01 18:26:42 UTC, 3 replies.
- [PR] [SPARK-59158] Add docs, Helm chart, deployment examples, and Dockerfile [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/01 18:59:33 UTC, 2 replies.
- Re: [PR] fix(jdbc): make Oracle bare NUMBER scale configurable [spark] - posted by "shoemoney (via GitHub)" <gi...@apache.org> on 2026/09/01 19:22:20 UTC, 0 replies.
- Re: [PR] [SPARK-58999][SPARK] Allow a bare error class when it defines sub-classes [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/09/01 19:23:43 UTC, 9 replies.
- [PR] [SPARK-59159] Remove `queriesForSpark4Only` from `SQLTests` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/01 19:34:26 UTC, 3 replies.
- Re: [PR] [SPARK-58000][CONNECT][TESTS] Increase listener events termination ti… [spark] - posted by "kckoh (via GitHub)" <gi...@apache.org> on 2026/09/01 20:09:03 UTC, 1 replies.
- Re: [PR] [SPARK-58752][SQL][PYTHON] Let a session set environment variables for its Python UDF workers [spark] - posted by "RamonZhou (via GitHub)" <gi...@apache.org> on 2026/09/01 20:23:03 UTC, 14 replies.
- [I] Feature: Configurable retry logic [spark] - posted by "a18-n03 (via GitHub)" <gi...@apache.org> on 2026/09/01 21:46:32 UTC, 0 replies.
- Re: [PR] [SPARK-56889][PYTHON][DOCS][FOLLOWUP] Note Python 3.10 support drop in the migration guide [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/09/01 21:56:07 UTC, 1 replies.
- [I] Feature: Add graceful shutdown handler [spark] - posted by "a18-n03 (via GitHub)" <gi...@apache.org> on 2026/09/01 21:59:24 UTC, 0 replies.
- Re: [PR] [DO NOT MERGE] Import Spark Connect Gateway reference implementation [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/01 23:01:12 UTC, 2 replies.
- [PR] [WIP][SPARK-59160][SQL]. Move the currentStageID counter to AdaptiveExecutionCont… [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2026/09/01 23:17:11 UTC, 0 replies.
- [PR] [SPARK-59161] Run the Redis-backed integration tests in CI [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/01 23:22:28 UTC, 2 replies.
- Re: [PR] [SPARK-58892][SQL] Allow DSv2 sources to report inferred Catalyst filters [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/09/01 23:46:53 UTC, 8 replies.
- Re: [PR] [MINOR][NETWORK] Use system default trust managers in SSLFactory when truststore is missing [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/02 00:43:08 UTC, 5 replies.
- Re: [PR] [SPARK-56976][SQL] Support Two-Argument IF(condition, value) Returning NULL [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/02 00:43:11 UTC, 1 replies.
- Re: [PR] [SPARK-56932][SQL] Rewrite top-level single-column NOT IN subqueries with UNION [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/02 00:43:15 UTC, 1 replies.
- [PR] [SPARK-59045][SQL][FOLLOWUP] Fix the subset join key test for the branch-4.3 backport [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/09/02 01:24:02 UTC, 0 replies.
- [PR] [SPARK-59162][ML] Replace BLAS calls with while loops in GBT models [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/02 01:31:26 UTC, 2 replies.
- [PR] [WIP][SPARK-59163][SQL] Reuse projected table-state options [spark] - posted by "yyanyy (via GitHub)" <gi...@apache.org> on 2026/09/02 01:40:04 UTC, 0 replies.
- Re: [PR] [SPARK-58836][WEBUI] Respect UI root when loading thread dump flame graph resources [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2026/09/02 01:45:15 UTC, 2 replies.
- [PR] [WIP][SQL] Split FunctionRegistry initialization into helper methods [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/02 01:46:33 UTC, 0 replies.
- [PR] [SPARK-50758][K8S]Mounts the krb5 config map on the executor pod [spark] - posted by "maomaodev (via GitHub)" <gi...@apache.org> on 2026/09/02 02:31:32 UTC, 1 replies.
- Re: [PR] [SPARK-59163][SQL] Reuse projected table-state options [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/02 03:35:26 UTC, 2 replies.
- Re: [PR] [SPARK-57322][SDP] Implement SCD2 Batch Processor; Reconcile StartAt/EndAt [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/09/02 04:08:32 UTC, 0 replies.
- Re: [PR] [SPARK-57356][SDP] Implement SCD2 Batch Processor; Cleanup Delete Encoding Rows Post-Reconciliation [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/09/02 04:08:57 UTC, 0 replies.
- Re: [PR] [SPARK-57378][SDP] Implement SCD2 Batch Processor; Merge Reconciled Rows into Aux and Target Tables [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/09/02 04:09:02 UTC, 0 replies.
- Re: [PR] [SPARK-57395][SDP] Implement SCD2 Batch Processor; foreachBatch Callback [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/09/02 04:09:06 UTC, 0 replies.
- [PR] [SPARK-59164][SDP] Support nested column schema evolution [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/09/02 04:16:43 UTC, 17 replies.
- Re: [PR] [SPARK-58126][CORE] Support a pluggable root pool comparator via configuration [spark] - posted by "ChrisMuki (via GitHub)" <gi...@apache.org> on 2026/09/02 04:35:04 UTC, 0 replies.
- [PR] [SPARK-59167][CONNECT] Add an end-to-end client benchmark harness (Rust drop-in vs reference PySpark) [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/02 04:36:11 UTC, 1 replies.
- Re: [PR] [SPARK-57659][SQL] Make SchemaPruning idempotent after variant pushdown [spark] - posted by "felipepessoto (via GitHub)" <gi...@apache.org> on 2026/09/02 05:15:33 UTC, 5 replies.
- Re: [PR] [SPARK-58899][BUILD] Upgrade scalapb-runtime from 0.11.17 to 0.11.20 [spark] - posted by "anoopamS (via GitHub)" <gi...@apache.org> on 2026/09/02 05:39:09 UTC, 0 replies.
- Re: [PR] [SPARK-59107][SQL] Do not widen a projection-sensitive V1 file read [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/02 06:10:21 UTC, 2 replies.
- Re: [PR] [SPARK-59045][SQL][4.3][FOLLOWUP] Fix the subset join key test [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/02 07:08:08 UTC, 3 replies.
- Re: [PR] [SPARK-59166][SQL] Split FunctionRegistry initialization into helper methods [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/02 07:14:42 UTC, 1 replies.
- [PR] [SPARK-59168][CORE] Avoid NoSuchElementException on missing keys in KVStore reads and writes [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/09/02 07:24:29 UTC, 15 replies.
- Re: [PR] [SPARK-59108][SQL] Fix Avro positional matching under column pruning [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/02 07:30:33 UTC, 11 replies.
- Re: [PR] [SPARK-58985][CORE] Fix HistoryServerDiskManager double-counting store size on concurrent release and makeRoom [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/09/02 08:35:28 UTC, 6 replies.
- [PR] [SPARK-59169][CORE] Log a warning when KVStoreProtobufSerializer falls back to JSON SerDe [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/09/02 08:42:37 UTC, 15 replies.
- [PR] [SPARK-59170][SQL] Align SQL function groupings across APIs and documentation [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/02 08:51:14 UTC, 0 replies.
- [PR] [SPARK-58968][SQL][4.2] Fix SPJ allowKeysSubsetOfPartitionKeys correctness for non-join operators [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/02 08:52:06 UTC, 3 replies.
- [PR] [SPARK-59172][CORE][TESTS] Use isEmpty instead of size == 0 in core tests [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/02 09:38:27 UTC, 0 replies.
- [PR] [SPARK-59173][ML] Use isEmpty instead of size == 0 in MLlib [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/02 09:47:13 UTC, 0 replies.
- [PR] [SPARK-59107][SQL][4.3] Do not widen a projection-sensitive V1 file read [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/02 09:55:17 UTC, 4 replies.
- Re: [PR] [SPARK-56897][SQL] Reduce per-value allocations in DELTA_BYTE_ARRAY Parquet decoder [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/09/02 09:57:09 UTC, 11 replies.
- [PR] [SPARK-59141][SQL] Columnar UnionExec ignores outputPartitioning and returns wrong results [spark] - posted by "hemanthboyina (via GitHub)" <gi...@apache.org> on 2026/09/02 10:01:30 UTC, 6 replies.
- Re: [PR] [SPARK-59070][PYTHON][ML] Guard TorchDistributor log socket getpeername() against OSError [spark] - posted by "TomeHirata (via GitHub)" <gi...@apache.org> on 2026/09/02 10:01:58 UTC, 2 replies.
- Re: [PR] [SPARK-59149][SQL] Use isEmpty/nonEmpty instead of size comparisons in the SQL modules [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/02 10:36:40 UTC, 4 replies.
- Re: [PR] [SPARK-58443][SQL] Fix wrong results/exception in instr and substring_index for an Integer.MIN_VALUE position or count [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/02 11:21:54 UTC, 1 replies.
- Re: [PR] [SPARK-58866][SQL] Add expression-level entry points to optimizer rules [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/02 11:32:36 UTC, 6 replies.
- [I] Adding delays between JDBC connection retries [spark] - posted by "tmaoz (via GitHub)" <gi...@apache.org> on 2026/09/02 11:45:48 UTC, 0 replies.
- [I] Credential Rotation [spark] - posted by "tmaoz (via GitHub)" <gi...@apache.org> on 2026/09/02 11:49:44 UTC, 1 replies.
- [PR] [SPARK-59174][SS] State-store instance metrics are shipped in every task result [spark] - posted by "Diveyam-Mishra (via GitHub)" <gi...@apache.org> on 2026/09/02 11:57:14 UTC, 10 replies.
- Re: [PR] [SPARK-59122][SQL] Take UnionExec's plain-union decision once instead of re-deriving it per caller [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/02 12:13:39 UTC, 73 replies.
- Re: [PR] [SPARK-58518][SQL] Do not duplicate input paths when globbing is disabled [spark] - posted by "Joorgem (via GitHub)" <gi...@apache.org> on 2026/09/02 12:23:23 UTC, 1 replies.
- Re: [PR] [SPARK-58458][SQL][TESTS] Add coverage for the record split when multiLine is disabled [spark] - posted by "Joorgem (via GitHub)" <gi...@apache.org> on 2026/09/02 12:23:25 UTC, 0 replies.
- Re: [PR] [SPARK-59173][ML] Use isEmpty/nonEmpty instead of size comparisons in MLlib [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/02 12:30:41 UTC, 5 replies.
- Re: [PR] [SPARK-59172][CORE] Use isEmpty/nonEmpty instead of size comparisons in core [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/02 12:30:42 UTC, 5 replies.
- Re: [PR] [SPARK-50758][K8S] Mounts the krb5 config map on the executor pod [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/02 12:38:57 UTC, 9 replies.
- [PR] [SPARK-59147][SQL] Preserve struct nullness when SELECT * EXCEPT drops a nested field [spark] - posted by "Vivek1106-04 (via GitHub)" <gi...@apache.org> on 2026/09/02 12:42:59 UTC, 2 replies.
- Re: [PR] [SPARK-57849][SQL] Support the TIME data type in DataFrame approxQuantile, summary and describe [spark] - posted by "iRakson (via GitHub)" <gi...@apache.org> on 2026/09/02 12:52:24 UTC, 0 replies.
- Re: [PR] [SPARK-58000][CONNECT][SS][TESTS] Mitigate flakiness between `streaming query listener` and `listener event` in `ClientStreamingQuerySuite` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/09/02 13:03:19 UTC, 2 replies.
- Re: [PR] [SPARK-58973][SS] Fix state store batch read failure when StreamingQueryManager is not initialized [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/09/02 13:41:16 UTC, 2 replies.
- Re: [I] [SQL] Stateful operations fail in non-streaming mode when StreamingQueryManager hasn't been initialized [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/09/02 13:43:34 UTC, 0 replies.
- Re: [PR] [SPARK-58876][SQL] Map Oracle DATE and TIMESTAMP to TimestampNTZType [spark] - posted by "aleksandar-trajkovic-db (via GitHub)" <gi...@apache.org> on 2026/09/02 14:18:44 UTC, 5 replies.
- Re: [PR] [SPARK-59063][SQL] Use a byte-length guard in LikeSimplification for 'prefix%suffix' [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/02 14:49:22 UTC, 4 replies.
- [PR] Bump org.apache.thrift:libthrift from 0.16.0 to 0.24.0 [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/09/02 15:00:00 UTC, 2 replies.
- Re: [PR] [SPARK-59171][SQL] Make SchemaPruning idempotent after variant pushdown [spark] - posted by "goutamadwant (via GitHub)" <gi...@apache.org> on 2026/09/02 15:13:22 UTC, 7 replies.
- [PR] [SPARK-59177] Use lower-bound version checks in `SQLTests` and `SparkConnectClientTests` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/02 16:13:10 UTC, 3 replies.
- [PR] [SPARK-56889][FOLLOWUP] Python 3.11 is the minimum version required [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/09/02 16:14:16 UTC, 0 replies.
- [PR] [SPARK-59121][SQL][4.3] Fix wrong results when a storage-partitioned join reduces the partition keys of both sides [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/02 16:18:01 UTC, 3 replies.
- [PR] [SPARK-59121][SQL][4.2] Fix wrong results when a storage-partitioned join reduces the partition keys of both sides [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/02 16:18:04 UTC, 2 replies.
- [PR] [SPARK-59178] Use `Xcode 26.6` in CIs [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/02 16:22:37 UTC, 3 replies.
- [PR] [SPARK-59179] Add `Xcode 27` (Swift 6.4) GitHub Action job [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/02 16:25:11 UTC, 3 replies.
- [PR] [SPARK-59165][SDP] SCD2 Ignore-null support; Introduce version map in `_cdc_metadata` [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/09/02 17:33:53 UTC, 8 replies.
- Re: [PR] [SPARK-49634][SQL] Remove the ANSI config suggestion in NUMERIC_VALUE_OUT_OF_RANGE.WITH_SUGGESTION [spark] - posted by "rpnkv (via GitHub)" <gi...@apache.org> on 2026/09/02 17:52:05 UTC, 5 replies.
- Re: [PR] [SPARK-59184][BUILD] Cleanup remaining references to Python 3.10 or earlier [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/09/02 18:07:41 UTC, 6 replies.
- Re: [I] Upgrades for SparkApp / SparkCluster CRDs [spark-kubernetes-operator] - posted by "crflynn (via GitHub)" <gi...@apache.org> on 2026/09/02 18:14:08 UTC, 1 replies.
- [PR] [SPARK-59185][SQL] Derive a StartsWith prefix filter from leading-literal LIKE patterns [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/02 18:30:17 UTC, 7 replies.
- [PR] [SPARK-59186][PS] Validate NumPy ufunc operand types instead of silently casting them [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/09/02 18:40:23 UTC, 4 replies.
- [PR] [SPARK-59176][SQL] Fix a storage-partitioned join that fails when one side reduced onto no key [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/02 20:24:15 UTC, 7 replies.
- [PR] [SPARK-59189] Run the proxy tracing integration test in CI [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/02 20:49:51 UTC, 2 replies.
- [PR] Bump fast-uri from 3.1.5 to 3.1.7 in /dev [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/09/02 23:44:44 UTC, 2 replies.
- Re: [I] Feature request: inferSchema do not infer digit strings that start with 0 as integer [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/03 00:43:42 UTC, 0 replies.
- Re: [PR] [SPARK-56795][SQL] Reject column types unsupported by the data source on CREATE TABLE / ALTER TABLE [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/03 00:43:44 UTC, 1 replies.
- Re: [PR] [SPARK-52669][PYSPARK] Fix Python executable selection for YARN client mode #51357 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/03 00:43:49 UTC, 1 replies.
- Re: [PR] [SPARK-55077][CORE][K8S] Support `spark.kubernetes.archives.avoidDownloadSchemes` for K8s Cluster Mode [spark] - posted by "xumanbu (via GitHub)" <gi...@apache.org> on 2026/09/03 02:25:06 UTC, 10 replies.
- Re: [PR] [SPARK-57518][SQL][FOLLOWUP] List ThriftServer schemas via SupportsNamespaces instead of special-casing spark_catalog [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/09/03 02:56:33 UTC, 0 replies.
- Re: [PR] [SPARK-55278][SQL] Add scalar external UDF planning support [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/03 03:52:38 UTC, 4 replies.
- [PR] [SPARK-59190] Make `Row.getAsBool` throw instead of trapping on type mismatch [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 04:08:57 UTC, 3 replies.
- [PR] [SPARK-59191] Support `grpc_max_message_size` in connection string [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 04:11:34 UTC, 4 replies.
- [PR] [SPARK-59192] Avoid force casts in `DataFrame.collect` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 04:13:42 UTC, 3 replies.
- [PR] [SPARK-59193] Add `firstOrThrow` to avoid trapping on empty server responses [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 04:52:20 UTC, 3 replies.
- [PR] [SPARK-59194] Use numeric Spark version comparison in tests [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 04:57:24 UTC, 3 replies.
- [PR] [SPARK-59195] Create a gRPC channel per session instead of per RPC [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 05:48:48 UTC, 3 replies.
- [PR] [SPARK-59196] Run the graceful-drain and multi-replica HA smoke examples in CI [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/03 06:23:40 UTC, 2 replies.
- Re: [PR] [SPARK-36082][SQL][FOLLOWUP] Preserve NAAJ broadcast fallback behavior [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/03 06:27:04 UTC, 4 replies.
- [PR] [WIP][PS] Do not widen float32 to float64 in NumPy ufunc results [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/09/03 06:27:18 UTC, 1 replies.
- [PR] [SPARK-59197] Support `TIMESTAMP_NTZ(p)` and `TIMESTAMP_LTZ(p)` nanosecond timestamp types in `DataType` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 07:11:23 UTC, 3 replies.
- [PR] [SPARK-59198] Support nanosecond timestamp values in `DataFrame.collect` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 07:48:33 UTC, 3 replies.
- [PR] [SPARK-33737][K8S] Support getting pod state using Informers + Listers [spark] - posted by "littlexyw (via GitHub)" <gi...@apache.org> on 2026/09/03 08:26:47 UTC, 15 replies.
- Re: [PR] [SPARK-59081][SQL] HiveSessionStateBuilder does not apply injectHintResolutionRule [spark] - posted by "s-maling-celonis (via GitHub)" <gi...@apache.org> on 2026/09/03 08:48:52 UTC, 2 replies.
- Re: [I] [SQL] SchemaPruning is not idempotent when a query reads `_metadata` and a VARIANT column is only referenced below a nondeterministic filter [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/03 09:50:45 UTC, 0 replies.
- Re: [PR] [SPARK-49933][SQL] Push WHEN NOT MATCHED BY SOURCE predicates to target [spark] - posted by "Visorgood (via GitHub)" <gi...@apache.org> on 2026/09/03 09:51:40 UTC, 14 replies.
- Re: [PR] [SPARK-59181][NETWORK] Use system default trust managers in SSLFactory when truststore is missing [spark] - posted by "RinZ27 (via GitHub)" <gi...@apache.org> on 2026/09/03 12:00:03 UTC, 0 replies.
- [PR] [SPARK-59200][STREAMING][TESTS] Simplify redundant boolean comparisons in BlockGeneratorSuite [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/03 12:18:13 UTC, 1 replies.
- [PR] [SPARK-59201][BUILD] Cross-reference the Hadoop fallback version between pom.xml and IsolatedClientLoader [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/03 12:18:18 UTC, 2 replies.
- [PR] [SPARK-59202][ML][TESTS] Enable save/load round-trip tests in Java ML tree suites [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/03 12:36:41 UTC, 3 replies.
- Re: [PR] [SPARK-57462][PYTHON][SQL] Add PySpark support for nanosecond-precision timestamp types [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/03 12:53:52 UTC, 16 replies.
- [PR] [SPARK-59203] Support nanosecond timestamp literals in `lit` and SQL parameter binding [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 14:23:10 UTC, 4 replies.
- [I] Bug: Shuffle partition optimization [spark] - posted by "a18-n03 (via GitHub)" <gi...@apache.org> on 2026/09/03 14:35:27 UTC, 0 replies.
- [I] Docs: Add PromQL examples [spark] - posted by "a18-n03 (via GitHub)" <gi...@apache.org> on 2026/09/03 14:40:17 UTC, 0 replies.
- [I] [SQL] Row-based Parquet reader silently accepts incompatible primitive type conversions [spark] - posted by "Jiayi-Wang-db (via GitHub)" <gi...@apache.org> on 2026/09/03 14:44:37 UTC, 0 replies.
- [PR] [SQL] Reject incompatible Parquet row reader conversions [spark] - posted by "Jiayi-Wang-db (via GitHub)" <gi...@apache.org> on 2026/09/03 14:45:39 UTC, 0 replies.
- Re: [PR] [SPARK-59151][SQL] Add a VariantBuilder.canonicalize primitive for Variant aggregation [spark] - posted by "bojana-db (via GitHub)" <gi...@apache.org> on 2026/09/03 14:48:15 UTC, 15 replies.
- [PR] [MINOR][INFRA][DOCS] Merge conflicting specification of PySpark Python version [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/09/03 14:52:56 UTC, 0 replies.
- [PR] [SPARK-59205] Support `TIMESTAMP_NTZ(p)` and `TIMESTAMP_LTZ(p)` in `createDataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 15:44:43 UTC, 3 replies.
- [PR] Bump browserslist from 4.28.2 to 4.28.8 in /ui-test [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/09/03 15:59:30 UTC, 2 replies.
- [PR] [SPARK-59176][SQL][4.3] Fix a storage-partitioned join that fails when one side reduced onto no key [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/03 16:38:22 UTC, 4 replies.
- [PR] [SPARK-59176][SQL][4.2] Fix a storage-partitioned join that fails when one side reduced onto no key [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/03 16:38:39 UTC, 3 replies.
- [PR] [SPARK-59206] Support hash functions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 16:42:04 UTC, 3 replies.
- Re: [PR] [SPARK-59092] Honor Retry-After when retrying secondary resource creation on Kubernetes API errors [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 16:49:20 UTC, 10 replies.
- [PR] [SPARK-59207] Support predicate functions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 16:58:40 UTC, 3 replies.
- [PR] [SPARK-59209] Support greatest, least, random and try arithmetic functions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 17:00:21 UTC, 0 replies.
- Re: [PR] [SPARK-59209] Support `greatest`, `least`, `random` and `try_*` arithmetic functions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 17:02:01 UTC, 2 replies.
- [PR] [SPARK-59187][SQL] Carry the partition key data types on KeyedPartitioning [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/03 17:11:48 UTC, 3 replies.
- [PR] [SPARK-59210] Support misc metadata functions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 17:27:08 UTC, 3 replies.
- [PR] [SPARK-59211] Support conditional functions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 17:29:40 UTC, 3 replies.
- Re: [PR] [MINOR][INFRA][DOCS] Merge conflicting specification of PySpark Python version in `docs` job [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/09/03 17:34:54 UTC, 3 replies.
- [PR] [SPARK-59212][K8S][INFRA] Pin the Minikube container runtime to `docker` in K8s CI [spark] - posted by "RamonZhou (via GitHub)" <gi...@apache.org> on 2026/09/03 18:10:23 UTC, 5 replies.
- [PR] [SPARK-59213] Support null ordering in sort functions and `Column` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 18:11:01 UTC, 3 replies.
- [PR] [SPARK-59214] Support bitwise functions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 18:15:39 UTC, 3 replies.
- [PR] [SPARK-59068][SQL][FOLLOWUP] Correct runtime filter validation and test fixtures [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/09/03 18:17:41 UTC, 13 replies.
- Re: [PR] [SPARK-57737][SQL] Speed up date_trunc zone offset resolution with a per-task cache [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/03 19:02:51 UTC, 3 replies.
- [PR] [SPARK-59215] Support general aggregate functions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 19:09:05 UTC, 3 replies.
- [PR] [SPARK-59216] Support JSON and CSV functions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 19:10:44 UTC, 3 replies.
- [PR] [SPARK-59217] Support interval and timestamp constructor functions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 19:12:17 UTC, 3 replies.
- Re: [PR] [SPARK-57938][INFRA] Add new `SKIP_` flags to doc build script [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/09/03 19:23:35 UTC, 1 replies.
- Re: [PR] [SPARK-58021][CONNECT] Recover abandoned local pool launches [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/09/03 19:33:17 UTC, 1 replies.
- Re: [PR] [SPARK-59130][SQL] Add `variant_pick` expression [spark] - posted by "ZdravDim (via GitHub)" <gi...@apache.org> on 2026/09/03 19:36:44 UTC, 18 replies.
- [PR] [SPARK-59220] Pin Minikube `container-runtime` to `docker` to fix CI failures with Minikube 1.39.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 19:37:10 UTC, 3 replies.
- [PR] [SPARK-59219][PYTHON] Avoid copying the Series to name it in convert_numpy [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/09/03 19:42:29 UTC, 5 replies.
- [PR] [SPARK-59221] Support linear regression aggregate functions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 20:01:23 UTC, 3 replies.
- [PR] [SPARK-59222] Support XML functions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 20:02:35 UTC, 3 replies.
- Re: [PR] [SPARK-39031][SQL] Match NaN pivot values in PivotFirst [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/09/03 20:23:15 UTC, 0 replies.
- [PR] [SPARK-59208][SDP] SCD2 Ignore-null support; Introduce ignore-null selection in `ChangeArgs` [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/09/03 20:50:32 UTC, 1 replies.
- [PR] [SPARK-53618][SQL] Turn a FULL JOIN with a false condition into a UNI… [spark] - posted by "tokoko (via GitHub)" <gi...@apache.org> on 2026/09/03 20:52:46 UTC, 1 replies.
- [PR] [SPARK-59223] Support VARIANT functions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 20:54:39 UTC, 4 replies.
- [PR] [SPARK-59201] Add an end-to-end workflow running the gateway on kind with a real PySpark client [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/03 21:24:48 UTC, 0 replies.
- [PR] [SPARK-57417][SQL][PYTHON][FOLLOWUP] Fix the `variant_delete` version to 4.3.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 21:37:16 UTC, 4 replies.
- Re: [PR] [SPARK-57417] Add `variant_delete` expression [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 21:39:04 UTC, 0 replies.
- Re: [PR] [SPARK-59163][SQL] Reuse projected options and make CaseInsensitiveStringMap read-only [spark] - posted by "yyanyy (via GitHub)" <gi...@apache.org> on 2026/09/03 21:57:38 UTC, 3 replies.
- [PR] [SPARK-59225] Support URL functions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 22:09:47 UTC, 3 replies.
- [PR] [SPARK-59226] Support geospatial ST functions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 22:10:27 UTC, 3 replies.
- [PR] [SPARK-59227] Support base32 functions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 22:11:26 UTC, 3 replies.
- [PR] [SPARK-59228] Support AES and HMAC functions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 22:14:20 UTC, 3 replies.
- [PR] [SPARK-59230] Upgrade `setup-gradle` GitHub Action to v6.3.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 22:26:02 UTC, 4 replies.
- [PR] [SPARK-59229][CORE] Identify Apache Spark in the User-Agent for Ivy dependency resolution [spark] - posted by "brianf (via GitHub)" <gi...@apache.org> on 2026/09/03 22:27:12 UTC, 0 replies.
- [PR] [SPARK-59231] Use the latest `docker/*` GitHub Actions [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/03 22:41:48 UTC, 5 replies.
- [PR] [SPARK-59232][PS] Support boolean operands in NumPy ufuncs [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/09/04 00:24:52 UTC, 3 replies.
- Re: [PR] [SPARK-58965][SQL][PYTHON] Add gcd and lcm math functions [spark] - posted by "Vivek1106-04 (via GitHub)" <gi...@apache.org> on 2026/09/04 00:31:31 UTC, 9 replies.
- Re: [PR] [SPARK-55427][SQL][DOCS] Add docs for temporal clause [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/04 00:40:21 UTC, 1 replies.
- [PR] [WIP][SQL][PYTHON] Let the session's Python worker environment reach every Python function family [spark] - posted by "RamonZhou (via GitHub)" <gi...@apache.org> on 2026/09/04 00:54:05 UTC, 0 replies.
- [PR] [SPARK-59235] Support error, reflection and bitmap functions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/04 02:18:06 UTC, 3 replies.
- [PR] [SPARK-59236] Support vector functions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/04 02:19:18 UTC, 3 replies.
- [PR] [SPARK-59237] Support `broadcast` function [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/04 02:38:28 UTC, 3 replies.
- [PR] [SPARK-59238] Support partition transform functions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/04 02:45:56 UTC, 3 replies.
- [PR] [SPARK-59239] Support `counter_diff` window function [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/04 02:49:11 UTC, 3 replies.
- [PR] [SPARK-59240] Support `call_function` and `call_udf` functions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/04 03:18:24 UTC, 3 replies.
- [PR] [SPARK-59141][4.2][SQL] Interleave partitions in columnar UnionExec [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/04 03:43:00 UTC, 3 replies.
- [PR] [SPARK-59141][4.1][SQL] Interleave partitions in columnar UnionExec [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/04 03:43:43 UTC, 3 replies.
- [PR] [SPARK-59241] Support Theta, KLL and Tuple sketch functions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/04 03:59:41 UTC, 3 replies.
- Re: [PR] [SPARK-58467][SQL] Add scalar external UDF planning support [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/04 04:00:40 UTC, 1 replies.
- Re: [PR] [SPARK-56922] Direct dispatcher to manage grpc-based udf server. [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/04 04:02:09 UTC, 1 replies.
- Re: [PR] [SPARK-58691] Allow metrics scraping ingress to SparkCluster worker web port [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/04 04:16:51 UTC, 2 replies.
- [PR] [SPARK-59108][SQL][4.3] Fix Avro positional matching under column pruning [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/04 04:43:17 UTC, 7 replies.
- Re: [PR] [Draft][SQL] Rewrite existence-only inequality self-joins as COUNT(DISTINCT) [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/04 05:38:35 UTC, 14 replies.
- [PR] [SPARK-59199][SQL] SPJ: Support runtime partition filtering for more join types [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/09/04 05:48:52 UTC, 12 replies.
- [PR] [SPARK-59119][CONNECT][PYTHON] Do not crash on cyclic or out-of-range cause_idx in error details [spark] - posted by "Eliaaazzz (via GitHub)" <gi...@apache.org> on 2026/09/04 06:36:24 UTC, 2 replies.
- [PR] [SPARK-36082][SQL][FOLLOWUP][4.2] Preserve NAAJ broadcast fallback behavior [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/04 06:50:06 UTC, 3 replies.
- [PR] [SPARK-59188][SQL] Make CatalogV2Util.replace recurse through nested collections [spark] - posted by "Eliaaazzz (via GitHub)" <gi...@apache.org> on 2026/09/04 07:13:50 UTC, 2 replies.
- [PR] [SPARK-59242][SQL] Guard the DAGScheduler cleanup in SQLExecution against a stopped SparkContext [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2026/09/04 07:20:30 UTC, 13 replies.
- [PR] [SPARK-59245] Support HLL sketch and bitmap aggregate functions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/04 07:28:42 UTC, 3 replies.
- [PR] [SPARK-59246] Remove `pi-v1beta1.yaml` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/04 07:30:26 UTC, 2 replies.
- Re: [PR] [SPARK-59224] Add an end-to-end workflow running the gateway on kind with a real PySpark client [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/04 07:33:47 UTC, 1 replies.
- Re: [PR] [SPARK-59154][ML] Optimize decision tree model transform closures [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/04 08:20:54 UTC, 1 replies.
- Re: [PR] [SPARK-53618][SQL] Turn a FULL JOIN with a false condition into a UNION ALL [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/04 08:29:21 UTC, 5 replies.
- [PR] [SPARK-59247][ML] Optimize tree ensemble classification model transform closures [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/04 08:29:29 UTC, 2 replies.
- Re: [PR] [SPARK-58006][SQL][FOLLOWUP] Reject escaping outer refs in forceSkipInline defs [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/09/04 08:30:11 UTC, 6 replies.
- Re: [PR] [SPARK-58950][SQL] Materialize repeated view references as one CTE [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/09/04 08:30:20 UTC, 10 replies.
- Re: [PR] [SPARK-58891][SQL] Reorder Window stacks to minimize exchanges [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/09/04 08:30:33 UTC, 9 replies.
- [PR] [SPARK-59044][SQL] Handle OFFSET 0 in physical planning when EliminateOffsets is excluded [spark] - posted by "hemanthboyina (via GitHub)" <gi...@apache.org> on 2026/09/04 08:39:39 UTC, 1 replies.
- [PR] [SPARK-58944][INFRA][FOLLOWUP] Handle manually completed cherry-picks [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/04 08:50:31 UTC, 2 replies.
- Re: [PR] [SPARK-58485] [SQL] Broadcast hash joins with scalar subquery as join key [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/04 10:22:35 UTC, 1 replies.
- Re: [PR] [SPARK-57926][SQL] Add IPv4 conversion functions [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/04 10:23:49 UTC, 1 replies.
- Re: [PR] [SPARK-58959][SQL] Duplicate PIVOT values corrupt the aggregation buffer on the PivotFirst fast path [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/04 10:34:53 UTC, 10 replies.
- [PR] [SPARK-59248][SQL] Keep storage-partitioned join when partition keys are pruned from the scan output [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/09/04 10:41:45 UTC, 10 replies.
- Re: [PR] [SPARK-58776][K8S] Propagate spark.ssl.rpc.* passwords to executors [spark] - posted by "sweb (via GitHub)" <gi...@apache.org> on 2026/09/04 11:01:31 UTC, 19 replies.
- Re: [PR] [SPARK-58951][SQL] Support non-binary collations in collect_set [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/04 11:59:09 UTC, 2 replies.
- [PR] [SPARK-59249][SQL] Take the grouped key-row ordering from the shared InternalRowComparableWrapper cache [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/04 13:18:44 UTC, 7 replies.
- [PR] [SPARK-59250][SQL] Translate an empty runtime IN filter to AlwaysFalse in DSv2 runtime filtering [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/09/04 13:22:15 UTC, 8 replies.
- [PR] [SPARK-59253][UDF] Fix direct dispatcher interrupt race [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2026/09/04 13:39:55 UTC, 2 replies.
- [PR] [SPARK-57938][DOCS] Print active SKIP_ flags when Ruby doc build script runs [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/09/04 13:56:05 UTC, 3 replies.
- [PR] [SPARK-59080][SQL] Pick one ShuffleSpecCollection member for the SPJ pushdown and the re-shuffle [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/04 16:11:36 UTC, 11 replies.
- [PR] [SPARK-59254] Support higher-order array functions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/04 16:13:06 UTC, 5 replies.
- [PR] [SPARK-59257] Update docker GitHub Actions to the latest ASF-approved hashes [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/04 16:49:25 UTC, 3 replies.
- [PR] [SPARK-59258] Support higher-order map functions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/04 16:53:28 UTC, 3 replies.
- [PR] [SPARK-59259] Upgrade `netty-tcnative` to 2.0.83.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/04 17:09:54 UTC, 2 replies.
- [PR] [SPARK-59260] Index all public functions and types in the DocC catalog [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/04 17:45:23 UTC, 3 replies.
- [PR] [SPARK-59252][SQL] Fix an SPJ scan reporting a different partitioning at execution than at planning [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/04 17:50:37 UTC, 7 replies.
- [PR] [SPARK-59255][SQL] Extend parse_sql to parse SQL batches [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/09/04 18:00:52 UTC, 31 replies.
- [PR] [SPARK-59256][SQL] Remove createPartitioning and numPartitions from ShuffleSpecCollection [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/04 18:14:56 UTC, 0 replies.
- [PR] [SPARK-59262] Add Java 27-ea to GitHub Actions [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/04 18:22:55 UTC, 6 replies.
- [PR] [SPARK-59263] Upgrade `compress-lzf` to 1.2.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/04 18:26:12 UTC, 0 replies.
- [PR] [SPARK-59264] Cache Apache Spark distributions in GitHub Actions jobs [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/04 18:36:45 UTC, 3 replies.
- [PR] [SPARK-59265] Upgrade `spotless-plugin-gradle` to 8.10.1 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/04 19:16:02 UTC, 2 replies.
- [PR] [SPARK-59266] Upgrade Lombok to 1.18.48 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/04 19:16:45 UTC, 3 replies.
- [PR] [SPARK-59267] Upgrade SpotBugs to 4.10.4 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/04 19:17:39 UTC, 3 replies.
- Re: [PR] [SPARK-59259][BUILD] Upgrade `netty-tcnative` to 2.0.83.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/04 19:22:14 UTC, 1 replies.
- [PR] [SPARK-59212][K8S][INFRA] Pin the Minikube container runtime to docker in K8s CI [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/09/04 20:36:39 UTC, 2 replies.
- Re: [PR] [SPARK-58721][K8S][TESTS] Add tests for ClientArguments.fromCommandLineArgs [spark] - posted by "vrjdev (via GitHub)" <gi...@apache.org> on 2026/09/04 20:58:58 UTC, 0 replies.
- Re: [PR] [SPARK-59263][BUILD] Upgrade `compress-lzf` to 1.2.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/04 21:41:02 UTC, 4 replies.
- Re: [PR] [SPARK-59056][SQL] Pre-size HashSets in ParquetFilters IN/InSet pushdown [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/04 21:42:11 UTC, 6 replies.
- [PR] [SPARK-59051][SQL] Compile JDBC partition bounds with the dialect [spark] - posted by "charliec05 (via GitHub)" <gi...@apache.org> on 2026/09/04 23:33:13 UTC, 7 replies.
- [PR] [SPARK-58316][SQL] Reject non-finite decimal casts in ANSI mode [spark] - posted by "charliec05 (via GitHub)" <gi...@apache.org> on 2026/09/04 23:33:14 UTC, 2 replies.
- [PR] [SPARK-58881][CORE] Ignore non-numeric checkpoint part files [spark] - posted by "charliec05 (via GitHub)" <gi...@apache.org> on 2026/09/04 23:33:15 UTC, 9 replies.
- [PR] [SPARK-59270] Run the JWT auth end-to-end walkthrough in CI [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/04 23:36:59 UTC, 2 replies.
- Re: [PR] [SPARK-57104][SQL] Enable schema-level collations by default [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/05 00:40:50 UTC, 1 replies.
- Re: [I] DSv2 spark streaming doesn't support SupportsMetadataColumns [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/05 00:40:58 UTC, 0 replies.
- Re: [PR] [SPARK-56942][SQL] Widen DSv2 row-id resolution to support nested columns [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/05 00:41:02 UTC, 1 replies.
- [PR] [SPARK-59271][PYTHON][TESTS] Add tests for pandas.api.types is_* predicates [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/09/05 00:50:54 UTC, 4 replies.
- Re: [PR] [SPARK-59011][PS] Fix descending rank first tie ordering [spark] - posted by "namviet157 (via GitHub)" <gi...@apache.org> on 2026/09/05 01:08:51 UTC, 3 replies.
- [PR] [SPARK-59108][4.2][SQL] Fix Avro positional matching under column pruning [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/05 03:28:35 UTC, 3 replies.
- [PR] [SPARK-59108][4.1][SQL] Fix Avro positional matching under column pruning [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/05 03:28:40 UTC, 3 replies.
- [PR] [SPARK-59108][4.0][SQL] Fix Avro positional matching under column pruning [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/05 03:28:43 UTC, 2 replies.
- [PR] [SPARK-59273][SQL] Complete CHAR/VARCHAR support at core execution boundaries [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/09/05 05:05:34 UTC, 9 replies.
- Re: [PR] [SPARK-58201][SQL] Optimize sliding window MIN/MAX aggregate function using monotonic deque [spark] - posted by "pavan51 (via GitHub)" <gi...@apache.org> on 2026/09/05 06:51:55 UTC, 9 replies.
- [PR] [SPARK-59261][SQL] Memoize outputPartitioning on the projection and SPJ grouping nodes [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/05 08:02:01 UTC, 13 replies.
- [PR] [SPARK-59279][SQL] Don't re-read the sorted-merge config after GroupPartitionsExec is planned [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/05 10:40:46 UTC, 7 replies.
- [PR] [SPARK-59175][SQL] Extract the whole GROUP BY expression when a select item combines it with a window function [spark] - posted by "hemanthboyina (via GitHub)" <gi...@apache.org> on 2026/09/05 13:14:58 UTC, 1 replies.
- [PR] [SPARK-59274][SQL] Enforce CHAR/VARCHAR semantics in schema-driven text parsing [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/09/05 19:14:40 UTC, 35 replies.
- [PR] [MINOR][SQL] Remove stale "Hash is not implemented" comment for nanosecond timestamp physical types [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/05 21:04:02 UTC, 4 replies.
- [PR] [DOCS][SPARK-56822] Add nanosecond-precision timestamp types to the SQL data types reference table [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/05 21:08:59 UTC, 0 replies.
- [PR] [SPARK-56822][TESTS] Reuse the shared nanosecond truncation helper in timestamp nanos tests [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/05 21:12:08 UTC, 3 replies.
- Re: [PR] [SPARK-56822][DOCS] Add nanosecond-precision timestamp types to the SQL data types reference table [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/05 23:30:07 UTC, 2 replies.
- Re: [PR] [SPARK-57128][SQL][TESTS] SQLQueryTestHelper --SET parser must preserve commas in config values [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/06 00:47:26 UTC, 1 replies.
- Re: [I] Pyspark: `DataFrame` methods behind `is_remote_only()` statically evaluate to `Union` during typechecking [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/06 00:47:30 UTC, 0 replies.
- Re: [PR] [SPARK-57076][SQL] Add session-level default collation support [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/06 00:47:31 UTC, 1 replies.
- Re: [PR] [SPARK-38101][CORE] Retry INTERNAL_ERROR_BROADCAST when fetching map statuses [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/06 00:47:34 UTC, 1 replies.
- Re: [PR] [SPARK-56199][CORE] Read fallback storage blocks asynchronously and multithread [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/06 00:47:36 UTC, 1 replies.
- Re: [PR] [SPARK-19335][SPARK-38200][SQL] Add upserts for writing to JDBC using MERGE INTO with temp table [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/06 00:47:41 UTC, 1 replies.
- [PR] [SPARK-59275][PYTHON] Complete CHAR/VARCHAR support for Python UDFs and Arrow [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/09/06 03:17:47 UTC, 51 replies.
- Re: [PR] [SPARK-58708][SQL] Fix out-of-range length handling in substring/lpad/rpad [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/09/06 05:59:44 UTC, 11 replies.
- Re: [PR] [SPARK-58713][SQL] Fix integer overflow in overlay() position arithmetic [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/09/06 06:05:47 UTC, 12 replies.
- Re: [PR] [SPARK-58897][SQL] Propagate NaN through the infinity norm in vector_norm [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/09/06 06:17:44 UTC, 7 replies.
- Re: [PR] [SPARK-51830][SQL] Fix partition type mismatch when validatePartitionColumns is disabled [spark] - posted by "pratham76 (via GitHub)" <gi...@apache.org> on 2026/09/06 08:14:36 UTC, 8 replies.
- Re: [PR] [SPARK-57769][SQL] Add a config to use the earliest offset for date_trunc at a DST fall-back overlap [spark] - posted by "Licht-T (via GitHub)" <gi...@apache.org> on 2026/09/06 08:23:22 UTC, 0 replies.
- Re: [PR] [SPARK-48701][SQL][PS] Make PandasMode collation-aware [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/06 08:58:48 UTC, 1 replies.
- Re: [PR] [SPARK-58631][SQL] Fix inconsistent array size limit errors in array_repeat and array_insert codegen [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/09/06 09:00:52 UTC, 7 replies.
- [PR] [SPARK-59284][SQL] Read INT64 TIMESTAMP(MICROS) columns as nanosecond timestamps [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/06 10:09:15 UTC, 3 replies.
- [PR] [SPARK-56548][CORE] Replace modulo with bitmask in BloomFilter hot paths [spark] - posted by "Vivek1106-04 (via GitHub)" <gi...@apache.org> on 2026/09/06 10:40:46 UTC, 0 replies.
- Re: [PR] [SPARK-58821][SQL] Return the recomputed length instead of an internal error in Sequence [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/09/06 13:55:58 UTC, 6 replies.
- Re: [PR] [SPARK-59187][SQL] Compare partition key rows at types with the naming erased [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/06 18:14:08 UTC, 8 replies.
- [PR] [SPARK-59285][SQL] Hold a KeyedPartitioning's shared partition layout in one value [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/06 18:29:20 UTC, 15 replies.
- Re: [PR] [SPARK-59281][DOCS] Add nanosecond-precision timestamp types to the SQL data types reference table [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/06 19:59:53 UTC, 1 replies.
- Re: [PR] [SPARK-59282][TESTS] Reuse the shared nanosecond truncation helper in timestamp nanos tests [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/06 20:00:58 UTC, 1 replies.
- [PR] [SPARK-59278][SQL] Fix CHAR comparison rewrite edge cases [spark] - posted by "shivadarshan-devadiga (via GitHub)" <gi...@apache.org> on 2026/09/06 20:48:45 UTC, 11 replies.
- Re: [PR] [SPARK-59256][SQL] Choose a ShuffleSpecCollection member by pairing, not by enumeration order [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/07 00:01:45 UTC, 9 replies.
- Re: [PR] [SPARK-19335][SPARK-38200][SQL] Add upserts for writing to JDBC [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/07 00:46:37 UTC, 1 replies.
- Re: [PR] [SPARK-55469][CORE] Fallback storage reads block data lazily [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/07 00:46:39 UTC, 1 replies.
- Re: [PR] [SPARK-52507][CORE] Attempt to read missing block from fallback storage [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/07 00:46:41 UTC, 1 replies.
- Re: [PR] [SPARK-52506][CORE] Allow migrating to fallback storage only [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/07 00:46:44 UTC, 1 replies.
- [PR] docs: update web documentation and resource links [spark] - posted by "learningworlds (via GitHub)" <gi...@apache.org> on 2026/09/07 01:26:04 UTC, 1 replies.
- [PR] [SPARK-59280][BUILD] Expand and group `sparktestsupport` ignore patterns [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/09/07 01:33:28 UTC, 15 replies.
- Re: [PR] [SPARK-58217][SQL] Fix silent garbage timestamps on decimal-to-timestamp overflow [spark] - posted by "jiangxt2 (via GitHub)" <gi...@apache.org> on 2026/09/07 01:49:37 UTC, 6 replies.
- [PR] [SPARK-57128][SQL][TEST] Preserve commas in SQL test settings [spark] - posted by "zhangxinyao88 (via GitHub)" <gi...@apache.org> on 2026/09/07 02:30:06 UTC, 7 replies.
- Re: [I] Github workflow for scanning CVEs [spark] - posted by "zhangxinyao88 (via GitHub)" <gi...@apache.org> on 2026/09/07 02:54:07 UTC, 0 replies.
- [PR] [SPARK-59286][ML] Optimize NaiveBayesModel transform closures [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/07 04:33:16 UTC, 3 replies.
- [PR] [SPARK-59287][ML] Optimize MultilayerPerceptronClassificationModel transform closures [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/07 05:42:16 UTC, 0 replies.
- [PR] [SPARK-59288][ML] Optimize FMClassificationModel transform closures [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/07 05:56:29 UTC, 0 replies.
- [PR] [SPARK-59048][ML][FOLLOWUP] Correct transform method documentation [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/07 06:19:37 UTC, 2 replies.
- Re: [PR] [SPARK-58996][SQL][4.2] Fix SPJ partially clustered data correctness when EnsureRequirements re-runs [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/09/07 06:36:57 UTC, 3 replies.
- [PR] [SPARK-59290][SS] Disallow the EXCEPT operator which has streaming as left input [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/09/07 08:18:29 UTC, 13 replies.
- [PR] [SPARK-59291][STREAMING] Add @return tags to the public StateSpec methods [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/07 08:29:21 UTC, 3 replies.
- [PR] [SPARK-59080][SQL][4.3] Pick one ShuffleSpecCollection member for the SPJ pushdown and the re-shuffle [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/07 09:05:10 UTC, 2 replies.
- [PR] [SPARK-59080][SQL][4.2] Pick one ShuffleSpecCollection member for the SPJ pushdown and the re-shuffle [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/07 09:05:29 UTC, 2 replies.
- Re: [PR] [SQL] Rewrite existence-only inequality self-joins as COUNT(DISTINCT) [spark] - posted by "hhr293 (via GitHub)" <gi...@apache.org> on 2026/09/07 09:08:57 UTC, 4 replies.
- [PR] [SPARK-59292][CONNECT][PYTHON] Add a client-side deadline to ML cache cleanup RPCs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/07 09:22:21 UTC, 0 replies.
- Re: [PR] [SPARK-58999][CORE] Allow a bare error class when it defines sub-classes [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/07 10:26:14 UTC, 3 replies.
- [PR] [SPARK-59294][SQL] Support partially clustered distribution and skew join split for LeftSingle and ExistenceJoin [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/09/07 10:32:47 UTC, 7 replies.
- [PR] [SPARK-57518][SQL][FOLLOWUP] Disable spark.sql.thriftServer.catalogMetadata.enabled by default [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/09/07 12:49:13 UTC, 6 replies.
- Re: [PR] [SPARK-57737][SPARK-57769][SQL] Speed up date_trunc zone offset resolution with a per-task cache [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/07 13:01:10 UTC, 4 replies.
- Re: [PR] [SPARK-59135][CONNECT][PYTHON] Handle metadata in command response streams [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/07 13:25:43 UTC, 3 replies.
- Re: [PR] [SPARK-59251][SQL] Reject incompatible Parquet row reader conversions [spark] - posted by "Jiayi-Wang-db (via GitHub)" <gi...@apache.org> on 2026/09/07 14:15:37 UTC, 5 replies.
- [PR] [SPARK-59296][CORE] Apply OIDC provider-declared properties on the driver by separating provider selection from credential resolution [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/09/07 14:24:59 UTC, 9 replies.
- [PR] [SPARK-59297][SQL][TESTS] Cover nanosecond precisions 7 and 8 in RowToColumnConverter round-trip tests [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/07 14:50:21 UTC, 3 replies.
- [PR] [SPARK-59300][SQL] Support nanosecond-precision timestamps in from_utc_timestamp and to_utc_timestamp [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/07 15:00:26 UTC, 4 replies.
- [PR] [SPARK-57819][SQL] Support nanosecond-precision timestamps in months_between [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/07 15:07:08 UTC, 3 replies.
- Re: [PR] [SPARK-59129][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_2033 [spark] - posted by "dkling-it (via GitHub)" <gi...@apache.org> on 2026/09/07 15:08:44 UTC, 3 replies.
- [PR] [SPARK-59299][SQL][TESTS] Add missing ASOF JOIN parser unit tests [spark] - posted by "LukaZdravic (via GitHub)" <gi...@apache.org> on 2026/09/07 15:28:20 UTC, 5 replies.
- Re: [PR] [SPARK-59042][SQL] Fix PushProjectionThroughUnion failure on correlated scalar subquery over UNION ALL [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/07 17:30:56 UTC, 4 replies.
- [PR] [SPARK-59293][INFRA] Fix update_build_status.yml to map non-standard conclusions [spark] - posted by "tokoko (via GitHub)" <gi...@apache.org> on 2026/09/07 17:50:28 UTC, 0 replies.
- [PR] [SPARK-59301][SQL] Unwrap the cast of a DSv2 runtime IN filter before pushing it down [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/09/07 18:10:30 UTC, 6 replies.
- [PR] [SPARK-59276][SQL] Preserve CHAR/VARCHAR collations in Spark Connect [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/09/07 20:25:17 UTC, 30 replies.
- [PR] [CONNECT] Include the LICENSE file in the maturin sdist [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/07 22:26:30 UTC, 0 replies.
- [PR] [MINOR][DOCS] Add crates.io + docs.rs badges and a Rust API reference link to the README [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/07 22:42:44 UTC, 1 replies.
- [PR] [SPARK-59303][K8S] Support `spark.kubernetes.executor.resizeMaxMemory` in `ExecutorResizePlugin` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/07 23:11:51 UTC, 6 replies.
- [PR] [SPARK-59304][K8S] Support `spark.kubernetes.executor.pvc.resizeMaxStorageinExecutorPVCResizePlugin` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/07 23:21:02 UTC, 1 replies.
- [PR] [SPARK-59305][CONNECT] Track Apache Spark 4.3.0: retarget CI to the RC, re-vendor upstream, and close 4.3.0 client gaps [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/07 23:26:30 UTC, 2 replies.
- [PR] [SPARK-59277][SQL][HIVE] Support first-class CHAR/VARCHAR in Hive extensions [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/09/07 23:44:12 UTC, 23 replies.
- Re: [PR] [SPARK-57127][SQL]. Fixing the canonicalization of JoinExec nodes as it does… [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/08 00:42:57 UTC, 1 replies.
- Re: [PR] [SPARK-57126][SQL]. Fixing the broken canonicalization of DynamicPruningSubq… [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/08 00:43:01 UTC, 1 replies.
- Re: [PR] [SPARK-57125][SQL] LimitPushDown should fold literal Limit+Offset sum so plan stays planable without ConstantFolding [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/08 00:43:03 UTC, 1 replies.
- Re: [PR] [PYTHON] Improve static typing for methods behind is_remote_only [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/08 00:43:07 UTC, 1 replies.
- Re: [PR] [SPARK-57105][SQL] Fix `StringIndexOutOfBoundsException` in parameterized SQL scripts [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/08 00:43:10 UTC, 1 replies.
- Re: [PR] [SPARK-59302][CONNECT] Include the LICENSE file in the maturin sdist [spark-connect-rust] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/08 00:45:37 UTC, 0 replies.
- Re: [PR] [SPARK-59050][SQL][4.1] SPJ one-side shuffle with out-of-set keys produces wrong results in multi-joins [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/09/08 01:20:30 UTC, 3 replies.
- Re: [PR] [SPARK-59050][SQL][4.0] SPJ one-side shuffle with out-of-set keys produces wrong results in multi-joins [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/09/08 01:20:32 UTC, 3 replies.
- Re: [PR] [SPARK-59050][SQL][4.3] SPJ one-side shuffle with out-of-set keys produces wrong results in multi-joins [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/09/08 02:04:46 UTC, 3 replies.
- Re: [PR] [SPARK-59050][SQL][4.2] SPJ one-side shuffle with out-of-set keys produces wrong results in multi-joins [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/09/08 02:06:14 UTC, 3 replies.
- Re: [PR] [SQL] Support reading Parquet UUID logical type [spark] - posted by "ravikiranpagidi (via GitHub)" <gi...@apache.org> on 2026/09/08 02:30:24 UTC, 0 replies.
- [PR] [SPARK-59248][FOLLOWUP][SQL] Update a stale exchange count in a SPARK-59050 test [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/09/08 03:47:38 UTC, 4 replies.
- [PR] [BUILD] Add config test module [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/09/08 04:00:07 UTC, 0 replies.
- [PR] [SPARK-51264][SQL][JDBC] Close driver connection before writing [spark] - posted by "zhangxinyao88 (via GitHub)" <gi...@apache.org> on 2026/09/08 04:25:31 UTC, 9 replies.
- Re: [PR] [SPARK-59304][K8S] Support `spark.kubernetes.executor.pvc.resizeMaxStorage` in `ExecutorPVCResizePlugin` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/08 04:39:03 UTC, 3 replies.
- [PR] [SPARK-59314][K8S][DOCS] Add `Heterogeneous Executor Management` section to `running-on-kubernetes.md` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/08 05:58:35 UTC, 5 replies.
- [PR] [SPARK-59316][K8S][DOCS] Remove the obsolete `-Pvolcano` build instruction from K8s docs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/08 06:13:51 UTC, 4 replies.
- [PR] [SPARK-59310][SQL] Report driver-side grouping metrics for GroupPartitionsExec [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/09/08 06:33:51 UTC, 10 replies.
- [PR] [SPARK-59315][SS] Fix the correctness issue on new resolution logic for dropDuplicates(WithinWatermark) [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/09/08 06:41:15 UTC, 3 replies.
- [PR] [SPARK-59187][SQL][4.3] Compare partition key rows at types with the naming erased [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/08 07:14:57 UTC, 3 replies.
- [PR] [SPARK-59306][SS] Redact all JAAS credential styles in Kafka parameter logging [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/08 07:20:16 UTC, 5 replies.
- [PR] [SPARK-59307][ML] Detect cyclic node ids when loading decision tree and bisecting k-means models [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/08 07:20:22 UTC, 8 replies.
- [PR] [SPARK-59308][ML] Avoid integer overflow when computing ML feature and image sizes [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/08 07:20:28 UTC, 1 replies.
- [PR] [SPARK-59309][ML] Add spark.sql.ml.maxNumFeatures to bound feature counts read from data [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/08 07:20:36 UTC, 4 replies.
- [PR] [SPARK-59311][SQL] Add spark.sql.avro.catalystTypeParsingMaxDepth to bound Catalyst type parsing [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/08 07:20:43 UTC, 1 replies.
- [PR] [SPARK-59312][YARN] Add an option to ignore the AM proxy-user cookie [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/08 07:20:49 UTC, 15 replies.
- [PR] [SPARK-59187][SQL][4.2] Compare partition key rows at types with the naming erased [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/08 07:26:50 UTC, 3 replies.
- [PR] [SPARK-59320][UI] Optionally require an expiration claim in JWSFilter [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/08 07:27:20 UTC, 4 replies.
- [PR] [SPARK-59321][PROTOBUF] Bound protobuf schema recursion depth across message types [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/08 07:29:23 UTC, 3 replies.
- [PR] [SPARK-59322][SQL] Add an optional maximum nesting depth for XML parsing [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/08 07:30:22 UTC, 1 replies.
- [PR] [SPARK-59319][SQL] Add an opt-in restricted SQL execution mode [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/08 07:31:46 UTC, 8 replies.
- [PR] [SPARK-59318][SQL] Add opt-in restrictions for data source client options, schema URLs, and class loading [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/08 07:34:45 UTC, 3 replies.
- [PR] [SPARK-59323][SQL] Record temp variables read by an IDENTIFIER clause as referred by the view [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/08 07:45:06 UTC, 27 replies.
- [PR] [SPARK-59324] Run the trust-boundary end-to-end walkthrough in CI [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/08 07:52:29 UTC, 2 replies.
- [PR] [SPARK-59325][SQL] Add an optional maximum nesting depth for variant values [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/08 08:09:19 UTC, 2 replies.
- [PR] [SPARK-59313][ML] Eagerly initialize the ANN model in MultilayerPerceptronClassificationModel [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/08 08:57:09 UTC, 0 replies.
- [PR] [SPARK-59326][SQL][TESTS] Add missing ASOF JOIN match-condition type unit tests [spark] - posted by "LukaZdravic (via GitHub)" <gi...@apache.org> on 2026/09/08 10:05:14 UTC, 1 replies.
- Re: [PR] [MINOR] Fix typo errors in code comments across multiple modules [spark] - posted by "r266-tech (via GitHub)" <gi...@apache.org> on 2026/09/08 10:06:26 UTC, 1 replies.
- Re: [PR] [SPARK-59322][SQL] Handle deep nesting during XML schema inference [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/08 11:02:26 UTC, 2 replies.
- [PR] [SPARK-59286][ML] Revert "Optimize NaiveBayesModel transform closures" [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/08 11:59:26 UTC, 2 replies.
- [PR] [SPARK-59286][ML] Reduce NaiveBayesModel transform closure size [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/08 12:20:41 UTC, 3 replies.
- [PR] [BACKPORT][MINOR] Improve Transport Context Stream Manager Delegation [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/08 12:38:50 UTC, 0 replies.
- [PR] [SPARK-59328][SQL] Add an option to reject specified Kafka options in the Kafka data source [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/08 12:44:29 UTC, 9 replies.
- [PR] [SPARK-59329][SQL] Add an allowlist of URI schemes for the Avro schemaUrl option [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/08 12:44:33 UTC, 14 replies.
- [PR] [SPARK-59330][SQL] Resolve Hive InputFormat and OutputFormat classes without eager initialization [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/08 12:44:37 UTC, 0 replies.
- [PR] [MINOR][CORE][BACKPORT] Avoid accidental collisions in SHS using LevelDB [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/08 12:45:21 UTC, 0 replies.
- [PR] [CORE][MINOR][BACKPORT] Validate array counts against received bytes in shuffle fetch decoders [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/08 12:48:34 UTC, 0 replies.
- [PR] [SPARK-59331][K8S] Turn off the recovery mode an OOM turned on when a held application resumes [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/08 12:50:26 UTC, 2 replies.
- [PR] [SPARK-59332][CORE][MINOR] Scope standalone shuffle service local dirs [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/08 13:00:19 UTC, 0 replies.
- [PR] [SPARK-59333][CORE] Validate data during recovery from ZK in HA failure [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/08 13:09:33 UTC, 12 replies.
- [PR] [SPARK-57780][SQL] Do not classify Postgres permission errors as synt… [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2026/09/08 13:12:26 UTC, 5 replies.
- [PR] [SPARK-59334][CORE][MINOR] Handle invalid application/worker links [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/08 13:18:14 UTC, 1 replies.
- [PR] [SPARK-59335][ML] Reduce GBTRegressionModel broadcast size [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/08 13:25:09 UTC, 2 replies.
- Re: [PR] [SPARK-59336][SQL] Do not classify Postgres permission errors as synt… [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2026/09/08 13:30:31 UTC, 1 replies.
- Re: [PR] [SPARK-59331][K8S] Turn off recovery mode when a held application resumes [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/08 13:36:09 UTC, 1 replies.
- [PR] [SPARK-59337][ML] Simplify GeneralizedLinearRegressionModel transform implementation [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/08 13:44:45 UTC, 2 replies.
- Re: [PR] [SPARK-59004][CORE] Use vectorized Arrays.compare for ComparableByteArray/Int/Long.compareTo [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/08 13:46:17 UTC, 3 replies.
- [PR] [SPARK-59338][ML] Move predictionColumn to PredictionModel [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/08 14:07:27 UTC, 2 replies.
- Re: [PR] [SPARK-59327][BUILD] Add config test module [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/09/08 14:18:51 UTC, 5 replies.
- Re: [PR] [SPARK-58946][SQL] Reject invalid CSV file extensions [spark] - posted by "subhramit (via GitHub)" <gi...@apache.org> on 2026/09/08 14:29:32 UTC, 59 replies.
- [PR] [SPARK-59339][ML] Add a code-generated SQL expression for ML vector dot products [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/08 14:39:08 UTC, 0 replies.
- [PR] [SPARK-59340][ML] Reduce Word2VecModel broadcast size [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/08 14:42:23 UTC, 3 replies.
- [PR] [SPARK-58963][ML][SQL][FOLLOWUP] Rename the vector posexplode internal expression [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/08 14:58:04 UTC, 2 replies.
- Re: [PR] [SPARK-59336][SQL] Fix syntax error classifier in Postgres connector [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2026/09/08 15:10:46 UTC, 17 replies.
- [PR] [SPARK-59341][SQL] Assign a tree pattern to UnresolvedStarExceptOrReplace [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/09/08 15:28:55 UTC, 0 replies.
- [PR] [SPARK-59299][SQL][TESTS][FOLLOWUP] Split ASOF JOIN parser test cases into separate tests [spark] - posted by "LukaZdravic (via GitHub)" <gi...@apache.org> on 2026/09/08 15:43:47 UTC, 8 replies.
- [PR] [SPARK-36082][SQL] Restore NAAJ broadcast hash join by default [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/08 16:18:14 UTC, 0 replies.
- [PR] Allow configuring schema alignment behavior for DSv2 writes [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2026/09/08 16:25:41 UTC, 0 replies.
- [PR] [SPARK-59279][SQL][4.2] Don't re-read the sorted-merge config after GroupPartitionsExec is planned [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/08 16:31:32 UTC, 3 replies.
- [PR] [SPARK-58980][SQL] Support GROUPS window frames [spark] - posted by "mrk-andreev (via GitHub)" <gi...@apache.org> on 2026/09/08 17:13:11 UTC, 0 replies.
- [PR] [SPARK-58286] Update operator-sdk version to 5.6.0 [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2026/09/08 17:18:10 UTC, 1 replies.
- [PR] [SPARK-59345][SQL] Add RUNTIME_FILTER join hint [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/09/08 18:05:15 UTC, 11 replies.
- Re: [PR] [SPARK-59341][SQL] Assign a tree pattern to UnresolvedStarBase related nodes [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/08 18:58:08 UTC, 2 replies.
- [PR] [SPARK-59344] Update operator-sdk version to 5.6.0 [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2026/09/08 20:09:26 UTC, 1 replies.
- [PR] [SPARK-59346][SQL][TESTS] Add tests for ProjectingInternalRow [spark] - posted by "vrjdev (via GitHub)" <gi...@apache.org> on 2026/09/08 20:25:16 UTC, 2 replies.
- [PR] [SPARK-59348][SQL] Rewrite match-all LIKE '%' to IsNotNull in predicates [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/08 21:19:33 UTC, 7 replies.
- [PR] [SPARK-59349][SQL] Override the gRPC authority for UDF worker Unix socket channels [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/08 22:42:18 UTC, 4 replies.
- Re: [PR] [SPARK-59308][ML] Avoid Int overflow when computing the decoded image size [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/08 23:26:01 UTC, 1 replies.
- Re: [PR] [SPARK-59311][SQL] Avoid StackOverflowError when parsing the Catalyst type in an Avro schema property [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/08 23:29:23 UTC, 1 replies.
- [PR] [SPARK-59352][SQL] Validate prefix lengths in the vectorized DELTA_BYTE_ARRAY reader [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/08 23:45:15 UTC, 4 replies.
- [PR] [SPARK-59353][UI] Avoid pre-fetch and crawlers triggering actions in UI [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/08 23:56:52 UTC, 11 replies.
- Re: [PR] [SPARK-59233][SQL][PYTHON] Let the session's Python worker environment reach every Python function family [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/09 00:07:44 UTC, 1 replies.
- Re: [PR] [SPARK-56564][SQL] Fix V2 write path to use CommitDeniedException for proper speculation handling [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/09 00:42:25 UTC, 1 replies.
- Re: [I] NullPointerException in KafkaMicroBatchStream.metrics when latestPartitionOffsets is uninitialized [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/09 00:42:30 UTC, 5 replies.
- [PR] [SPARK-59354][SQL] Derive a length guard from LIKE patterns with '_' wildcards [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/09 02:09:54 UTC, 0 replies.
- [PR] [SPARK-59319][SQL][FOLLOWUP] Enforce restricted mode in the single-pass analyzer and avoid eager class loading for rejected calls [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/09 02:42:22 UTC, 4 replies.
- [PR] [MINOR][CONNECT] Improve Python client plan test coverage [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/09 02:43:18 UTC, 0 replies.
- [PR] [SPARK-59355][SQL] Simplify LIKE patterns containing escaped wildcards [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/09 02:51:08 UTC, 2 replies.
- [PR] [SPARK-59183][SDP] SCD2 Ignore-null support; Populate version map per event row at ingest [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/09/09 02:59:25 UTC, 10 replies.
- [PR] [SPARK-59273][SQL][FOLLOWUP] Restore skipping non-string columns in DataFrameNaFunctions.fillValue [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/09/09 03:05:36 UTC, 3 replies.
- [PR] [SPARK-59273][SQL][FOLLOWUP] Skip non-string columns in fill [spark] - posted by "zhangxinyao88 (via GitHub)" <gi...@apache.org> on 2026/09/09 03:27:58 UTC, 3 replies.
- [PR] [SPARK-59356][SQL] Estimate selectivity of StartsWith/EndsWith/Contains in FilterEstimation [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/09 03:28:12 UTC, 3 replies.
- [PR] [SPARK-58897][SQL][4.2] Propagate NaN through the infinity norm in vector_norm [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/09/09 05:54:04 UTC, 3 replies.
- [PR] [SPARK-57900][BUILD][FOLLOWUP][4.X] Fix the parent version in credential-aws-integration-tests pom [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/09/09 05:56:25 UTC, 0 replies.
- [PR] [SPARK-59359][PYTHON][TEST] Add tests for NumPy ufunc type coercion [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/09/09 06:07:38 UTC, 3 replies.
- Re: [PR] [SPARK-59212][K8S][INFRA][4.3] Pin the Minikube container runtime to docker in K8s CI [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/09/09 06:36:46 UTC, 2 replies.
- [PR] [SPARK-59360] Run the multi-tenant routing end-to-end walkthrough in CI [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/09 07:39:25 UTC, 2 replies.
- Re: [PR] [SPARK-59339][ML][SQL] Add a SQL expression for ML vector dot products [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/09 07:44:44 UTC, 1 replies.
- Re: [PR] [SPARK-38983][SQL][TESTS] Add grouping boolean error regression test [spark] - posted by "superdiaodiao (via GitHub)" <gi...@apache.org> on 2026/09/09 07:55:44 UTC, 0 replies.
- [PR] [SPARK-59361][CORE][TESTS] Add unit tests for SparkSchemaUtils.escapeMetaCharacters [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/09 08:41:28 UTC, 1 replies.
- [PR] [SPARK-59362][SQL] Extract the duplicated TableProvider resolution block in ResolveDataSource [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/09 08:41:32 UTC, 4 replies.
- [PR] [SPARK-59363][DOCS] Fix ungrammatical 'allows to' in the Avro data source doc [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/09 08:41:34 UTC, 2 replies.
- [PR] [SPARK-57846][SQL] Add the try_make_time function [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/09 08:59:57 UTC, 4 replies.
- [PR] [SPARK-59351][SQL] Rewrite nested subqueries in hoisted correlated predicates against the subquery plan [spark] - posted by "pratham76 (via GitHub)" <gi...@apache.org> on 2026/09/09 09:10:26 UTC, 76 replies.
- [PR] [SPARK-59365][SQL][TESTS] Add ASOF JOIN MATCH_CONDITION tests for array-of-struct and literal operands [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/09/09 09:41:32 UTC, 8 replies.
- [PR] [SPARK-57820][SQL] Support nanosecond-precision timestamps in time_bucket [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/09 09:55:01 UTC, 12 replies.
- Re: [PR] [SPARK-57900][BUILD][FOLLOWUP][4.X] Fix the pom of credential-aws-integration-tests [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/09 10:01:42 UTC, 2 replies.
- Re: [PR] [SPARK-58884][SS] Add stateful benchmarks for Real-Time Mode [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/09/09 10:29:33 UTC, 3 replies.
- Re: [PR] [SPARK-59313][ML] Avoid serializing FeedForwardModel scratch buffers [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/09 12:23:40 UTC, 1 replies.
- Re: [PR] [SPARK-58151] Publish Apache Spark 4.2.0 to docker registry [spark-docker] - posted by "konjac (via GitHub)" <gi...@apache.org> on 2026/09/09 12:42:32 UTC, 1 replies.
- [PR] [SPARK-59289][SQL] Decide a co-partitioned child's GroupPartitionsExec once, where the join's merged keys are known [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/09 14:32:07 UTC, 18 replies.
- [PR] [SPARK-59370][SQL] Improve the EXPLAIN output of BIN BY plan nodes [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/09/09 15:23:22 UTC, 12 replies.
- [PR] [SPARK-59372][SQL] Support MATERIALIZED and NOT MATERIALIZED options for CTE [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/09/09 15:32:40 UTC, 23 replies.
- [PR] [SPARK-59373][SQL][PYTHON][DOC] Fix the documented return type of ceil and floor with a scale argument [spark] - posted by "vb-dbrks (via GitHub)" <gi...@apache.org> on 2026/09/09 15:39:33 UTC, 6 replies.
- [PR] [SPARK-59371][SQL] Gate the startsAndEndsWith LikeSimplification rewrite on a cheap child [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/09 15:58:26 UTC, 2 replies.
- [PR] [SPARK-59376][ML][PYTHON] Add frequency encoding to ml.feature [spark] - posted by "vb-dbrks (via GitHub)" <gi...@apache.org> on 2026/09/09 16:29:52 UTC, 0 replies.
- Re: [PR] [SPARK-58923][PYTHON] Bound applyInPandas output Arrow batch size [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/09/09 16:40:11 UTC, 9 replies.
- [PR] [SPARK-59295][SQL] Emit a common expression's definition once per scope under whole-stage codegen [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/09 17:15:32 UTC, 8 replies.
- Re: [PR] [SPARK-58869][BUILD] Upgrade Parquet to 1.18.0 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/09/09 17:56:02 UTC, 0 replies.
- [PR] [SPARK-59377] DSv2 column statistics are silently dropped when the column name needs quoting or differs only in case [spark] - posted by "hemanthboyina (via GitHub)" <gi...@apache.org> on 2026/09/09 18:23:41 UTC, 18 replies.
- [PR] [SPARK-59378][CORE] Cache the full-ASCII flag as a byproduct of UTF8String.numChars() [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/09 18:32:12 UTC, 5 replies.
- [PR] [SPARK-59379][CORE] Add ASCII fast-path to UTF8String character/byte position lookups [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/09 19:07:21 UTC, 4 replies.
- [PR] [SPARK-59380] Upgrade `actions/setup-java` to v6 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/09 19:17:01 UTC, 3 replies.
- [PR] [SPARK-59381] Update `setup-java` to v6 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/09 19:21:35 UTC, 0 replies.
- [PR] [SPARK-59382][CORE] Avoid redundant volatile reads of lazy caches in UTF8String [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/09 19:24:44 UTC, 0 replies.
- [PR] [SPARK-59383] Upgrade `actions/setup-java` to v6 and `actions/setup-python` to v7 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/09 19:26:36 UTC, 1 replies.
- [PR] [SPARK-59384][BUILD] Upgrade `kubernetes-client` to 7.9.0 and `vertx` to 4.5.31 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/09 19:53:45 UTC, 4 replies.
- [PR] [SPARK-59386][CORE] Avoid redundant byte reads in the UTF8String.levenshteinDistance inner loop [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/09 19:58:33 UTC, 4 replies.
- [PR] [SPARK-59385][SS] Enable dropDuplicatesWithinWatermark to be supported by RTM [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/09/09 19:59:41 UTC, 7 replies.
- [PR] [SPARK-59388] Upgrade Vert.x to 4.5.33 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/09 20:08:00 UTC, 5 replies.
- [PR] [SPARK-59387][SQL][TESTS] Cover restricted-mode rejection of banned functions in subqueries [spark] - posted by "vrjdev (via GitHub)" <gi...@apache.org> on 2026/09/09 20:17:46 UTC, 6 replies.
- [PR] [SPARK-59389][CORE] Avoid per-character UTF8String allocation in trimLeft/trimRight with a trim set [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/09 20:21:13 UTC, 6 replies.
- [PR] [WIP][CORE] Build padding in UTF8String.lpad/rpad with a shared repeat-fill helper [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/09 20:36:21 UTC, 0 replies.
- [PR] [SPARK-59391] Support `groupingSets` in `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/09 21:27:18 UTC, 3 replies.
- [PR] [SPARK-59392] Upgrade Jackson to 2.22.2 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/09 21:29:55 UTC, 3 replies.
- [PR] [SPARK-59393][BUILD] Upgrade Jackson to 2.22.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/09 21:53:34 UTC, 3 replies.
- Re: [PR] [SPARK-59208][SDP] Introduce ignore-null selection in `ChangeArgs` for SCD2 [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/09/09 22:39:17 UTC, 1 replies.
- Re: [PR] [MINOR][CORE][3.5] Avoid accidental collisions in SHS using LevelDB [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/09 23:17:20 UTC, 2 replies.
- Re: [PR] [SPARK-59118][SQL] Error when doAs is used and not supported [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/09 23:31:51 UTC, 5 replies.
- Re: [PR] [SPARK-58626][PYTHON][SQL] Optimize evaluating inputs to transpiled UDFs [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/09 23:35:21 UTC, 3 replies.
- Re: [PR] [SPARK-59332][CORE] Scope standalone shuffle service local dirs [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/09 23:47:17 UTC, 13 replies.
- Re: [PR] [SPARK-55014][SQL] Split projection for expensive filters [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/09 23:55:08 UTC, 1 replies.
- Re: [PR] [CORE][SPARK-49788] Add optional TTL based cleaning for blocks to better support notebooks [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/09 23:58:57 UTC, 0 replies.
- Re: [PR] [MINOR][NETWORK][3.5] Improve Transport Context Stream Manager Delegation [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/10 00:11:40 UTC, 3 replies.
- [PR] [SPARK-58622][CONNECT] Support TLS and mutual TLS (mTLS) for Spark Connect gRPC server [spark] - posted by "Edigueh (via GitHub)" <gi...@apache.org> on 2026/09/10 00:11:54 UTC, 2 replies.
- Re: [PR] [SPARK-59118][SQL][4.x] Warn when doAs is enabled but not enforced [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/10 00:23:23 UTC, 6 replies.
- Re: [PR] [SPARK-57189][CONNECT] Fix double execution and guard bypass in handleSqlCommand for WITH_RELATIONS [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/10 01:42:53 UTC, 1 replies.
- Re: [PR] [SPARK-57064][SQL] Widen bucketing rule pattern matches to use FileSourceScanLike trait [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/10 01:42:56 UTC, 1 replies.
- Re: [PR] [SPARK-57029][SQL][TESTS] Add byte-level visibility golden for ICU collation sort keys [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/10 01:42:58 UTC, 1 replies.
- Re: [PR] [SPARK-38101][CORE] Make metadata fetch failure repeat the task, not restart stages [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/10 01:43:02 UTC, 1 replies.
- Re: [PR] [SPARK-56028][CORE] Fix shuffle block GC not cleanup checksum file [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/10 01:43:06 UTC, 1 replies.
- Re: [PR] [SPARK-55324][PYTHON] Make convert_numpy support ArrayType [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/09/10 01:49:33 UTC, 0 replies.
- Re: [PR] [SPARK-55325][PYTHON] Introduce ArrowArrayToPandasConversion.convert_pyarrow [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/09/10 01:50:02 UTC, 1 replies.
- [PR] [SPARK-59394][SQL] UnBase64: decode the input bytes directly instead of converting to a String per row [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/10 02:29:28 UTC, 0 replies.
- [PR] [SPARK-48701][SQL][PS][FOLLOWUP] Make pandas_mode/mode null-safe for collated strings nested in complex types [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/09/10 03:07:32 UTC, 3 replies.
- [PR] [SPARK-59396][SQL] Enable SPJ partition filtering and ordering over partition keys by default [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/09/10 03:28:43 UTC, 19 replies.
- [PR] [SPARK-59273][SQL][FOLLOWUP] Cover string fill with mixed schemas [spark] - posted by "zhangxinyao88 (via GitHub)" <gi...@apache.org> on 2026/09/10 03:46:31 UTC, 1 replies.
- [PR] [SPARK-58968][SQL][4.0] Enforce subset clustering before non-join operators [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/09/10 04:34:33 UTC, 0 replies.
- [PR] [SPARK-59054][CORE][SQL][4.0] Compare SPJ shuffle partition keys by value [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/09/10 04:34:36 UTC, 0 replies.
- [PR] [SPARK-55411][SQL][4.0] Drop scan ordering when SPJ regroups input partitions [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/09/10 04:35:11 UTC, 0 replies.
- [PR] [SPARK-55411][SQL][TEST] Preserve null bucket keys in test fixtures [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/09/10 04:35:14 UTC, 0 replies.
- [PR] [WIP][CORE] Make shuffle tracking storage-aware [spark] - posted by "venkata91 (via GitHub)" <gi...@apache.org> on 2026/09/10 05:10:11 UTC, 0 replies.
- [PR] [SPARK-59397][ML] Reduce serialized size of mllib Word2VecModel [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/10 05:44:21 UTC, 2 replies.
- Re: [PR] [SPARK-36082][SQL][FOLLOWUP] Restore NAAJ broadcast hash join by default [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/10 06:44:59 UTC, 8 replies.
- Re: [PR] [SPARK-59381] Upgrade `setup-java` to v6 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/10 07:12:14 UTC, 2 replies.
- Re: [PR] [SPARK-59383][INFRA] Upgrade `actions/setup-java` to v6 and `actions/setup-python` to v7 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/10 07:17:08 UTC, 2 replies.
- [PR] Bump baseline-browser-mapping from 2.10.37 to 2.11.21 in /ui-test [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/09/10 07:39:08 UTC, 2 replies.
- [PR] Bump js-yaml from 4.3.1 to 4.3.2 in /dev [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/09/10 07:39:39 UTC, 2 replies.
- [PR] [SPARK-59399] Support `colRegex` in `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/10 07:53:41 UTC, 3 replies.
- Re: [PR] [SPARK-47010][K8S] Support csi driver for volume type [spark] - posted by "zgzzbws (via GitHub)" <gi...@apache.org> on 2026/09/10 07:54:35 UTC, 19 replies.
- Re: [PR] [SPARK-59357][CONNECT][TEST] Improve Python client protobuf plan stability coverage [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/10 09:53:32 UTC, 1 replies.
- [PR] [SPARK-59400][ML] Reuse TreeEnsembleModel prediction helper [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/10 10:05:28 UTC, 2 replies.
- [PR] [SPARK-59398][ML][SQL] Add a SQL expression for ML vector affine transformations [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/10 10:13:51 UTC, 0 replies.
- [PR] [WIP][SPARK-56822][SQL] Read INT96 timestamp columns as nanosecond timestamps [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/10 10:18:48 UTC, 3 replies.
- [PR] [WIP][SPARK-57462][PYTHON][SQL] Add Arrow support for nanosecond-precision timestamp types in PySpark [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/10 10:34:04 UTC, 0 replies.
- [PR] [SPARK-59402][ML] Reduce RandomForestRegressionModel broadcast size [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/10 10:53:04 UTC, 2 replies.
- [PR] [SPARK-59404][CORE] Match REST environment filtering in standalone Client submission [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/10 11:09:46 UTC, 17 replies.
- [PR] [SPARK-59403][CORE] Fix remote fetch of empty deserialized RDD blocks [spark] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2026/09/10 11:14:06 UTC, 1 replies.
- [PR] [SPARK-59405][SQL] XSD Validation improvements [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/10 11:14:33 UTC, 6 replies.
- Re: [PR] [SPARK-59330][SQL] Add an option to defer Hive InputFormat and OutputFormat class initialization [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/10 11:20:06 UTC, 9 replies.
- [PR] [SPARK-59406][UI] Fix UI display on weird custom log names [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/10 11:23:36 UTC, 3 replies.
- [PR] [SPARK-59407][UI][HISTORY] Improve compressed line handling in Spark History server [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/10 11:28:54 UTC, 5 replies.
- Re: [PR] [SPARK-59144][SQL] Route plain SQL/JSON function calls through routine resolution [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/10 12:17:39 UTC, 19 replies.
- [PR] [SPARK-59409][SQL][TESTS] Expand RewriteAsOfJoin optimizer rule test coverage [spark] - posted by "LukaZdravic (via GitHub)" <gi...@apache.org> on 2026/09/10 12:34:30 UTC, 3 replies.
- [PR] [SPARK-59410][SQL] Derive PartitionPredicate from identity fields of a mixed partitioning [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/09/10 12:34:35 UTC, 10 replies.
- Re: [PR] [SPARK-59315][SQL][SS] Fix the correctness issue on new resolution logic for dropDuplicates(WithinWatermark) [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/09/10 12:38:00 UTC, 2 replies.
- Re: [PR] [SPARK-59170][SQL][PYTHON] Align SQL function groupings across APIs and documentation [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/10 15:14:21 UTC, 1 replies.
- [PR] [SPARK-59374][SQL] Check the array size limit in concat codegen [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/09/10 15:23:28 UTC, 8 replies.
- [PR] [SQL] Stream multiline top-level JSON arrays [spark] - posted by "tdcmeehan (via GitHub)" <gi...@apache.org> on 2026/09/10 15:29:06 UTC, 0 replies.
- [PR] [SQL] Derive pushdown predicates from ANSI integral arithmetic [spark] - posted by "tdcmeehan (via GitHub)" <gi...@apache.org> on 2026/09/10 16:28:14 UTC, 1 replies.
- [PR] [SPARK-59411][SQL] Support the TIME data type in the width_bucket function [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/10 16:38:00 UTC, 3 replies.
- [PR] [SPARK-59375][SQL] Check the array size limit in flatten codegen [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/09/10 16:43:24 UTC, 5 replies.
- [PR] [SPARK-57834][SQL] Support nanosecond-precision timestamps in the sequence function [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/10 16:44:48 UTC, 7 replies.
- [PR] [SPARK-59358] SCD2 Ignore-null support; union microbatch with target table during preprocessing [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/09/10 16:56:49 UTC, 0 replies.
- [PR] [SQL] Preserve SELECT-list order when extracting multiple generators [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2026/09/10 17:44:20 UTC, 0 replies.
- [PR] [SPARK-59412][CORE] Support short class names of built-in plugins in `spark.plugins` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/10 18:03:03 UTC, 4 replies.
- [PR] [SPARK-59413][SQL] Treat the Collate passthrough as cheap in CollapseProject.isCheap [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/10 18:46:44 UTC, 3 replies.
- Re: [PR] [SPARK-59005][INFRA] Offer to update the JIRA Affects Version from the fix version in the merge script [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/09/10 19:20:26 UTC, 6 replies.
- Re: [PR] [SPARK-57971][K8S][DOCS] Drop K8s v1.34 Support [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/10 19:53:50 UTC, 0 replies.
- [PR] [SPARK-59364][UDF] Build external UDF payload and Init messages [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2026/09/10 19:55:44 UTC, 2 replies.
- Re: [PR] [SPARK-59401][SQL] Read INT96 timestamp columns as nanosecond timestamps [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/10 20:06:30 UTC, 3 replies.
- Re: [PR] [SPARK-58946][SQL] Fix CSV file extension validations [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/10 20:12:25 UTC, 11 replies.
- [PR] [SPARK-59414] Assign plan IDs to `DataFrame` relations [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/10 20:23:00 UTC, 3 replies.
- Re: [PR] [SPARK-58837][CONNECT] Use per-module Python loggers [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/09/10 20:33:10 UTC, 4 replies.
- [PR] [SPARK-59416] Support `col` and subscript column accessors in `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/10 20:57:46 UTC, 3 replies.
- Re: [PR] [SPARK-58989][PYTHON][TESTS] Replace pyspark-install with pyspark-periodic [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/09/10 21:01:20 UTC, 7 replies.
- [PR] [SPARK-59418][CORE] Prefer idle executors and isolate repeated OOM retries [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/09/10 21:48:41 UTC, 0 replies.
- [PR] [SPARK-59093][PS][FOLLOWUP] Reuse the floating floor division expression [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/09/10 21:54:11 UTC, 3 replies.
- Re: [PR] [SPARK-59347][SDP] SCD2 Ignore-null support; union microbatch with target table during preprocessing [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/09/10 22:38:01 UTC, 3 replies.
- [PR] [SPARK-59419][K8S] Use `VolumeBuilder.withNewEmptyDir` instead of `EmptyDirVolumeSourceBuilder` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/11 00:24:26 UTC, 0 replies.
- [PR] [SPARK-59420] Support `withField` and `dropFields` in `Column` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/11 00:26:11 UTC, 3 replies.
- Re: [PR] [SPARK-56632][CONNECT][TESTS][4.2] Add E2E test for self-join reusing a DataFrame [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/11 00:41:10 UTC, 1 replies.
- Re: [PR] [SPARK-56632][CONNECT][TESTS][4.1] Add E2E test for self-join reusing a DataFrame [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/11 00:41:15 UTC, 1 replies.
- Re: [PR] [SPARK-56980][SQL] Fix computeStats assertion on DSv2 relations before pushdown [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/11 00:41:20 UTC, 1 replies.
- Re: [I] [SPARK-38101] execuors fail fetching map statuses with `INTERNAL_ERROR_BROADCAST` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/11 00:41:25 UTC, 0 replies.
- Re: [PR] [SPARK-52011][SQL] Reduce HDFS NameNode RPC on vectorized Parquet reader [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/11 00:41:28 UTC, 1 replies.
- [PR] [SPARK-59419][K8S][4.x] Use nested builders for volume sources in `MountVolumesFeatureStep` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/11 00:41:48 UTC, 3 replies.
- [PR] [SPARK-59421][BUILD] Upgrade `zstd-jni` to 1.5.7-16 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/11 00:47:51 UTC, 3 replies.
- [PR] [SPARK-59422][BUILD] Upgrade Netty to 4.2.18.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/11 00:51:24 UTC, 0 replies.
- [PR] [SPARK-59423] Upgrade `Netty` to 4.2.18.Final [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/11 00:53:27 UTC, 3 replies.
- [PR] [SPARK-59424][BUILD] Upgrade `netty-tcnative` to 2.0.84.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/11 00:59:10 UTC, 5 replies.
- Re: [PR] [SPARK-59422][BUILD] Upgrade `Netty` to 4.2.18.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/11 01:03:29 UTC, 4 replies.
- Re: [PR] [SPARK-59419][K8S] Use nested builders for volume sources in `MountVolumesFeatureStep` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/11 01:04:15 UTC, 2 replies.
- Re: [PR] [SPARK-59417][SQL] Stream multiline top-level JSON arrays [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/11 01:05:58 UTC, 16 replies.
- [PR] [SPARK-48701][FOLLOWUP][SQL][PS] Guard nulls nested in collated complex types in mode aggregates [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/11 01:19:25 UTC, 1 replies.
- [PR] [SPARK-59311][FOLLOWUP][SQL] Name the map-key property when its Catalyst type overflows the parser [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/11 01:19:30 UTC, 4 replies.
- [PR] [SPARK-59061][FOLLOWUP][CORE] List all eight StandaloneAppClientListener callbacks in its doc [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/11 01:19:32 UTC, 2 replies.
- [PR] [SPARK-59426][SQL] Avoid per-lookup allocation in EquivalentExpressions.ExpressionEquals.hashCode [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/11 01:29:01 UTC, 6 replies.
- [PR] [SPARK-59154][FOLLOWUP][ML] Clean up DecisionTreeRegressionModel transform [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/11 01:40:37 UTC, 3 replies.
- [PR] [SPARK-59427][SQL] Avoid a redundant map lookup in CollectFrequentItems.add [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/11 02:46:06 UTC, 3 replies.
- [PR] [SPARK-59428][SQL] Remove a dead emptiness guard in CollectFrequentItems.add [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/11 02:58:00 UTC, 4 replies.
- Re: [PR] [SPARK-59334][CORE] Handle invalid application/worker links [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/11 03:03:24 UTC, 3 replies.
- [PR] [SPARK-59429] Pass plan ID in `DataFrame.colRegex` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/11 03:04:27 UTC, 3 replies.
- [PR] [SPARK-59430][CORE] Cache UTF8String.hashCode [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/11 03:25:04 UTC, 1 replies.
- [PR] [SPARK-59425][PYTHON] Introduce EvalTypeHandler pipeline and migrate scalar Arrow UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/09/11 03:30:18 UTC, 18 replies.
- [PR] [SPARK-59431][CORE] Use ArrayList instead of LinkedList for BytesToBytesMap dataPages [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/11 03:49:32 UTC, 2 replies.
- [PR] [SPARK-59432][CONNECT][PYTHON] Declare gil_used = false on the _pyspark module [spark-connect-rust] - posted by "james-willis (via GitHub)" <gi...@apache.org> on 2026/09/11 04:16:21 UTC, 6 replies.
- [PR] [SPARK-59432][CONNECT][INFRA] Build free-threaded (cp3xxt) wheels [spark-connect-rust] - posted by "james-willis (via GitHub)" <gi...@apache.org> on 2026/09/11 04:25:37 UTC, 11 replies.
- [PR] [SPARK-59093][PS][TEST][FOLLOWUP] Skip floor division overflow tests on old NumPy [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/09/11 04:53:53 UTC, 4 replies.
- Re: [PR] [SPARK-34586][SQL] Support declaring a write distribution and ordering in CREATE/REPLACE TABLE [spark] - posted by "anuragmantri (via GitHub)" <gi...@apache.org> on 2026/09/11 05:34:53 UTC, 10 replies.
- Re: [PR] [SPARK-38079][K8S] Create the driver's config maps and mounted secret as pre-resources to avoid a mount race [spark] - posted by "HwangDongJun (via GitHub)" <gi...@apache.org> on 2026/09/11 06:22:35 UTC, 4 replies.
- [PR] [SPARK-58896][FOLLOWUP][ML] Apply decision tree MiMa exclusions from Spark 4.4 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/11 07:55:57 UTC, 2 replies.
- Re: [PR] [SPARK-58129][SQL] Assign a name to the error class _LEGACY_ERROR_TEMP_0031 [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/09/11 08:11:37 UTC, 4 replies.
- [PR] [SPARK-59433][SQL] Render TIMESTAMP_LTZ explicitly when spark.sql.timestampType=TIMESTAMP_NTZ [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/09/11 08:43:52 UTC, 3 replies.
- [I] Upgrade base images to Ubuntu 22.04 [spark-docker] - posted by "RobbertDM (via GitHub)" <gi...@apache.org> on 2026/09/11 08:51:36 UTC, 0 replies.
- [PR] [SPARK-59434][SQL] Non-deterministic predicates should not be pushed down to CTE definitions [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/09/11 09:11:03 UTC, 9 replies.
- [PR] Switch tags to noble to build on 24.04 instead of 22.04 [spark-docker] - posted by "RobbertDM (via GitHub)" <gi...@apache.org> on 2026/09/11 09:36:10 UTC, 0 replies.
- Re: [PR] [SPARK-58975][CORE] Add failure messages to MemoryPool require checks [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/11 10:43:16 UTC, 1 replies.
- Re: [PR] [SPARK-57462][PYTHON][SQL] Add Arrow support for nanosecond-precision timestamp types in PySpark [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/11 10:51:57 UTC, 3 replies.
- Re: [PR] [SPARK-58507][CORE] Avoid redundant closure-class parsing in ClosureCleaner's indylambda path [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/09/11 11:44:27 UTC, 4 replies.
- [PR] [MINOR][CORE] Simplify the next-page index computation in BytesToBytesMap.MapIterator [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/11 12:27:19 UTC, 0 replies.
- [PR] [SPARK-59296][CORE][FOLLOWUP] Run OIDC `UserCredentialManager` in local mode for parity with `HadoopDelegationTokenManager` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/09/11 12:38:10 UTC, 8 replies.
- [PR] [SPARK-59435][UDF] Qualify UDF worker proto import paths [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2026/09/11 13:04:50 UTC, 2 replies.
- [PR] [MINOR][CORE][SQL] Inline argument checks and drop the network.util.JavaUtils dependency in ReadAheadInputStream and VectorizedDeltaBinaryPackedReader [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/11 13:19:36 UTC, 2 replies.
- [PR] [MINOR][CORE] Document the JavaUtils.checkArgument format-string contract and fix a concatenating caller [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/11 13:36:56 UTC, 0 replies.
- [PR] [SPARK-59439][CORE] Release the HistoryServerDiskManager lease reservation exactly once on a failed commit [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/11 13:50:48 UTC, 7 replies.
- [PR] [SPARK-59438][SQL][TESTS] Add planner-stage test coverage for ASOF JOIN sort-merge operator [spark] - posted by "LukaZdravic (via GitHub)" <gi...@apache.org> on 2026/09/11 13:56:56 UTC, 5 replies.
- [PR] [MINOR][CORE] Add verbatim-message overloads for JavaUtils.checkArgument and checkState [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/11 14:15:19 UTC, 0 replies.
- [PR] [SPARK-59440][SQL] Support the TIME data type in the hll_sketch_agg function [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/11 14:19:51 UTC, 7 replies.
- [PR] [SPARK-59441][PYTHON] Simplify the UDF/UDTF runner contract to (func, serializer) [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/09/11 16:04:00 UTC, 2 replies.
- [PR] [SPARK-56822][SQL] Zero the reserved payload when writing a null nanosecond timestamp to UnsafeRow [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/11 16:16:48 UTC, 3 replies.
- [PR] [SPARK-59445] Run the multi-replica Redis affinity end-to-end walkthrough in CI [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/11 17:02:54 UTC, 2 replies.
- [PR] [SPARK-59444][CORE] Retain execution-memory task registration while allocations wait [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/09/11 17:46:22 UTC, 4 replies.
- Re: [PR] [SPARK-59431][CORE] Use ArrayDeque instead of LinkedList for BytesToBytesMap dataPages [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/11 18:01:49 UTC, 8 replies.
- [PR] [SPARK-59443][SQL] Reduce allocations in ArrowColumnVector decimal reads [spark] - posted by "xiaoh1024 (via GitHub)" <gi...@apache.org> on 2026/09/11 18:34:15 UTC, 3 replies.
- [PR] [SPARK-59395][SDP] Expose deterministic flow execution attribution [spark] - posted by "marcuslin123 (via GitHub)" <gi...@apache.org> on 2026/09/11 18:40:51 UTC, 0 replies.
- Re: [PR] [SPARK-58235][SQL] Fix Double/Float to Timestamp silent overflow clamping in non-ANSI mode [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/09/11 19:11:03 UTC, 5 replies.
- [PR] [SPARK-59437][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1060 [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/09/11 20:00:50 UTC, 1 replies.
- [PR] [SPARK-54966][PYTHON] Factor out legacy pandas-to-Arrow column conversion [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/09/11 21:46:40 UTC, 13 replies.
- [PR] [SPARK-59449] Support type-safe getters in `Row` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/11 22:06:17 UTC, 3 replies.
- [PR] [SPARK-59450] Support Codable in `createDataFrame` and `DataFrame.collect` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/11 23:07:26 UTC, 3 replies.
- [PR] [MINOR][SQL] Centralize runtime filter eligibility checks [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/09/11 23:18:27 UTC, 0 replies.
- [PR] [SQL] Optimize DeduplicateRelations for wide plans [spark] - posted by "bhollis-dbx (via GitHub)" <gi...@apache.org> on 2026/09/11 23:31:15 UTC, 0 replies.
- Re: [PR] [SPARK-59015][SQL] Rebind refreshed DSv2 relations to the current table schema [spark] - posted by "yyanyy (via GitHub)" <gi...@apache.org> on 2026/09/12 00:47:27 UTC, 22 replies.
- Re: [PR] [SPARK-59452][SQL] Optimize DeduplicateRelations for wide plans [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/09/12 01:03:09 UTC, 3 replies.
- [PR] [SPARK-59454][PYTHON] Move Arrow-to-pandas batch conversion into ArrowToPandasConversion [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/09/12 01:23:03 UTC, 0 replies.
- [PR] [SPARK-59456][SQL] Fix: RuleExecutor.PlanChangeLogger does work even when it doesn't log [spark] - posted by "bhollis-dbx (via GitHub)" <gi...@apache.org> on 2026/09/12 02:31:06 UTC, 0 replies.
- Re: [PR] [SPARK-58186][SQL] Add bitmap_contains function [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/12 04:10:43 UTC, 1 replies.
- Re: [PR] [SPARK-59361][CORE][TEST] Add unit tests for SparkSchemaUtils.escapeMetaCharacters [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/12 07:04:39 UTC, 2 replies.
- Re: [PR] [SPARK-59291][STREAMING] Add return tags to the public StateSpec methods [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/12 07:38:52 UTC, 3 replies.
- Re: [PR] [SPARK-41416][SQL] Rewrite existence-only inequality self-joins as COUNT(DISTINCT) [spark] - posted by "hhr293 (via GitHub)" <gi...@apache.org> on 2026/09/12 07:41:01 UTC, 0 replies.
- Re: [PR] [SPARK-41416][SQL] Rewrite existence-only inequality self-joins as MIN/MAX [spark] - posted by "hhr293 (via GitHub)" <gi...@apache.org> on 2026/09/12 07:42:43 UTC, 23 replies.
- [PR] [SPARK-59457][SQL] RowLevelOperationTable should delegate partitioning() to the wrapped table [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/09/12 07:48:12 UTC, 12 replies.
- [PR] [SPARK-59458][YARN] Fix 'propogate' typos in YarnAllocator comments [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/12 08:04:11 UTC, 1 replies.
- [PR] [SPARK-59459][CORE] Extract a helper for the HashPartitioner array-key check in PairRDDFunctions [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/12 08:04:50 UTC, 6 replies.
- [PR] [SPARK-59460][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1072 [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/09/12 08:29:55 UTC, 1 replies.
- [PR] [SPARK-59146][SQL] Retain qualified access to source columns affected by pipe SET [spark] - posted by "AMC-hawk (via GitHub)" <gi...@apache.org> on 2026/09/12 09:15:26 UTC, 11 replies.
- Re: [PR] [SPARK-59018][SQL] Add variant_array_length expression [spark] - posted by "bojana-db (via GitHub)" <gi...@apache.org> on 2026/09/12 13:01:17 UTC, 7 replies.
- [PR] [SPARK-58274][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1068 [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/09/12 17:48:33 UTC, 4 replies.
- [PR] [WIP][SQL] Report structured errors for invalid JDBC partition bounds [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2026/09/12 17:54:16 UTC, 8 replies.
- [PR] [SPARK-59461][CORE] Reclaim optional execution memory before active query allocations [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/09/12 20:14:53 UTC, 12 replies.
- [PR] [SPARK-59462] Support safe upcasts and throw errors instead of crashing in `DataFrame.collect(as:)` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/12 23:37:17 UTC, 3 replies.
- [PR] [SPARK-59463] Fix FlatBuffers nesting assertion on `TIMESTAMP` columns in `createDataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/13 00:08:13 UTC, 3 replies.
- Re: [I] Fix name for frequent items/heavy hitters sketch from highly misleading "approx top k" [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/13 00:47:11 UTC, 0 replies.
- Re: [PR] [SQL][DML] Resolve Path Based Tables for both Reads and Writes [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/13 00:47:13 UTC, 1 replies.
- Re: [PR] [SPARK-42411][K8S] Add support for istio with strict mtls [spark] - posted by "tariq-hasan (via GitHub)" <gi...@apache.org> on 2026/09/13 01:50:07 UTC, 0 replies.
- [PR] [SPARK-59464] Fix `DATE` handling for dates before 1970 and after 2106 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/13 03:54:11 UTC, 3 replies.
- [PR] [SPARK-59465] Support integral to floating-point upcasts in `DataFrame.collect(as:)` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/13 05:06:35 UTC, 3 replies.
- [PR] [WIP][K8S][TEST] Replace dead minio/minio image with alpine/minio [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/09/13 06:18:13 UTC, 0 replies.
- [PR] [SPARK-59467][PYTHON] Normalize ArrowDtype timestamps to the session timezone in pandas conversion [spark] - posted by "fangchenli (via GitHub)" <gi...@apache.org> on 2026/09/13 07:02:32 UTC, 2 replies.
- Re: [PR] [SPARK-59455][PYTHON] Move Arrow-to-pandas batch conversion into ArrowToPandasConversion [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/09/13 07:52:14 UTC, 3 replies.
- Re: [PR] [SPARK-59468][K8S][TEST] Replace dead minio/minio image with alpine/minio [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/09/13 09:37:31 UTC, 4 replies.
- Re: [PR] [SPARK-58326][K8S][TESTS] Pin MinIO image version in DepsTestsSuite [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/09/13 09:41:37 UTC, 0 replies.
- [I] [COMMUNITY] Request to open dedicated discussion space (Slack /Discord/ GitHub Discussions) [spark-connect-gateway] - posted by "dangdat1111 (via GitHub)" <gi...@apache.org> on 2026/09/13 11:14:09 UTC, 2 replies.
- Re: [PR] [SQL][SPARK-59469] Report structured errors for invalid JDBC partition bounds [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2026/09/13 15:18:00 UTC, 0 replies.
- Re: [PR] [SPARK-59442][SQL] Zero the reserved payload when writing a null nanosecond timestamp to UnsafeRow [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/13 15:37:46 UTC, 2 replies.
- Re: [PR] [SPARK-58322][CORE] Bind executor bootstrap and registration to driver instances [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2026/09/13 15:48:31 UTC, 2 replies.
- [PR] [SPARK-59470] Respect `spark.sql.caseSensitive` when resolving column names in `DataFrame.collect(as:)` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/13 17:34:54 UTC, 3 replies.
- [PR] [SPARK-59471] Fix `DECIMAL` decoding to use the full signed 128-bit value [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/13 18:31:17 UTC, 3 replies.
- [PR] [SPARK-59472] Support `Decimal` properties in `createDataFrame` with `Encodable` types [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/13 19:10:05 UTC, 3 replies.
- [PR] [SPARK-59473] Support top-level `Decimal` decoding in `DataFrame.collect(as:)` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/13 19:26:24 UTC, 3 replies.
- [PR] [SPARK-59474] Support `DECIMAL` type in `createDataFrame` with `[[Sendable?]]` rows [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/13 19:50:56 UTC, 3 replies.
- [PR] [SPARK-59475] Add `suspend` field to BaseSpec for SparkApplication and SparkCluster [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/13 20:02:41 UTC, 8 replies.
- [PR] [SPARK-59476][SQL] Throw NULL_DATA_SOURCE_OPTION for null JDBC url instead of NullPointerException [spark] - posted by "dejankrak-db (via GitHub)" <gi...@apache.org> on 2026/09/13 20:05:55 UTC, 3 replies.
- [PR] [SPARK-59477][SQL] Add CSV write option treatNullAsEmptyString [spark] - posted by "dejankrak-db (via GitHub)" <gi...@apache.org> on 2026/09/13 20:17:52 UTC, 2 replies.
- [PR] [SPARK-59479][K8S] Remove SecurityManager dependency from KubernetesExecutorBuilder and BasicExecutorFeatureStep [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/13 20:47:39 UTC, 0 replies.
- [PR] [SPARK-59478][BUILD] Add sbin/start-connect-server.sh to pyspark-connect test module [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/09/13 20:57:40 UTC, 2 replies.
- [PR] [SPARK-59480] Fix concurrent actions on the same DataFrame to return correct results [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/13 22:52:36 UTC, 3 replies.
- [PR] [SPARK-59481] Fix concurrent commands on the same session to return correct responses [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/13 23:10:49 UTC, 3 replies.
- Re: [PR] [SPARK-59479][K8S] Remove `SecurityManager` dependency from `KubernetesExecutorBuilder` and `BasicExecutorFeatureStep` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/13 23:14:34 UTC, 2 replies.
- Re: [PR] [SPARK-57039][SQL] Fold InnerJoin with single-row LocalRelation/OneRowRelation into Project [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/14 00:46:36 UTC, 1 replies.
- [PR] [SPARK-59482] Fix the kubectl wait race in the e2e jobs and add a .dockerignore [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/14 01:30:59 UTC, 2 replies.
- [PR] [SPARK-59483] Fix `DataFrame.(head|first)` to throw an error instead of crashing on empty results [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/14 03:35:21 UTC, 3 replies.
- [PR] [SPARK-59484] Use `value` as the output column name of `DataFrame.toJSON` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/14 03:58:26 UTC, 3 replies.
- [PR] [SPARK-59485] Use server-side aggregation for `DataFrame.count()` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/14 04:09:33 UTC, 3 replies.
- [PR] [SPARK-59486] Add Kueue v1beta1 Workload CRD model and constants [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/14 05:40:03 UTC, 0 replies.
- Re: [PR] [SPARK-59486] Add `Kueue` v1beta1 Workload CRD model and constants [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/14 05:43:44 UTC, 3 replies.
- [PR] [SPARK-59487][CORE] Add task attempt spans to executor profiling [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2026/09/14 06:30:07 UTC, 5 replies.
- [PR] [SPARK-59436][SQL] SPJ: Support optimize skew join [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/09/14 06:46:25 UTC, 4 replies.
- [PR] [SPARK-59488][INFRA][TEST] Fix npm vulnerabilities in dev and ui-test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/14 07:47:41 UTC, 3 replies.
- [PR] [SPARK-59489][K8S] Promote `KubernetesExecutorSpec` to `DeveloperApi` and `Stable` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/14 08:05:37 UTC, 5 replies.
- Re: [PR] [SPARK-59326][SQL][TESTS] Add ASOF JOIN analyzer, operand-type, and rewrite unit tests [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/14 08:08:05 UTC, 0 replies.
- Re: [PR] [SPARK-59326][SQL][TESTS] Add ASOF JOIN analyzer, operand-type, and rewrite unit tests [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/14 08:08:31 UTC, 7 replies.
- [PR] [SPARK-59490] Add `KueueWorkloadFactory` for SparkApplication and SparkCluster [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/14 08:20:29 UTC, 4 replies.
- [PR] [SPARK-59491][SQL] Zero the reserved payload when writing a null CalendarInterval to UnsafeRow [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/14 09:01:50 UTC, 4 replies.
- [PR] [SPARK-59492][SQL] Remove partial window group limit below a GroupPartitionsExec [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/09/14 11:25:53 UTC, 6 replies.
- Re: [PR] [SPARK-59469][SQL] Report structured errors for invalid JDBC partition bounds [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/14 13:36:51 UTC, 2 replies.
- [PR] [SPARK-59493][SQL][TESTS] Add execution-metric test coverage for the ASOF JOIN sort-merge operator [spark] - posted by "LukaZdravic (via GitHub)" <gi...@apache.org> on 2026/09/14 13:48:57 UTC, 6 replies.
- [PR] [MINOR][TESTS][CONNECT] Assert DataFrame column resolution errors [spark] - posted by "marko-radoicic-db (via GitHub)" <gi...@apache.org> on 2026/09/14 13:53:05 UTC, 8 replies.
- [PR] [SPARK-59495] Drop temporary view [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2026/09/14 15:15:50 UTC, 0 replies.
- [PR] [SPARK-59496][SQL] Avoid exponential NullIf plan growth [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2026/09/14 15:24:21 UTC, 10 replies.
- Re: [PR] [SPARK-59495][SQL] Implement Drop temporary view [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2026/09/14 16:11:24 UTC, 1 replies.
- [PR] [SPARK-59497][PYTHON][TEST] Fix flaky Python data source worker logging tests [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/09/14 16:20:05 UTC, 2 replies.
- [PR] [SPARK-59498][K8S] Promote `KubernetesConf` abstract class to `DeveloperApi` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/14 16:25:54 UTC, 0 replies.
- Re: [PR] [SPARK-59490] Add `KueueWorkloadFactory` for `SparkApplication` and `SparkCluster` [spark-kubernetes-operator] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/14 16:32:57 UTC, 15 replies.
- [PR] [SPARK-59499][SQL] Avoid eager debug log rendering in Hive Thrift server [spark] - posted by "bhollis-dbx (via GitHub)" <gi...@apache.org> on 2026/09/14 16:36:21 UTC, 3 replies.
- Re: [PR] [SPARK-59498][K8S] Promote `KubernetesConf` abstract class to `Unstable` `DeveloperApi` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/14 17:15:23 UTC, 3 replies.
- Re: [PR] [SPARK-58910][K8S] Keep the executor pod template's service account [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/14 17:20:39 UTC, 10 replies.
- [PR] [SPARK-59500][K8S] Promote `KubernetesExecutorConf` to `DeveloperApi` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/14 17:28:45 UTC, 4 replies.
- [PR] [SPARK-59446][CONNECT] Support ignore-null updates in Auto CDC flows over Spark Connect [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/09/14 17:51:59 UTC, 3 replies.
- Re: [PR] [MINOR][SQL] Centralize static and runtime filter eligibility checks [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/09/14 17:58:02 UTC, 3 replies.
- [PR] [WIP][SPARK-59451] Wait to register Accumulators until after they are done deserializing [spark] - posted by "jlamberts-yobi (via GitHub)" <gi...@apache.org> on 2026/09/14 18:24:23 UTC, 0 replies.
- Re: [PR] [SPARK-58883][CORE] Detect truncated checkpoint directory on read via persisted partition count [spark] - posted by "anshulbaliga7 (via GitHub)" <gi...@apache.org> on 2026/09/14 18:28:12 UTC, 11 replies.
- [PR] [SPARK-57925][SQL] Use DecimalType.DEFAULT_SCALE for Oracle bare NUMBER columns [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/09/14 18:44:54 UTC, 7 replies.
- Re: [PR] [SPARK-59342][SQL] Allow configuring schema alignment behavior for DSv2 writes [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/09/14 19:02:01 UTC, 14 replies.
- [PR] [SPARK-59503] Upgrade `Kueue` Workload CRD model to `v1beta2` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/14 19:43:25 UTC, 4 replies.
- [PR] [SPARK-59504] Use `enabled` key convention in Helm `values.yaml` while honoring legacy `enable` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/14 19:58:52 UTC, 9 replies.
- [PR] [PYTHON] Preserve collation metadata when parsing schema JSON [spark] - posted by "laserninja (via GitHub)" <gi...@apache.org> on 2026/09/14 20:58:29 UTC, 0 replies.
- [PR] [PYTHON] Handle infinity norm of all-zero sparse vectors [spark] - posted by "laserninja (via GitHub)" <gi...@apache.org> on 2026/09/14 20:58:34 UTC, 0 replies.
- [PR] [PYTHON] Compare Row lengths in assertDataFrameEqual [spark] - posted by "laserninja (via GitHub)" <gi...@apache.org> on 2026/09/14 20:58:39 UTC, 0 replies.
- [PR] [PYTHON] Handle nonfinite values in assertDataFrameEqual [spark] - posted by "laserninja (via GitHub)" <gi...@apache.org> on 2026/09/14 20:58:45 UTC, 1 replies.
- [PR] [PYTHON] Compare leaf type parameters in assertSchemaEqual [spark] - posted by "laserninja (via GitHub)" <gi...@apache.org> on 2026/09/14 20:58:51 UTC, 0 replies.
- [PR] [SPARK-59005][FOLLOWUP][INFRA] Offer to update the JIRA Affects Version even when no fix version is added [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/09/14 21:01:23 UTC, 5 replies.
- [PR] [SPARK-59506][SQL] Avoid per-call regex Matcher allocation in SparkDateTimeUtils.getZoneId [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/14 21:10:06 UTC, 1 replies.
- [PR] [MINOR][SQL] Fix stale doc for spark.sql.parquet.pushdown.inFilterThreshold [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/14 21:22:58 UTC, 2 replies.
- [PR] [SPARK-59455][PYTHON][FOLLOWUP] Clarify private Arrow-to-pandas column helpers [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/09/14 21:25:18 UTC, 3 replies.
- [PR] [SPARK-59502] Support publishing Kubernetes Event objects for SparkApplication and … [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2026/09/14 21:30:55 UTC, 1 replies.
- [PR] [SPARK-59507][SQL] Parse interval fractional seconds without building a padded string [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/14 21:36:31 UTC, 5 replies.
- [PR] [SPARK-59505][PYTHON][CONNECT] Round HALF_UP when rescaling decimals in LocalDataToArrowConversion [spark] - posted by "NestDream (via GitHub)" <gi...@apache.org> on 2026/09/14 21:52:28 UTC, 8 replies.
- [PR] [SPARK-59508][PYTHON] Harden client safety with restricted unpickle serializer [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/09/14 22:54:21 UTC, 2 replies.
- [PR] [SQL] Include SQL type in Python UDT identity [spark] - posted by "lavanv11 (via GitHub)" <gi...@apache.org> on 2026/09/14 23:12:09 UTC, 0 replies.
- Re: [PR] [SPARK-59312][CORE][YARN] Add an option to ignore the AM proxy-user cookie [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/14 23:16:10 UTC, 2 replies.
- Re: [PR] [SPARK-59444][CORE] Re-register execution-memory tasks after concurrent release [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/09/14 23:23:42 UTC, 1 replies.
- [PR] [SPARK-59501][SQL] Reduce allocations in unchanged TreeNode traversals [spark] - posted by "bhollis-dbx (via GitHub)" <gi...@apache.org> on 2026/09/14 23:37:14 UTC, 11 replies.
- [PR] [SPARK-59509][CORE] Fix record undercount in UnsafeSorterSpillMerger and document the getNumRecords() contract [spark] - posted by "qingfureal (via GitHub)" <gi...@apache.org> on 2026/09/14 23:39:54 UTC, 0 replies.
- [PR] [SPARK-59511][SQL] Reduce ANSI type coercion allocations [spark] - posted by "bhollis-dbx (via GitHub)" <gi...@apache.org> on 2026/09/15 00:08:06 UTC, 1 replies.
- Re: [PR] [SPARK-59249][SQL][FOLLOWUP] Include SQL type in Python UDT identity [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/15 00:25:15 UTC, 3 replies.
- Re: [I] PushPredicateThroughNonJoin assertion failure when pushing filter through Project into Union (Hive view) [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/15 00:43:31 UTC, 0 replies.
- [PR] [MINOR][SQL] Avoid per-call closure allocation in SparkDateTimeUtils.parseTimestampString [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/15 02:08:32 UTC, 5 replies.
- Re: [PR] [SPARK-59512][PYTHON] Preserve collation metadata when parsing schema JSON [spark] - posted by "laserninja (via GitHub)" <gi...@apache.org> on 2026/09/15 02:32:53 UTC, 2 replies.
- Re: [PR] [SPARK-59516][MLLIB][PYTHON] Handle infinity norm of all-zero sparse vectors [spark] - posted by "laserninja (via GitHub)" <gi...@apache.org> on 2026/09/15 02:32:56 UTC, 1 replies.
- Re: [PR] [SPARK-59513][PYTHON] Compare Row lengths in assertDataFrameEqual [spark] - posted by "laserninja (via GitHub)" <gi...@apache.org> on 2026/09/15 02:32:59 UTC, 1 replies.
- Re: [PR] [SPARK-59514][PYTHON] Handle nonfinite values in assertDataFrameEqual [spark] - posted by "laserninja (via GitHub)" <gi...@apache.org> on 2026/09/15 02:33:02 UTC, 1 replies.
- Re: [PR] [SPARK-59515][PYTHON] Compare leaf type parameters in assertSchemaEqual [spark] - posted by "laserninja (via GitHub)" <gi...@apache.org> on 2026/09/15 02:33:04 UTC, 1 replies.
- [I] CSOAI — Spark AI governance big data [spark] - posted by "CSOAI-ORG (via GitHub)" <gi...@apache.org> on 2026/09/15 03:43:25 UTC, 2 replies.
- Re: [PR] [SPARK-59398][ML][SQL] Add an internal expression for ML vector scaling and shifting [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/15 05:10:33 UTC, 1 replies.
- [PR] [FOLLOWUP][SPARK-59339][ML][SQL] Use a static method for VectorDotProduct [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/15 05:36:54 UTC, 0 replies.
- [PR] [SPARK-59517][PYTHON] Fix outdated docstrings in serializers module [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/09/15 05:44:34 UTC, 3 replies.
- [PR] [SPARK-59519] Add opt-in `Kueue` RBAC rules to Helm chart [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/15 05:51:10 UTC, 11 replies.
- Re: [PR] [SPARK-58209][SQL] Mark stateful expressions to prevent data races [spark] - posted by "anshulbaliga7 (via GitHub)" <gi...@apache.org> on 2026/09/15 06:27:19 UTC, 1 replies.
- [PR] [SPARK-59518][K8S] Fall back to the driver service account when the executor one is empty [spark] - posted by "anshulbaliga7 (via GitHub)" <gi...@apache.org> on 2026/09/15 06:45:09 UTC, 2 replies.
- [PR] [SPARK-59520][PYSPARK] Perform PySpark RDD conversion under tracked execution [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/15 06:57:59 UTC, 0 replies.
- Re: [PR] [SPARK-59520][PYTHON] Perform PySpark RDD conversion under tracked execution [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/15 08:42:40 UTC, 6 replies.
- [PR] [SPARK-58876][SQL][FOLLOWUP] Map sub-microsecond Oracle TIMESTAMP to nanos NTZ [spark] - posted by "aleksandar-trajkovic-db (via GitHub)" <gi...@apache.org> on 2026/09/15 09:29:44 UTC, 7 replies.
- [PR] [WIP][SQL] Fix multi-value UNPIVOT with mixed types [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/15 09:41:09 UTC, 0 replies.
- [PR] [SPARK-59521][ML] Store word vectors directly in Word2VecModel [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/15 09:41:34 UTC, 0 replies.
- [PR] [SPARK-59522][ML] Add descriptive messages to the bare require checks in InstanceBlock [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/15 10:15:41 UTC, 6 replies.
- [PR] [SPARK-59523][ML] Store IDF data directly in IDFModel [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/15 10:16:38 UTC, 0 replies.
- Re: [PR] [SPARK-59339][ML][SQL][FOLLOWUP] Use a static method for VectorDotProduct [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/15 10:28:54 UTC, 2 replies.
- Re: [PR] [SPARK-59451][CORE] Wait to register Accumulators until after they are done deserializing [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/15 10:38:16 UTC, 4 replies.
- Re: [PR] [SPARK-58869][BUILD] Upgrade Parquet to 1.18.1 [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/09/15 11:08:11 UTC, 4 replies.
- [PR] [SPARK-59272][SQL] Revalidate the storage-partitioned join pairing when a regrouped side drops the keyed claim [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/15 11:21:26 UTC, 11 replies.
- Re: [PR] [SPARK-59525][PYTHON][SQL] Add Arrow support for nanosecond-precision timestamp types in PySpark [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/15 11:24:52 UTC, 1 replies.
- Re: [PR] [SPARK-59458][YARN][DOCS] Fix typos in the YARN custom-resource comment and running-on-yarn.md [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/15 11:27:54 UTC, 3 replies.
- Re: [PR] [SPARK-59200][STREAMING][TESTS] Simplify redundant boolean comparisons in streaming module tests [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/15 11:30:18 UTC, 2 replies.
- Re: [PR] [SPARK-58691] Add configurable worker metrics NetworkPolicy ingress [spark-kubernetes-operator] - posted by "yalindogusahin (via GitHub)" <gi...@apache.org> on 2026/09/15 11:54:56 UTC, 13 replies.
- [PR] [SPARK-59531][SQL] Avoid a per-match MatchResult allocation in regexp_extract, regexp_extract_all, and regexp_instr [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/15 13:50:53 UTC, 5 replies.
- [PR] [SPARK-59532][ML][SQL] Optimize VectorDotProduct for foldable inputs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/15 13:58:56 UTC, 0 replies.
- [PR] [SPARK-57878][CORE] Add task assignment strategy to support binpack/balance task scheduling [spark] - posted by "SwechchhaSinha (via GitHub)" <gi...@apache.org> on 2026/09/15 14:04:42 UTC, 0 replies.
- [PR] [SPARK-54918][SQL][FOLLOWUP] Handle floating-point normalization in array set operations [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/15 14:10:45 UTC, 4 replies.
- [PR] [SPARK-59054][CORE][SQL][4.1] Fix `KeyGroupedPartitioner` to compare partition keys by value in storage-partitioned join shuffles [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/15 14:25:05 UTC, 3 replies.
- [PR] [SPARK-59054][CORE][SQL][4.0] Fix `KeyGroupedPartitioner` to compare partition keys by value in storage-partitioned join shuffles [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/15 14:25:28 UTC, 3 replies.
- [PR] [SPARK-57759][SQL] Surface a catalog's FORBIDDEN_OPERATION instead of UNRESOLVED_ROUTINE [spark] - posted by "Vivek1106-04 (via GitHub)" <gi...@apache.org> on 2026/09/15 14:25:41 UTC, 0 replies.
- [PR] [SPARK-59535][MLLIB] Run PCA covariance decomposition on an executor [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/15 14:46:11 UTC, 0 replies.
- [PR] [SPARK-59527][SQL] Coerce ASOF JOIN MATCH_CONDITION operands like the comparison operator [spark] - posted by "LukaZdravic (via GitHub)" <gi...@apache.org> on 2026/09/15 14:52:50 UTC, 12 replies.
- [PR] [SPARK-59080][SQL][4.1] Pick one ShuffleSpecCollection member for the SPJ pushdown and the re-shuffle [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/15 15:01:01 UTC, 3 replies.
- [PR] [SPARK-59080][SQL][4.0] Pick one ShuffleSpecCollection member for the SPJ pushdown and the re-shuffle [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/15 15:01:25 UTC, 3 replies.
- [PR] [SPARK-59536][SQL] Fix parsing of hint-shaped nested comments [spark] - posted by "aleksei-akhundov-db (via GitHub)" <gi...@apache.org> on 2026/09/15 15:03:30 UTC, 8 replies.
- [PR] [SPARK-59528][SQL] Coerce array element types in ASOF JOIN MATCH_CONDITION [spark] - posted by "LukaZdravic (via GitHub)" <gi...@apache.org> on 2026/09/15 15:08:16 UTC, 2 replies.
- [PR] [SPARK-59539][SQL] Avoid per-row autoboxing in InSet code generation for integral and date/time types [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/15 15:12:22 UTC, 2 replies.
- [PR] [SPARK-36520][DSTREAMS] KinesisInitialPosition interface should be pu… [spark] - posted by "Yuvraj2172 (via GitHub)" <gi...@apache.org> on 2026/09/15 15:28:04 UTC, 1 replies.
- [PR] [SPARK-59541][SQL] Coalesce OR-connected equality and IN predicates on the same column into a single IN [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/15 15:38:02 UTC, 0 replies.
- [PR] [SPARK-59542] Support `spec.suspend` to hold driver and master/worker creation in `AppInitStep` and `ClusterInitStep` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/15 15:49:36 UTC, 15 replies.
- [PR] [SQL] Resolve evolved nested fields positionally in column-list inserts [spark] - posted by "EamesTrinh (via GitHub)" <gi...@apache.org> on 2026/09/15 17:26:36 UTC, 0 replies.
- [PR] [SPARK-59543][SQL] Avoid a per-record SQLConf.get in the JSON charset-decode path [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/15 18:05:57 UTC, 2 replies.
- [PR] [WIP][SQL] Extend InSet binary-search membership to Decimal [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/15 18:11:28 UTC, 0 replies.
- [PR] [SPARK-59546][SQL] Avoid per-row exceptions when inferring TimeType in JSON, CSV, and XML [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/15 19:53:23 UTC, 0 replies.
- [PR] [SPARK-59547][PYTHON] Flush Python worker logs before task completion so python_worker_logs() is consistent [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/09/15 20:01:30 UTC, 0 replies.
- [PR] [SPARK-59545][SQL] Fix PostProcessor rewriting a detached parse tree node during error unwinding [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/09/15 20:05:06 UTC, 4 replies.
- Re: [PR] Bump opentelemetry_sdk from 0.31.0 to 0.32.1 [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/15 21:04:03 UTC, 2 replies.
- Re: [PR] Bump jsonwebtoken from 9.3.1 to 10.3.0 [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/15 21:04:27 UTC, 2 replies.
- [PR] [SPARK-59548] Upgrade the OpenTelemetry crates to 0.32 and tracing-opentelemetry to 0.33 [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/15 21:10:08 UTC, 2 replies.
- [PR] [SPARK-59549][PYTHON][TEST] Add tests for pandas.Series.astype [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/09/15 21:12:24 UTC, 3 replies.
- [PR] [SPARK-59550] Group coupled crate families in dependabot updates [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/15 21:17:45 UTC, 2 replies.
- [PR] [SPARK-59551][SQL] Avoid recomputing existence default values per row in the Parquet, ORC, and CSV readers [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/15 21:36:23 UTC, 1 replies.
- [PR] [SPARK-59552] Upgrade jsonwebtoken to 10 and select the rust_crypto provider [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/15 21:38:39 UTC, 2 replies.
- [PR] [WIP][SPARK-51162][SQL] Support the TIME data type in the count_min_sketch function [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/15 23:20:13 UTC, 0 replies.
- [PR] [SPARK-59555][PYTHON][DOCS] Fix flaky DataFrameReader.json doctest by sorting multi-file read [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/09/16 00:18:41 UTC, 3 replies.
- [PR] [SPARK-59556][SQL] Compile a lookup-shaped CASE WHEN on a string key to a hash probe [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/16 00:53:27 UTC, 0 replies.
- [PR] [SPARK-59557][SQL] Avoid intermediate java.lang.String when casting integral and boolean to string [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/16 02:41:48 UTC, 0 replies.
- [PR] [SPARK-59447][CONNECT][PYTHON] Add ignore-null updates to the Auto CDC Python API [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/09/16 02:42:46 UTC, 13 replies.
- [PR] [SPARK-59558][SQL] Use ArrayDeque instead of LinkedList for the whole-stage codegen row buffer [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/16 03:47:09 UTC, 11 replies.
- [PR] [SPARK-59559] Add `kueue` E2E test for resources without `kueue.x-k8s.io/queue-name` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/16 04:06:55 UTC, 8 replies.
- Re: [PR] [SPARK-59502] Support publishing Kubernetes Event objects for SparkApplication and SparkCluster [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/16 04:11:32 UTC, 1 replies.
- [PR] [SPARK-59494][SQL] Memoize a join condition's common expression instead of inlining it into every reference [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/16 05:42:04 UTC, 0 replies.
- [PR] [SPARK-59560][MLLIB] Reduce Word2Vec driver peak memory during training [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/16 06:12:20 UTC, 1 replies.
- [PR] [SPARK-58532][PS][DOC] Explain NumPy ufunc type behavior [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/09/16 06:31:50 UTC, 2 replies.
- [PR] [SPARK-59562][ML] Fix stale values in reused multinomial logistic aggregation buffer [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/16 06:43:27 UTC, 4 replies.
- [PR] [SPARK-59563][ML] Use BLAS routines for vector L1 and L2 norms [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/16 07:12:28 UTC, 0 replies.
- [PR] [SPARK-59571][SQL][TESTS] Cover every TIME precision, null pattern and interval sign in ArrowCachedBatchSerializerSuite [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/09/16 08:59:33 UTC, 7 replies.
- [PR] [SPARK-59572][SQL] PartitionPredicate evaluation failure must not be reported as a partition match [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/09/16 09:28:09 UTC, 11 replies.
- [PR] [SPARK-59534][SQL] Support implicit casting for time_bucket timestamp arguments [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/09/16 09:45:00 UTC, 0 replies.
- [PR] [SPARK-59529][SQL] Reject ASOF JOIN MATCH_CONDITION operand that references no join input [spark] - posted by "LukaZdravic (via GitHub)" <gi...@apache.org> on 2026/09/16 10:25:39 UTC, 4 replies.
- [PR] [SPARK-59536][SQL][FOLLOWUP] Add nested comment migration note [spark] - posted by "aleksei-akhundov-db (via GitHub)" <gi...@apache.org> on 2026/09/16 10:26:30 UTC, 4 replies.
- [PR] [WIP][SPARK-57833][SQL] Support nanosecond-precision timestamps in timestampadd [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/16 10:30:17 UTC, 0 replies.
- [PR] [SPARK-59574][SQL] Apply injectHintResolutionRule in the single-pass Analyzer [spark] - posted by "s-maling-celonis (via GitHub)" <gi...@apache.org> on 2026/09/16 12:01:28 UTC, 12 replies.
- [PR] [SPARK-59540] Warn about deprecated Helm `enable` keys via `NOTES.txt` [spark-kubernetes-operator] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/16 12:09:35 UTC, 4 replies.
- [PR] [MINOR][CORE] Use ArrayDeque instead of LinkedList in TransportFrameDecoder [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/16 13:12:10 UTC, 2 replies.
- [PR] [SPARK-59272][SQL][FOLLOWUP] Keep partition filtering from narrowing a marked layout's key list [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/16 13:13:02 UTC, 8 replies.
- [PR] [SPARK-55278][CORE] Make the external UDF worker dispatcher factory configurable [spark] - posted by "zozo123 (via GitHub)" <gi...@apache.org> on 2026/09/16 13:52:31 UTC, 2 replies.
- Re: [PR] [SPARK-59573][SQL] Fix multi-value UNPIVOT with mixed types [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/16 14:08:12 UTC, 2 replies.
- Re: [PR] [SPARK-59554][SQL] Support the TIME data type in the count_min_sketch function [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/16 14:12:19 UTC, 6 replies.
- Re: [PR] [SPARK-57833][SQL] Support nanosecond-precision timestamps in timestampadd [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/16 14:14:59 UTC, 4 replies.
- Re: [PR] [SPARK-59502] Support K8s `Warning` events for `SparkApplication` and `SparkCluster` failures [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/16 14:16:35 UTC, 1 replies.
- [PR] [SPARK-59576] Support K8s `Normal` events for all `SparkApplication` and `SparkCluster` state transitions [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/16 14:39:29 UTC, 6 replies.
- [PR] [SPARK-59577][BUILD] Add Python test Dockerfiles to pyspark-core test module [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/09/16 14:45:01 UTC, 1 replies.
- [PR] [SPARK-59561][CORE] Reconcile ExecutorAllocationManager against AppStatusStore after a dropped StageSubmitted event [spark] - posted by "HwangDongJun (via GitHub)" <gi...@apache.org> on 2026/09/16 15:02:36 UTC, 1 replies.
- Re: [PR] [SPARK-59031][CONNECT][PYTHON] Support best-effort commands that no-op on servers missing the API [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/09/16 15:14:11 UTC, 1 replies.
- [PR] [SQL] Include original JDBC engine SQLSTATE in external engine syntax errors [spark] - posted by "alekjarmov (via GitHub)" <gi...@apache.org> on 2026/09/16 15:40:42 UTC, 0 replies.
- [PR] [SPARK-44702][SQL] Fix ExpressionEncoder derivation for case class fi… [spark] - posted by "Yuvraj2172 (via GitHub)" <gi...@apache.org> on 2026/09/16 15:59:55 UTC, 0 replies.
- [PR] [SPARK-59581][SQL] Avoid copying every input row in TakeOrderedAndProject top-N [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/16 16:05:50 UTC, 0 replies.
- [PR] [SPARK-59580][SQL] Reduce TreeNode cache allocation [spark] - posted by "bhollis-dbx (via GitHub)" <gi...@apache.org> on 2026/09/16 16:13:40 UTC, 13 replies.
- [PR] [SPARK-59583] Upgrade `actions/checkout` to v7 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/16 16:43:32 UTC, 3 replies.
- [PR] [SPARK-59584] Upgrade `actions/checkout` to v7 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/16 16:46:03 UTC, 3 replies.
- [PR] [SPARK-59585][INFRA] Upgrade `actions/checkout` to v7 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/16 16:48:30 UTC, 6 replies.
- [PR] [SPARK-59586] Support `spark.kubernetes.operator.events.excludedReasons` to skip K8s events by reason [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/16 16:50:41 UTC, 5 replies.
- [PR] [SQL] Correct expression foldability and determinism [spark] - posted by "n-young (via GitHub)" <gi...@apache.org> on 2026/09/16 16:52:13 UTC, 2 replies.
- Re: [PR] [SPARK-59509][CORE] Make UnsafeSorterIterator.getNumRecords() a consistent total [spark] - posted by "tdcmeehan (via GitHub)" <gi...@apache.org> on 2026/09/16 16:59:16 UTC, 4 replies.
- [PR] [SPARK-59587] Narrow Helm RBAC verbs for `events` to `get|create|patch` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/16 17:07:09 UTC, 0 replies.
- [PR] [SPARK-59588] Add `KueueWorkloadUtils` to request admission and release Kueue Workloads [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/16 17:42:50 UTC, 5 replies.
- [PR] [SPARK-59590] Remove unnecessary `try` keywords reported by Swift 6.4 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/16 17:59:28 UTC, 3 replies.
- [PR] [SPARK-59591] Add integration tests with Swift 6.4 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/16 18:07:20 UTC, 3 replies.
- [PR] [SPARK-59579][SQL] Keep the conditional-branch guards after the subexpression elimination shortcut peel [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/16 18:26:52 UTC, 7 replies.
- [PR] [SPARK-59271][PYTHON][TEST][FOLLOWUP] Fix pandas.api.types golden test with NumPy 1.23 [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/09/16 18:36:29 UTC, 3 replies.
- [PR] [SPARK-36082][SQL][FOLLOWUP] Floor the NAAJ broadcast threshold [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/16 18:40:20 UTC, 12 replies.
- [PR] [SPARK-59592] Use Java 21 at least in CI [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/16 18:48:42 UTC, 3 replies.
- [PR] [SPARK-57901][DOCS] Add documentation about OIDC credential propagation [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/09/16 19:04:20 UTC, 7 replies.
- [PR] [SPARK-59593] Add opt-in Kueue `Workload` informer [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/16 19:56:09 UTC, 4 replies.
- [PR] [SPARK-59594] Release Kueue `Workload` when `AppCleanUpStep` releases `SparkApplication` resources [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/16 20:04:41 UTC, 5 replies.
- [PR] [SPARK-59595][SQL] Optimize data source expression normalization [spark] - posted by "bhollis-dbx (via GitHub)" <gi...@apache.org> on 2026/09/16 20:58:59 UTC, 2 replies.
- Re: [PR] [SPARK-59587] Narrow Helm RBAC verbs for `events` to `create|get|patch` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/16 21:02:50 UTC, 3 replies.
- Re: [PR] [SPARK-55206][PYTHON][FOLLOWUP] Preserve Python semantics in UDF transpilation [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/16 21:04:02 UTC, 0 replies.
- [PR] [SPARK-59537] Honor `operatorRbac.configManagement.create` in Helm chart [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/16 21:21:55 UTC, 3 replies.
- [PR] [SPARK-59596] Fix Helm chart configuration table in `operations.md` to match `values.yaml` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/16 21:28:05 UTC, 4 replies.
- [PR] [SPARK-59597][SQL] Avoid quadratic CTE attribute restoration [spark] - posted by "bhollis-dbx (via GitHub)" <gi...@apache.org> on 2026/09/16 22:31:36 UTC, 3 replies.
- [PR] [SPARK-59553][CONNECT] Make SparkSession.addArtifact honor spark.jars.ivySettings [spark] - posted by "qianlan717 (via GitHub)" <gi...@apache.org> on 2026/09/16 23:10:40 UTC, 4 replies.
- [PR] [SPARK-59598][SQL] GetMapValue and ElementAt must not match a null map key [spark] - posted by "qingfureal (via GitHub)" <gi...@apache.org> on 2026/09/16 23:32:40 UTC, 1 replies.
- Re: [PR] [SPARK-56375][PANDAS/PS] Implement DataFrame.set_axis and Series.set_axis [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/17 00:41:54 UTC, 1 replies.
- Re: [PR] refactor: replace misleading approx_top_k terminology with frequent items naming [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/17 00:41:56 UTC, 1 replies.
- Re: [PR] [SPARK-43877][PYTHON] Fix behavior difference for compare binary functions. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/17 00:42:00 UTC, 1 replies.
- [PR] [SPARK-59599][SQL] Pre-size the ArrowConverters.serializeBatch output buffer to avoid repeated reallocation [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/17 01:38:20 UTC, 0 replies.
- [PR] [SPARK-59601][SQL] Close the output stream of a spilled DiskRowQueue [spark] - posted by "qingfureal (via GitHub)" <gi...@apache.org> on 2026/09/17 02:09:54 UTC, 0 replies.
- [PR] [MINOR][SQL][TEST] Make the not-null and null-map-key test assertions… [spark] - posted by "pedrumj2 (via GitHub)" <gi...@apache.org> on 2026/09/17 02:45:45 UTC, 0 replies.
- [PR] [MINOR][SQL] Hoist loop-invariant left row out of the AS-OF join inner scan [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/17 03:11:37 UTC, 0 replies.
- Re: [PR] [SPARK-59602][SQL] Handle floating-point normalization in array set operations [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/17 03:40:57 UTC, 3 replies.
- Re: [PR] [SPARK-58972][SQL][PROTOBUF] from_protobuf unwrapped primitive wrappers follow wrapper presence, not emit.default.values [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/17 08:03:47 UTC, 4 replies.
- Re: [PR] [SPARK-59582][SQL] Include original JDBC engine SQLSTATE in external engine syntax errors [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/17 09:24:00 UTC, 10 replies.
- [PR] [WIP][SPARK-57833][SQL] Support nanosecond-precision timestamps in timestampdiff [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/17 09:33:28 UTC, 0 replies.
- [PR] [SPARK-59606] Map `SparkCluster` pods by `spark.operator/spark-cluster-name` in `SparkClusterReconciler` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/17 10:19:24 UTC, 8 replies.
- [PR] [SPARK-59610] Fill missing `master` and `worker` requests of Kueue `Workload` for `SparkCluster` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/17 10:45:13 UTC, 9 replies.
- [PR] [SPARK-59589][SQL] Hand Expand's varying output columns to the consumer as globals [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/17 10:56:09 UTC, 0 replies.
- [PR] [SPARK-59603][SQL] Memoize a subexpression repeated inside a conditional branch [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/17 10:56:17 UTC, 0 replies.
- [PR] [SPARK-59606][FOLLOWUP] Use `spark.operator/spark-cluster-name` label selector for `SparkCluster` pod informer [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/17 11:19:37 UTC, 4 replies.
- [PR] [MINOR][CONNECT] Remove stale fallback parity tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/17 11:56:10 UTC, 0 replies.
- [PR] [SPARK-59564][SQL] Combine adjacent aggregation across a GroupPartitionsExec [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/09/17 11:59:18 UTC, 10 replies.
- [PR] [MINOR][CONNECT][PYTHON][TEST] Rename createDataFrame test module [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/17 12:08:08 UTC, 0 replies.
- [PR] [SPARK-59612] Wait for Kueue `Workload` admission in `AppInitStep` and `ClusterInitStep` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/17 12:35:42 UTC, 8 replies.
- [PR] [SPARK-59614][SQL] Compile the AS-OF join as-of/residual conditions to a Predicate [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/17 12:55:19 UTC, 0 replies.
- [PR] [SPARK-59615][SQL] Avoid an intermediate buffer in VectorizedPlainValuesReader.readGeoData [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/17 13:08:12 UTC, 0 replies.
- [PR] [SPARK-59616][SQL] Avoid copying every candidate row in the AS-OF join best-match scan [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/17 13:35:34 UTC, 2 replies.
- [PR] [SPARK-59617][SQL] Reuse a per-evaluator output buffer in JsonExpressionEvalUtils (json_tuple, JSON_TABLE) [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/17 13:40:18 UTC, 0 replies.
- [PR] [WIP][SPARK-59618][ML] Prevent concurrent F2J LAPACK initialization [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/17 14:13:57 UTC, 0 replies.
- [PR] [MINOR][GRAPHX] Remove unused arpack_combined_all dependency [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/17 14:27:21 UTC, 1 replies.
- [PR] [INFRA] Distinguish source and test modules in test selection [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/17 14:27:32 UTC, 6 replies.
- [PR] [SPARK-59619][CORE] Pre-size the RequestMessage serialization buffer in NettyRpcEnv [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/17 14:50:46 UTC, 1 replies.
- [PR] [SPARK-59621][CORE] Serialize StatusUpdate manually to avoid Enumeration/BigDecimal overhead [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/17 15:41:48 UTC, 0 replies.
- Re: [PR] [MINOR][SQL][TEST] Make test assertions protected functions for downstream reusability [spark] - posted by "pedrumj2 (via GitHub)" <gi...@apache.org> on 2026/09/17 15:43:16 UTC, 1 replies.
- [PR] [SPARK-59620][SQL] Late-materialization storage-filter pushdown via splicing [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/17 16:09:03 UTC, 1 replies.
- [PR] [WIP][SPARK-59600][SQL] Bind the resolved function owner across star preprocessing and function resolution [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2026/09/17 17:08:36 UTC, 0 replies.
- [PR] [WIP][CONNECT][PYTHON] Fix streaming query listener removal deadlock [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2026/09/17 17:25:55 UTC, 0 replies.
- [PR] [WIP][JDBC] Unwrap reflected SQL Server parser exceptions [spark] - posted by "alekjarmov (via GitHub)" <gi...@apache.org> on 2026/09/17 18:36:36 UTC, 0 replies.
- [PR] [SPARK-XXXXX][SQL] Validate the arity of connector-reported partition keys [spark] - posted by "tdcmeehan (via GitHub)" <gi...@apache.org> on 2026/09/17 18:53:02 UTC, 0 replies.
- Re: [PR] [SPARK-59455][PYTHON][FOLLOWUP] Clarify private Arrow-to-pandas array helpers [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/09/17 19:08:31 UTC, 3 replies.
- [PR] [SPARK-59622][PYTHON] Migrate Arrow map/iter UDF eval types to the EvalTypeHandler pipeline [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/09/17 21:57:42 UTC, 9 replies.
- [PR] [SPARK-59091][SQL] Emit the NaN guard in transpiled equality only for floating-point columns [spark] - posted by "jzhan-2026 (via GitHub)" <gi...@apache.org> on 2026/09/17 22:32:11 UTC, 4 replies.
- [PR] [SPARK-59572][SQL][FOLLOWUP] Clarify PartitionPredicate migration guide entry [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/09/17 22:32:49 UTC, 4 replies.
- [PR] [SPARK-59624][PYTHON] Move element-wise UDF conversion behind Arrow batch interfaces [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/09/18 00:20:32 UTC, 19 replies.
- [PR] Bump the kube group with 2 updates [spark-connect-gateway] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/09/18 00:30:57 UTC, 4 replies.
- [PR] Bump rand from 0.8.7 to 0.10.2 [spark-connect-gateway] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/09/18 00:31:11 UTC, 3 replies.
- [PR] [MINOR][SQL][DOCS] Correct SPJ configuration prerequisites and example [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/09/18 00:31:13 UTC, 4 replies.
- [PR] Bump jsonwebtoken from 9.3.1 to 11.0.0 [spark-connect-gateway] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/09/18 00:31:17 UTC, 3 replies.
- [PR] Bump base64 from 0.22.1 to 0.23.1 [spark-connect-gateway] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/09/18 00:31:24 UTC, 3 replies.
- [PR] Bump redis from 1.6.0 to 1.7.0 [spark-connect-gateway] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/09/18 00:31:30 UTC, 3 replies.
- Re: [I] Expose `preOptimizerRules` in session extensions API [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/18 00:41:52 UTC, 0 replies.
- [PR] [SPARK-59572][SQL][FOLLOWUP][4.2] Clarify PartitionPredicate migration guide entry [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/09/18 01:17:24 UTC, 4 replies.
- Re: [PR] [SPARK-51579][SQL] Avoid EOFException in CSV Parsing by Appending Line Terminator [spark] - posted by "Richard-Durkee (via GitHub)" <gi...@apache.org> on 2026/09/18 02:10:54 UTC, 0 replies.
- [PR] [MINOR][SQL] Remove redundant second modulo in integral MathUtils.pmod [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/18 03:18:07 UTC, 0 replies.
- Re: [I] [SPARK-57743][SQL] Addition of a partition function in datalake V1 tables [spark] - posted by "konjac (via GitHub)" <gi...@apache.org> on 2026/09/18 05:00:17 UTC, 0 replies.
- Re: [PR] [MINOR][CONNECT][PYTHON][TEST] Remove stale fallback parity tests [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/09/18 05:44:26 UTC, 4 replies.
- Re: [PR] [MINOR][CONNECT][PYTHON][TEST] Rename DataFrame creation test modules [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/18 05:45:34 UTC, 1 replies.
- Re: [PR] [SPARK-59630][PS][DOC] Explain NumPy ufunc type behavior [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/09/18 07:04:08 UTC, 1 replies.
- [PR] [SPARK-59631][SQL] Preserve cached V1 time-travel snapshots after table writes [spark] - posted by "joelrobin18 (via GitHub)" <gi...@apache.org> on 2026/09/18 08:36:06 UTC, 8 replies.
- [PR] [SQL] Make unary trim collation-aware for case-insensitive ICU collations [spark] - posted by "mkaravel (via GitHub)" <gi...@apache.org> on 2026/09/18 12:31:02 UTC, 0 replies.
- [PR] [SPARK-59578] Clarify that Kueue `integrations.externalFrameworks` is not needed in `operations.md` [spark-kubernetes-operator] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/18 12:47:34 UTC, 2 replies.
- Re: [PR] [SPARK-58729][SQL] Support the ANSI SQL/JSON JSON_OBJECT constructor function [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/18 13:47:12 UTC, 22 replies.
- Re: [PR] [SPARK-59632][SQL] Unwrap reflected SQL Server parser exceptions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/18 13:50:05 UTC, 2 replies.
- Re: [PR] [SPARK-59633][SQL] Make unary trim collation-aware for case-insensitive ICU collations [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/18 14:23:24 UTC, 14 replies.
- [PR] [SPARK-59635] Requeue immediately when AppRunningStep changes the running state [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/18 14:40:09 UTC, 0 replies.
- Re: [PR] [SPARK-59538] Resolve evolved nested fields positionally in column-list inserts [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2026/09/18 14:48:46 UTC, 4 replies.
- Re: [PR] [SPARK-59635] Requeue immediately when `AppRunningStep` changes the running state [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/18 14:50:20 UTC, 2 replies.
- [PR] [SPARK-59636][CORE] Fix integer overflow in GcmTransportCipher [spark] - posted by "aajisaka (via GitHub)" <gi...@apache.org> on 2026/09/18 15:06:22 UTC, 3 replies.
- [PR] [SPARK-59637] Remove duplicate driver termination check from `AppDriverStartObserver` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/18 15:35:14 UTC, 5 replies.
- [PR] [SPARK-59638] Support K8s events for Kueue admission of `SparkApplication` and `SparkCluster` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/18 16:13:11 UTC, 0 replies.
- [PR] [SPARK-59639][SQL] Tighten nullability of Divide, Remainder, IntegralDivide, and Pmod under ANSI mode [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/18 16:21:58 UTC, 1 replies.
- [PR] [SPARK-59641][K8S] Redact `spark.exit-exception` annotation with `spark.redaction.string.regex` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/18 16:34:38 UTC, 6 replies.
- Re: [PR] [SPARK-30628][SQL] Support DPP and subquery partition pruning for V2 file sources [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/18 16:46:56 UTC, 3 replies.
- [PR] [SPARK-59317][SQL] Unwrap the cast of a DSv2 scalar subquery runtime filter before pushing it down [spark] - posted by "Vivek1106-04 (via GitHub)" <gi...@apache.org> on 2026/09/18 17:07:13 UTC, 1 replies.
- [PR] [SPARK-59644] Add Kueue `ResourceFlavor` v1beta2 model [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/18 17:07:17 UTC, 5 replies.
- [PR] [SPARK-59643][SQL] Tighten CheckOverflow nullability to match MakeDecimal [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/18 17:09:35 UTC, 2 replies.
- [PR] [SPARK-59640][SDP] SCD2 Ignore-null support; add version-map authorship operations [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/09/18 17:36:10 UTC, 6 replies.
- Re: [PR] [SPARK-59534][SQL] Support implicit casting of DATE, STRING, and TIME to TIMESTAMP in time_bucket [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/09/18 17:43:15 UTC, 2 replies.
- [PR] [SPARK-59646] Upgrade `gRPC Swift NIO Transport` to 2.10.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/18 18:04:53 UTC, 3 replies.
- [PR] [SPARK-59645][SDP] SCD1 Ignore-null support; Refactor SCD1 microbatch reconciliation into strategies [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/09/18 18:05:36 UTC, 4 replies.
- [PR] [SPARK-59647][BUILD] Upgrade Jetty to 12.1.13 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/18 18:09:39 UTC, 4 replies.
- [PR] [SPARK-59648][BUILD] Upgrade `objenesis` to 3.6 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/18 18:13:26 UTC, 4 replies.
- [PR] [SPARK-59649] Upgrade `slf4j` to 2.0.19 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/18 18:15:22 UTC, 2 replies.
- [PR] [SPARK-59650][BUILD] Upgrade `lz4-java` to 1.11.3 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/18 18:18:03 UTC, 4 replies.
- [PR] [SPARK-59651][BUILD] Upgrade `xbean-asm9-shaded` to 5.0.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/18 18:19:36 UTC, 3 replies.
- [PR] [SPARK-59652][BUILD] Upgrade ZooKeeper to 3.9.6 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/18 19:07:30 UTC, 4 replies.
- [PR] [SPARK-59653][SQL] Lazily materialize UnsafeMapData key/value arrays for escape analysis [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/18 20:47:53 UTC, 0 replies.
- Re: [PR] [SPARK-59638] Support K8s events for `Kueue` admission of `SparkApplication` and `SparkCluster` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/18 21:22:46 UTC, 7 replies.
- [PR] [SPARK-59654] Resolve Kueue `ResourceFlavor` node labels and tolerations of admitted `Workload` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/18 21:45:14 UTC, 8 replies.
- [PR] [SPARK-59655] Fill `priorityClassRef` and `priority` of Kueue `Workload` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/18 22:15:14 UTC, 10 replies.
- [PR] [SPARK-59656][K8S] Skip `spark.exit-exception` annotation in the submission client of cluster mode [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/18 22:57:05 UTC, 5 replies.
- [PR] Bump org.bouncycastle:bcprov-jdk18on from 1.84 to 1.85 [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/09/19 00:14:28 UTC, 2 replies.
- Re: [PR] [SPARK-57331][SDP] Support native CDC changelog sources as input to AutoCDC flows [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/19 00:41:02 UTC, 1 replies.
- Re: [PR] [SPARK-56999][PYTHON] Fix mapInArrow opaque getInt error by coercing output to declared schema [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/19 00:41:05 UTC, 1 replies.
- Re: [PR] [SPARK-43253][SQL] Assign a name to the error class _LEGACY_ERROR_TEMP_2017 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/19 00:41:08 UTC, 1 replies.
- [PR] [SQL] Guaranteed CTE shuffle reuse [spark] - posted by "AveryQi115 (via GitHub)" <gi...@apache.org> on 2026/09/19 01:13:37 UTC, 0 replies.
- [PR] [SQL] Add configurable retry attempts and backoff delay for JDBC connection establishment [spark] - posted by "CodersAcademy006 (via GitHub)" <gi...@apache.org> on 2026/09/19 05:47:14 UTC, 0 replies.
- [PR] [SPARK-59657] Update the redis and base64 dependencies [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/19 07:36:27 UTC, 2 replies.
- [PR] [SPARK-59658][SQL] Rewrite sliding window frames as prefix differences [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/09/19 09:48:01 UTC, 0 replies.
- [PR] [MINOR][SQL] Document TIME as an accepted histogram_numeric input type [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/19 10:29:17 UTC, 3 replies.
- [PR] [SPARK-59659][SQL] Consolidate the repeated cluster-key matching in Partitioning.satisfies0 [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/19 11:08:41 UTC, 5 replies.
- Re: [PR] [SPARK-58555][SQL] Add new tests for JDBC DS Join pushdown [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2026/09/19 13:02:54 UTC, 6 replies.
- Re: [PR] [SPARK-59600][SQL] Bind the resolved function owner across star preprocessing and function resolution [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/19 14:11:18 UTC, 4 replies.
- [PR] [SPARK-59662] Check for isRepartitionBatch can crash if metadata keys are missing [spark] - posted by "ivasilyev1 (via GitHub)" <gi...@apache.org> on 2026/09/19 18:37:06 UTC, 2 replies.
- [PR] [SPARK-59664] Use official `Swift 6.4` Docker image instead of nightly [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/19 22:17:34 UTC, 3 replies.
- [PR] [SPARK-59665] Upgrade `operator-sdk` to 5.6.1 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/19 22:42:35 UTC, 3 replies.
- [PR] [SPARK-59666][K8S] Avoid creating a K8s client when there is no driver pod [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/19 22:52:42 UTC, 4 replies.
- [PR] [SPARK-59667] Do not treat a failed read as a missing secondary resource [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/19 23:51:48 UTC, 9 replies.
- Re: [PR] [SPARK-57296][SPARK-57346][SQL] Fix incorrect aggregate resolution in ORDER BY with GROUPING ANALYTICS [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/20 00:46:57 UTC, 1 replies.
- Re: [I] Is Spark limited to split the Parquet read granularity by Row Group level only? [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/20 00:47:02 UTC, 0 replies.
- Re: [PR] [SPARK-56479][SQL] df.cache() with DSv2 interfaces to enable V2ScanRelationPushDown optimizer rules [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/20 00:47:04 UTC, 1 replies.
- [PR] [SPARK-59670][CORE] Avoid redundant waiting-stage scans and job-preflight traversals [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/09/20 06:41:40 UTC, 3 replies.
- [PR] [SPARK-59672][SQL] Bind SQL parameters when a custom parser is injected [spark] - posted by "franciscoabsampaio (via GitHub)" <gi...@apache.org> on 2026/09/20 09:02:30 UTC, 0 replies.
- [PR] [SPARK-59674][CORE] Fix Comparison method violates its general contract in FIFOSchedulingAlgorithm [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2026/09/20 14:18:11 UTC, 5 replies.
- Re: [PR] [MINOR][INFRA] Add Cursor Cloud Agent development environment [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/09/20 17:34:33 UTC, 1 replies.
- [PR] [SPARK-59675] Migrate `Examples` to Swift 6.4 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/20 18:25:16 UTC, 3 replies.
- [PR] [SPARK-59677] Support K8s events for suspended `SparkApplication` and `SparkCluster` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/20 19:23:18 UTC, 4 replies.
- [PR] [SPARK-59676] Use the current branch version as the default JIRA fix version in `merge_spark_pr.py` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/20 20:09:46 UTC, 4 replies.
- [PR] [SPARK-59679] Upgrade PMD to 7.27.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/20 20:36:51 UTC, 5 replies.
- [PR] [SPARK-59680] Do not release the Kueue quota of a running driver or master on a failed read [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/20 21:56:22 UTC, 12 replies.
- [PR] [SPARK-59678][SQL] Ignore nullability when matching pivot values to the pivot column [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/09/20 22:21:04 UTC, 0 replies.
- Re: [I] Automatically create the spark history log directory [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/21 00:46:13 UTC, 0 replies.
- Re: [PR] [SQL] Update grammar/TableChange to allow CLUSTER BY expressions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/21 00:46:14 UTC, 1 replies.
- Re: [PR] [SPARK-59673][SQL] Floor the NAAJ broadcast threshold [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/21 03:34:55 UTC, 8 replies.
- [PR] [SPARK-59579][4.3][SQL] Keep the conditional-branch guards after the subexpression elimination shortcut peel [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/21 04:09:28 UTC, 3 replies.
- Re: [PR] [SPARK-59681][SQL] Guaranteed CTE shuffle reuse [spark] - posted by "AveryQi115 (via GitHub)" <gi...@apache.org> on 2026/09/21 05:15:13 UTC, 5 replies.
- [PR] [WIP][SQL][HIVE] Support first-class CHAR/VARCHAR in script TRANSFORM output [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/09/21 05:17:20 UTC, 0 replies.
- [PR] [WIP][SPARK-59684][SQL] pivot() on a struct column fails unless the pivot values are given explicitly [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/09/21 05:56:28 UTC, 0 replies.
- Re: [PR] [SPARK-47672][SQL][PYTHON] Mark PythonUDF expensive to avoid double evaluation [spark] - posted by "psavalle (via GitHub)" <gi...@apache.org> on 2026/09/21 08:07:52 UTC, 4 replies.
- [PR] [WIP][SPARK-59685][SQL] Keep clause-free SQL/JSON constructor canonical SQL bound to the built-in [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2026/09/21 08:34:28 UTC, 0 replies.
- [PR] [SPARK-59686][SQL] Clamp the rounding scale in round and bround [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/09/21 09:00:57 UTC, 0 replies.
- [PR] [SPARK-31760][SQL] Simplify contained integral range predicates [spark] - posted by "xiaoh1024 (via GitHub)" <gi...@apache.org> on 2026/09/21 09:57:54 UTC, 8 replies.
- [PR] [SPARK-59687][SQL] Use exists instead of find(...).isDefined in WindowExpression.hasWindowExpression [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/21 10:15:38 UTC, 0 replies.
- [PR] [SPARK-59671][SQL] Validate a co-partitioned pair by its children's pairing [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/09/21 10:32:53 UTC, 30 replies.
- Re: [PR] [SPARK-50110][SQL] Fix CSV parsing when numeric values have surrounding whitespace [spark] - posted by "aviyehuda (via GitHub)" <gi...@apache.org> on 2026/09/21 11:27:36 UTC, 0 replies.
- [PR] [SPARK-59688][SQL] Fix wrong results when a storage-partitioned join skips the reduce on coinciding partition keys [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/21 11:46:24 UTC, 6 replies.
- Re: [PR] [SPARK-50593][SQL] SPJ: Support truncate transform via generalized ReducibleFunction API [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/21 11:55:39 UTC, 9 replies.
- [PR] [SPARK-59689][SQL] Run EXECUTE IMMEDIATE commands at execution time [spark] - posted by "matvei-zamiatin-db (via GitHub)" <gi...@apache.org> on 2026/09/21 12:46:49 UTC, 5 replies.
- [PR] [SPARK-59609][SQL] Fix Parquet/ORC aggregate push-down reading statistics from the wrong column [spark] - posted by "hemanthboyina (via GitHub)" <gi...@apache.org> on 2026/09/21 13:29:04 UTC, 2 replies.
- [PR] [SPARK-59690] Exclude PMD `GodClass` rule [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/21 14:59:14 UTC, 3 replies.
- Re: [PR] [SPARK-58966][SQL] Resolve SQL variables in UPDATE and MERGE INTO conditions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/21 15:40:29 UTC, 3 replies.
- Re: [PR] [SPARK-59528][SQL] Align ASOF MATCH_CONDITION operand type check with the comparison for arrays and structs [spark] - posted by "LukaZdravic (via GitHub)" <gi...@apache.org> on 2026/09/21 15:55:17 UTC, 2 replies.
- [PR] [SPARK-59692] Upgrade the minimum K8s version to v1.35 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/21 15:58:29 UTC, 3 replies.
- [PR] [SPARK-57812][SQL] Support catalog column-statistics serialization for nanosecond-precision timestamps [spark] - posted by "vrjdev (via GitHub)" <gi...@apache.org> on 2026/09/21 16:10:24 UTC, 3 replies.
- [PR] [SPARK-59358][SDP] SCD2 Ignore-null support; Coalesce ignored-null values [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/09/21 17:10:40 UTC, 1 replies.
- [PR] [SPARK-59694] Do not treat an unanswered request as a permanent failure [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/21 17:33:08 UTC, 10 replies.
- Re: [PR] [SPARK-59623][SS][PYTHON] Fix streaming query listener removal deadlock [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2026/09/21 17:43:34 UTC, 1 replies.
- Re: [PR] [SPARK-39031][SQL] NaN pivot values never match on the PivotFirst fast path [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/09/21 17:56:01 UTC, 2 replies.
- [PR] [SPARK-40608][SQL] Push necessary predicates from partially translatable V2 filters [spark] - posted by "xiaoh1024 (via GitHub)" <gi...@apache.org> on 2026/09/21 17:59:15 UTC, 4 replies.
- [PR] [WIP][CORE] Skip the redundant record comparator in the external-sort spill merge when the key prefix is a total order [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/21 19:01:11 UTC, 0 replies.
- Re: [PR] [SPARK-59696][SQL] Remove redundant second modulo in integral MathUtils.pmod [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/21 19:09:45 UTC, 1 replies.
- [PR] [SPARK-59698][SQL][SS] Reject ASOF joins with streaming right side [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/09/21 20:27:30 UTC, 12 replies.
- [PR] [SPARK-59699][CONNECT] Make DataFrameReader options case-insensitive [spark] - posted by "haoyangeng-db (via GitHub)" <gi...@apache.org> on 2026/09/21 21:09:32 UTC, 2 replies.
- [PR] [SPARK-59700] Add a minimum interval between unchanged K8s event repeats [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/21 21:13:44 UTC, 7 replies.
- [PR] [SPARK-59549][PYTHON][TEST][FOLLOWUP] Add ARM expected results for pandas.Series.astype tests [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/09/21 21:29:22 UTC, 3 replies.
- [PR] [SPARK-59701][CONNECT] Fix flaky test_reap_server_does_not_expire_when_idle_retirement_is_disabled [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/09/21 21:30:55 UTC, 0 replies.
- Re: [PR] [SPARK-59701][TESTS] Fix flaky test_reap_server_does_not_expire_when_idle_retirement_is_disabled [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/09/21 21:32:26 UTC, 0 replies.
- Re: [PR] [SPARK-58592][CORE] Redact secrets in Standalone Master RequestMasterState RPC [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/21 22:20:09 UTC, 3 replies.
- [PR] [SPARK-59702][K8S][4.X] Use `KeyToPathBuilder` instead of `KeyToPath` constructor [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/21 22:42:14 UTC, 4 replies.
- Re: [PR] [SPARK-59693][SQL][PYTHON] Mark PythonUDF expensive to avoid double evaluation [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/09/21 23:43:56 UTC, 1 replies.
- [PR] [SPARK-59703][INFRA] Update the dependency list for nogil dockerfile [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/09/21 23:56:58 UTC, 2 replies.
- [PR] [SPARK-59704][PYTHON] Migrate Arrow aggregate and window UDF eval types to the EvalTypeHandler pipeline [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/09/22 00:00:26 UTC, 2 replies.
- [PR] [SPARK-59705][INFRA] Use pyproject.toml for pandas 3 dependency list [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/09/22 00:03:07 UTC, 2 replies.
- [PR] [SQL] Fix JDBC V2 join pushdown for partitioned reads and partial AVG [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2026/09/22 00:08:56 UTC, 6 replies.
- Re: [PR] [SPARK-55792][PS] Optimize DataFrame diff axis=0 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/22 00:42:20 UTC, 1 replies.
- Re: [PR] [SPARK-59696][SQL] Skip the redundant second modulo in integral MathUtils.pmod for positive divisors [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/22 01:50:38 UTC, 4 replies.
- [PR] [SPARK-59706][SQL] Hoist loop-invariant left row out of the AS-OF join inner scan [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/22 02:16:00 UTC, 6 replies.
- [PR] [SPARK-57547][SQL] Fix NPE in PartitionKeyedAccumulator during initialization race condition [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2026/09/22 02:17:37 UTC, 5 replies.
- Re: [PR] [SPARK-59707][CORE] Use ArrayDeque instead of LinkedList in TransportFrameDecoder [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/22 02:30:09 UTC, 2 replies.
- Re: [PR] [SPARK-59273][SQL][TEST][FOLLOWUP] Cover string fill with mixed schemas [spark] - posted by "zhangxinyao88 (via GitHub)" <gi...@apache.org> on 2026/09/22 02:40:12 UTC, 6 replies.
- [PR] [SPARK-56925][PYSPARK][SQL] Support bare `if x` in UDF transpilation [spark] - posted by "jzhan-2026 (via GitHub)" <gi...@apache.org> on 2026/09/22 02:52:06 UTC, 0 replies.
- [I] Informer watches drop every ~50s behind an idle-timeout load balancer because the hard-wired Vert.x HTTP client never sends WebSocket pings [spark-kubernetes-operator] - posted by "gada121982 (via GitHub)" <gi...@apache.org> on 2026/09/22 04:40:18 UTC, 5 replies.
- [PR] [SPARK-59708][CONNECT] Tolerate serialVersionUID drift of sql.types classes when deserializing Scala UDF payloads [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/09/22 04:57:23 UTC, 9 replies.
- [PR] [SPARK-59688][SQL][4.3] Fix wrong results when a storage-partitioned join skips the reduce on coinciding partition keys [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/22 07:39:14 UTC, 3 replies.
- [PR] [SPARK-59688][SQL][4.2] Fix wrong results when a storage-partitioned join skips the reduce on coinciding partition keys [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/22 07:39:29 UTC, 3 replies.
- [PR] [SPARK-59613] Fix intermittent 404s on SparkSQL ExecutionPage [spark] - posted by "samra-h (via GitHub)" <gi...@apache.org> on 2026/09/22 07:55:44 UTC, 0 replies.
- [PR] [SPARK-59628][SQL] Report a missing MATCH_CONDITION in ASOF JOIN instead of parsing ASOF as an alias [spark] - posted by "AMC-hawk (via GitHub)" <gi...@apache.org> on 2026/09/22 08:22:20 UTC, 0 replies.
- Re: [PR] [SPARK-57561][SQL] Add size validation to bitmap_or_agg and bitmap_and_agg [spark] - posted by "minni31 (via GitHub)" <gi...@apache.org> on 2026/09/22 08:28:29 UTC, 3 replies.
- [I] SparkApplication stuck in DriverRequested when the driver Pod is terminal with empty containerStatuses (PodGC node deletion / node DiskPressure eviction) [spark-kubernetes-operator] - posted by "robertpi (via GitHub)" <gi...@apache.org> on 2026/09/22 09:04:36 UTC, 3 replies.
- Re: [PR] [SPARK-59687][SQL] Use exists instead of find(...).isDefined/isEmpty in catalyst and SQL core [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/22 09:08:23 UTC, 2 replies.
- Re: [PR] [SPARK-59620][SQL] Late-materialization storage-filter pushdown in the vectorized Parquet reader [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/22 12:05:51 UTC, 40 replies.
- Re: [I] Upgrade base images to Ubuntu 24.04 [spark-docker] - posted by "RobbertDM (via GitHub)" <gi...@apache.org> on 2026/09/22 12:13:47 UTC, 6 replies.
- [PR] [SPARK-34122][SQL] Remove repeated deterministic CASE conditions [spark] - posted by "xiaoh1024 (via GitHub)" <gi...@apache.org> on 2026/09/22 12:58:31 UTC, 0 replies.
- Re: [PR] [SPARK-59379][CORE] Add an ASCII fast-path to UTF8String position lookups, warmed by numChars() [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/22 13:02:04 UTC, 1 replies.
- Re: [PR] [SPARK-59701][PYTHON][TESTS] Fix flaky test_reap_server_does_not_expire_when_idle_retirement_is_disabled [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/22 15:11:36 UTC, 1 replies.
- [PR] [SPARK-59711][CORE] Stop LiveExecutorStageSummary from retaining a full v1.TaskMetrics tree [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2026/09/22 15:31:47 UTC, 8 replies.
- [PR] [SPARK-59712] Apply Kueue `ResourceFlavor` node labels and tolerations to Spark pods [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/22 15:44:03 UTC, 4 replies.
- Re: [PR] [SPARK-59710][SQL] Fix JDBC V2 join pushdown for partitioned reads and partial AVG [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2026/09/22 15:47:51 UTC, 2 replies.
- [PR] [SPARK-59713] Add a large-group case to AsOfJoinBenchmark [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/22 16:09:26 UTC, 0 replies.
- [PR] [SPARK-59714][CORE] Align `TaskSchedulerImpl.executorDecommission` locking with `executorLost` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/22 16:41:30 UTC, 4 replies.
- Re: [PR] [SPARK-59713][SQL][TESTS] Add a large-group case to `AsOfJoinBenchmark` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/22 16:43:21 UTC, 6 replies.
- [PR] [SPARK-59715] Release the Kueue quota of a terminated application with retained resources [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/22 17:54:39 UTC, 5 replies.
- [PR] [SPARK-59716][SQL] Skip the per-match `UnsafeRow` copy when the AS-OF join right-side buffer is in memory [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/22 17:58:39 UTC, 6 replies.
- [PR] [WIP][SQL] Mark CheckOverflow as null-intolerant to match MakeDecimal [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/22 18:27:46 UTC, 0 replies.
- [PR] [SPARK-59695] SCD1 Ignore-null support; Introduce version map in `cdc_metadata` [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/09/22 19:00:36 UTC, 0 replies.
- [PR] [WIP][K8S] Avoid scanning healthy executor pods in lifecycle processing [spark] - posted by "ForVic (via GitHub)" <gi...@apache.org> on 2026/09/22 19:40:45 UTC, 0 replies.
- Re: [PR] [SPARK-59390][CORE] Build padding in UTF8String.lpad/rpad with a shared repeat-fill helper [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/22 19:52:50 UTC, 2 replies.
- Re: [PR] [SPARK-39031][SQL] Match NaN and NULL pivot values on the PivotFirst fast path [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/09/22 19:56:51 UTC, 0 replies.
- [PR] [SPARK-59717][SQL] Fix MatchError when grouping by a UDT column backed by a primitive type [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/09/22 19:59:56 UTC, 2 replies.
- [PR] [SPARK-59608][SQL] Keep the FILTER clause when OptimizeWindowFunctions rewrites first to nth_value [spark] - posted by "mrutunjay-kinagi (via GitHub)" <gi...@apache.org> on 2026/09/22 20:12:33 UTC, 2 replies.
- [PR] [SPARK-59629][SQL] Resolve columnNameOfCorruptRecord with the case-sensitivity conf [spark] - posted by "mrutunjay-kinagi (via GitHub)" <gi...@apache.org> on 2026/09/22 20:41:29 UTC, 0 replies.
- [PR] [SPARK-59718][SQL] Add opt-in in-process Python UDF execution via Arrow C Data Interface [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/22 21:04:33 UTC, 35 replies.
- [PR] [SPARK-59720] Stop the infinite status update loop of a failed SparkCluster [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/22 21:29:42 UTC, 5 replies.
- [PR] [SPARK-59721][SQL] Keep storage-partitioned join when a partition key cannot be resolved [spark] - posted by "anuragmantri (via GitHub)" <gi...@apache.org> on 2026/09/22 22:02:18 UTC, 2 replies.
- [PR] [SPARK-52816][CORE][SQL] Remove direct usage of `sun.misc.Signal` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/22 22:11:52 UTC, 4 replies.
- [PR] [MINOR][SQL] Avoid Unicode escapes in trim tests [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/22 23:30:00 UTC, 11 replies.
- Re: [PR] [SPARK-56325][SDP] Refactor FlowSystemMetadata.flowCheckpointsDirOpt to avoid scala.Option [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/23 00:40:19 UTC, 1 replies.
- [PR] [SPARK-59725][K8S] Create Volcano PodGroup after driver pod creation [spark] - posted by "ruanwenjun (via GitHub)" <gi...@apache.org> on 2026/09/23 02:23:26 UTC, 0 replies.
- [PR] [SPARK-59005][INFRA][FOLLOWUP] Suggest JIRA affects versions for unreleased major and minor releases [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/09/23 02:25:11 UTC, 7 replies.
- Re: [PR] [SPARK-59685][SQL] Keep clause-free SQL/JSON constructor canonical SQL bound to the built-in [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/23 04:00:36 UTC, 7 replies.
- Re: [PR] [SPARK-59512][PYTHON] Test repeated parsing of collation schema metadata [spark] - posted by "laserninja (via GitHub)" <gi...@apache.org> on 2026/09/23 05:22:55 UTC, 2 replies.
- [PR] [SPARK-59723][SQL] Skip preferred locations when ignoreDataLocality is enabled [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2026/09/23 05:41:34 UTC, 0 replies.
- [PR] [MINOR][SQL] Fix StructField Scalafmt check [spark] - posted by "ruanwenjun (via GitHub)" <gi...@apache.org> on 2026/09/23 05:46:30 UTC, 3 replies.
- [PR] Bump the opentelemetry group with 6 updates [spark-connect-gateway] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/09/23 05:46:58 UTC, 2 replies.
- [PR] Bump uuid from 1.24.0 to 1.26.1 [spark-connect-gateway] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/09/23 05:47:34 UTC, 0 replies.
- [PR] Bump jsonwebtoken from 10.4.0 to 11.1.0 [spark-connect-gateway] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/09/23 05:47:52 UTC, 0 replies.
- [PR] [SPARK-59448][SQL] Support IGNORE NULL UPDATES in Auto CDC SQL syntax [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/09/23 05:55:15 UTC, 3 replies.
- [PR] [SPARK-59146][SQL] Retain qualified access to source columns after pipe SET [spark] - posted by "joelrobin18 (via GitHub)" <gi...@apache.org> on 2026/09/23 06:31:10 UTC, 0 replies.
- Re: [PR] [SPARK-59725][K8S] Create Volcano PodGroup with driver owner reference after driver pod creation [spark] - posted by "ruanwenjun (via GitHub)" <gi...@apache.org> on 2026/09/23 06:40:55 UTC, 0 replies.
- [PR] [SPARK-59729] Detect a terminated driver pod without container statuses [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/23 07:19:19 UTC, 5 replies.
- [PR] [SPARK-59730] Update `architecture.md` to reflect the current code [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/23 07:34:36 UTC, 4 replies.
- [PR] [SPARK-59732] Terminate as `ResourceReleased` when resources are force released for restart [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/23 08:05:37 UTC, 9 replies.
- [PR] [WIP][SPARK-55278][SQL] Execute scalar external UDFs through worker sessions [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2026/09/23 08:16:49 UTC, 0 replies.
- [PR] [SPARK-59733][SQL][TESTS] Cover the p=7/8 boundary in nanosecond timestamp widening [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/23 08:51:50 UTC, 3 replies.
- [PR] [SPARK-59727][PYTHON] Migrate Arrow incremental aggregate and window UDF eval types to the EvalTypeHandler pipeline [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/09/23 08:59:29 UTC, 8 replies.
- [PR] [MINOR][YARN] Dump thread stacks when SparkContext initialization times out in ApplicationMaster [spark] - posted by "singer-bin (via GitHub)" <gi...@apache.org> on 2026/09/23 09:13:06 UTC, 1 replies.
- Re: [PR] [SPARK-57833][SQL] Support nanosecond-precision timestamps in timestampdiff [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/23 09:25:32 UTC, 0 replies.
- [PR] [SPARK-59735] Use `static-debian13` distroless image in `Examples` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/23 09:45:28 UTC, 3 replies.
- [PR] [SPARK-59736] Use `Swift 6.4` Docker image in all Linux CI jobs [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/23 09:48:01 UTC, 3 replies.
- [PR] [SPARK-59737][BUILD] Ban `sun.misc.Signal` usage except `SignalUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/23 09:53:06 UTC, 5 replies.
- [PR] [SPARK-59738] Install Chainsaw from a pinned release binary in CI [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/23 10:13:14 UTC, 3 replies.
- [PR] [SPARK-59739] Add `since` Javadoc tag for all public `spark-operator-api` methods [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/23 10:18:26 UTC, 4 replies.
- [PR] [SPARK-59740][SQL][TESTS] Add nanosecond timestamp DML and file roundtrip coverage [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/23 10:24:03 UTC, 0 replies.
- [PR] [SPARK-59742] Build the operator image once and share it via artifact in CI [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/23 10:42:48 UTC, 3 replies.
- [PR] [SPARK-59734] Deprecate the unused `resourceRetainPolicy` parameter of `ApplicationStatus.terminateOrRestart` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/23 10:48:19 UTC, 4 replies.
- Re: [PR] [SPARK-58206][CORE][SQL] Add custom write metrics to the pluggable shuffle framework [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/23 11:22:15 UTC, 1 replies.
- [PR] [SPARK-59741][SQL] Run CALL at execution time [spark] - posted by "matvei-zamiatin-db (via GitHub)" <gi...@apache.org> on 2026/09/23 11:54:32 UTC, 0 replies.
- [PR] [SPARK-59746][SQL][TESTS] Improve golden file testing for hints [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/09/23 12:52:11 UTC, 4 replies.
- Re: [PR] [SPARK-59719][SQL] Mark CheckOverflow as null-intolerant to match MakeDecimal [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/23 13:01:59 UTC, 6 replies.
- [PR] [SPARK-59747][CORE] Don't retry compaction of rolled event log files with malformed input [spark] - posted by "DengYiping (via GitHub)" <gi...@apache.org> on 2026/09/23 13:06:13 UTC, 1 replies.
- Re: [PR] [SPARK-59528][SQL] Align ASOF MATCH_CONDITION operand type check with the comparison it builds [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/23 13:13:50 UTC, 1 replies.
- [PR] [SPARK-59627][SQL] Report INCOMPATIBLE_JOIN_TYPES for unsupported join types for ASOF JOIN [spark] - posted by "LukaZdravic (via GitHub)" <gi...@apache.org> on 2026/09/23 14:10:18 UTC, 0 replies.
- [PR] [SPARK-59748][CORE] Loser tree + small-k linear merge for UnsafeSorterSpillMerger [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/23 14:34:25 UTC, 1 replies.
- [PR] [SPARK-58209][SQL] Mark CallMethodViaReflection stateful to prevent argument buffer data races [spark] - posted by "anshulbaliga7 (via GitHub)" <gi...@apache.org> on 2026/09/23 14:41:10 UTC, 2 replies.
- [PR] [SPARK-59743] Consolidate `Helm Tests` matrix jobs into a single job [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/23 14:54:08 UTC, 4 replies.
- Re: [PR] [SPARK-59744][UDF] Execute scalar external UDFs through worker sessions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/23 14:55:25 UTC, 11 replies.
- [PR] [SPARK-59750] Support `spec.suspend` for a running `SparkCluster` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/23 15:33:06 UTC, 10 replies.
- [PR] [SPARK-57897][BUILD][FOLLOWUP] Use AWS SDK bundle in credential-aws [spark] - posted by "ruanwenjun (via GitHub)" <gi...@apache.org> on 2026/09/23 15:38:30 UTC, 8 replies.
- Re: [PR] [SPARK-59725][K8S] Bind Volcano PodGroup with driver when podgroup creation [spark] - posted by "ruanwenjun (via GitHub)" <gi...@apache.org> on 2026/09/23 15:40:10 UTC, 2 replies.
- [PR] [SPARK-59628][SQL] Reject ASOF JOIN without MATCH_CONDITION instead of a silent plain join [spark] - posted by "LukaZdravic (via GitHub)" <gi...@apache.org> on 2026/09/23 15:50:27 UTC, 4 replies.
- Re: [PR] [SPARK-44426][SQL] Add support for ExistenceJoin to AQE [spark] - posted by "vanekjar (via GitHub)" <gi...@apache.org> on 2026/09/23 16:20:11 UTC, 1 replies.
- [PR] [SPARK-59212][K8S][INFRA][3.5] Pin the Minikube container runtime to docker in K8s CI [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/23 17:01:50 UTC, 3 replies.
- [PR] [SPARK-59752][INFRA] dev/scalastyle: annotate style violations that report a column [spark] - posted by "vrjdev (via GitHub)" <gi...@apache.org> on 2026/09/23 17:43:21 UTC, 1 replies.
- [PR] [SPARK-59753] Upgrade Java Operator SDK to 5.6.2 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/23 18:22:58 UTC, 3 replies.
- [PR] [SPARK-59754] Release the Kueue `Workload` of a suspended `SparkCluster` regardless of its queue label [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/23 18:52:17 UTC, 0 replies.
- Re: [PR] [SPARK-59534][SQL] Support implicit casting of DATE and STRING to TIMESTAMP in time_bucket [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/09/23 19:28:10 UTC, 4 replies.
- Re: [PR] [SPARK-59754] Release the Kueue `Workload` of suspended `Spark(Application|Cluster)` regardless of the queue label [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/23 19:31:55 UTC, 11 replies.
- [PR] [SPARK-59605][SQL] Handle NULL literal in ORC IN filter pushdown [spark] - posted by "vboo123 (via GitHub)" <gi...@apache.org> on 2026/09/23 19:49:06 UTC, 5 replies.
- [PR] [SPARK-59755][PYTHON] Add ASV benchmarks for Arrow incremental aggregate and window UDF eval types [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/09/23 20:13:51 UTC, 2 replies.
- [PR] [MINOR][CORE][TESTS] Fix flaky DAGSchedulerSuite test for push-based shuffle [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/23 20:36:01 UTC, 2 replies.
- [PR] [SPARK-59705][INFRA][FOLLOWUP] Fix pandas3 dependency conflict [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/09/23 22:31:50 UTC, 3 replies.
- [PR] [SPARK-59705][INFRA][FOLLOWUP] Create ci_connect_pandas_3 for pandas 3 dependencies [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/09/24 00:06:25 UTC, 2 replies.
- Re: [PR] [SPARK-57472][SQL] Make FileTable.mergedOptions merge table and relation options case-insensitively [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/24 00:41:56 UTC, 1 replies.
- Re: [I] [FEATURE REQUEST] Add ADBC (Arrow Database Connectivity) Data Source [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/24 00:41:58 UTC, 6 replies.
- [PR] [WIP][CORE] Fix NPE in BytesToBytesMap after failed reset during spill [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/24 02:36:56 UTC, 0 replies.
- Re: [PR] [SPARK-59757][CORE] Fix NPE in BytesToBytesMap after failed reset during spill [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/24 03:37:46 UTC, 1 replies.
- Re: [PR] [SPARK-59512][PYTHON][TEST] Test repeated parsing of collation schema metadata [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/24 06:33:44 UTC, 2 replies.
- [PR] [MINOR][DOCS] Fix broken HTML table in sql-error-conditions caused by placeholders inside code spans [spark] - posted by "anshulbhide (via GitHub)" <gi...@apache.org> on 2026/09/24 06:50:28 UTC, 0 replies.
- [PR] [SPARK-59760] Release the Kueue `Workload` of a stopped `SparkApplication` regardless of the queue label [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/24 08:35:49 UTC, 1 replies.
- [PR] [SPARK-59758] Release the Kueue `Workload` of a stopped `SparkApplication` regardless of the queue label [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/24 08:39:15 UTC, 7 replies.
- [PR] [SPARK-59760] Add `spark.kubernetes.operator.kueue.enabled` to disable the Kueue integration by default [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/24 08:53:50 UTC, 7 replies.
- [PR] [SPARK-57897][BUILD][4.x] Use AWS SDK bundle in credential-aws [spark] - posted by "ruanwenjun (via GitHub)" <gi...@apache.org> on 2026/09/24 09:06:37 UTC, 3 replies.
- [PR] [SPARK-59761][SQL] Add SET VARIABLE DEFAULT golden tests [spark] - posted by "vladanvasi-db (via GitHub)" <gi...@apache.org> on 2026/09/24 09:07:20 UTC, 1 replies.
- [PR] [SPARK-59762] Release Python UDF init message before processing rows [spark] - posted by "craiuconstantintiberiu (via GitHub)" <gi...@apache.org> on 2026/09/24 09:14:18 UTC, 3 replies.
- [I] Shuffle tracking prevents dynamic allocation from removing executors after `collect()` / `toPandas()` [spark] - posted by "aalopatin (via GitHub)" <gi...@apache.org> on 2026/09/24 09:24:05 UTC, 2 replies.
- [PR] Annotate `TokenIngestor` with `@Private` instead of `@DeveloperApi` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/09/24 10:14:46 UTC, 0 replies.
- Re: [PR] Switch tags to resolute to build on 26.04 instead of 22.04 [spark-docker] - posted by "RobbertDM (via GitHub)" <gi...@apache.org> on 2026/09/24 11:50:18 UTC, 0 replies.
- Re: [PR] [SPARK-59757][CORE] Harden BytesToBytesMap after failed reset allocation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/24 12:02:11 UTC, 18 replies.
- [PR] [SPARK-59749][SQL] Accept empty STRUCT operands in ASOF JOIN MATCH_CONDITION [spark] - posted by "LukaZdravic (via GitHub)" <gi...@apache.org> on 2026/09/24 12:20:14 UTC, 16 replies.
- [PR] [SPARK-59764][SQL][TESTS] Check generated code of benchmark queries with AQE disabled [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/09/24 13:27:28 UTC, 4 replies.
- [PR] [SPARK-59765][SQL][TESTS] Generate broadcast joins in full when measuring benchmark query codegen [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/09/24 15:00:01 UTC, 6 replies.
- Re: [PR] [SPARK-52589][K8S] Prune `schedulerKnownNewlyCreatedExecs` entries unknown to the scheduler backend [spark] - posted by "zahed1994 (via GitHub)" <gi...@apache.org> on 2026/09/24 16:10:45 UTC, 0 replies.
- Re: [PR] [SPARK-55294][PS] Add support for PyArrow-backed dtypes in pandas API [spark] - posted by "zahed1994 (via GitHub)" <gi...@apache.org> on 2026/09/24 16:13:18 UTC, 1 replies.
- [PR] [SPARK-59766] Make a pending Kueue `Workload` follow the changed or removed queue label [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/24 16:24:17 UTC, 6 replies.
- [PR] [SPARK-59767] Consolidate `Kueue` integration tests into the `kueue` E2E test [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/24 16:42:28 UTC, 3 replies.
- Re: [PR] [SPARK-59763][CORE] Annotate `TokenIngestor` with `@Private` instead of `@DeveloperApi` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/09/24 17:09:19 UTC, 2 replies.
- [PR] [SPARK-59769] Apply the flavors of an admitted Kueue `Workload` to a resource whose queue label was removed [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/24 18:14:02 UTC, 6 replies.
- [PR] [SPARK-59770] Add `ValidatingAdmissionPolicy` to keep the Kueue queue of started `Spark(Application|Cluster)` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/24 18:16:30 UTC, 6 replies.
- Re: [PR] [MINOR][CORE][3.5] Validate array counts against received bytes in shuffle fetch decoders [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/24 18:25:42 UTC, 2 replies.
- [PR] [PYTHON] Add versioned Python worker metrics reports [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/09/24 19:07:39 UTC, 0 replies.
- [PR] [SPARK-59771] Release the Kueue `Workload` of `SparkApplication` only after its pods are gone [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/24 20:05:30 UTC, 8 replies.
- Re: [PR] [SPARK-58209][SQL] Mark CallMethodViaReflection and XPathExtract stateful to prevent data races [spark] - posted by "anshulbaliga7 (via GitHub)" <gi...@apache.org> on 2026/09/24 20:06:36 UTC, 2 replies.
- [PR] [SPARK-59774][SQL] Warn, and name the remedy, when a generated method is too long to be JIT compiled [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/09/24 20:08:43 UTC, 0 replies.
- [PR] [SPARK-59775] Upgrade `Gradle` to 9.8.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/24 20:33:51 UTC, 7 replies.
- Re: [PR] [SPARK-59773][PYTHON] Add versioned Python worker metrics reports [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/09/24 21:09:46 UTC, 1 replies.
- Re: [PR] [SPARK-59678][SQL] Fix pivot failing on array and struct columns with non-nullable nested fields [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/09/24 21:15:03 UTC, 0 replies.
- [PR] [WIP][SQL] Make changelog loading state-option-aware [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/09/24 21:26:40 UTC, 0 replies.
- Re: [PR] [SPARK-38719][SQL] Test the error class: CANNOT_CAST_DATATYPE [spark] - posted by "deepujain (via GitHub)" <gi...@apache.org> on 2026/09/24 21:35:11 UTC, 0 replies.
- Re: [PR] [SPARK-38743][SQL] Test the error class: MISSING_STATIC_PARTITION_COLUMN [spark] - posted by "deepujain (via GitHub)" <gi...@apache.org> on 2026/09/24 21:35:13 UTC, 0 replies.
- [PR] [WIP][SQL][TESTS] Add nanosecond timestamp coverage for joins, pivot/unpivot and transform [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/24 21:46:40 UTC, 0 replies.
- [PR] [WIP][SQL] Support nanosecond timestamp output columns in script TRANSFORM [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/09/24 21:48:42 UTC, 0 replies.
- [PR] [WIP][SS] Saturate state-watermark microsecond re-expansion to avoid overflow [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2026/09/24 22:04:59 UTC, 0 replies.
- [PR] [SPARK-59777][PYTHON] Fix timing metrics for reused Python workers [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/09/24 22:25:27 UTC, 3 replies.
- Re: [PR] [SPARK-59407][UI] Improve compressed line handling in Spark History server [spark] - posted by "asf-gitbox-commits (via GitHub)" <gi...@apache.org> on 2026/09/24 23:32:18 UTC, 0 replies.
- [PR] [SPARK-8682][SQL] Support range join for range-predicate joins [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2026/09/24 23:35:19 UTC, 6 replies.
- Re: [PR] [SPARK-59069][PYTHON] Transpile Python UDFs with positional-only params [spark] - posted by "asf-gitbox-commits (via GitHub)" <gi...@apache.org> on 2026/09/24 23:44:51 UTC, 1 replies.
- [PR] [SPARK-43253][SQL] Report unresolved MapObjects as an internal error [spark] - posted by "deepujain (via GitHub)" <gi...@apache.org> on 2026/09/24 23:59:53 UTC, 0 replies.
- [PR] [SPARK-59353][UI][4.0] Avoid pre-fetch and crawlers triggering actions in UI [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/25 00:04:15 UTC, 2 replies.
- [PR] [SPARK-59353][UI][3.5] Avoid pre-fetch and crawlers triggering actions in UI [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/25 00:04:25 UTC, 2 replies.
- [PR] [SPARK-59405][SQL][4.0] XSD Validation improvements- #58698 [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/25 00:05:22 UTC, 2 replies.
- [PR] [SPARK-59353][UI][4.1] Avoid pre-fetch and crawlers triggering actions in UI- #59029 [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/25 00:08:56 UTC, 2 replies.
- [PR] [SPARK-59353][UI][4.2] Avoid pre-fetch and crawlers triggering actions in UI- #59029 [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/25 00:09:00 UTC, 2 replies.
- [PR] [SPARK-59353][UI][4.3] Avoid pre-fetch and crawlers triggering actions in UI- #59029 [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/25 00:09:04 UTC, 2 replies.
- Re: [PR] Add regression test for issue #55392 - Named parameters without legacy config [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/25 00:42:11 UTC, 1 replies.
- [PR] [SPARK-35198][SQL][PYTHON] Expose direct debugCodegen methods [spark] - posted by "deepujain (via GitHub)" <gi...@apache.org> on 2026/09/25 00:53:22 UTC, 1 replies.
- Re: [PR] [SPARK-59774][SQL] Warn once, and name the remedy, when a whole-stage codegen method is too long to be JIT compiled [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/09/25 01:46:00 UTC, 5 replies.
- [PR] [SPARK-59778][SQL] Add display-only properties to the Table API [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/09/25 02:59:44 UTC, 6 replies.
- [PR] [SPARK][CORE][SQL][SHUFFLE] Restore interrupt status after catching InterruptedException [spark] - posted by "TimurRakhmatullin86 (via GitHub)" <gi...@apache.org> on 2026/09/25 03:54:00 UTC, 0 replies.
- [PR] [SPARK-59262] Add Java 27 to GitHub Actions [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/25 04:56:25 UTC, 6 replies.
- [PR] [SPARK-59780] Use Java 27 toolchain while supporting Java 21+ [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/25 05:26:54 UTC, 7 replies.
- [PR] [SPARK-59781][PYTHON] Raise FIELD_STRUCT_LENGTH_MISMATCH instead of truncating rows longer than the schema in createDataFrame [spark] - posted by "NestDream (via GitHub)" <gi...@apache.org> on 2026/09/25 08:17:49 UTC, 6 replies.
- [PR] [SPARK-59765][SQL][TESTS][4.x] Generate broadcast joins in full when measuring benchmark query codegen [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/09/25 08:30:37 UTC, 4 replies.
- [PR] [MINOR][TESTS][CONNECT][FOLLOWUP] Make column resolution error differences explicit [spark] - posted by "marko-radoicic-db (via GitHub)" <gi...@apache.org> on 2026/09/25 12:28:13 UTC, 0 replies.
- [I] index.html [spark] - posted by "al11-pablollocab-prog (via GitHub)" <gi...@apache.org> on 2026/09/25 15:00:20 UTC, 0 replies.
- [PR] [SPARK-59783][SQL] Group the calls to split functions so the method holding them stays JIT-compilable [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/09/25 15:09:34 UTC, 0 replies.
- [PR] [SPARK-59784][SQL][TESTS] Fix flaky test driver side SQL metrics in SQLAppStatusListenerSuite [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/09/25 16:47:26 UTC, 0 replies.
- [PR] [SPARK-59786][SDP] SCD1 Ignore-null support; Populate version map per event row at ingest [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/09/25 17:09:52 UTC, 0 replies.
- [PR] [SPARK-59787][SDP] SCD1 Ignore-null support; Coalesce incoming microbatch rows per key [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/09/25 17:23:05 UTC, 0 replies.
- [PR] [SPARK-59785][CONNECT][TESTS] Fix SparkConnectResultSetSuite failure when ANSI mode is off [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/09/25 17:24:23 UTC, 9 replies.
- [PR] [SPARK-59779][DOCS] Document the whole-stage codegen method limit [spark] - posted by "deepujain (via GitHub)" <gi...@apache.org> on 2026/09/25 17:28:48 UTC, 3 replies.
- [PR] [SPARK-59788][SS] Initialize the global aggregation once per empty batch in the streamline plan [spark] - posted by "nahtonaj (via GitHub)" <gi...@apache.org> on 2026/09/25 18:37:33 UTC, 0 replies.
- [PR] [SPARK-59406][UI][FOLLOW-UP] Fix jquery import in utils.test.js for branch-4.0 [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/25 19:19:32 UTC, 0 replies.
- Re: [PR] [SPARK-59783][SQL] Keep the caller of split functions JIT-compilable [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/09/25 19:35:47 UTC, 6 replies.
- [PR] [SPARK-59352][SQL][3.5] Validate prefix lengths in the vectorized DELTA_BYTE_ARRAY reader [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/25 19:49:10 UTC, 2 replies.
- [PR] [SPARK-59352][SQL][4.1] Validate prefix lengths in the vectorized DELTA_BYTE_ARRAY reader [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/25 19:49:12 UTC, 2 replies.
- [PR] [SPARK-59352][SQL][4.0] Validate prefix lengths in the vectorized DELTA_BYTE_ARRAY reader [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/25 19:49:15 UTC, 2 replies.
- [PR] [SPARK-59406][UI][FOLLOW-UP] Fix jquery import in utils.test.js for branch-4.1 [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/25 20:12:19 UTC, 0 replies.
- [PR] [SPARK-59776][CORE][SQL] Notify ExecutorMonitor when SQL shuffle cleanup removes shuffle files [spark] - posted by "saurabhdamle11 (via GitHub)" <gi...@apache.org> on 2026/09/25 20:29:59 UTC, 0 replies.
- Re: [PR] [SPARK-59789][UI][FOLLOW-UP][4.0] Fix jquery import in utils.test.js for branch-4.0 [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/25 20:39:29 UTC, 1 replies.
- Re: [PR] [SPARK-59789][UI][FOLLOW-UP][4.1] Fix jquery import in utils.test.js for branch-4.1 [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/25 20:46:48 UTC, 0 replies.
- [PR] [SPARK-59789][UI][FOLLOW-UP][4.1] Fix jquery import in utils.test.js [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/25 20:53:18 UTC, 2 replies.
- [PR] [SPARK-59790] Bound the wait for the terminating pods of a suspended `SparkCluster` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/25 20:59:14 UTC, 10 replies.
- Re: [PR] [SPARK-56925][PYTHON][SQL] Support bare `if x` in UDF transpilation [spark] - posted by "jzhan-2026 (via GitHub)" <gi...@apache.org> on 2026/09/25 21:23:08 UTC, 2 replies.
- Re: [PR] [SPARK-59406][UI][3.5] Fix UI display on weird custom log names [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/25 21:33:07 UTC, 1 replies.
- [PR] [SPARK-59407][UI][4.2] Improve compressed line handling in Spark History server [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/25 21:36:56 UTC, 2 replies.
- [PR] [SPARK-59407][UI][4.1] Improve compressed line handling in Spark History server [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/25 21:37:06 UTC, 2 replies.
- [PR] [SPARK-59407][UI][4.0] Improve compressed line handling in Spark History server [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/25 21:37:09 UTC, 2 replies.
- [PR] [SPARK-59407][UI][3.5] Improve compressed line handling in Spark History server [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/25 21:37:12 UTC, 2 replies.
- [PR] [SPARK-55220][PYTHON][SQL] Add null strictness level parameter to Python UDF transpiler [spark] - posted by "jzhan-2026 (via GitHub)" <gi...@apache.org> on 2026/09/25 22:03:01 UTC, 2 replies.
- [PR] [SPARK-59756][CORE] Make Utils.chmod700 atomic on POSIX FS [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/26 00:23:46 UTC, 1 replies.
- Re: [PR] [SPARK-53848][SQL] Add ability to support Alpha family in Theta Aggregates [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/26 00:41:37 UTC, 1 replies.
- [PR] [SPARK-59792][SQL][PYTHON] Skip ColumnarToRow for Arrow-backed input to Python UDTFs [spark] - posted by "FelixYBW (via GitHub)" <gi...@apache.org> on 2026/09/26 02:03:59 UTC, 3 replies.
- [PR] [SPARK-59087][4.2][CONNECT][FOLLOWUP] Add extraServerConfs hook to SparkConnectServerTest [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/26 02:26:45 UTC, 4 replies.
- [PR] [SPARK-59087][4.1][CONNECT][FOLLOWUP] Add extraServerConfs hook to SparkConnectServerTest [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/26 02:26:50 UTC, 3 replies.
- [PR] [SPARK-59087][4.0][CONNECT][FOLLOWUP] Add extraServerConfs hook to SparkConnectServerTest [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/26 02:26:54 UTC, 2 replies.
- [PR] [SQL] Preserve column default expressions in CTAS and RTAS [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/09/26 02:49:09 UTC, 0 replies.
- Re: [PR] [SPARK-59333][CORE] Apply a serialization filter when recovering Master state from ZooKeeper [spark] - posted by "asf-gitbox-commits (via GitHub)" <gi...@apache.org> on 2026/09/26 02:58:11 UTC, 0 replies.
- [PR] [WIP][SQL] Multiply and add/subtract compact decimals without BigDecimal [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/26 03:02:39 UTC, 0 replies.
- [PR] [SPARK-59794][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1079 [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/09/26 05:15:28 UTC, 0 replies.
- [PR] [SPARK-59795] Respect user-specified terminationGracePeriodSeconds of SparkCluster pods [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/26 05:51:51 UTC, 1 replies.
- Re: [PR] [SPARK-59721][SQL] Fall back to unknown partitioning instead of failing when a reported partition key cannot be resolved [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/26 07:50:37 UTC, 5 replies.
- [PR] [SPARK-33301][SQL] Split a large CASE WHEN into methods under whole-stage codegen [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/09/26 07:52:38 UTC, 9 replies.
- Re: [PR] [SPARK-59795] Respect user-specified terminationGracePeriodSeconds of `SparkCluster` pods [spark-kubernetes-operator] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/26 08:07:07 UTC, 3 replies.
- [PR] [SPARK-59797] Preserve user-specified dnsConfig of SparkCluster worker pods [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/26 08:34:38 UTC, 4 replies.
- [PR] [SPARK-59798][K8S] Support `spark.executor.extraLibraryPath` for K8s executors [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/26 08:49:41 UTC, 6 replies.
- [PR] [SPARK-59799] Support `spark.executor.extraLibraryPath` in `entrypoint.sh.template` [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/26 09:02:15 UTC, 2 replies.
- Re: [PR] [SPARK-59793][SQL] Preserve column default expressions in CTAS and RTAS [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/26 09:35:43 UTC, 0 replies.
- Re: [PR] [SPARK-59577][BUILD] Add shared PySpark base test module [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/09/26 10:06:13 UTC, 0 replies.
- [PR] [SPARK-59800] Handle an evicted or deactivated Kueue `Workload` before requesting the driver or master [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/26 10:06:56 UTC, 6 replies.
- [PR] [MINOR][INFRA] During release, push to spark-website only once [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/09/26 12:37:22 UTC, 1 replies.
- Re: [PR] [SPARK-56898][SQL] Rewrite COUNT(DISTINCT IF) to COUNT(DISTINCT) FILTER for Expand reduction [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/26 13:19:30 UTC, 0 replies.
- [PR] [SPARK-59801][SQL] Fix internal error for non-foldable options maps [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/26 16:06:18 UTC, 14 replies.
- [PR] [SPARK-59803] Handle an evicted or deactivated Kueue `Workload` of a running `SparkCluster` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/26 17:44:47 UTC, 6 replies.
- [PR] [MINOR][SQL] Deduplicate variant manipulation expressions [spark] - posted by "bojana-db (via GitHub)" <gi...@apache.org> on 2026/09/26 18:28:44 UTC, 1 replies.
- [PR] [SPARK-59804][UI] Fix UTF-8 byte limits and physical line numbers during event log replay [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/27 00:14:14 UTC, 26 replies.
- [PR] [FOLLOWUP][SQL][JDBC] Close JDBC connection after DSv2 truncate [spark] - posted by "zhangxinyao88 (via GitHub)" <gi...@apache.org> on 2026/09/27 00:26:10 UTC, 0 replies.
- Re: [PR] Fix: enable spark archive reader config [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/27 00:49:08 UTC, 1 replies.
- Re: [PR] [SPARK-45154][ML]Fixed an issue where CrossValidator yields non-deterministic trees in Spark 3 due to Python's hash randomization on the default seed. Replaced it with a stable zlib.crc32 seed. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/27 00:49:12 UTC, 1 replies.
- Re: [PR] [SPARK-56620][SQL] Fix stale entries in RuleIdCollection [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/27 00:49:17 UTC, 1 replies.
- Re: [PR] [SPARK-54751][SQL] Add version information to the configuration of SQL [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/27 00:49:22 UTC, 1 replies.
- [PR] [SPARK-59805][SQL] Avoid BigDecimal round trips for wide decimals that fit in a long in UnsafeRow [spark] - posted by "dwsmith1983 (via GitHub)" <gi...@apache.org> on 2026/09/27 02:38:26 UTC, 3 replies.
- Re: [PR] [SPARK-59069][PYTHON] Transpile Python UDFs with explicit positional-only parameters [spark] - posted by "charliec05 (via GitHub)" <gi...@apache.org> on 2026/09/27 04:19:28 UTC, 1 replies.
- [PR] [SPARK-59604][SQL] Honor LAST_WIN when simplifying map lookups [spark] - posted by "charliec05 (via GitHub)" <gi...@apache.org> on 2026/09/27 04:39:43 UTC, 2 replies.
- [PR] [SPARK-44517][SQL] Preserve nullability in batch deduplication [spark] - posted by "charliec05 (via GitHub)" <gi...@apache.org> on 2026/09/27 04:39:44 UTC, 2 replies.
- [PR] [SPARK-57472][SQL] Merge file table options case-insensitively [spark] - posted by "charliec05 (via GitHub)" <gi...@apache.org> on 2026/09/27 04:39:46 UTC, 2 replies.
- Re: [PR] [SPARK-50698][SQL] Refactor CreateUserDefinedFunction command to extend from UnaryRunnableCommand [spark] - posted by "zahed1994 (via GitHub)" <gi...@apache.org> on 2026/09/27 06:08:12 UTC, 1 replies.
- [PR] [SPARK-55214][PYTHON][SQL] Transpile string len() to Catalyst length [spark] - posted by "mounikavas (via GitHub)" <gi...@apache.org> on 2026/09/27 06:26:06 UTC, 4 replies.
- [PR] [SPARK-59808][INFRA] Remove JIRA fix versions when merging reverts [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/09/27 07:39:55 UTC, 3 replies.
- [PR] [SPARK-59807][CORE] Reject executor hold while an unreliably-stored shuffle is active [spark] - posted by "venkata91 (via GitHub)" <gi...@apache.org> on 2026/09/27 19:33:10 UTC, 0 replies.
- [PR] [SPARK-59810] Use Ubuntu 26.04 LTS-based `gradle` image for builder stage [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/27 21:48:59 UTC, 6 replies.
- Re: [PR] [SPARK-59762][PYTHON] Release Python UDF init message before processing rows [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/09/27 22:42:47 UTC, 1 replies.
- [PR] [SPARK-59811] Check the live driver of a suspended `SparkApplication` before releasing its admitted Kueue `Workload` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/27 22:52:10 UTC, 10 replies.
- [PR] [SPARK-59798][4.3][K8S] Support `spark.executor.extraLibraryPath` for K8s executors [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/27 23:13:00 UTC, 3 replies.
- Re: [PR] [SPARK-59813][YARN] Dump thread stacks when SparkContext initialization times out in ApplicationMaster [spark] - posted by "singer-bin (via GitHub)" <gi...@apache.org> on 2026/09/27 23:17:39 UTC, 0 replies.
- [PR] [SPARK-59798][4.2][K8S] Support `spark.executor.extraLibraryPath` for K8s executors [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/27 23:18:12 UTC, 3 replies.
- [PR] [SPARK-59798][4.1][K8S] Support `spark.executor.extraLibraryPath` for K8s executors [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/27 23:20:11 UTC, 3 replies.
- [PR] [SPARK-59812][SQL] Validate value lengths and skip amounts in the vectorized PLAIN and DELTA_LENGTH_BYTE_ARRAY readers [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/27 23:22:54 UTC, 3 replies.
- [PR] [SPARK-59798][4.0][K8S] Support `spark.executor.extraLibraryPath` for K8s executors [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/27 23:22:59 UTC, 3 replies.
- [PR] [SPARK-59814] Clarify when the `Submitted` K8s event is published in `configuration.md` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/28 00:06:19 UTC, 6 replies.
- Re: [PR] [SPARK-58893][UI][4.0] Fix Spark UI multi-cluster reverse proxy: propagate… [spark] - posted by "Nflrijal (via GitHub)" <gi...@apache.org> on 2026/09/28 00:10:35 UTC, 1 replies.
- [PR] [SPARK-59815] Add `events` E2E test for state transition events of `Spark(Application|Cluster)` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/28 00:26:27 UTC, 6 replies.
- [PR] [SPARK-58893][UI] Fix Spark UI multi-cluster reverse proxy: propagate reverseProxyUrl to driver, fix redirect Location and kill button [spark] - posted by "Nflrijal (via GitHub)" <gi...@apache.org> on 2026/09/28 00:29:52 UTC, 1 replies.
- Re: [PR] [SPARK-57537][SS] Add metrics support for deleteRange operation in RocksDB [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/28 00:49:06 UTC, 1 replies.
- Re: [PR] [SPARK-42751][PS] Support str.findall with capture groups [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/28 00:49:11 UTC, 1 replies.
- Re: [PR] [SPARK-57363][PS][TESTS] Add tests for Index.identical in pandas-on-Spark [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/28 00:49:16 UTC, 1 replies.
- [PR] [SPARK-59817][BUILD] Upgrade `scala-xml` to 2.5.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/28 04:58:42 UTC, 4 replies.
- [PR] [SPARK-59673][SQL][FOLLOWUP] Restore zero as NAAJ broadcast threshold disable sentinel [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/28 05:18:47 UTC, 2 replies.
- [PR] [SPARK-59819][CORE] Fix `Resubmitted` task end accounting in `AppStatusListener` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/28 06:15:42 UTC, 4 replies.
- [PR] [SPARK-59820][BUILD] Upgrade `lz4-java` to 1.12.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/28 06:18:08 UTC, 4 replies.
- [PR] [SPARK-59818][SQL] Handle a NULL sketch state in approx_top_k_estimate and approx_top_k_combine [spark] - posted by "jubins (via GitHub)" <gi...@apache.org> on 2026/09/28 06:35:00 UTC, 10 replies.
- [PR] [SPARK-59524][CORE] Enforce the array-key / HashPartitioner guard in subtractByKey and the Java fakeClassTag key path [spark] - posted by "zahed1994 (via GitHub)" <gi...@apache.org> on 2026/09/28 06:42:31 UTC, 7 replies.
- [PR] [SPARK-59553][FOLLOWUP][CONNECT] Isolate Maven utility test files [spark] - posted by "qianlan717 (via GitHub)" <gi...@apache.org> on 2026/09/28 06:56:42 UTC, 0 replies.
- Re: [PR] [SPARK-58970] Defer LeftSemi/Anti join pushdown through Aggregate to after scan pushdown [spark] - posted by "hemanthboyina (via GitHub)" <gi...@apache.org> on 2026/09/28 07:41:49 UTC, 0 replies.
- Re: [PR] [SPARK-59039][INFRA][BUILD] Add a README for our GitHub workflows [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/09/28 10:04:56 UTC, 1 replies.
- Re: [PR] [SPARK-58540][SQL] Deduplicate variant manipulation expressions [spark] - posted by "bojana-db (via GitHub)" <gi...@apache.org> on 2026/09/28 11:13:22 UTC, 3 replies.
- [PR] [SPARK-59218][SQL] Support escape sequences in Variant path parsing [spark] - posted by "bojana-db (via GitHub)" <gi...@apache.org> on 2026/09/28 11:28:03 UTC, 1 replies.
- Re: [PR] [SPARK-59761][SQL][TEST] Add SET VARIABLE DEFAULT golden tests [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/28 12:32:53 UTC, 1 replies.
- Re: [PR] [SPARK-59821][CORE] Make Maven utility tests safe for concurrent runs [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/28 12:51:37 UTC, 3 replies.
- Re: [PR] [MINOR][TESTS] Make column resolution error differences explicit [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/28 13:02:09 UTC, 0 replies.
- [PR] [SPARK-59825][SQL][TESTS] Fix `HiveClientSuites` to work with sbt `testOnly` and `-z` filtering [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/09/28 14:34:32 UTC, 4 replies.
- [PR] [SPARK-59529][SQL][FOLLOWUP] Restore refs1/refs2 parameter names for ASOF_JOIN_MATCH_CONDITION_TABLE_REFERENCE [spark] - posted by "LukaZdravic (via GitHub)" <gi...@apache.org> on 2026/09/28 14:55:22 UTC, 2 replies.
- [PR] [SPARK-59826] Do not serialize `is(Admitted|QuotaReserved|Finished)` of Kueue `WorkloadStatus` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/28 15:06:01 UTC, 3 replies.
- [PR] [SPARK-59663][CONNECT][SDP] Keep pipeline flow dependencies when withColumns and withColumnsRenamed eagerly analyze [spark] - posted by "Vivek1106-04 (via GitHub)" <gi...@apache.org> on 2026/09/28 15:55:44 UTC, 7 replies.
- [PR] [SPARK-59828][SQL] Fix skipping FIXED_LEN_BYTE_ARRAY values in the vectorized DELTA_BYTE_ARRAY reader [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/28 15:59:27 UTC, 2 replies.
- [PR] [SPARK-59829][SQL] Fix overflow in forward ASOF join by keeping the first match [spark] - posted by "LukaZdravic (via GitHub)" <gi...@apache.org> on 2026/09/28 16:06:50 UTC, 0 replies.
- [PR] [SPARK-59827][CORE] Re-register a waiting task in ExecutionMemoryPool.acquireMemory after its entry is removed [spark] - posted by "dwsmith1983 (via GitHub)" <gi...@apache.org> on 2026/09/28 16:10:39 UTC, 1 replies.
- [PR] [SPARK-59830] Unify K8s event sources into `spark-kubernetes-operator` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/28 16:12:59 UTC, 2 replies.
- [PR] [SPARK-59713][SQL][TEST][4.x] Add a large-group case to `AsOfJoinBenchmark` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/28 16:34:24 UTC, 4 replies.
- Re: [PR] [SPARK-59812][SQL] Validate value lengths and skip amounts in the vectorized PLAIN, DELTA_LENGTH_BYTE_ARRAY and DELTA_BYTE_ARRAY readers [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/28 16:50:00 UTC, 3 replies.
- Re: [PR] [SPARK-59000][SQL] Use java.util.Arrays.compareUnsigned for BinaryType comparison [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/28 17:09:52 UTC, 0 replies.
- [PR] [SPARK-59833] Upgrade Jackson to 2.22.3 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/28 17:40:57 UTC, 3 replies.
- [PR] [SPARK-59834] Upgrade the base image to `alpine:3.24` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/28 18:03:22 UTC, 3 replies.
- [PR] [SPARK-59835][BUILD] Upgrade Jackson to 2.22.3 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/28 18:09:26 UTC, 3 replies.
- Re: [PR] [SPARK-59828][SQL] Support `skipFixedLenByteArray` in `VectorizedDeltaByteArrayReader` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/28 18:10:12 UTC, 3 replies.
- [PR] [SPARK-59836] Remove unused `libstdc++` package from Docker image [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/28 18:28:03 UTC, 3 replies.
- [PR] [SPARK-59837][SQL][TESTS] Add Parquet v2 writer test cases to `ParquetColumnIndexSuite` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/28 18:43:49 UTC, 8 replies.
- [PR] [SPARK-59624][PYTHON][FOLLOWUP] Return an empty batch from concat_batches for empty input [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/09/28 18:53:05 UTC, 2 replies.
- [PR] [SPARK-58628][SQL] Transpiler: skip null guards for is-not-None-narrowed parameters [spark] - posted by "jzhan-2026 (via GitHub)" <gi...@apache.org> on 2026/09/28 20:19:54 UTC, 0 replies.
- Re: [PR] [SPARK-59624][PYTHON][FOLLOWUP] Support an optional schema in concat_batches for empty input [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/09/28 20:35:56 UTC, 0 replies.
- Re: [PR] [SPARK-59773][PYTHON] Report Python worker metrics as JSON [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/09/28 20:48:48 UTC, 10 replies.
- [PR] [SPARK-59838] Upgrade Mockito to 5.24.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/28 21:03:36 UTC, 4 replies.
- [PR] [SPARK-59812][SQL][4.2] Validate value lengths and skip amounts in the vectorized PLAIN, DELTA_LENGTH_BYTE_ARRAY and DELTA_BYTE_ARRAY readers [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/28 21:09:41 UTC, 3 replies.
- [PR] [SPARK-59812][SQL][4.1] Validate value lengths and skip amounts in the vectorized PLAIN, DELTA_LENGTH_BYTE_ARRAY and DELTA_BYTE_ARRAY readers [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/28 21:09:44 UTC, 3 replies.
- [PR] [SPARK-57324][SQL] Surface external UDF terminal metrics [spark] - posted by "tdcmeehan (via GitHub)" <gi...@apache.org> on 2026/09/28 21:35:38 UTC, 9 replies.
- Re: [PR] [SPARK-59624][PYTHON][FOLLOWUP] Drop zero-row batches in concat_batches and accept an optional schema [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/09/28 21:56:44 UTC, 9 replies.
- [PR] [SPARK-59839][K8S] Prune PVC usage reports of removed and inactive executors in `ExecutorPVCResizePlugin` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/28 21:58:49 UTC, 9 replies.
- [PR] [SPARK-59840][K8S] Fix `ExecutorResizePlugin` to exclude inactive executor pods [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/28 22:10:35 UTC, 7 replies.
- [PR] [SPARK-59842][K8S] Fix `spark.kubernetes.executor.resizeInterval` default value and `0` handling [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/28 22:29:10 UTC, 9 replies.
- [PR] [SPARK-59843][K8S] Make `ExecutorResizePlugin` validate `resizeThreshold` and `resizeFactor` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/28 22:37:22 UTC, 10 replies.
- [PR] [WIP] [STREAMING] Preserve root causes for RTM async operation failures [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/09/28 23:17:28 UTC, 0 replies.
- [PR] [SPARK-59832][SQL] Fail on truncated input in the vectorized RLE reader [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/28 23:22:20 UTC, 8 replies.
- [PR] [SPARK-59831][SQL] Validate bounds in the vectorized BYTE_STREAM_SPLIT reader [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/28 23:22:38 UTC, 9 replies.
- [PR] [SPARK-59841][SQL] Align changelog state options and metadata reuse [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/09/29 00:08:46 UTC, 12 replies.
- [PR] [SPARK-59846] Record the Kueue `PodsReady` condition of started `Spark(Application|Cluster)` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/29 00:16:13 UTC, 4 replies.
- [PR] [SPARK-59848] Use a sequential stream in `PodUtils.isPodReady` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/29 00:21:15 UTC, 5 replies.
- [PR] [SPARK-59847][CONNECT][SS][PYTHON] Fix deadlock in StreamingQueryListenerBus when removing the last listener [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/09/29 00:26:00 UTC, 3 replies.
- Re: [PR] [SPARK-54367][Connect]Propagate close() from SessionState to CatalogPlugins to prevent leak [spark] - posted by "MonkeyCanCode (via GitHub)" <gi...@apache.org> on 2026/09/29 01:05:37 UTC, 3 replies.
- [PR] [SPARK-56898][SQL][FOLLOWUP] Revert conditional COUNT(DISTINCT) rewrite [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/29 02:11:39 UTC, 0 replies.
- Re: [PR] Revert [SPARK-56898][SQL] conditional COUNT(DISTINCT) rewrite [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/29 02:14:17 UTC, 6 replies.
- [PR] [SPARK-59824][SQL] Add a single-row size guard for pickle Python UDFs [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2026/09/29 03:20:14 UTC, 2 replies.
- [PR] [SPARK-59850][SQL] Support user statistics visitor [spark] - posted by "zhztheplayer (via GitHub)" <gi...@apache.org> on 2026/09/29 03:59:48 UTC, 0 replies.
- [PR] [SPARK-59845][CORE] Register an accumulator with the TaskContext only after it is fully deserialized [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2026/09/29 04:02:48 UTC, 2 replies.
- [PR] [SPARK-59607][SQL] Fix COUNT on a null partition column in aggregate push down [spark] - posted by "vboo123 (via GitHub)" <gi...@apache.org> on 2026/09/29 04:12:18 UTC, 5 replies.
- [PR] [SPARK-59851][K8S] Add `ACTIVE_TASKS` executor roll policy [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/29 04:27:33 UTC, 7 replies.
- [PR] [SPARK-59708][CONNECT][FOLLOWUP] Re-audit sql.types serialVersionUIDs for branch-4.3 [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/29 05:15:29 UTC, 2 replies.
- [PR] [SPARK-58626][PYTHON][SQL][FOLLOWUP] Align higher-order-function transpile tests with branch-4.3 [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/29 05:42:34 UTC, 0 replies.
- [PR] [SPARK-59688][SQL][TESTS][FOLLOWUP] Add a left outer join regression test for coinciding partition keys [spark] - posted by "naveenp2708 (via GitHub)" <gi...@apache.org> on 2026/09/29 05:52:52 UTC, 0 replies.
- [PR] [SPARK-59852][SQL] Classify only syntax error SQLSTATEs as syntax errors in H2 and Derby dialects [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/09/29 06:02:36 UTC, 1 replies.
- Re: [I] OracleDialect: Hardcoded scale of 10 in Decimal(38,10) causes silent precision loss for bare NUMBER columns [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/09/29 06:45:17 UTC, 0 replies.
- [PR] [SPARK-59855][SQL][CONNECT] Analyze long withColumns chains in one pass and remove the eager analysis in Spark Connect [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/29 07:34:46 UTC, 3 replies.
- [PR] [SPARK-59856] Record the provenance of the vendored Spark Connect protos and add a sync script [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/29 07:42:49 UTC, 2 replies.
- [PR] [SPARK-59857][BUILD] Ensure test module names are unique [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/09/29 10:18:12 UTC, 2 replies.
- Re: [PR] [SPARK-59823][SQL] Deduplicate variant manipulation expressions [spark] - posted by "bojana-db (via GitHub)" <gi...@apache.org> on 2026/09/29 10:23:19 UTC, 4 replies.
- [PR] [DO-NOT-MERGE] SPARK-55410 FEB sink reproducer for some observed issues [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/09/29 11:53:56 UTC, 1 replies.
- [PR] [SPARK-59858][SQL] Keep NULL STRUCT operands NULL in ASOF JOIN MATCH_CONDITION [spark] - posted by "LukaZdravic (via GitHub)" <gi...@apache.org> on 2026/09/29 12:10:42 UTC, 1 replies.
- [PR] [SPARK-59859][SQL] Fail on overflow in date_add and date_sub instead of wrapping around [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/09/29 13:01:50 UTC, 0 replies.
- [PR] [SPARK-59762][PYTHON][FOLLOWUP] Stop UDTFWithPartitions from keeping udtf_info alive for the whole task [spark] - posted by "craiuconstantintiberiu (via GitHub)" <gi...@apache.org> on 2026/09/29 13:24:23 UTC, 3 replies.
- [PR] [SPARK-59861][SQL] Propagate trusted DataSource V2 primary keys as distinct keys [spark] - posted by "hemanthboyina (via GitHub)" <gi...@apache.org> on 2026/09/29 13:31:07 UTC, 0 replies.
- Re: [PR] [SPARK-59829][SQL] Make the forward ASOF scan keep the first match like backwards scan [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/09/29 13:38:57 UTC, 9 replies.
- [PR] [SPARK-59863] Use 4.2.1 RC1 for Spark 4.2 integration tests [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/29 13:43:20 UTC, 3 replies.
- [PR] [SPARK-59864] Use 4.1.4 RC1 for Spark 4.1 integration tests [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/29 13:46:27 UTC, 3 replies.
- [PR] [SPARK-59417][SQL][FOLLOWUP] Stop resuming a streamed JSON array inside a malformed element [spark] - posted by "tdcmeehan (via GitHub)" <gi...@apache.org> on 2026/09/29 13:48:08 UTC, 0 replies.
- [PR] [SPARK-59860][SQL] Fail on overflow in from_unixtime instead of wrapping around [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/09/29 13:49:34 UTC, 0 replies.
- [PR] [SPARK-59865][SQL] Decide Oracle TimestampNTZ wall-clock conversion from JDBCOptions instead of column metadata [spark] - posted by "aleksandar-trajkovic-db (via GitHub)" <gi...@apache.org> on 2026/09/29 14:25:53 UTC, 0 replies.
- Re: [PR] [SPARK-59822][CORE] Make the external UDF worker dispatcher factory configurable [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2026/09/29 14:28:40 UTC, 1 replies.
- [PR] [SPARK-59866] Support K8s events for Kueue eviction of running `SparkApplication` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/29 15:08:37 UTC, 3 replies.
- [PR] [SPARK-59867] Update GitHub Actions to the latest versions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/29 15:32:32 UTC, 3 replies.
- [PR] [SPARK-59868] Update GitHub Actions to the latest approved versions [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/29 15:36:24 UTC, 3 replies.
- [PR] [SPARK-59869][INFRA] Update GitHub Actions to the latest approved versions [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/29 15:42:41 UTC, 4 replies.
- [PR] [SPARK-59870] Clarify the `Failed` message of `SparkCluster` and the K8s events docs [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/29 16:14:42 UTC, 6 replies.
- [PR] [SPARK-59691] Report a failed suspend check of a SparkApplication or SparkCluster [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2026/09/29 17:16:47 UTC, 13 replies.
- [PR] [SPARK-59873] Use `ubuntu-26.04` instead of `ubuntu-latest` in GitHub Actions [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/29 17:17:50 UTC, 3 replies.
- [PR] [SPARK-59874] Update GitHub Actions to the latest approved versions in `spark-docker` [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/29 17:31:44 UTC, 3 replies.
- [PR] [SPARK-59872][PYTHON] Raise structured PySparkRuntimeError for OSError when reading Protobuf descriptor file [spark] - posted by "brijrajk (via GitHub)" <gi...@apache.org> on 2026/09/29 17:34:12 UTC, 2 replies.
- [PR] [SPARK-59876] Suspend and requeue a running `SparkCluster` on Kueue `PodsReadyTimeout` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/29 17:49:48 UTC, 4 replies.
- [PR] [SPARK-59875] Pin Minikube container-runtime to docker to fix CI failures with Minikube 1.39.0 in `spark-docker` [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/29 17:58:03 UTC, 3 replies.
- Re: [PR] [SPARK-58626][PYTHON][SQL][TESTS][FOLLOWUP] Align higher-order-function transpile tests with branch-4.3 [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/09/29 17:59:49 UTC, 1 replies.
- [PR] [SPARK-59878] Exclude `(UWF|NP)_UNWRITTEN_FIELD` for test classes in `spotbugs_exclude.xml` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/29 19:03:55 UTC, 3 replies.
- [PR] [SPARK-59871][SQL] Balance wide predicate trees in optimizer to avoid stack overflow [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2026/09/29 19:17:45 UTC, 1 replies.
- Re: [PR] [SPARK-59808][INFRA] Remove JIRA fix versions and reopen tickets when merging reverts [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/09/29 19:34:45 UTC, 5 replies.
- [PR] [SPARK-59879] Close PrintWriter with try-with-resources in ConfOptionDocGenerator [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2026/09/29 20:29:09 UTC, 0 replies.
- [PR] [SPARK-59877][SS] Fix state store reuse race in Cartesian joins [spark] - posted by "liviazhu (via GitHub)" <gi...@apache.org> on 2026/09/29 21:04:15 UTC, 3 replies.
- Re: [PR] [SPARK-59822][UDF] Make the external UDF worker dispatcher factory configurable [spark] - posted by "zozo123 (via GitHub)" <gi...@apache.org> on 2026/09/29 21:11:44 UTC, 6 replies.
- [PR] [WIP][SQL] Copy a freqItems value only when storing it in the counter map [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/29 21:40:56 UTC, 0 replies.
- Re: [PR] [SPARK-59275][PYTHON] Reject CHAR/VARCHAR at Python/Arrow host boundaries [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/09/29 23:22:57 UTC, 2 replies.
- [PR] [SQL][WIP] Avoid serializing cached columnar RDDs in whole-stage closures [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/09/30 00:18:35 UTC, 0 replies.
- [PR] [SPARK-59885][PYTHON][TESTS] Fix flaky WorkerMemoryTest by pinning spark.task.cpus [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/09/30 00:42:01 UTC, 2 replies.
- Re: [PR] [SPARK-59884][SQL] Avoid serializing cached columnar RDDs in whole-stage closures [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/09/30 00:43:20 UTC, 1 replies.
- Re: [PR] [SPARK-56947][SQL] Add `SortLike` trait for sort physical operators [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/30 00:46:48 UTC, 1 replies.
- Re: [PR] [SPARK-53478][CORE] Resolve SparkFiles.get against root directory when job artifact UUID is set in local mode [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/09/30 00:46:51 UTC, 1 replies.
- [PR] [SPARK-59369][SQL] Add integration testing for JDBC syntax error classification [spark] - posted by "Admaing (via GitHub)" <gi...@apache.org> on 2026/09/30 01:53:33 UTC, 3 replies.
- [PR] [SPARK-55569][SQL] Collapse non-matching pivot column values in fast-path firstAgg [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/09/30 02:52:33 UTC, 0 replies.
- [PR] [SPARK-59841][SQL][4.3] Align changelog state options and metadata reuse [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/09/30 03:40:54 UTC, 2 replies.
- Re: [PR] [SPARK-59884][SQL] Mark SparkPlan's columnar execution cache transient [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/09/30 05:16:22 UTC, 4 replies.
- Re: [PR] [SPARK-59688][SQL][FOLLOWUP] Cover a left outer join in the coinciding-partition-keys test [spark] - posted by "naveenp2708 (via GitHub)" <gi...@apache.org> on 2026/09/30 05:37:54 UTC, 0 replies.
- Re: [PR] [SPARK-59721][SQL] Ignore reported partitioning and ordering that reference unresolvable columns [spark] - posted by "anuragmantri (via GitHub)" <gi...@apache.org> on 2026/09/30 05:38:16 UTC, 5 replies.
- [PR] Bump the opentelemetry group across 1 directory with 7 updates [spark-connect-gateway] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/09/30 05:46:16 UTC, 0 replies.
- [PR] [SPARK-59122][4.3][SQL] Take UnionExec's plain-union decision once instead of re-deriving it per caller [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/30 06:10:56 UTC, 2 replies.
- [PR] Bump brace-expansion in /ui-test [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/09/30 08:27:01 UTC, 2 replies.
- [PR] [SPARK-59886][UDF] Route external UDF dispatch through worker specifications [spark] - posted by "zozo123 (via GitHub)" <gi...@apache.org> on 2026/09/30 09:03:51 UTC, 10 replies.
- [PR] [SPARK-57468][SQL] Add SparkPlan.convention() API to support different columnar batch types [spark] - posted by "zhztheplayer (via GitHub)" <gi...@apache.org> on 2026/09/30 13:31:32 UTC, 0 replies.
- [PR] [SPARK-59886][UDF][TESTS][FOLLOWUP] Test scalar external UDFs end to end through a direct gRPC worker [spark] - posted by "zozo123 (via GitHub)" <gi...@apache.org> on 2026/09/30 14:26:51 UTC, 0 replies.
- [PR] [SPARK-59892] Honor non-positive `spark.kubernetes.operator.reconciler.retry.maxIntervalSeconds` as unlimited [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/30 15:13:45 UTC, 3 replies.
- [PR] [SPARK-59893][INFRA][TEST] Fix npm vulnerabilities in dev and ui-test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/30 15:16:54 UTC, 0 replies.
- [PR] [SPARK-59894][BUILD][TESTS] Upgrade bouncycastle to 1.85 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/09/30 15:17:05 UTC, 0 replies.
- [PR] [SPARK-59890][SQL][TESTS] Replace ResolveAsOfJoinSuite with end-to-end ASOF JOIN tests [spark] - posted by "LukaZdravic (via GitHub)" <gi...@apache.org> on 2026/09/30 15:31:08 UTC, 0 replies.
- [PR] [SPARK-59895] Add `migration_guide.md` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/30 15:35:07 UTC, 9 replies.
- [PR] [SPARK-59891][SQL] Classify only syntax error codes as syntax errors in Teradata dialect [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/09/30 16:37:35 UTC, 1 replies.
- [PR] [SPARK-59897][SQL] Support filters from both join children in PlanMerger [spark] - posted by "hemanthboyina (via GitHub)" <gi...@apache.org> on 2026/09/30 16:54:18 UTC, 0 replies.
- [PR] [SPARK-59898][SQL] Compare BinaryType values by content in freqItems [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/09/30 17:02:44 UTC, 0 replies.
- [PR] [SPARK-59899][SQL] Truncate DSv2 scan output ordering at the first sort order on a pruned column [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/30 17:38:12 UTC, 4 replies.
- [PR] [WIP][CORE][SQL] Prototype compact UI storage and metric tracking [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/09/30 17:44:22 UTC, 0 replies.
- [PR] [SPARK-59887][SQL] Fix wrong results when a storage-partitioned join pairs a transform of a join-key expression with one of a column [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/09/30 17:48:32 UTC, 1 replies.
- [PR] [SPARK-59804][3.5][UI] Fix UTF-8 byte limits and physical line numbers during event log replay [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/30 18:40:11 UTC, 0 replies.
- Re: [PR] [SPARK-58300][PROTOBUF] Add from_protobuf option to keep Timestamp/Duration as struct [spark] - posted by "kavpreetgrewal (via GitHub)" <gi...@apache.org> on 2026/09/30 19:02:11 UTC, 0 replies.
- [PR] [SPARK-59722][SQL] Enforce CHAR/VARCHAR semantics for JSON map keys [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/09/30 19:09:35 UTC, 0 replies.
- [PR] [SPARK-59903] Upgrade `Iceberg` example to use Iceberg 1.12.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/30 20:20:47 UTC, 3 replies.
- [PR] [SPARK-59904] Upgrade Iceberg to 1.12.0 in integration tests [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/30 20:22:48 UTC, 3 replies.
- [PR] [SPARK-58601][PYTHON][TEST][FOLLOWUP] Cover the mapInBatch acceptAnyIterable default in mapInArrow/mapInPandas [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/09/30 20:31:49 UTC, 0 replies.
- Re: [PR] [SPARK-59899][SQL] Restrict DSv2 scan output ordering to sort orders that hold over the scan output [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/30 20:39:54 UTC, 3 replies.
- [PR] [SPARK-59906][PYSPARK] Run relevant tests when JVM-launched Python worker scripts change under smart test selection [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/09/30 20:49:53 UTC, 0 replies.
- [PR] [SPARK-59908] Sync the vendored Spark Connect protos to v4.2.0 [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/09/30 21:28:13 UTC, 0 replies.
- [PR] [SPARK-59909][PYTHON] Fix PySpark errors raised with undefined error conditions or mismatched message parameters [spark] - posted by "jubins (via GitHub)" <gi...@apache.org> on 2026/09/30 22:11:53 UTC, 0 replies.
- [PR] [SPARK-59911][PYTHON] Introduce a pandas eval-type handler base and migrate SQL_SCALAR_PANDAS_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/09/30 22:47:36 UTC, 0 replies.
- [PR] [SPARK-59912][PYSPARK][TEST] Fix flaky WorkerReuseTest and WorkerPoolCrashTest by pinning spark.python.use.daemon [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/09/30 22:52:22 UTC, 0 replies.
- [PR] [SPARK-51830][SQL][4.2] Fix partition type mismatch when validatePartitionColumns is disabled [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/09/30 23:09:07 UTC, 1 replies.
- [PR] [SPARK-59913][INFRA] Point PR component-tag guidance in AGENTS.md to the merge_spark_pr.py registry [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/09/30 23:12:03 UTC, 0 replies.
- [PR] [SPARK-59914][K8S] Make `ExecutorResizePlugin` skip executor pods with the placeholder `EXECID` label [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/30 23:34:08 UTC, 2 replies.
- [PR] [SPARK-59915][DOCS] Document how to hold and resume applications via scripted HTTP requests [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/09/30 23:48:46 UTC, 2 replies.