reviews@spark.apache.org, 2026-10

You are viewing a plain text version of this content. The canonical link for it is here.

- Re: [PR] [SPARK-59915][DOCS] Document how to hold and resume applications via scripted HTTP requests [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/10/01 00:04:26 UTC, 3 replies.
- Re: [PR] [SPARK-59620][SQL] Late-materialization storage-filter pushdown in the vectorized Parquet reader [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/01 00:06:15 UTC, 29 replies.
- Re: [PR] [SPARK-58893][UI] Fix Spark UI multi-cluster reverse proxy: propagate reverseProxyUrl to driver, fix redirect Location and kill button [spark] - posted by "Nflrijal (via GitHub)" <gi...@apache.org> on 2026/10/01 00:09:15 UTC, 15 replies.
- Re: [PR] [SPARK-57324][SQL] Surface external UDF terminal metrics [spark] - posted by "tdcmeehan (via GitHub)" <gi...@apache.org> on 2026/10/01 00:10:32 UTC, 8 replies.
- Re: [PR] [SPARK-59662] Check for isRepartitionBatch can crash if metadata keys are missing [spark] - posted by "ivasilyev1 (via GitHub)" <gi...@apache.org> on 2026/10/01 00:14:51 UTC, 8 replies.
- Re: [PR] [SPARK-59778][SQL] Add display-only properties to the Table API [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/10/01 00:18:05 UTC, 18 replies.
- Re: [PR] [SPARK-59727][PYTHON] Migrate Arrow incremental aggregate and window UDF eval types to the EvalTypeHandler pipeline [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/01 00:30:18 UTC, 1 replies.
- Re: [PR] [SPARK-59804][3.5][UI] Fix UTF-8 byte limits and physical line numbers during event log replay [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/01 00:31:02 UTC, 2 replies.
- Re: [PR] [SPARK-59891][SQL] Classify only syntax error codes as syntax errors in Teradata dialect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/01 00:34:23 UTC, 2 replies.
- Re: [PR] [SPARK-59886][UDF][TESTS][FOLLOWUP] Test scalar external UDFs end to end through a direct gRPC worker [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/01 00:39:08 UTC, 13 replies.
- Re: [PR] [SPARK-59886][UDF] Route external UDF dispatch through worker specifications [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/01 00:41:40 UTC, 1 replies.
- Re: [PR] [SPARK-59369][SQL] Add integration testing for JDBC syntax error classification [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/01 00:42:29 UTC, 3 replies.
- Re: [PR] [SPARK-59914][K8S] Make `ExecutorResizePlugin` skip executor pods with the placeholder `EXECID` label [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/01 00:45:09 UTC, 5 replies.
- [PR] [SPARK-59907][SS] Release in-flight buffer when StreamingShuffleWriter.write() fails [spark] - posted by "Jasraj-Dhanoa (via GitHub)" <gi...@apache.org> on 2026/10/01 00:45:46 UTC, 2 replies.
- Re: [PR] [SPARK-59913][INFRA] Point PR component-tag guidance in AGENTS.md to the merge_spark_pr.py registry [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/01 00:47:33 UTC, 6 replies.
- Re: [PR] [SPARK-57055][SQL][DOCS] Document non-binary collation gap in DataFrameStatFunctions.bloomFilter [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/01 00:53:11 UTC, 1 replies.
- Re: [PR] [SPARK-56845] [K8S] Truncate ConfigMap names that exceed DNS subdomain limit [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/01 00:53:16 UTC, 1 replies.
- [PR] [SPARK-59916][CORE] Support `hold` and `resume` in REST Submission API [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/01 01:14:22 UTC, 6 replies.
- Re: [PR] [SPARK-59831][SQL] Validate bounds in the vectorized BYTE_STREAM_SPLIT reader [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/01 01:23:08 UTC, 2 replies.
- Re: [PR] [SPARK-58892][SQL] Allow DSv2 sources to report inferred Catalyst filters [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/10/01 01:46:05 UTC, 7 replies.
- Re: [PR] [SPARK-58447][CONNECT] Preserve operation tags in Python foreachBatch callbacks [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/10/01 02:46:37 UTC, 0 replies.
- [PR] [WIP][SDP] Memoize flow reachability queries in the pipelines DataflowGraph [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/10/01 02:58:35 UTC, 0 replies.
- Re: [PR] [SPARK-58446][CORE] Prevent late task events from corrupting pending task state [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/10/01 03:11:10 UTC, 0 replies.
- Re: [PR] [SPARK-58093][SQL] Push down LIMIT through UNION ALL to Data Source V2 scan [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/10/01 03:13:16 UTC, 0 replies.
- Re: [PR] [SPARK-51830][SQL][4.2] Fix partition type mismatch when validatePartitionColumns is disabled [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/10/01 03:14:23 UTC, 2 replies.
- Re: [PR] [SPARK-58979][SS] Preserve event time through streaming dedup pruning [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/10/01 03:19:23 UTC, 1 replies.
- Re: [PR] [SPARK-58201][SQL] Optimize sliding window MIN/MAX aggregate function using monotonic deque [spark] - posted by "pavan51 (via GitHub)" <gi...@apache.org> on 2026/10/01 03:29:25 UTC, 8 replies.
- Re: [PR] [SPARK-59844][SS][RTM] Preserve root causes for RTM async operation failures [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/10/01 03:48:31 UTC, 2 replies.
- Re: [PR] [SPARK-58300][PROTOBUF] Add from_protobuf option to keep Timestamp/Duration as struct [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/10/01 04:08:46 UTC, 2 replies.
- Re: [PR] [SPARK-51264][SQL][JDBC][FOLLOWUP] Close JDBC connection after DSv2 truncate [spark] - posted by "zhangxinyao88 (via GitHub)" <gi...@apache.org> on 2026/10/01 04:18:34 UTC, 2 replies.
- Re: [PR] [SPARK-59832][SQL] Fail on truncated input in the vectorized RLE reader [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/01 04:37:44 UTC, 18 replies.
- Re: [PR] [SPARK-58209][SQL] Mark CallMethodViaReflection and XPathExtract stateful to prevent data races [spark] - posted by "anshulbaliga7 (via GitHub)" <gi...@apache.org> on 2026/10/01 04:40:48 UTC, 3 replies.
- Re: [PR] [SPARK-59909][PYTHON] Fix PySpark errors raised with undefined error conditions or mismatched message parameters [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/01 04:48:48 UTC, 13 replies.
- [PR] [SPARK-59918][K8S] Support `deployment` pods allocator in `ExecutorResizePlugin` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/01 04:56:25 UTC, 4 replies.
- Re: [PR] [SPARK-59718][SQL] Add opt-in in-process Python UDF execution via Arrow C Data Interface [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/01 05:40:21 UTC, 49 replies.
- Re: [PR] [SPARK-44462][SS][CONNECT] Fix the session passed to foreachBatch in Spark Connect [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/10/01 05:55:15 UTC, 11 replies.
- Re: [PR] [SPARK-59893][INFRA][TEST] Fix npm vulnerabilities in dev and ui-test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/10/01 05:55:42 UTC, 2 replies.
- Re: [PR] [SPARK-59894][BUILD][TESTS] Upgrade bouncycastle to 1.85 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/10/01 06:00:23 UTC, 2 replies.
- Re: [PR] [SPARK-59887][SPARK-59901][SQL] Fix wrong results when a storage-partitioned join pairs a transform of a join-key expression with one of a column [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/01 06:18:30 UTC, 16 replies.
- [PR] [MINOR][BUILD] Remove stale Conda env var [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/10/01 07:48:50 UTC, 2 replies.
- [PR] [SPARK-59920][BUILD] Remove unnecessary `git clean` from pip tests script [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/10/01 08:15:46 UTC, 4 replies.
- Re: [PR] [SPARK-59829][SQL] Make the forward ASOF scan keep the first match like backwards scan [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/10/01 08:42:52 UTC, 1 replies.
- [PR] [MINOR][SQL] Reuse MetricUtils constants in SQLMetrics instead of duplicating them [spark] - posted by "vim89 (via GitHub)" <gi...@apache.org> on 2026/10/01 08:44:04 UTC, 2 replies.
- Re: [PR] [SPARK-59890][SQL][TESTS] Replace ResolveAsOfJoinSuite with end-to-end ASOF JOIN tests [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/10/01 08:48:14 UTC, 2 replies.
- Re: [PR] [SPARK-38983][SQL][TESTS] Add grouping boolean error regression test [spark] - posted by "superdiaodiao (via GitHub)" <gi...@apache.org> on 2026/10/01 08:51:44 UTC, 0 replies.
- Re: [PR] [SPARK-59865][SQL] Decide Oracle TimestampNTZ wall-clock conversion from JDBCOptions instead of column metadata [spark] - posted by "milastdbx (via GitHub)" <gi...@apache.org> on 2026/10/01 09:08:22 UTC, 13 replies.
- Re: [PR] [SPARK-59740][SQL][TESTS] Add nanosecond timestamp DML coverage [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/10/01 10:37:48 UTC, 2 replies.
- Re: [PR] [SPARK-59824][SQL] Add a single-row size guard for pickle Python UDFs [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/10/01 10:41:47 UTC, 4 replies.
- Re: [PR] [SPARK-59379][CORE] Add an ASCII fast-path to UTF8String position lookups, warmed by numChars() [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/10/01 10:44:09 UTC, 2 replies.
- Re: [PR] [SPARK-59921][SQL] Reuse MetricUtils constants in SQLMetrics instead of duplicating them [spark] - posted by "vim89 (via GitHub)" <gi...@apache.org> on 2026/10/01 10:45:30 UTC, 4 replies.
- Re: [PR] [SPARK-59859][SQL] Fail on overflow in date_add and date_sub instead of wrapping around [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/10/01 11:05:06 UTC, 3 replies.
- Re: [PR] [SPARK-59860][SQL] Fail on overflow in from_unixtime instead of wrapping around [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/10/01 11:10:25 UTC, 0 replies.
- [PR] [SPARK-50698][SQL] Refactor CreateUserDefinedFunctionCommand to extend from UnaryRunnableCommand [spark] - posted by "zahed1994 (via GitHub)" <gi...@apache.org> on 2026/10/01 12:07:12 UTC, 6 replies.
- Re: [PR] [SPARK-59722][SQL] Enforce CHAR/VARCHAR semantics for JSON map keys [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/10/01 13:10:10 UTC, 7 replies.
- [PR] [SPARK-59923][CORE] Warn when OIDC credential propagation is enabled without RPC encryption [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/10/01 13:29:57 UTC, 19 replies.
- [PR] [SPARK-59922][SQL] Inline With definitions in filters inferred by InferFiltersFromConstraints [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/10/01 13:40:28 UTC, 3 replies.
- [PR] [SPARK-59924][K8s][DOCS] Fix stale "Valid values" list for `spark.kubernetes.executor.rollPolicy` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/10/01 13:47:09 UTC, 9 replies.
- [PR] [SPARK-59917][SQL] Do not rtrim CHAR arguments to from_json, from_csv… [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/10/01 14:07:22 UTC, 0 replies.
- Re: [PR] [SPARK-59917][SQL] Do not rtrim CHAR arguments to from_json, from_csv, and from_xml [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/01 14:48:26 UTC, 12 replies.
- [PR] [SPARK-59905][SQL] Fix storage-partitioned join sorting partitions the wrong way for an ORDER BY over a join-key expression [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/01 15:08:16 UTC, 7 replies.
- Re: [PR] [SPARK-59858][SQL] Keep NULL STRUCT operands NULL in ASOF JOIN MATCH_CONDITION [spark] - posted by "SavicStefan (via GitHub)" <gi...@apache.org> on 2026/10/01 15:27:05 UTC, 12 replies.
- Re: [PR] [SPARK-59691] Report a failed suspend check of a SparkApplication or SparkCluster [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/01 15:31:12 UTC, 14 replies.
- Re: [PR] [SPARK-59879] Close PrintWriter with try-with-resources in ConfOptionDocGenerator [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/01 15:32:35 UTC, 2 replies.
- Re: [PR] [SPARK-58601][PYTHON][TEST][FOLLOWUP] Cover the mapInBatch acceptAnyIterable default in mapInArrow/mapInPandas [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/01 17:05:57 UTC, 1 replies.
- [PR] [SPARK-59926] Do not retry failed K8s event writes [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/01 17:12:22 UTC, 6 replies.
- Re: [PR] [SPARK-59721][SQL] Ignore reported partitioning and ordering that reference unresolvable columns [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/01 17:14:36 UTC, 10 replies.
- Re: [PR] [SPARK-58645] Add `recursive` flag to `variant_explode` [spark] - posted by "bojana-db (via GitHub)" <gi...@apache.org> on 2026/10/01 18:03:08 UTC, 0 replies.
- [PR] [SPARK-59927] Fix the Kubernetes client metric names in `configuration.md` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/01 18:07:24 UTC, 4 replies.
- Re: [PR] [SPARK-59696][SQL] Skip the redundant second modulo in integral MathUtils.pmod for positive divisors [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/01 18:11:47 UTC, 6 replies.
- Re: [PR] [SPARK-50593][SQL] SPJ: Support truncate transform via generalized ReducibleFunction API [spark] - posted by "metanil (via GitHub)" <gi...@apache.org> on 2026/10/01 18:15:15 UTC, 6 replies.
- [PR] [SPARK-59929][SQL] Fix Int overflow in window execution for partitions larger than Int.MaxValue rows [spark] - posted by "markj-db (via GitHub)" <gi...@apache.org> on 2026/10/01 18:42:57 UTC, 1 replies.
- Re: [PR] [SPARK-59604][SQL] Honor LAST_WIN when simplifying map lookups [spark] - posted by "charliec05 (via GitHub)" <gi...@apache.org> on 2026/10/01 18:54:48 UTC, 0 replies.
- Re: [PR] [SPARK-44517][SQL] Preserve nullability in batch deduplication [spark] - posted by "charliec05 (via GitHub)" <gi...@apache.org> on 2026/10/01 18:54:51 UTC, 0 replies.
- Re: [PR] [SPARK-57472][SQL] Merge file table options case-insensitively [spark] - posted by "charliec05 (via GitHub)" <gi...@apache.org> on 2026/10/01 18:54:55 UTC, 0 replies.
- Re: [PR] [SPARK-58969][K8S] Preserve URI fragments for uploaded dependencies [spark] - posted by "charliec05 (via GitHub)" <gi...@apache.org> on 2026/10/01 18:54:57 UTC, 0 replies.
- Re: [PR] [SPARK-58316][SQL] Reject non-finite decimal casts in ANSI mode [spark] - posted by "charliec05 (via GitHub)" <gi...@apache.org> on 2026/10/01 18:54:59 UTC, 0 replies.
- Re: [PR] [SPARK-59051][SQL] Compile JDBC partition bounds with the dialect [spark] - posted by "charliec05 (via GitHub)" <gi...@apache.org> on 2026/10/01 18:55:11 UTC, 0 replies.
- [PR] [SPARK-58881][CORE][FOLLOWUP] Document checkpoint part-file filtering [spark] - posted by "charliec05 (via GitHub)" <gi...@apache.org> on 2026/10/01 18:55:33 UTC, 3 replies.
- Re: [PR] [SPARK-58881][CORE] Ignore non-numeric checkpoint part files [spark] - posted by "charliec05 (via GitHub)" <gi...@apache.org> on 2026/10/01 18:56:16 UTC, 0 replies.
- Re: [PR] [SPARK-59912][PYTHON][TESTS] Fix flaky WorkerReuseTest and WorkerPoolCrashTest by pinning spark.python.use.daemon [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/10/01 19:02:27 UTC, 1 replies.
- [PR] [SPARK-59928] Fix kubernetes.client.http.response.latency.nanos always recording near zero [spark-kubernetes-operator] - posted by "ykisana (via GitHub)" <gi...@apache.org> on 2026/10/01 19:43:20 UTC, 16 replies.
- [PR] [SPARK-59930] Upgrade Kueue to v0.20.0 in CI [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/01 19:49:14 UTC, 5 replies.
- [PR] [SPARK-59931] Simplify the K8s event messages of errors and `SchedulingFailure` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/01 20:28:41 UTC, 4 replies.
- [PR] [SPARK-59932] Document Kueue v0.20.0+ as the recommended version [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/01 21:11:41 UTC, 2 replies.
- [PR] [SPARK-59933][SQL] Eliminate quadratic nested field aliasing deduplication [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/10/01 21:21:48 UTC, 4 replies.
- [PR] [SPARK-59935] Fix Prometheus `_sum` and quantiles of histograms and timers [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/01 21:46:02 UTC, 5 replies.
- [PR] [SPARK-59936][DOCS] Use short plugin class names in `spark.plugins` examples and config docs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/01 22:21:37 UTC, 3 replies.
- [PR] [SPARK-59937] Recommend `spark.driver.timeout` instead of Kueue `max-exec-time-seconds` label [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/01 22:27:58 UTC, 3 replies.
- [PR] [SPARK-59939] Deprecate `v1beta1` version of SparkApp and SparkCluster CRDs [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/01 22:42:50 UTC, 3 replies.
- [PR] [SPARK-59940] Use Swift 6.4 as the minimum version and unify CI on `xcode-27` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/01 23:05:18 UTC, 3 replies.
- Re: [PR] [SPARK-34586][SQL] Support declaring a write distribution and ordering in CREATE/REPLACE TABLE [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/01 23:07:46 UTC, 17 replies.
- [PR] [SPARK-57125][SQL] LimitPushDown should fold the merged limit so the plan stays plannable without ConstantFolding [spark] - posted by "rdtr (via GitHub)" <gi...@apache.org> on 2026/10/01 23:22:42 UTC, 8 replies.
- Re: [PR] [SPARK-57125][SQL] LimitPushDown should fold literal Limit+Offset sum so plan stays planable without ConstantFolding [spark] - posted by "rdtr (via GitHub)" <gi...@apache.org> on 2026/10/01 23:24:57 UTC, 0 replies.
- Re: [PR] [SPARK-59929][SQL] Fail fast when a window partition exceeds Int.MaxValue rows [spark] - posted by "markj-db (via GitHub)" <gi...@apache.org> on 2026/10/01 23:25:23 UTC, 6 replies.
- [PR] [SPARK-59942][PYTHON] Use real RunnerConf in Arrow eval type handler tests [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/02 00:22:00 UTC, 2 replies.
- Re: [PR] [SPARK-57623][SDP] Drop AutoCDC `requireDestinationSupportsRowLevelOps` Check [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/02 00:44:53 UTC, 1 replies.
- Re: [I] [PYTHON][PYSPARK][FUNCTIONS] pyspark.sql.functions.try_to_date is missing in PySpark 4.0.0-4.0.4 but the docs say it became available in 4.0.0 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/02 00:44:57 UTC, 0 replies.
- [PR] [SPARK-59938][CONNECT] Improve cancellation for server-side Maven artifact resolution [spark] - posted by "qianlan717 (via GitHub)" <gi...@apache.org> on 2026/10/02 00:56:53 UTC, 8 replies.
- Re: [PR] [SPARK-59327][BUILD] Add config test module [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/10/02 01:04:22 UTC, 3 replies.
- Re: [PR] [SPARK-59342][SQL] Allow configuring schema alignment behavior for DSv2 writes [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/10/02 01:06:26 UTC, 12 replies.
- Re: [PR] [SPARK-59539][SQL] Avoid per-row autoboxing in InSet code generation for integral and date/time types [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/10/02 01:57:10 UTC, 0 replies.
- [PR] [WIP][CORE] Fix integer-division truncation in SizeEstimator's sampled-array extrapolation [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/10/02 03:15:41 UTC, 0 replies.
- [PR] [WIP][CORE] Avoid allocation and boxing in UTF8String ASCII case conversion [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/10/02 04:00:43 UTC, 0 replies.
- Re: [PR] [SPARK-59788][SS] Initialize the global aggregation once per empty batch in the streamline plan [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/10/02 04:15:35 UTC, 5 replies.
- Re: [PR] [SPARK-59605][SQL] Handle NULL values in ORC filter pushdown [spark] - posted by "vboo123 (via GitHub)" <gi...@apache.org> on 2026/10/02 04:21:33 UTC, 5 replies.
- [PR] [SPARK-59948][SQL] Strip aliases from a DSv2 reported ordering on a nested field [spark] - posted by "ykisana (via GitHub)" <gi...@apache.org> on 2026/10/02 04:52:23 UTC, 12 replies.
- Re: [PR] [SPARK-38079][K8S] Create the driver's config maps and mounted secret as pre-resources to avoid a mount race [spark] - posted by "HwangDongJun (via GitHub)" <gi...@apache.org> on 2026/10/02 06:26:00 UTC, 19 replies.
- [PR] [SPARK-44462][4.3][SS][CONNECT] Fix the session passed to foreachBatch in Spark Connect [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/10/02 07:44:17 UTC, 6 replies.
- [PR] [MINOR][PYTHON] Preserve decimal precision when decoding variants [spark] - posted by "Arthur031221 (via GitHub)" <gi...@apache.org> on 2026/10/02 08:29:14 UTC, 0 replies.
- [PR] [SPARK-44462][FOLLOWUP][SS][CONNECT] Assert foreachBatch close() unregisters the cloned session [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/10/02 08:49:54 UTC, 4 replies.
- [PR] [SPARK-59905][SQL][4.3] Fix storage-partitioned join sorting partitions the wrong way for an ORDER BY over a join-key expression [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/02 09:49:39 UTC, 2 replies.
- [PR] [SPARK-59905][SQL][4.2] Fix storage-partitioned join sorting partitions the wrong way for an ORDER BY over a join-key expression [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/02 09:49:44 UTC, 2 replies.
- [PR] [SPARK-59905][SQL][4.1] Fix storage-partitioned join sorting partitions the wrong way for an ORDER BY over a join-key expression [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/02 09:49:46 UTC, 7 replies.
- [PR] [SPARK-59905][SQL][4.0] Fix storage-partitioned join sorting partitions the wrong way for an ORDER BY over a join-key expression [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/02 09:49:48 UTC, 7 replies.
- Re: [PR] [SPARK-59683][SQL][HIVE] Support first-class CHAR/VARCHAR in script TRANSFORM output [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/02 10:09:11 UTC, 8 replies.
- Re: [PR] [SPARK-59911][PYTHON] Migrate SQL_SCALAR_PANDAS_UDF to a pandas eval type handler [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/02 10:44:19 UTC, 1 replies.
- [PR] SPARK-59925: DriverResourceDecorator overwrites resource-defined labe… [spark-kubernetes-operator] - posted by "ssirowa14 (via GitHub)" <gi...@apache.org> on 2026/10/02 11:24:44 UTC, 0 replies.
- Re: [PR] [SPARK-59951][CORE] Avoid allocation and boxing in UTF8String ASCII case conversion [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/02 13:20:52 UTC, 0 replies.
- Re: [PR] [SPARK-59146][SQL] Retain qualified access to source columns affected by pipe SET [spark] - posted by "AMC-hawk (via GitHub)" <gi...@apache.org> on 2026/10/02 13:26:53 UTC, 6 replies.
- Re: [PR] [SPARK-59122][4.3][SQL] Take UnionExec's plain-union decision once instead of re-deriving it per caller [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/10/02 13:54:56 UTC, 2 replies.
- [PR] [SPARK-59952][SQL] Avoid allocating lowercased copies in UTF8_LCASE contains for ASCII strings [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/10/02 14:26:36 UTC, 0 replies.
- [PR] [SPARK-59122][4.2][SQL] Take UnionExec's plain-union decision once instead of re-deriving it per caller [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/10/02 14:35:59 UTC, 5 replies.
- Re: [PR] SPARK-59925: DriverResourceDecorator overwrites resource-defined labels with driver pod labels [spark-kubernetes-operator] - posted by "otterc (via GitHub)" <gi...@apache.org> on 2026/10/02 15:04:05 UTC, 5 replies.
- Re: [PR] [SPARK-53535][SQL] Fix missing structs always being assumed as nulls [spark] - posted by "foliveira-xonai (via GitHub)" <gi...@apache.org> on 2026/10/02 15:39:49 UTC, 4 replies.
- [PR] [SPARK-59953] Add Kueue examples and use them as the Kueue E2E fixtures [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/02 16:58:59 UTC, 9 replies.
- [PR] [SPARK-59954][SQL] Fix DECLARE VARIABLE failing on a NULLIF or BETWEEN default [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/10/02 17:41:59 UTC, 9 replies.
- Re: [PR] [SPARK-59494][SQL] Memoize a join condition's common expression instead of inlining it into every reference [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/10/02 17:42:20 UTC, 1 replies.
- [PR] [WIP][CORE] Count objects behind fields that reflection can't read in SizeEstimator [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/10/02 18:06:41 UTC, 1 replies.
- Re: [PR] [SPARK-59451][CORE] Wait to register Accumulators until after they are done deserializing [spark] - posted by "jlamberts-yobi (via GitHub)" <gi...@apache.org> on 2026/10/02 18:10:21 UTC, 0 replies.
- [PR] [SPARK-59956] Use 4.0.5 RC1 for Spark 4.0 integration tests [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/02 18:24:41 UTC, 4 replies.
- [PR] [SPARK-59957] Use `spark` for `meta.helm.sh/release-name` of the dynamic config E2E fixtures [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/02 18:34:17 UTC, 5 replies.
- [PR] [SPARK-59958] Deduplicate E2E fixtures and state transition assertions [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/02 18:46:12 UTC, 4 replies.
- [PR] [SPARK-59960] Fix Helm command examples to use `spark` release name consistently [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/02 18:55:40 UTC, 5 replies.
- [PR] [SPARK-59959][PYTHON] Migrate SQL_SCALAR_PANDAS_ITER_UDF and SQL_MAP_PANDAS_ITER_UDF to pandas eval type handlers [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/02 18:58:50 UTC, 5 replies.
- [PR] [SPARK-59910][PYTHON] Make VariantVal.toJson match the JVM to_json output [spark] - posted by "AMC-hawk (via GitHub)" <gi...@apache.org> on 2026/10/02 19:24:26 UTC, 1 replies.
- Re: [PR] [SPARK-30628][SQL] Support DPP and subquery partition pruning for V2 file sources [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/02 19:46:54 UTC, 7 replies.
- [PR] [SQL] Cache the compiled regex in StringSplit [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/10/02 19:57:33 UTC, 0 replies.
- [PR] [SPARK-59910][PYTHON] Make VariantVal.toJson produce valid JSON and match the JVM to_json output [spark] - posted by "jubins (via GitHub)" <gi...@apache.org> on 2026/10/02 20:22:25 UTC, 30 replies.
- [PR] [SPARK-55396][SQL][CONNECT] Support Java records in Dataset encoders [spark] - posted by "JacksonKjar (via GitHub)" <gi...@apache.org> on 2026/10/02 20:27:29 UTC, 7 replies.
- Re: [PR] [SPARK-59688][SQL][FOLLOWUP] Cover a left outer join in the coinciding-partition-keys test [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/10/02 20:31:48 UTC, 2 replies.
- [PR] [SPARK-58456][PYTHON][SQL] Support chained comparisons in transpilation [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/10/02 21:13:45 UTC, 3 replies.
- [PR] [SPARK-59962][SQL] Inline common expressions in a command instead of pre-evaluating them under it [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/10/02 21:35:24 UTC, 15 replies.
- [PR] [SPARK-59963] Fix RBAC to allow `Spark` driver to create `Deployment` and scale executors [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/02 22:28:43 UTC, 3 replies.
- [PR] [SPARK-59964] Fix workload RBAC to grant `deletecollection` to Spark drivers [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/02 22:48:46 UTC, 3 replies.
- Re: [PR] [SPARK-59884][SQL] Mark SparkPlan's columnar execution cache transient [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/10/02 22:55:44 UTC, 8 replies.
- [PR] [SPARK-59553][CONNECT][TESTS] Make ArtifactSuite Ivy resolution hermetic [spark] - posted by "qianlan717 (via GitHub)" <gi...@apache.org> on 2026/10/02 23:13:54 UTC, 1 replies.
- [PR] [SPARK-59965][SS] Classify invalid Kafka batch offsets as structured errors [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2026/10/02 23:23:21 UTC, 5 replies.
- [PR] [SQL] Only add explicitly configured remote repositories with custom Ivy settings [spark] - posted by "qianlan717 (via GitHub)" <gi...@apache.org> on 2026/10/02 23:58:05 UTC, 0 replies.
- Re: [PR] [SPARK-56573][SQL] Widen the default tablesample seed to reduce collisions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/03 00:42:30 UTC, 1 replies.
- Re: [I] exitStatusCode:0 The return code of spark-submit is 0 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/03 00:42:32 UTC, 0 replies.
- Re: [PR] [SPARK-56975][SS] Warn when DataStreamReader.table() is given a user-specified schema [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/03 00:42:34 UTC, 1 replies.
- Re: [PR] [SPARK-55818][PS] Decimal-float mixed arithmetic should always raise TypeError [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/03 00:42:36 UTC, 1 replies.
- Re: [PR] [SPARK-56488][BUILD][3.5] Bump Scala 2.13 to 2.13.9 on branch-3.5 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/03 00:42:39 UTC, 1 replies.
- [PR] [SPARK-59919] OffsetSeqMetadataV2 missing shuffle partitions [spark] - posted by "ivasilyev1 (via GitHub)" <gi...@apache.org> on 2026/10/03 00:55:54 UTC, 33 replies.
- Re: [PR] [SPARK-59185][SQL] Derive a StartsWith prefix filter from leading-literal LIKE patterns [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/10/03 02:42:57 UTC, 0 replies.
- [PR] [SPARK-59967][CORE] Scan 8 bytes at a time in UTF8String.contains and binary contains [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/10/03 02:46:05 UTC, 0 replies.
- [PR] [SPARK-59968][SQL] Reuse the regex Matcher across rows in LIKE and RLIKE codegen [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/10/03 02:49:30 UTC, 0 replies.
- [PR] [SPARK-59969][CORE] Skip the redundant bounds check on internal UTF8String byte reads [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/10/03 03:32:38 UTC, 0 replies.
- [PR] [SPARK-33301][SQL] Split a large CASE WHEN into methods under whole-stage codegen [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/10/03 05:38:41 UTC, 27 replies.
- Re: [PR] [SPARK-59950][CORE] Fix integer-division truncation in SizeEstimator's sampled-array extrapolation [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/03 07:01:08 UTC, 0 replies.
- Re: [PR] [SPARK-59827][CORE] Re-register a waiting task in ExecutionMemoryPool.acquireMemory after its entry is removed [spark] - posted by "dwsmith1983 (via GitHub)" <gi...@apache.org> on 2026/10/03 07:12:35 UTC, 1 replies.
- Re: [PR] [SPARK-59805][SQL] Avoid BigDecimal round trips for wide decimals that fit in a long in UnsafeRow [spark] - posted by "dwsmith1983 (via GitHub)" <gi...@apache.org> on 2026/10/03 07:14:18 UTC, 2 replies.
- Re: [PR] [SPARK-59756][CORE] Make Utils.chmod700 atomic on POSIX FS [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/03 07:50:36 UTC, 2 replies.
- [PR] [SPARK-59970][SQL] Reject a temporary variable read through an IDENTIFIER clause in a persistent SQL function [spark] - posted by "anshulbaliga7 (via GitHub)" <gi...@apache.org> on 2026/10/03 09:13:32 UTC, 10 replies.
- Re: [PR] [SPARK-59323][SQL] Record temp variables read by an IDENTIFIER clause as referred by the view [spark] - posted by "anshulbaliga7 (via GitHub)" <gi...@apache.org> on 2026/10/03 09:15:17 UTC, 0 replies.
- Re: [PR] [SPARK-59251][SQL] Reject incompatible Parquet row reader conversions [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/03 09:46:15 UTC, 1 replies.
- Re: [PR] [SPARK-59807][CORE] Reject executor hold while an unreliably-stored shuffle is active [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/03 10:07:57 UTC, 2 replies.
- Re: [PR] [SPARK-59524][CORE] Enforce the array-key / HashPartitioner guard in subtractByKey and the Java fakeClassTag key path [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/03 11:23:20 UTC, 1 replies.
- Re: [PR] [SPARK-59218][SQL] Support escape sequences in Variant path parsing [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/03 11:37:59 UTC, 19 replies.
- Re: [PR] [SPARK-58776][K8S] Propagate spark.ssl.rpc.* passwords to executors [spark] - posted by "sweb (via GitHub)" <gi...@apache.org> on 2026/10/03 11:38:51 UTC, 14 replies.
- [PR] [SQL] Skip V2 pushdown for scalar boolean operands [spark] - posted by "daniilgrbic (via GitHub)" <gi...@apache.org> on 2026/10/03 12:50:14 UTC, 0 replies.
- Re: [PR] [SPARK-59607][SQL] Fix COUNT on a null partition column in aggregate push down [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/03 13:45:53 UTC, 1 replies.
- Re: [PR] [SPARK-55569][SQL] Collapse non-matching pivot column values in fast-path firstAgg [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/03 15:07:01 UTC, 1 replies.
- Re: [PR] [SPARK-59898][SQL] Compare BinaryType values by content in freqItems [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/03 15:32:23 UTC, 5 replies.
- Re: [PR] [SPARK-59906][PYTHON][TESTS] Run relevant tests when JVM-launched Python worker scripts change under smart test selection [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/03 16:03:29 UTC, 0 replies.
- [PR] [MINOR][CORE] Fix the unit of the maximum page size in PackedRecordPointer comment [spark] - posted by "DaemonforY (via GitHub)" <gi...@apache.org> on 2026/10/03 23:18:49 UTC, 3 replies.
- [PR] [SPARK-59972][CORE] Count killed unfinished tasks as pending [spark] - posted by "miaoever (via GitHub)" <gi...@apache.org> on 2026/10/04 00:40:49 UTC, 7 replies.
- Re: [PR] [DO NOT SUBMIT] Prototype to add a versioning header to sketch-based aggregate functions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/04 01:19:45 UTC, 1 replies.
- Re: [PR] [SPARK-55791][PYTHON] Fix pandas-on-Spark equality comparisons under ANSI mode [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/04 01:19:49 UTC, 1 replies.
- Re: [PR] [SPARK-59966][SQL] Only add explicitly configured remote repositories with custom Ivy settings [spark] - posted by "qianlan717 (via GitHub)" <gi...@apache.org> on 2026/10/04 02:49:29 UTC, 4 replies.
- Re: [PR] [SPARK-59908] Sync the vendored Spark Connect protos to v4.2.0 [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/04 05:38:13 UTC, 1 replies.
- Re: [PR] Bump uuid from 1.24.0 to 1.26.1 [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/04 06:47:59 UTC, 2 replies.
- Re: [PR] [SPARK-59877][SS] Fix state store reuse race in Cartesian joins [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/04 07:39:34 UTC, 1 replies.
- Re: [PR] [SPARK-59871][SQL] Balance wide predicate trees in optimizer to avoid stack overflow [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/04 08:23:29 UTC, 3 replies.
- Re: [PR] [SPARK-59784][SQL][TESTS] Fix racy waits for SQL execution metrics in tests [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/10/04 09:19:11 UTC, 4 replies.
- [PR] [SPARK-57214][UDF] Shade gRPC in the udf worker module [spark] - posted by "zozo123 (via GitHub)" <gi...@apache.org> on 2026/10/04 11:34:18 UTC, 1 replies.
- [PR] [SPARK-59083][UDF] Run scalar external UDFs in a CPython worker [spark] - posted by "zozo123 (via GitHub)" <gi...@apache.org> on 2026/10/04 11:56:51 UTC, 7 replies.
- [PR] [WIP][SPARK-55278][UDF] Add an external command that runs a direct worker inside sbx [spark] - posted by "zozo123 (via GitHub)" <gi...@apache.org> on 2026/10/04 13:49:20 UTC, 0 replies.
- Re: [PR] [SPARK-59636][CORE] Fix integer overflow in GcmTransportCipher [spark] - posted by "aajisaka (via GitHub)" <gi...@apache.org> on 2026/10/04 14:45:34 UTC, 0 replies.
- [PR] [SPARK-59961][SQL] Cache the compiled regex in StringSplit [spark] - posted by "pratham76 (via GitHub)" <gi...@apache.org> on 2026/10/04 17:26:51 UTC, 7 replies.
- Re: [I] [SparkConnect] Support url path in SparkConnect connection string [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/05 00:49:46 UTC, 0 replies.
- Re: [PR] [SPARK-57715][SQL] PIVOT count() empty buckets should return 0 instead of NULL [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/05 00:49:48 UTC, 1 replies.
- Re: [PR] [SPARK-57685][SQL] Support non-deterministic expressions in MERGE INTO action assignments on DSv2 tables [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/05 00:49:53 UTC, 1 replies.
- Re: [PR] [SPARK-57275][CONNECT] Validate row count after consuming all arrow batches [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/05 00:49:58 UTC, 1 replies.
- [PR] [SPARK-59973] Upgrade the OpenTelemetry crates to 0.33 and tracing-opentelemetry to 0.34 [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/05 06:57:39 UTC, 2 replies.
- Re: [PR] Bump the opentelemetry group across 1 directory with 7 updates [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/05 06:57:52 UTC, 2 replies.
- Re: [PR] [SPARK-58729][SQL] Support the ANSI SQL/JSON JSON_OBJECT constructor function [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/05 07:17:09 UTC, 24 replies.
- [PR] [SPARK-53322][SQL][4.0] Select a KeyGroupedShuffleSpec only when join key positions can be fully pushed down [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/05 07:44:04 UTC, 2 replies.
- [PR] [SPARK-54124][SQL] Add AS JSON output support for SHOW VIEWS [spark] - posted by "ayushbilala (via GitHub)" <gi...@apache.org> on 2026/10/05 07:59:45 UTC, 7 replies.
- Re: [PR] [SPARK-59358][SDP] SCD2 Ignore-null support; Coalesce ignored-null values [spark] - posted by "jose-torres (via GitHub)" <gi...@apache.org> on 2026/10/05 08:00:16 UTC, 5 replies.
- Re: [PR] [SPARK-46367][SQL] Support narrowing projection of `KeyedPartitioning` in `PartitioningPreservingUnaryExecNode` [spark] - posted by "ammarchalifah (via GitHub)" <gi...@apache.org> on 2026/10/05 12:10:46 UTC, 0 replies.
- Re: [PR] [SPARK-54439][SQL] KeyGroupedPartitioning and join key size mismatch [spark] - posted by "ammarchalifah (via GitHub)" <gi...@apache.org> on 2026/10/05 12:28:09 UTC, 1 replies.
- Re: [PR] [SPARK-50569][CONNECT]: clean up data cached by individual sessions [spark] - posted by "psavalle (via GitHub)" <gi...@apache.org> on 2026/10/05 12:44:17 UTC, 0 replies.
- Re: [PR] [SPARK-59044][SQL] Handle OFFSET 0 in physical planning when EliminateOffsets is excluded [spark] - posted by "hemanthboyina (via GitHub)" <gi...@apache.org> on 2026/10/05 12:48:32 UTC, 2 replies.
- Re: [I] Credential Rotation [spark] - posted by "CoderNasim2023 (via GitHub)" <gi...@apache.org> on 2026/10/05 13:18:29 UTC, 2 replies.
- [PR] [WIP][SQL] Preserve boolean literals in V2 scalar expressions [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/10/05 15:27:16 UTC, 0 replies.
- [PR] [SPARK-59887][SPARK-59901][SQL][4.2] Fix wrong results when a storage-partitioned join pairs a transform of a join-key expression with one of a column [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/05 15:29:20 UTC, 3 replies.
- [PR] [SPARK-59887][SPARK-59901][SQL][4.3] Fix wrong results when a storage-partitioned join pairs a transform of a join-key expression with one of a column [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/05 15:29:29 UTC, 3 replies.
- Re: [PR] [SPARK-59275][PYTHON] Reject CHAR/VARCHAR at Python/Arrow host boundaries [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/05 16:00:53 UTC, 7 replies.
- Re: [PR] [SPARK-58814][SQL] Cover CHAR/VARCHAR round-trips and stop ORC truncating scans [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/05 16:25:33 UTC, 3 replies.
- [PR] [SPARK-59976] Use `spark` release name for `helm uninstall` in `watched-namespaces` E2E test [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/05 16:57:44 UTC, 3 replies.
- Re: [PR] [SPARK-58111][SQL] Scan and write schema narrowing for column-level UPDATE in DSv2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/05 17:09:40 UTC, 8 replies.
- [PR] [SPARK-59978][SQL] Fix BIN BY boundary index overflow [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/10/05 17:21:04 UTC, 2 replies.
- [PR] [SPARK-59980] Upgrade `spotbugs-gradle-plugin` to 6.5.12 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/05 17:36:12 UTC, 3 replies.
- [PR] [SPARK-59982][BUILD] Bump `commons-lang3` to 3.21.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/05 17:38:47 UTC, 4 replies.
- Re: [PR] [SPARK-59553][CONNECT][TESTS][FOLLOWUP] Make ArtifactSuite Ivy resolution hermetic [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/10/05 18:00:56 UTC, 1 replies.
- Re: [PR] [SPARK-59897][SQL] Support filters from both join children in PlanMerger [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/05 18:13:19 UTC, 12 replies.
- [PR] [SPARK-59979] Fix `podLogs` selectors and collect all log lines in E2E tests [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/05 18:15:35 UTC, 3 replies.
- [PR] [SPARK-59983][SQL] Fix `StackOverflowError` in `toString` of V2 expressions with unknown names [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/05 19:32:11 UTC, 6 replies.
- [PR] [SPARK-59984] Parse Boolean config values like Apache Spark and use the default value for null [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/05 20:00:23 UTC, 3 replies.
- [I] Python images can't run default Python UDFs since Spark 4.2 (PyArrow and pandas not installed) [spark-docker] - posted by "lisancao (via GitHub)" <gi...@apache.org> on 2026/10/05 20:24:55 UTC, 0 replies.
- [PR] [SPARK-59985][ML][PYTHON] Fix malformed warning in TorchDistributor w… [spark] - posted by "firasbouzazi (via GitHub)" <gi...@apache.org> on 2026/10/05 20:51:05 UTC, 9 replies.
- [PR] [SPARK-59989] Pin the Rust toolchain and silence double_must_use on async_trait traits [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/05 21:30:43 UTC, 2 replies.
- Re: [PR] [SPARK-59487][CORE] Add task attempt spans to executor profiling [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/10/05 21:48:23 UTC, 1 replies.
- [PR] [SPARK-59990] Fix the documented precedence of system properties in `configuration.md` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/05 22:18:31 UTC, 3 replies.
- [PR] [SPARK-59991] Remove unused `operatorConfiguration.append` and fix broken `conf/` links [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/05 22:50:45 UTC, 4 replies.
- [PR] [SPARK-59988][SQL] Raise DATATYPE_MISMATCH instead of INTERNAL_ERROR for to_timestamp with numeric input and a format [spark] - posted by "sadikovi (via GitHub)" <gi...@apache.org> on 2026/10/05 23:18:49 UTC, 3 replies.
- [PR] [SPARK-59992][SQL] Make element_at and array index nullable when the index is nullable under ANSI mode [spark] - posted by "richardc-db (via GitHub)" <gi...@apache.org> on 2026/10/05 23:48:24 UTC, 4 replies.
- [PR] [SPARK-58972][FOLLOWUP][DOCS] Add migration guide entry for from_protobuf wrapper unwrapping [spark] - posted by "bhollis-dbx (via GitHub)" <gi...@apache.org> on 2026/10/06 00:16:35 UTC, 7 replies.
- [PR] [SPARK-59993][PYTHON] Collect scalar pandas UDF phase timing metrics [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/10/06 00:30:15 UTC, 9 replies.
- Re: [PR] [MINOR][PYTHON][DOCS] Clarify PySpark installation options [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/06 00:45:35 UTC, 1 replies.
- Re: [PR] [SPARK-56093][CORE][HISTORY] Allow AppStatus to be cached and reused by the history server. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/06 00:45:37 UTC, 1 replies.
- [PR] [SPARK-59986][SS] Expose trigger metadata in streaming query progress [spark] - posted by "alyssa-db (via GitHub)" <gi...@apache.org> on 2026/10/06 00:56:04 UTC, 15 replies.
- [PR] [SPARK-59941][CORE][SQL] Widen UnsafeExternalSorter row accounting to Long for window partitions larger than Int.MaxValue rows [spark] - posted by "markj-db (via GitHub)" <gi...@apache.org> on 2026/10/06 01:25:04 UTC, 5 replies.
- [PR] [SPARK-57744][SQL] Route vectorized column population and row getters through type operations [spark] - posted by "zhangxinyao88 (via GitHub)" <gi...@apache.org> on 2026/10/06 03:55:31 UTC, 1 replies.
- Re: [PR] [SPARK-59919][SS] Fix OffsetSeqMetadataV2 missing shuffle partitions on rebinding [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/10/06 04:57:17 UTC, 23 replies.
- Re: [PR] Revert [SPARK-56898][SQL] conditional COUNT(DISTINCT) rewrite [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/10/06 05:38:52 UTC, 0 replies.
- Re: [PR] [MINOR][PYTHON] Coerce the JVM error message to str in ArrowCollectSerializer.load_stream [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/06 05:55:05 UTC, 1 replies.
- [PR] [SPARK-59569][BUILD] Add support for shell script test goals [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/10/06 06:20:09 UTC, 16 replies.
- Re: [I] index.html [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/10/06 07:01:08 UTC, 0 replies.
- Re: [PR] [SPARK-59824][SQL] Guard top-level StringType/BinaryType inputs to pickle Python UDFs [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2026/10/06 07:53:55 UTC, 4 replies.
- Re: [PR] [SPARK-59818][SQL] Handle a NULL sketch state in approx_top_k_estimate and approx_top_k_combine [spark] - posted by "jubins (via GitHub)" <gi...@apache.org> on 2026/10/06 07:56:09 UTC, 9 replies.
- Re: [PR] [MINOR][DOCS] Fix broken HTML table in sql-error-conditions caused by placeholders inside code spans [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/10/06 08:03:44 UTC, 6 replies.
- [PR] [SPARK-59995][SQL] Let `TransformExpression` generate the code of its bound function [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/06 08:14:50 UTC, 1 replies.
- [PR] [SPARK-59975]Handle all-null partial and final tuple/theta intersection aggregates [spark] - posted by "SavicStefan (via GitHub)" <gi...@apache.org> on 2026/10/06 08:16:34 UTC, 2 replies.
- [PR] [SPARK-59924][K8S][DOC][4.3] Fix stale "Valid values" list for `spark.kubernetes.executor.rollPolicy` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/10/06 08:58:17 UTC, 3 replies.
- [PR] [SPARK-59997][SQL] Avoid full config registry scans during body resolution [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2026/10/06 09:57:38 UTC, 3 replies.
- Re: [PR] [SPARK-59574][SQL] Apply injectHintResolutionRule in the single-pass Analyzer [spark] - posted by "s-maling-celonis (via GitHub)" <gi...@apache.org> on 2026/10/06 10:12:48 UTC, 6 replies.
- [PR] [SPARK-59998][CORE] Make LogEntry concatenation lazy [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2026/10/06 10:24:38 UTC, 5 replies.
- [PR] [SPARK-59682][SQL] Make RemoveRedundantAliases non-excludable [spark] - posted by "pratham76 (via GitHub)" <gi...@apache.org> on 2026/10/06 10:32:29 UTC, 5 replies.
- Re: [PR] [SPARK-59642][SQL] Validate the arity of connector-reported partition keys [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/06 10:36:51 UTC, 0 replies.
- [PR] [SPARK-59981][SQL] Derive the partition-key ordering when a V2 scan's reported ordering keeps no sort order [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/06 12:39:56 UTC, 14 replies.
- Re: [PR] [SPARK-59858][SQL] Compare ASOF JOIN STRUCT operands without rebuilding them [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/10/06 12:56:04 UTC, 2 replies.
- Re: [PR] Switch tags to resolute to build on 26.04 instead of 22.04 [spark-docker] - posted by "RobbertDM (via GitHub)" <gi...@apache.org> on 2026/10/06 13:00:56 UTC, 1 replies.
- Re: [PR] [SPARK-59978][SQL] Handle BIN BY range and boundary overflows [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/10/06 13:16:24 UTC, 11 replies.
- [PR] [SPARK-30768][SQL] Constraints inferred from inequality attributes [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2026/10/06 14:11:15 UTC, 18 replies.
- Re: [PR] [SPARK-59987][SQL] Wrap Boolean scalars for V2 predicate pushdown [spark] - posted by "alekjarmov (via GitHub)" <gi...@apache.org> on 2026/10/06 14:48:37 UTC, 7 replies.
- Re: [PR] [SPARK-59138][CORE] Preserve reliably-stored shuffle map outputs on executor loss [spark] - posted by "venkata91 (via GitHub)" <gi...@apache.org> on 2026/10/06 15:47:15 UTC, 2 replies.
- Re: [PR] [WIP][SQL] Make changelog loading state-option-aware [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/10/06 17:01:21 UTC, 0 replies.
- [PR] [SPARK-52878][SQL] Rewrite checkpoint constraints by expression ID [spark] - posted by "vb-dbrks (via GitHub)" <gi...@apache.org> on 2026/10/06 17:33:31 UTC, 1 replies.
- [PR] [SPARK-60003][SQL] Do not promote collation-only CAST when applying LCT [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/10/06 19:11:09 UTC, 2 replies.
- [PR] [SPARK-60004] Upgrade `Apache DataFusion Comet` to 1.1.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/06 19:33:03 UTC, 2 replies.
- [PR] [SPARK-60005] Upgrade `joda-time` to 2.15.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/06 19:43:04 UTC, 3 replies.
- [PR] [SPARK-60006] Upgrade `Netty` to 4.2.19.Final [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/06 19:46:34 UTC, 3 replies.
- [PR] [SPARK-60007] Upgrade `Apache Gluten` to 1.7.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/06 20:02:44 UTC, 3 replies.
- Re: [PR] [SPARK-59925] DriverResourceDecorator overwrites resource-defined labels with driver pod labels [spark-kubernetes-operator] - posted by "ssirowa14 (via GitHub)" <gi...@apache.org> on 2026/10/06 20:11:06 UTC, 16 replies.
- [PR] [SPARK-60008] Enable K8s events by default [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/06 20:11:28 UTC, 7 replies.
- Re: [PR] [SPARK-59467][PYTHON] Normalize ArrowDtype timestamps to the session timezone in pandas conversion [spark] - posted by "fangchenli (via GitHub)" <gi...@apache.org> on 2026/10/06 21:10:47 UTC, 0 replies.
- [PR] Install `pyarrow` and `pandas` in `r-python.template` [spark-docker] - posted by "lisancao (via GitHub)" <gi...@apache.org> on 2026/10/06 21:13:33 UTC, 4 replies.
- Re: [PR] [SPARK-57743][SQL] Addition of a partitions function in datalake V1 tables [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/07 00:47:27 UTC, 1 replies.
- Re: [PR] [SPARK-56539][CORE] Fix zero exit code on Standalone remote driver failure [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/07 00:47:30 UTC, 1 replies.
- [PR] [SPARK-60013][CONNECT] Ensure Ivy contexts are popped after Maven resolution failures [spark] - posted by "qianlan717 (via GitHub)" <gi...@apache.org> on 2026/10/07 01:35:28 UTC, 2 replies.
- [PR] [SPARK-60012][CONNECT][SQL] Avoid copying Ivy caches when cloning ArtifactManager [spark] - posted by "qianlan717 (via GitHub)" <gi...@apache.org> on 2026/10/07 01:47:02 UTC, 3 replies.
- Re: [PR] [SPARK-59615][SQL] Avoid an intermediate buffer in VectorizedPlainValuesReader.readGeoData [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/10/07 02:45:11 UTC, 0 replies.
- [PR] [SPARK-60014] Upgrade PMD to 7.28.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/07 03:26:30 UTC, 4 replies.
- [PR] [SPARK-59984][FOLLOWUP] Fix the JIRA link of the Boolean config item in `migration_guide.md` [spark-kubernetes-operator] - posted by "ykisana (via GitHub)" <gi...@apache.org> on 2026/10/07 03:28:21 UTC, 4 replies.
- [PR] [SPARK-60015] Remove JIRA IDs from `migration_guide.md` [spark-kubernetes-operator] - posted by "ykisana (via GitHub)" <gi...@apache.org> on 2026/10/07 03:35:41 UTC, 2 replies.
- [PR] [SPARK-60002][SQL] Respect NULL DEFINED AS in ROW FORMAT DELIMITED [spark] - posted by "sankalpsthakur (via GitHub)" <gi...@apache.org> on 2026/10/07 03:58:53 UTC, 3 replies.
- [PR] [SPARK-60017] Fix `Workload` access revocation and `Suspended` downgrade notes [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/07 04:22:20 UTC, 4 replies.
- [PR] [SPARK-60018] Add `ApplicationStateSummary.Suspended` and `ApplicationStatus#resume` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/07 04:26:32 UTC, 8 replies.
- [PR] [SPARK-60019][UI] Build the executor thread dump download in the browser [spark] - posted by "zsxwing (via GitHub)" <gi...@apache.org> on 2026/10/07 05:06:36 UTC, 3 replies.
- [PR] [SPARK-60020] Fix `KubernetesMetricsInterceptor` exceptions for `namespaces` paths and out-of-range response codes [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/07 05:07:15 UTC, 5 replies.
- [PR] [SPARK-60022][BUILD] Upgrade Netty to 4.2.19.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/07 05:34:18 UTC, 5 replies.
- [PR] Bump the opentelemetry group with 7 updates [spark-connect-gateway] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/10/07 05:45:22 UTC, 3 replies.
- [PR] Bump uuid from 1.24.0 to 1.27.0 [spark-connect-gateway] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/10/07 05:45:44 UTC, 2 replies.
- [PR] [SPARK-60025] Support `spec.suspend` for a running `SparkApplication` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/07 06:26:31 UTC, 6 replies.
- Re: [PR] [SPARK-59460][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1072 [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/10/07 06:41:28 UTC, 14 replies.
- Re: [PR] [SPARK-58129][SQL] Assign a name to the error class _LEGACY_ERROR_TEMP_0031 [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/10/07 06:41:30 UTC, 0 replies.
- Re: [PR] [SPARK-59577][BUILD] Add shared PySpark base test module [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/10/07 07:08:05 UTC, 5 replies.
- Re: [PR] [SPARK-59995][SQL] Drop sort orders that hold a partition transform from a V2 scan's output ordering [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/07 09:06:40 UTC, 14 replies.
- Re: [PR] [SPARK-59663][CONNECT][SDP] Plan pipeline flow relations at analysis time to keep dataset dependencies [spark] - posted by "Vivek1106-04 (via GitHub)" <gi...@apache.org> on 2026/10/07 10:06:37 UTC, 0 replies.
- [PR] [SPARK-60000][SQL] Accept a hidden USING column in ASOF JOIN MATCH_CONDITION [spark] - posted by "LukaZdravic (via GitHub)" <gi...@apache.org> on 2026/10/07 10:13:51 UTC, 23 replies.
- [PR] [SPARK-60010][SQL] Fail vectorized Parquet reads of a non-zero-scale DECIMAL as an integral type [spark] - posted by "sankalpsthakur (via GitHub)" <gi...@apache.org> on 2026/10/07 10:16:24 UTC, 1 replies.
- Re: [PR] [SPARK-59925] Keep resource-defined labels over driver pod labels in DriverResourceDecorator [spark-kubernetes-operator] - posted by "ssirowa14 (via GitHub)" <gi...@apache.org> on 2026/10/07 11:27:13 UTC, 24 replies.
- [PR] [SPARK-60034][SQL] Skip a storage filter on the rows the Parquet reader already checked [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/07 11:43:17 UTC, 19 replies.
- Re: [PR] [SPARK-58006][SQL][FOLLOWUP] Reject escaping outer refs in forceSkipInline defs [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/10/07 13:21:37 UTC, 0 replies.
- [PR] [SPARK-60036][SQL] Preserve USER_SPECIFIED_CAST when retargeting collation-only CAST [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/10/07 14:15:29 UTC, 3 replies.
- Re: [PR] [SPARK-59639][SQL] Tighten nullability of Divide, Remainder, IntegralDivide, and Pmod under ANSI mode [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/10/07 15:28:43 UTC, 0 replies.
- [PR] [SPARK-XXXXX][SQL] Merge nested nullability of all values in UNPIVOT value columns [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/10/07 15:36:34 UTC, 0 replies.
- [PR] [SPARK-59949] Record the `operator.sdk` controller execution histograms with sub-second precision [spark-kubernetes-operator] - posted by "sankalpsthakur (via GitHub)" <gi...@apache.org> on 2026/10/07 16:07:17 UTC, 1 replies.
- [PR] [SPARK-60039] Upgrade `checkstyle` to 13.11.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/07 16:15:17 UTC, 3 replies.
- Re: [PR] [SPARK-60005][BUILD] Upgrade `joda-time` to 2.15.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/07 16:17:10 UTC, 1 replies.
- [PR] Bump net.snowflake:snowflake-jdbc from 4.1.0 to 4.3.4 [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/10/07 16:27:54 UTC, 2 replies.
- [PR] [SPARK-60042] Support Kueue admission check `podSetUpdates` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/07 17:26:58 UTC, 5 replies.
- [PR] [SPARK-60045][SQL] Avoid per-value regex compilation when parsing decimals in CSV/JSON/XML [spark] - posted by "dwsmith1983 (via GitHub)" <gi...@apache.org> on 2026/10/07 18:34:37 UTC, 1 replies.
- [PR] [PYTHON] Dispatch SQL_ARROW_UDTF through an eval type handler [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/07 19:08:34 UTC, 0 replies.
- [PR] [SPARK-60050][SQL] Convert only timestamp-bearing ORC file columns when checking timestamp compatibility per split [spark] - posted by "dwsmith1983 (via GitHub)" <gi...@apache.org> on 2026/10/07 19:17:56 UTC, 1 replies.
- [PR] [SPARK-60051] Fix `DataFrame.collect()` to return `Data` for `BINARY` columns instead of crashing [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/07 19:35:08 UTC, 3 replies.
- [PR] [SPARK-60052] Suspend and requeue a running `SparkApplication` on Kueue eviction [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/07 19:55:13 UTC, 8 replies.
- [PR] [SPARK-60053] Fix `MergeIntoWriter.update` to pass assignments to the merge action [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/07 20:29:56 UTC, 3 replies.
- [PR] [SPARK-60054] Fix `DataFrame.hint` to not crash on out-of-range integers and unsupported parameter types [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/07 20:31:03 UTC, 3 replies.
- [PR] [SPARK-60055] Fix `dropDuplicatesWithinWatermark` to set `withinWatermark` in `Deduplicate` relation [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/07 20:32:22 UTC, 3 replies.
- [PR] [WIP][SS] Report the streaming query failure even if building its exception fails [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2026/10/07 20:44:13 UTC, 0 replies.
- [PR] [SPARK-60056] Split `kueue` E2E test group into `kueue` and `kueue-pods-ready` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/07 21:09:36 UTC, 5 replies.
- [PR] [SPARK-XXXXX][CONNECT] Allow recreating an expired Spark Connect session via ReleaseSession(allow_reconnect=true) [spark] - posted by "venkata91 (via GitHub)" <gi...@apache.org> on 2026/10/07 21:10:50 UTC, 1 replies.
- [PR] [MINOR][SQL] State the NULL STRUCT rule in the AsOfJoin.buildMatchExpressions Scaladoc [spark] - posted by "LukaZdravic (via GitHub)" <gi...@apache.org> on 2026/10/07 21:18:04 UTC, 2 replies.
- Re: [PR] [SPARK-49933][SQL] Push WHEN NOT MATCHED BY SOURCE predicates to target [spark] - posted by "tokoko (via GitHub)" <gi...@apache.org> on 2026/10/07 21:35:17 UTC, 3 replies.
- [PR] [SPARK-60057] Add `suspendReason` to `Suspended` states` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/07 21:38:08 UTC, 2 replies.
- Re: [PR] [SPARK-60057] Add `suspendReason` to `Suspended` states [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/07 21:55:30 UTC, 2 replies.
- [PR] [SPARK-60058][SQL] Add ALTERNATE_VARIANT_ENCODING JSON Option for from_json and to_json expressions [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2026/10/07 21:56:29 UTC, 2 replies.
- [PR] [K8S] Install `pyarrow` in PySpark K8s Dockerfile [spark] - posted by "lisancao (via GitHub)" <gi...@apache.org> on 2026/10/07 22:08:04 UTC, 1 replies.
- [PR] [SPARK-60059][INFRA] Enable `metrics-server` addon in K8s integration test CI [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/07 22:11:57 UTC, 5 replies.
- [PR] [SPARK-60060] Make StreamingQueryStatus and StreamingQueryException properties public [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/07 22:17:07 UTC, 3 replies.
- [PR] [SPARK-60061] Fix Row.getAsTimestampNanos and Row.== to not crash on out-of-range values [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/07 22:17:58 UTC, 3 replies.
- [PR] [SPARK-60063] Fix Catalog.listDatabases/getDatabase/getFunction to not crash on null locationUri and className [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/07 22:18:50 UTC, 3 replies.
- Re: [PR] [SPARK-60062][CONNECT] Allow recreating an expired Spark Connect session via ReleaseSession(allow_reconnect=true) [spark] - posted by "venkata91 (via GitHub)" <gi...@apache.org> on 2026/10/07 22:19:05 UTC, 2 replies.
- [PR] [SPARK-60064] Fix DataFrameReader and DataStreamReader to not send empty format when format is not specified [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/07 22:19:48 UTC, 3 replies.
- [PR] [SPARK-60065] Build the operator image without Gradle in the build-image CI job [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/07 22:27:26 UTC, 5 replies.
- [PR] [SPARK-60068] Run unit tests on each matrix JDK and skip linters in `build-test` CI [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/07 22:55:01 UTC, 5 replies.
- Re: [PR] [SPARK-59601][SQL] Close the output stream of a spilled DiskRowQueue [spark] - posted by "qingfureal (via GitHub)" <gi...@apache.org> on 2026/10/07 23:15:37 UTC, 3 replies.
- Re: [PR] [SPARK-59598][SQL] GetMapValue and ElementAt must not match a null map key [spark] - posted by "qingfureal (via GitHub)" <gi...@apache.org> on 2026/10/07 23:16:12 UTC, 2 replies.
- Re: [PR] [SPARK-54999] Re-enable `ConstraintTests` by moving into `IcebergTests` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/07 23:16:56 UTC, 1 replies.
- Re: [PR] [SPARK-58021][CONNECT] Recover abandoned local pool launches [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/10/07 23:18:36 UTC, 8 replies.
- [PR] [SPARK-60071][SQL] Use identity equality for HybridRowQueue [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/07 23:32:31 UTC, 13 replies.
- [PR] [SPARK-60067[SQL] Keep UpdateFields compact through execution [spark] - posted by "bhollis-dbx (via GitHub)" <gi...@apache.org> on 2026/10/07 23:37:53 UTC, 12 replies.
- Re: [PR] [SPARK-58021][CONNECT] Add local server pool acquisition engine [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/10/07 23:51:58 UTC, 0 replies.
- Re: [PR] [SPARK-60062][CONNECT] Allow a Spark Connect session to opt in to reusing its session id after close [spark] - posted by "venkata91 (via GitHub)" <gi...@apache.org> on 2026/10/08 00:03:35 UTC, 21 replies.
- Re: [PR] [SPARK-56757][PYTHON] Refactor scalar iterator Pandas UDF worker path [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/08 00:46:37 UTC, 1 replies.
- [PR] Revert "[SPARK-59487][CORE] Add task attempt spans to executor profiling" [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2026/10/08 00:56:20 UTC, 3 replies.
- [PR] [WIP][STREAMING] Reacquire Kafka consumer during offset recovery [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2026/10/08 01:08:10 UTC, 0 replies.
- [PR] [SPARK-59487][FOLLOWUP] Change profiler task span enabled configuration version [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2026/10/08 01:19:54 UTC, 4 replies.
- [PR] [SPARK-60074][SQL] Avoid parsing the requested schema twice per split in the vectorized Parquet reader [spark] - posted by "dwsmith1983 (via GitHub)" <gi...@apache.org> on 2026/10/08 01:55:47 UTC, 1 replies.
- [PR] [SPARK-59417][SQL] Stream multiline top-level JSON arrays [spark] - posted by "tdcmeehan (via GitHub)" <gi...@apache.org> on 2026/10/08 02:35:00 UTC, 2 replies.
- Re: [PR] [SPARK-47010][K8S] Support csi driver for volume type [spark] - posted by "zgzzbws (via GitHub)" <gi...@apache.org> on 2026/10/08 03:04:20 UTC, 0 replies.
- [PR] [SPARK-60079][K8S][TESTS] Add `ExecutorResizePlugin` integration test [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/08 03:38:22 UTC, 4 replies.
- [PR] [SPARK-60080] Add `Kueue Admission and Workload Lifecycle` section to `architecture.md` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/08 03:43:21 UTC, 3 replies.
- Re: [PR] [SPARK-59674][CORE] Fix Comparison method violates its general contract in FIFOSchedulingAlgorithm [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2026/10/08 03:46:29 UTC, 1 replies.
- Re: [PR] [SPARK-59671][SQL] Validate a co-partitioned pair by its children's pairing [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/10/08 03:55:52 UTC, 2 replies.
- [PR] [SPARK-60082] Deduplicate the remaining E2E `SparkApplication` fixtures [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/08 04:43:29 UTC, 3 replies.
- Re: [PR] [SPARK-58126][CORE] Support a pluggable root pool comparator via configuration [spark] - posted by "ChrisMuki (via GitHub)" <gi...@apache.org> on 2026/10/08 05:38:11 UTC, 0 replies.
- Re: [PR] [SPARK-58950][SQL] Materialize repeated view references as one CTE [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/10/08 06:04:28 UTC, 7 replies.
- [PR] [SPARK-59919][4.3][SS] Fix OffsetSeqMetadataV2 missing shuffle partitions on rebinding [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/10/08 07:44:32 UTC, 0 replies.
- [PR] [SPARK-59919][4.2][SS] Fix OffsetSeqMetadataV2 missing shuffle partitions on rebinding [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/10/08 07:46:42 UTC, 0 replies.
- Re: [PR] [SPARK-59919][SS][4.3] Fix OffsetSeqMetadataV2 missing shuffle partitions on rebinding [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/10/08 07:48:05 UTC, 3 replies.
- Re: [PR] [SPARK-59919][SS][4.2] Fix OffsetSeqMetadataV2 missing shuffle partitions on rebinding [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/10/08 07:48:10 UTC, 3 replies.
- [PR] [SPARK-60073][SQL] Return NULL from try_make_timestamp for a year outside the timestamp range [spark] - posted by "huangpengtao00-dotcom (via GitHub)" <gi...@apache.org> on 2026/10/08 10:08:04 UTC, 1 replies.
- [PR] [SPARK-60072][SQL] Expand count(*) in pivot aggregates [spark] - posted by "huangpengtao00-dotcom (via GitHub)" <gi...@apache.org> on 2026/10/08 10:08:08 UTC, 1 replies.
- [PR] [SPARK-60084][SQL] Fix PlanMerger losing a reused filter attribute before the aggregate [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/08 10:33:23 UTC, 5 replies.
- [PR] [SPARK-60085][SQL][WIP] Reduce hash clustering for Float/Double map keys [spark] - posted by "vb-dbrks (via GitHub)" <gi...@apache.org> on 2026/10/08 10:38:38 UTC, 0 replies.
- Re: [PR] [SPARK-59345][SQL] Add RUNTIME_FILTER join hint [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/10/08 10:51:56 UTC, 20 replies.
- Re: [PR] [SPARK-59781][PYTHON] Warn when a row has a different number of values than the inferred schema in createDataFrame [spark] - posted by "NestDream (via GitHub)" <gi...@apache.org> on 2026/10/08 12:36:07 UTC, 2 replies.
- [PR] [SPARK-60086] Document Kueue v0.20.0+ as the required version [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/08 12:49:51 UTC, 3 replies.
- [PR] [SPARK-60087] Add Kueue feature support table to `spark_custom_resources.md` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/08 12:52:29 UTC, 3 replies.
- [PR] [SPARK-60088][SQL] Remove non-existent built-in functions `ai_complete` and `ai_embed` from the single-pass resolver guard [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/10/08 13:04:54 UTC, 5 replies.
- [PR] [SPARK-60089][SQL] Surface remote JDBC insufficient-privilege errors as a dedicated error class [spark] - posted by "milos-stojanovic-db (via GitHub)" <gi...@apache.org> on 2026/10/08 13:19:24 UTC, 1 replies.
- [PR] [SPARK-60081][PYTHON] Preserve datetime.fold for repeated DST-hour timestamps in Python UDFs [spark] - posted by "canyang25 (via GitHub)" <gi...@apache.org> on 2026/10/08 14:15:55 UTC, 12 replies.
- [PR] [SPARK-60037][SQL] Preserve source column order for columns added by schema evolution [spark] - posted by "imonteroq (via GitHub)" <gi...@apache.org> on 2026/10/08 14:25:43 UTC, 15 replies.
- [PR] [SPARK-60028][SQL] Do not split LIKE 'prefix%suffix' over a nondeterministic input [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/10/08 14:55:46 UTC, 7 replies.
- [PR] [SPARK-60001][SQL] Allow outer references bellow ASOF JOIN in correlated subqueries [spark] - posted by "LukaZdravic (via GitHub)" <gi...@apache.org> on 2026/10/08 15:40:48 UTC, 0 replies.
- [PR] [SPARK-60090][SQL][HIVE] Apply CHAR/VARCHAR assignment after TRANSFORM via Project [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/10/08 15:45:31 UTC, 15 replies.
- [PR] [SPARK-59995][SQL][4.3] Drop sort orders that hold a partition transform from a V2 scan's output ordering [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/08 16:18:20 UTC, 3 replies.
- [PR] [SPARK-59995][SQL][4.2] Drop sort orders that hold a partition transform from a V2 scan's output ordering [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/08 16:18:23 UTC, 3 replies.
- Re: [PR] [SPARK-38719][SQL] Test the error class: CANNOT_CAST_DATATYPE [spark] - posted by "deepujain (via GitHub)" <gi...@apache.org> on 2026/10/08 16:58:47 UTC, 2 replies.
- Re: [PR] [MINOR][DOCS] Fix broken HTML table in sql-error-conditions [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/10/08 18:01:04 UTC, 1 replies.
- Re: [PR] [SPARK-59518][K8S] Fall back to the driver service account when the executor one is empty [spark] - posted by "anshulbaliga7 (via GitHub)" <gi...@apache.org> on 2026/10/08 18:02:25 UTC, 0 replies.
- Re: [PR] [SPARK-58883][CORE] Detect truncated checkpoint directory on read via persisted partition count [spark] - posted by "anshulbaliga7 (via GitHub)" <gi...@apache.org> on 2026/10/08 18:04:02 UTC, 3 replies.
- [PR] [SPARK-60092][SQL] Add FileType Catalyst data type with FILE EXTERNAL DDL and JSON schema support [spark] - posted by "dejankrak-db (via GitHub)" <gi...@apache.org> on 2026/10/08 18:10:47 UTC, 36 replies.
- Re: [PR] [SPARK-59681][SQL] Guaranteed CTE shuffle reuse [spark] - posted by "AveryQi115 (via GitHub)" <gi...@apache.org> on 2026/10/08 18:54:29 UTC, 1 replies.
- [PR] [SPARK-60044][SQL] Freeze the k-way merge ordering of GroupPartitionsExec when the merge is planned [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/08 19:07:40 UTC, 11 replies.
- [PR] [SPARK-60084][SQL][4.3] Fix PlanMerger losing a reused filter attribute before the aggregate [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/08 19:36:44 UTC, 4 replies.
- [PR] [SPARK-60084][SQL][4.2] Fix PlanMerger losing a reused filter attribute before the aggregate [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/08 19:37:17 UTC, 3 replies.
- Re: [PR] [SPARK-59993][PYTHON] Collect worker and Arrow-optimized Python UDF timing metrics [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/08 20:39:31 UTC, 14 replies.
- [PR] [SPARK-60094][SDP] Gate AutoCDC ignore-null updates [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/10/08 20:45:43 UTC, 4 replies.
- [PR] [SPARK-60096][CONNECT][SQL] Raise a user-facing error instead of INTERNAL_ERROR for an unresolved DataFrame subquery plan id [spark] - posted by "sadikovi (via GitHub)" <gi...@apache.org> on 2026/10/08 22:33:59 UTC, 15 replies.
- Re: [PR] [SPARK-59747][CORE] Don't retry compaction of rolled event log files with malformed input [spark] - posted by "DengYiping (via GitHub)" <gi...@apache.org> on 2026/10/08 23:23:46 UTC, 11 replies.
- [PR] [SPARK-60097][SDP] SCD1 Ignore-null support; Define version map construction [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/10/08 23:50:19 UTC, 5 replies.
- Re: [PR] [SPARK-59695][SDP] SCD1 Ignore-null support; Introduce version map in `cdc_metadata` [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/10/09 00:07:50 UTC, 1 replies.
- Re: [PR] [SPARK-57780][SQL] Do not classify Postgres permission-denied as a syntax error [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/09 00:48:28 UTC, 1 replies.
- Re: [PR] [SPARK-57776][CORE] Add History Server access logging [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/09 00:48:32 UTC, 1 replies.
- Re: [PR] fix issue MapType as a type hint for schema 55900 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/09 00:48:37 UTC, 1 replies.
- [PR] [SPARK-60100][PYTHON] Migrate grouped and cogrouped map pandas UDF eval types to pandas eval type handlers [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/09 00:54:25 UTC, 5 replies.
- [PR] [SPARK-60101][SQL] Add a columnar data source API for JVM and native (Rust, C++) data sources [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/09 01:10:20 UTC, 0 replies.
- Re: [PR] [SPARK-58118][SDP] Allow user-specified AUTO CDC schema to omit the reserved metadata column [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/10/09 01:17:52 UTC, 4 replies.
- [PR] [WIP][CONNECT][PYTHON] Honor uncapped retry backoff in Python client [spark] - posted by "akashmalbari (via GitHub)" <gi...@apache.org> on 2026/10/09 02:13:24 UTC, 1 replies.
- Re: [PR] [SPARK-59794][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1079 [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/10/09 02:53:25 UTC, 3 replies.
- [PR] [SPARK-60102][SQL] Apply CSV CHAR/VARCHAR assignment after STRING parse [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/10/09 03:12:41 UTC, 0 replies.
- [PR] [SPARK-60103][SQL] Apply XML CHAR/VARCHAR assignment after STRING parse [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/10/09 03:15:04 UTC, 0 replies.
- [PR] [SPARK-59234][SQL] Fail fast when a distributed key holds more splits than its expected count [spark] - posted by "naveenp2708 (via GitHub)" <gi...@apache.org> on 2026/10/09 03:59:51 UTC, 5 replies.
- Re: [PR] [SPARK-60038][SQL] Merge nested nullability of all values in UNPIVOT value columns [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/09 04:16:29 UTC, 18 replies.
- Re: [PR] [SPARK-59722][SQL] Apply JSON CHAR/VARCHAR assignment after STRING parse [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/09 04:23:34 UTC, 7 replies.
- Re: [PR] [SPARK-55278][UDF] Document and test direct worker launcher commands [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/09 05:26:24 UTC, 11 replies.
- [PR] [WIP] Psd preflight clean rejection [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/10/09 05:38:57 UTC, 1 replies.
- [PR] [SPARK-60104][BUILD][TESTS] Switch Snowflake JDBC Driver from fat to thin [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/10/09 06:04:03 UTC, 3 replies.
- Re: [PR] [SPARK-60101][SQL] Support native data sources implemented in Rust or C++ [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/10/09 07:07:28 UTC, 61 replies.
- Re: [PR] [SPARK-60091][SS] Report the streaming query failure even if building its exception fails [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/09 07:09:24 UTC, 7 replies.
- [PR] [SPARK-60105][SQL] Memoize the retained session-config overlay for view and SQL function body confs [spark] - posted by "sebastianhillig-db (via GitHub)" <gi...@apache.org> on 2026/10/09 07:19:25 UTC, 9 replies.
- Re: [PR] [SPARK-59813][YARN] Dump thread stacks when SparkContext initialization times out in ApplicationMaster [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/10/09 07:44:05 UTC, 9 replies.
- [PR] Bump rustls from 0.23.43 to 0.23.45 [spark-connect-gateway] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/10/09 07:53:12 UTC, 2 replies.
- Re: [PR] [SPARK-59169][CORE] Log a warning when KVStoreProtobufSerializer falls back to JSON SerDe [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/10/09 08:45:44 UTC, 2 replies.
- Re: [PR] [SPARK-59975][SQL] Handle all-null partial and final tuple/theta intersection aggregates [spark] - posted by "SavicStefan (via GitHub)" <gi...@apache.org> on 2026/10/09 09:25:34 UTC, 6 replies.
- Re: [PR] [SPARK-57881][SQL] UnionExec outputPartitioning supports KeyedPartitioning [spark] - posted by "ammarchalifah (via GitHub)" <gi...@apache.org> on 2026/10/09 11:12:38 UTC, 0 replies.
- [PR] [SPARK-60106][SQL] Require symmetric filter propagation when both plans filter different join children [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/09 11:25:51 UTC, 5 replies.
- [PR] [SPARK-60040][SQL] Carry the AS-OF join direction to SortMergeAsOfJoinExec [spark] - posted by "LukaZdravic (via GitHub)" <gi...@apache.org> on 2026/10/09 11:39:02 UTC, 8 replies.
- [PR] [SPARK-59971][SQL] Apply requireAllClusterKeysForCoPartition to the one-side shuffle of a storage-partitioned join [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/09 14:13:11 UTC, 16 replies.
- [PR] [SPARK-60107][SQL] Trim the storage-filter comments and conf docs [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/09 14:15:39 UTC, 25 replies.
- Re: [PR] [SPARK-59589][SQL] Hand Expand's varying output columns to the consumer as globals [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/10/09 14:19:59 UTC, 7 replies.
- Re: [PR] [SPARK-59175][SQL] Extract the whole GROUP BY expression when a select item combines it with a window function [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/10/09 16:25:13 UTC, 5 replies.
- [PR] [SPARK-60108][SQL] Length-check JSON CHAR/VARCHAR map keys without pad or trim [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/10/09 16:34:53 UTC, 19 replies.
- [PR] [SPARK-60009][PYTHON] Honor Arrow-backed pandas conversion types and safety [spark] - posted by "luc-pimentel (via GitHub)" <gi...@apache.org> on 2026/10/09 16:51:09 UTC, 6 replies.
- Re: [PR] [SPARK-57324][SQL][UDF] Surface external UDF terminal metrics [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/09 17:38:15 UTC, 1 replies.
- [PR] [SPARK-60109][UI] Apply the replay line-length limit and UTF-8-safe line alignment to the History Server end-event reparse [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/09 19:44:15 UTC, 15 replies.
- [PR] [SPARK-60110][UI] Skip event log compaction when replay skips lines over the line-length limit [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/09 20:19:16 UTC, 10 replies.
- [PR] [SPARK-60098][SQL] Fix memory leaks in ParquetColumnVector [spark] - posted by "frroliveira (via GitHub)" <gi...@apache.org> on 2026/10/09 22:59:36 UTC, 6 replies.
- [PR] [WIP][SPARK-60111][SQL] Preserve tags when rebuilding DataSource V2 relations [spark] - posted by "yyanyy (via GitHub)" <gi...@apache.org> on 2026/10/09 23:28:40 UTC, 0 replies.
- Re: [PR] [SPARK-60076][STREAMING] Reacquire Kafka consumer during offset recovery [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2026/10/09 23:48:26 UTC, 0 replies.
- [PR] [SPARK-60116] Document Kueue default `LocalQueue` as not supported [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/10 00:46:08 UTC, 4 replies.
- Re: [PR] [SPARK-54507][SQL] Add time_of_day_bucket function for TIME type bucketing [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/10 00:46:43 UTC, 1 replies.
- Re: [PR] [SPARK-60117][K8S] Install `pyarrow` in PySpark Docker image [spark] - posted by "lisancao (via GitHub)" <gi...@apache.org> on 2026/10/10 01:41:23 UTC, 20 replies.
- [PR] [SPARK-60112][CORE] Track memory consumers by identity in TaskMemoryManager [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/10 01:43:16 UTC, 7 replies.
- [PR] [SPARK-60113][SQL] Wait for the pipelined Python UDF writer to exit before task completion cleanup [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/10 01:43:33 UTC, 1 replies.
- Re: [PR] [SPARK-60076][SS] Reacquire Kafka consumer during offset recovery [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/10 02:16:10 UTC, 4 replies.
- [PR] [SPARK-60115] Pin the transitive h2 dependency to 0.4.16 to pick up RUSTSEC-2026-0258 [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/10 02:16:49 UTC, 2 replies.
- [PR] [SPARK-60023][SQL] Set writeJobUUID before setupJob in FileFormatWriter [spark] - posted by "ykisana (via GitHub)" <gi...@apache.org> on 2026/10/10 02:41:07 UTC, 7 replies.
- Re: [PR] [SPARK-60103][SQL] Length-check XML CHAR/VARCHAR map keys without pad or trim [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/10/10 03:01:46 UTC, 8 replies.
- Re: [PR] [SPARK-40608][SQL] Push necessary predicates from partially translatable V2 filters [spark] - posted by "xiaoh1024 (via GitHub)" <gi...@apache.org> on 2026/10/10 03:11:27 UTC, 0 replies.
- [PR] [SPARK-60118][SQL] Fix Int overflow in the fast-fail check of casting string to decimal [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/10 04:57:53 UTC, 18 replies.
- [PR] [SPARK-60119][SQL] Skip rescaling in Decimal.changePrecision when the result is known from the magnitude [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/10 05:26:48 UTC, 15 replies.
- Re: [PR] [SPARK-60001][SQL] Allow outer references for ASOF JOIN in correlated subqueries [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/10 06:59:44 UTC, 0 replies.
- [PR] [SPARK-60121][BUILD] Upgrade `snappy-java` to 1.1.10.11 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/10 07:52:37 UTC, 2 replies.
- [PR] [SPARK-60122][PYTHON] Remove non-existent `avro` Maven profile from Avro doctest skip messages [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/10 08:10:02 UTC, 3 replies.
- [PR] [SPARK-60120][CORE] Upgrade zstd-jni to 1.5.7-22 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/10/10 08:30:31 UTC, 0 replies.
- Re: [PR] [SPARK-60102][SQL] Skip CSV filter pushdown for CHAR columns [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/10 11:11:22 UTC, 4 replies.
- Re: [PR] [SPARK-8682][SQL] Support range join for range-predicate joins [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/10 12:49:43 UTC, 36 replies.
- [PR] [SPARK-58628][PYTHON] Gate transpiled NULL checks on inferred nullability [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/10/10 13:02:22 UTC, 4 replies.
- Re: [I] [FEATURE REQUEST] Add ADBC (Arrow Database Connectivity) Data Source [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/10/10 13:39:41 UTC, 4 replies.
- Re: [PR] [SPARK-59351][SQL] Rewrite nested subqueries in hoisted correlated predicates against the subquery plan [spark] - posted by "pratham76 (via GitHub)" <gi...@apache.org> on 2026/10/10 14:34:54 UTC, 36 replies.
- Re: [PR] [SPARK-58891][SQL] Reorder Window stacks to minimize exchanges [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/10/10 16:35:45 UTC, 5 replies.
- Re: [PR] [SPARK-59717][SQL] Fix MatchError when grouping by a UDT column backed by a primitive type [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/10/10 18:17:55 UTC, 4 replies.
- Re: [PR] [SPARK-60113][CORE][SQL] Wait for the pipelined Python UDF writer to exit before task completion cleanup [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/10 18:23:40 UTC, 33 replies.
- [PR] [SPARK-60135][SQL] Prune unnecessary subquery-expression traversal [spark] - posted by "hussein-awala (via GitHub)" <gi...@apache.org> on 2026/10/10 21:37:19 UTC, 0 replies.
- [PR] [SPARK-60136][SQL] Reduce allocations when computing TreeNode node names [spark] - posted by "hussein-awala (via GitHub)" <gi...@apache.org> on 2026/10/10 21:37:24 UTC, 0 replies.
- Re: [PR] [SPARK-38483][PYTHON][CONNECT] Add Column.col_name property exposing a column's name [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/11 00:51:14 UTC, 1 replies.
- [PR] [MINOR][ML][PYTHON] Narrow FM model types in examples [spark] - posted by "bearomorphism (via GitHub)" <gi...@apache.org> on 2026/10/11 03:25:01 UTC, 1 replies.
- [PR] [MINOR][PYTHON] Annotate UNSUPPORTED_COMBINATIONS in pyspark/install.py [spark] - posted by "bearomorphism (via GitHub)" <gi...@apache.org> on 2026/10/11 03:46:05 UTC, 0 replies.
- [PR] [SPARK-60137][SQL] Allow lossless widening cast in ExprUtils.canEvaluateUnconditionally [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2026/10/11 03:57:24 UTC, 2 replies.
- [PR] [PYTHON] Add type annotations to LooseVersion comparisons [spark] - posted by "bearomorphism (via GitHub)" <gi...@apache.org> on 2026/10/11 04:21:20 UTC, 0 replies.
- [PR] [WIP][SQL] Return zero for instr with zero start and empty substring [spark] - posted by "zhangxinyao88 (via GitHub)" <gi...@apache.org> on 2026/10/11 04:39:05 UTC, 2 replies.
- [PR] [SPARK-60145][PYTHON] Remove type: ignore[var-annotated] in pyspark.sql [spark] - posted by "soaring0616 (via GitHub)" <gi...@apache.org> on 2026/10/11 04:44:18 UTC, 5 replies.
- [PR] [MINOR][MLLIB] Declare size on PySpark Vector [spark] - posted by "bearomorphism (via GitHub)" <gi...@apache.org> on 2026/10/11 05:00:02 UTC, 0 replies.
- [PR] [MINOR][MLLIB] Fix PySpark Vector dot product typing [spark] - posted by "bearomorphism (via GitHub)" <gi...@apache.org> on 2026/10/11 05:15:19 UTC, 0 replies.
- [PR] [SPARK-60141][PYTHON] Correct SparkContext profiler collector type annotation [spark] - posted by "Horse-MA00 (via GitHub)" <gi...@apache.org> on 2026/10/11 05:27:28 UTC, 2 replies.
- Re: [PR] [SPARK-60139][PYTHON] Remove dead code UNSUPPORTED_COMBINATIONS [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/10/11 05:52:38 UTC, 0 replies.
- [PR] [SPARK-60149][PYTHON][TESTS] Add tests for ErrorClassesReader lookup and breaking_change_info fallback [spark] - posted by "vito-lin-dev (via GitHub)" <gi...@apache.org> on 2026/10/11 05:54:54 UTC, 2 replies.
- [PR] [SPARK-60151][ML][PYTHON] Fix CrossValidatorModel.load returning the last fold's sub-models for every fold [spark] - posted by "chinaoel (via GitHub)" <gi...@apache.org> on 2026/10/11 06:03:01 UTC, 3 replies.
- [PR] [SPARK-60138][PYTHON][TEST] Add unit tests for minimum version checks in pyspark.sql.pandas.utils [spark] - posted by "leeeating (via GitHub)" <gi...@apache.org> on 2026/10/11 06:07:09 UTC, 1 replies.
- [PR] [SPARK-60140][ML][MLLIB][PYTHON] Remove type: ignore caused by variable re-binding in pyspark.ml and pyspark.mllib linalg [spark] - posted by "leeeating (via GitHub)" <gi...@apache.org> on 2026/10/11 06:07:12 UTC, 0 replies.
- [PR] Add a type annotation and descriptive comment for UNSUPPORTED_COMBINATIONS [spark] - posted by "HsuehYi (via GitHub)" <gi...@apache.org> on 2026/10/11 06:14:43 UTC, 3 replies.
- Re: [PR] [SPARK-60146][PYTHON] Use len for MLlib vector dimensions [spark] - posted by "bearomorphism (via GitHub)" <gi...@apache.org> on 2026/10/11 06:19:40 UTC, 0 replies.
- [PR] [SPARK-60154][PYTHON][TEST] Add test for Catalog.createDatabase with properties [spark] - posted by "kjs1095 (via GitHub)" <gi...@apache.org> on 2026/10/11 06:22:01 UTC, 4 replies.
- [PR] [SPARK-60148][PYTHON][TESTS] Add unit tests for pyspark.traceback_utils [spark] - posted by "NickJavaDev88 (via GitHub)" <gi...@apache.org> on 2026/10/11 06:32:58 UTC, 4 replies.
- [PR] [SPARK-60143][PYTHON][TESTS] Make make_timestamp tests in test_functions independent of the local timezone [spark] - posted by "kenny75557 (via GitHub)" <gi...@apache.org> on 2026/10/11 06:35:07 UTC, 2 replies.
- [PR] [SPARK-60158][UI] Avoid per-character synchronized reads in the bounded event log line reader [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/11 06:36:48 UTC, 6 replies.
- [PR] [SPARK-60159][PYTHON][CONNECT][TEST] Add tests for string and DataFrame keyword arguments in spark.sql formatting [spark] - posted by "LearnFirst (via GitHub)" <gi...@apache.org> on 2026/10/11 06:39:56 UTC, 0 replies.
- [PR] [SPARK-60161][PYTHON][TEST] Add tests for nested timestamp conversion in pandas type converters [spark] - posted by "Xiugapurin (via GitHub)" <gi...@apache.org> on 2026/10/11 07:00:37 UTC, 2 replies.
- [PR] [SPARK-60155][PYTHON][TESTS] Add tests for pyspark.ml.linalg.VectorUDT [spark] - posted by "mix060514 (via GitHub)" <gi...@apache.org> on 2026/10/11 07:06:54 UTC, 2 replies.
- [PR] [SPARK-60163][PYTHON] Remove type: ignore[no-untyped-def] in pyspark.sql [spark] - posted by "RogelioKG (via GitHub)" <gi...@apache.org> on 2026/10/11 07:10:01 UTC, 0 replies.
- [PR] [SPARK-60162][PYTHON] Correct DataFrame debugging configuration type narrowing [spark] - posted by "Horse-MA00 (via GitHub)" <gi...@apache.org> on 2026/10/11 07:10:28 UTC, 0 replies.
- [PR] [SPARK-60164][CONNECT][PYTHON][TESTS] Cover configuration responses and partitioning expressions [spark] - posted by "Echoslayer (via GitHub)" <gi...@apache.org> on 2026/10/11 07:15:00 UTC, 0 replies.
- [PR] [SPARK-60142][TESTS] Add unit tests for _SparkPartitionTorchDataset._get_field_converter [spark] - posted by "shiannn13 (via GitHub)" <gi...@apache.org> on 2026/10/11 07:21:16 UTC, 1 replies.
- [PR] [SPARK-60157][PYTHON][TESTS] Test ListState existence and clear behavior [spark] - posted by "billy784512 (via GitHub)" <gi...@apache.org> on 2026/10/11 07:23:13 UTC, 2 replies.
- [PR] [MINOR][ML][PYTHON] Declare validator parameter dependency in Connect persistence [spark] - posted by "bearomorphism (via GitHub)" <gi...@apache.org> on 2026/10/11 07:23:36 UTC, 0 replies.
- [PR] [SPARK-60166][PYTHON][TESTS] Extend test coverage for Spark Connect P… [spark] - posted by "Chia-Chi-Shen (via GitHub)" <gi...@apache.org> on 2026/10/11 07:28:58 UTC, 0 replies.
- [PR] [MINOR][PYTHON][TEST] Cover GC state restoration in disable_gc [spark] - posted by "bearomorphism (via GitHub)" <gi...@apache.org> on 2026/10/11 07:43:26 UTC, 0 replies.
- [PR] [SPARK-60167][PYTHON][TEST] Add test for skipping disallowed accumulator metrics in Spark Connect client [spark] - posted by "shibe2655 (via GitHub)" <gi...@apache.org> on 2026/10/11 07:56:01 UTC, 0 replies.
- [PR] [SPARK-60160][PS][TEST] Improve test coverage of complex_ops in pandas API [spark] - posted by "kevinhongzl (via GitHub)" <gi...@apache.org> on 2026/10/11 07:56:42 UTC, 0 replies.
- [PR] [SPARK-60169][PYTHON][TEST] Add unit tests for PySpark SQL utility helpers [spark] - posted by "WgLy (via GitHub)" <gi...@apache.org> on 2026/10/11 08:02:52 UTC, 1 replies.
- Re: [PR] [SPARK-60148][PYTHON][TESTS] Cover first_spark_call from the shell entry point [spark] - posted by "NickJavaDev88 (via GitHub)" <gi...@apache.org> on 2026/10/11 08:16:27 UTC, 0 replies.
- [PR] [SPARK-60172][CONNECT][TEST] Add tests for retry policies and progress [spark] - posted by "Echoslayer (via GitHub)" <gi...@apache.org> on 2026/10/11 08:18:21 UTC, 0 replies.
- [PR] [SPARK-60174][PYTHON] Remove type: ignore[union-attr] in pyspark.sql.… [spark] - posted by "soaring0616 (via GitHub)" <gi...@apache.org> on 2026/10/11 08:31:47 UTC, 0 replies.
- [PR] [SPARK-XXXXX][PYTHON][ML] Replace type: ignore[union-attr] in pyspark… [spark] - posted by "vito-lin-dev (via GitHub)" <gi...@apache.org> on 2026/10/11 08:34:05 UTC, 0 replies.
- Re: [PR] [SPARK-60159][PYTHON][TEST] Add tests for string and DataFrame keyword arguments in spark.sql formatting [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/10/11 08:42:42 UTC, 1 replies.
- [PR] [MINOR][ML] Replace remote identifier type ignores with assertions [spark] - posted by "bearomorphism (via GitHub)" <gi...@apache.org> on 2026/10/11 08:43:41 UTC, 0 replies.
- [PR] [SPARK-60168][PYTHON] Remove type: ignore[union-attr] for the JVM and gateway handles [spark] - posted by "EdwardLeeMacau (via GitHub)" <gi...@apache.org> on 2026/10/11 10:03:16 UTC, 1 replies.
- [PR] Improve type annotations and kwargs handling [spark] - posted by "HsuehYi (via GitHub)" <gi...@apache.org> on 2026/10/11 12:36:44 UTC, 0 replies.
- [PR] [SPARK-59985][4.3][ML][PYTHON] Fix malformed warning in TorchDistributor when the log streaming server fails to start [spark] - posted by "firasbouzazi (via GitHub)" <gi...@apache.org> on 2026/10/11 14:56:03 UTC, 0 replies.
- [PR] [SPARK-59985][4.2][ML][PYTHON] Fix malformed warning in TorchDistributor when the log streaming server fails to start [spark] - posted by "firasbouzazi (via GitHub)" <gi...@apache.org> on 2026/10/11 14:56:11 UTC, 0 replies.
- [PR] [SPARK-59985][4.1][ML][PYTHON] Fix malformed warning in TorchDistributor when the log streaming server fails to start [spark] - posted by "firasbouzazi (via GitHub)" <gi...@apache.org> on 2026/10/11 14:56:21 UTC, 0 replies.
- [PR] [SPARK-59985][4.0][ML][PYTHON] Fix malformed warning in TorchDistributor when the log streaming server fails to start [spark] - posted by "firasbouzazi (via GitHub)" <gi...@apache.org> on 2026/10/11 14:56:29 UTC, 0 replies.
- [PR] [SPARK-59985][3.5][ML][PYTHON] Fix malformed warning in TorchDistributor when the log streaming server fails to start [spark] - posted by "firasbouzazi (via GitHub)" <gi...@apache.org> on 2026/10/11 14:56:37 UTC, 3 replies.
- [PR] [SPARK-60177][SQL] Support CREATE OR REPLACE for metric views in the session catalog [spark] - posted by "lisancao (via GitHub)" <gi...@apache.org> on 2026/10/11 18:29:57 UTC, 4 replies.
- Re: [PR] [SPARK-38743][SQL] Test the error class: MISSING_STATIC_PARTITION_COLUMN [spark] - posted by "deepujain (via GitHub)" <gi...@apache.org> on 2026/10/11 20:43:04 UTC, 1 replies.
- [PR] [SPARK-60011][SQL] Keep a DSv2 nested-field ordering after schema pruning [spark] - posted by "ykisana (via GitHub)" <gi...@apache.org> on 2026/10/11 21:34:01 UTC, 7 replies.
- Re: [I] EXPLAIN COST gives wrong estimated input size when querying via VIEW instead of physical Delta path [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/12 00:52:30 UTC, 0 replies.
- Re: [PR] [SPARK-57786][CORE] Disable Spark History Server log access from UI by default [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/12 00:52:32 UTC, 1 replies.
- Re: [PR] [SPARK-59507][SQL] Parse interval fractional seconds without building a padded string [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/10/12 02:44:41 UTC, 3 replies.
- [PR] [WIP][PYTHON] Improve type annotation for SparkContext._accumulatorServer [spark] - posted by "bearomorphism (via GitHub)" <gi...@apache.org> on 2026/10/12 02:59:27 UTC, 0 replies.
- Re: [PR] [SPARK-60142][PYTHON][TESTS] Add unit tests for _SparkPartitionTorchDataset._get_field_converter [spark] - posted by "shiannn13 (via GitHub)" <gi...@apache.org> on 2026/10/12 03:56:33 UTC, 0 replies.
- [PR] [SPARK-60181][STREAMING] Guard stream-stream join state format and RocksDB merge operator compatibility [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/10/12 04:39:53 UTC, 0 replies.
- Re: [PR] [SPARK-59662][SS] Check for isRepartitionBatch can crash if metadata keys are missing [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/10/12 05:13:20 UTC, 3 replies.
- [PR] [WIP][PYTHON] Improve type annotation for MLlib Vector indexing [spark] - posted by "bearomorphism (via GitHub)" <gi...@apache.org> on 2026/10/12 05:44:28 UTC, 0 replies.
- [PR] Bump net.snowflake:snowflake-jdbc-thin from 4.1.0 to 4.3.4 [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/10/12 06:35:03 UTC, 2 replies.
- [PR] [WIP][PYTHON] Improve type annotation for pandas_on_spark accessors [spark] - posted by "bearomorphism (via GitHub)" <gi...@apache.org> on 2026/10/12 06:37:42 UTC, 0 replies.
- [PR] [WIP][PYTHON] Improve type annotation for pandas-on-Spark datetime callbacks [spark] - posted by "bearomorphism (via GitHub)" <gi...@apache.org> on 2026/10/12 06:42:25 UTC, 0 replies.
- [PR] [SPARK-60184] Fix workload RBAC to allow `ExecutorResizePlugin` to resize executor pods [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/12 07:15:53 UTC, 4 replies.
- Re: [PR] [SPARK-60121][BUILD] Upgrade `snappy-java` to 1.1.10.12 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/12 07:54:01 UTC, 2 replies.
- [PR] [SPARK-60179][SQL] Treat a cast to STRING as time-zone dependent when… [spark] - posted by "hhr293 (via GitHub)" <gi...@apache.org> on 2026/10/12 08:17:46 UTC, 6 replies.
- Re: [PR] [SPARK-43253][SQL] Report unresolved MapObjects as an internal error [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/10/12 08:49:28 UTC, 2 replies.
- [PR] [WIP][PYTHON] Improve type annotation for SparkConnectGrpcException message [spark] - posted by "bearomorphism (via GitHub)" <gi...@apache.org> on 2026/10/12 08:59:35 UTC, 0 replies.
- [PR] [WIP][PYTHON] Improve type annotation for remove_unused_categories [spark] - posted by "bearomorphism (via GitHub)" <gi...@apache.org> on 2026/10/12 08:59:36 UTC, 0 replies.
- [PR] [WIP][PYTHON] Improve type annotation for StreamingQueryListener sessions [spark] - posted by "bearomorphism (via GitHub)" <gi...@apache.org> on 2026/10/12 08:59:38 UTC, 0 replies.
- [PR] [WIP][PYTHON] Improve type annotation for StatCounter callables [spark] - posted by "bearomorphism (via GitHub)" <gi...@apache.org> on 2026/10/12 08:59:40 UTC, 0 replies.
- [PR] [SPARK-60191] Add `ExecutorResizePlugin` E2E test to `pi-java25` group [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/12 10:30:43 UTC, 4 replies.
- Re: [PR] [SPARK-59560][MLLIB] Reduce Word2Vec driver peak memory during training [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/12 11:04:56 UTC, 1 replies.
- [PR] [SPARK-60193] [SQL] Single-pass resolver code health improvements [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/10/12 12:51:21 UTC, 2 replies.
- Re: [PR] [SPARK-59861][SQL] Propagate trusted DataSource V2 primary keys as distinct keys [spark] - posted by "hemanthboyina (via GitHub)" <gi...@apache.org> on 2026/10/12 12:54:10 UTC, 0 replies.
- [PR] [MINOR][SQL][TESTS] Add DROP TABLE SQL golden tests [spark] - posted by "vladanvasi-db (via GitHub)" <gi...@apache.org> on 2026/10/12 12:58:22 UTC, 0 replies.
- [PR] [SPARK-60187][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1000 [spark] - posted by "DevanshSingh-Ksolves (via GitHub)" <gi...@apache.org> on 2026/10/12 12:58:43 UTC, 3 replies.
- [PR] [SPARK-56898][SQL] Rewrite COUNT(DISTINCT IF) to COUNT(DISTINCT) FILTER with a union-of-filters guard [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/10/12 12:59:09 UTC, 17 replies.
- [PR] [WIP][SPARK-60150][SQL] Do not push filters that observe float normalization below Aggregate [spark] - posted by "ctagard (via GitHub)" <gi...@apache.org> on 2026/10/12 14:14:02 UTC, 0 replies.
- Re: [PR] [SPARK-53618][SQL] Turn a FULL JOIN with a false condition into a UNION ALL [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/12 14:26:36 UTC, 6 replies.
- Re: [PR] [SQL][SPARK-59768] Correct expression foldability and determinism [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2026/10/12 17:51:44 UTC, 0 replies.
- [PR] [SPARK-60199][SQL] Preserve XML timestamps under the LEGACY parser policy [spark] - posted by "matthewbayer (via GitHub)" <gi...@apache.org> on 2026/10/12 18:36:57 UTC, 3 replies.
- [PR] [SPARK-60192][SQL] Include supported YAML versions in invalid version errors [spark] - posted by "marcuslin123 (via GitHub)" <gi...@apache.org> on 2026/10/12 18:58:25 UTC, 4 replies.
- [PR] [SPARK-60201][SQL] Preserve ISO-first XML date parsing under LEGACY [spark] - posted by "matthewbayer (via GitHub)" <gi...@apache.org> on 2026/10/12 19:13:51 UTC, 1 replies.
- [PR] [SPARK-58213][SQL][FOLLOWUP] Add a migration guide entry for corr with a zero-variance column [spark] - posted by "rdtr (via GitHub)" <gi...@apache.org> on 2026/10/12 19:16:08 UTC, 0 replies.
- [PR] [SPARK-60202][SQL] Preserve floating-point boundaries in scaled floor and ceil [spark] - posted by "vb-dbrks (via GitHub)" <gi...@apache.org> on 2026/10/12 19:21:03 UTC, 9 replies.
- Re: [PR] [SPARK-58783][SQL][4.1] Fix SPJ with runtime filtering when join keys are a subset of partition keys [spark] - posted by "ammarchalifah (via GitHub)" <gi...@apache.org> on 2026/10/12 19:50:46 UTC, 0 replies.
- [PR] [CONNECT] Preserve server errors with unknown conditions in Scala clients [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2026/10/12 20:46:45 UTC, 2 replies.
- [PR] [WIP][SPARK-60203][SQL][4.1] Fix SPJ originalPartitionValues when join keys are a subset of partition keys [spark] - posted by "ammarchalifah (via GitHub)" <gi...@apache.org> on 2026/10/12 20:49:01 UTC, 0 replies.
- Re: [PR] [SPARK-60120][CORE] Upgrade zstd-jni to 1.5.7-23 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/12 20:54:16 UTC, 4 replies.
- Re: [PR] [SPARK-60203][SQL][4.1] Fix SPJ originalPartitionValues when join keys are a subset of partition keys [spark] - posted by "ammarchalifah (via GitHub)" <gi...@apache.org> on 2026/10/12 20:57:00 UTC, 16 replies.
- [PR] [SPARK-60190][PYSPARK] Pass callable to _transpile_from_ast [spark] - posted by "marcuslin123 (via GitHub)" <gi...@apache.org> on 2026/10/12 21:35:54 UTC, 0 replies.
- Re: [PR] [SPARK-55220][PYTHON][SQL] Add null strictness level parameter to Python UDF transpiler [spark] - posted by "jzhan-2026 (via GitHub)" <gi...@apache.org> on 2026/10/12 21:41:06 UTC, 1 replies.
- Re: [PR] [SPARK-60112][CORE] Use identity equality for memory consumers [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/12 22:06:10 UTC, 4 replies.
- [PR] [SPARK-60204][UI] Use UI root when fetching CSS for SQL plan SVG download [spark] - posted by "ykisana (via GitHub)" <gi...@apache.org> on 2026/10/12 22:56:15 UTC, 4 replies.
- [PR] [SPARK-60071][SQL][4.1] Use identity equality for HybridRowQueue [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/12 23:01:51 UTC, 3 replies.
- [PR] [SPARK-60071][SQL][4.0] Use identity equality for HybridRowQueue [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/12 23:01:57 UTC, 4 replies.
- [PR] [SPARK-60071][SQL][3.5] Use identity equality for HybridRowQueue [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/12 23:02:06 UTC, 4 replies.
- Re: [PR] [SPARK-58628][SQL] Transpiler: skip null guards for is-not-None-narrowed parameters [spark] - posted by "jzhan-2026 (via GitHub)" <gi...@apache.org> on 2026/10/12 23:28:37 UTC, 1 replies.
- Re: [PR] [SPARK-60069][PYTHON] Migrate SQL_ARROW_UDTF to the EvalTypeHandler pipeline [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/12 23:44:48 UTC, 1 replies.
- [PR] [SPARK-60206][SQL] Resolve metric view sources in the namespace they were created in [spark] - posted by "lisancao (via GitHub)" <gi...@apache.org> on 2026/10/13 00:06:50 UTC, 6 replies.
- Re: [PR] [MINOR][TESTS] Make column resolution error differences explicit [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/13 00:26:47 UTC, 1 replies.
- [PR] [SPARK-60207][PYTHON] Move eval type handler test helpers onto the test classes [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/13 00:32:04 UTC, 0 replies.
- Re: [PR] [SPARK-59563][ML] Use BLAS routines for vector L1 and L2 norms [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/13 00:58:09 UTC, 1 replies.
- Re: [PR] [SPARK-59523][ML] Store IDF data directly in IDFModel [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/13 01:09:08 UTC, 1 replies.
- [PR] [SPARK-60209][PYTHON] Migrate SQL_ARROW_TABLE_UDF to the EvalTypeHandler pipeline [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/13 01:13:50 UTC, 2 replies.
- Re: [PR] [SPARK-60207][PYTHON][TEST] Move eval type handler test helpers onto the test classes [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/10/13 01:22:54 UTC, 3 replies.
- [PR] [SPARK-60208][PYTHON] Migrate grouped aggregate and window pandas UDF eval types to pandas eval type handlers [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/13 01:25:50 UTC, 0 replies.
- [PR] [SPARK-60205][SQL] Report the rejected value in the Decimal.set overflow error [spark] - posted by "ykisana (via GitHub)" <gi...@apache.org> on 2026/10/13 01:50:11 UTC, 0 replies.
- Re: [PR] [SPARK-59521][ML] Store word vectors directly in Word2VecModel [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/13 02:47:58 UTC, 1 replies.
- [PR] [MINOR][INFRA] Add scheduled Python 3.15 build [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/13 02:54:45 UTC, 0 replies.
- [PR] [SPARK-60125][SQL] Make regexp_instr return the position of the regex group idx [spark] - posted by "surawut-jirasaktavee (via GitHub)" <gi...@apache.org> on 2026/10/13 04:20:10 UTC, 7 replies.
- Re: [PR] [SPARK-60181][SS] Guard stream-stream join state format and RocksDB merge operator compatibility [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/10/13 04:43:38 UTC, 2 replies.
- [PR] [SPARK-60211][PYTHON][4.1] Fix applyInPandasWithState failure with PyArrow 26 due to float slice offsets [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/13 05:50:34 UTC, 5 replies.
- [PR] [SPARK-60101][SQL] Support native data sources implemented in Rust or C++ with the FFM API [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/13 06:44:02 UTC, 25 replies.
- [PR] [SPARK-57189][CONNECT] Fix double execution and guard bypass in handleSqlCommand for WITH_RELATIONS [spark] - posted by "rdtr (via GitHub)" <gi...@apache.org> on 2026/10/13 06:48:37 UTC, 5 replies.
- [I] [SPARK DECLARATIVE PIPELINES] public docs mention custom resource manager is compatible but a run fails with "Remote cannot be specified with master and/or deploy mode" [spark] - posted by "astelrastogi (via GitHub)" <gi...@apache.org> on 2026/10/13 06:56:07 UTC, 1 replies.
- [PR] [SPARK-60071][SQL][4.2] Use identity equality for HybridRowQueue [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/13 07:32:06 UTC, 3 replies.
- Re: [PR] [SQL] Return zero for instr with zero start and empty substring [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/13 08:19:12 UTC, 1 replies.
- [PR] [SPARK-60213][BUILD] Upgrade sbt to `1.13.0` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/10/13 08:54:16 UTC, 4 replies.
- [PR] [SPARK-60214][SQL] Rejecting non-folable lgNomEntries in analysis phase [spark] - posted by "SavicStefan (via GitHub)" <gi...@apache.org> on 2026/10/13 09:33:49 UTC, 0 replies.
- Re: [PR] [SPARK-60175][PYTHON] Improve type annotations and kwargs handling [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/13 10:37:45 UTC, 0 replies.
- Re: [PR] [SPARK-60193][SQL] Single-pass resolver code health improvements [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/10/13 10:40:37 UTC, 6 replies.
- [PR] [SPARK-60212][BUILD] Publish Maven and sbt Build Scans to develocity.apache.org [spark] - posted by "jprinet (via GitHub)" <gi...@apache.org> on 2026/10/13 11:24:48 UTC, 9 replies.
- Re: [PR] [SPARK-60072][SQL] Expand star arguments in pivot aggregates [spark] - posted by "huangpengtao00-dotcom (via GitHub)" <gi...@apache.org> on 2026/10/13 14:00:29 UTC, 2 replies.
- Re: [PR] [SPARK-60208][PYTHON] Migrate grouped aggregate and window pandas UDF eval types to pandas eval type handlers [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/13 14:32:40 UTC, 1 replies.
- Re: [PR] [SPARK-59723][SQL] Support partition projection in Hive 4.0 for write and truncate commands [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2026/10/13 15:00:11 UTC, 1 replies.
- [PR] [SPARK-60218][PYTHON] Migrate SQL_TABLE_UDF to the EvalTypeHandler pipeline and remove read_udtf [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/13 15:11:10 UTC, 2 replies.
- [PR] [SPARK-60219][PYTHON] Migrate SQL_ARROW_BATCHED_UDF to the EvalTypeHandler pipeline [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/13 15:26:15 UTC, 2 replies.
- [I] Wrong result: LIMIT/OFFSET over LIMIT/OFFSET over a LEFT JOIN returns more rows than its LIMIT when adaptive query execution is on [spark] - posted by "bgiesbrecht (via GitHub)" <gi...@apache.org> on 2026/10/13 15:49:01 UTC, 1 replies.
- [PR] [SPARK-60217][SQL] Add a decompressionCodec read option to text-based file sources [spark] - posted by "sandip-db (via GitHub)" <gi...@apache.org> on 2026/10/13 15:52:20 UTC, 2 replies.
- [PR] [MINOR][CORE][DOCS] Fix the ACL config name in the spark.history.ui.acls.enable description [spark] - posted by "DaemonforY (via GitHub)" <gi...@apache.org> on 2026/10/13 16:27:55 UTC, 1 replies.
- [PR] [SPARK-60178][SQL] Do not re-associate floating-point Add/Multiply in canonicalization [spark] - posted by "Vivek1106-04 (via GitHub)" <gi...@apache.org> on 2026/10/13 17:02:47 UTC, 4 replies.
- Re: [PR] [SPARK-57189][CONNECT][SDP] Fix double execution and guard bypass in handleSqlCommand for WITH_RELATIONS [spark] - posted by "rdtr (via GitHub)" <gi...@apache.org> on 2026/10/13 18:10:22 UTC, 12 replies.
- [I] Wrong rows from a subquery expression in the select list over a sorted LIMIT or OFFSET (PushProjectionThroughLimitAndOffset) [spark] - posted by "bgiesbrecht (via GitHub)" <gi...@apache.org> on 2026/10/13 18:13:55 UTC, 2 replies.
- Re: [PR] [SPARK-60067][SQL] Keep UpdateFields compact through execution [spark] - posted by "bhollis-dbx (via GitHub)" <gi...@apache.org> on 2026/10/13 18:13:57 UTC, 21 replies.
- [PR] [SPARK-60109][UI][3.5] Apply the replay line-length limit and UTF-8-safe line alignment to the History Server end-event reparse [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/13 18:18:13 UTC, 2 replies.
- Re: [PR] [MINOR][INFRA] During release, push to spark-website only once [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/10/13 19:02:31 UTC, 2 replies.
- [PR] [SPARK-60223][SQL] Make the ASOF join configs internal [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/10/13 19:21:51 UTC, 6 replies.
- [PR] [SPARK-60200][SQL] Avoid unbounded plain strings for decimals [spark] - posted by "marcuslin123 (via GitHub)" <gi...@apache.org> on 2026/10/13 19:49:41 UTC, 0 replies.
- [PR] [SPARK-60224] Upgrade `Gradle` to 9.8.1 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/13 20:19:42 UTC, 5 replies.
- [PR] [WIP][SQL] Prototype a Rust SDK for native batch data sources [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/10/13 20:34:43 UTC, 0 replies.
- Re: [PR] [SPARK-57121][BUILD] Upgrade Jetty to 12.1.9 [spark] - posted by "samibashe (via GitHub)" <gi...@apache.org> on 2026/10/13 20:41:05 UTC, 1 replies.
- [PR] [SPARK-59809] Remove the `AZUL` vendor requirement from Java 27 toolchain [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/13 20:56:12 UTC, 6 replies.
- [PR] [SPARK-60225] Support dynamic allocation with Kueue by reserving `maxExecutors` on opt-in [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/13 20:59:48 UTC, 13 replies.
- [PR] [SPARK-60095][SQL] Copy collated strings in interpreted InternalRow writers [spark] - posted by "ykisana (via GitHub)" <gi...@apache.org> on 2026/10/13 22:20:10 UTC, 2 replies.
- [PR] [SPARK-60220][PYTHON] Add ASV benchmarks for SQL_TABLE_UDF eval type [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/13 22:50:56 UTC, 2 replies.
- [PR] [SQL] Preserve LIMIT and OFFSET semantics for projected subqueries [spark] - posted by "mhatipog (via GitHub)" <gi...@apache.org> on 2026/10/13 23:50:07 UTC, 2 replies.
- [PR] [SPARK-60226][CONNECT] Preserve context for typed Scala UDF unpacking failures [spark] - posted by "dbtsai (via GitHub)" <gi...@apache.org> on 2026/10/13 23:52:20 UTC, 3 replies.
- [PR] [SS] Preserve self-union source slots in v2 offset logs [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/10/13 23:56:05 UTC, 0 replies.
- [PR] [SPARK-60228][SQL] Avoid quadratic cache lookups by table name in CacheManager [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/14 00:24:03 UTC, 8 replies.
- Re: [PR] [SPARK-57214][UDF] Ship the direct UDF dispatcher in a shaded runtime jar [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/14 00:27:19 UTC, 4 replies.
- [PR] [CONNECT] Reproduce Scala client failures for unknown server error conditions [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2026/10/14 00:57:11 UTC, 1 replies.
- [PR] [SPARK-60118][SQL][3.5] Fix Int overflow in the fast-fail check of casting string to decimal [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/14 01:29:33 UTC, 4 replies.
- Re: [PR] [SPARK-60210][INFRA] Add scheduled Python 3.15 build [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/14 02:33:33 UTC, 1 replies.
- Re: [PR] Updating gitignore for .scalafmt.conf [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/14 02:33:57 UTC, 1 replies.
- Re: [PR] [SPARK-57584][CONNECT] Add Spark Connect gRPC health checks [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/14 02:34:01 UTC, 1 replies.
- Re: [PR] [SPARK-57574][PANDAS] Support the TIME data type in pandas API on Spark [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/14 02:34:05 UTC, 1 replies.
- [PR] [SPARK-60230][ML][PYTHON] Keep TorchDistributor MASTER_PORT reserved until training finishes [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/14 02:54:27 UTC, 7 replies.
- [PR] [SPARK-XXXXX][SS] Improve the put/merge operation in ListState with TTL when there are multiple values [spark] - posted by "kavpreetgrewal (via GitHub)" <gi...@apache.org> on 2026/10/14 02:56:37 UTC, 0 replies.
- Re: [I] MERGE INTO over Iceberg temp-view source can fail with assertion failed: No plan for TableReference[...] [spark] - posted by "quangbilly79 (via GitHub)" <gi...@apache.org> on 2026/10/14 03:29:51 UTC, 0 replies.
- Re: [PR] [MINOR][DOCS] Fix typos in comments and docstrings across multiple files [spark] - posted by "csj4032 (via GitHub)" <gi...@apache.org> on 2026/10/14 04:21:46 UTC, 0 replies.
- Re: [PR] [SPARK-57759][SQL] Surface a catalog's FORBIDDEN_OPERATION instead of UNRESOLVED_ROUTINE [spark] - posted by "Vivek1106-04 (via GitHub)" <gi...@apache.org> on 2026/10/14 04:26:25 UTC, 0 replies.
- Re: [PR] [SPARK-56548][CORE] Replace modulo with bitmask in BloomFilter hot paths [spark] - posted by "Vivek1106-04 (via GitHub)" <gi...@apache.org> on 2026/10/14 04:26:27 UTC, 2 replies.
- Re: [PR] [SPARK-60028][4.3][SQL] Do not split LIKE 'prefix%suffix' over a nondeterministic input [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/10/14 04:39:18 UTC, 2 replies.
- [PR] [SPARK-60229][SQL] Keep CHAR/VARCHAR map key checks on from_json(to_json) [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/10/14 05:04:47 UTC, 4 replies.
- [PR] [SPARK-60110][3.5][UI] Skip event log compaction when replay skips lines over the line-length limit [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/14 06:09:18 UTC, 2 replies.
- [PR] [SPARK-60071][SPARK-60211][3.5] Revert non-security backports from branch-3.5 [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/14 06:35:34 UTC, 4 replies.
- [PR] [SPARK-60233][PYTHON] Remove type: ignore[var-annotated] in serializers.py [spark] - posted by "DrEthan9608 (via GitHub)" <gi...@apache.org> on 2026/10/14 07:02:56 UTC, 0 replies.
- [PR] [SPARK-60234][INFRA] During releases create a single spark-website commit [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/10/14 07:35:52 UTC, 3 replies.
- [PR] [SPARK-59909][PYTHON][4.3] Fix PySpark errors raised with undefined error conditions or mismatched message parameters [spark] - posted by "jubins (via GitHub)" <gi...@apache.org> on 2026/10/14 07:59:23 UTC, 5 replies.
- [PR] [SPARK-60235][PYTHON] Migrate element-wise UDF eval types to the EvalTypeHandler pipeline [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/14 08:03:47 UTC, 2 replies.
- [PR] [SPARK-60236] Document Kueue v0.20.0+ as the required version in `spark_custom_resources.md` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/14 08:07:07 UTC, 3 replies.
- [PR] [SPARK-60124][SQL] Fix RewriteDistinctAggregates failure on ListAgg with DISTINCT and FILTER [spark] - posted by "zahed1994 (via GitHub)" <gi...@apache.org> on 2026/10/14 08:09:09 UTC, 1 replies.
- [PR] [MINOR][ML] Use OpenHashSet for binary HashingTF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/14 08:19:39 UTC, 0 replies.
- Re: [PR] [SPARK-57372][SQL] Remove the Types Framework feature flag [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2026/10/14 08:45:49 UTC, 0 replies.
- Re: [PR] [SPARK-41416][SQL] Rewrite existence-only inequality self-joins as MIN/MAX [spark] - posted by "hhr293 (via GitHub)" <gi...@apache.org> on 2026/10/14 08:58:24 UTC, 0 replies.
- Re: [PR] [SPARK-59949] Record the `operator.sdk` controller execution durations with sub-second precision [spark-kubernetes-operator] - posted by "sankalpsthakur (via GitHub)" <gi...@apache.org> on 2026/10/14 09:24:09 UTC, 3 replies.
- [PR] [SPARK-60216][SQL] Assign a name to the error condition _LEGACY_ERROR… [spark] - posted by "DevanshSingh-Ksolves (via GitHub)" <gi...@apache.org> on 2026/10/14 09:55:14 UTC, 0 replies.
- [PR] [SPARK-60239][SQL] Reject aliased GROUP BY ordinals in pipe AGGREGATE [spark] - posted by "marko-radoicic-db (via GitHub)" <gi...@apache.org> on 2026/10/14 11:04:41 UTC, 10 replies.
- [I] [Build][Discuss] How do you do checking for license headers? [spark] - posted by "ottlinger (via GitHub)" <gi...@apache.org> on 2026/10/14 11:17:24 UTC, 1 replies.
- Re: [PR] [SPARK-60150][SQL] Normalize float grouping keys in filters pushed below Aggregate [spark] - posted by "ctagard (via GitHub)" <gi...@apache.org> on 2026/10/14 14:13:47 UTC, 12 replies.
- [PR] [SPARK-60125][PYTHON][TESTS][4.0] Make the regexp_instr doctest independent of the idx semantics [spark] - posted by "surawut-jirasaktavee (via GitHub)" <gi...@apache.org> on 2026/10/14 14:34:18 UTC, 0 replies.
- [PR] [SQL] Support ARRAY input in vector_sum [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2026/10/14 14:39:27 UTC, 0 replies.
- [PR] [SPARK-59016][SQL] Harden FunctionRegistry inventory and stop DSv2 prune re-stamping CHAR [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/10/14 14:43:36 UTC, 10 replies.
- [PR] [SPARK-60242][SQL] Enforce CHAR/VARCHAR length in from_avro and to_avro [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/10/14 14:47:51 UTC, 0 replies.
- Re: [PR] [SPARK-59557][SQL] Avoid intermediate java.lang.String when casting integral and boolean to string [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/10/14 15:01:53 UTC, 0 replies.
- Re: [PR] [SPARK-59426][SQL] Avoid per-lookup allocation in EquivalentExpressions.ExpressionEquals.hashCode [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/10/14 15:08:13 UTC, 2 replies.
- Re: [PR] [WIP][POC][GRAPHFRAMES] Add GraphFrames as an in-tree Spark module [spark] - posted by "SemyonSinchenko (via GitHub)" <gi...@apache.org> on 2026/10/14 15:12:18 UTC, 16 replies.
- Re: [PR] [SPARK-60245][SQL] Support ARRAY input in vector_sum [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2026/10/14 16:30:01 UTC, 11 replies.
- [PR] [SPARK-60238][PYTHON] Migrate stateful streaming UDF eval types to the EvalTypeHandler pipeline [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/14 17:07:35 UTC, 4 replies.
- [PR] [SPARK-60228][SQL][4.2] Avoid quadratic cache lookups by table name in CacheManager [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/14 17:18:26 UTC, 3 replies.
- [PR] [SPARK-34525][DOCS] Document that '=' is optional in DDL property lists [spark] - posted by "prabhu7380 (via GitHub)" <gi...@apache.org> on 2026/10/14 17:20:07 UTC, 1 replies.
- [PR] [SPARK-60246][CORE] Close the download channel when fetchFile fails [spark] - posted by "cravani (via GitHub)" <gi...@apache.org> on 2026/10/14 17:22:28 UTC, 2 replies.
- [PR] [SPARK-60228][SQL][4.1] Avoid quadratic cache lookups by table name in CacheManager [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/14 17:24:45 UTC, 3 replies.
- [PR] [SPARK-60247][SQL][CONNECT] Point typed UDF DataFrame query context at the user call site [spark] - posted by "dbtsai (via GitHub)" <gi...@apache.org> on 2026/10/14 17:49:57 UTC, 3 replies.
- [PR] [SPARK-60248][SQL] Do not stop the nearest sort-merge AS-OF join scan at rows that share an as-of value [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/10/14 18:04:45 UTC, 3 replies.
- Re: [I] Spark Connect server retains high JVM memory and leading to restarts causing jobs to fail [spark] - posted by "developer-rpai (via GitHub)" <gi...@apache.org> on 2026/10/14 18:37:58 UTC, 0 replies.
- [PR] [SPARK-60250][SQL] Do not simplify LIKE under UTF8_LCASE [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/10/14 19:08:51 UTC, 0 replies.
- [PR] [SPARK-60243][SQL] Cover remaining CHAR/VARCHAR standardSemantics test gaps [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/10/14 20:12:12 UTC, 7 replies.
- [PR] [SPARK-60251][SQL][DOCS] Document vector functions in the SQL built-in function reference [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/10/14 21:52:33 UTC, 5 replies.
- [PR] [SPARK-60196][SQL] Exact nearest gaps and DATE/TIMESTAMP keys in sort-merge ASOF joins [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/10/14 22:02:53 UTC, 0 replies.
- [PR] Bump hyper from 1.11.0 to 1.12.0 [spark-connect-gateway] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/10/14 22:05:13 UTC, 0 replies.
- [PR] Bump uuid from 1.24.0 to 1.28.0 [spark-connect-gateway] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/10/14 22:05:26 UTC, 0 replies.
- [PR] [SPARK-59111][CORE] Add parameterized BID-k encodings through Decimal256 [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/10/14 23:56:15 UTC, 0 replies.
- Re: [PR] [WIP] [SPARK-60253][CORE] Validate pipelined shuffle jobs before registering stages [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/10/15 00:06:59 UTC, 2 replies.
- [PR] [SPARK-59832][SQL][4.x] Fail on truncated input in the vectorized RLE reader [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/15 00:14:23 UTC, 3 replies.
- [PR] [SPARK-59832][SQL][4.2] Fail on truncated input in the vectorized RLE reader [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/15 00:14:25 UTC, 3 replies.
- [PR] [SPARK-59832][SQL][4.1] Fail on truncated input in the vectorized RLE reader [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/15 00:14:27 UTC, 3 replies.
- [PR] [SPARK-59832][SQL][4.0] Fail on truncated input in the vectorized RLE reader [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/15 00:14:31 UTC, 3 replies.
- Re: [PR] [SPARK-57756][SQL][TESTS] Add buildSQLFunctionConf ANSI-invariant tests [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/15 00:38:06 UTC, 1 replies.
- Re: [PR] [SPARK-57739][SQL] Return NULL for Parquet MIN/MAX aggregate push-down over all-null row groups [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/15 00:38:11 UTC, 1 replies.
- Re: [PR] [SPARK-XXXXX][CORE] Tolerate missing jdk.internal.ref.Cleaner on JDK 26+ [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/15 00:38:16 UTC, 1 replies.
- Re: [PR] [SPARK-57806][SQL] Fix coercion of NullTyped expressions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/15 00:38:20 UTC, 1 replies.
- Re: [PR] [SPARK-56729][SQL] ReplaceData and WriteDelta should implement SupportsNonDeterministicExpression [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/15 00:38:24 UTC, 2 replies.
- [PR] [SPARK-60254][MLLIB] Replace Breeze delegation in vector and matrix primitives [spark] - posted by "dbtsai (via GitHub)" <gi...@apache.org> on 2026/10/15 01:05:57 UTC, 4 replies.
- [PR] [SQL] Offer conjuncts over a storage filter's key columns to the Parquet reader [spark] - posted by "ForVic (via GitHub)" <gi...@apache.org> on 2026/10/15 02:31:24 UTC, 0 replies.
- [PR] [SPARK-60028][4.2][SQL] Do not split LIKE 'prefix%suffix' over a nondeterministic input [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/10/15 03:07:58 UTC, 3 replies.
- [PR] [SPARK-60028][4.1][SQL] Do not split LIKE 'prefix%suffix' over a nondeterministic input [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/10/15 03:09:23 UTC, 3 replies.
- [PR] [SPARK-60028][4.0][SQL] Do not split LIKE 'prefix%suffix' over a nondeterministic input [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/10/15 03:09:54 UTC, 4 replies.
- Re: [PR] [SPARK-60237][ML] Use OpenHashSet for binary HashingTF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/15 03:20:31 UTC, 1 replies.
- [PR] [MINOR][SQL] Fix the version of two SQL configs that ship in Spark 4.3.0 [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/15 05:01:27 UTC, 6 replies.
- [PR] [SPARK-58378][SQL][FOLLOWUP] Fix the version of spark.sql.optimizer.combineApproximatePercentiles.enabled [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/15 05:05:27 UTC, 4 replies.
- [PR] [MINOR][STREAMING] Use 3.5.10 as the version of spark.streaming.raw.maxBlockSizeBytes [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/15 05:11:19 UTC, 4 replies.
- [PR] [MINOR][STREAMING][4.x] Use 3.5.10 as the version of spark.streaming.raw.maxBlockSizeBytes [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/15 05:11:22 UTC, 3 replies.
- [PR] [MINOR][STREAMING][4.3] Use 3.5.10 as the version of spark.streaming.raw.maxBlockSizeBytes [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/15 05:11:25 UTC, 2 replies.
- [PR] [MINOR][STREAMING][4.2] Use 3.5.10 as the version of spark.streaming.raw.maxBlockSizeBytes [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/15 05:11:27 UTC, 2 replies.
- [PR] [MINOR][STREAMING][4.1] Use 3.5.10 as the version of spark.streaming.raw.maxBlockSizeBytes [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/15 05:11:30 UTC, 2 replies.
- [PR] [MINOR][STREAMING][4.0] Use 3.5.10 as the version of spark.streaming.raw.maxBlockSizeBytes [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/15 05:11:32 UTC, 2 replies.
- Re: [PR] [SPARK-60253][CORE] Validate pipelined shuffle jobs before registering stages [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/15 05:11:44 UTC, 1 replies.
- [PR] [SPARK-60101][SQL] Support native data sources with a frozen C core and versioned messages [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/15 06:21:29 UTC, 1 replies.
- Re: [PR] [SPARK-59417][SQL][FOLLOWUP] Stop resuming a streamed JSON array inside a malformed element [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/15 06:33:22 UTC, 3 replies.
- [PR] [WIP] [SPARK-xxxxx][CORE] Fail a pipelined group on a killed or commit-denied member task [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/10/15 06:33:41 UTC, 0 replies.
- [PR] [MINOR][ML] Correct KMeans.setIntermediateStorageLevel version metadata [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/15 06:47:35 UTC, 2 replies.
- [PR] [ML] Remove stale BLAS.axpy TODO in DTStatsAggregator.merge [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/15 06:48:50 UTC, 0 replies.
- Re: [PR] [SPARK-60196][SQL] Optimize DataFrame nearest ASOF scans and support DATE/TIMESTAMP keys [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/15 07:06:29 UTC, 14 replies.
- Re: [PR] [SPARK-59234][SQL] Count a partial-clustering spread side's expected partitions in its reduced key space [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/15 07:09:35 UTC, 2 replies.
- [PR] [MINOR][INFRA] Add spark-test as a triage collaborator in .asf.yaml [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/15 09:50:19 UTC, 6 replies.
- [PR] [SQL] Map SQL Server native JSON JDBC type to StringType [spark] - posted by "alekjarmov (via GitHub)" <gi...@apache.org> on 2026/10/15 09:50:25 UTC, 0 replies.
- [PR] [SPARK-60257][SDP][TEST] Test pipeline event responses missing result fields [spark] - posted by "dahhs (via GitHub)" <gi...@apache.org> on 2026/10/15 10:07:12 UTC, 2 replies.
- Re: [PR] [SPARK-60216][SQL] Assign a name to the error condition _LEGACY_ERROR_1002 [spark] - posted by "DevanshSingh-Ksolves (via GitHub)" <gi...@apache.org> on 2026/10/15 10:07:17 UTC, 3 replies.
- Re: [PR] [SPARK-60242][SQL] Assign CHAR/VARCHAR in from_avro and identity-check Avro map keys [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/15 10:32:54 UTC, 4 replies.
- [PR] [SQL] Treat Oracle broken synonyms (ORA-00980) as not selectable [spark] - posted by "alekjarmov (via GitHub)" <gi...@apache.org> on 2026/10/15 10:45:39 UTC, 0 replies.
- Re: [PR] [MINOR][ML] Remove stale BLAS.axpy TODO in DTStatsAggregator.merge [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/15 11:43:59 UTC, 1 replies.
- [PR] [MINOR][PS] Document missing rolling and expanding window APIs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/15 11:58:00 UTC, 0 replies.
- [PR] [SPARK-60240][SQL] Trim tuple_sketch_agg results to nominal k entries in every plan [spark] - posted by "stojkomilos (via GitHub)" <gi...@apache.org> on 2026/10/15 12:19:22 UTC, 0 replies.
- Re: [PR] [SPARK-60216][SQL] Assign a name to the error condition LEGACY_ERROR_TEMP_1002 [spark] - posted by "DevanshSingh-Ksolves (via GitHub)" <gi...@apache.org> on 2026/10/15 14:06:23 UTC, 0 replies.
- [PR] [SPARK-60044][SQL][4.3] Freeze the k-way merge ordering of GroupPartitionsExec when the merge is planned [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/15 14:43:26 UTC, 3 replies.
- [PR] [SPARK-60044][SQL][4.2] Freeze the k-way merge ordering of GroupPartitionsExec when the merge is planned [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/15 14:43:29 UTC, 3 replies.
- [PR] [SPARK-60262][SQL] Fail Parquet reads where two requested fields select the same column [spark] - posted by "andygrove (via GitHub)" <gi...@apache.org> on 2026/10/15 15:20:47 UTC, 7 replies.
- Re: [PR] [SPARK-59748][CORE] Loser tree + small-k linear merge for UnsafeSorterSpillMerger [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/10/15 15:21:04 UTC, 0 replies.
- Re: [PR] [SPARK-60258][SQL] Map SQL Server native JSON JDBC type to StringType [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/15 15:23:06 UTC, 3 replies.
- Re: [PR] [SPARK-60259][SQL] Treat Oracle broken synonyms (ORA-00980) as not selectable [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2026/10/15 15:47:52 UTC, 6 replies.
- [PR] [SPARK-60249] [SS] Allow reuse of named streaming sources [spark] - posted by "SMHodges (via GitHub)" <gi...@apache.org> on 2026/10/15 16:40:04 UTC, 0 replies.
- [PR] [SPARK-60119][SQL][4.3] Skip rescaling in Decimal.changePrecision when the result is known from the magnitude [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/15 16:40:27 UTC, 3 replies.
- [PR] [SPARK-60119][SQL][4.2] Skip rescaling in Decimal.changePrecision when the result is known from the magnitude [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/15 16:40:29 UTC, 3 replies.
- [PR] [SPARK-60119][SQL][4.1] Skip rescaling in Decimal.changePrecision when the result is known from the magnitude [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/15 16:40:32 UTC, 3 replies.
- [PR] [SPARK-60119][SQL][4.0] Skip rescaling in Decimal.changePrecision when the result is known from the magnitude [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/15 16:40:33 UTC, 3 replies.
- [PR] [SPARK-60244][SQL] Align XML CHAR/VARCHAR map key error message with JSON [spark] - posted by "ykisana (via GitHub)" <gi...@apache.org> on 2026/10/15 16:43:47 UTC, 4 replies.
- [PR] [SPARK-54733][SQL] Desc As Json GeographyType [spark] - posted by "ashutosh-jindal (via GitHub)" <gi...@apache.org> on 2026/10/15 16:57:41 UTC, 0 replies.
- [PR] [SPARK-60264][SS] Propagate close() failures in AbortableStreamBasedCheckpointFileManager [spark] - posted by "snmvaughan (via GitHub)" <gi...@apache.org> on 2026/10/15 17:13:50 UTC, 4 replies.
- [PR] [SPARK-60252][SDP] SCD1 Ignore-null support; Field Reconciliation Data Classes [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/10/15 17:22:23 UTC, 0 replies.
- [PR] [WIP][SQL] Add a Rust SDK for native data sources over the C ABI [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/10/15 18:06:12 UTC, 0 replies.
- [PR] [SPARK-XXXXX][SS] Fix state data source change feed dropping list state values after the first [spark] - posted by "kavpreetgrewal (via GitHub)" <gi...@apache.org> on 2026/10/15 18:44:29 UTC, 0 replies.
- [PR] [SPARK-60265][SQL] Allow optional grouping of V2 scan splits below shuffles [spark] - posted by "rekbun (via GitHub)" <gi...@apache.org> on 2026/10/15 19:13:37 UTC, 5 replies.
- [PR] [WIP][CORE] Reject persisted native pipelined shuffle consumers [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/10/15 19:23:28 UTC, 0 replies.
- [PR] [CORE] Reject repeated consumption of pipelined shuffle partitions [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/10/15 19:24:08 UTC, 0 replies.
- [PR] [WIP][POC][GRAPHFRAMES] Add GraphFrames documentation to the Spark docs [spark] - posted by "SemyonSinchenko (via GitHub)" <gi...@apache.org> on 2026/10/15 20:52:14 UTC, 1 replies.
- [PR] [SPARK-60270][CONNECT] Preserve streaming source names for table reads [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/10/15 21:12:11 UTC, 1 replies.
- [PR] [SPARK-60267][SQL] Fix Int overflow in the segment-tree cache size estimate for ROWS frames with offsets near Int.MaxValue [spark] - posted by "markj-db (via GitHub)" <gi...@apache.org> on 2026/10/15 21:12:55 UTC, 1 replies.
- [PR] [SPARK-60266][SDP] SCD1 Ignore-null support; Apply persisted tombstones per field [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/10/15 21:51:44 UTC, 0 replies.
- [PR] [SPARK-59438][SQL] Do not push projection with subquery expressions through Limit/Offset [spark] - posted by "txwyy123 (via GitHub)" <gi...@apache.org> on 2026/10/15 22:19:21 UTC, 2 replies.
- [PR] [SPARK-60273][CONNECT] Avoid binding the default Connect port in SparkConnectClientSuite URI check [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/15 22:48:51 UTC, 0 replies.
- Re: [PR] [SPARK-60273][CONNECT][TEST] Avoid binding the default Connect port in SparkConnectClientSuite URI check [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/15 22:50:10 UTC, 3 replies.
- [PR] [SPARK-60274][SDP] SCD1 Ignore-null support; Wire ignore-null microbatch reconciliation [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/10/15 23:14:24 UTC, 0 replies.
- [PR] [SPARK-60246][FOLLOWUP][CORE] Remove logging from FileDownloadCallback and test the close-during-write path [spark] - posted by "cravani (via GitHub)" <gi...@apache.org> on 2026/10/15 23:30:57 UTC, 19 replies.
- [PR] [WIP] Preserve ownership of deferred pipelined task completions [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/10/16 00:55:33 UTC, 0 replies.
- [PR] [SPARK-60275][PYTHON] Migrate SQL_BATCHED_UDF to the EvalTypeHandler pipeline and remove read_udfs [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/16 00:56:34 UTC, 3 replies.
- Re: [PR] [SPARK-59618][ML] Prevent concurrent F2J LAPACK initialization to fix a deadlock [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/16 02:21:55 UTC, 1 replies.
- [PR] [SPARK-60277][SQL] Merge a union's keyed partitionings when the unknown-keyed leg declares the other legs' keys [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/10/16 04:07:06 UTC, 0 replies.
- Re: [PR] [SPARK-60216][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1002 [spark] - posted by "DevanshSingh-Ksolves (via GitHub)" <gi...@apache.org> on 2026/10/16 04:17:08 UTC, 1 replies.
- Re: [PR] [SPARK-60272][CORE] Reject repeated consumption of pipelined shuffle partitions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/16 04:30:53 UTC, 4 replies.
- Re: [PR] [SPARK-60271][CORE] Reject persisted native pipelined shuffle consumers [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/16 04:31:20 UTC, 5 replies.
- Re: [PR] [SPARK-60256][CORE] Fail a pipelined group on a killed or commit-denied member task [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/16 04:32:52 UTC, 2 replies.
- [PR] [MINOR][SQL] Fix the @since version of ORC Types Framework ops that ship in Spark 4.3.0 [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/16 04:34:53 UTC, 3 replies.
- [PR] Scd1 target merge before aux merge [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/10/16 05:10:50 UTC, 0 replies.
- [PR] [SPARK-37553][PS] Fix DataFrame.pivot_table with multiple values when names contain underscores [spark] - posted by "hzmsh (via GitHub)" <gi...@apache.org> on 2026/10/16 06:11:21 UTC, 2 replies.
- [PR] [CORE][ML] Register classification tree nodes with Kryo [spark] - posted by "luka-erceg-data-oss (via GitHub)" <gi...@apache.org> on 2026/10/16 06:26:46 UTC, 4 replies.
- [PR] [CONNECT] Support client-generated checkpoint relation IDs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/16 06:38:55 UTC, 0 replies.
- [PR] [SPARK-60279][CONNECT][PYTHON] Fix Spark Connect pivot rejecting None, date and Decimal values [spark] - posted by "hzmsh (via GitHub)" <gi...@apache.org> on 2026/10/16 07:18:18 UTC, 3 replies.
- [PR] [SPARK-59854][SQL] Report the column in decoding errors of the vectorized Parquet reader [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/16 07:25:20 UTC, 13 replies.
- [PR] [SPARK-60280][PYTHON] Replace _is_iter_based with an EvalTypeHandler class property [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/16 08:07:30 UTC, 2 replies.
- [PR] [SPARK-60203][SQL][4.0] Fix SPJ originalPartitionValues when join keys are a subset of partition keys [spark] - posted by "ammarchalifah (via GitHub)" <gi...@apache.org> on 2026/10/16 09:43:59 UTC, 7 replies.
- Re: [PR] [SPARK-59723][SQL][HIVE] Support partition projection in Hive 4.0 for write, truncate, repair, scan, and metadata queries [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2026/10/16 09:47:21 UTC, 2 replies.
- [PR] [SPARK-60032][SQL] Do not freeze the current time and the like in a CHECK constraint added by ALTER TABLE [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/10/16 11:35:15 UTC, 11 replies.
- [PR] [MINOR][DOC] Correct PostgreSQL JDBC truncate documentation [spark] - posted by "hunnguye (via GitHub)" <gi...@apache.org> on 2026/10/16 12:48:49 UTC, 0 replies.
- Re: [PR] [SPARK-56891][CONNECT] Propagate Spark Connect session user as a SparkContext local property [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/10/16 13:15:55 UTC, 0 replies.
- Re: [PR] [SPARK-57819][SQL] Support nanosecond-precision timestamps in months_between [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/10/16 13:30:40 UTC, 4 replies.
- Re: [PR] [SPARK-57829][SQL] Support window, session_window and window_time over nanosecond-precision timestamps [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/10/16 13:32:57 UTC, 0 replies.
- Re: [PR] [SPARK-39142][SPARK-42235][PYTHON] Add overloads in pandas function stub file [spark] - posted by "hzmsh (via GitHub)" <gi...@apache.org> on 2026/10/16 13:36:45 UTC, 3 replies.
- Re: [PR] [SPARK-57843][SS] Support nanosecond-precision event-time in streaming stateful operators [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/10/16 13:38:13 UTC, 1 replies.
- [PR] [SPARK-60281][INFRA] Upgrade AnchorJS to v5.0.0 [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/10/16 13:44:02 UTC, 11 replies.
- [PR] [SPARK-56891][CONNECT] Use session user for SQL current user functions [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/10/16 14:24:20 UTC, 0 replies.
- [PR] [SPARK-60284] Use `Eclipse Temurin` instead of `Azul Zulu` in CIs and Docker image [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/16 14:36:04 UTC, 3 replies.
- [PR] [SPARK-60283][CONNECT] Validate Spark Connect JDBC connections against the server in isValid [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/10/16 14:43:26 UTC, 0 replies.
- [PR] [SPARK-60287] Support Java 27 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/16 14:54:20 UTC, 3 replies.
- [PR] [SPARK-60288] Upgrade `grpc-swift-2` to 2.4.4 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/16 15:02:18 UTC, 3 replies.
- [PR] [SPARK-60285][PYTHON][TESTS] Add tests for ReadLimitRegistry [spark] - posted by "soaring0616 (via GitHub)" <gi...@apache.org> on 2026/10/16 15:03:26 UTC, 0 replies.
- [PR] [SPARK-60289] Upgrade `gRPC Swift NIO Transport` to 2.11.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/16 15:08:37 UTC, 3 replies.
- [PR] [SPARK-60290] Upgrade `gRPC Swift Protobuf` to 2.5.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/16 15:11:56 UTC, 3 replies.
- [PR] [SPARK-60291] Drop Java 26 Support [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/16 15:13:51 UTC, 3 replies.
- [PR] [SPARK-60292] Upgrade Swift Docker image to 6.4.1 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/16 15:17:36 UTC, 3 replies.
- Re: [PR] [SPARK-60137][SQL] Allow non-throwing widening cast in ExprUtils.canEvaluateUnconditionally [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2026/10/16 15:39:32 UTC, 0 replies.
- [PR] [SPARK-60294][SQL] Copy the pass-through columns of Arrow-backed input to Python UDFs [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/16 15:52:28 UTC, 9 replies.
- [PR] [SPARK-60293][SQL] Resolve Parquet pushed filters and vectorized read types by field id [spark] - posted by "andygrove (via GitHub)" <gi...@apache.org> on 2026/10/16 16:05:34 UTC, 0 replies.
- Re: [PR] [SPARK-60276][CORE] Preserve ownership of deferred pipelined task completions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/16 16:19:15 UTC, 4 replies.
- [PR] [SPARK-60262][SQL][4.3] Fail Parquet reads where two requested fields select the same column [spark] - posted by "andygrove (via GitHub)" <gi...@apache.org> on 2026/10/16 17:02:17 UTC, 4 replies.
- [PR] [SPARK-60262][SQL][4.2] Fail Parquet reads where two requested fields select the same column [spark] - posted by "andygrove (via GitHub)" <gi...@apache.org> on 2026/10/16 17:02:20 UTC, 3 replies.
- [PR] [SPARK-60262][SQL][4.1] Fail Parquet reads where two requested fields select the same column [spark] - posted by "andygrove (via GitHub)" <gi...@apache.org> on 2026/10/16 17:02:23 UTC, 3 replies.
- [PR] [SPARK-60262][SQL][4.0] Fail Parquet reads where two requested fields select the same column [spark] - posted by "andygrove (via GitHub)" <gi...@apache.org> on 2026/10/16 17:02:29 UTC, 3 replies.
- Re: [PR] [SPARK-58772][SQL] Make SelectedField pass column metadata [spark] - posted by "andygrove (via GitHub)" <gi...@apache.org> on 2026/10/16 17:20:03 UTC, 0 replies.
- [PR] [SPARK-60295] Fix flaky `StreamingQueryTests.status` test by waiting for query initialization before stop [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/16 17:34:34 UTC, 3 replies.
- [PR] [SPARK-52878][SQL] Rewrite LogicalRDD attribute references by exprId to fix checkpoint with case-insensitive references [spark] - posted by "mbyne (via GitHub)" <gi...@apache.org> on 2026/10/16 17:45:51 UTC, 0 replies.
- [PR] [SPARK-39142][SPARK-42235][PYTHON] Fix type checker errors for pandas_udf without functionType [spark] - posted by "hzmsh (via GitHub)" <gi...@apache.org> on 2026/10/16 17:48:19 UTC, 1 replies.
- [PR] [SPARK-60296][MLLIB] Make `DenseMatrix.hashCode` consistent with `equals` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/16 18:02:04 UTC, 5 replies.
- [PR] [SPARK-60297] Enforce TLS in `SparkConnectClient` when a token is set [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/16 18:06:37 UTC, 3 replies.
- [PR] [SPARK-60298] Set default `grpc_max_message_size` to 128 MiB and support Arrow batch result chunking [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/16 18:09:20 UTC, 8 replies.
- [PR] [SPARK-60299] Fix `SparkSession` to reject an invalid `session_id` instead of silently truncating it [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/16 18:17:40 UTC, 2 replies.
- [PR] [SPARK-60300][MLLIB] Make `DenseMatrix.copy` and `SparseMatrix.copy` preserve `isTransposed` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/16 18:22:14 UTC, 5 replies.
- [PR] [SPARK-60301] Use the session time zone when printing variant values as strings [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2026/10/16 19:45:53 UTC, 1 replies.
- [PR] [SPARK-60302] Change the default value of `spark.redaction.regex` like Spark 4.3.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/16 19:46:41 UTC, 4 replies.
- [PR] [SPARK-60303] Support `UDFRegistration.registerJava` via `SparkSession.udf` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/16 19:49:45 UTC, 8 replies.
- [PR] [SPARK-60304][SQL] Fix `PlanMerger` losing a shared lower filter when merging into a merged Filter [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/16 20:45:24 UTC, 9 replies.
- Re: [PR] [SPARK-59511][SQL] Reduce ANSI type coercion allocations [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/10/16 21:49:28 UTC, 1 replies.
- Re: [PR] [SPARK-59580][SQL] Reduce TreeNode cache allocation [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/10/16 21:51:48 UTC, 1 replies.
- Re: [PR] [SPARK-59456][SQL] Fix: RuleExecutor.PlanChangeLogger does work even when it doesn't log [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/10/16 21:59:19 UTC, 4 replies.
- [PR] [SPARK-60307] Exclude `org.fusesource.leveldbjni` additionally [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/16 22:17:22 UTC, 3 replies.
- Re: [PR] [SPARK-59501][SQL] Reduce allocations in unchanged TreeNode traversals [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/10/16 22:19:08 UTC, 4 replies.
- Re: [PR] [SPARK-59452][SQL] Optimize DeduplicateRelations for wide plans [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/10/16 22:32:25 UTC, 1 replies.
- [PR] [SPARK-XXXXX][CONNECT][PYTHON] Use FieldDescriptor.is_repeated when truncating plans for logging [spark] - posted by "RamonZhou (via GitHub)" <gi...@apache.org> on 2026/10/16 23:02:03 UTC, 0 replies.
- [PR] [SPARK-60308][SQL][WEBUI] Fix exponential re-renders on stage/task checkbox clicks in SQL plan detailed mode [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/17 00:16:48 UTC, 3 replies.
- [PR] [SPARK-60305][PYTHON] Keep the Python runner's input buffer alive when an Arrow write is interrupted [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/17 00:22:20 UTC, 12 replies.
- Re: [PR] [PYTHON][BENCHMARKS] Add Arrow Python UDF type benchmarks [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/17 00:39:15 UTC, 1 replies.
- Re: [I] [SQL] Exchange reuse fails when a VIEW is referenced in both UNION ALL branches via a CTE [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/17 00:39:21 UTC, 0 replies.
- Re: [PR] [SPARK-57922][SQL] Migrate pipeline-dataset parser guards off _LEGACY_ERROR_TEMP_0035 to named error conditions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/17 00:39:25 UTC, 1 replies.
- Re: [PR] [SPARK-54582][SQL] Add Time Type Statistics Collection Support [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/17 00:39:30 UTC, 1 replies.
- [PR] [WIP][SQL] Avoid copying byte-array-backed strings in Parquet writes [spark] - posted by "saths008 (via GitHub)" <gi...@apache.org> on 2026/10/17 00:57:15 UTC, 0 replies.
- Re: [PR] [SPARK-60217][SQL] Add a decompression read option to text-based file sources [spark] - posted by "sandip-db (via GitHub)" <gi...@apache.org> on 2026/10/17 01:19:39 UTC, 5 replies.
- [PR] [SPARK-60309][SQL] Fix `mode` to count binary values by content instead of by reference [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/17 01:28:32 UTC, 5 replies.
- Re: [PR] [SPARK-60294][SQL] Disable Arrow-backed columnar input to Python UDFs by default [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/17 02:21:11 UTC, 5 replies.
- [PR] [SPARK-60310][SQL] Fix `PythonForeachWriter` reading freed buffer pages after its task is killed [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/17 02:30:30 UTC, 7 replies.
- [PR] [SPARK-60311][CORE][WEBUI] Respect UI root in History Server log page [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/17 02:40:52 UTC, 4 replies.
- Re: [PR] [SPARK-60312][PYTHON] Preserve decimal precision when decoding variants [spark] - posted by "Arthur031221 (via GitHub)" <gi...@apache.org> on 2026/10/17 03:06:20 UTC, 3 replies.
- [PR] [SPARK-60313][SS][PYTHON] Fix `pythonDataSent` undercount in `applyInPandasWithState` and `transformWithState` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/17 03:25:42 UTC, 4 replies.
- [PR] [SPARK-60314][SQL] Make `Literal.sql` preserve the precision of `TIME(7)`-`TIME(9)` literals [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/17 03:29:51 UTC, 10 replies.
- Re: [PR] [SPARK-59779][DOCS] Document the whole-stage codegen method limit [spark] - posted by "deepujain (via GitHub)" <gi...@apache.org> on 2026/10/17 04:57:23 UTC, 0 replies.
- Re: [PR] [SPARK-35198][SQL][PYTHON] Expose direct debugCodegen methods [spark] - posted by "deepujain (via GitHub)" <gi...@apache.org> on 2026/10/17 04:57:26 UTC, 0 replies.
- [PR] [SPARK-60320][SQL] Fix wrong values from the vectorized DELTA_BYTE_ARRAY reader for uncompressed pages [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/10/17 07:52:24 UTC, 1 replies.
- [PR] [SPARK-60315][SQL] Evaluate the conjuncts after a NULL one in whole-stage codegen of a filter [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/10/17 08:12:15 UTC, 0 replies.
- Re: [PR] [SPARK-60321][SQL] Avoid intermediate copies of byte-array-backed strings in Parquet writes [spark] - posted by "saths008 (via GitHub)" <gi...@apache.org> on 2026/10/17 10:17:23 UTC, 0 replies.
- Re: [PR] [SPARK-60315][SQL] Fix inconsistent filter behavior with whole-stage codegen on and off when a conjunct is NULL [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/10/17 11:02:15 UTC, 23 replies.
- Re: [PR] [SPARK-57849][SQL] Support the TIME data type in DataFrame approxQuantile, summary and describe [spark] - posted by "iRakson (via GitHub)" <gi...@apache.org> on 2026/10/17 14:53:58 UTC, 2 replies.
- [PR] [SPARK-60322][SQL] Fix Parquet and ORC filter pushdown dropping rows for comparisons with a zero [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/10/17 17:49:57 UTC, 1 replies.
- [PR] [WIP][SQL] Do not implicitly narrow nanosecond-precision timestamps [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/10/17 18:33:42 UTC, 0 replies.
- [PR] [WIP][SQL][DOCS] Document the migration path from spark.sql.legacy.parquet.nanosAsLong to nanosecond timestamp types. [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/10/17 18:37:57 UTC, 0 replies.
- [PR] [SPARK-57836][SQL] Support nanosecond precision in to_timestamp, to_timestamp_ntz, to_timestamp_ltz and try_to_timestamp [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/10/17 18:43:30 UTC, 0 replies.
- [PR] [SPARK-57826][SQL] Reject nanosecond timestamps in percentile_approx and histogram_numeric [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/10/17 18:59:33 UTC, 0 replies.
- [PR] [SPARK-57838][SQL] Harden overflow and range handling for nanosecond timestamps [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/10/17 19:01:21 UTC, 4 replies.
- [PR] [SPARK-60188][PYTHON] Warn on unknown transpiler names in pyTranspilers [spark] - posted by "guan404ming (via GitHub)" <gi...@apache.org> on 2026/10/17 22:38:46 UTC, 6 replies.
- Re: [PR] [SPARK-58004][SQL][FOLLOWUP] Preserve AQE fan-in bound through local shuffle reads [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/18 00:43:48 UTC, 1 replies.
- Re: [PR] [SPARK-57784][SQL] Support the TIME data type in cost-based optimizer statistics estimation [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/18 00:43:53 UTC, 1 replies.
- Re: [PR] [SPARK-43322][SQL] Document null/empty behavior in explode_outer and posexplode_outer [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/18 00:43:57 UTC, 1 replies.
- Re: [PR] [SPARK-56367][SS][PYTHON][DOCS] Fix latestOffset docstring, update tutorial signature, and add Trigger.AvailableNow documentation [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/18 00:44:02 UTC, 1 replies.
- Re: [PR] [SPARK-40437][SS][PYTHON] Support string representation of durationMs in GroupState.setTimeoutDuration [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/18 00:44:07 UTC, 1 replies.
- [PR] [SPARK-60306][SQL] Release consumed columnar batches in non-codegen ColumnarToRow and Arrow Python UDFs [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/18 07:22:23 UTC, 5 replies.
- [PR] [SPARK-60325][SQL] Re-enable Arrow columnar input to Python UDFs, holding only vectors that are not reused [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/18 07:32:39 UTC, 0 replies.
- [PR] [SPARK-60324][SQL] Normalize -0.0 and NaN in floating-point dynamic partition values [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/10/18 08:41:59 UTC, 6 replies.
- [PR] [SPARK-60326][SQL] Pass the ORC SearchArgument to the reader directly [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/10/18 10:27:30 UTC, 2 replies.
- Re: [PR] [SPARK-58891][SQL] Reorder Window stacks to reduce exchanges [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/10/18 11:13:14 UTC, 3 replies.
- Re: [I] Shuffle tracking prevents dynamic allocation from removing executors after `collect()` / `toPandas()` [spark] - posted by "AbarnaaSree (via GitHub)" <gi...@apache.org> on 2026/10/18 13:27:55 UTC, 0 replies.
- Re: [PR] [SPARK-60185][PYTHON] Improve type annotation for SparkConnectGrpcException message [spark] - posted by "bearomorphism (via GitHub)" <gi...@apache.org> on 2026/10/18 16:11:12 UTC, 0 replies.
- [PR] [WIP][PYTHON] Improve type annotation for ML and MLlib Vector [spark] - posted by "bearomorphism (via GitHub)" <gi...@apache.org> on 2026/10/18 16:48:02 UTC, 0 replies.
- [PR] [WIP][PYTHON] Improve type annotation for vector operations and factories [spark] - posted by "bearomorphism (via GitHub)" <gi...@apache.org> on 2026/10/18 17:25:45 UTC, 0 replies.
- Re: [PR] [SPARK-59234][SQL] Don't produce key reducers for a pair admitted without reduction [spark] - posted by "naveenp2708 (via GitHub)" <gi...@apache.org> on 2026/10/19 00:28:31 UTC, 6 replies.
- [PR] [SPARK-60328][SQL][TESTS] Clear test jar from every artifact bucket in HiveDDLSuite SPARK-34261 test [spark] - posted by "jzhuge (via GitHub)" <gi...@apache.org> on 2026/10/19 01:06:33 UTC, 5 replies.
- [I] [BUILD] Bump Ivy up to 2.6.0 [spark] - posted by "art000109 (via GitHub)" <gi...@apache.org> on 2026/10/19 01:07:06 UTC, 0 replies.
- Re: [PR] [SPARK-59643][SQL] Tighten CheckOverflow nullability to match MakeDecimal [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/10/19 03:00:15 UTC, 1 replies.
- Re: [PR] [SPARK-59355][SQL] Simplify LIKE patterns containing escaped wildcards [spark] - posted by "david-mollitor-db (via GitHub)" <gi...@apache.org> on 2026/10/19 04:00:18 UTC, 3 replies.
- Re: [PR] [SPARK-58485] [SQL] Broadcast hash joins with scalar subquery as join key [spark] - posted by "VindhyaG (via GitHub)" <gi...@apache.org> on 2026/10/19 04:46:00 UTC, 2 replies.
- Re: [PR] [SPARK-38079][K8S] Gate the driver pod until the resources it mounts exist [spark] - posted by "HwangDongJun (via GitHub)" <gi...@apache.org> on 2026/10/19 04:49:16 UTC, 16 replies.
- [PR] [SQL] Support ARRAY input in vector_avg [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2026/10/19 09:40:25 UTC, 0 replies.
- [PR] [SPARK-60282][SQL] Fix ASOF JOIN handling of hidden USING columns from its inputs [spark] - posted by "LukaZdravic (via GitHub)" <gi...@apache.org> on 2026/10/19 10:37:19 UTC, 10 replies.
- [PR] [SPARK-59816][PYTHON] Transpile str upper, lower, startswith, and endswith [spark] - posted by "guan404ming (via GitHub)" <gi...@apache.org> on 2026/10/19 11:30:58 UTC, 0 replies.
- [PR] [SPARK-XXXXX][CORE] Avoid System.getenv on every JavaUtils.isTesting call [spark] - posted by "sebastianhillig-db (via GitHub)" <gi...@apache.org> on 2026/10/19 11:42:43 UTC, 0 replies.
- Re: [PR] [SPARK-60340][CORE] Avoid System.getenv on every JavaUtils.isTesting call [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/10/19 12:59:26 UTC, 3 replies.
- Re: [PR] [SPARK-60335][SQL] Do not implicitly narrow nanosecond-precision timestamps [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/10/19 13:21:45 UTC, 4 replies.
- [PR] [SPARK-60336][SS] Preserve repeated arithmetic terms in streaming join watermarks [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/10/19 13:30:14 UTC, 4 replies.
- [PR] [SPARK-60342][CORE][WEBUI] Respect UI root in Master UI links [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/19 13:56:12 UTC, 8 replies.
- [PR] [SPARK-60341][SQL] Support internal metadata columns in changelog reads [spark] - posted by "SanJSp (via GitHub)" <gi...@apache.org> on 2026/10/19 14:00:37 UTC, 0 replies.
- [PR] [SPARK-60343][PYTHON] Fix `pythonDataSent` to keep counting after 2 GiB per task in pipelined Python UDF mode [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/19 14:26:27 UTC, 3 replies.
- [PR] [SPARK-60344][SQL] Fix `Constraint.toDDL` to quote constraint names if needed [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/19 15:08:37 UTC, 4 replies.
- [PR] [SPARK-60232][SQL][4.1] Fix nested SPJ overwriting inner join pushdown [spark] - posted by "ammarchalifah (via GitHub)" <gi...@apache.org> on 2026/10/19 16:56:44 UTC, 15 replies.
- Re: [PR] [SPARK-60111][SQL] Preserve tags when rebuilding DataSource V2 relations [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/10/19 17:03:57 UTC, 2 replies.
- [PR] [SPARK-60346][SQL] Keep the precision of `TIME(p)` in `RowEncoder` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/19 17:31:07 UTC, 3 replies.
- [PR] [SPARK-60347][SDP] SCD1 Ignore-null support; Refactor SCD1 target merge into strategies [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/10/19 18:01:55 UTC, 0 replies.
- [PR] [SPARK-60349] Fix `StreamingQuery` creation to throw instead of trapping on non-UUID query ids from the server [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/19 18:08:01 UTC, 3 replies.
- Re: [PR] [SPARK-60231][SS] Improve the put/merge operation in ListState with TTL when there are multiple values [spark] - posted by "kavpreetgrewal (via GitHub)" <gi...@apache.org> on 2026/10/19 18:09:39 UTC, 4 replies.
- [PR] [SPARK-60351] Fix `getConf(WithDefault|Option)?` and `isModifiable` to not crash on empty Config responses [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/19 18:10:15 UTC, 3 replies.
- [PR] [SPARK-60352] Fix DataFrameStatFunctions.cov/corr/approxQuantile to throw instead of crashing on unexpected result types [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/19 18:12:07 UTC, 2 replies.
- [PR] [SPARK-60353] Fix `Catalog` APIs to not crash on null values returned by the server [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/19 18:13:46 UTC, 3 replies.
- [PR] [SPARK-60355][SQL] Support TIME precision widening in `UnwrapCastInBinaryComparison` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/19 18:22:31 UTC, 3 replies.
- [PR] [SPARK-60347][SDP] SCD1 Ignore-null support; Implement target table merge [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/10/19 18:24:32 UTC, 0 replies.
- [PR] [SPARK-60357][PYTHON] Return a named record from read_single_udf for every eval type [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/19 18:27:47 UTC, 3 replies.
- [PR] [SPARK-60356][SQL] Support left semi and left anti join pushdown for DSv2 [spark] - posted by "hemanthboyina (via GitHub)" <gi...@apache.org> on 2026/10/19 18:28:07 UTC, 0 replies.
- [PR] [SPARK-60358][SQL] Fix Parquet filter pushdown on `TIME` columns read with a lower precision [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/19 19:00:05 UTC, 7 replies.
- Re: [PR] [SPARK-48290][CORE] Record skewed shuffle block sizes by default so that AQE can detect skew [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/10/19 19:29:40 UTC, 1 replies.
- [PR] [SPARK-60311][4.0][CORE][UI][FOLLOWUP] Set `ecmaVersion` to `latest` in `dev/eslint.js` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/19 20:20:21 UTC, 5 replies.
- [PR] [SPARK-60359][SS] Remove state only when eviction iterator advances [spark] - posted by "minyyy (via GitHub)" <gi...@apache.org> on 2026/10/19 20:57:03 UTC, 5 replies.
- Re: [PR] [SPARK-60328][SQL][TESTS] Use a unique jar copy in the HiveDDLSuite SPARK-34261 test [spark] - posted by "jzhuge (via GitHub)" <gi...@apache.org> on 2026/10/19 21:25:17 UTC, 1 replies.
- [PR] [SPARK-60361][BUILD] Fix `core` module to use the root `exec-maven-plugin` version instead of `1.6.0` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/19 21:26:10 UTC, 5 replies.
- [PR] [SPARK-60360][SQL] Validate file source writes before deleting existing data in static overwrite [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/19 21:27:00 UTC, 5 replies.
- [PR] [SPARK-60363][SQL][TESTS] Raise PROCESSES of the Oracle test container to avoid ORA-12516 [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/10/19 21:42:31 UTC, 3 replies.
- [PR] [SPARK-60364][BUILD] Upgrade `scopt` to 4.2.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/19 21:45:26 UTC, 0 replies.
- [PR] [SPARK-52598][DOCS] Reorganize the Spark Connect docs and add a programming guide [spark] - posted by "lisancao (via GitHub)" <gi...@apache.org> on 2026/10/19 22:05:52 UTC, 1 replies.
- [PR] [SPARK-60366][CORE] Fix dynamic partition overwrite to replace partitions with non-`FileOutputCommitter` committers [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/19 22:09:02 UTC, 10 replies.
- [PR] [SQL] Fix overflow and non-finite handling in vector_avg for float vectors [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2026/10/19 22:24:50 UTC, 1 replies.
- [PR] [SPARK-60367][SQL] Fix duplicated rows and closed reader root in sliced Arrow output processors [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/19 22:32:51 UTC, 21 replies.
- [PR] [SPARK-60368][SDP] SCD1 Ignore-null support; Dispatch leaf-level reconciliation and target merge [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/10/19 22:38:46 UTC, 0 replies.
- Re: [PR] [SPARK-60197][MINOR][SQL][TESTS] Add DROP TABLE SQL golden tests [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/10/19 22:57:50 UTC, 1 replies.
- Re: [PR] [SPARK-59988][SQL] Fix INTERNAL_ERROR in to_timestamp with numeric input and a format [spark] - posted by "sadikovi (via GitHub)" <gi...@apache.org> on 2026/10/19 22:59:20 UTC, 1 replies.
- [PR] [SQL] Push down local limits below unions and cross joins [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/10/19 23:43:49 UTC, 0 replies.
- Re: [PR] [SPARK-58785][CORE][TESTS] Add tests for FilteredObjectInputStream resolveClass allow-list [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/10/20 00:02:15 UTC, 8 replies.
- [PR] [SPARK-59747][CORE][4.1] Don’t retry compaction of rolled event log files with malformed input [spark] - posted by "DengYiping (via GitHub)" <gi...@apache.org> on 2026/10/20 00:25:39 UTC, 0 replies.
- [PR] [SPARK-59747][CORE][4.0] Don't retry compaction of rolled event log files with malformed input [spark] - posted by "DengYiping (via GitHub)" <gi...@apache.org> on 2026/10/20 00:25:50 UTC, 1 replies.
- Re: [PR] [SPARK-60354][CONNECT][PYTHON] Use FieldDescriptor.is_repeated when truncating plans for logging [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/20 00:26:59 UTC, 1 replies.
- [PR] [SPARK-60373][SS] Count state rows removed while producing outer join output [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/10/20 00:27:45 UTC, 5 replies.
- Re: [PR] [SPARK-60330][ML] Register classification tree nodes with Kryo [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/20 00:28:26 UTC, 1 replies.
- Re: [PR] [SPARK-59747][CORE][4.1] Don't retry compaction of rolled event log files with malformed input [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/10/20 00:35:59 UTC, 1 replies.
- Re: [PR] [MINOR][PS][DOC] Document missing rolling and expanding window APIs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/20 00:46:09 UTC, 1 replies.
- Re: [PR] [SPARK-58036][SQL] Delegate missing methods in AggregatedDialect to underlying dialects [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/20 00:48:39 UTC, 1 replies.
- Re: [PR] [SPARK-57240][CORE] Avoid unnecessary String conversion in UTF8String.splitSQL [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/20 00:48:44 UTC, 1 replies.
- Re: [PR] [SPARK-57561][SQL] Reject TIME inputs for unsupported datetime functions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/20 00:48:49 UTC, 1 replies.
- Re: [PR] [SPARK-57636][SQL] Support REPLACE USING with row-level DSv2 writes [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/20 00:48:53 UTC, 1 replies.
- [PR] [SPARK-60372] Avoid blocking the reconciler thread on long secondary-resource-create backoffs [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2026/10/20 00:55:09 UTC, 0 replies.
- Re: [PR] [SPARK-59125][CONNECT][PYTHON] Skip exit cleanup RPCs when the client has no live server-side session [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/20 01:52:44 UTC, 1 replies.
- Re: [PR] [SPARK-60277][SQL] Preserve keyed partitioning through unions with unknown keys [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/10/20 02:39:44 UTC, 14 replies.
- [PR] [SPARK-60305][PYTHON][TESTS][FOLLOWUP][4.2] Fix ReaderInputStream arguments in CloseShieldOutputStreamSuite [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/20 03:00:29 UTC, 4 replies.
- [PR] [SPARK-60305][PYTHON][TESTS][FOLLOWUP][4.1] Fix ReaderInputStream arguments in CloseShieldOutputStreamSuite [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/20 03:00:31 UTC, 3 replies.
- [PR] [SPARK-60305][PYTHON][TESTS][FOLLOWUP][4.0] Fix ReaderInputStream arguments in CloseShieldOutputStreamSuite [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/20 03:00:34 UTC, 3 replies.
- [PR] SPARK-58485: Fix Broadcast hash join with scalar sub query as key [spark] - posted by "VindhyaG (via GitHub)" <gi...@apache.org> on 2026/10/20 03:08:14 UTC, 0 replies.
- [PR] [SPARK-60375][SS] Base left semi join output watermarks on emitted event time [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/10/20 04:18:21 UTC, 3 replies.
- [I] Cached UC managed Delta table reads remain stale after RTAS or overwrite on Spark 4.0.1 [spark] - posted by "johnnyzhon (via GitHub)" <gi...@apache.org> on 2026/10/20 05:44:17 UTC, 0 replies.
- [PR] [SPARK-60376][SS] Restrict V4 join matching scans to event-time bounds [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/10/20 06:13:57 UTC, 4 replies.
- Re: [PR] [SPARK-58942][DOCS] Document CHAR/VARCHAR as a character string type family [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/20 06:56:24 UTC, 10 replies.
- [PR] [SPARK-60378][SS] Fix skipped rows in V4 streaming join eviction [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/10/20 07:25:00 UTC, 8 replies.
- Re: [PR] [SPARK-59532][ML][SQL] Optimize VectorDotProduct for foldable inputs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/20 07:26:25 UTC, 1 replies.
- [PR] [SPARK-60379][SQL] Push down shuffle exchange through union [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/10/20 08:20:44 UTC, 13 replies.
- Re: [PR] [SPARK-60173][PYTHON][TEST] Replace type: ignore[union-attr] in pyspark.ml [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/20 08:35:10 UTC, 1 replies.
- Re: [PR] [SPARK-60334][SQL][DOCS] Document the migration path from spark.sql.legacy.parquet.nanosAsLong to nanosecond timestamp types. [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/10/20 09:11:53 UTC, 2 replies.
- Re: [PR] [SPARK-60186][PS] Simplify remove_unused_categories [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/20 09:13:25 UTC, 1 replies.
- [PR] [MINOR][4.3][SQL][PYTHON] Document collect_union in the function reference [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/20 09:23:56 UTC, 2 replies.
- [PR] [MINOR][CORE][SQL] Correct versions of configs introduced in Spark 4.3.0 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/20 09:25:18 UTC, 0 replies.
- [PR] [SPARK-60383][CORE] Keep streaming shuffle implementation details out of the public API [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/20 09:29:54 UTC, 4 replies.
- [PR] [SPARK-60385][SQL] Pass JDBCOptions to JdbcUtils.getSchema instead of individual timestamp flags [spark] - posted by "aleksandar-trajkovic-db (via GitHub)" <gi...@apache.org> on 2026/10/20 09:37:27 UTC, 11 replies.
- [PR] [SPARK-60384][BUILD] Check binary compatibility against Spark 4.2.0 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/20 09:38:28 UTC, 2 replies.
- [PR] [SPARK-60382][SQL] CoalesceBucketsInJoin should see only the streamed side of a broadcast join [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2026/10/20 09:47:34 UTC, 3 replies.
- [PR] [SPARK-59824][SQL][FOLLOWUP] Guard top-level geometry and geography inputs to pickle Python UDFs [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2026/10/20 09:50:44 UTC, 1 replies.
- [PR] [ML][MLLIB][PYTHON] Say deprecated APIs will be removed in the future [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/20 10:13:16 UTC, 0 replies.
- [PR] [SPARK-60381][SQL] Account the late-materialization survivor buffer to the task's execution memory [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/20 10:33:23 UTC, 27 replies.
- Re: [PR] [SPARK-60374][CONNECT] Support client-generated checkpoint relation IDs [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/20 10:43:17 UTC, 2 replies.
- Re: [PR] [SPARK-60282][SQL] Fix hidden USING columns from join inputs in ASOF JOIN and single-pass JOIN [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/10/20 11:48:53 UTC, 1 replies.
- Re: [PR] [SPARK-60337][SQL] Reject nanosecond timestamps in percentile_approx and histogram_numeric [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/10/20 12:06:46 UTC, 2 replies.
- [PR] [SPARK-60386][SQL] Enforce FILE EXTERNAL in table columns and reject FILE where it would need an ordering [spark] - posted by "dejankrak-db (via GitHub)" <gi...@apache.org> on 2026/10/20 12:30:33 UTC, 7 replies.
- Re: [PR] [SPARK-60364][BUILD][EXAMPLES] Upgrade `scopt` to 4.2.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/20 13:04:29 UTC, 3 replies.
- [PR] [SPARK-60380][SQL] Fix Parquet filter pushdown on nanosecond timestamp columns read with a lower precision [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/20 13:47:29 UTC, 9 replies.
- [PR] [SPARK-56720][4.2][SS] Fail subsequent async log writes after a prior failure in async progress tracking [spark] - posted by "snmvaughan (via GitHub)" <gi...@apache.org> on 2026/10/20 15:00:24 UTC, 2 replies.
- [PR] [SPARK-60387][SQL] Keep the existing table when `saveAsTable` overwrite fails before writing [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/20 15:00:26 UTC, 4 replies.
- [PR] [SPARK-56720][4.1][SS] Fail subsequent async log writes after a prior failure in async progress tracking [spark] - posted by "snmvaughan (via GitHub)" <gi...@apache.org> on 2026/10/20 15:00:31 UTC, 2 replies.
- [PR] [SPARK-56720][4.0][SS] Fail subsequent async log writes after a prior failure in async progress tracking [spark] - posted by "snmvaughan (via GitHub)" <gi...@apache.org> on 2026/10/20 15:00:33 UTC, 2 replies.
- [PR] [SPARK-60388] Fix `DataFrame.na` and `DataFrame.stat.sampleBy` to not crash on unsupported value types [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/20 15:24:30 UTC, 3 replies.
- [PR] [SPARK-60389] Fix `createDataFrame` to throw instead of crashing on a non-integer `spark.sql.session.localRelationCacheThreshold` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/20 15:26:46 UTC, 3 replies.
- [PR] [SPARK-60390] Fix `collect` to return struct columns as nested `Row`s instead of crashing on non-UTF-8 binary fields [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/20 15:29:01 UTC, 3 replies.
- [PR] [WIP][SQL] Support DROP TABLE in the single-pass analyzer [spark] - posted by "vladanvasi-db (via GitHub)" <gi...@apache.org> on 2026/10/20 15:59:16 UTC, 0 replies.
- [PR] [SPARK-60113][4.3][CORE][SQL] Wait for the pipelined Python UDF writer to exit before task completion cleanup [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/20 16:48:21 UTC, 3 replies.
- [PR] [SPARK-60391][SQL] Add DataFrame API for BIN BY [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/10/20 17:52:19 UTC, 6 replies.
- [PR] [SPARK-60396][SQL] Fix Hive ORC filter pushdown on nanosecond timestamp columns [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/20 19:12:11 UTC, 4 replies.
- [PR] [SPARK-60398][SQL] Fix ExpandExec codegen to call switch case functions in nested classes by their qualified names [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/20 19:55:00 UTC, 0 replies.
- [PR] [SPARK-60399][DOCS][SQL] Add a Metric Views programming guide and a CREATE METRIC VIEW reference page [spark] - posted by "lisancao (via GitHub)" <gi...@apache.org> on 2026/10/20 20:04:29 UTC, 0 replies.
- [PR] [SPARK-60400][SQL] Fix ORC `TIMESTAMP` schema inference with `spark.sql.timestampType=TIMESTAMP_NTZ` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/20 20:11:10 UTC, 3 replies.
- Re: [PR] [SPARK-60398][SQL] Fix `ExpandExec` codegen to call switch case functions in nested classes by their qualified names [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/20 20:14:44 UTC, 3 replies.
- [PR] [SPARK-60401] Stop the infinite status update loop of a `ClientMode` SparkApplication [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/20 20:24:40 UTC, 2 replies.
- [PR] [SPARK-60402] Ignore sidecar containers when observing the driver pod [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/20 20:36:07 UTC, 4 replies.
- [PR] [SPARK-60403][SQL] Fix `(SortMergeJoin|ShuffledHashJoin|MergeRows)Exec` codegen to call functions in nested classes by their qualified names [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/20 20:46:16 UTC, 3 replies.
- [PR] [SPARK-60404] Use lowercase UUIDs as operation IDs to fix ReattachExecute and ReleaseExecute [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/20 20:53:12 UTC, 3 replies.
- [PR] [SPARK-60405] Fix `collect` to return empty `Row`s instead of crashing on results without columns [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/20 20:55:01 UTC, 3 replies.
- [PR] [SPARK-60407] Fix command APIs to not return empty results when ExecutionProgress arrives first [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/20 20:56:09 UTC, 3 replies.
- [PR] [SPARK-60408] Migrate `notify_test_workflow.yml` from `pull_request_target` to `workflow_run` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/20 20:58:54 UTC, 2 replies.
- [PR] [SPARK-60397][SQL] Fix ORC filter pushdown on nanosecond timestamp columns read with a lower precision [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/20 21:02:44 UTC, 0 replies.
- [PR] [SPARK-60406][SQL] Count CollapseProject's column references by expression ID [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/10/20 21:06:45 UTC, 1 replies.
- [PR] [SPARK-60387][SQL][4.1] Keep the existing table when `saveAsTable` overwrite fails before writing [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/20 21:08:54 UTC, 3 replies.
- [PR] [SPARK-60387][SQL][4.0] Keep the existing table when `saveAsTable` overwrite fails before writing [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/20 21:18:54 UTC, 3 replies.
- [PR] [SPARK-60409] Fix createDataFrame to keep the number of rows of local data without columns [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/20 21:31:25 UTC, 1 replies.
- [I] Reporting an issue with util.SizeEstimator, as requested. [spark] - posted by "maxbox63 (via GitHub)" <gi...@apache.org> on 2026/10/20 21:37:02 UTC, 1 replies.
- [PR] [SPARK-60412] Fix `SparkSession.Builder` to not send spark.(remote|master) to the server [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/20 21:55:43 UTC, 3 replies.
- Re: [PR] [SPARK-60409] Fix `createDataFrame` to keep the number of rows of local data without columns [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/20 22:03:14 UTC, 1 replies.
- [PR] [SPARK-60413][SQL] Warn when evolving a DSv2 table that accepts any schema [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/10/20 22:15:37 UTC, 4 replies.
- Re: [PR] [SPARK-60348][SS] Fix state data source change feed dropping list state values after the first [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/20 22:26:58 UTC, 4 replies.
- Re: [PR] [MINOR][CORE][SQL][DOC] Correct versions of configs introduced in Spark 4.3.0 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/21 00:31:06 UTC, 1 replies.
- [PR] [MINOR][CORE][SQL][DOC][4.3] Correct versions of configs introduced in Spark 4.3.0 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/21 00:40:30 UTC, 2 replies.
- [PR] [SQL] Expose subquery planning context to DataSource V2 scan builders [spark] - posted by "yyanyy (via GitHub)" <gi...@apache.org> on 2026/10/21 01:11:39 UTC, 2 replies.
- Re: [PR] [SPARK-59988][SQL] Parse numeric input as string in to_timestamp with a format [spark] - posted by "sadikovi (via GitHub)" <gi...@apache.org> on 2026/10/21 01:51:25 UTC, 3 replies.
- [PR] [SPARK-60222][CORE] Keep task completion listeners on the completing thread when another thread invokes listeners [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/21 02:02:14 UTC, 13 replies.
- [PR] [SPARK-60333][SQL] Fix make_timestamp second overflow [spark] - posted by "Huang-404-Q (via GitHub)" <gi...@apache.org> on 2026/10/21 04:24:37 UTC, 0 replies.
- [PR] [SPARK-60416][SQL][SS] Allow Structured Streaming Coverage in SQL Tests [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2026/10/21 05:50:54 UTC, 3 replies.
- Re: [PR] [SPARK-60281][DOCS] Upgrade AnchorJS to v5.0.0 [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/10/21 08:02:08 UTC, 0 replies.
- [PR] [MINOR][INFRA] Mention `Co-authored-by: ` in PR template [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/10/21 08:18:08 UTC, 3 replies.
- [PR] [SPARK-60417][ML][PYTHON] Remove type: ignore[no-untyped-def] in pyspark.ml.torch.distributor [spark] - posted by "soaring0616 (via GitHub)" <gi...@apache.org> on 2026/10/21 08:32:45 UTC, 0 replies.
- [PR] [SPARK-60418][SQL] Skip subexpression elimination for a conditional IN list element [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/10/21 09:11:26 UTC, 0 replies.
- Re: [PR] [SPARK-59151][SQL] Add a VariantBuilder.canonicalize primitive for Variant aggregation [spark] - posted by "ZdravDim (via GitHub)" <gi...@apache.org> on 2026/10/21 10:34:02 UTC, 1 replies.
- [PR] [SPARK-59151][SQL] Implement the CanonicalizeVariant Catalyst expression [spark] - posted by "SavicStefan (via GitHub)" <gi...@apache.org> on 2026/10/21 10:59:29 UTC, 0 replies.
- Re: [PR] [WIP][SQL] Extract shared catalog identifier and DROP TABLE helpers [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/10/21 12:06:02 UTC, 0 replies.
- [PR] [SPARK-60419][CORE] Fix file descriptor leak in `FileSystemPersistenceEngine.deserializeFromFile` when compression is enabled [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/10/21 13:17:27 UTC, 8 replies.
- Re: [PR] [SPARK-60422][SQL] Extract shared catalog identifier and DROP TABLE helpers [spark] - posted by "vladanvasi-db (via GitHub)" <gi...@apache.org> on 2026/10/21 14:59:02 UTC, 3 replies.
- [PR] [SPARK-60424][SQL] Fix Hive `timestamp` type parsing with `spark.sql.timestampType=TIMESTAMP_NTZ` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/21 15:38:27 UTC, 8 replies.
- [PR] [SPARK-60425][SQL] Fix InternalRow.copyValue to clone Array[Byte] values [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2026/10/21 15:54:32 UTC, 3 replies.
- [PR] [SPARK-60426] Make the index-based subscript of Row public [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/21 16:25:57 UTC, 3 replies.
- [PR] [SPARK-60427] Update GitHub Actions to the latest approved versions and pin `setup-minikube` to a commit SHA [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/21 16:26:14 UTC, 3 replies.
- [PR] [SPARK-60429] Fix Helm chart to create sentinel resources in all sentinel namespaces [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/21 16:36:57 UTC, 3 replies.
- [PR] [SPARK-59718][SQL][4.x] Add opt-in in-process Python UDF execution via Arrow C Data Interface [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/21 16:44:49 UTC, 4 replies.
- [PR] [SPARK-60428][SQL] Avoid zeroing Arrow vectors to their full capacity in ArrowWriter.reset() [spark] - posted by "qingfureal (via GitHub)" <gi...@apache.org> on 2026/10/21 16:48:44 UTC, 0 replies.
- Re: [PR] [MINOR][INFRA] Suggest `Assisted-by` instead of `Generated-by` in PR template [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/10/21 17:04:45 UTC, 0 replies.
- Re: [PR] [SPARK-60423][SQL] Fix Hive ORC filter pushdown on timestamp literals with sub-millisecond digits [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/21 17:16:01 UTC, 3 replies.
- [PR] [SPARK-60431][SQL] Split a wide projection's outputs into methods under whole-stage codegen [spark] - posted by "qingfureal (via GitHub)" <gi...@apache.org> on 2026/10/21 17:29:57 UTC, 0 replies.
- [PR] [SPARK-60432][CORE] Validate `spark.io.compression.zstd.bufferSize` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/21 17:40:07 UTC, 4 replies.
- [PR] [SPARK-60430][CORE] Fix `FileSystemRecoveryModeFactory` to handle `none` as a codec [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/21 17:41:44 UTC, 5 replies.
- [PR] [SPARK-60433][SQL] Support non-constant expressions in VALUES lists [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/10/21 17:49:10 UTC, 12 replies.
- [PR] [SPARK-60434] Send `client_observed_server_side_session_id` to detect server-side session changes [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/21 17:53:52 UTC, 3 replies.
- [PR] [SPARK-60435] Enable gRPC keepalive by default and support `grpc_keepalive_*` parameters in connection string [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/21 17:55:20 UTC, 3 replies.
- [PR] [SPARK-60436][SQL] Fix ORC filter pushdown on timestamp literals with sub-millisecond digits [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/21 17:59:58 UTC, 5 replies.
- [PR] [SPARK-60438] Add the name getters of the Services and NetworkPolicy of SparkCluster [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/21 18:02:07 UTC, 3 replies.
- [PR] [SPARK-60437][DOCS] Fix stale API references in the Data Source V2 page and add a connector walkthrough [spark] - posted by "lisancao (via GitHub)" <gi...@apache.org> on 2026/10/21 18:02:16 UTC, 15 replies.
- [PR] [SPARK-60440] Migrate `notify_test_workflow.yml` from `pull_request_target` to `workflow_run` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/21 18:03:34 UTC, 5 replies.
- [PR] [SPARK-60439][SQL] Support DataSource V2 pushdown for aggregates with FILTER clauses [spark] - posted by "hemanthboyina (via GitHub)" <gi...@apache.org> on 2026/10/21 18:08:59 UTC, 0 replies.
- [PR] [SPARK-60441][CORE] Let a task release UnsafeSorterSpillReader's record buffer before it ends [spark] - posted by "qingfureal (via GitHub)" <gi...@apache.org> on 2026/10/21 18:39:12 UTC, 0 replies.
- [PR] [SPARK-48143][SQL][3.5] Use lightweight exceptions for control-flow between UnivocityParser and FailureSafeParser [spark] - posted by "adgubrud (via GitHub)" <gi...@apache.org> on 2026/10/21 19:26:07 UTC, 2 replies.
- Re: [PR] [SPARK-59174][SS] State-store instance metrics are shipped in every task result [spark] - posted by "Diveyam-Mishra (via GitHub)" <gi...@apache.org> on 2026/10/21 20:01:08 UTC, 4 replies.
- [PR] [SPARK-60096][4.x][CONNECT][SQL] Raise a user-facing error instead of INTERNAL_ERROR for an unresolved DataFrame subquery plan id [spark] - posted by "sadikovi (via GitHub)" <gi...@apache.org> on 2026/10/21 20:38:02 UTC, 4 replies.
- [PR] [SPARK-60443][SQL] Allow Variant decimal values with scale > type precision [spark] - posted by "jack-leitch98 (via GitHub)" <gi...@apache.org> on 2026/10/21 21:06:52 UTC, 2 replies.
- [PR] [SPARK-60442][SQL][PYTHON] Fix variant decoding rejecting spec-valid decimals [spark] - posted by "qlong (via GitHub)" <gi...@apache.org> on 2026/10/21 21:07:05 UTC, 0 replies.
- [PR] [SPARK-XXXXX][SS][PYTHON] Stop the transformWithState state server before a failed task aborts its state store [spark] - posted by "dylanwong250 (via GitHub)" <gi...@apache.org> on 2026/10/21 22:11:59 UTC, 0 replies.
- [PR] [SPARK-59985][FOLLOWUP][4.x][ML][PYTHON] Drop the log_streaming_auth_secret assertion that branch-4.x does not have [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/21 22:41:57 UTC, 3 replies.
- Re: [PR] [SPARK-59546][SQL] Avoid per-row exceptions when inferring TimeType in JSON, CSV, and XML [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/10/21 22:50:36 UTC, 0 replies.
- Re: [PR] [SPARK-59059][CORE] Support per-logger log level configuration with static Spark conf [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/10/21 23:01:10 UTC, 2 replies.
- [PR] [WIP][SQL] Add a native Parquet source with an arrow-rs RowFilter to the Rust SDK examples [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/10/21 23:11:40 UTC, 1 replies.
- [I] Merge spark PR script hard blocks on JIRA [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/10/22 00:26:24 UTC, 0 replies.
- [PR] [SPARK-56632][SQL][CONNECT] Keep re-selected hidden join keys regular in DataFrame column resolution [spark] - posted by "dejankrak-db (via GitHub)" <gi...@apache.org> on 2026/10/22 00:45:23 UTC, 1 replies.
- [PR] [INFRA] Tolerate an unreachable ASF JIRA in the merge script [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/10/22 00:54:56 UTC, 3 replies.
- Re: [PR] [SPARK-57714][CORE] Add loser tree based k-way merger for UnsafeExternalSorter spill merge [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/22 01:33:50 UTC, 1 replies.
- [PR] [SPARK-60371] Update quinn-proto and rustls in Cargo.lock to pick up recent RustSec advisories [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/22 02:34:47 UTC, 2 replies.
- [PR] [SPARK-60370] Run cargo audit in CI on a daily schedule and on dependency changes [spark-connect-gateway] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/10/22 02:42:58 UTC, 2 replies.
- [PR] [SPARK-56093][CORE][HISTORY] Allow AppStatus to be cached and reused by the history server [spark] - posted by "ForVic (via GitHub)" <gi...@apache.org> on 2026/10/22 03:07:01 UTC, 8 replies.
- [PR] [SPARK-60447][SQL] Support DataSource V2 functions in CREATE FUNCTION on the session catalog [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/10/22 03:38:47 UTC, 5 replies.
- Re: [I] [SQL] State-store instance metrics are shipped in every task result [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/10/22 04:24:33 UTC, 0 replies.
- [PR] [SPARK-60430][4.0][CORE][TEST][FOLLOWUP] Use `foreach` instead of `gridTest` in `RecoverySuite` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/22 04:36:28 UTC, 5 replies.
- [PR] [SPARK-60449][SQL] Fix ORC filter pushdown on `TIMESTAMP` values with sub-microsecond digits [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/22 04:49:18 UTC, 5 replies.
- [PR] [SPARK-56906][SQL] Add SKEW_JOIN hint with SkewKeyJoinExec [spark] - posted by "pratham76 (via GitHub)" <gi...@apache.org> on 2026/10/22 05:39:19 UTC, 1 replies.
- Re: [PR] [SPARK-60448][SQL] Apply filter conditions on a storage filter's key columns in the Parquet reader [spark] - posted by "ForVic (via GitHub)" <gi...@apache.org> on 2026/10/22 05:39:26 UTC, 2 replies.
- Re: [PR] [SPARK-38079][K8S] Gate the driver pod until the resources spark-submit creates for it exist [spark] - posted by "HwangDongJun (via GitHub)" <gi...@apache.org> on 2026/10/22 06:38:08 UTC, 14 replies.
- Re: [PR] [SPARK-60197][SQL][TESTS] Add DROP TABLE SQL golden tests [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/10/22 06:49:46 UTC, 1 replies.
- [PR] [SPARK-27052][SQL][PYTHON][FOLLOWUP] Fix issues in lifting Python UDFs out of higher-order function lambdas [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/10/22 07:20:46 UTC, 4 replies.
- Re: [PR] [SPARK-59317][SQL] Unwrap the cast of a DSv2 scalar subquery runtime filter before pushing it down [spark] - posted by "spark-test (via GitHub)" <gi...@apache.org> on 2026/10/22 08:21:08 UTC, 0 replies.
- [PR] [SPARK-60459][SQL] Push down filters through ASOF JOIN [spark] - posted by "LukaZdravic (via GitHub)" <gi...@apache.org> on 2026/10/22 09:30:56 UTC, 4 replies.
- [PR] [SPARK-60458][SQL] Optimize skewed joins per join instead of all-or-nothing [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/10/22 09:34:21 UTC, 4 replies.
- [PR] [SPARK-60461][MLLIB] Restore Strategy constructor binary compatibility [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/22 11:56:25 UTC, 3 replies.
- Re: [PR] [SPARK-60462][SQL][CONNECT] Keep re-selected hidden join keys regular in DataFrame column resolution [spark] - posted by "dejankrak-db (via GitHub)" <gi...@apache.org> on 2026/10/22 12:03:26 UTC, 6 replies.
- [PR] [SPARK-56632][SQL][CONNECT][4.1] Fix AMBIGUOUS_COLUMN_REFERENCE regression for reused DataFrame in natural join [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/10/22 12:51:16 UTC, 2 replies.
- [PR] [SPARK-47230][SPARK-34956][SQL] Prune nested fields read through explode and posexplode [spark] - posted by "ohad-definity (via GitHub)" <gi...@apache.org> on 2026/10/22 13:31:27 UTC, 0 replies.
- [PR] [SPARK-60463] Release the resources of a `SparkCluster` on `SchedulingFailure` and end it as `ResourceReleased` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/22 13:37:54 UTC, 4 replies.
- [PR] [SPARK-60464] Fix completed executions to not fail when the final `ReleaseExecute` fails [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/22 13:48:20 UTC, 3 replies.
- [PR] [SPARK-60466][CORE] Fix `ThreadUtils.shutdown` to call `shutdownNow` after the grace period [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/22 13:54:34 UTC, 12 replies.
- [PR] [SPARK-60468][INFRA] Only treat leading SPARK JIRA tags as JIRA IDs in merge_spark_pr.py [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/10/22 14:00:10 UTC, 5 replies.
- [PR] [SPARK-60467][CORE] Fix `FileSystemPersistenceEngine` to clean up failed writes and skip unreadable files [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/22 14:00:14 UTC, 8 replies.
- [PR] [SPARK-60469][SS] Fix the executor termination check in async progress tracking cleanup [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/22 14:21:22 UTC, 3 replies.
- [PR] [SPARK-60471] Fix `DataFrame.withColumnRenamed` to not crash on duplicate column names [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/22 14:26:56 UTC, 3 replies.
- [PR] [SPARK-60470][SQL] Fix `CatalystTypeConverters` to read `GEOMETRY` and `GEOGRAPHY` fields at the given ordinal [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/22 14:27:50 UTC, 4 replies.
- Re: [PR] [SPARK-60447][SQL] Support V2 functions in CREATE FUNCTION on session catalog [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/10/22 14:28:47 UTC, 3 replies.
- [PR] [SPARK-60472] Fix `collect` to throw an error instead of misreading compressed Arrow batches [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/22 15:04:35 UTC, 3 replies.
- [PR] [SPARK-60474][CORE] Do not wait for pending abort timer tasks in `TaskSchedulerImpl.stop` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/22 15:30:02 UTC, 5 replies.
- Re: [PR] [SPARK-60445][SS][PYTHON] Stop the transformWithState state server before a failed task aborts its state store [spark] - posted by "dylanwong250 (via GitHub)" <gi...@apache.org> on 2026/10/22 16:04:39 UTC, 0 replies.
- [PR] [SPARK-60475] Delete the HPA and PDB of a failed `SparkCluster` after releasing its Kueue `Workload` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/22 16:10:03 UTC, 2 replies.
- [PR] [SPARK-54055][CORE] Clean up Python worker factories on session eviction [spark] - posted by "psavalle (via GitHub)" <gi...@apache.org> on 2026/10/22 16:13:01 UTC, 2 replies.
- [PR] [SPARK-60476] Remove unused `ArrowFlight` files [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/22 16:14:29 UTC, 3 replies.
- [PR] [SPARK-60477] Fix `DataFrameStatFunctions.approxQuantile` to throw instead of crashing on empty results [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/22 16:17:41 UTC, 3 replies.
- [PR] [SPARK-60478][INFRA] Fix tpcds-kit build failure with GCC 15 on Ubuntu 26.04 GitHub runners [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/10/22 17:02:45 UTC, 3 replies.
- Re: [PR] [SPARK-60475] Delete the HPA and PDB of a `SparkCluster` after releasing its Kueue `Workload` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/22 17:25:32 UTC, 2 replies.
- [PR] [SPARK-60465][SQL] Late-materialization storage-filter pushdown for data source V2 scans [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/10/22 17:28:36 UTC, 2 replies.
- [PR] [SPARK-60479][SQL] Push down CHAR filters when read-side padding is enabled [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/10/22 18:09:14 UTC, 10 replies.
- [PR] [WIP][SQL] Fix the vectorized Parquet reader for a dictionary page following a PLAIN page in a batch [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/10/22 18:56:52 UTC, 0 replies.
- [PR] [SPARK-60462][SQL][CONNECT][4.3] Keep re-selected hidden join keys regular in DataFrame column resolution [spark] - posted by "dejankrak-db (via GitHub)" <gi...@apache.org> on 2026/10/22 20:16:26 UTC, 0 replies.
- [PR] [SPARK-60481][CONNECT][SDP] Block `INSERT OVERWRITE DIRECTORY` in `spark.sql` of SDP [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/22 20:44:54 UTC, 3 replies.
- [PR] [SPARK-60482][SQL] Mark `TIME` as a Hive incompatible data type [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/22 20:57:04 UTC, 4 replies.
- [PR] [SPARK-55213][PYTHON] Provide hooks for custom transpilers [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/10/22 21:17:17 UTC, 2 replies.
- Re: [PR] [SPARK-60485][SQL] Initial support for non-constant expressions in VALUES list (excluding correlation references and SQL UDFs) [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/10/22 21:20:34 UTC, 1 replies.
- [PR] [SPARK-55219][SQL] Handle map and array inputs in UDF transpilation [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/10/22 21:26:40 UTC, 0 replies.
- [PR] [MINOR][PS][DOC] Document missing rolling and expanding std, var, skew and kurt APIs [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/10/22 21:34:44 UTC, 3 replies.
- Re: [PR] [SPARK-58793][SQL] Support ANSI SQL `IS [NOT] JSON` predicate [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/10/22 21:50:54 UTC, 3 replies.
- [PR] [SPARK-57266][PYTHON][SQL] Transpile Arrow-optimized and scalar pandas Python UDFs [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/10/22 22:26:23 UTC, 0 replies.
- Re: [PR] [SPARK-60480][K8S] Avoid scanning healthy executor pods in ExecutorPodsLifecycleManager [spark] - posted by "ForVic (via GitHub)" <gi...@apache.org> on 2026/10/22 22:32:09 UTC, 0 replies.
- [PR] [SPARK-60484][SQL] Keep the sign of CAST(string AS INTERVAL SECOND) for values between -1 and 0 [spark] - posted by "ykisana (via GitHub)" <gi...@apache.org> on 2026/10/22 22:33:07 UTC, 0 replies.
- [PR] [WIP][SPARK-60489][SQL] Add a C++ SDK for native data sources over the C ABI [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/10/22 22:41:53 UTC, 1 replies.
- [PR] [WIP][SS] Finish terminating a streaming query when releasing its resources fails [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2026/10/22 23:06:32 UTC, 0 replies.
- [PR] [SPARK-60129][SQL] Do not overwrite existing partitions in InMemoryCatalog.createPartitions with ignoreIfExists [spark] - posted by "sambhav37 (via GitHub)" <gi...@apache.org> on 2026/10/22 23:45:29 UTC, 0 replies.
- Re: [PR] [SPARK-58928][SQL] Fix collation-aware grouping in WindowGroupLimitExec [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/10/22 23:52:59 UTC, 0 replies.
- [PR] [SPARK-60491][MLLIB] Include the shape and the entry positions in `Matrix.hashCode` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/23 00:05:45 UTC, 0 replies.
- [PR] [SPARK-55210][SPARK-59090][PYSPARK][SQL] Transpile numeric type promotion and drop options that fail to resolve [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/10/23 00:08:08 UTC, 0 replies.
- [PR] [SPARK-55209][PYTHON][SQL] Add a Java-code transpilation target for Python UDFs [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/10/23 00:20:15 UTC, 0 replies.
- [PR] [SPARK-60486][SQL] Preserve Python UDF partition filters after V2 pushdown [spark] - posted by "xgbtxy (via GitHub)" <gi...@apache.org> on 2026/10/23 00:28:53 UTC, 2 replies.
- [PR] [SPARK-60492][SQL] Keep Hive incompatible partition columns in `HiveExternalCatalog.(alter|rename)Table` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/23 00:37:39 UTC, 2 replies.
- [PR] [SPARK-60493][SQL] Disallow Hive incompatible partition column types in Hive serde tables [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/23 00:46:57 UTC, 1 replies.
- [PR] [SPARK-60494][CONNECT][SDP] Defer SQL with DataFrame arguments in a pipeline flow to flow analysis [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/23 00:48:24 UTC, 1 replies.
- [PR] [SPARK-60495][CONNECT][SDP] Block `EXECUTE IMMEDIATE`, `CALL`, and `IDENTIFIER` clause commands in the SDP SQL guard [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/23 00:51:42 UTC, 0 replies.
- [PR] [SPARK-60496][CORE] Limit the pipelined resource profile check to group members [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/23 00:56:50 UTC, 0 replies.
- [PR] [SPARK-60497][CORE] Reject a map-stage job that depends on a pipelined shuffle [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/23 01:18:36 UTC, 4 replies.
- [PR] [SPARK-60498][CONNECT][SDP] Block CTE-prefixed DML and multi-insert statements in `spark.sql` of SDP [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/10/23 01:30:32 UTC, 0 replies.
- Re: [PR] [SPARK-57583][SQL] Support lazy dictionary decoding for TIME in the vectorized Parquet reader [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/23 02:08:14 UTC, 1 replies.
- Re: [PR] [SPARK-XXXXX][PYTHON] Standardize PySpark row count mismatch error class to use RESULT_ROWS_MISMATCH [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/23 02:08:19 UTC, 1 replies.
- Re: [I] Spark Streaming (DStream) UI / receiver diagnostics not reliably available after EMR cluster termination [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/23 02:08:23 UTC, 0 replies.
- Re: [PR] [SPARK-57648][SQL] Spread unmatchable left outer join rows across shuffle partitions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/23 02:08:26 UTC, 1 replies.
- [PR] [SPARK-60499][PYTHON] Fix toPandas with Arrow for timestamps outside the datetime64[ns] range on pandas 3 [spark] - posted by "hzmsh (via GitHub)" <gi...@apache.org> on 2026/10/23 02:33:37 UTC, 1 replies.
- Re: [PR] [SPARK-60179][SQL] Treat a cast to STRING as time-zone dependent when the source type contains a nested TIMESTAMP_LTZ [spark] - posted by "hhr293 (via GitHub)" <gi...@apache.org> on 2026/10/23 02:35:17 UTC, 0 replies.
- [PR] [SPARK-58511][SQL][FOLLOWUP] Apply the minRows floor to the adaptive partial aggregation spill check [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/10/23 03:16:48 UTC, 1 replies.