reviews@spark.apache.org, 2026-07

You are viewing a plain text version of this content. The canonical link for it is here.

- Re: [PR] [SPARK-57778][SQL] Handle Oracle JDBC objects that are not selectable as tables [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/01 00:01:23 UTC, 1 replies.
- Re: [PR] [SPARK-57789] Update and bundle `LICENSE-binary` and `licenses-binary` to describe all bundled libraries [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/01 00:04:53 UTC, 3 replies.
- [PR] [SPARK-57794] Exclude 3rd party Maven metadata from shadow jar [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/01 00:16:11 UTC, 3 replies.
- Re: [PR] [SPARK-57779][INFRA] Upgrade GitHub Actions artifact actions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/01 00:35:06 UTC, 1 replies.
- Re: [PR] [SPARK-57512][SQL] Introduce DelegateExpression, a logical-plan wrapper stripped before planning [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/01 00:50:16 UTC, 7 replies.
- Re: [PR] [SPARK-57781][INFRA] Add backport confirmation and show push target branch in merge_spark_pr.py [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/01 01:05:45 UTC, 0 replies.
- Re: [PR] [SPARK-54916][ML] Fix Parquet footer error in DecisionTree test suites by caching RDDs [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/01 01:06:53 UTC, 1 replies.
- Re: [I] DecisionTreeClassifierSuite fails in Spark 4.2.0-preview3 (Scala 2.13) with corrupted Parquet file error [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/01 01:06:55 UTC, 0 replies.
- Re: [PR] [SPARK-56660][SQL] Decompose struct equality into field-level predicates for filter pushdown [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/01 01:14:37 UTC, 0 replies.
- Re: [PR] [SPARK-56504][SQL] Extend join pushdown to accept pushed samples [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/01 01:19:28 UTC, 4 replies.
- Re: [PR] [SPARK-57678][SQL] Add explodeEmbeddedArray JSON option for streaming scans of embedded arrays. [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/01 01:27:54 UTC, 1 replies.
- [PR] [SPARK-57458][SQL][FOLLOWUP] Avoid non-local return in XmlInferSchema.tryParseTimestampNTZ [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/01 01:29:59 UTC, 5 replies.
- [PR] [INFRA] Post a merge summary comment on the PR in merge_spark_pr.py [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/01 01:53:46 UTC, 0 replies.
- Re: [PR] [SPARK-57220][SQL] Extend block-chunked segment-tree window frame to shrinking frames [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/01 02:03:17 UTC, 1 replies.
- Re: [PR] [SPARK-57774][CORE] DriverLogger should not propagate log4j internal exception to caller [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/07/01 02:17:11 UTC, 1 replies.
- [PR] [SPARK-57796] Exclude `org.checkerframework` dependency [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/01 02:36:08 UTC, 3 replies.
- Re: [PR] [SPARK-57792][INFRA][R] Add sparkr docker image to sparkr module [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/01 02:53:36 UTC, 2 replies.
- Re: [PR] [SPARK-57788] Prevent Build CI cancellation between different commits in `main` branch [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/01 02:56:05 UTC, 0 replies.
- Re: [PR] [SPARK-57795][INFRA] Post a merge summary comment on the PR in merge_spark_pr.py [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/01 02:57:22 UTC, 4 replies.
- Re: [PR] [SPARK-57777][SQL][CONNECT] Distinguish explicit collation when rendering string literals to SQL [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/01 03:07:47 UTC, 3 replies.
- Re: [PR] [SPARK-56972][SS][4.2] Persist sink name in V3 commit log via MicroBatchExecution [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/01 03:08:24 UTC, 1 replies.
- Re: [PR] [SPARK-57353][SQL] Fix single-pass resolver crash on GROUPING SETS with HAVING/ORDER BY [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/07/01 03:08:26 UTC, 6 replies.
- [PR] [SPARK-57797][BUILD] Exclude `stax:stax-api` from `hive-exec` dependency [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/01 03:33:19 UTC, 4 replies.
- Re: [PR] [SPARK-57738][CONNECT] Restore fast-fail guard for nanosecond timestamp types in ArrowVectorReader [spark] - posted by "jubins (via GitHub)" <gi...@apache.org> on 2026/07/01 03:35:25 UTC, 2 replies.
- Re: [PR] [SPARK-50593][SQL] SPJ: Support truncate transform via generalized ReducibleFunction API [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/07/01 03:41:11 UTC, 7 replies.
- Re: [PR] [SPARK-57268][SQL] Add Apache Arrow as a native cache format for in-memory Dataset caching [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/07/01 03:41:52 UTC, 24 replies.
- Re: [PR] [SPARK-57741][PYTHON] Add timestamp_nanos to PySpark public API [spark] - posted by "jubins (via GitHub)" <gi...@apache.org> on 2026/07/01 03:42:12 UTC, 3 replies.
- Re: [PR] [SPARK-57742][PYTHON] Add truncation disclaimer to unix_micros docstring [spark] - posted by "jubins (via GitHub)" <gi...@apache.org> on 2026/07/01 03:48:07 UTC, 1 replies.
- Re: [PR] [SPARK-57379][SQL] Block temporary variables in CHECK constraint expressions [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/07/01 03:48:45 UTC, 2 replies.
- Re: [PR] [SPARK-57437][SQL] Infer additional constraints by substituting attribute-to-literal bindings [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/01 03:49:31 UTC, 3 replies.
- [PR] [SPARK-57798] Exclude `net.sf.py4j` dependency [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/01 04:06:05 UTC, 3 replies.
- Re: [PR] [SPARK-57641] Add `variant_insert` expression [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2026/07/01 04:06:19 UTC, 6 replies.
- [PR] [SPARK-57799] Exclude `net.razorvine` dependency [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/01 04:16:54 UTC, 3 replies.
- Re: [PR] [SPARK-57769][SQL] Add a config to use the earliest offset for date_trunc at a DST fall-back overlap [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/07/01 04:26:06 UTC, 5 replies.
- [PR] [SPARK-57801] Upgrade `fabric8` to 7.8.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/01 04:30:54 UTC, 3 replies.
- Re: [PR] [SPARK-54588][SQL] Add time_format function to convert TIME values to formatted string representations [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/07/01 04:49:56 UTC, 9 replies.
- Re: [PR] [SPARK-57773][SQL] Strip leaked internal metadata in DataSourceV2Relation.create while preserving column IDs [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/01 05:12:58 UTC, 1 replies.
- Re: [PR] [SPARK-56660][SQL] Decompose struct equality into field predicates at the data source pushdown layer [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/07/01 05:14:23 UTC, 7 replies.
- Re: [PR] [SPARK-52825][SQL] Recognize aws-advanced-jdbc-wrapper URL prefix in MySQL/PostgresDialect [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/07/01 05:43:14 UTC, 0 replies.
- [PR] [SPARK-57802][SQL] Refactor XML schema inference to refine the type inferred so far [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/01 05:55:16 UTC, 0 replies.
- Re: [PR] [SPARK-57471][SQL] Populate input/output size metrics for JDBC reads and writes [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/07/01 07:01:17 UTC, 6 replies.
- [PR] [SPARK-57803][CORE] Delete the temp file when closeAndRead fails on the fetch-to-disk path [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/01 07:06:37 UTC, 3 replies.
- Re: [PR] [SPARK-57555][FOLLOWUP][SQL] Add escape-hatch conf to keep legacy JDBC TIME-to-timestamp mapping [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/07/01 07:11:09 UTC, 1 replies.
- Re: [PR] [SPARK-57802][SQL] Make XML schema inference incremental, aligning with CSV [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/01 07:24:45 UTC, 4 replies.
- [PR] [SPARK-56615][SQL] Throw overflow errors for ceil and floor [spark] - posted by "ycli12 (via GitHub)" <gi...@apache.org> on 2026/07/01 07:48:49 UTC, 7 replies.
- Re: [PR] [SPARK-57693][BUILD] Simplify `kubernetes-client` deps management by using BOM [spark] - posted by "gillespeiffer-db (via GitHub)" <gi...@apache.org> on 2026/07/01 07:52:27 UTC, 0 replies.
- Re: [PR] [SPARK-57756][SQL] Move SQL UDF default-argument padding to common code [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/07/01 08:53:51 UTC, 1 replies.
- Re: [PR] [SPARK-57557][SQL] Support the TIME data type in quantile aggregates [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/07/01 09:35:47 UTC, 1 replies.
- Re: [PR] [SPARK-57748][SQL] Use a dedicated tree-pattern bit for the TIME to TIMESTAMP cast rewrite in ComputeCurrentTime [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/07/01 09:50:48 UTC, 2 replies.
- Re: [PR] [SPARK-57160][CONNECT] Add Spark Connect protocol support for nanosecond-capable timestamp types and literals [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/07/01 10:19:56 UTC, 2 replies.
- [I] Support Vertex File Format [spark] - posted by "melin (via GitHub)" <gi...@apache.org> on 2026/07/01 10:32:09 UTC, 1 replies.
- Re: [PR] [SPARK-49642][SQL] Remove the ANSI config suggestion in DATETIME_FIELD_OUT_OF_BOUNDS [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/07/01 10:33:04 UTC, 3 replies.
- Re: [PR] [SPARK-57737][SQL] Cache zone offset per task in date_trunc [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/07/01 10:42:45 UTC, 4 replies.
- [PR] [INFRA] Refine the merge summary comment in merge_spark_pr.py [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/01 11:19:40 UTC, 0 replies.
- Re: [PR] [SPARK-57795][INFRA][FOLLOWUP] Refine the merge summary comment in merge_spark_pr.py [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/01 11:27:58 UTC, 4 replies.
- [PR] Revert "[SPARK-57795][INFRA][FOLLOWUP] Refine the merge summary comment in merge_spark_pr.py" [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/01 11:37:49 UTC, 2 replies.
- Re: [PR] [SPARK-54582][SQL] Add Time Type Statistics Collection Support [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/07/01 11:41:25 UTC, 2 replies.
- [PR] [SPARK-49580][CONNECT] Add config to limit concurrent executions [spark] - posted by "psavalle (via GitHub)" <gi...@apache.org> on 2026/07/01 11:50:47 UTC, 0 replies.
- [PR] [SPARK-57806][SQL] Fix coercion of NullTyped expressions [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2026/07/01 13:11:00 UTC, 1 replies.
- Re: [PR] [SPARK-57787][CONNECT] Reuse a persistent local Spark Connect server for faster local startup [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/07/01 14:23:38 UTC, 67 replies.
- Re: [PR] [SPARK-21529][SQL] Improve the error message for unsupported Hive union type [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/07/01 14:36:14 UTC, 5 replies.
- Re: [PR] [SPARK-57467][SCHEDULER] Reuse identical resource profiles when available [spark] - posted by "psavalle (via GitHub)" <gi...@apache.org> on 2026/07/01 14:45:25 UTC, 3 replies.
- [PR] [SPARK-57844] Exclude Hadoop YARN classes from shadow jar [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/01 14:54:19 UTC, 4 replies.
- [PR] [SPARK-57845] Exclude `org.roaringbitmap` dependency [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/01 15:03:32 UTC, 3 replies.
- Re: [PR] [SPARK-57352][SDP] Detect resolved table references in pipeline flow lineage [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/07/01 15:13:46 UTC, 2 replies.
- [PR] [SPARK-57851][SQL] Shuffle-free single-task execution for small queries [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/07/01 15:19:53 UTC, 15 replies.
- [PR] [SPARK-57856] Authenticate `minikube` GitHub API requests to avoid CI rate limit failures [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/01 15:29:47 UTC, 3 replies.
- [PR] [SPARK-57857] Exclude `com.ning` dependency [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/01 15:52:51 UTC, 3 replies.
- [PR] [SPARK-57858][SQL] Emit BIN BY scaled DISTRIBUTE columns as produced attributes [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/07/01 16:20:01 UTC, 1 replies.
- Re: [PR] [SPARK-57491][CORE] Prevent and detect stale push-based shuffle data from duplicate map task attempts [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/01 16:37:24 UTC, 3 replies.
- Re: [PR] [SPARK-57487][SQL] Support distributed map join for medium-sized tables via SQL hint [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/01 16:37:59 UTC, 1 replies.
- [PR] [SPARK-57850][SQL] Return the correct fractional-second scale from EXTRACT(SECOND) on TIME [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/07/01 17:18:27 UTC, 6 replies.
- [PR] [SPARK-57846][SQL] Add the try_make_time function [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/07/01 17:23:26 UTC, 7 replies.
- Re: [PR] [SPARK-57625][SDP][1/2] Manage Auxiliary Table Lifecycle in DatasetManager [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/07/01 17:28:34 UTC, 0 replies.
- [PR] [SPARK-57859] Exclude `kryo` dependency [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/01 17:37:25 UTC, 1 replies.
- [PR] [SPARK-57793][CONNECT] Add PathAwareChannelBuilder for SparkConnect python client [spark] - posted by "hiboyang (via GitHub)" <gi...@apache.org> on 2026/07/01 17:46:35 UTC, 7 replies.
- Re: [PR] [SPARK-57859] Exclude `com.esotericsoftware` dependency [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/01 17:53:38 UTC, 1 replies.
- [PR] [SPARK-57847][SQL] Support the TIME data type in approx_count_distinct_for_intervals [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/07/01 18:05:57 UTC, 0 replies.
- [PR] [SPARK-57810][SQL] Infer nanosecond-precision timestamp types in XML schema inference [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/07/01 18:10:56 UTC, 5 replies.
- Re: [PR] [SPARK-57625][SDP] Manage Auxiliary Table Lifecycle in DatasetManager 1/2 [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/07/01 18:58:57 UTC, 2 replies.
- [PR] [SPARK-57855][SQL] Refactor JDBC value getters into a sealed type for readability [spark] - posted by "Gamal72 (via GitHub)" <gi...@apache.org> on 2026/07/01 19:23:36 UTC, 1 replies.
- [PR] [SPARK-57861][BUILD] Remove `javax.xml.bind:jaxb-api` from `LICENSE-binary` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/01 19:49:08 UTC, 6 replies.
- Re: [PR] [SPARK-55444][SQL] Introduce and Route TimeType to Parquet vectorized read through the Types Framework [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/07/01 19:53:11 UTC, 2 replies.
- [PR] [SPARK-57862][INFRA] Allow create_spark_jira.py to set the issue description [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/07/01 20:01:17 UTC, 0 replies.
- [I] JDK26 support with lates spark 4.2-preview5 [spark] - posted by "andrey-borisov-patrianna (via GitHub)" <gi...@apache.org> on 2026/07/01 20:02:45 UTC, 8 replies.
- [PR] [SPARK-57863][PYTHON] Avoid redundant per-element output conversion in Arrow-optimized Python UDF [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/07/01 20:05:37 UTC, 3 replies.
- [PR] [SPARK-57839][SQL] Support the nanosecond-precision timestamp types in CBO statistics estimation [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/07/01 20:27:05 UTC, 5 replies.
- [PR] [SPARK-57828][SQL] Add vectorized Parquet reader support for nanosecond-precision timestamps [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/07/01 20:32:06 UTC, 10 replies.
- Re: [PR] [SPARK-57681][SQL] Support dynamic table options for UPDATE [spark] - posted by "anuragmantri (via GitHub)" <gi...@apache.org> on 2026/07/01 20:33:32 UTC, 10 replies.
- [PR] [SPARK-57864][PYTHON] Speed up Arrow-optimized Python UDF input conversion for array columns [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/07/01 20:49:25 UTC, 6 replies.
- [PR] [SPARK-57830][SS] Support event-time watermark on nanosecond-precision timestamp columns [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/07/01 21:24:04 UTC, 3 replies.
- Re: [PR] [CONNECT][SDP][SPARK-56249] Create AUTO CDC syntax for SCD Type 1 in SQL [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/07/01 21:36:09 UTC, 3 replies.
- [PR] [SPARK-57867][CORE] Driver should not reserve off-heap memory in non-local mode [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/01 21:45:38 UTC, 7 replies.
- [PR] [SPARK-57809][SQL] Support nanosecond-precision timestamps in collect_list/listagg ordering safety [spark] - posted by "iRakson (via GitHub)" <gi...@apache.org> on 2026/07/01 21:48:16 UTC, 0 replies.
- Re: [PR] [MINOR] Remove branch-4.x "build_main.yml" icon in README [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/01 22:06:36 UTC, 1 replies.
- Re: [PR] [SPARK-57708][INFRA] Install zstd in CI container images used by the branch-4.1 scheduler [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/01 22:26:07 UTC, 1 replies.
- [PR] [SPARK-57869][BUILD] Remove `logging-interceptor` from `LICENSE-binary` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/01 22:33:24 UTC, 4 replies.
- [PR] [SPARK-57680][PYTHON] Remove unused ArrowStreamAggPandasUDFSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/07/01 22:40:55 UTC, 0 replies.
- Re: [PR] [SPARK-57791][4.0][INFRA] Backport CI precompile artifact sharing, Coursier cache unification, and zstd in CI images [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/01 22:42:02 UTC, 2 replies.
- [PR] [SPARK-57860][ML] Add HasIntermediateStorageLevel shared param and apply to KMeans [spark] - posted by "maoli67660 (via GitHub)" <gi...@apache.org> on 2026/07/01 23:35:39 UTC, 1 replies.
- [PR] [SPARK-57871] Exclude Hadoop MapReduce classes from shadow jar [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/02 00:02:54 UTC, 3 replies.
- [PR] [SPARK-57872][INFRA] Pin `lxml==4.9.4` in Dockerfile for PyPy to recover branch-4.1 CI [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/02 00:30:36 UTC, 0 replies.
- [PR] [SPARK-57829][SQL] Support window, session_window and window_time over nanosecond-precision timestamps [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/07/02 00:47:44 UTC, 1 replies.
- Re: [PR] [SPARK-56100][SQL] Fail the query when IN list has no left-hand column or expression in the where clause [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/02 01:02:27 UTC, 1 replies.
- Re: [PR] [SPARK-54833][SQL] Fix Mode sql() to display correct sort direction for WITHIN GROUP [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/02 01:02:31 UTC, 5 replies.
- Re: [PR] [SPARK-57860][ML][PYTHON] Add HasIntermediateStorageLevel shared param and apply to KMeans [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/02 01:33:59 UTC, 3 replies.
- [PR] [SPARK-XXXXX][CORE] Tolerate missing jdk.internal.ref.Cleaner on JDK 26+ [spark] - posted by "krishnamanchikalapudi (via GitHub)" <gi...@apache.org> on 2026/07/02 02:08:34 UTC, 3 replies.
- Re: [PR] [SPARK-57624][SQL] from_xml to variant should honor the parse mode [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/02 03:17:42 UTC, 2 replies.
- [PR] [SPARK-57873][CORE] Support disabling ContextCleaner periodic GC via non-positive interval [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/02 04:16:53 UTC, 3 replies.
- [PR] [SPARK-57874] Exclude Hadoop MapReduce resources from shadow jar [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/02 04:42:55 UTC, 3 replies.
- [PR] [SPARK-57875] Exclude Hadoop `filecache` classes from shadow jar [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/02 05:38:51 UTC, 3 replies.
- Re: [PR] [SPARK-57727][SQL] Fix incorrect query result due to inferAdditionalConstraints incorrectly substituting attributes with non-binary-stable collations [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/07/02 06:42:01 UTC, 3 replies.
- [PR] [SPARK-57877][CORE] DirectByteBuffer cleaner support Java 26 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/07/02 06:59:18 UTC, 4 replies.
- Re: [PR] [SPARK-21529][SQL][4.X] Improve the error message for unsupported Hive union type [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/07/02 08:03:53 UTC, 1 replies.
- [PR] [SPARK-57928][SQL] Collapse redundant Partial+Final aggregate pair when shuffle is skipped [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/07/03 08:05:17 UTC, 4 replies.
- Re: [PR] [SPARK-57889][CORE] Authorize StreamRequest consistently with ChunkFetchRequest in the transport layer [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/07/03 08:24:53 UTC, 3 replies.
- Re: [PR] [SPARK-57882][SQL] Enforce AuthV2 metadata authorization on GetPrimaryKeys and GetCrossReference operations [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/07/03 08:57:19 UTC, 2 replies.
- Re: [PR] [SPARK-57921][CORE] Fix `spark.memory.offHeap.size` error message to require at least 1MiB [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/03 10:11:40 UTC, 4 replies.
- Re: [PR] [SPARK-57920][CORE][SQL][YARN] Use `Files.createTempFile` to create temporary files with owner-only permissions [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/03 10:17:38 UTC, 5 replies.
- Re: [PR] [SPARK-57819][SQL] Support nanosecond-precision timestamps in months_between [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/07/03 10:29:37 UTC, 0 replies.
- [PR] [SPARK-57889][FOLLOWUP][3.5][CORE][TESTS] Use JUnit 4 Assert.assertThrows in OneForOneStreamManagerSuite [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/07/03 10:55:43 UTC, 1 replies.
- Re: [PR] [SPARK-57904][WEBUI] Change default value of `spark.ui.xXssProtection` to `0` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/07/03 12:23:38 UTC, 2 replies.
- [PR] [SPARK-57930][BUILD] Respect MAVEN_MIRROR_URL for Coursier-based Maven plugins in build/mvn [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/03 12:33:53 UTC, 3 replies.
- [I] EXPLAIN COST gives wrong estimated input size when querying via VIEW instead of physical Delta path [spark] - posted by "omarMseddi0 (via GitHub)" <gi...@apache.org> on 2026/07/03 13:23:30 UTC, 0 replies.
- [PR] [SPARK-55444][SQL] Add Framework support for the vectorized lazy-decoding gate for TimeType [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/07/03 14:17:36 UTC, 8 replies.
- Re: [PR] [MINOR][PYTHON][EXAMPLES] Clarify basic SQL example output column [spark] - posted by "Israelobuk (via GitHub)" <gi...@apache.org> on 2026/07/03 14:46:16 UTC, 1 replies.
- Re: [PR] [MINOR][PYTHON][TESTS] Add PySpark session_window behavior test [spark] - posted by "Israelobuk (via GitHub)" <gi...@apache.org> on 2026/07/03 14:50:54 UTC, 1 replies.
- [PR] [SPARK-53504][SQL] Route ORC TIME/nanos support through the Types Framework [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/07/03 14:58:08 UTC, 9 replies.
- [PR] [SPARK-57911][DOCS] Upgrade Sphinx version to 8.2.3 [spark] - posted by "marcuslin123 (via GitHub)" <gi...@apache.org> on 2026/07/03 15:36:23 UTC, 1 replies.
- Re: [PR] [SPARK-57889][CORE][3.5][FOLLOWUP][TESTS] Use JUnit 4 Assert.assertThrows in OneForOneStreamManagerSuite [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/07/03 16:10:46 UTC, 1 replies.
- Re: [PR] [SPARK-57881][SQL] UnionExec outputPartitioning supports KeyedPartitioning [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/07/03 16:33:58 UTC, 7 replies.
- Re: [PR] [SPARK-55444][SQL] Route TimeType Parquet filter pushdown through the Types Framework [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/07/03 16:41:17 UTC, 11 replies.
- Re: [PR] [SPARK-57752][SPARK-57753][SPARK-57754][SQL] Assign names to Hive UDF Java type error conditions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/03 17:14:28 UTC, 1 replies.
- Re: [PR] [SPARK-57625][SDP] Manage Auxiliary Table Lifecycle from `DatasetManager` 2/2 [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/07/03 17:45:03 UTC, 15 replies.
- [PR] [SPARK-57752][SPARK-57753][SPARK-57754][SQL][4.X] Assign names to Hive UDF Java type error conditions [spark] - posted by "michaelmitchell-bit (via GitHub)" <gi...@apache.org> on 2026/07/03 18:15:13 UTC, 3 replies.
- [PR] [SPARK-57931][CORE] Restore worker channel blocking mode after pipelined Python UDF execution [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/07/03 18:22:50 UTC, 3 replies.
- Re: [PR] [SPARK-57843][SS] Support nanosecond-precision event-time in streaming stateful operators [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/07/03 18:38:38 UTC, 2 replies.
- [PR] [SPARK-57393] Build: Clean out old PySpark sdists [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/07/03 19:35:14 UTC, 3 replies.
- [PR] [SPARK-57783][DOCS][R] Document the TIME data type as unsupported in SparkR [spark] - posted by "ApurvaKusum (via GitHub)" <gi...@apache.org> on 2026/07/03 19:44:35 UTC, 5 replies.
- [PR] [SPARK-57932][SQL] Fix regexp_instr and regexp_replace returning wrong results for supplementary characters [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/07/03 22:39:12 UTC, 13 replies.
- Re: [PR] [SPARK-56200][CORE] Remove jackson JSON nesting depth limitation [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/04 00:48:19 UTC, 1 replies.
- Re: [I] AES-GCM for RPC encryption does not work on YARN [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/04 00:48:24 UTC, 0 replies.
- Re: [PR] [SPARK-56015][INFRA][DOCS] Cleanup docs container, remove unused R deps, and fix x86 build. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/04 00:48:26 UTC, 1 replies.
- Re: [PR] [MINOR] Add quotes to fix erroneous pip install command in SDP Prog Guide [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/04 00:48:31 UTC, 2 replies.
- Re: [PR] [SPARK-56181][SQL] Guard against unresolved attributes in constraint inference [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/04 00:48:35 UTC, 1 replies.
- [PR] [WIP][SPARK-57561][SQL] Reject TIME inputs for unsupported datetime functions [spark] - posted by "michaelmitchell-bit (via GitHub)" <gi...@apache.org> on 2026/07/04 01:07:00 UTC, 0 replies.
- Re: [PR] [SPARK-57555][FOLLOWUP][SQL] Add TimeType support to PostgresDialect [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/07/04 06:13:13 UTC, 2 replies.
- [PR] [SPARK-57240][CORE] Avoid unnecessary String conversion in UTF8String.splitSQL [spark] - posted by "adith-os (via GitHub)" <gi...@apache.org> on 2026/07/04 12:57:35 UTC, 0 replies.
- Re: [PR] [SPARK-57561][SQL] Reject TIME inputs for unsupported datetime functions [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/07/04 14:00:53 UTC, 1 replies.
- [PR] [SPARK-57922][SQL] Migrate pipeline-dataset parser guards off _LEGACY_ERROR_TEMP_0035 to named error conditions) [spark] - posted by "Fabian-Schneider01 (via GitHub)" <gi...@apache.org> on 2026/07/04 15:36:33 UTC, 0 replies.
- Re: [PR] [SPARK-57915][SQL][TESTS] Add a TPC-DS whole-stage-codegen size benchmark [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/07/04 16:38:13 UTC, 3 replies.
- Re: [PR] [SPARK-57229][SS][RTM][StreamingShuffle][part4] Add StreamingShuffleWriter + server-side Netty handler [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/07/04 17:30:28 UTC, 15 replies.
- Re: [PR] [SPARK-56907][SQL] Reduce per-value allocation in DELTA_LENGTH_BYTE_ARRAY Parquet vectorized reader [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/07/04 20:17:02 UTC, 2 replies.
- Re: [PR] [SPARK-56897][SQL] Reduce per-value allocations in DELTA_BYTE_ARRAY Parquet decoder [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/07/04 20:17:04 UTC, 6 replies.
- Re: [PR] [SPARK-56227][CORE] Fix GcmTransportCipher to correctly handle multiple messages per channel [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/07/04 22:36:21 UTC, 22 replies.
- [PR] [SPARK-57934] Support opt-in `NetworkPolicy` for operator pod in Helm chart [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/04 23:07:51 UTC, 4 replies.
- Re: [PR] [SPARK-56121][SQL] Use dedicated EmptyRelation node for static PropagateEmptyRelation [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/05 00:52:55 UTC, 1 replies.
- Re: [PR] [SPARK-56057] Fix TLS Memory Leak [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/05 00:52:57 UTC, 1 replies.
- Re: [PR] [SPARK-55559][SQL] Add optional bits parameter to bit_count for Trino compatibility [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/05 00:52:59 UTC, 1 replies.
- [PR] [SPARK-57935][SQL][TESTS] Add `DecimalDivideBenchmark` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/05 02:19:18 UTC, 4 replies.
- [PR] [SQL] Support reading Parquet UUID logical type [spark] - posted by "ravikiranpagidi (via GitHub)" <gi...@apache.org> on 2026/07/05 03:32:28 UTC, 0 replies.
- [PR] [SPARK-57936][BUILD] Upgrade `kubernetes-client` to 7.8.0 and `vertx` to 4.5.28 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/05 04:26:03 UTC, 4 replies.
- Re: [PR] [SPARK-57584][CONNECT] Add Spark Connect gRPC health checks [spark] - posted by "Shekharrajak (via GitHub)" <gi...@apache.org> on 2026/07/05 07:42:04 UTC, 0 replies.
- [PR] [PYTHON][CONNECT] Fix UNSUPPORTED_PIPELINES_DATASET_TYPE error parameter name [spark] - posted by "anxkhn (via GitHub)" <gi...@apache.org> on 2026/07/05 08:45:31 UTC, 1 replies.
- [PR] [SPARK-57937][SQL] Improve decimal division performance by dividing at the result scale [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/05 10:26:46 UTC, 8 replies.
- [PR] #1: Add AI Chat [spark] - posted by "keklik-wq (via GitHub)" <gi...@apache.org> on 2026/07/05 11:15:48 UTC, 1 replies.
- [PR] [SPARK-57818][SQL]Support nanosecond-precision and LTZ timestamps in convert_timezone [spark] - posted by "iRakson (via GitHub)" <gi...@apache.org> on 2026/07/05 11:39:32 UTC, 3 replies.
- Re: [PR] [SPARK-57922][SQL] Migrate pipeline-dataset parser guards off _LEGACY_ERROR_TEMP_0035 to named error conditions [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/05 12:12:05 UTC, 1 replies.
- Re: [PR] [SPARK-57905][SQL] Collapse null-guarded UnsafeRowWriter writes into a single writeNullable call [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/05 12:32:25 UTC, 4 replies.
- Re: [PR] [SPARK-57902][SQL] Emit a ternary for 2-arg Coalesce with a non-nullable pure fallback [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/05 12:35:06 UTC, 6 replies.
- Re: [PR] [SPARK-57884][SQL] Make XML schema inference honor preferDate, consistent with CSV [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/05 12:38:41 UTC, 6 replies.
- Re: [PR] [SPARK-57909][SQL] Extract ColumnarToRow batch-advance machinery into a compiled helper [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/05 12:39:36 UTC, 3 replies.
- [PR] [SPARK-57933][CONNECT] Map Spark Connect client failures to SQLException in the JDBC driver [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/07/05 12:49:17 UTC, 3 replies.
- Re: [PR] [SPARK-57908][SQL] Replace generated fast-hash-map TaskCompletionListener with a close-hook helper [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/05 13:19:34 UTC, 4 replies.
- Re: [PR] [SPARK-57907][SQL] Extract schema-independent fast-hash-map machinery into a shared base class [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/05 13:21:24 UTC, 3 replies.
- [PR] [SPARK-57938][INFRA] Add new `SKIP_` flags to doc build script [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/07/05 14:12:56 UTC, 8 replies.
- [PR] Updating gitignore for .scalafmt.conf [spark] - posted by "0xAJX (via GitHub)" <gi...@apache.org> on 2026/07/05 14:14:39 UTC, 0 replies.
- [PR] [PYTHON][SQL] Fix DataFrame.dropna to raise PySparkValueError on invalid how [spark] - posted by "anxkhn (via GitHub)" <gi...@apache.org> on 2026/07/05 17:43:21 UTC, 1 replies.
- [PR] [SPARK-57848][SQL] Support the TIME data type in approx_top_k [spark] - posted by "iRakson (via GitHub)" <gi...@apache.org> on 2026/07/05 18:57:11 UTC, 6 replies.
- Re: [PR] [SPARK-57543] Make ConfigOption dynamic override opt-in and filter dynamic config refresh [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/05 19:18:36 UTC, 2 replies.
- [PR] [SPARK-57939][SQL][TESTS] Add wide-schema benchmark cases to `UnsafeProjectionBenchmark` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/05 20:47:11 UTC, 5 replies.
- [PR] [DOCS][INFRA] Use GitHub Actions problem matcher to simplify Unidoc log filtering [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/07/05 20:56:47 UTC, 10 replies.
- Re: [PR] [SPARK-57574][PANDAS] Support the TIME data type in pandas API on Spark [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/05 22:14:04 UTC, 1 replies.
- [PR] [SPARK-57940] Enable `readOnlyRootFilesystem` for operator container in Helm chart [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/05 22:17:25 UTC, 4 replies.
- [PR] [SPARK-57942] Replace wildcard RBAC verbs with explicit verb list in Helm chart [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/05 22:20:14 UTC, 4 replies.
- [PR] [SPARK-57941][CONNECT] Expose Spark Connect sessions and operations via REST API [spark] - posted by "venkata91 (via GitHub)" <gi...@apache.org> on 2026/07/05 22:22:29 UTC, 24 replies.
- Re: [PR] [SPARK-57424][SQL] Add First/Last to segment-tree window aggregate allowlist [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/05 22:35:03 UTC, 6 replies.
- [PR] [SPARK-57943] MetricsSystem should not expose sink property values [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/05 22:35:46 UTC, 5 replies.
- [PR] [DO-NOT-MERGE][SPARK-57710][YARN][TESTS][FOLLOWUP] Size YarnClusterSuite mini NodeManager via the yarn.minicluster.* key [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/05 22:40:51 UTC, 1 replies.
- Re: [PR] [SPARK-56147][SQL] Use parser-based SQL splitter in `spark-sql` CLI [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/05 22:41:20 UTC, 6 replies.
- [PR] [SPARK-57944][SQL] Improve fixed-width field write performance in `UnsafeRowWriter` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/05 23:10:34 UTC, 1 replies.
- [PR] [SPARK-57945][K8S] Avoid persisting potentially sensitive Java options to disk in `entrypoint.sh` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/05 23:48:48 UTC, 0 replies.
- [PR] fix: sanitize shell/subprocess call in run-tests.py [spark] - posted by "orbisai0security (via GitHub)" <gi...@apache.org> on 2026/07/06 00:32:10 UTC, 2 replies.
- Re: [PR] [SPARK-52351][SQL] Fix T prefix detection after whitespace trimming in stringToTimestamp [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/06 00:52:56 UTC, 1 replies.
- Re: [PR] [SPARK-56154][SQL] Preserve ENUM logical annotation through Parquet read-write [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/06 00:53:01 UTC, 1 replies.
- Re: [PR] [SPARK-56220][PYTHON] Add utility to check wrongly used errorClass in Python [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/06 00:53:06 UTC, 1 replies.
- Re: [PR] [SPARK-56252][HISTORY] History server disk store lease should remove temp path delete hook after commit and rollback to avoid memory leak [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/06 00:53:10 UTC, 1 replies.
- Re: [PR] [SPARK-57131] Provide configuration option to specify ConfigMap name for dynamic configs [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/06 00:58:24 UTC, 1 replies.
- Re: [PR] [DO-NOT-MERGE][SPARK-57710][YARN][TESTS][FOLLOW-UP] Size YarnClusterSuite mini NodeManager via the yarn.minicluster.* key [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 01:33:32 UTC, 0 replies.
- [PR] [SPARK-57993][SS][TEST] Fix flaky RocksDBStateStoreIntegrationSuite bounded memory usage test by isolating global RocksDBMemoryManager [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 01:42:29 UTC, 4 replies.
- [PR] [DO-NOT-MERGE][SPARK-57947][SS][KAFKA][TESTS] Deflake KafkaSourceStressForDontFailOnDataLossSuite [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 01:43:54 UTC, 0 replies.
- Re: [PR] [SPARK-57710][YARN][TESTS][FOLLOW-UP] Size YarnClusterSuite mini NodeManager via the yarn.minicluster.* key [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 03:14:59 UTC, 3 replies.
- [PR] [SPARK-57948][PYTHON][CORE] Fix pipelined Python UDF data transfer over Unix domain sockets [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 03:15:30 UTC, 2 replies.
- [PR] [SPARK-56642][CORE][FOLLOWUP] Support Unix Domain Socket mode in pipelined Python UDF data transfer [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 03:15:34 UTC, 4 replies.
- Re: [PR] [SPARK-57945][K8S] Avoid persisting Java options to disk in `entrypoint.sh` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/06 03:16:56 UTC, 4 replies.
- [PR] [SPARK-57993][SS][TEST][branch-4.x] Fix flaky RocksDBStateStoreIntegrationSuite bounded memory usage test by isolating global RocksDBMemoryManager [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 03:28:17 UTC, 1 replies.
- [PR] [SPARK-57993][SS][TEST][branch-4.2] Fix flaky RocksDBStateStoreIntegrationSuite bounded memory usage test by isolating global RocksDBMemoryManager [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 03:28:19 UTC, 2 replies.
- [PR] [SPARK-57993][SS][TEST][branch-4.1] Fix flaky RocksDBStateStoreIntegrationSuite bounded memory usage test by isolating global RocksDBMemoryManager [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 03:28:21 UTC, 2 replies.
- Re: [PR] [SPARK-57710][YARN][TESTS] Reduce YarnClusterSuite flakiness from CI runner contention [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 03:30:04 UTC, 0 replies.
- Re: [PR] [SPARK-57650][YARN][TESTS] Allow AMs to use the whole queue in BaseYarnClusterSuite to fix ACCEPTED-state timeouts [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 03:30:08 UTC, 0 replies.
- [PR] [SPARK-57950] Support `spark.redaction.regex` and redact sensitive values in operator logs [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/06 03:33:50 UTC, 3 replies.
- Re: [PR] [SPARK-56972][SS][FOLLOWUP] Reject sink evolution combined with async progress tracking [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/07/06 03:43:01 UTC, 3 replies.
- Re: [PR] [SPARK-57652][SS][TESTS] Deflake snapshotStartBatchId-with-transformWithState StateDataSource test [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 03:43:23 UTC, 0 replies.
- [PR] [SPARK-57949][PYTHON][TESTS] Use shortest temp base for direct-worker UDS path to fix macOS AF_UNIX path too long [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 03:50:41 UTC, 2 replies.
- [PR] [DO-NOT-MERGE][SPARK-XXXXX][CORE][TESTS] Retry retryOnOOM a few times to reduce SorterSuite flaky OOM [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 04:05:51 UTC, 0 replies.
- [PR] [SPARK-57739][SQL] Return NULL for Parquet MIN/MAX aggregate push-down over all-null row groups [spark] - posted by "Aayush7352 (via GitHub)" <gi...@apache.org> on 2026/07/06 04:43:58 UTC, 0 replies.
- [PR] [DO-NOT-MERGE][SPARK-XXXXX][INFRA] Pin lxml==4.9.4 in branch-4.0 pypy-310 image to fix PyPy build [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 05:13:15 UTC, 0 replies.
- [PR] [SPARK-57951][ML][TESTS] Tolerate last-ULP FP differences in MLTest single-prediction checks [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 05:13:24 UTC, 0 replies.
- [PR] [SPARK-57954][INFRA] Install libxslt1-dev in the PyPy 3.10 test image so lxml builds from source [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 05:27:18 UTC, 3 replies.
- Re: [PR] [SPARK-57953][INFRA] Pin lxml==4.9.4 in branch-4.0 pypy-310 image to fix PyPy build [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 05:27:34 UTC, 1 replies.
- [PR] [SPARK-57955][SQL] Raise a proper error for out-of-Int-range data type parameters [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/06 07:10:09 UTC, 3 replies.
- Re: [PR] [SPARK-57614][WEBUI] Use CSP `frame-ancestors` instead of deprecated `X-Frame-Options: ALLOW-FROM` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/07/06 08:08:19 UTC, 3 replies.
- Re: [PR] [SPARK-57947][SS][KAFKA][TESTS] Deflake KafkaSourceStressForDontFailOnDataLossSuite [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 08:24:08 UTC, 1 replies.
- [PR] [SPARK-57957][ML][TESTS] Deflake GaussianMixtureSuite 'GMM support instance weighting' on macOS using well-posed data [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 08:27:09 UTC, 2 replies.
- Re: [PR] [SPARK-57952][CORE][TESTS] Retry retryOnOOM a few times to reduce SorterSuite flaky OOM [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 08:27:46 UTC, 1 replies.
- Re: [PR] [SPARK-57951][ML][TESTS] Tolerate last-ULP FP differences in MLTest single-prediction checks for macOS [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 08:29:54 UTC, 1 replies.
- Re: [PR] [SPARK-57636][SQL] Support REPLACE USING with row-level DSv2 writes [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/07/06 09:00:57 UTC, 20 replies.
- [PR] [SPARK-57958][SQL][TESTS] Close the ORC Reader in OrcSourceSuite to fix leaked file streams [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 09:41:01 UTC, 2 replies.
- [PR] [SPARK-57959][SQL][TESTS] Deflake MetricsFailureInjectionSuite non-deterministic injection test [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 09:43:52 UTC, 2 replies.
- [PR] [SPARK-57960][SQL] Apply escapeSql to table/schema identifiers in JDBC index metadata queries [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/07/06 10:29:21 UTC, 3 replies.
- Re: [PR] [SPARK-38719][SQL] Test the error class: CANNOT_CAST_DATATYPE [spark] - posted by "deepujain (via GitHub)" <gi...@apache.org> on 2026/07/06 10:53:33 UTC, 15 replies.
- Re: [PR] [SPARK-38743][SQL] Test the error class: MISSING_STATIC_PARTITION_COLUMN [spark] - posted by "deepujain (via GitHub)" <gi...@apache.org> on 2026/07/06 10:53:35 UTC, 15 replies.
- [PR] [SPARK-57961][SQL][TESTS] Fix scalastyle line length violations in MetricsFailureInjectionSuite [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 10:55:46 UTC, 0 replies.
- Re: [PR] [SPARK-57961][SQL][FOLLOW-UP][TESTS] Fix scalastyle line length violations in MetricsFailureInjectionSuite [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 10:56:28 UTC, 3 replies.
- Re: [PR] [SPARK-57775][SQL] Return one row for GROUP BY GROUPING SETS (()) over empty input [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/07/06 12:26:14 UTC, 5 replies.
- Re: [PR] [PYTHON] Avoid shell invocation for rm -rf in run-tests.py [spark] - posted by "orbisai0security (via GitHub)" <gi...@apache.org> on 2026/07/06 13:07:40 UTC, 0 replies.
- [PR] [SPARK-57962][PYTHON] Guard against path traversal in install_spark tar extraction [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/07/06 13:26:52 UTC, 16 replies.
- [PR] [SPARK-57963][SS] Restore interrupt status unexpectedly cleared for `StreamExecution.stop` can stop micro-batch streaming query [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/07/06 14:08:18 UTC, 0 replies.
- [PR] [SPARK-57756][SQL][TESTS] Add buildSQLFunctionConf ANSI-invariant tests [spark] - posted by "daniel-lunin-db (via GitHub)" <gi...@apache.org> on 2026/07/06 15:01:27 UTC, 0 replies.
- Re: [PR] [SPARK-56729][SQL] ReplaceData and WriteDelta should implement SupportsNonDeterministicExpression [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2026/07/06 15:21:25 UTC, 2 replies.
- Re: [PR] [SPARK-57421][SQL] Support @-syntax version time travel on table names [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/07/06 16:06:14 UTC, 4 replies.
- Re: [PR] [SPARK-57222][SDP] Implement SCD2 Batch Processor; Decompose affected rows [spark] - posted by "jose-torres (via GitHub)" <gi...@apache.org> on 2026/07/06 16:18:26 UTC, 2 replies.
- Re: [PR] ci: pin GitHub Actions to full commit SHAs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/06 16:18:51 UTC, 1 replies.
- [PR] [CONNECT] Avoid redundant DSv2 table refresh in Spark Connect [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/07/06 16:52:33 UTC, 1 replies.
- [PR] [SPARK-57853][SQL] Use ANSI modulo-24 semantics for TIME +/- INTERVAL [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/07/06 17:50:42 UTC, 2 replies.
- [PR] [SPARK-57966][YARN][DOCS] Update Java 17 support description in `running-on-yarn.md` for Hadoop 3.5.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/06 17:52:49 UTC, 4 replies.
- Re: [PR] [SPARK-57761][SQL] Add missing error class INVALID_XML_SCHEMA_MAP_TYPE [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/07/06 18:10:21 UTC, 6 replies.
- [PR] [SPARK-57967] Upgrade Swift Docker image to 6.3.3 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/06 18:12:12 UTC, 3 replies.
- [PR] [SPARK-57968] Use virtual threads for `SentinelManager` scheduled executor [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/06 18:39:45 UTC, 3 replies.
- [PR] [SPARK-57969] Use virtual thread for periodic GC scheduler [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/06 18:49:08 UTC, 4 replies.
- [PR] [SPARK-57970][BUILD] Upgrade ASM to 9.10.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/06 18:56:15 UTC, 6 replies.
- [PR] [SPARK-57903][PYTHON][TESTS] Add ASV microbenchmark for SQL_TRANSFORM_WITH_STATE_PYTHON_ROW_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/07/06 19:11:39 UTC, 2 replies.
- [PR] [SPARK-57971][K8S][DOCS] Drop K8s v1.34 Support [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/06 19:42:32 UTC, 5 replies.
- Re: [PR] [SPARK-57644][SQL] Support generated column values on V2 table writes [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/07/06 19:46:58 UTC, 1 replies.
- [PR] [SPARK-57973][SQL][TESTS] Drop the unreliable compile-time metric from WholeStageCodegenSizeBenchmark [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/07/06 19:56:44 UTC, 3 replies.
- [PR] [SPARK-57972][SS] Preserve the cause when StreamingPythonRunner initialization fails [spark] - posted by "gnanda (via GitHub)" <gi...@apache.org> on 2026/07/06 19:59:10 UTC, 3 replies.
- [PR] [SPARK-57974][DOCS] Add pandas upper bound `<3.0.0` in `dev/requirements.txt` and `install.rst` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/06 20:18:52 UTC, 0 replies.
- [PR] [SPARK-57747][SQL] Fix translate() to distinguish deletion from literal U+0000 replacement [spark] - posted by "spyrospav (via GitHub)" <gi...@apache.org> on 2026/07/06 20:19:51 UTC, 4 replies.
- Re: [PR] [SPARK-57974][PYTHON][DOCS] Add pandas upper bound `<3.0.0` in `dev/requirements.txt` and `install.rst` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/06 20:21:23 UTC, 4 replies.
- Re: [PR] [SPARK-57872][INFRA][4.0] Pin `lxml==4.9.4` in Dockerfile for PyPy to recover branch-4.0 CI [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/06 21:00:54 UTC, 1 replies.
- [PR] [SPARK-57975][SQL] Add an opt-in lossless Arrow struct representation for nanosecond timestamps [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/07/06 21:03:51 UTC, 3 replies.
- [PR] [SPARK-57976][INFRA][4.0] Fix URL of get-pip.py in dev/infra/Dockerfile for Python 3.9 [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/06 21:49:51 UTC, 3 replies.
- [PR] [SPARK-57868] Requeue after driver not found because of the stale cache [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2026/07/06 22:14:38 UTC, 17 replies.
- [PR] [SPARK-57977][PYTHON] Remove obsolete encoding declarations from Python files [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/06 22:15:59 UTC, 4 replies.
- Re: [PR] [SPARK-57225][SS] Reject write operations on state data sources with clear error [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/07/06 22:20:58 UTC, 7 replies.
- [PR] [SPARK-57978][PYTHON] Use explicit UTF-8 encoding in text-mode I/O to prepare for PEP 686 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/06 22:27:31 UTC, 5 replies.
- Re: [PR] [SPARK-57000][CORE][SS][RTM] Add concurrent scheduling capabilites for Real-time Mode [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/07/06 22:35:05 UTC, 5 replies.
- [PR] [DO-NOT-MERGE][CORE][TESTS] Deflake BarrierTaskContextSuite wall-clock skew assertions on macOS-26 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/06 23:01:47 UTC, 0 replies.
- [PR] [SPARK-57979][SQL] Extract the SortExec metric-recording epilogue into a shared helper [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/07/06 23:20:04 UTC, 4 replies.
- [PR] [SPARK-57980][SQL] Extract the HashAggregateExec hash-map spill machinery into a shared helper [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/07/06 23:20:23 UTC, 3 replies.
- [PR] [SPARK-57981][PYTHON][TESTS] Move packaging test with test-install [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/06 23:23:53 UTC, 3 replies.
- Re: [PR] [SPARK-57394][PYTHON] Refactor SQL_ARROW_TABLE_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/07/06 23:50:31 UTC, 1 replies.
- [PR] [SPARK-57983][INFRA] Add python/docs to doc module [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/06 23:56:58 UTC, 3 replies.
- [PR] [DO-NOT-MERGE][SPARK-57958][SQL] Close ORC schema-inference Reader uninterruptibly to fix leaked file streams [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/07 00:09:54 UTC, 0 replies.
- Re: [PR] [SPARK-57910][ML][PYTHON] Make ALS reuse the shared HasIntermediateStorageLevel param [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/07 00:42:34 UTC, 2 replies.
- Re: [PR] [SPARK-54986][PYSPARK][DOCS] Document return type (DoubleType) for aggregate functions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/07 00:51:29 UTC, 1 replies.
- Re: [I] Feature Request: Add support for qualify clause in SQL [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/07 00:51:32 UTC, 0 replies.
- Re: [PR] [SPARK-57911][DOCS] Upgrade sphinx version to 8.2.3 [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/07 01:04:33 UTC, 2 replies.
- [PR] [SPARK-57984][BUILD] Upgrade `lz4-java` to 1.11.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/07 01:50:28 UTC, 7 replies.
- [PR] [SPARK-57985][BUILD] Upgrade netty-tcnative to 2.0.80.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/07 01:58:09 UTC, 3 replies.
- [PR] [MINOR][PS][DOC] Fix typos in pandas-on-Spark docstrings [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/07 03:23:53 UTC, 2 replies.
- [PR] [SPARK-57987][SQL] Expose modifiedConfigs and node description in SQL REST API [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/07/07 03:38:40 UTC, 9 replies.
- [PR] [SPARK-57986][PS] Align Rolling/Expanding.sem with pandas 3 [spark] - posted by "fangchenli (via GitHub)" <gi...@apache.org> on 2026/07/07 03:40:17 UTC, 3 replies.
- Re: [PR] [SPARK-57525][CONNECT][4.1] Declarative Pipelines should not throw NoSuchElementException when a run fails without an attached cause [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/07 04:17:51 UTC, 2 replies.
- Re: [PR] [SPARK-57664][CONNECT] Make dropped pipeline events observable in PipelineEventSender [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/07 04:20:20 UTC, 2 replies.
- [PR] [SPARK-57989][CONNECT][PYTHON] Raise NOT_IMPLEMENTED for year-month interval in Connect collect, matching Classic's default [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/07 04:22:23 UTC, 2 replies.
- [PR] [SPARK-57990][SQL] Share array-index JSON paths across coalesce [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/07/07 04:57:33 UTC, 5 replies.
- Re: [PR] [SPARK-57562][SQL] Add benchmarks for the TIME data type [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/07/07 05:48:41 UTC, 1 replies.
- Re: [PR] [CORE][TESTS] Deflake BarrierTaskContextSuite wall-clock skew assertions on macOS-26 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/07 05:56:47 UTC, 0 replies.
- [PR] [SPARK-54938][PYTHON][TEST][FOLLOW-UP] Fix inferred time unit for ns Timestamp/Timedelta under pandas 3 [spark] - posted by "fangchenli (via GitHub)" <gi...@apache.org> on 2026/07/07 06:04:07 UTC, 2 replies.
- [PR] [SPARK-54937][PYTHON][TESTS][FOLLOW-UP] Fix pytz-specific tz assertion for pandas 3 zoneinfo [spark] - posted by "fangchenli (via GitHub)" <gi...@apache.org> on 2026/07/07 06:16:31 UTC, 4 replies.
- Re: [PR] [SPARK-57958][FOLLOWUP][SQL] Close ORC schema-inference Reader uninterruptibly to fix leaked file streams [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/07 07:40:41 UTC, 1 replies.
- Re: [PR] [SPARK-57991][CORE][TESTS] Deflake BarrierTaskContextSuite wall-clock skew assertions on macOS-26 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/07 07:46:50 UTC, 1 replies.
- [PR] [SPARK-57992][BUILD] Upgrade sbt to 1.12.13 [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/07/07 08:01:45 UTC, 3 replies.
- [PR] [SPARK-57993][SQL] Support advisory partition size in rebalance hint [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2026/07/07 08:17:07 UTC, 15 replies.
- [PR] [SPARK-57995][BUILD] Upgrade `ammonite` to 3.0.9 [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/07/07 08:24:33 UTC, 0 replies.
- [PR] [SPARK-57994][CORE] Buffer shuffle-migration relocation that races map output registration [spark] - posted by "ChuckLin2025 (via GitHub)" <gi...@apache.org> on 2026/07/07 08:27:12 UTC, 7 replies.
- Re: [PR] [SPARK-57963][SS] Restore interrupt status unexpectedly cleared so that `StreamExecution.stop` can stop micro-batch streaming query [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/07/07 08:28:28 UTC, 3 replies.
- [PR] [PYTHON][TESTS] Fix ts_unit assumption in test_pyarrow_array_type_inference for pandas 3 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/07 08:30:27 UTC, 0 replies.
- [PR] [SPARK-57996][SQL] CoalesceShufflePartitions should coalesce partitioning-aware UnionExec children as a single group [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/07/07 08:31:41 UTC, 6 replies.
- [PR] [DO-NOT-MERGE][SPARK-XXXXX][PS][PYTHON] Support pandas 3 in pandas-on-Spark tests [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/07 08:58:21 UTC, 2 replies.
- [PR] [SPARK-57999][SQL][TESTS] Add generated table of accepted input types for built-in scalar functions [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/07 10:28:12 UTC, 0 replies.
- [PR] [SPARK-57988][SQL] Parenthesize IN and other non-comparison predicate operands of IS [NOT] NULL in V2ExpressionSQLBuilder [spark] - posted by "joelrobin18 (via GitHub)" <gi...@apache.org> on 2026/07/07 12:16:04 UTC, 2 replies.
- [PR] [SPARK-58001] [SQL] Improve `UNSUPPORTED_EXPR_FOR_OPERATOR` error message [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/07/07 13:38:31 UTC, 18 replies.
- [PR] [WIP][SPARK-57813][SQL] Support nanosecond-precision timestamp types as file-source partition columns [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/07/07 15:22:14 UTC, 0 replies.
- [PR] [INFRA] Refresh CI build images on a schedule [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/07/07 15:22:22 UTC, 0 replies.
- [PR] [WIP][SPARK-57831][SQL] Align Hive-metastore compatibility classification for nanosecond-precision timestamp types [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/07/07 15:25:21 UTC, 0 replies.
- Re: [PR] [SPARK-58002][INFRA] Refresh CI build images on a schedule [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/07/07 15:26:18 UTC, 16 replies.
- [PR] [WIP][SPARK-57814][SQL] Support NTZ and nanosecond-precision timestamps in unix_seconds, unix_millis and unix_micros [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/07/07 16:17:31 UTC, 0 replies.
- [PR] [SPARK-58003][SQL] Add physical execution for BIN BY [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/07/07 16:36:07 UTC, 5 replies.
- Re: [PR] [SPARK-56505][SQL][TESTS][FOLLOWUP] Make the classic session in SparkSessionBinderBase an overridable seam [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/07 16:41:35 UTC, 2 replies.
- Re: [PR] [SPARK-55433][INFRA] Remove labeler in GitHub Actions [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/07/07 16:41:43 UTC, 7 replies.
- Re: [PR] [SPARK-57641][SQL] Add `variant_insert` expression [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/07 16:49:48 UTC, 1 replies.
- [PR] [SPARK-58004][SQL] Add hard fan-in bound to AQE shuffle partition coalescing [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/07/07 17:03:16 UTC, 15 replies.
- [PR] [SPARK-58005][SQL] Add an opt-in lossless Arrow struct representation for CalendarInterval [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/07/07 17:07:28 UTC, 6 replies.
- [PR] [SPARK-57586][SQL] Support the ANSI OVERLAPS predicate for datetime periods [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/07/07 17:34:03 UTC, 4 replies.
- Re: [PR] [SPARK-57590][SQL] Read and infer Parquet schema from tar and zip archives [spark] - posted by "akshatshenoi-db (via GitHub)" <gi...@apache.org> on 2026/07/07 17:37:04 UTC, 4 replies.
- [PR] [SPARK-58009][INFRA] Add build/test irrelevant files to `dev_tools` module [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/07 18:26:38 UTC, 3 replies.
- [PR] [SPARK-58006][SQL] Add forceSkipInline flag to CTERelationDef to force CTE materialization in logical planning [spark] - posted by "AveryQi115 (via GitHub)" <gi...@apache.org> on 2026/07/07 18:28:16 UTC, 6 replies.
- Re: [PR] [DO-NOT-MERGE][PS][PYTHON] Support pandas 3 in pandas-on-Spark tests [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/07 19:07:33 UTC, 2 replies.
- Re: [PR] [SPARK-55271][SS] The error originates in KafkaMicroBatchStream.metrics() at line 520, where the code attempts to call .get() on a Scala Option that contains null, then immediately invokes .map() on the null result [spark] - posted by "dipeshmr1 (via GitHub)" <gi...@apache.org> on 2026/07/07 19:12:26 UTC, 0 replies.
- Re: [PR] [SPARK-47017][SQL] Show internal SQL plans for RDDScanExec [spark] - posted by "alexandrefimov (via GitHub)" <gi...@apache.org> on 2026/07/07 19:56:49 UTC, 3 replies.
- [PR] [!DO NOT MERGE!][DOC] Pipelined shuffle dependency & concurrent stage scheduling spec discussion [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/07/07 21:12:26 UTC, 44 replies.
- Re: [PR] [SPARK-57923][SQL][SDP][TESTS] Add CREATE STREAMING TABLE parser test coverage [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/07/07 21:55:44 UTC, 4 replies.
- [PR] [SPARK-58015][INFRA] Move dependency list from requirements.txt to pyproject.toml [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/07 23:04:17 UTC, 15 replies.
- [PR] [SPARK-58016][PYTHON] Revert Arrow-optimized Python UDFs and Arrow-based PySpark IPC by default [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/07/07 23:23:19 UTC, 2 replies.
- [PR] [DO-NOT-MERGE][SPARK-58017][SS][TESTS] Deflake KafkaSourceStressForDontFailOnDataLossSuite [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/07 23:28:40 UTC, 0 replies.
- [PR] [DO-NOT-MERGE][SPARK-58018][SQL][TESTS] Deflake AQE 'should avoid to submit shuffle job on cancellation' test [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/07 23:28:59 UTC, 0 replies.
- Re: [PR] [SPARK-57997][PYTHON][TESTS] Fix ts_unit assumption in test_pyarrow_array_type_inference for pandas 3 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/07 23:31:35 UTC, 4 replies.
- [PR] [DO-NOT-MERGE] Fix flaky FileDataSourceV2FallBackSuite listener race and SparkR Windows silent timeout [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/07 23:37:39 UTC, 0 replies.
- [PR] [DO-NOT-MERGE] Retry Docker image pull in DockerJDBCIntegrationSuite to avoid transient 502 aborts [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/07 23:37:58 UTC, 2 replies.
- [PR] [SPARK-58019][PYTHON] Convert Arrow list columns to Python rows in bulk [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/07/07 23:48:14 UTC, 21 replies.
- Re: [PR] [SPARK-58017][SS][TESTS] Deflake KafkaSourceStressForDontFailOnDataLossSuite [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/07 23:56:52 UTC, 1 replies.
- Re: [PR] [SPARK-58018][SQL][TESTS] Deflake AQE 'should avoid to submit shuffle job on cancellation' test [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/07 23:58:38 UTC, 1 replies.
- [PR] [SPARK-58020][PYTHON][TESTS][4.1] Fix flaky test_data_source_writer_with_logging [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/08 00:12:09 UTC, 2 replies.
- [PR] [SPARK-57852][SQL] Support TIME endpoints in the sequence function [spark] - posted by "vboo123 (via GitHub)" <gi...@apache.org> on 2026/07/08 00:27:33 UTC, 3 replies.
- [PR] [SPARK-58021][CONNECT] Add an opt-in pool of pre-warmed, single-use local Spark Connect servers [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/07/08 00:32:04 UTC, 1 replies.
- [PR] [SPARK-58022][SQL] Remove unused legacy error conditions [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/08 00:35:28 UTC, 4 replies.
- Re: [PR] [SPARK-55076][SQL] Add legacy config for MySQL unsigned TINYINT type … [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/08 00:43:32 UTC, 1 replies.
- Re: [I] Support mapUnsignedTinyIntToShort [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/08 00:43:39 UTC, 0 replies.
- [PR] [SPARK-58023][PYTHON] Fast paths for converting Arrow string, binary, numeric and boolean columns to Python rows [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/07/08 00:45:44 UTC, 2 replies.
- [PR] [SPARK-58024][PYTHON] Convert Arrow struct and map columns to Python rows in bulk [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/07/08 00:46:05 UTC, 8 replies.
- [PR] [DO-NOT-MERGE][SPARK-58025][INFRA] Redirect build/mvn fallback message to stderr to avoid corrupting version captures [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/08 01:33:44 UTC, 0 replies.
- [PR] [DO-NOT-MERGE][SPARK-58026][INFRA] Bound SparkR Windows test step to avoid silent 2h job timeout [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/08 01:40:26 UTC, 0 replies.
- [PR] [SPARK-57965][CONNECT][PYSPARK] Fix UNSUPPORTED_PIPELINES_DATASET_TYPE parameter name mismatch [spark] - posted by "marcuslin123 (via GitHub)" <gi...@apache.org> on 2026/07/08 01:45:29 UTC, 3 replies.
- [I] Exchange reuse fails when a VIEW is referenced in both UNION ALL branches via a CTE [spark] - posted by "boobpoop (via GitHub)" <gi...@apache.org> on 2026/07/08 03:11:16 UTC, 0 replies.
- [PR] [SPARK-58027][SQL] Avoid unnecessary Matcher allocation in getZoneId for region-based zone IDs [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/08 03:50:00 UTC, 11 replies.
- [PR] [SPARK-58028][TESTS] Retry Docker image pull in DockerJDBCIntegrationSuite to avoid transient 502 aborts [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/08 03:59:06 UTC, 4 replies.
- Re: [PR] [SPARK-58025][INFRA] Redirect build/mvn fallback message to stderr to avoid corrupting version captures [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/08 04:11:46 UTC, 1 replies.
- Re: [PR] [SPARK-58026][INFRA] Bound SparkR Windows test step to avoid silent 2h job timeout [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/08 04:17:57 UTC, 1 replies.
- [PR] [SPARK-58029][ML] Backtick the `*` selector in breeze.linalg import for Scala 3 compatibility [spark] - posted by "fangchenli (via GitHub)" <gi...@apache.org> on 2026/07/08 05:08:25 UTC, 2 replies.
- [I] Spark Streaming (DStream) UI / receiver diagnostics not reliably available after EMR cluster termination [spark] - posted by "AnishaKondaTR (via GitHub)" <gi...@apache.org> on 2026/07/08 05:38:49 UTC, 3 replies.
- Re: [PR] [SPARK-58030][SQL][TESTS] Make FileDataSourceV2FallBackSuite robust to extra listener events [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/08 05:55:52 UTC, 1 replies.
- Re: [PR] [SPARK-57995][BUILD] Upgrade `ammonite` to 3.0.9 and `semanticdb-shared` to 4.15.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/08 06:11:14 UTC, 2 replies.
- Re: [PR] [SPARK-57688][SQL] Add spark.sql.execution.bypassPartialAggregation to skip partial agg [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/07/08 06:13:10 UTC, 1 replies.
- [PR] [SPARK-58031][BUILD][DOCS] Update `docs/_config.yml` version to 5.0.0-SNAPSHOT [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/08 06:29:54 UTC, 4 replies.
- [PR] [SPARK-58032][BUILD][DOCS][4.x] Update `docs/_config.yml` version to 4.3.0-SNAPSHOT [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/08 06:34:32 UTC, 5 replies.
- [PR] [SPARK-58033][PYTHON][DOCS] Fix `py4j` version requirement in PySpark installation guide [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/08 06:41:22 UTC, 5 replies.
- [PR] [SPARK-58034][DOCS] Fix `Connect Overview` doc to use `site.SPARK_VERSION` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/08 06:54:57 UTC, 3 replies.
- Re: [PR] [SPARK-57056][SQL] Add `SupportsBranching` DSv2 interface and branching DDL [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/07/08 07:10:10 UTC, 1 replies.
- Re: [PR] [SPARK-57057][SQL] Target a specific branch on SELECT / INSERT via temporal clause and session config [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/07/08 07:10:43 UTC, 1 replies.
- [PR] [PYTHON][BENCHMARKS] Add Arrow Python UDF type benchmarks [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/07/08 08:14:17 UTC, 0 replies.
- Re: [PR] [DO-NOT-MERGE][SQL][PYTHON][DOCS] Document accepted input types for built-in functions, backed by a generated test [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/08 09:41:35 UTC, 0 replies.
- Re: [PR] [SPARK-57813][SQL] Support nanosecond-precision timestamp types as file-source partition columns [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/07/08 10:42:23 UTC, 2 replies.
- Re: [PR] [SPARK-57831][SQL] Align Hive-metastore compatibility classification for nanosecond-precision timestamp types [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/07/08 11:45:44 UTC, 2 replies.
- Re: [PR] [SPARK-57616][SQL] Extend SupportsCatalogOptions to allow migration from DSv1 file based data source [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2026/07/08 11:59:27 UTC, 1 replies.
- [PR] [SPARK-57849][SQL] Support the TIME data type in DataFrame approxQuantile, summary and describe [spark] - posted by "iRakson (via GitHub)" <gi...@apache.org> on 2026/07/08 13:12:35 UTC, 2 replies.
- [PR] Add `try_variant_set` expression [spark] - posted by "bojana-db (via GitHub)" <gi...@apache.org> on 2026/07/08 13:18:54 UTC, 1 replies.
- [PR] [SPARK-57775][SQL][FOLLOWUP] Document the grand-total behavior change in the migration guide [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/08 14:14:08 UTC, 3 replies.
- [PR] [SPARK-58037] [PYTHON] [TESTS] Add DataFrame API golden file test framework for PySpark [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/07/08 14:37:42 UTC, 7 replies.
- [I] Spark Connect server retains high JVM memory and many session-state objects after client jobs complete [spark] - posted by "kkondamadugula (via GitHub)" <gi...@apache.org> on 2026/07/08 15:13:38 UTC, 0 replies.
- [PR] [SPARK-58038][DOCS] Fix to use Hadoop 3.5 in PySpark installation guide and Spark Connect overview [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/08 16:33:17 UTC, 3 replies.
- Re: [I] [SQL] Ceiling and floor do not throw on overflow [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/07/08 16:34:08 UTC, 2 replies.
- [PR] [SPARK-58039] Upgrade `Netty` to 4.2.16.Final [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/08 16:39:55 UTC, 3 replies.
- Re: [PR] [SQL] Throw overflow errors for ceil and floor [spark] - posted by "ycli12 (via GitHub)" <gi...@apache.org> on 2026/07/08 16:47:15 UTC, 8 replies.
- [PR] Add variant_set expression [spark] - posted by "bojana-db (via GitHub)" <gi...@apache.org> on 2026/07/08 16:50:38 UTC, 0 replies.
- [PR] [SPARK-58041][BUILD] Upgrade Netty to 4.2.16.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/08 16:51:18 UTC, 6 replies.
- [PR] [SPARK-58004][SQL][FOLLOWUP] Preserve AQE fan-in bound through local shuffle reads [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/07/08 17:29:28 UTC, 2 replies.
- Re: [I] Spark Connect server retains high JVM memory and leading to restarts causing jobs to fail [spark] - posted by "cschanhniem (via GitHub)" <gi...@apache.org> on 2026/07/08 17:36:02 UTC, 0 replies.
- [PR] [SPARK-58043][SQL] Use explicit `.apply` instead of a case class companion as a function for Scala 3 compatibility [spark] - posted by "fangchenli (via GitHub)" <gi...@apache.org> on 2026/07/08 17:46:24 UTC, 8 replies.
- [PR] [SPARK-58042][CONNECT] Validate the UDT jvm_class is a UserDefinedType before instantiating it [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/07/08 17:56:41 UTC, 7 replies.
- [PR] [SPARK-58045][INFRA] Verify the linked JIRA matches the PR in merge_spark_pr.py [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/07/08 18:08:35 UTC, 6 replies.
- [PR] [SPARK-58046][DOCS] Fix the required NumPy version to 1.23.2 in MLlib guide [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/08 18:10:53 UTC, 5 replies.
- [PR] [SPARK-58047][DOCS] Fix the required NumPy version to 1.21 in MLlib guide [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/08 18:19:48 UTC, 0 replies.
- Re: [PR] [SPARK-58047][DOCS][4.2] Fix the required NumPy version to 1.21 in MLlib guide [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/08 18:20:58 UTC, 6 replies.
- [PR] [SPARK-57775][SQL][4.2] Return one row for GROUP BY GROUPING SETS (()) over empty input [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/08 18:25:56 UTC, 9 replies.
- [PR] [SPARK-58048] Add `Swift 6.4` build test CI [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/08 19:23:14 UTC, 3 replies.
- [PR] [SPARK-57964][PYSPARK] Fix DataFrame.dropna VALUE_NOT_ANY_OR_ALL parameter name mismatch [spark] - posted by "marcuslin123 (via GitHub)" <gi...@apache.org> on 2026/07/08 19:30:30 UTC, 4 replies.
- [PR] [CONNECT] Default refreshPhaseEnabled from spark.api.mode [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/07/08 19:38:37 UTC, 0 replies.
- [PR] [SPARK-58050][PYTHON] Fuse per-row converters into bulk Arrow conversion for Arrow Python UDFs [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/07/08 19:49:33 UTC, 1 replies.
- [PR] [SPARK-58049][CODE] Limit the request body size of the Master REST submission server [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/08 19:52:01 UTC, 7 replies.
- Re: [PR] [SPARK-58040][SQL] Throw overflow errors for ceil and floor [spark] - posted by "ycli12 (via GitHub)" <gi...@apache.org> on 2026/07/08 20:03:16 UTC, 0 replies.
- [PR] [SPARK-57775][SQL][FOLLOWUP] Fix the grand-total behavior change version to Spark 4.2+ [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/08 20:04:34 UTC, 3 replies.
- Re: [PR] [WIP][SPARK-58012][SQL][CONNECT] Support @-syntax timestamp time travel on table names [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/07/08 20:06:31 UTC, 0 replies.
- [PR] [SPARK-58051] Replace release-stripped asserts with runtime validation [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/08 20:18:14 UTC, 3 replies.
- Re: [PR] [SPARK-58035] Add `try_variant_insert` expression [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2026/07/08 20:55:42 UTC, 3 replies.
- Re: [PR] [SPARK-58052][SQL] Throw overflow errors for ceil and floor in ANSI mode [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/07/08 21:00:58 UTC, 6 replies.
- [PR] [SPARK-57890][CORE] Add core credential types (UserContext, ServiceCredential, UserCredentials) [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/07/08 21:02:36 UTC, 12 replies.
- [PR] [SPARK-58053][DOCS] Update building-spark.md to require Hadoop 3.4.0 or later [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/08 21:13:05 UTC, 3 replies.
- [PR] implement column list and refactor replace where into insertintostate… [spark] - posted by "leonwind (via GitHub)" <gi...@apache.org> on 2026/07/08 21:50:17 UTC, 1 replies.
- [PR] [SPARK-58040][SQL] Extract a MathUtils.doubleToLong helper to simplify Ceil/Floor overflow codegen [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/07/08 22:34:45 UTC, 5 replies.
- Re: [PR] [SPARK-57230][SS][RTM][StreamingShuffle][part5] Add StreamingShuffleReader + client-side Netty handler [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2026/07/08 22:35:54 UTC, 4 replies.
- [PR] [SPARK-58054][CORE] Enable spark.ui.contentSecurityPolicy.enabled by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/08 22:59:03 UTC, 1 replies.
- Re: [PR] [SPARK-58054][CORE] Enable `spark.ui.contentSecurityPolicy.enabled` by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/08 23:03:33 UTC, 3 replies.
- Re: [PR] [SPARK-58050][PYTHON] Bulk-assemble Arrow Python UDF results [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/07/08 23:24:49 UTC, 3 replies.
- [PR] [DO-NOT-MERGE][CONNECT] Don't drop streaming listener events on a transient send failure [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/08 23:32:54 UTC, 0 replies.
- [PR] [DO-NOT-MERGE][K8S][TESTS] Make VolumeSuite OnDemand PVC test robust to slow container startup [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/08 23:50:49 UTC, 0 replies.
- [PR] [SPARK-57787][CONNECT] Reuse a persistent local Spark Connect server managed by sbin/start-connect-server.sh [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/07/08 23:52:26 UTC, 2 replies.
- [PR] [DO-NOT-MERGE][PYTHON][TESTS] Fix flaky test_data_source_writer_with_logging on branch-4.1 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/09 00:03:35 UTC, 6 replies.
- Re: [PR] [SPARK-58055][CONNECT] Don't drop streaming listener events on a transient send failure [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/09 00:47:40 UTC, 0 replies.
- Re: [PR] [SPARK-55278][CONNECT][SQL] Add language-agnostic UDF IPC protocol (Phase 1: protocol definition + Arrow serde) [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/09 00:47:54 UTC, 1 replies.
- Re: [PR] [SPARK-54986][DOCS] Document return types for aggregate functions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/09 00:47:57 UTC, 1 replies.
- Re: [I] Spark CBO considers columnar operator by generic interface [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/09 00:48:00 UTC, 0 replies.
- Re: [PR] [SPARK-58053][DOCS] Update `building-spark.md` to require Hadoop 3.4.0 or later [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/09 01:46:43 UTC, 6 replies.
- [PR] initial autocdc type1 docs [spark] - posted by "suhuruli (via GitHub)" <gi...@apache.org> on 2026/07/09 02:31:59 UTC, 1 replies.
- [PR] [SPARK-38632][CORE] Use `FileUtil.unTar` for `.tar` files at `Utils.unpack` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/09 02:41:59 UTC, 4 replies.
- [PR] [SPARK-58056][CORE] Improve `NettyStreamManager` to serve only files under the registered directory [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/09 03:22:16 UTC, 5 replies.
- [PR] [SPARK-32750][SQL] Support whole-stage codegen for SortAggregate with grouping keys [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/07/09 03:30:48 UTC, 15 replies.
- Re: [PR] [SPARK-57999][SQL][PYTHON][DOCS] Document accepted input and return types for built-in functions [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/09 04:30:58 UTC, 23 replies.
- Re: [PR] [SPARK-57760][SS] Make small optimizations to StatefulProcessorApiClient [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/07/09 04:34:42 UTC, 2 replies.
- Re: [PR] [SPARK-58057][K8S][TESTS] Make VolumeSuite OnDemand PVC test robust to slow container startup [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/09 04:44:11 UTC, 1 replies.
- [PR] [INFRA] Document Python test base classes in AGENTS.md [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/09 04:59:48 UTC, 2 replies.
- Re: [PR] [SPARK-57784][SQL] Support the TIME data type in cost-based optimizer statistics estimation [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/07/09 06:04:39 UTC, 1 replies.
- Re: [PR] [SPARK-57640] Implement gRPC WorkerSession and test it against an echo server. [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/07/09 06:26:09 UTC, 15 replies.
- [PR] [SPARK-58058][PYTHON][TESTS] Split slow PySpark test suites into smaller modules [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/09 07:24:27 UTC, 3 replies.
- Re: [PR] [SPARK-57205][SQL] Add SupportsScanMerging to merge equivalent V2 file scans [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/09 07:31:17 UTC, 2 replies.
- Re: [PR] [DO-NOT-MERGE][SPARK-58058][PYTHON][TESTS] Split slow PySpark test suites into smaller modules [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/09 09:28:25 UTC, 2 replies.
- [I] Publish an API spec for the CRDs [spark-kubernetes-operator] - posted by "q-yusufmahtab (via GitHub)" <gi...@apache.org> on 2026/07/09 10:00:00 UTC, 3 replies.
- [PR] Add `variant_array_append` expression [spark] - posted by "bojana-db (via GitHub)" <gi...@apache.org> on 2026/07/09 12:54:38 UTC, 0 replies.
- [PR] [SPARK-58063][SQL] Add column pruning for BIN BY [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/07/09 13:20:59 UTC, 3 replies.
- [PR] [DO-NOT-MERGE][SS][PYTHON] Avoid eagerly importing numpy in StatefulProcessorApiClient [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/09 13:24:50 UTC, 1 replies.
- [PR] [SPARK-58064][SQL] Push deterministic filters through BIN BY [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/07/09 13:27:52 UTC, 0 replies.
- [PR] [DO-NOT-MERGE] Do not import numpy at 'import pyspark' time in stateful_processor_api_client [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/09 13:28:17 UTC, 1 replies.
- Re: [PR] [SPARK-56367][SS][PYTHON][DOCS] Fix latestOffset docstring, update tutorial signature, and add Trigger.AvailableNow documentation [spark] - posted by "brijrajk (via GitHub)" <gi...@apache.org> on 2026/07/09 14:14:13 UTC, 0 replies.
- Re: [PR] [SPARK-43847][PYTHON] Throw structured error when reading Protobuf descriptor file fails [spark] - posted by "brijrajk (via GitHub)" <gi...@apache.org> on 2026/07/09 14:14:23 UTC, 0 replies.
- Re: [PR] [SPARK-40437][SS][PYTHON] Support string representation of durationMs in GroupState.setTimeoutDuration [spark] - posted by "brijrajk (via GitHub)" <gi...@apache.org> on 2026/07/09 14:14:46 UTC, 0 replies.
- Re: [PR] [SPARK-58049][CORE] Limit the request body size of the Master REST submission server [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/09 15:00:50 UTC, 1 replies.
- [PR] [SPARK-58008][SQL] Support dynamic table options for DELETE [spark] - posted by "brijrajk (via GitHub)" <gi...@apache.org> on 2026/07/09 15:19:33 UTC, 25 replies.
- [PR] [SPARK-58066][SQL] Hoist streamed-side predicates in outer/anti/existence joins [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/07/09 15:41:26 UTC, 4 replies.
- [PR] [SPARK-57760][SS][PYTHON][FOLLOWUP] Avoid importing numpy at module level in stateful_processor_api_client [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/07/09 17:02:19 UTC, 11 replies.
- Re: [PR] [SPARK-56596][SQL] Enable dual runs for single-pass analyzer [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/07/09 18:08:09 UTC, 8 replies.
- Re: [PR] [SPARK-58064][SQL] Add filter pushdown for BIN BY [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/09 19:00:38 UTC, 3 replies.
- [PR] [SPARK-58068][PYTHON][TESTS] Move test_import_spark to pyspark_install module [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/09 19:55:32 UTC, 0 replies.
- Re: [PR] [SPARK-57223][SQL] INCOMPATIBLE_DATA_FOR_TABLE errors mis-quote a column/field name that contains a dot [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/07/09 20:08:13 UTC, 2 replies.
- [PR] [MINOR][UI] Encode query parameters when generating log page scripts [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/07/09 20:13:46 UTC, 6 replies.
- [PR] [BACKPORT][MINOR][UI] Encode query parameters when generating log page scripts [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/07/09 20:18:48 UTC, 10 replies.
- Re: [PR] [SPARK-58068][PYTHON][TESTS] Move `test_import_spark` to `pyspark_install` module [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/09 20:51:48 UTC, 5 replies.
- [PR] [SPARK-58067][PYTHON][TESTS] Add ASV microbenchmark for SQL_TRANSFORM_WITH_STATE_PYTHON_ROW_INIT_STATE_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/07/09 20:57:03 UTC, 2 replies.
- Re: [PR] [SPARK-57594][SDP] Add spark_confs support to create_auto_cdc_flow [spark] - posted by "trisjain-db (via GitHub)" <gi...@apache.org> on 2026/07/09 20:57:05 UTC, 0 replies.
- [PR] [SPARK-58070][INFRA] Remove curl -v flag from Nexus staging REST calls in `release-build.sh` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/09 21:24:20 UTC, 3 replies.
- [PR] [SPARK-58071][SS][PYTHON] Do not import numpy at 'import pyspark' time in stateful_processor_api_client [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/09 21:50:46 UTC, 3 replies.
- [PR] [SPARK-58073][SS][PYTHON] Avoid eagerly importing numpy in StatefulProcessorApiClient [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/09 21:51:41 UTC, 0 replies.
- Re: [PR] [SPARK-58072][SS][PYTHON] Avoid eagerly importing numpy in StatefulProcessorApiClient [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/09 22:07:22 UTC, 0 replies.
- [PR] [SPARK-58074][INFRA] Mask `PYPI_API_TOKEN` in dry-run mode of `release.yml` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/09 22:15:16 UTC, 3 replies.
- [PR] [SPARK-58075][INFRA] Add `--rm` to docker run in `do-release-docker.sh` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/09 22:32:02 UTC, 3 replies.
- [PR] [WIP][SPARK-XXXXX][SQL][TESTS] Remove --ONLY_IF spark from subquery SQL tests to enable PostgreSQL cross-DBMS testing [spark] - posted by "andylam-db (via GitHub)" <gi...@apache.org> on 2026/07/09 22:46:54 UTC, 0 replies.
- [PR] [SPARK-57760][SS][PYTHON][FOLLOWUP] Fix mypy union-attr error in _normalize_state_value [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/07/09 22:52:58 UTC, 4 replies.
- [PR] [SPARK-58077][INFRA] Add `--no-auth-cache` to svn ci/rm commands in `release-build.sh` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/09 22:59:24 UTC, 3 replies.
- [PR] [SPARK-58079][INFRA] Create credential files securely and remove `~/.msmtprc` after use in `release-build.sh` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/09 23:04:58 UTC, 3 replies.
- [PR] [SPARK-57402][SDP] Register AUTO CDC SQL syntax with the dataflow graph [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/07/09 23:38:29 UTC, 0 replies.
- [PR] [SPARK-58069][SQL] approx_top_k returns incorrect/garbage sort-key bytes instead of actual values for collated strings [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/07/09 23:40:43 UTC, 0 replies.
- Re: [PR] [SPARK-57091][SQL] Add BroadcastNearestByJoinExec to avoid cross-product materialization [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/07/10 00:19:12 UTC, 12 replies.
- Re: [PR] [SPARK-58081][INFRA] Document Python test base classes in AGENTS.md [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/10 00:29:57 UTC, 2 replies.
- Re: [PR] [SPARK-57518][SQL] Make ThriftServer JDBC metadata operations DataSource V2 catalog-aware [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/07/10 00:33:15 UTC, 12 replies.
- Re: [I] Ubuntu 25.10 - access denied to /tmp even in 777 mode without protected mode [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/10 00:47:59 UTC, 0 replies.
- Re: [PR] [SPARK-43413][SQL] Support QUALIFY clause [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/10 00:48:00 UTC, 1 replies.
- Re: [I] [DOCS] Document return types for aggregate functions (stddev, variance, etc.) [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/10 00:48:02 UTC, 0 replies.
- [PR] [SPARK-58082][SQL] Add DSv2 relation and row-level command tree patterns [spark] - posted by "yyanyy (via GitHub)" <gi...@apache.org> on 2026/07/10 01:44:51 UTC, 3 replies.
- Re: [PR] [SPARK-58012][SQL][CONNECT] Support @-syntax timestamp time travel on table names [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/07/10 03:12:09 UTC, 3 replies.
- Re: [PR] [SPARK-58045][INFRA] Verify the linked JIRA matches the PR in `merge_spark_pr.py` [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/07/10 03:13:06 UTC, 2 replies.
- [PR] [WIP][SPARK-58078][CORE] Add PipelinedShuffleDependency [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/07/10 04:50:05 UTC, 0 replies.
- [PR] [SPARK-58083][INFRA] Pass PyPI token to twine via environment variable in `release-build.sh` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/10 05:19:51 UTC, 3 replies.
- [PR] [SPARK-58084][SQL] Support converting sort merge join to shuffled hash join in AQE physical plan [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/07/10 05:39:04 UTC, 21 replies.
- [PR] [MINOR][DOCS] Fix typos in comments and docstrings across multiple files [spark] - posted by "csj4032 (via GitHub)" <gi...@apache.org> on 2026/07/10 07:35:02 UTC, 1 replies.
- [PR] [SPARK-58085][SQL][DOCS] Document accepted input types for built-in functions in the SQL function reference [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/10 07:48:32 UTC, 4 replies.
- [PR] [SPARK-58086][SQL][DOCS] Document accepted input and return types in the Scala functions API [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/10 07:48:49 UTC, 3 replies.
- [PR] [SPARK-58087][PYTHON][DOCS] Document accepted input and return types in the PySpark functions API [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/10 07:48:58 UTC, 9 replies.
- Re: [PR] [SPARK-57804][SQL] Add `variant_set` expression [spark] - posted by "bojana-db (via GitHub)" <gi...@apache.org> on 2026/07/10 12:03:10 UTC, 6 replies.
- [PR] [SPARK-56227][4.0][CORE] Fix GcmTransportCipher to correctly handle multiple messages per channel [spark] - posted by "aajisaka (via GitHub)" <gi...@apache.org> on 2026/07/10 14:41:20 UTC, 3 replies.
- Re: [PR] [SPARK-46179 FOLLOW UP][TESTS] Remove --ONLY_IF spark from subquery SQL tests to enable PostgreSQL cross-DBMS testing [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/10 15:34:14 UTC, 3 replies.
- Re: [PR] [SPARK-58063][SQL] Test that BIN BY is column-pruned by the generic ColumnPruning fallback [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/07/10 16:18:38 UTC, 2 replies.
- [PR] [SPARK-58088][INFRA] Extract checkout-and-sync pattern into composite GitHub Action [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/07/10 17:02:51 UTC, 5 replies.
- [PR] [SPARK-58080][PYTHON][TESTS] Add ASV microbenchmark for SQL_GROUPED_MAP_PANDAS_UDF_WITH_STATE [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/07/10 17:39:39 UTC, 3 replies.
- Re: [PR] [MINOR][UI][4.2] Encode query parameters when generating log page scripts [spark] - posted by "huaxingao (via GitHub)" <gi...@apache.org> on 2026/07/10 20:00:59 UTC, 1 replies.
- [PR] [SPARK-58090] Add `doc.crds.dev` link to Spark custom resources documentation [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/10 20:21:25 UTC, 3 replies.
- [PR] [SPARK-58089][SQL] Push variant extractions through Aggregate/Sort/Join [spark] - posted by "qlong (via GitHub)" <gi...@apache.org> on 2026/07/10 20:49:07 UTC, 8 replies.
- [PR] [SPARK-58091] Upgrade `swift-system` to 1.7.4 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/10 20:51:51 UTC, 3 replies.
- [PR] [SPARK-57891][CORE] Add CredentialProvider SPI and ServiceLoader discovery [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/07/10 21:31:18 UTC, 15 replies.
- Re: [PR] [SPARK-46179][SQL][FOLLOW UP][TESTS] Remove --ONLY_IF spark from subquery SQL tests to enable PostgreSQL cross-DBMS testing [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/07/10 22:37:37 UTC, 2 replies.
- Re: [PR] [SPARK-58061][SQL] Add `variant_array_append` expression [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2026/07/10 23:58:47 UTC, 4 replies.
- [PR] [SPARK-57322][SDP] Implement SCD2 Batch Processor; Reconcile StartAt/EndAt [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/07/11 00:10:16 UTC, 30 replies.
- Re: [PR] [SPARK-55888][K8S] Parallel pod creation for Kubernetes executor allocation [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/11 00:41:42 UTC, 1 replies.
- Re: [PR] [SPARK-57402][SQL][SDP] Register AUTO CDC SQL syntax with the dataflow graph [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/07/11 01:22:04 UTC, 10 replies.
- [PR] [SPARK-58036][SQL] Delegate missing methods in AggregatedDialect to underlying dialects [spark] - posted by "marcuslin123 (via GitHub)" <gi...@apache.org> on 2026/07/11 03:36:24 UTC, 0 replies.
- [PR] [SPARK-58093][SQL] Add ASOF JOIN SQL syntax with MATCH_CONDITION [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/07/11 05:02:04 UTC, 6 replies.
- Re: [PR] [SPARK-56227][3.5][CORE] Fix GcmTransportCipher to correctly handle multiple messages per channel [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/07/11 05:04:54 UTC, 2 replies.
- [PR] Log page encode 4.0 [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/07/11 05:13:02 UTC, 0 replies.
- [PR] Spark 57555 mysql time dialect [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/07/11 06:31:01 UTC, 0 replies.
- [PR] [MINOR][PYTHON][DOCS] Add example to Column.outer docstring [spark] - posted by "CynicDog (via GitHub)" <gi...@apache.org> on 2026/07/11 12:01:00 UTC, 5 replies.
- [PR] [SPARK-58093][SQL] Push down LIMIT through UNION ALL to Data Source V2 scan [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/07/11 14:10:03 UTC, 2 replies.
- Re: [PR] [SPARK-57393][BUILD][FOLLOWUP] Clean out old PySpark sdists [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/07/11 15:18:46 UTC, 3 replies.
- [PR] [WIP][SPARK-XXXXX][SHUFFLE] Wire streaming shuffles into the StreamingShuffleOutputTracker lifecycle [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/07/11 18:04:12 UTC, 1 replies.
- [PR] [SPARK-58094][ Connect] Blocking RPCs hang forever when the connection dies mid-wait [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/07/11 18:12:42 UTC, 13 replies.
- [PR] [SPARK-XXXXX][PYTHON] Standardize PySpark row count mismatch error class to use RESULT_ROWS_MISMATCH [spark] - posted by "Alwaysgaurav1 (via GitHub)" <gi...@apache.org> on 2026/07/11 18:21:15 UTC, 4 replies.
- [PR] [MINOR][DOC] Fix to use Hive 4.1 on Hadoop 3,5 in PySpark installation guide [spark] - posted by "art000109 (via GitHub)" <gi...@apache.org> on 2026/07/11 21:17:46 UTC, 0 replies.
- [PR] [SPARK-57870][ML][PYTHON] Apply HasIntermediateStorageLevel to tree ensemble estimators (GBT, RandomForest) [spark] - posted by "maoli67660 (via GitHub)" <gi...@apache.org> on 2026/07/12 00:24:41 UTC, 5 replies.
- Re: [PR] [SPARK-54978][CORE] Change log level to waring in UnifiedMemoryManager [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/12 00:46:28 UTC, 1 replies.
- Re: [PR] [SPARK-54888][SQL] Allow non determinism in VALUES [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/12 00:46:30 UTC, 1 replies.
- Re: [PR] [SPARK-54775][Core] Add logging for the execution steps of Spark shutdown hooks [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/12 00:46:32 UTC, 1 replies.
- [PR] [MINOR][SPARK-3.5] Upgrade to Ivy 2.5.3 [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/07/12 04:50:44 UTC, 2 replies.
- [PR] [MINOR][DOC] Fix to use Hive 4.1 on Hadoop 3.5 in PySpark installation guide [spark] - posted by "art000109 (via GitHub)" <gi...@apache.org> on 2026/07/12 09:23:45 UTC, 1 replies.
- Re: [PR] [SPARK-57964][PYTHON][SQL] Fix DataFrame.dropna to raise PySparkValueError on invalid how [spark] - posted by "anxkhn (via GitHub)" <gi...@apache.org> on 2026/07/12 11:51:56 UTC, 0 replies.
- [I] [BUILD] Drop oro dependency [spark] - posted by "art000109 (via GitHub)" <gi...@apache.org> on 2026/07/12 12:19:15 UTC, 7 replies.
- [PR] [SPARK-57929][CORE][SQL] Support Binary/List view types in ArrowColumnVector [spark] - posted by "robert3005 (via GitHub)" <gi...@apache.org> on 2026/07/13 00:26:35 UTC, 5 replies.
- Re: [PR] [SPARK-56160][SQL] Add DataType classes for nanosecond timestamp types [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/13 00:46:36 UTC, 1 replies.
- Re: [PR] [MINOR][DOCS] Fix to use Hive 4.1 on Hadoop 3.5 in PySpark installation guide [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/07/13 01:44:42 UTC, 4 replies.
- [PR] [SPARK-57927][SQL] Add json_valid function for JSON syntax validation [spark] - posted by "marcuslin123 (via GitHub)" <gi...@apache.org> on 2026/07/13 03:41:08 UTC, 5 replies.
- [PR] [WIP] [SPARK-57231] [SS][RTM][StreamingShuffle][Part6] Activate streaming shuffle and add end-to-end StreamingShuffleSuite [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/07/13 03:49:16 UTC, 0 replies.
- [PR] [SPARK-57932][SQL][4.2] Fix regexp_instr and regexp_replace returning wrong results for supplementary characters [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/07/13 04:08:38 UTC, 2 replies.
- [PR] [SPARK-57932][SQL][4.1] Fix regexp_instr and regexp_replace returning wrong results for supplementary characters [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/07/13 04:10:16 UTC, 2 replies.
- [PR] [SPARK-57932][SQL][4.x] Fix regexp_instr and regexp_replace returning wrong results for supplementary characters [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/07/13 04:11:30 UTC, 2 replies.
- [PR] [SPARK-57932][SQL][4.0] Fix regexp_instr and regexp_replace returning wrong results for supplementary characters [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/07/13 04:12:26 UTC, 2 replies.
- [PR] [SPARK-57932][SQL][3.5] Fix regexp_instr and regexp_replace returning wrong results for supplementary characters [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/07/13 04:13:12 UTC, 4 replies.
- [PR] [SPARK-58098][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_0033 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/13 05:22:52 UTC, 0 replies.
- [PR] [SPARK-58097][CONNECT] Preserve composite (userId, sessionId) session identity in Connect UI/status store [spark] - posted by "venkata91 (via GitHub)" <gi...@apache.org> on 2026/07/13 05:53:16 UTC, 17 replies.
- Re: [PR] [SPARK-57714][CORE] Add loser tree based k-way merger for UnsafeExternalSorter spill merge [spark] - posted by "s-unscrupulous (via GitHub)" <gi...@apache.org> on 2026/07/13 07:14:31 UTC, 0 replies.
- [I] CPU burn in PartitioningUtils.resolvePartitions for large numbers of partition directories [spark] - posted by "flipp5b (via GitHub)" <gi...@apache.org> on 2026/07/13 09:21:16 UTC, 4 replies.
- [PR] [SPARK-58099][SQL] Remove the local sort dangling below the shuffle added by skew join optimization [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/07/13 11:35:19 UTC, 8 replies.
- [PR] [SPARK-57775][SQL][4.1] Return one row for GROUP BY GROUPING SETS (()) over empty input [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/13 13:18:57 UTC, 5 replies.
- [PR] [WIP][SPARK-57811][SQL] Support string to nanosecond-precision timestamp coercion in comparisons and predicates [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/07/13 13:20:52 UTC, 1 replies.
- [PR] [WIP][SPARK-57821][SQL] Support nanosecond-precision timestamps in date_trunc [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/07/13 13:27:49 UTC, 0 replies.
- [PR] [WIP][SPARK-57816][SQL] Support nanosecond-precision timestamps in date_format, to_char and to_varchar [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/07/13 13:37:58 UTC, 0 replies.
- [PR] [SPARK-58101] Remove misleading spark.submit.deployMode=cluster from spark-connect-server-with-spark-cluster.yaml [spark-kubernetes-operator] - posted by "yalindogusahin (via GitHub)" <gi...@apache.org> on 2026/07/13 13:56:26 UTC, 1 replies.
- Re: [PR] [SPARK-57821][SQL] Support nanosecond-precision timestamps in date_trunc [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/07/13 15:22:36 UTC, 4 replies.
- [PR] [SPARK-58102][SQL] Fix SLAM scope extraction bailing out on ReusedSubqueryExec [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2026/07/13 15:34:44 UTC, 4 replies.
- Re: [PR] [SPARK-58098][SQL] Convert _LEGACY_ERROR_TEMP_0033 to an internal error [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/13 15:55:19 UTC, 3 replies.
- [PR] [SPARK-58007][SQL] Support dynamic table options for MERGE [spark] - posted by "anuragmantri (via GitHub)" <gi...@apache.org> on 2026/07/13 16:15:07 UTC, 10 replies.
- Re: [PR] [SPARK-58101] Remove misleading `spark.submit.deployMode=cluster` from `spark-connect-server-with-spark-cluster.yaml` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/13 16:15:58 UTC, 3 replies.
- [PR] [SPARK-58103][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_2228 [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/13 16:30:32 UTC, 4 replies.
- [PR] [SPARK-58104][SQL] Make XML schema inference honor the nullValue option, consistent with CSV [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/13 17:02:31 UTC, 3 replies.
- [PR] [SPARK-58105][INFRA] Remove branch-specific code from build_and_test.yml [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/13 19:10:31 UTC, 3 replies.
- [PR] [SPARK-58106][DOCS][INFRA] Remove stale references to black [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/13 20:35:46 UTC, 3 replies.
- Re: [PR] [SPARK-58078][CORE] Add PipelinedShuffleDependency [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/13 20:40:17 UTC, 7 replies.
- [PR] [SPARK-58107][CORE] Detect and repair non-deterministic local checkpoints via RDD-block content checksums [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2026/07/13 20:52:21 UTC, 5 replies.
- [PR] [SPARK-58108][INFRA] Use pyproject.toml for python-312 docker file [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/13 21:53:47 UTC, 0 replies.
- Re: [PR] [SPARK-58069][SQL] approx_top_k returns incorrect/garbage sort-key bytes instead of actual values for collated strings [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/07/13 23:28:22 UTC, 5 replies.
- [PR] [SPARK-58109][SQL] Use Hadoop file reader for SQL from_protobuf descriptor files [spark] - posted by "kavpreetgrewal (via GitHub)" <gi...@apache.org> on 2026/07/14 00:02:01 UTC, 0 replies.
- Re: [PR] [SPARK-58111][SQL] Write schema narrowing for column-level UPDATE in DSv2 [spark] - posted by "anuragmantri (via GitHub)" <gi...@apache.org> on 2026/07/14 00:30:32 UTC, 17 replies.
- [PR] [SPARK-58112][SQL] Skip pushdown for nondeterministic Catalyst filters [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/07/14 00:52:13 UTC, 8 replies.
- [PR] [PYTHON] Consolidate VALUE_NOT_ANY_OR_ALL into VALUE_NOT_ALLOWED [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/14 01:46:35 UTC, 1 replies.
- [PR] [PYTHON][TEST] Use pandas-specific PyArrow goldens [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/14 02:43:09 UTC, 0 replies.
- [PR] [SPARK-58110][SQL] Extract SupportsArchiveFormat trait for archive-read data sources [spark] - posted by "akshatshenoi-db (via GitHub)" <gi...@apache.org> on 2026/07/14 03:15:33 UTC, 7 replies.
- [PR] [SPARK-57583][SQL] Support lazy dictionary decoding for TIME in the vectorized Parquet reader [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/07/14 04:47:33 UTC, 0 replies.
- [PR] [MINOR][SQL] Fix incorrect type wording in Row getter scaladoc [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/14 05:32:06 UTC, 3 replies.
- [PR] [SPARK-57982][SQL] Make exact percentile monotonic for large values [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/07/14 05:47:27 UTC, 11 replies.
- [PR] [SPARK-58113][K8S] Support publishNotReadyAddresses in driver service [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/07/14 05:59:01 UTC, 0 replies.
- [PR] [SPARK-58100] Use IndexedSeq to fix quadratic complexity in partition resolution [spark] - posted by "flipp5b (via GitHub)" <gi...@apache.org> on 2026/07/14 06:42:18 UTC, 12 replies.
- [PR] [SPARK-57775][SQL][4.0] Return one row for GROUP BY GROUPING SETS (()) over empty input [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/14 07:07:47 UTC, 2 replies.
- [PR] [SPARK-58116][SDP] Validate user-specified schema for tables fed by a named flow [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/07/14 07:16:15 UTC, 7 replies.
- Re: [PR] [SPARK-57555][FOLLOWUP][SQL] Add TimeType support to MySQLDialect [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/07/14 07:49:25 UTC, 1 replies.
- [PR] [SPARK-57775][SQL][3.5] Return one row for GROUP BY GROUPING SETS (()) over empty input [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/14 07:53:53 UTC, 2 replies.
- [PR] [SPARK-58119][CORE][PYTHON] Introduce PythonWorkerHandle abstraction for the Python worker path [spark] - posted by "fapaul (via GitHub)" <gi...@apache.org> on 2026/07/14 09:10:18 UTC, 6 replies.
- [PR] [SPARK-58120][SQL] doCanonicalize preserves keyGroupedPartitioning expression order [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2026/07/14 10:01:15 UTC, 13 replies.
- [PR] [SPARK-58121][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_0012 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/14 12:56:21 UTC, 4 replies.
- [PR] [SPARK-58114][PYTHON] Consolidate VALUE_NOT_ANY_OR_ALL into VALUE_NOT_ALLOWED [spark] - posted by "marcuslin123 (via GitHub)" <gi...@apache.org> on 2026/07/14 13:32:38 UTC, 6 replies.
- Re: [PR] [SPARK-XXXXX][SQL][TESTS] Refactor some DSv2 tests to use SessionQueryTest [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/14 14:38:51 UTC, 0 replies.
- Re: [PR] [SPARK-58100][SQL] Use IndexedSeq to fix quadratic complexity in partition resolution [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/14 15:28:59 UTC, 5 replies.
- [PR] [SPARK-58122][SQL] Add SQL ASOF JOIN parser and error conditions [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/07/14 16:05:39 UTC, 6 replies.
- [PR] [SPARK-57891][CORE][FOLLOWUP] Fix contradictory thread-safety docs in CredentialProviderLoader [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/07/14 16:38:05 UTC, 1 replies.
- Re: [PR] [SPARK-58113][K8S] Support `publishNotReadyAddresses` in driver service [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/14 17:14:27 UTC, 4 replies.
- [PR] [SPARK-57555][FOLLOWUP][SQL] Add TimeType support to MsSqlServerDialect [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/07/14 17:59:50 UTC, 1 replies.
- Re: [PR] [SPARK-44462][SS][CONNECT] Fix the session passed to foreachBatch in Spark Connect [spark] - posted by "juanpaulH (via GitHub)" <gi...@apache.org> on 2026/07/14 18:55:50 UTC, 0 replies.
- [PR] [SPARK-58015][INFRA][FOLLOWUP] Add mkdocs to pyproject.toml [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/14 19:07:52 UTC, 3 replies.
- [PR] [MINOR][DOCS] Fixed 2 links in the "See also" section [spark] - posted by "art000109 (via GitHub)" <gi...@apache.org> on 2026/07/14 20:25:31 UTC, 1 replies.
- [PR] [MINOR][DOCS] Fixed 2 links in the "See also" section of Column.outer() method [spark] - posted by "art000109 (via GitHub)" <gi...@apache.org> on 2026/07/14 20:46:08 UTC, 2 replies.
- [PR] [SPARK-58126][CORE] Support a pluggable SchedulingAlgorithm via confi guration [spark] - posted by "ChrisMuki (via GitHub)" <gi...@apache.org> on 2026/07/14 21:03:53 UTC, 7 replies.
- [PR] [SPARK-58127][INFRA] Remove flake8 from the Python lint tooling [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/14 21:37:10 UTC, 3 replies.
- [PR] [WIP][SPARK-XXXXX][SS] Support async progress tracking for Real-Time Mode [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/07/14 22:30:01 UTC, 0 replies.
- [PR] [SPARK-58128][PYTHON] Refactor SQL_TRANSFORM_WITH_STATE_PANDAS_INIT_STATE_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/07/14 22:56:50 UTC, 9 replies.
- Re: [PR] [SPARK-52825][SQL] Recognize well-known JDBC URL prefixes in MySQL/PostgresDialect [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/07/14 23:09:23 UTC, 5 replies.
- Re: [PR] [SPARK-57891][CORE][DOCS][FOLLOWUP] Fix contradictory thread-safety docs in `CredentialProviderLoader` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/07/14 23:13:21 UTC, 2 replies.
- [PR] [SPARK-58129][SQL] Assign a name to the error class _LEGACY_ERROR_TEMP_0031 [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/07/14 23:14:22 UTC, 2 replies.
- Re: [PR] [SPARK-58109][SQL][PROTOBUF] Use Hadoop file reader for SQL from_protobuf descriptor files [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/07/15 00:16:10 UTC, 4 replies.
- Re: [PR] [SPARK-56319][SQL] ShuffleExternalSorter should reuse write buffer [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/15 00:37:08 UTC, 1 replies.
- Re: [PR] [SPARK-56286][PYTHON] Add DataFrame.dataQuality API for column profiling [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/15 00:37:12 UTC, 1 replies.
- Re: [PR] [MINOR] Raise exception if no active Spark context [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/15 00:37:17 UTC, 1 replies.
- Re: [PR] [SPARK-56842][SQL] Short-circuit AQE when materialized stages are empty [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/07/15 00:56:12 UTC, 4 replies.
- Re: [PR] [SPARK-58115][PYTHON][TEST] Handle Pandas 3 in PyArrow Array.to_pandas golden test [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/15 00:56:52 UTC, 1 replies.
- [PR] [SPARK-57892][CORE] Add TokenIngestor interface and FileTokenIngestor implementation [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/07/15 00:59:24 UTC, 12 replies.
- Re: [PR] [SPARK-57648][SQL] Spread unmatchable left outer join rows across shuffle partitions [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/07/15 01:04:29 UTC, 0 replies.
- [PR] [MINOR][PYTHON][TESTS] Reduce memory footprint of grouped-agg UDF batch-slicing tests [spark] - posted by "gurpreetmultanii (via GitHub)" <gi...@apache.org> on 2026/07/15 01:23:52 UTC, 0 replies.
- [PR] [SPARK-58123][SQL] Add ResolveAsOfJoin analysis for SQL ASOF JOIN [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/07/15 01:39:52 UTC, 6 replies.
- [PR] [SPARK-58133][SQL] XML schema inference must not skip empty values to avoid data loss [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/15 02:11:28 UTC, 4 replies.
- [PR] [SPARK-58134][BUILD] Upgrade janino to 3.1.12 [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2026/07/15 02:35:19 UTC, 5 replies.
- Re: [PR] [SPARK-58132][PYTHON][TESTS] Reduce memory footprint of grouped-agg UDF batch-slicing tests [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/15 03:11:32 UTC, 2 replies.
- [PR] [MINOR][PYTHON] Fix parameter name in BisectingKMeansModel.computeCost docstring [spark] - posted by "nikolauspschuetz (via GitHub)" <gi...@apache.org> on 2026/07/15 03:25:02 UTC, 0 replies.
- [PR] [WIP][PYTHON] Consolidate VALUE_NOT_TRUE into VALUE_NOT_ALLOWED [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/15 03:26:04 UTC, 0 replies.
- [PR] [SPARK-58136][INFRA] Automate downloads.md and versions.json updates in the release script [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/15 04:16:36 UTC, 2 replies.
- [PR] [WIP][PYTHON] Measure PySpark session lifecycle [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/15 05:14:28 UTC, 1 replies.
- [PR] [WIP][DOCS] Allow JIRA-free minor PRs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/15 05:36:29 UTC, 0 replies.
- [PR] [SPARK-58096][SQL] approx_top_k over-merges ICU-collation-distinct values via lossy sort-key decode [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/07/15 06:27:05 UTC, 1 replies.
- [PR] [SPARK-58130][PYTHON] Refactor legacy SQL_ARROW_TABLE_UDF pandas path and remove ArrowStreamPandasUDTFSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/07/15 06:44:32 UTC, 3 replies.
- [PR] [SPARK-58137][CORE] Optimize hasAttemptOnHost from O(m) linear scan to O(1) HashSet lookup [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2026/07/15 07:01:03 UTC, 2 replies.
- Re: [PR] [MINOR][DOCS] Allow JIRA-free draft and minor PRs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/15 08:24:28 UTC, 1 replies.
- Re: [PR] [SPARK-58135][PYTHON] Consolidate VALUE_NOT_TRUE into VALUE_NOT_ALLOWED [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/15 08:27:37 UTC, 1 replies.
- Re: [PR] [SPARK-54956][CORE] Unify the indeterminate shuffle retry solution [spark] - posted by "yikf (via GitHub)" <gi...@apache.org> on 2026/07/15 08:35:36 UTC, 0 replies.
- Re: [PR] [SPARK-57782][INFRA][DOC] Make pages.yml reuse the doc image [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/15 08:54:41 UTC, 2 replies.
- Re: [PR] [SPARK-57232][SS][RTM][StreamingShuffle][Part7] Add additional e2e testing for streaming shuffle [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/07/15 09:11:13 UTC, 3 replies.
- [PR] [SPARK-58138][SQL] Preserve child output partitioning through BIN BY [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/07/15 11:43:36 UTC, 2 replies.
- Re: [PR] [SPARK-57814][SQL] Support NTZ and nanosecond-precision timestamps in unix_seconds, unix_millis and unix_micros [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/07/15 11:53:02 UTC, 9 replies.
- [PR] [SPARK-43317][SQL] Support combine adjacent aggregation [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/07/15 12:06:05 UTC, 14 replies.
- Re: [PR] [SPARK-56048][UI] Add copy plan text and share link buttons to SQL execution page [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2026/07/15 12:22:00 UTC, 0 replies.
- [PR] [SPARK-58140] Upgrade Spark to 4.2.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/15 14:13:50 UTC, 6 replies.
- [PR] [SPARK-58141] Use Apache Spark 4.2.0 for Spark 4.2 integration tests [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/15 14:20:22 UTC, 4 replies.
- [PR] [SPARK-58142] Upgrade JUnit to 6.1.2 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/15 14:43:43 UTC, 4 replies.
- [PR] [SPARK-58143] Upgrade `spotbugs-gradle-plugin` to 6.5.9 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/15 14:47:08 UTC, 4 replies.
- [PR] [SPARK-58144] Add `verification-metadata.xml` regeneration guide to `AGENTS.md` and fix `README.md` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/15 15:28:54 UTC, 4 replies.
- [PR] [SPARK-58124][SQL] Wire sort-merge ASOF JOIN physical execution [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/07/15 15:34:09 UTC, 5 replies.
- [PR] [SPARK-58145] Upgrade `Apache Celeborn` to 0.6.3 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/15 15:53:22 UTC, 3 replies.
- [PR] [SPARK-58139][SQL] Improve BIN BY test coverage for DST and bin alignment [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/07/15 16:16:31 UTC, 4 replies.
- [PR] [SPARK-58146] Upgrade `log4j` to 2.26.1 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/15 16:36:36 UTC, 5 replies.
- [PR] [SPARK-58147] Upgrade SpotBugs to 4.10.3 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/15 16:51:26 UTC, 4 replies.
- [PR] [SPARK-58148][BUILD] Upgrade `tink` to 1.23.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/15 17:10:16 UTC, 3 replies.
- [PR] [SPARK-58150][BUILD] Upgrade Jetty to 12.1.11 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/15 17:17:54 UTC, 3 replies.
- [PR] [SPARK-58151] Publish Apache Spark 4.2.0 to docker registry [spark-docker] - posted by "huaxingao (via GitHub)" <gi...@apache.org> on 2026/07/15 17:52:52 UTC, 9 replies.
- [PR] [SPARK-58152][K8S] Avoid logging credentials in Kubernetes client config debug log [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/15 18:09:07 UTC, 4 replies.
- [PR] [MINOR][CONNECT][PYTHON] Fix mock session leakage in test_clinet.py [spark] - posted by "Abacn (via GitHub)" <gi...@apache.org> on 2026/07/15 18:11:46 UTC, 0 replies.
- [PR] [SPARK-58153][CORE][R] Reject JAR entries escaping the extraction directory in `RPackageUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/15 18:17:36 UTC, 4 replies.
- Re: [PR] [SPARK-54879][CORE] Add final status to Spark History Server for failed executions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/15 18:29:47 UTC, 0 replies.
- Re: [PR] [SPARK-58108][INFRA] Use pyproject.toml for python-31x docker file [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/15 18:56:36 UTC, 6 replies.
- [PR] [SPARK-57724][SQL][FOLLOWUP] Use consistent operation name "CREATE METRIC VIEW" in MISSING_CLAUSES_FOR_OPERATION [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/15 19:16:12 UTC, 3 replies.
- [PR] [SPARK-38954][CORE][WIP] Cloud Credential Refresh and Distribution Without Kerberos [spark] - posted by "parthchandra (via GitHub)" <gi...@apache.org> on 2026/07/15 19:48:16 UTC, 1 replies.
- [PR] [WIP]Stack/pipelined shuffle pr2 routing [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/07/15 19:51:25 UTC, 14 replies.
- [PR] [SPARK-58155][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1066 [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/07/15 19:51:45 UTC, 3 replies.
- [PR] [SPARK-58156][CORE] Escape the executor removal reason in the timeline tooltip [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/15 20:56:50 UTC, 0 replies.
- Re: [PR] [SPARK-58156][CORE][UI] Escape the executor removal reason in the timeline tooltip [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/15 21:09:23 UTC, 3 replies.
- [PR] [SPARK-58095][SQL] Fix approx_top_k_combine MatchError on empty input [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/07/15 22:34:28 UTC, 0 replies.
- [PR] [SPARK-58158][CORE][UI] Escape the executor removal reason in `executorspage.js` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/15 22:53:18 UTC, 6 replies.
- Re: [PR] [SPARK-58096][SQL] Fix approx_top_k wrong counts/items for UNICODE-collated non-ASCII strings [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/07/15 22:53:27 UTC, 8 replies.
- [PR] [SPARK-58159][PYTHON] Add support for with statement for connect session [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/15 23:17:38 UTC, 2 replies.
- Re: [PR] [SPARK-56295][PYTHON] Add Java error classes to Python side [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/16 00:40:47 UTC, 1 replies.
- Re: [I] [PYTHON] Support path-based table reference in `DataFrame.mergeInto` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/16 00:40:48 UTC, 0 replies.
- Re: [PR] [SPARK-57521][ML][CONNECT] Exclude parent from Model.estimatedSize to fix overcounting in ML cache [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/16 01:48:47 UTC, 3 replies.
- [PR] [SPARK-58161][PYTHON] Standardize PySpark UDF row count mismatch error to use RESULT_ROWS_MISMATCH [spark] - posted by "Alwaysgaurav1 (via GitHub)" <gi...@apache.org> on 2026/07/16 03:58:28 UTC, 4 replies.
- [PR] [SPARK-56972][SS][FOLLOWUP] Reject sink evolution combined with continuous processing [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/16 04:03:02 UTC, 3 replies.
- [PR] [SPARK-58163][SQL] Extract the BroadcastHashJoinExec read-only relation setup into a shared helper [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/16 05:20:47 UTC, 3 replies.
- Re: [PR] [MINOR][PYTHON][ML][DOC] Fix parameter name in BisectingKMeansModel.computeCost docstring [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/16 05:44:20 UTC, 1 replies.
- Re: [PR] [MINOR][CONNECT][PYTHON][TEST] Fix mock session leakage in test_clinet.py [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/16 05:56:20 UTC, 1 replies.
- Re: [PR] [SPARK-57965][PYTHON][CONNECT] Fix UNSUPPORTED_PIPELINES_DATASET_TYPE error parameter name [spark] - posted by "anxkhn (via GitHub)" <gi...@apache.org> on 2026/07/16 06:08:52 UTC, 0 replies.
- [PR] [SPARK-57924][SQL] Add bitmap_xor_agg aggregation function [spark] - posted by "jiangxt2 (via GitHub)" <gi...@apache.org> on 2026/07/16 06:46:29 UTC, 0 replies.
- [PR] [SPARK-58166][SQL] Replace TypeTag on PhysicalDataType with ClassTag [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2026/07/16 07:23:54 UTC, 0 replies.
- [PR] [SPARK-49123][SS] Log empty Kafka polls with advanced offsets [spark] - posted by "superdiaodiao (via GitHub)" <gi...@apache.org> on 2026/07/16 08:18:15 UTC, 4 replies.
- [PR] Add 3.5.9 4.0.4 and 4.1.3 [spark-docker] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/07/16 10:26:47 UTC, 10 replies.
- [PR] [SPARK-38983][SQL][TESTS] Add grouping boolean error regression test [spark] - posted by "superdiaodiao (via GitHub)" <gi...@apache.org> on 2026/07/16 11:53:43 UTC, 4 replies.
- Re: [PR] [SPARK-56898][SQL] Rewrite COUNT(DISTINCT IF) to COUNT(DISTINCT) FILTER for Expand reduction [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/07/16 12:37:52 UTC, 3 replies.
- [PR] [SPARK-58168][SQL] Do no use Array[Nothing] in Flatten [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2026/07/16 13:00:32 UTC, 0 replies.
- Re: [PR] [SPARK-56637][CORE] Fix Variant getFieldByKey to handle unsorted object fields [spark] - posted by "steveloughran (via GitHub)" <gi...@apache.org> on 2026/07/16 13:07:20 UTC, 0 replies.
- [PR] [SPARK-58170][SQL][TESTS] Provide sql shorthand in SparkSessionProvider [spark] - posted by "fwc (via GitHub)" <gi...@apache.org> on 2026/07/16 13:11:08 UTC, 0 replies.
- Re: [PR] [SPARK-57816][SQL] Support nanosecond-precision timestamps in date_format, to_char and to_varchar [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/07/16 13:16:00 UTC, 3 replies.
- [PR] [SPARK-58171][SQL] Alias bare top-level OuterReferences in Project and Aggregate outputs [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2026/07/16 13:32:04 UTC, 4 replies.
- [PR] [SPARK-58169][SQL] Use java reflection for finding the SparkSession companions [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2026/07/16 13:47:02 UTC, 0 replies.
- [PR] [SPARK-57548][SQL] Avoid eager scala.reflect.runtime.universe initialization in ScalaReflection [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2026/07/16 14:00:05 UTC, 0 replies.
- [PR] [SPARK-58125][SQL] SQL ASOF JOIN integration tests [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/07/16 14:01:17 UTC, 2 replies.
- Re: [PR] [SPARK-57811][SQL] Support string to nanosecond-precision timestamp coercion in comparisons and predicates [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/16 14:01:58 UTC, 9 replies.
- Re: [PR] [SPARK-58065] Support column lists for `INSERT REPLACE WHERE` [spark] - posted by "leonwind (via GitHub)" <gi...@apache.org> on 2026/07/16 14:05:43 UTC, 9 replies.
- [PR] [SPARK-58172][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_0031 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/16 14:10:17 UTC, 2 replies.
- [PR] [SPARK-58173][SQL] Add ASOF JOIN FVT golden-file SQL tests [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/07/16 14:27:32 UTC, 10 replies.
- [PR] Fetch maven plugins from mirror if MAVEN_MIRROR_URL is set [spark] - posted by "fwc (via GitHub)" <gi...@apache.org> on 2026/07/16 14:28:02 UTC, 0 replies.
- [PR] [SPARK-58165][SQL][CONNECT] Fix SubqueryExpression dropping nested subquery plans in IN values [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/16 14:41:36 UTC, 10 replies.
- [PR] [SPARK-58018][SQL][TESTS][FOLLOWUP] Drain slow_udf scalar-subquery jobs in the AQE cancellation test so they don't flake sibling tests [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/16 15:39:56 UTC, 4 replies.
- [PR] [SPARK-58107][FOLLOWUP][CORE] Add verifyRddChecksumSeal invariant check for sealed RDD block checksums [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2026/07/16 16:18:55 UTC, 8 replies.
- Re: [PR] [WIP] Define PipelinedShuffleDependency and route shuffles to a ShuffleManager by dependency type [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/16 17:28:19 UTC, 10 replies.
- [PR] [SPARK-54831][SQL] Support COMMENT ON COLUMN for table columns [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2026/07/16 17:40:06 UTC, 10 replies.
- [PR] [SPARK-58176][DOCS] Add SQL reference documentation for ASOF JOIN [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/07/16 17:52:43 UTC, 4 replies.
- [PR] Add Unified Spark CLI [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/07/16 18:32:33 UTC, 7 replies.
- [PR] [SPARK-58177][GRAPHX] Fix wrong operand in SVD++ aggregateMessages combiner [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/07/16 18:42:28 UTC, 6 replies.
- [PR] ⚡ perf(sql): Fold single-row anti joins [spark] - posted by "huan233usc (via GitHub)" <gi...@apache.org> on 2026/07/16 18:50:59 UTC, 1 replies.
- [PR] [SPARK-58019][PYTHON][FOLLOWUP] Convert Arrow list columns to Python rows in bulk at foreachPartition and data source write [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/07/16 20:45:59 UTC, 2 replies.
- [PR] [SPARK-58167][BUILD] Add LICENSE files [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/07/16 20:48:13 UTC, 2 replies.
- [PR] [SPARK-58062][SQL] Add variant_strip_nulls expression [spark] - posted by "marcuslin123 (via GitHub)" <gi...@apache.org> on 2026/07/16 21:43:32 UTC, 6 replies.
- [PR] [SPARK-58180][INFRA][4.2] Prepare branch-4.2 build workflows for decoupling [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/16 23:23:46 UTC, 2 replies.
- [PR] [SPARK-58162][Connect] Bound the unbounded RetryException retry loop in reattach path [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/07/17 00:12:13 UTC, 4 replies.
- [PR] [SPARK-58175][SQL][PROTOBUF] Cache descriptor trees built from a binary FileDescriptorSetjust [spark] - posted by "bhollis-dbx (via GitHub)" <gi...@apache.org> on 2026/07/17 00:13:27 UTC, 0 replies.
- Re: [PR] [SPARK-56231][SQL] Bucket pruning and bucket join optimization for V2 file read path [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/17 00:43:08 UTC, 1 replies.
- Re: [PR] [SPARK-56368] Make the number of rows per custom metrics update configurable [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/17 00:43:12 UTC, 1 replies.
- Re: [PR] [SPARK-56367][SS][PYTHON][DOCS] Fix latestOffset docstring and tutorial to use correct field name and signature [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/17 00:43:17 UTC, 1 replies.
- Re: [I] [PYTHON] Allow `PathLike` path objects as input to `readwriter` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/17 00:43:22 UTC, 0 replies.
- Re: [PR] [SPARK-56304][SQL] Support IF NOT EXISTS for V2 file table INSERT OVERWRITE [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/17 00:43:24 UTC, 1 replies.
- Re: [PR] [SPARK-56316][SQL] Support static partition overwrite for V2 file tables [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/17 00:43:28 UTC, 1 replies.
- Re: [PR] [SPARK-53368][SQL] Support reading Parquet TIME data with isAdjustedToUTC=true [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/07/17 02:20:18 UTC, 1 replies.
- [PR] [WIP][SPARK-57521][ML][CONNECT] Include parameter metadata in tree classifier size estimates [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/17 02:20:43 UTC, 0 replies.
- [PR] [SPARK-58183][SQL] Report observation metrics from the last successful task attempt [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/07/17 03:19:58 UTC, 21 replies.
- [PR] [SPARK-58179][PYTHON] Simplify namespace list construction in PySpark Catalog [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/07/17 03:33:50 UTC, 5 replies.
- [PR] [SPARK-57234][SS][DOCS][4.2] Add Real-time Mode documentation page to the Structured Streaming guide [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/07/17 04:14:17 UTC, 2 replies.
- [PR] [SPARK-58184][CORE] Remove dead ExternalBlockStore executor exit codes [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/07/17 05:09:44 UTC, 3 replies.
- Re: [PR] [SPARK-58185][CORE] Define PipelinedShuffleDependency and route shuffles to a ShuffleManager by dependency type [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/07/17 05:26:42 UTC, 13 replies.
- Re: [PR] [SPARK-57521][ML][CORE] Add skipTransient mode to SizeEstimator to fix ML cache overcounting [spark] - posted by "mkincaid (via GitHub)" <gi...@apache.org> on 2026/07/17 05:36:30 UTC, 5 replies.
- [PR] [SPARK-58164][SQL] approx_top_k_estimate crashes or returns wrong results on sketches whose item type was widened by type coercion [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/07/17 06:15:46 UTC, 4 replies.
- Re: [PR] [SPARK-58131][SS][RTM] Support async progress tracking for Real-Time Mode [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/07/17 06:41:27 UTC, 11 replies.
- [PR] [SPARK-57926][SQL] Add IPv4 address functions: inet_aton, inet_ntoa, try_inet_aton [spark] - posted by "jiangxt2 (via GitHub)" <gi...@apache.org> on 2026/07/17 07:46:01 UTC, 0 replies.
- [PR] [SPARK-58187][CORE] Increase task CPUs on OOM retry to reduce concurrency and grow per-task memory [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/07/17 07:59:03 UTC, 17 replies.
- [PR] [SPARK-58188][PYTHON] Remove unused ArrowStreamUDTFSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/07/17 08:00:46 UTC, 2 replies.
- [PR] [SPARK-58190][PYTHON] Delete unused TransformWithStateInPandasInitStateSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/07/17 08:08:17 UTC, 2 replies.
- [PR] [SPARK-58192][CORE] Support fractional spark.task.cpus [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/07/17 08:58:54 UTC, 72 replies.
- Re: [PR] [SPARK-58149][SQL][TESTS] Refactor some DSv2 tests to use SessionQueryTest [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/17 09:30:24 UTC, 2 replies.
- [PR] [SPARK-58193][SQL] Classify Databricks syntax errors by message [spark] - posted by "alekjarmov (via GitHub)" <gi...@apache.org> on 2026/07/17 10:24:53 UTC, 3 replies.
- [PR] [MINOR][SQL] Fix incorrect scaladoc in functions.scala [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/17 11:28:14 UTC, 3 replies.
- [PR] [SPARK-58194] Upgrade docker images to Apache Spark 4.2.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/17 15:02:23 UTC, 3 replies.
- [PR] [SPARK-58195][BUILD] Upgrade ORC to 2.3.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/17 15:04:59 UTC, 7 replies.
- [PR] [SPARK-58186][SQL] Add bitmap_contains function [spark] - posted by "jiangxt2 (via GitHub)" <gi...@apache.org> on 2026/07/17 15:09:08 UTC, 3 replies.
- [PR] [SPARK-58196] Use `apache/spark:4.2.0-scala-java25` image in Spark 4.2 integration test [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/17 15:25:59 UTC, 4 replies.
- [PR] [SPARK-58197] Upgrade `Java Operator SDK` to 5.5.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/17 16:15:16 UTC, 4 replies.
- [PR] [SPARK-58191][PYTHON] Refactor SQL_TRANSFORM_WITH_STATE_PYTHON_ROW_UDF and SQL_TRANSFORM_WITH_STATE_PYTHON_ROW_INIT_STATE_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/07/17 16:46:32 UTC, 3 replies.
- [PR] [SPARK-58198] Use Apache Spark 4.2.0 in `README.md`, `Examples`, and `Examples.md` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/17 17:02:56 UTC, 3 replies.
- [PR] [SPARK-58044][SQL] Support the TIME data type in the aggregate function avg [spark] - posted by "marcuslin123 (via GitHub)" <gi...@apache.org> on 2026/07/17 17:09:22 UTC, 0 replies.
- [PR] [SPARK-58189][PYTHON] Refactor SQL_GROUPED_MAP_PANDAS_UDF_WITH_STATE [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/07/17 17:15:55 UTC, 2 replies.
- [PR] [SPARK-58199][SQL] Add FileIndex fullyPushedFilter hint for physical plan [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/07/17 18:25:09 UTC, 5 replies.
- [PR] [WIP] Stack/pipelined shuffle pr3 scheduling [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/07/17 20:13:22 UTC, 0 replies.
- [PR] [SPARK-58094][CONNECT][FOLLOWUP] Fix flaky BindException by awaiting gRPC server [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/07/17 21:13:38 UTC, 0 replies.
- [PR] [SPARK-58200][BUILD] Add a scala-3 build profile and make the version switch reversible [spark] - posted by "fangchenli (via GitHub)" <gi...@apache.org> on 2026/07/17 21:48:22 UTC, 7 replies.
- Re: [PR] [SPARK-58094][CONNECT][FOLLOWUP] Fix flaky BindException in SparkConnectServiceKeepAliveSuite [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/17 21:55:32 UTC, 1 replies.
- [PR] [SPARK-53154][SQL][PYTHON] Add native `hmac` SQL function [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/07/17 23:15:09 UTC, 0 replies.
- [PR] [SPARK-57402][SQL][FOLLOWUP] Allow pipeline definitions in batch operation checks [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/18 00:32:29 UTC, 3 replies.
- Re: [PR] Implement `SET` command in single-pass analyzer [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/18 00:39:31 UTC, 1 replies.
- Re: [PR] [SPARK-56373][PYSPARK] Add docstring annotations to classify PySpark APIs for Spark Connect compatibility [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/18 00:39:35 UTC, 1 replies.
- Re: [PR] [SPARK-56233][SQL][SS] V2 streaming write for FileTable [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/18 00:39:39 UTC, 1 replies.
- Re: [PR] [SPARK-56232][SQL][SS] V2 streaming read for FileTable [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/18 00:39:44 UTC, 1 replies.
- Re: [PR] [SPARK-56370] Optimize Platform.copyMemory with a fast path for small copies [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/18 00:39:51 UTC, 1 replies.
- Re: [PR] [SPARK-56320] Introduce JIT compilation metrics [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/18 00:39:55 UTC, 1 replies.
- [PR] [SPARK-58201][SQL] Optimize sliding window MIN/MAX aggregate function… [spark] - posted by "pavan51 (via GitHub)" <gi...@apache.org> on 2026/07/18 00:54:31 UTC, 4 replies.
- [PR] [SPARK-57956][SQL] Fix AQE incorrectly eliminating a global LIMIT over a non-materialized query stage [spark] - posted by "vboo123 (via GitHub)" <gi...@apache.org> on 2026/07/18 02:06:36 UTC, 2 replies.
- [PR] [SPARK-56486][SQL] Add XSDToSchema.extendDecimalPrecision to prevent … [spark] - posted by "vboo123 (via GitHub)" <gi...@apache.org> on 2026/07/18 02:14:22 UTC, 2 replies.
- Re: [PR] [SPARK-53154][SQL][PYTHON] Add `hmac` SQL function [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/07/18 08:36:41 UTC, 3 replies.
- [PR] [SPARK-58202][K8S] Skip driver containerPort declaration when the por… [spark] - posted by "zhengchenyu (via GitHub)" <gi...@apache.org> on 2026/07/18 13:40:48 UTC, 2 replies.
- [PR] [SPARK-58203][K8S] Support configuring spark-managed UI service to work with spark.ui.port=0 [spark] - posted by "zhengchenyu (via GitHub)" <gi...@apache.org> on 2026/07/18 15:39:47 UTC, 13 replies.
- Re: [PR] [SPARK-5686][SQL] Add show current roles command in HiveQl [spark] - posted by "oikewll (via GitHub)" <gi...@apache.org> on 2026/07/18 15:51:12 UTC, 0 replies.
- [PR] [SPARK-49442][SS] Cache Kafka partition metadata to reduce DescribeTopics RPCs per micro-batch [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/07/18 19:07:35 UTC, 5 replies.
- [PR] [INFRA] Add a README for our GitHub workflows [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/07/18 20:41:23 UTC, 1 replies.
- [PR] [SPARK-58204][SQL] Fix unprotected mutable state in RegExpReplace, RegExpExtractBase, StringTranslate, FormatNumber, and NamedLambdaVariable by marking them stateful [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/07/19 00:42:45 UTC, 1 replies.
- Re: [PR] [SPARK-56178][SQL] MSCK REPAIR TABLE for V2 file tables [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/19 00:44:33 UTC, 1 replies.
- Re: [PR] [SPARK-56177][SQL] V2 file bucketing write support [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/19 00:44:38 UTC, 1 replies.
- Re: [PR] [SPARK-56176][SQL] V2-native ANALYZE TABLE/COLUMN with stats propagation to FileScan [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/19 00:44:42 UTC, 1 replies.
- Re: [PR] [SPARK-56174][SQL] Complete V2 file write path for DataFrame API [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/19 00:44:47 UTC, 1 replies.
- Re: [PR] [SPARK-56175][SQL] FileTable implements SupportsPartitionManagement and V2 catalog table loading [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/19 00:44:52 UTC, 1 replies.
- [PR] [SPARK-58205][SQL] Mark JSON/CSV/XML expressions stateful to prevent shared-evaluator data races [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/07/19 01:48:33 UTC, 7 replies.
- [PR] [SPARK-58206] Add custom write metrics to the pluggable shuffle framework [spark] - posted by "karuppayya (via GitHub)" <gi...@apache.org> on 2026/07/19 06:30:07 UTC, 2 replies.
- [PR] [SPARK-57109][SQL] Fix exchange reuse failure when a VIEW is referenced in both UNION ALL branches via a CTE [spark] - posted by "kush2439p (via GitHub)" <gi...@apache.org> on 2026/07/19 09:06:48 UTC, 1 replies.
- [PR] [SPARK-58207][SQL] Skip pushdown for nondeterministic V2 filters [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/07/19 09:22:56 UTC, 25 replies.
- [PR] [SPARK-58178][SQL][TEST] Expected size needs to increase [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/07/19 11:40:57 UTC, 0 replies.
- Re: [PR] [SPARK-58167][BUILD][3.5] Add LICENSE files [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/07/19 11:52:38 UTC, 2 replies.
- [PR] [MINOR][PYSPARK][DOCS] Fixed some links in documentation. [spark] - posted by "art000109 (via GitHub)" <gi...@apache.org> on 2026/07/19 13:16:51 UTC, 0 replies.
- [PR] [SPARK-40259][SQL] Support merging equivalent DataSource V2 scans in MergeSubplans [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/07/19 17:44:09 UTC, 21 replies.
- Re: [PR] [MINOR][PYTHON][DOCS] Fixed some links in documentation. [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/19 22:38:37 UTC, 18 replies.
- Re: [PR] [SPARK-56375][PS] Implement DataFrame.set_axis and Series.set_axis [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/20 00:46:00 UTC, 1 replies.
- Re: [PR] [SPARK-53565][SQL] Fix missing grand total row for ROLLUP/CUBE on runtime-empty tables [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/20 00:47:07 UTC, 1 replies.
- Re: [PR] [SPARK-56033][SQL] Support whole-stage codegen for `ArrayTransform` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/20 00:47:35 UTC, 1 replies.
- Re: [PR] [SPARK-55939][SQL] Add built-in DataSketches ItemsSketch (Frequent Items) functions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/20 00:48:08 UTC, 1 replies.
- Re: [PR] [SPARK-46161][PS] Add axis=1 support for DataFrame.diff [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/20 00:49:52 UTC, 1 replies.
- [PR] [WIP] Stack/pipelined shuffle pr6 failfast [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/07/20 01:49:05 UTC, 0 replies.
- [PR] [FollowUp][SPARK-53840][SQL] Make SHOW TABLE EXTENDED AS JSON match V2 metadata [spark] - posted by "linhongliu-db (via GitHub)" <gi...@apache.org> on 2026/07/20 01:58:34 UTC, 0 replies.
- Re: [PR] [SPARK-58206][CORE][SQL] Add custom write metrics to the pluggable shuffle framework [spark] - posted by "karuppayya (via GitHub)" <gi...@apache.org> on 2026/07/20 02:30:14 UTC, 9 replies.
- [PR] [SPARK-58210][SQL] Enable ReplaceHashWithSortAgg and CombineAdjacentAggregation by default [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/07/20 04:48:13 UTC, 15 replies.
- Re: [PR] [SPARK-58182][ML][CONNECT] Include parameter metadata in tree classifier size estimates [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/20 05:48:45 UTC, 1 replies.
- [PR] [SPARK-58212][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1052 [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/07/20 05:57:59 UTC, 0 replies.
- [PR] [PSARK-57356][SDP] Implement SCD2 Batch Processor; Cleanup Delete Encoding Rows Post-Reconciliation [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/07/20 06:06:38 UTC, 0 replies.
- [PR] [WIP][PYTHON] Use VALUE_NOT_ALLOWED for corr [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/20 06:12:09 UTC, 0 replies.
- [PR] [WIP][SPARK-58182][ML][CONNECT] Include parameter metadata in tree regressor size estimates [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/20 06:19:17 UTC, 0 replies.
- [PR] [SPARK-58211][SQL] Peel all leading AND/OR operands in subexpression elimination shortcut [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2026/07/20 06:25:33 UTC, 2 replies.
- [PR] [SPARK-58213][SQL] corr should return NULL when a column has zero variance [spark] - posted by "jiangxt2 (via GitHub)" <gi...@apache.org> on 2026/07/20 07:03:53 UTC, 0 replies.
- Re: [PR] [SPARK-58201][SQL] Optimize sliding window MIN/MAX aggregate function using monotonic deque [spark] - posted by "pavan51 (via GitHub)" <gi...@apache.org> on 2026/07/20 07:28:51 UTC, 7 replies.
- [PR] [SPARK-58216][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1069 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/20 07:34:23 UTC, 3 replies.
- [PR] [SPARK-58209][SQL] Mark stateful expressions to prevent data races [spark] - posted by "huanghanyu-vungle (via GitHub)" <gi...@apache.org> on 2026/07/20 07:51:28 UTC, 0 replies.
- [PR] [SPARK-58217][SQL] CAST(DECIMAL AS TIMESTAMP) silently produces garbage timestamps on overflow [spark] - posted by "jiangxt2 (via GitHub)" <gi...@apache.org> on 2026/07/20 09:59:42 UTC, 2 replies.
- [PR] [WIP][PYTHON] Add See Also sections to PySpark functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/20 11:14:52 UTC, 0 replies.
- [PR] [SPARK-58069][SQL][FOLLOWUP] Handle empty approx_top_k combine buffers [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/20 12:38:33 UTC, 6 replies.
- [PR] [SPARK-58218][SQL] Replace generic RuntimeException with typed exceptions in AvroDeserializer [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2026/07/20 12:58:02 UTC, 0 replies.
- [PR] [SPARK-58220][SQL] Fix scaladoc and comment errors across sql/api [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/20 13:50:42 UTC, 3 replies.
- [PR] Add `try_variant_array_append` expression [spark] - posted by "bojana-db (via GitHub)" <gi...@apache.org> on 2026/07/20 14:08:51 UTC, 0 replies.
- [PR] [SPARK-58223][SQL] Fix SparkSession.Builder.classic() building a Connect session [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/20 15:28:27 UTC, 3 replies.
- [PR] [SPARK-58224][SQL] ASOF JOIN analysis fixes found during FVT review [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/07/20 15:35:34 UTC, 4 replies.
- [PR] [SPARK-XXXXX][SQL] Honor persistentCatalogFirst for DDL on two-part s… [spark] - posted by "jiashenC (via GitHub)" <gi...@apache.org> on 2026/07/20 16:15:38 UTC, 0 replies.
- [PR] [SPARK-58225][PYTHON] Delete unused TransformWithStateInPandasSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/07/20 17:44:40 UTC, 3 replies.
- [PR] [WIP][SPARK-58227][CONNECT] Support Spark Connect in the spark-sql CLI (spark-sql --remote) [spark] - posted by "dhruv-pratap (via GitHub)" <gi...@apache.org> on 2026/07/20 18:04:53 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-57356][SDP] Implement SCD2 Batch Processor; Cleanup Delete Encoding Rows Post-Reconciliation [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/07/20 18:27:38 UTC, 2 replies.
- Re: [PR] [SPARK-51051][SQL]Add an optional parameter for `array_position` function to specify starting index for matching. [spark] - posted by "mrbrahman (via GitHub)" <gi...@apache.org> on 2026/07/20 18:43:25 UTC, 0 replies.
- Re: [PR] [SPARK-57269][SS] Enforce read-only access in the StateDateSource/StateMetadataSource [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/07/20 19:11:39 UTC, 2 replies.
- [PR] [SPARK-58160] Add Gateway API HTTPRoute/GRPCRoute support for driver endpoints [spark-kubernetes-operator] - posted by "otterc (via GitHub)" <gi...@apache.org> on 2026/07/20 20:05:52 UTC, 5 replies.
- [PR] [SPARK-58228][SQL] Convert unreachable error condition _LEGACY_ERROR_TEMP_1058 to an internal error [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/07/20 22:53:34 UTC, 0 replies.
- [PR] [POC][SPARK-51705][CONNECT][PYTHON] Support SparkSession.broadcast() (broadcast variables over Spark Connect) [spark] - posted by "Tagar (via GitHub)" <gi...@apache.org> on 2026/07/20 23:21:43 UTC, 1 replies.
- [PR] [SPARK-58229][PYSPARK] Make graphviz requirement to match the documentation [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/20 23:32:49 UTC, 2 replies.
- [PR] [SPARK-57893][CORE] Implement UserCredentialManager [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/07/21 00:14:00 UTC, 37 replies.
- Re: [PR] [SPARK-58214][PYTHON] Consolidate VALUE_NOT_PEARSON into VALUE_NOT_ALLOWED [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/21 00:33:25 UTC, 1 replies.
- Re: [PR] [SPARK-58215][ML][CONNECT] Include parameter metadata in tree regressor size estimates [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/21 00:35:38 UTC, 1 replies.
- Re: [PR] [SPARK-58219][PYTHON][DOC] Add More See Also sections to PySpark functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/21 00:39:45 UTC, 1 replies.
- Re: [PR] [SPARK-54651][CORE] Driver should delete temporary files when exiting during commit process [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/21 00:42:59 UTC, 1 replies.
- [PR] [WIP][ML] Avoid per-leaf map for tree predictions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/21 01:23:47 UTC, 1 replies.
- Re: [PR] [SPARK-58178][SQL][TEST][3.5] Expected size needs to increase [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/07/21 01:43:06 UTC, 7 replies.
- Re: [PR] [SPARK-58221] Add `try_variant_set` expression [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2026/07/21 02:01:02 UTC, 6 replies.
- Re: [PR] [SPARK-58222] Add `try_variant_array_append` expression [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2026/07/21 02:30:57 UTC, 0 replies.
- [PR] [MINOR][PYTHON] Batch missing columns in pandas-on-Spark concat [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/21 02:45:07 UTC, 0 replies.
- [PR] [SPARK-58223][SQL][4.1] Fix SparkSession.Builder.classic() building a Connect session [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/21 03:24:51 UTC, 4 replies.
- [PR] [SPARK-58231][GRAPHX] Add regression test for SVD++ aggregateMessages combiner [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/07/21 03:54:10 UTC, 0 replies.
- [PR] [SPARK-58158][CORE][UI][4.1][FOLLOWUP] Fix broken jQuery import path in executorspage.test.js [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/21 04:53:30 UTC, 5 replies.
- [PR] [SPARK-58158][CORE][UI][4.0][FOLLOWUP] Fix broken jQuery import path in executorspage.test.js [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/21 04:54:13 UTC, 5 replies.
- [PR] [SPARK-58232][SQL] Simplify cached-batch column-index resolution with a map lookup [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2026/07/21 05:21:32 UTC, 3 replies.
- [PR] [SPARK-58233][SQL] Push down local sort to reduce redundant sorts within a stage [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/07/21 06:49:23 UTC, 14 replies.
- [PR] [MINOR][PS] Use native inverse hyperbolic functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/21 06:58:37 UTC, 0 replies.
- Re: [PR] [SPARK-57521][ML][CONNECT] Use parentless copy in Model.estimatedSize to fix ML cache overcounting [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/21 07:45:26 UTC, 4 replies.
- Re: [PR] [SPARK-58234][PS] Use native functions for NumPy inverse hyperbolic ufuncs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/21 07:56:55 UTC, 1 replies.
- Re: [PR] [SPARK-58230][PS] Batch pandas-on-Spark column projections [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/21 07:58:42 UTC, 1 replies.
- Re: [PR] [SPARK-58231][GRAPHX][FOLLOW UP] Add regression test for SVD++ aggregateMessages combiner [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/07/21 08:59:34 UTC, 0 replies.
- Re: [PR] [SPARK-58222][SQL] Add `try_variant_array_append` expression [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/21 11:16:37 UTC, 1 replies.
- [PR] [SPARK-58236][SQL] Fix hash codegen dropping the CalendarInterval days field [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/21 11:48:19 UTC, 5 replies.
- [PR] [SPARK-58235][SQL] Fix Double/Float to Timestamp silent overflow clamping in non-ANSI mode [spark] - posted by "jiangxt2 (via GitHub)" <gi...@apache.org> on 2026/07/21 12:19:04 UTC, 3 replies.
- [PR] [SPARK-58238][SQL] Assign names to the error conditions _LEGACY_ERROR_TEMP_3093-3095 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/21 12:47:03 UTC, 4 replies.
- [PR] [SPARK-58237][SQL] Fix BIN BY multi-day civil-time bin boundaries to use the absolute grid [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/07/21 12:53:37 UTC, 4 replies.
- Re: [PR] [SPARK-53840][SQL][FollowUp] Make SHOW TABLE EXTENDED AS JSON match V2 metadata [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/21 13:00:51 UTC, 1 replies.
- [PR] [SPARK-58239][SQL] DML Command Outputs for DSv2 [spark] - posted by "ZiyaZa (via GitHub)" <gi...@apache.org> on 2026/07/21 13:16:26 UTC, 7 replies.
- Re: [PR] [SPARK-57465][CORE] Do not count RejectedExecutionException from a shutting-down executor toward task failures [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/21 16:32:39 UTC, 7 replies.
- Re: [PR] [SPARK-56891][CONNECT] Propagate Spark Connect session user as a SparkContext local property [spark] - posted by "hit2024 (via GitHub)" <gi...@apache.org> on 2026/07/21 16:41:11 UTC, 8 replies.
- Re: [PR] [SPARK-47013][SS] Document `spark.sql.streaming.minBatchesToRetain` config [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/21 17:09:36 UTC, 0 replies.
- [PR] [SPARK-58241][PYTHON] Fix the columnar Arrow Python UDF runner writing the input schema in the legacy protocol position [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/07/21 17:09:43 UTC, 6 replies.
- [PR] [SPARK-56968][SS] Force offset log VERSION_2 when streaming source evolution is enabled [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/07/21 17:21:54 UTC, 2 replies.
- Re: [PR] [MINOR][PYTHON][DOCS] Fix session window example usage [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/21 17:23:34 UTC, 1 replies.
- Re: [PR] [SPARK-57762][SQL] Add missing error class COLUMN_IS_NOT_VARIANT_TYPE [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/21 17:32:38 UTC, 3 replies.
- Re: [PR] [SPARK-47013][SS] Promote `spark.sql.streaming.minBatchesToRetain` to a public config [spark] - posted by "brijrajk (via GitHub)" <gi...@apache.org> on 2026/07/21 18:47:11 UTC, 3 replies.
- [PR] Bump js-yaml from 4.2.0 to 4.3.0 in /dev [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/07/21 18:57:44 UTC, 2 replies.
- [PR] Build: Test Apache Parquet 1.18.0 [spark] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/07/21 19:02:06 UTC, 0 replies.
- [PR] [SPARK-XXXX][PYTHON] Remove type: ignore[name-defined] in pyspark.sql [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/07/21 19:44:25 UTC, 0 replies.
- Re: [PR] [SPARK-38954][CORE] Cloud Credential Refresh and Distribution Without Kerberos [spark] - posted by "parthchandra (via GitHub)" <gi...@apache.org> on 2026/07/21 21:22:13 UTC, 34 replies.
- [PR] [SPARK-58242][INFRA] Move scheduled CIs for 4.2 to branch-4.2 [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/21 21:33:18 UTC, 3 replies.
- Re: [PR] [SPARK-58244][PYTHON] Remove type: ignore[name-defined] in pyspark.sql [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/21 21:38:22 UTC, 7 replies.
- [PR] [SPARK-58243][PYTHON] Remove unused ApplyInPandasWithStateSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/07/21 21:39:16 UTC, 4 replies.
- Re: [PR] [SPARK-57158][SQL] ExplainUtils: extract operator ID assignment phase from processPlan into a private helper [spark] - posted by "markj-db (via GitHub)" <gi...@apache.org> on 2026/07/21 22:16:06 UTC, 9 replies.
- [PR] [SPARK-58245] Fix AsyncEventQueue Shutdown Hang When Poison Pill Enqueue Is Interrupted [spark] - posted by "zeruibao (via GitHub)" <gi...@apache.org> on 2026/07/21 22:55:08 UTC, 2 replies.
- [PR] [SPARK-58246][SQL] Read files from 7z archives [spark] - posted by "akshatshenoi-db (via GitHub)" <gi...@apache.org> on 2026/07/22 00:23:34 UTC, 2 replies.
- [PR] [SPARK-58247][CONNECT][SDP] Support SCD Type 2 in the Auto CDC Python and Spark Connect APIs [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/07/22 00:25:58 UTC, 7 replies.
- Re: [PR] [SPARK-58227][CONNECT] Support Spark Connect in the spark-sql CLI (spark-sql --remote) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/22 00:38:03 UTC, 3 replies.
- Re: [PR] [SPARK-55787][SQL] Add is_struct_empty and is_struct_non_empty built-in functions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/22 00:41:50 UTC, 1 replies.
- Re: [PR] [SPARK-55242][PYTHON] Handle np.ndarray elements in list-valued columns when converting from pandas [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/22 00:41:52 UTC, 1 replies.
- Re: [PR] [SPARK-31561][SQL] Add QUALIFY Clause [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/22 00:41:55 UTC, 1 replies.
- Re: [PR] [SPARK-58240] Add Unified Spark CLI [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/22 00:45:37 UTC, 1 replies.
- [PR] [SPARK-55749][SQL][DOC] Clarify `array_contains` null-handling in the docs and example [spark] - posted by "comphead (via GitHub)" <gi...@apache.org> on 2026/07/22 01:29:27 UTC, 5 replies.
- [PR] [SPARK-58248][SQL] Reuse single-line inference path for JSON/XML archive inference [spark] - posted by "akshatshenoi-db (via GitHub)" <gi...@apache.org> on 2026/07/22 01:38:36 UTC, 6 replies.
- Re: [PR] [SPARK-57356][SDP] Implement SCD2 Batch Processor; Cleanup Delete Encoding Rows Post-Reconciliation [spark] - posted by "jose-torres (via GitHub)" <gi...@apache.org> on 2026/07/22 01:46:44 UTC, 10 replies.
- [PR] Revert "[MINOR][PYTHON][DOC] Fixed some links in documentation." [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/22 02:01:32 UTC, 2 replies.
- [PR] [SPARK-55020][PYTHON][FOLLOWUP] Disable GC for Config gRPC to avoid deadlock [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/22 02:07:04 UTC, 6 replies.
- [PR] [PS] Use native functions for NumPy math ufuncs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/22 02:51:13 UTC, 0 replies.
- [PR] Bump fast-uri from 3.1.2 to 3.1.4 in /dev [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/07/22 03:10:32 UTC, 2 replies.
- Re: [PR] [SPARK-57425][CONNECT][PYTHON] Make reattach iterator recover from short-TTL credential expiry [spark] - posted by "dtaniwaki (via GitHub)" <gi...@apache.org> on 2026/07/22 03:26:02 UTC, 0 replies.
- [PR] [SPARK-58241][PYTHON][4.2] Fix the columnar Arrow Python UDF runner writing the input schema in the legacy protocol position [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/07/22 03:35:56 UTC, 3 replies.
- [PR] [SPARK-58181][ML][CONNECT] Add OneVsRest size estimate [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/22 03:56:37 UTC, 0 replies.
- [PR] [WIP][MINOR][CONNECT] Use signed nanos timestamp fields [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/22 04:12:42 UTC, 0 replies.
- Re: [PR] [SPARK-58095][SQL] approx_top_k_combine throws scala.MatchError on empty input [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/07/22 04:24:06 UTC, 3 replies.
- [PR] [WIP][ML] Add feature model size estimates [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/22 04:25:59 UTC, 0 replies.
- [PR] [SPARK-58252][SQL] Throw GROUP_BY_POS_OUT_OF_RANGE for out-of-range ordinal in pipe AGGREGATE GROUP BY [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/22 04:57:28 UTC, 5 replies.
- [PR] [WIP][ML] Add size estimates for RobustScalerModel, MinMaxScalerModel, MaxAbsScalerModel, and StandardScalerModel [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/22 04:58:29 UTC, 0 replies.
- [PR] [SPARK-58254] Upgrade `swift-system` to 1.7.5 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/22 06:04:03 UTC, 5 replies.
- [PR] [SPARK-58255][BUILD] Upgrade PostgreSQL JDBC driver to 42.7.13 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/22 06:10:02 UTC, 4 replies.
- [PR] [SPARK-58256][INFRA][TEST] Fix npm vulnerabilities in ui-test and dev [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/22 06:51:48 UTC, 4 replies.
- [PR] [SPARK-58167][SPARK-57393][3.5] Build: PySpark and SparkR source distributions are missing LICENSE and NOTICE files [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/07/22 08:31:24 UTC, 2 replies.
- [PR] [SPARK-58258][PYTHON][SQL] Gate the columnar Arrow Python UDF passthrough on the vector shape matching the declared schema [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/07/22 08:41:15 UTC, 20 replies.
- Re: [PR] [SPARK-58259][BUILD] Remove redundant Jackson version declarations managed by jackson-bom [spark] - posted by "gillespeiffer-db (via GitHub)" <gi...@apache.org> on 2026/07/22 10:17:44 UTC, 2 replies.
- [PR] [SPARK-58260][SQL] Add config to render Hive DDL in SHOW CREATE TABLE for Hive tables [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/07/22 10:47:18 UTC, 9 replies.
- [PR] [SPARK-57822][SQL] Support Parquet predicate pushdown for nanosecond-precision timestamps [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/07/22 11:33:34 UTC, 5 replies.
- Re: [PR] [SPARK-58250][ML][CONNECT] Add OneVsRest size estimate [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/22 11:46:52 UTC, 1 replies.
- Re: [PR] [SPARK-58249][PS] Use native functions for NumPy math ufuncs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/22 11:49:20 UTC, 1 replies.
- Re: [PR] [SPARK-58226][SQL] Honor persistentCatalogFirst for DDL on two-part name resolution [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/22 12:25:35 UTC, 4 replies.
- [PR] [SPARK-58107][CORE][FOLLOWUP] Fix BlockManagerSuite compilation error [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/07/22 14:31:46 UTC, 3 replies.
- Re: [PR] [SPARK-57160][CONNECT][FOLLOW-UP] Use signed nanos timestamp fields [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/22 15:17:55 UTC, 2 replies.
- Re: [PR] [SPARK-58253][ML][CONNECT] Add size estimates for RobustScalerModel, MinMaxScalerModel, MaxAbsScalerModel, and StandardScalerModel [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/22 15:30:26 UTC, 4 replies.
- Re: [PR] [WIP][SPARK-58247][CONNECT][SDP] Support SCD Type 2 in the Auto CDC Python and Spark Connect APIs [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/22 15:34:48 UTC, 2 replies.
- [PR] [MINOR][SQL] Remove unused Parquet test dependencies [spark] - posted by "dossett (via GitHub)" <gi...@apache.org> on 2026/07/22 15:37:33 UTC, 4 replies.
- Re: [PR] [SPARK-49634][SQL] Remove the ANSI config suggestion in NUMERIC_VALUE_OUT_OF_RANGE.WITH_SUGGESTION [spark] - posted by "rpnkv (via GitHub)" <gi...@apache.org> on 2026/07/22 15:48:26 UTC, 0 replies.
- Re: [PR] [MINOR][PYTHON][DOCS] Improve PySpark contributing documentation wording [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/22 15:54:47 UTC, 1 replies.
- Re: [PR] [SPARK-52163][SQL] Cap estimated size in bytes at Long.MaxValue in SizeInBytesOnlyStatsPlanVisitor [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/22 15:56:17 UTC, 1 replies.
- Re: [PR] [SPARK-58251][ML][CONNECT] Add size estimates for OneHotEncoderModel, PCAModel, StringIndexerModel, and IDFModel [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/22 16:34:00 UTC, 3 replies.
- [PR] [SPARK-58262][PYTHON] Remove ArrowStreamPandasUDFSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/07/22 18:25:53 UTC, 2 replies.
- [PR] [WIP][SPARK-58261][SQL][SDP] Support SCD Type 2 syntax in SQL AUTO CDC [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/07/22 18:32:52 UTC, 0 replies.
- Re: [PR] [WIP] [SPARK-XXXXX][CORE] Concurrently schedule pipelined-shuffle stage groups in the DAGScheduler [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/07/22 18:43:55 UTC, 0 replies.
- [PR] [SPARK-54946][PYTHON][TEST] Add tests for pa.Array.to_pandas with coe… [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/07/22 19:16:41 UTC, 5 replies.
- [PR] [SPARK-58264][CONNECT][TESTS] Use OS-assigned ports in Connect server tests [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/07/22 19:51:12 UTC, 2 replies.
- [PR] [SPARK-58265][SQL] Reuse projected broadcast values for dynamic partition pruning [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/07/22 20:04:06 UTC, 15 replies.
- [PR] [SPARK-58157][PYTHON] Remove TransformWithStateInPySparkRowInitStateSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/07/22 20:29:49 UTC, 3 replies.
- Re: [PR] [SPARK-58268][PYTHON] Disable GC for Config gRPC to avoid deadlock [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/22 20:35:57 UTC, 4 replies.
- Re: [PR] [SPARK-58244][PYTHON] Remove type: ignore[name-defined] for DataFrame.plot and streaming _test() in pyspark.sql [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/07/22 20:44:27 UTC, 3 replies.
- Re: [PR] [SPARK-54946][PYTHON][TEST] Add tests for pa.Array.to_pandas with coerce_temporal_nanoseconds [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/07/22 21:10:18 UTC, 8 replies.
- [PR] [SPARK-58269][SQL] Infer generated column partition filters [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/07/22 21:21:11 UTC, 1 replies.
- [PR] [SPARK-58266][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1058 [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/07/22 21:23:36 UTC, 2 replies.
- Re: [PR] [SPARK-58261][SQL][SDP] Support SCD Type 2 syntax in SQL AUTO CDC [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/07/22 21:55:06 UTC, 11 replies.
- Re: [PR] [SPARK-55928][SQL] New linter for config effectiveness in views and UDFs [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2026/07/22 21:57:46 UTC, 4 replies.
- [PR] [SPARK-58273][SQL] Do not auto-fill generated columns for by-position schema evolution inserts [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/07/22 22:29:54 UTC, 3 replies.
- [PR] [SPARK-52246][SQL][TESTS] Add bucket transform regression test for one-side shuffle with join key tail of partition keys [spark] - posted by "naveenp2708 (via GitHub)" <gi...@apache.org> on 2026/07/22 22:42:23 UTC, 11 replies.
- [PR] [SPARK-58272][SQL] Enable runtime Bloom filters for materialized cached inputs [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/07/22 22:48:06 UTC, 13 replies.
- Re: [PR] [SPARK-58175][SQL][PROTOBUF] Cache descriptor trees built from a binary FileDescriptorSet [spark] - posted by "dbtsai (via GitHub)" <gi...@apache.org> on 2026/07/22 23:26:49 UTC, 7 replies.
- Re: [PR] [SPARK-57638][SQL] Avoid busy-waiting in Declarative Pipelines flow resolution [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/07/22 23:45:37 UTC, 4 replies.
- [PR] [WIP][SPARK-57378][SDP] Implement SCD2 Batch Processor; Merge Reconciled Rows into Aux and Target Tables [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/07/22 23:48:38 UTC, 0 replies.
- [PR] [SPARK-58267][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1059 [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/07/22 23:54:09 UTC, 1 replies.
- Re: [PR] [SPARK-56337][SQL] Propagate analyzed sizeInBytes to V2 FileScan estimates [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/23 00:43:47 UTC, 1 replies.
- Re: [PR] [SPARK-56371][SQL] Support _metadata.row_index for V2 Parquet reads [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/23 00:43:52 UTC, 1 replies.
- Re: [PR] [SPARK-56335][SQL] Implement SupportsMetadataColumns in FileTable [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/23 00:43:57 UTC, 1 replies.
- Re: [PR] [SPARK 55879] [Web UI] copy sql to clipboard [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/23 00:44:01 UTC, 1 replies.
- Re: [PR] [SPARK-56388][CONNECT] Add XML support to Spark Connect Parse protocol [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/23 00:44:05 UTC, 1 replies.
- Re: [I] KLL_INVALID_INPUT_SKETCH_BUFFER error when empty KLL sketch is read [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/23 00:44:10 UTC, 0 replies.
- [PR] [SPARK-58276][PYTHON] Consolidate serializer selection branches in worker.py [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/07/23 01:00:36 UTC, 3 replies.
- Re: [PR] [SPARK-58263][CORE] Concurrently schedule pipelined-shuffle stage groups in the DAGScheduler [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/07/23 01:02:26 UTC, 24 replies.
- [PR] [WIP][ML] Estimate size of Univariate, ChiSq, Variance selector, and Imputer models [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/23 01:03:11 UTC, 0 replies.
- [PR] [WIP][ML] Estimate size of TargetEncoder, VectorIndexer, CountVectorizer, and MinHashLSH models [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/23 01:05:01 UTC, 0 replies.
- [PR] [WIP][ML] Estimate size of BucketedRandomProjectionLSH, Word2Vec, and RFormula models [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/23 01:07:55 UTC, 0 replies.
- [PR] [SPARK-58275][SQL][PYTHON] Add `normalize` Unicode normalization SQL … [spark] - posted by "SreeramaYeshwanthGowd (via GitHub)" <gi...@apache.org> on 2026/07/23 01:08:14 UTC, 2 replies.
- [PR] [WIP][ML] Avoid parent overcounting in PipelineModel size estimates [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/23 02:02:34 UTC, 0 replies.
- [PR] [SPARK-58282][PYTHON][DOCS] Refresh PySpark README and clarify project scope [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/07/23 03:06:09 UTC, 13 replies.
- [PR] [SPARK-58277][SQL] Stream DataType JSON serialization [spark] - posted by "marcuslin123 (via GitHub)" <gi...@apache.org> on 2026/07/23 03:10:19 UTC, 3 replies.
- [PR] [SPARK-58277][SQL] Stream DataType.json to bound peak memory for large schemas [spark] - posted by "bhollis-dbx (via GitHub)" <gi...@apache.org> on 2026/07/23 04:25:58 UTC, 2 replies.
- [PR] [SPARK-52825][SQL] Add JDBC dialect URL aliases [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/23 04:53:10 UTC, 0 replies.
- Re: [PR] [SPARK-58111][SQL] Scan and write schema narrowing for column-level UPDATE in DSv2 [spark] - posted by "anuragmantri (via GitHub)" <gi...@apache.org> on 2026/07/23 06:11:10 UTC, 1 replies.
- [PR] [SPARK-58283][SQL] Assign names to the error conditions _LEGACY_ERROR_TEMP_1138-1141 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/23 06:19:01 UTC, 4 replies.
- [PR] [SPARK-58284] Remove duplicated NetworkPolicy creation in favor of `NetworkPolicyFeatureStep` of Spark 4.2 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/23 06:48:52 UTC, 3 replies.
- [PR] [INFRA] Remove stale PySpark CI dependency bypass [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/23 06:55:33 UTC, 0 replies.
- [PR] branch-1.0 CI Test [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/23 07:09:40 UTC, 1 replies.
- [PR] [SPARK-58288] Bump version to 1.1.0-SNAPSHOT in `main` branch [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/23 07:21:09 UTC, 3 replies.
- [PR] [SPARK-58289] Add `dev/prepare_release.py` to automate release version preparation [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/23 07:53:15 UTC, 3 replies.
- Re: [PR] [SPARK-58285][INFRA] Remove stale container CI dependency bypasses [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/23 08:12:07 UTC, 3 replies.
- [PR] [SPARK-58287] Add `dev/bump_maintenance_version.py` to bump maintenance version with dev postfix [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/23 08:27:39 UTC, 2 replies.
- [PR] [MINOR][PS] Test native NumPy ufuncs with special values [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/23 10:12:17 UTC, 0 replies.
- [PR] [SPARK-58290][SQL] Fix O(n^2) partition index access in ShufflePartitionsUtil.coalescePartitionsWithSkew [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/07/23 10:30:23 UTC, 3 replies.
- Re: [PR] [SPARK-57699][DOCS] Update docs/control-flow/leave-stmt.md [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2026/07/23 10:30:49 UTC, 0 replies.
- Re: [PR] [SPARK-52825][SQL] Register existing dialects for additional URL prefixes [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/23 10:37:18 UTC, 8 replies.
- Re: [PR] [SPARK-58280][ML][CONNECT] Estimate size of BucketedRandomProjectionLSH and Word2Vec models [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/23 10:41:59 UTC, 2 replies.
- Re: [PR] [SPARK-58281][ML][CONNECT] Avoid parent overcounting in PipelineModel size estimates [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/23 10:50:10 UTC, 3 replies.
- Re: [PR] [SPARK-58275][SQL][PYTHON] Add `normalize` Unicode normalization SQL function [spark] - posted by "SreeramaYeshwanthGowd (via GitHub)" <gi...@apache.org> on 2026/07/23 10:50:47 UTC, 1 replies.
- Re: [PR] [SPARK-58279][ML][CONNECT] Estimate size of TargetEncoder, VectorIndexer, CountVectorizer, and MinHashLSH models [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/23 10:51:18 UTC, 3 replies.
- [PR] [SPARK-58291][SQL] Guard statistical-aggregate merge against empty-buffer overflow to NaN [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/07/23 11:13:51 UTC, 6 replies.
- [PR] [WIP][INFRA] Add precise AI test selection to post-merge CI [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/23 12:04:22 UTC, 0 replies.
- [PR] [SPARK-58292][CORE] Recreate the netty worker EventLoopGroup when a worker event loop thread dies [spark] - posted by "ChuckLin2025 (via GitHub)" <gi...@apache.org> on 2026/07/23 12:06:29 UTC, 10 replies.
- [I] Derby jar update [spark] - posted by "yjphhw (via GitHub)" <gi...@apache.org> on 2026/07/23 12:15:41 UTC, 4 replies.
- Re: [PR] [SPARK-57590][SQL] Read and infer Parquet schema from archives [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/23 12:22:14 UTC, 2 replies.
- Re: [PR] [SPARK-58278][ML][CONNECT] Estimate size of Univariate, ChiSq, Variance selector, and Imputer models [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/23 12:44:50 UTC, 1 replies.
- [PR] [SPARK-58294][SQL] Fix Hive UDAF with two aggregation buffers in Complete mode [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/07/23 13:08:22 UTC, 3 replies.
- [PR] [SPARK-58107][FOLLOWUP][CORE] Fix stale identifier in local-checkpoint self-check comment [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2026/07/23 13:13:55 UTC, 3 replies.
- [PR] [SPARK-58295][SQL][PYTHON] Add `to_base32` and `from_base32` built-in… [spark] - posted by "SreeramaYeshwanthGowd (via GitHub)" <gi...@apache.org> on 2026/07/23 13:55:48 UTC, 0 replies.
- [PR] committed [spark] - posted by "suhel657 (via GitHub)" <gi...@apache.org> on 2026/07/23 14:11:31 UTC, 3 replies.
- Re: [PR] [MINOR][BUILD] Remove unused Parquet test dependencies [spark] - posted by "dossett (via GitHub)" <gi...@apache.org> on 2026/07/23 14:17:57 UTC, 3 replies.
- [PR] [SPARK-57518][SQL][FOLLOWUP] List ThriftServer schemas via SupportsNamespaces instead of special-casing spark_catalog [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/07/23 16:54:41 UTC, 11 replies.
- [PR] [SPARK-58274][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1068 [spark] - posted by "Ma77Ball (via GitHub)" <gi...@apache.org> on 2026/07/23 19:06:14 UTC, 0 replies.
- [PR] [SPARK-58297][PYTHON] Remove TransformWithStateInPySparkRowSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/07/23 19:23:42 UTC, 2 replies.
- [PR] Bump json from 2.12.2 to 2.19.9 in /docs [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/07/23 20:14:31 UTC, 2 replies.
- [PR] [SPARK-58298][PYTHON] Reduce the expected progress for streaming data source tests [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/23 20:18:17 UTC, 2 replies.
- Re: [PR] [SPARK-56498][SS] Implement decoupled state store maintenance [spark] - posted by "liviazhu (via GitHub)" <gi...@apache.org> on 2026/07/23 20:48:00 UTC, 0 replies.
- [PR] [SPARK-58299] Upgrade `Iceberg` example to use Spark 4.1.2 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/23 21:12:19 UTC, 3 replies.
- [PR] [SPARK-58300][PROTOBUF] Add from_protobuf option to keep Timestamp/Duration as struct [spark] - posted by "bhollis-dbx (via GitHub)" <gi...@apache.org> on 2026/07/23 21:17:23 UTC, 0 replies.
- [PR] [SPARK-58301] Upgrade `Apache DataFusion Comet` to 0.17.1 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/23 21:20:38 UTC, 3 replies.
- [PR] [SPARK-58303] Declare least-privilege `permissions` in GitHub Actions workflows [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/23 21:39:38 UTC, 3 replies.
- [PR] [SPARK-58302][INFRA] Remove the unused dev/infra/Dockerfile base image [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/23 21:42:10 UTC, 3 replies.
- [PR] [SPARK-58304] Simplify examples to show only feature-specific configurations [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/23 22:05:59 UTC, 3 replies.
- [PR] [SPARK-40945][SQL][PYTHON] Add `truncate` function [spark] - posted by "SreeramaYeshwanthGowd (via GitHub)" <gi...@apache.org> on 2026/07/23 22:07:25 UTC, 0 replies.
- [PR] [SPARK-58306] Use `ubuntu-26.04(-arm)?` in GitHub Action jobs [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/23 22:16:30 UTC, 3 replies.
- [PR] [SPARK-58305][PYTHON] Clarify jinja2 usage [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/23 22:18:45 UTC, 3 replies.
- [PR] [SPARK-58308][INFRA] Remove usage of ipython_genutils [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/23 22:30:01 UTC, 3 replies.
- [PR] [SPARK-58307][SQL][PYTHON] Add json_typeof function [spark] - posted by "SreeramaYeshwanthGowd (via GitHub)" <gi...@apache.org> on 2026/07/23 22:55:27 UTC, 2 replies.
- [PR] [SPARK-58309][SS] Anchor now() and current_time() to the batch timestamp in streaming queries [spark] - posted by "PorridgeSwim (via GitHub)" <gi...@apache.org> on 2026/07/23 23:22:29 UTC, 1 replies.
- Re: [PR] [SPARK-38954][CORE][4.x] Cloud Credential Refresh and Distribution Without Kerberos [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/23 23:24:09 UTC, 2 replies.
- [PR] [SPARK-58311][SQL] Gate generated column values on write with a table capability [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/07/24 00:04:38 UTC, 5 replies.
- [PR] [SPARK-58312][PYTHON] Remove unnecessary type: ignore comments in pyspark.sql.udf and group [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/07/24 00:16:24 UTC, 3 replies.
- Re: [PR] [SPARK-57378][SDP] Implement SCD2 Batch Processor; Merge Reconciled Rows into Aux and Target Tables [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/07/24 00:28:33 UTC, 4 replies.
- [PR] [SPARK-58293][ML] Delay VectorIndexerModel attribute initialization [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/24 00:33:20 UTC, 2 replies.
- Re: [PR] [SPARK-54055][CONNECT][PYTHON] Clean up per-session PythonWorkerFactory [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/24 00:40:42 UTC, 1 replies.
- Re: [PR] [SPARK-56171][SQL] Enable V2 file write path for non-partitioned DataFrame API writes and delete `FallBackFileSourceV2` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/24 00:40:48 UTC, 1 replies.
- Re: [I] dropDuplicates(columns) followed by ExceptAll results in INTERNAL_ERROR_ATTRIBUTE_NOT_FOUND [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/24 00:40:51 UTC, 0 replies.
- [PR] [SPARK-43086][CORE] Add configurable bin-packing task placement [spark] - posted by "starcatmeow (via GitHub)" <gi...@apache.org> on 2026/07/24 01:29:58 UTC, 8 replies.
- Re: [PR] [SPARK-58249][SPARK-58234][PS][TEST][FOLLOWUP] Test native NumPy ufuncs with special values [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/24 01:31:56 UTC, 1 replies.
- [PR] [SPARK-58310][SQL] Avoid runtime Bloom-filter subqueries containing Python UDFs [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/07/24 02:58:49 UTC, 10 replies.
- [PR] [SPARK-58296][SQL] Fix to_time returning STRING type when the format is a foldable NULL [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/24 03:06:49 UTC, 3 replies.
- [PR] [SPARK-58315][SQL] Refactor V2 scan statistics handling [spark] - posted by "yyanyy (via GitHub)" <gi...@apache.org> on 2026/07/24 04:28:49 UTC, 15 replies.
- [PR] [SPARK-57251][SQL] Validate SCD2 reserved framework columns at AutoCDC flow construction [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/07/24 04:30:30 UTC, 0 replies.
- [PR] [SPARK-58296][SQL] Fix to_time return type with null format [spark] - posted by "mohammadsubhani (via GitHub)" <gi...@apache.org> on 2026/07/24 04:39:22 UTC, 1 replies.
- [PR] [SPARK-58313][SQL] Validate SCD2 track-history columns at AutoCDC flow construction [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/07/24 05:03:28 UTC, 0 replies.
- [PR] [SPARK-58317][SQL] Union output partitioning should support PartitioningCollection children [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/07/24 05:12:08 UTC, 12 replies.
- [PR] [MINOR][BUILD] Drop retired oro dependency [spark] - posted by "ybapat (via GitHub)" <gi...@apache.org> on 2026/07/24 05:19:20 UTC, 1 replies.
- [PR] [MINOR][CONNECT] Remove redundant user_context.user_id assignment in execute_command methods [spark] - posted by "ybapat (via GitHub)" <gi...@apache.org> on 2026/07/24 05:19:31 UTC, 5 replies.
- Re: [I] [Quick Question] Duplicate set of user_context in SparkConnect Client [spark] - posted by "ybapat (via GitHub)" <gi...@apache.org> on 2026/07/24 05:19:45 UTC, 2 replies.
- [I] [K8S][CORE] Heartbeat-timeout executor replacement may be classified as ExecutorKilled and skip task failure counting [spark] - posted by "lan1994 (via GitHub)" <gi...@apache.org> on 2026/07/24 05:21:01 UTC, 0 replies.
- [PR] [SPARK-57395][SDP] Implement SCD2 Batch Processor; foreachBatch Callback [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/07/24 05:25:37 UTC, 20 replies.
- [PR] [SPARK-58319][SDP] Derive SCD2 AutoCDC target table schema [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/07/24 06:03:11 UTC, 8 replies.
- [PR] [SPARK-51975][SQL] Add variant_from_arrays and variant_from_entries [spark] - posted by "SreeramaYeshwanthGowd (via GitHub)" <gi...@apache.org> on 2026/07/24 07:08:50 UTC, 4 replies.
- [I] [CORE] bug report: collision of resource profile id [spark] - posted by "rterror (via GitHub)" <gi...@apache.org> on 2026/07/24 08:09:52 UTC, 1 replies.
- [PR] [SPARK-58107][CORE][FOLLOWUP] Keep the local-checkpoint sealed checksum as a tombstone past last-replica loss [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2026/07/24 09:22:43 UTC, 3 replies.
- Re: [PR] [SPARK-58221][SQL] Add `try_variant_set` expression [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/24 11:26:09 UTC, 1 replies.
- [PR] [SPARK-56942][SQL] Support nested field references as row-level opera… [spark] - posted by "EamesTrinh (via GitHub)" <gi...@apache.org> on 2026/07/24 11:42:06 UTC, 0 replies.
- Re: [PR] [SPARK-57251][SDP] Validate SCD2 reserved framework columns at AutoCDC flow construction [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/24 12:38:57 UTC, 10 replies.
- Re: [PR] [SPARK-56942][SQL] Support nested field references as row-level operation row IDs [spark] - posted by "EamesTrinh (via GitHub)" <gi...@apache.org> on 2026/07/24 13:50:39 UTC, 10 replies.
- [PR] [MINOR][DOCS] Use AGENTS.md for nested project instructions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/24 14:32:15 UTC, 4 replies.
- [PR] [SPARK-58323][SQL] Materialize AliasAware output ordering and partitioning to avoid StackOverflowError [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/07/24 15:35:24 UTC, 5 replies.
- [PR] [SPARK-58324][SQL] Drop unused sameOrderExpressions from GroupPartitionsExec k-way merge ordering [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/07/24 16:01:53 UTC, 3 replies.
- [PR] [SPARK-58013][PS] Fix loc setitem dropping writes for reordered columns on pandas 3 [spark] - posted by "Vivek1106-04 (via GitHub)" <gi...@apache.org> on 2026/07/24 16:27:32 UTC, 2 replies.
- [PR] [SPARK-58326][K8S] Pin MinIO image version in DepsTestsSuite [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/24 18:08:00 UTC, 0 replies.
- [PR] [SPARK-58328] Remove stale TODO comments from `DriverKubernetesCredentialsFeatureStep` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/24 18:20:52 UTC, 0 replies.
- [PR] [SPARK-58314][PYTHON] Remove ArrowStreamUDFSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/07/24 18:39:01 UTC, 4 replies.
- Re: [PR] [SPARK-58326][K8S][TESTS] Pin MinIO image version in DepsTestsSuite [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/24 19:35:55 UTC, 3 replies.
- Re: [PR] [SPARK-58328][K8S] Remove stale TODO comments from `DriverKubernetesCredentialsFeatureStep` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/24 19:36:14 UTC, 3 replies.
- [PR] [SPARK-58330] [SQL] Prevent silent dropping of dynamic options on same table references in DML [spark] - posted by "anuragmantri (via GitHub)" <gi...@apache.org> on 2026/07/24 20:00:40 UTC, 1 replies.
- [PR] [SPARK-57271][PYTHON] Propagate traceback locals to Python planner runner [spark] - posted by "linhongliu-db (via GitHub)" <gi...@apache.org> on 2026/07/24 20:02:57 UTC, 2 replies.
- [PR] [SPARK-58331] Use Java-friendly `sparkVersion` API instead of `labels` override in `SparkAppDriverConf` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/24 20:03:27 UTC, 3 replies.
- [PR] [SPARK-58332][PYTHON][TEST] Move compare_or_generate_golden_matrix into GoldenFileTestMixin [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/07/24 20:06:05 UTC, 5 replies.
- [PR] [SPARK-58333][K8S] Add Java-friendly constructor to `KubernetesDriverConf` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/24 20:16:31 UTC, 4 replies.
- [PR] [SPARK-58334][K8S][DOCS] Introduce Apache Spark Kubernetes Operator in `running-on-kubernetes.md` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/24 20:40:13 UTC, 0 replies.
- [PR] [SPARK-58335][K8S][TESTS] Add `SparkKubernetesClientFactorySuite` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/24 20:46:57 UTC, 4 replies.
- [PR] [SPARK-58336] Support `Column` expression type and `functions` API [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/24 21:29:34 UTC, 3 replies.
- [PR] [SPARK-58337] Fix `StreamingQuery.exception()` to return `nil` when no exception exists [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/24 21:34:36 UTC, 3 replies.
- [PR] [SPARK-58338] Fix `defineFlow` to send `relation` via `relation_flow_details` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/24 21:39:24 UTC, 3 replies.
- [PR] [SPARK-58339] Send `RemoveCachedRemoteRelationCommand` when checkpointed `DataFrame` is deallocated [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/24 21:42:23 UTC, 3 replies.
- [PR] [SPARK-58320][SDP] Build SCD2 AutoCDC auxiliary table spec [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/07/24 21:42:43 UTC, 2 replies.
- [PR] [SPARK-58340][PYSPARK] Add missing package to pyproject.toml for lint [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/24 22:21:43 UTC, 3 replies.
- Re: [PR] [SPARK-57878][CORE] Add task assignment strategy to support binpack/balance task scheduling [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/24 22:36:27 UTC, 4 replies.
- [PR] [SPARK-58341][SQL] Fix binding order of 5+ positional parameters in `sql` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/24 22:42:15 UTC, 0 replies.
- Re: [PR] [SPARK-58341][SQL] Fix wrong results with 5+ positional parameters in `sql` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/24 22:55:10 UTC, 6 replies.
- [PR] [SPARK-58342][SDP] Add unit tests for the SCD1 AutoCDC auxiliary table spec [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/07/25 00:12:02 UTC, 2 replies.
- Re: [PR] [SPARK-58334][K8S][DOCS] Introduce Apache Spark K8s Operator in `running-on-kubernetes.md` [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/25 00:12:46 UTC, 3 replies.
- [PR] [SPARK-58343][SQL][TESTS] Add unit test for TypeUtils.typeWithProperEquals [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/25 00:24:51 UTC, 3 replies.
- [PR] [SPARK-58344] Support Arrow `Null` type to fix `collect()` crash on void columns [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/25 00:36:00 UTC, 3 replies.
- [PR] [MINOR][SS] Use filterNot in HDFSBackedStateStoreProvider snapshot filtering [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/25 00:36:31 UTC, 3 replies.
- [PR] [SPARK-58345] Handle Arrow message load failures in `DataFrame.execute` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/25 00:39:36 UTC, 3 replies.
- Re: [I] Can't install prerelease using pip because version check doesn't like the version number. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/25 00:43:58 UTC, 0 replies.
- Re: [PR] [SPARK-40328][PS] Implement DataFrame.compare [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/25 00:44:00 UTC, 1 replies.
- [PR] [MINOR][DOCS] Fix typo 'commited' in state data source docs [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/25 00:44:59 UTC, 3 replies.
- Re: [PR] [SPARK-58313][SDP] Validate SCD2 track-history columns at AutoCDC flow construction [spark] - posted by "jose-torres (via GitHub)" <gi...@apache.org> on 2026/07/25 00:52:08 UTC, 8 replies.
- [PR] [SPARK-58346][PYTHON] Remove unnecessary type: ignore[union-attr] comments in PySpark [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/07/25 01:13:29 UTC, 4 replies.
- Re: [PR] [SPARK-57665][SQL] Fix slice() returning empty for large length in the interpreted path [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/07/25 02:18:23 UTC, 0 replies.
- [PR] [MINOR][PYTHON] Fix wrong expected_type in DataFrame.sort ascending type error [spark] - posted by "nikolauspschuetz (via GitHub)" <gi...@apache.org> on 2026/07/25 03:51:51 UTC, 1 replies.
- [PR] [SPARK-58348][PYTHON][DOCS] Move PySpark error doc header into global variable [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/07/25 04:13:31 UTC, 3 replies.
- [PR] [SPARK-58322][CORE] Verify executor app ID matches driver at config fetch [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2026/07/25 04:35:36 UTC, 2 replies.
- [PR] [SPARK-57805][SQL] Support TimestampNTZ, ANSI interval, and TIME in CBO estimation [spark] - posted by "johntomcat7408-cmyk (via GitHub)" <gi...@apache.org> on 2026/07/25 06:10:19 UTC, 1 replies.
- [PR] Spark 57251 reserved columns v2 [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/07/25 07:21:13 UTC, 0 replies.
- Re: [PR] [SPARK-58295][SQL][PYTHON] Add `to_base32` and `from_base32` functions [spark] - posted by "SreeramaYeshwanthGowd (via GitHub)" <gi...@apache.org> on 2026/07/25 12:20:19 UTC, 0 replies.
- [PR] [SPARK-48290][CORE] Record skewed shuffle block sizes by default so that AQE can detect skew [spark] - posted by "Vivek1106-04 (via GitHub)" <gi...@apache.org> on 2026/07/25 13:06:40 UTC, 4 replies.
- [PR] [MINOR][PYTHON][DOCS] Added Returns and See Also sections in pyspark.sql.functions documentation. [spark] - posted by "art000109 (via GitHub)" <gi...@apache.org> on 2026/07/25 15:10:35 UTC, 4 replies.
- [I] [DISCUSS][CORE] Should managed off-heap memory take the container limit into account? [spark] - posted by "920032148 (via GitHub)" <gi...@apache.org> on 2026/07/25 15:30:04 UTC, 0 replies.
- Re: [PR] [SPARK-58330][SQL] Prevent silent dropping of dynamic options on same table references in DML [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/07/25 16:31:46 UTC, 3 replies.
- [PR] [SPARK-58323][SQL][4.1] Materialize AliasAware output ordering and partitioning to avoid StackOverflowError [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/07/25 16:46:58 UTC, 3 replies.
- [PR] [SPARK-58323][SQL][4.0] Materialize AliasAware output ordering and partitioning to avoid StackOverflowError [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/07/25 16:55:54 UTC, 3 replies.
- [PR] [SPARK-58323][SQL][3.5] Materialize AliasAware output ordering and partitioning to avoid StackOverflowError [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/07/25 17:18:26 UTC, 3 replies.
- [I] [SQL] Add CASE WHEN equivalent for the DECODE function [spark] - posted by "art000109 (via GitHub)" <gi...@apache.org> on 2026/07/25 18:23:28 UTC, 1 replies.
- [I] [SQL] EXTRACT and DATE_PART function for 'SECOND' parameter returns decimal(8,6), otherwise SECOND function returns integer [spark] - posted by "art000109 (via GitHub)" <gi...@apache.org> on 2026/07/25 18:27:26 UTC, 0 replies.
- [PR] [MINOR][DOCS] Fix typos and add missing references to standalone and YARN deployment docs [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/07/25 18:51:25 UTC, 2 replies.
- Re: [I] Webpage for downloading binaries is broken [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/26 00:47:20 UTC, 0 replies.
- Re: [PR] [SPARK-53440][PYTHON] Allow Column.transform() to accept SQL lambda expression strings [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/26 00:47:23 UTC, 1 replies.
- Re: [PR] [SPARK-42025][SHUFFLE] Improve logs level in removeBlocks [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/26 00:47:25 UTC, 1 replies.
- Re: [PR] [MINOR][SQL] SQL state code change from XX000 to 42704 for MISSING_ATTRIBUTES [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/26 00:47:27 UTC, 1 replies.
- [PR] [SPARK-58349][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1081 [spark] - posted by "gatorsmile (via GitHub)" <gi...@apache.org> on 2026/07/26 05:20:17 UTC, 1 replies.
- [PR] [SPARK-58350][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1228 [spark] - posted by "gatorsmile (via GitHub)" <gi...@apache.org> on 2026/07/26 05:50:25 UTC, 1 replies.
- [PR] [SPARK-58351][CORE] Assign a name to the error condition _LEGACY_ERROR_TEMP_3014 [spark] - posted by "gatorsmile (via GitHub)" <gi...@apache.org> on 2026/07/26 06:00:33 UTC, 0 replies.
- [PR] [SPARK-58352][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_2070 [spark] - posted by "gatorsmile (via GitHub)" <gi...@apache.org> on 2026/07/26 06:58:30 UTC, 1 replies.
- [PR] [MINOR][ML] Fix doubled word in HasTrainingSummary scaladoc [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/26 11:23:53 UTC, 3 replies.
- [PR] [SPARK-58353][CONNECT] Extract parseExplainMode helper in Connect Dataset [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/26 11:25:29 UTC, 3 replies.
- [PR] [MINOR][DOCS] Fix grammar in spark.speculation.efficiency.processRateMultiplier doc [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/26 11:26:09 UTC, 3 replies.
- [PR] [SPARK-58354][PYTHON] Remove unused ArrowStreamPandasSerializer base class [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/07/26 15:10:16 UTC, 4 replies.
- [PR] [MINOR][CONNECT][PYTHON] Fix stale running-task count in progress bar [spark] - posted by "fallintoplace (via GitHub)" <gi...@apache.org> on 2026/07/26 19:37:21 UTC, 8 replies.
- Re: [I] OracleDialect: Hardcoded scale of 10 in Decimal(38,10) causes silent precision loss for bare NUMBER columns [spark] - posted by "ru-mi10 (via GitHub)" <gi...@apache.org> on 2026/07/26 21:05:04 UTC, 2 replies.
- [PR] [SPARK-58355][SS] Fix grammar in metadata log null-check message [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/26 22:43:38 UTC, 2 replies.
- [PR] [SPARK-58356][CORE] Use exists instead of filter(...).nonEmpty in MasterPage [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/26 22:44:06 UTC, 2 replies.
- [PR] [SPARK-58357][SQL] Remove unused withCatalogIdentClause in SparkSqlAstBuilder [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/26 22:44:30 UTC, 2 replies.
- Re: [PR] [SPARK-58013][PS][PYTHON] Support pandas 3 in pandas-on-Spark tests [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/26 22:54:46 UTC, 0 replies.
- [PR] [SPARK-47232][UI] Fix Spark UI tab links and inline scripts in Standalone mode with reverse proxy [spark] - posted by "Nflrijal (via GitHub)" <gi...@apache.org> on 2026/07/27 00:31:24 UTC, 6 replies.
- [PR] [SPARK-58358][SQL] Add tag validation to removeTag [spark] - posted by "jubins (via GitHub)" <gi...@apache.org> on 2026/07/27 00:32:27 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-56514][SQL] Allow catalog Table objects to be passed directly to read.table() and writeTo() [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/27 00:47:11 UTC, 1 replies.
- Re: [PR] [SPARK-56355][SQL] Improve join stats estimation when equi-join keys lack column statistics [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/27 00:47:14 UTC, 1 replies.
- Re: [I] Why didn't the Executor fail after the Shuffle connection timeout? [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/27 00:47:17 UTC, 0 replies.
- Re: [PR] [SPARK-55869][SQL] Extended Predicate Pushdown for DataSource V2 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/27 00:47:18 UTC, 1 replies.
- Re: [PR] [SPARK-40945][SQL][PYTHON] Add truncate function [spark] - posted by "SreeramaYeshwanthGowd (via GitHub)" <gi...@apache.org> on 2026/07/27 00:55:08 UTC, 1 replies.
- [PR] [SPARK-58359][SQL] Require the arguments field in built-in function documentation [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/07/27 01:09:40 UTC, 6 replies.
- [PR] [WIP][ML] Avoid nested parent overcount in RFormulaModel size estimate [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/27 02:53:44 UTC, 0 replies.
- [PR] [WIP][ML] Include clustering model metadata in size estimates [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/27 03:12:46 UTC, 0 replies.
- [PR] [WIP][ML] Include ALS metadata in size estimates [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/27 03:38:29 UTC, 0 replies.
- Re: [PR] [WIP][INFRA] Add smart class-level test selection for post-merge CI [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/27 03:40:56 UTC, 3 replies.
- [PR] [WIP][INFRA] Run post-merge build every five commits [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/27 04:42:40 UTC, 0 replies.
- [PR] [SPARK-58363][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_2214-2219 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/27 05:15:43 UTC, 5 replies.
- [PR] [SPARK-58364][CORE] Rename the configuration namespace from `spark.security.credentials` to `spark.security.oidc` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/07/27 05:22:32 UTC, 5 replies.
- Re: [PR] [SPARK-56460][CORE] Define configs in text files [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/27 05:45:38 UTC, 2 replies.
- [I] sparkcluster resource master starts with port 7070 instead of 7077 [spark-kubernetes-operator] - posted by "christiangierschner (via GitHub)" <gi...@apache.org> on 2026/07/27 06:18:24 UTC, 0 replies.
- [PR] [SPARK-58365][SQL] Build the NOT-IN-in-disjunction join condition from the deduplicated subquery output [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/27 06:54:37 UTC, 4 replies.
- [PR] [SPARK-58366][SQL] Support JSON_TABLE table-valued function [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2026/07/27 07:21:47 UTC, 4 replies.
- [PR] [SPARK-58369][CONNECT][TESTS] Introduce a way to `SparkConnectServiceKeepAliveSuite` to wait until unbinding a port is complete [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/07/27 08:18:05 UTC, 3 replies.
- [I] [SQL] Clarify bitmap_or_agg / bitmap_and_agg input contract: fixed 4096-byte vs. variable-length bitmaps [spark] - posted by "minni31 (via GitHub)" <gi...@apache.org> on 2026/07/27 08:23:23 UTC, 2 replies.
- [PR] [SPARK-58249][PS][FOLLOWUP] Use native function for NumPy invert [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/27 09:28:33 UTC, 3 replies.
- [PR] [SPARK-58370][SQL] Check table write privileges when the write target is also read in the same statement [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/07/27 10:24:22 UTC, 4 replies.
- [PR] [SPARK-XXXXX][SQL] Truncate fractional to integral casts pushed down to JDBC sources [spark] - posted by "marko-sisovic-db (via GitHub)" <gi...@apache.org> on 2026/07/27 10:27:45 UTC, 0 replies.
- Re: [PR] [SPARK-49828][SQL] Expose ColumnNode to/from Expression utils as developer APIs [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/07/27 11:11:10 UTC, 0 replies.
- Re: [PR] [SQL] Truncate fractional to integral casts pushed down to JDBC sources [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2026/07/27 13:27:29 UTC, 8 replies.
- Re: [PR] [SPARK-58367][ML][CONNECT] Include ALS metadata in size estimates [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/27 13:35:17 UTC, 2 replies.
- Re: [PR] [SPARK-58361][ML][CONNECT] Include clustering model metadata in size estimates [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/27 13:36:25 UTC, 2 replies.
- Re: [PR] [SPARK-58360][ML][CONNECT] Avoid nested parent overcount in RFormulaModel size estimate [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/27 13:43:31 UTC, 2 replies.
- [PR] [SPARK-58371][DOC] Update `json` gem version to 2.21.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/27 14:22:39 UTC, 3 replies.
- Re: [PR] [SPARK-58372][SQL] Truncate fractional to integral casts pushed down to JDBC sources [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/27 14:38:32 UTC, 7 replies.
- Re: [PR] [SPARK-58322][CORE] Verify executor app ID at registration time [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2026/07/27 14:55:04 UTC, 4 replies.
- [PR] [SPARK-57498][CORE] Fix ResourceProfile ID collision when custom profile is created before default [spark] - posted by "ybapat (via GitHub)" <gi...@apache.org> on 2026/07/27 15:09:29 UTC, 0 replies.
- [PR] [SPARK-57561][SQL] Add size validation to bitmap_or_agg and bitmap_and_agg [spark] - posted by "ybapat (via GitHub)" <gi...@apache.org> on 2026/07/27 15:09:49 UTC, 1 replies.
- [PR] [SPARK-57534][PYSPARK] Expose multi-argument Oracle-style decode() in PySpark [spark] - posted by "ybapat (via GitHub)" <gi...@apache.org> on 2026/07/27 15:10:23 UTC, 1 replies.
- Re: [PR] [SPARK-57635][SQL] Make Declarative Pipelines run-termination reason deterministic [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/27 15:22:47 UTC, 3 replies.
- [PR] [SPARK-58374][BUILD] Upgrade `joda-time` to 2.14.3 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/27 16:27:16 UTC, 4 replies.
- [PR] [SPARK-58375][BUILD] Upgrade `ap-loader` to 4.5-13 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/27 16:30:49 UTC, 4 replies.
- [PR] [SPARK-57638][4.1][SQL] Avoid busy-waiting in Declarative Pipelines flow resolution [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/27 16:36:37 UTC, 3 replies.
- [PR] [SPARK-58376][BUILD] Upgrade `byte-buddy` to 1.18.11 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/27 16:37:05 UTC, 4 replies.
- [PR] [POC][SPARK-51705][CONNECT][SCALA] Support SparkSession.broadcast() for Scala UDFs over Spark Connect [spark] - posted by "Tagar (via GitHub)" <gi...@apache.org> on 2026/07/27 16:38:08 UTC, 0 replies.
- [PR] [SPARK-58377][BUILD] Upgrade `netty-tcnative` to 2.0.81.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/27 16:41:47 UTC, 3 replies.
- [PR] [SPARK-58379][BUILD] Upgrade `jnr-posix` to 3.2.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/27 17:08:10 UTC, 4 replies.
- [PR] [SPARK-58378][SQL] Fuse compatible approximate percentile sketches [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/07/27 17:15:26 UTC, 11 replies.
- [PR] [SPARK-58380] Update Spark 4.1/4.0 examples to use 4.1.3 and 4.0.4 docker images [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/27 17:49:43 UTC, 2 replies.
- [PR] [SPARK-58381][SQL] Gate the Arrow cache zero-copy write path on physical congruence with the cache schema [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/07/27 17:53:28 UTC, 5 replies.
- [PR] [SPARK-58382][SQL] binaryFile archive support via wholeFile option [spark] - posted by "akshatshenoi-db (via GitHub)" <gi...@apache.org> on 2026/07/27 18:12:51 UTC, 4 replies.
- Re: [PR] [SPARK-58368][INFRA] Add smart class-level test selection for post-merge CI [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/27 19:13:01 UTC, 4 replies.
- [PR] [SPARK-56460][CORE][FOLLOWUP] Fix parent POM version in common/config on branch-4.x [spark] - posted by "qlong (via GitHub)" <gi...@apache.org> on 2026/07/27 19:26:36 UTC, 1 replies.
- [PR] [SPARK-58386][SS] Restore backward compatibility of SupportsRealTimeRead.nextWithTimeout [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2026/07/27 20:00:42 UTC, 1 replies.
- Re: [PR] [SPARK-58312][PYTHON] Remove unnecessary type: ignore comments in pyspark.sql.group [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/07/27 20:37:27 UTC, 2 replies.
- [PR] [SPARK-58388][INFRA] Clean up the dependency list for lint/docs/gen-protos docker image [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/27 20:59:50 UTC, 2 replies.
- [PR] [SPARK-58389][SQL] Pass all options while loading tables [spark] - posted by "yyanyy (via GitHub)" <gi...@apache.org> on 2026/07/27 21:16:40 UTC, 40 replies.
- Re: [PR] [SPARK-XXXXX][PYTHON][DOCS] Added Returns and See Also sections in pyspark.sql.functions documentation. [spark] - posted by "art000109 (via GitHub)" <gi...@apache.org> on 2026/07/27 21:22:26 UTC, 1 replies.
- [PR] [SPARK-58390][SQL] Emit row counts without deserializing Arrow payloads for empty-projection cache reads [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/07/27 21:49:20 UTC, 3 replies.
- [PR] [SPARK-58321][SDP] Wire SCD2 AutoCDC streaming write and enable SCD2 end to end [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/07/27 21:59:04 UTC, 13 replies.
- [PR] [SPARK-58392][SQL] Pass all options while loading relations [spark] - posted by "yyanyy (via GitHub)" <gi...@apache.org> on 2026/07/28 00:52:11 UTC, 1 replies.
- [PR] [WIP][PS] Fix NumPy isfinite and isinf mappings [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/28 01:08:25 UTC, 0 replies.
- [PR] [SPARK-58393][PYTHON][INFRA] Smart select tests for PySpark test framework [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/28 02:06:47 UTC, 6 replies.
- Re: [PR] [SPARK-56460][CORE][FOLLOWUP][4.x] Fix `common/config` module POM version [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/07/28 02:15:24 UTC, 3 replies.
- [PR] [SPARK-58394][SQL] Use ZipFile instead of ZipArchiveInputStream for zip archives [spark] - posted by "akshatshenoi-db (via GitHub)" <gi...@apache.org> on 2026/07/28 03:33:11 UTC, 3 replies.
- [PR] [WIP][ML] Include LDA metadata in size estimates [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/28 03:46:06 UTC, 0 replies.
- [PR] [SPARK-58396][ML][CONNECT] Include FPGrowth metadata in size estimates [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/28 03:52:57 UTC, 3 replies.
- [PR] [WIP][ML][CONNECT] Add Bucketizer size estimate [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/28 04:00:02 UTC, 0 replies.
- [PR] [SPARK-XXXXX][SQL][PYTHON] Add `collect_union` aggregate function [spark] - posted by "ChuckLin2025 (via GitHub)" <gi...@apache.org> on 2026/07/28 04:16:28 UTC, 0 replies.
- [PR] [SPARK-58400][SQL] Fix ANSI mode assumption for views created by Spark 4.0+ [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/07/28 05:57:48 UTC, 14 replies.
- Re: [PR] [SPARK-58399][SQL][PYTHON] Add `collect_union` aggregate function [spark] - posted by "ChuckLin2025 (via GitHub)" <gi...@apache.org> on 2026/07/28 05:59:12 UTC, 8 replies.
- Re: [PR] [SPARK-58398][CORE] Group-atomic failure and fail-fast rejection for pipelined-shuffle stage groups [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/07/28 06:21:55 UTC, 6 replies.
- [PR] [WIP][PYTHON] Consolidate UNKNOWN_EXPLAIN_MODE into VALUE_NOT_ALLOWED [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/28 06:42:37 UTC, 0 replies.
- [PR] [MINOR][SQL] Simplify redundant boolean ternary in visitDeclareCursorStatement [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/28 07:55:26 UTC, 2 replies.
- [PR] [SPARK-58401][DOCS] Update Parquet links to 1.17.1 in Parquet data source docs [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/28 07:56:24 UTC, 2 replies.
- [PR] [MINOR][INFRA] Fix doubled braces in structured logging style-check hint [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/28 07:56:48 UTC, 2 replies.
- [PR] Fix CVE 4.2.0 [spark] - posted by "scottme (via GitHub)" <gi...@apache.org> on 2026/07/28 08:28:47 UTC, 0 replies.
- Re: [PR] [SPARK-58330][SQL] Prevent silent dropping of dynamic options on same table references. [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/07/28 08:33:22 UTC, 4 replies.
- [PR] [SPARK-58370][SQL][4.1] Check table write privileges when the write target is also read in the same statement [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/07/28 08:58:46 UTC, 3 replies.
- [PR] [SPARK-58370][SQL][4.0] Check table write privileges when the write target is also read in the same statement [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/07/28 08:59:07 UTC, 3 replies.
- [PR] [SPARK-58370][SQL][3.5] Check table write privileges when the write target is also read in the same statement [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/07/28 08:59:33 UTC, 3 replies.
- Re: [PR] [SPARK-58397][ML][CONNECT] Add Bucketizer size estimate [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/28 10:14:45 UTC, 1 replies.
- [PR] [SPARK-58404][SQL] Support bypassing partial WindowGroupLimit [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/07/28 10:19:14 UTC, 12 replies.
- [PR] [SPARK-58405][SQL] Pull up project alias through window to eliminate redundant shuffle and sort [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/07/28 11:31:31 UTC, 11 replies.
- [PR] [SPARK-58403][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_3201-3205`: `MALFORMED_EXPRESSION_INFO` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/28 12:07:58 UTC, 3 replies.
- [PR] [SPARK-58373][SQL] Do not prune the from_json schema under named_struct when parse options are set [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/28 12:31:40 UTC, 4 replies.
- Re: [PR] [SPARK-58402][PYTHON] Consolidate UNKNOWN_EXPLAIN_MODE into VALUE_NOT_ALLOWED [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/28 12:32:05 UTC, 1 replies.
- Re: [PR] [SPARK-57893][CORE] Implement `UserCredentialManager` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/28 15:39:21 UTC, 15 replies.
- [PR] [SPARK-58407] Fix connect sessionquerytest lifecycle [spark] - posted by "fwc (via GitHub)" <gi...@apache.org> on 2026/07/28 15:50:15 UTC, 0 replies.
- [PR] [SPARK-58408][CORE] Register TimestampNanosVal in KryoSerializer [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/07/28 17:36:21 UTC, 3 replies.
- [PR] [MINOR][DOCS] Document CSV read behaviour when multiLine is disabled [spark] - posted by "Joorgem (via GitHub)" <gi...@apache.org> on 2026/07/28 17:47:00 UTC, 2 replies.
- Re: [PR] [4.2] Upgrade Jetty, Ivy, lz4-java, and tink to address CVEs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/28 17:59:04 UTC, 2 replies.
- [PR] [CONNECT] Skip redundant DSv2 table refreshes in Spark Connect [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/07/28 18:18:33 UTC, 0 replies.
- [PR] [SPARK-58347][SDP] Thread conf.resolver through ColumnSelection.applyToSchema [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/07/28 19:03:05 UTC, 6 replies.
- [PR] [SPARK-58410][PYTHON] Remove unnecessary type: ignore comments in the DataFrame read/write API [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/07/28 19:15:05 UTC, 6 replies.
- [PR] [SPARK-58271][SDP] Allow AUTO CDC clauses in any order [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/07/28 20:43:20 UTC, 7 replies.
- [PR] [WIP] Stack/pipelined shuffle pr7 rtm [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/07/28 20:49:42 UTC, 0 replies.
- [PR] [SPARK-58411][SQL] Preserve ORDER BY in LIMIT decorrelation when correlation references only the outer table [spark] - posted by "AveryQi115 (via GitHub)" <gi...@apache.org> on 2026/07/28 21:22:56 UTC, 6 replies.
- [PR] [SPARK-XXXXX][SQL] Read and infer ORC schema from archives [spark] - posted by "akshatshenoi-db (via GitHub)" <gi...@apache.org> on 2026/07/28 21:46:08 UTC, 0 replies.
- [PR] [SPARK-58413][SQL][TESTS] Rename `sequential fetch` label to `pipelined fetch (1 client)` in `NettyTransportBenchmark` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/28 21:49:43 UTC, 5 replies.
- [PR] [SPARK-58412][SQL] Prevent incomplete and stale cache materialization statistics [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/07/28 22:25:04 UTC, 3 replies.
- [PR] [MINOR][TESTS] Add catch-all case to non-total onOtherEvent in test listeners [spark] - posted by "haoyangeng-db (via GitHub)" <gi...@apache.org> on 2026/07/29 00:00:47 UTC, 3 replies.
- Re: [PR] [SPARK-54216][SQL] Add regression tests for V2 table cache refresh with immutable Table instances [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/29 00:40:35 UTC, 1 replies.
- [PR] [SPARK-58414][SQL][TESTS] Add e2e coverage for nanosecond timestamps nested in complex types in the Arrow cache [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/07/29 01:30:08 UTC, 9 replies.
- [PR] [SPARK-58415][TESTS] Regenerate benchmark results [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/29 04:44:37 UTC, 4 replies.
- [PR] [MINOR][PS] Remove stale Python 2 reference in DataFrame.to_latex docstring [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/29 05:27:58 UTC, 0 replies.
- [PR] [SPARK-58416][EXAMPLES] Fix wrong class name in SqlNetworkWordCount usage messages [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/29 05:29:13 UTC, 3 replies.
- [PR] [MINOR][BUILD] Fix duplicated word in spark-profiler POM description [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/29 05:30:00 UTC, 4 replies.
- Re: [PR] [SPARK-58407][SQL][TESTS][CONNECT] Fix connect.SessionQueryTest beforeAll, afterAll [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/29 05:34:52 UTC, 0 replies.
- [PR] [SPARK-54945][PYTHON] Add tests for pa.Array.to_pandas with zero copy [spark] - posted by "Spenserrrr (via GitHub)" <gi...@apache.org> on 2026/07/29 06:09:55 UTC, 1 replies.
- [PR] [SPARK-58391][SDP] Validate AutoCDC sequencing-type and SCD2 track-history drift [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/07/29 07:38:42 UTC, 14 replies.
- Re: [PR] [SPARK-58126][CORE] Support a pluggable SchedulingAlgorithm via configuration [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/29 09:04:54 UTC, 1 replies.
- Re: [I] MERGE INTO over Iceberg temp-view source can fail with assertion failed: No plan for TableReference[...] [spark] - posted by "mrjoe7 (via GitHub)" <gi...@apache.org> on 2026/07/29 09:13:53 UTC, 0 replies.
- [PR] Fix insecure HTTP links in documentation [spark] - posted by "arijitroy003 (via GitHub)" <gi...@apache.org> on 2026/07/29 12:13:54 UTC, 2 replies.
- [PR] Add .editorconfig for consistent coding style [spark] - posted by "arijitroy003 (via GitHub)" <gi...@apache.org> on 2026/07/29 12:14:16 UTC, 1 replies.
- [PR] Pin GitHub Actions runners to ubuntu-24.04 [spark] - posted by "arijitroy003 (via GitHub)" <gi...@apache.org> on 2026/07/29 12:39:41 UTC, 2 replies.
- [PR] [SQL] Normalize map values in distinct aggregates [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2026/07/29 13:51:39 UTC, 0 replies.
- [PR] [SPARK-58419][SQL] Support ANSI SQL UNNEST in the FROM clause [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2026/07/29 14:40:36 UTC, 4 replies.
- Re: [PR] [SPARK-58126][CORE] Support a pluggable root pool comparator via configuration [spark] - posted by "ChrisMuki (via GitHub)" <gi...@apache.org> on 2026/07/29 14:43:39 UTC, 1 replies.
- [PR] [SPARK-58414][SQL][TESTS][FOLLOWUP] Use the imported LocalDateTime instead of the fully qualified name [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/07/29 15:05:07 UTC, 4 replies.
- Re: [PR] [SPARK-57370][SQL] Add a JDK (javac) compiler backend for whole-stage codegen [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/29 15:29:05 UTC, 4 replies.
- Re: [PR] [SPARK-58322][CORE] Validate executor app ID before returning credentials and at registration [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2026/07/29 15:56:19 UTC, 4 replies.
- [PR] [SPARK-58421] Improve `sql` parameter binding to support more literal types instead of crashing [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/29 16:18:06 UTC, 3 replies.
- [PR] [SPARK-55199][K8S][DOCS] Improve K8s integration tests `README` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/29 16:21:44 UTC, 4 replies.
- [PR] [SPARK-58422][K8S][TESTS] Update Minikube minimum version check to 1.38.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/29 16:27:30 UTC, 0 replies.
- [PR] [WIP][SPARK-57841][SQL][TEST] Add cross-precision and nested-type test cov… [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/07/29 17:23:23 UTC, 0 replies.
- [PR] [WIP][SPARK-57815][SQL] Reject nanosecond-precision timestamps in Hive-serde tables [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/07/29 17:33:30 UTC, 0 replies.
- [PR] [WIP][SPARK-57825][SQL] Add +/- ANSI year-month interval support for TIMESTAMP_NTZ/LTZ(p) [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/07/29 17:44:08 UTC, 0 replies.
- [PR] [SPARK-58423][SQL] Raise MISSING_ATTRIBUTES for missing input after single-pass hidden-output insertion [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/07/29 18:05:17 UTC, 0 replies.
- [I] 1.0 release with Spark 3.5 [spark-kubernetes-operator] - posted by "kristopherkane (via GitHub)" <gi...@apache.org> on 2026/07/29 18:35:46 UTC, 1 replies.
- Re: [PR] [SPARK-58422][K8S][TESTS] Upgrade the minimum Minikube version to 1.38.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/29 18:35:51 UTC, 3 replies.
- [PR] [SPARK-58424] Add `count`/`sum`/`avg`/`mean`/`min`/`max` to `GroupedData` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/29 18:45:28 UTC, 5 replies.
- [PR] [SPARK-58425] Support `observe` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/29 18:47:53 UTC, 5 replies.
- [PR] [SPARK-58427] Support `randomSplit` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/29 18:52:33 UTC, 3 replies.
- [PR] [MINOR][CONNECT] Filter null extension elements returned by GetStatus plugins [spark] - posted by "haoyangeng-db (via GitHub)" <gi...@apache.org> on 2026/07/29 18:59:15 UTC, 1 replies.
- Re: [PR] [SPARK-55077][CORE][K8S] Support `spark.kubernetes.archives.avoidDownloadSchemes` for K8s Cluster Mode [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/29 19:20:42 UTC, 1 replies.
- [PR] [SPARK-58426] Render each JVM option as its own command element [spark-kubernetes-operator] - posted by "snicholasbarton (via GitHub)" <gi...@apache.org> on 2026/07/29 19:51:37 UTC, 0 replies.
- [PR] [SPARK-58037][PYTHON][TESTS][FOLLOWUP] Keep DataFrame golden tests internal [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/07/29 20:22:02 UTC, 4 replies.
- [PR] [SPARK-58430] Support `alias` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/29 20:32:24 UTC, 3 replies.
- [PR] [SPARK-58432] Support `sortWithinPartitions` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/29 20:39:57 UTC, 3 replies.
- [PR] [SPARK-58433] Support `repartitionByRange` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/29 20:42:28 UTC, 3 replies.
- [PR] [SPARK-58434] Support `pivot` in `GroupedData` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/29 20:45:51 UTC, 2 replies.
- Re: [PR] [SPARK-58417][PS] Remove stale Python 2 reference in DataFrame.to_latex docstring [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/29 21:21:19 UTC, 2 replies.
- [PR] [SPARK-58431][SQL] Preserve ANSI array index errors during optimization [spark] - posted by "marcuslin123 (via GitHub)" <gi...@apache.org> on 2026/07/29 21:56:13 UTC, 2 replies.
- [PR] [MINOR][SQL] Remove redundant trailing semicolon in CreateUserDefinedFunctionCommand [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/29 22:09:21 UTC, 0 replies.
- [PR] [SPARK-58435][SQL] Use named containsNull argument in KLL sketch ArrayType results [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/29 22:10:19 UTC, 0 replies.
- [PR] [MINOR][SQL] Add missing @since tag to functions.expr [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/29 22:10:47 UTC, 0 replies.
- [PR] [SPARK-58118][SDP] Allow user-specified AUTO CDC schema to omit the reserved metadata column [spark] - posted by "naveenp2708 (via GitHub)" <gi...@apache.org> on 2026/07/29 23:59:13 UTC, 0 replies.
- Re: [PR] [SPARK-56415][INFRA] Refactor create_spark_jira.py for LLM use and extract shared utilities [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/07/29 23:59:23 UTC, 1 replies.
- Re: [PR] [SPARK-56374][BUILD] Align SBT assembly shade rules with Maven [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/30 00:39:32 UTC, 1 replies.
- Re: [PR] [SPARK-56451][DOCS][SDP] Document how SDP datasets are stored and refreshed [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/30 00:39:36 UTC, 1 replies.
- Re: [PR] [SPARK-58159][PYTHON] Support `with` statement for connect session [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/30 00:50:01 UTC, 2 replies.
- Re: [PR] [SPARK-38954][CORE] Support delegation token renewal and distribution without Kerberos [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/30 00:52:53 UTC, 1 replies.
- [PR] [SPARK-58439][BUILD][INFRA] Add dedicated validation script for distributions [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/07/30 01:55:36 UTC, 3 replies.
- [PR] [WIP] Stack/pipelined shuffle pr7 mot decouple [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/07/30 04:20:24 UTC, 0 replies.
- [PR] [SPARK-58441][SQL] Fix wrong results in instr and substring_index for ICU collations caused by inconsistent StringSearch iteration [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/07/30 07:00:03 UTC, 0 replies.
- [PR] [SPARK-58443][SQL] Fix instr returning a wrong position for Int.MinValue start due to negation overflow in UTF8String.indexOf [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/07/30 07:13:59 UTC, 0 replies.
- Re: [PR] [SPARK-38954][CORE][4.x] Support delegation token renewal and distribution without Kerberos [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/07/30 08:00:34 UTC, 2 replies.
- [PR] [SPARK-58444][SQL] Do not enable concurrent output writer when ordering already matched [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2026/07/30 09:47:04 UTC, 8 replies.
- [PR] [SPARK-58446][CORE] Prevent late task events from corrupting pending task state [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/07/30 11:34:25 UTC, 1 replies.
- [PR] [WIP][ML] Estimate IsotonicRegressionModel size [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/30 12:24:31 UTC, 0 replies.
- [PR] [SPARK-58447][CONNECT] Preserve operation tags in Python foreachBatch callbacks [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/07/30 12:54:29 UTC, 1 replies.
- Re: [PR] [SPARK-58448][CONNECT] Estimate IsotonicRegressionModel size [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/30 13:56:27 UTC, 2 replies.
- Re: [PR] [SPARK-58420][SQL] Normalize map values in distinct aggregates [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/30 13:59:14 UTC, 24 replies.
- Re: [PR] [SPARK-57825][SQL] Add +/- ANSI year-month interval support for TIMESTAMP_NTZ/LTZ(p) [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/07/30 14:28:09 UTC, 3 replies.
- Re: [PR] [SPARK-57815][SQL] Reject nanosecond-precision timestamps in Hive-serde tables [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/07/30 14:28:26 UTC, 2 replies.
- Re: [PR] [SPARK-57841][SQL][TEST] Add cross-precision and nested-type test coverage for nanosecond-precision timestamps [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/07/30 14:28:38 UTC, 4 replies.
- Re: [PR] [SPARK-58451][CONNECT] Filter null extension elements returned by GetStatus plugins [spark] - posted by "haoyangeng-db (via GitHub)" <gi...@apache.org> on 2026/07/30 15:20:17 UTC, 0 replies.
- Re: [PR] [MINOR][SQL] Remove redundant trailing semicolons in the SQL module [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/07/30 17:35:22 UTC, 1 replies.
- [PR] [SPARK-58450][SQL] Add single-pass analyzer support for ASOF JOIN [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/07/30 17:45:16 UTC, 1 replies.
- [PR] [SPARK-57898][CORE] Implement AwsStsCredentialProvider (OIDC to STS credential exchange) [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/07/30 17:55:26 UTC, 3 replies.
- [PR] [SPARK-58437][SQL] Fix invalid Java constructs in generated code [spark] - posted by "marcuslin123 (via GitHub)" <gi...@apache.org> on 2026/07/30 18:47:46 UTC, 6 replies.
- [PR] [MINOR][DOCS] Document pointing the s3a connector at an S3-compatible object store [spark] - posted by "goanpeca (via GitHub)" <gi...@apache.org> on 2026/07/30 20:00:14 UTC, 0 replies.
- Re: [PR] [SPARK-58445][PS] Fix NumPy isfinite and isinf mappings [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/30 20:49:13 UTC, 2 replies.
- Re: [PR] [SPARK-55206][PYTHON][SQL] Transpilation minimal functional implementation with python [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/07/30 22:44:11 UTC, 0 replies.
- [PR] [SPARK-58457][SQL][DOCS] Correct the PERMISSIVE mode claim that corrupt records are dropped [spark] - posted by "Joorgem (via GitHub)" <gi...@apache.org> on 2026/07/30 23:53:59 UTC, 2 replies.
- [I] [SQL] SchemaPruning is not idempotent when a query reads `_metadata` and a VARIANT column is only referenced below a nondeterministic filter [spark] - posted by "felipepessoto (via GitHub)" <gi...@apache.org> on 2026/07/31 00:13:52 UTC, 0 replies.
- Re: [PR] [SPARK-XXXXX][SQL][TESTS] Add DSv2 table refresh infrastructure and t… [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/31 00:44:54 UTC, 1 replies.
- Re: [PR] [SPARK-XXXXX][CONNECT][TESTS] Add Connect DataFrame pinning tests [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/31 00:44:57 UTC, 1 replies.
- Re: [PR] [SPARK-55890] Check arrow memory at end of tests [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/31 00:44:59 UTC, 1 replies.
- [PR] [SPARK-58459][INFRA] Manage build_main.yml per-branch instead of gating on github.ref [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/07/31 00:51:38 UTC, 2 replies.
- [PR] [SPARK-58460][SQL] Do not leak generated column expressions into DataFrame schemas and derived tables [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/07/31 02:13:56 UTC, 2 replies.
- [PR] [SPARK-58461][CORE] Convert unreachable `_LEGACY_ERROR_TEMP_3021-3042` invariants in `SparkCoreErrors` to internal errors [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/31 02:45:09 UTC, 1 replies.
- [PR] [SPARK-58440][SQL] Convert Sequence codegen error parameters to String [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/31 02:57:54 UTC, 7 replies.
- [PR] [WIP][ML][CONNECT] Exclude tuning params from CrossValidatorModel size [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/31 03:17:39 UTC, 0 replies.
- Re: [PR] [SPARK-58436][SQL][DOC] Add missing @since tags in functions.scala [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/31 03:56:29 UTC, 1 replies.
- [PR] [WIP][INFRA] Close merged pull requests before posting summaries [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/31 04:08:26 UTC, 0 replies.
- [PR] [SPARK-58249][PS][FOLLOWUP] Use native functions for NumPy bitwise shifts [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/31 05:41:49 UTC, 0 replies.
- [PR] [SPARK-58465][PS] Use native expressions for NumPy reciprocal ufunc [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/31 06:04:28 UTC, 0 replies.
- [PR] [SPARK-58418][SDP] Let SCD2 AutoCDC reconcile a microbatch narrower than the evolved target [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/07/31 06:10:34 UTC, 10 replies.
- Re: [PR] [SPARK-58315][SQL] Refactor DSv2 scan statistics handling [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/31 07:34:48 UTC, 1 replies.
- Re: [PR] [SPARK-58466][SQL] Route ORC TIME/nanos support through the Types Framework [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/31 09:10:11 UTC, 1 replies.
- Re: [PR] [SPARK-57737][SQL] Speed up date_trunc zone offset resolution with a per-task cache [spark] - posted by "Licht-T (via GitHub)" <gi...@apache.org> on 2026/07/31 09:28:14 UTC, 1 replies.
- [PR] [SPARK-55278][SQL] Add scalar external UDF planning support [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2026/07/31 09:48:17 UTC, 0 replies.
- [I] Upgrades for SparkApp / SparkCluster CRDs [spark-kubernetes-operator] - posted by "Pluies (via GitHub)" <gi...@apache.org> on 2026/07/31 10:15:14 UTC, 0 replies.
- [PR] [SPARK-58458][SQL][TESTS] Add coverage for the record split when multiLine is disabled [spark] - posted by "Joorgem (via GitHub)" <gi...@apache.org> on 2026/07/31 12:00:47 UTC, 1 replies.
- Re: [PR] [SPARK-58459][4.x][INFRA] Manage build_main.yml per-branch instead of gating on github.ref [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/31 12:15:01 UTC, 0 replies.
- Re: [PR] [SPARK-58463][INFRA] Close merged pull requests before posting summaries [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/31 12:16:19 UTC, 2 replies.
- Re: [PR] [SPARK-58462][ML][CONNECT] Exclude tuning params from CrossValidatorModel size [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/31 12:16:27 UTC, 2 replies.
- [PR] [SPARK-58469][PS] Use native expressions for NumPy rint [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/31 12:25:36 UTC, 0 replies.
- [PR] [SPARK-58470][PS] Use native expressions for NumPy trunc [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/31 12:29:41 UTC, 0 replies.
- [PR] [WIP][ML] Improve TrainValidationSplitModel size estimation [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/07/31 12:43:43 UTC, 0 replies.
- [PR] [SPARK-57894][SPARK-57895][CORE][K8S] Implement `UpdateUserCredentials` RPC, backend integration, and initial credential delivery [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/07/31 12:50:05 UTC, 0 replies.
- [PR] [SPARK-58468][CORE] Support on-demand loading for V1 event logs in SHS [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/07/31 13:03:22 UTC, 0 replies.
- [PR] [SPARK-58472][CORE] Add `AutoCloseable` lifecycle to `CredentialProvider` SPI [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/07/31 13:27:49 UTC, 2 replies.
- Re: [PR] [SPARK-58468][CORE] Support on-demand loading for single event logs in SHS [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/07/31 13:39:24 UTC, 9 replies.
- Re: [PR] [SPARK-57225][SQL] Reject batch writes for DSv2 sources without write capability [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/07/31 14:09:43 UTC, 0 replies.
- [PR] [SPARK-58440][4.2][SQL] Convert Sequence codegen error parameters to String [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/07/31 14:13:43 UTC, 4 replies.
- [PR] [SPARK-58473] Support comparison/logical/arithmetic operators in `Column` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/31 14:53:59 UTC, 2 replies.
- [PR] [SPARK-58474] Support Swift literal operands in `Column` operators via `SparkLiteral` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/31 15:12:29 UTC, 3 replies.
- [PR] [SPARK-57897][BUILD] Create `connector/credential-aws` module with CI/release integration [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/07/31 15:19:37 UTC, 0 replies.
- [PR] [WIP][SPARK-57832][SQL] Support timestamp - timestamp subtraction for nanosecond-precision timestamps [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/07/31 15:41:37 UTC, 0 replies.
- [PR] [WIP][SPARK-57823][SQL] Support ORC predicate pushdown for nanosecond-precision timestamps [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/07/31 15:43:21 UTC, 0 replies.
- [PR] [SPARK-xxxxx][SQL] Make variant path functions raise INVALID_VARIANT_PATH consistently in interpreted and codegen execution [spark] - posted by "bojana-db (via GitHub)" <gi...@apache.org> on 2026/07/31 16:01:42 UTC, 0 replies.
- [PR] [SPARK-58475] Support predicate and string methods in `Column` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/31 16:07:30 UTC, 4 replies.
- [PR] [SPARK-58476] Support Column-based `sort/withColumn/drop/join` in `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/31 16:10:15 UTC, 4 replies.
- [PR] [CONNECT] Demonstrate stale cached plan without DSv2 refresh [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/07/31 16:10:50 UTC, 0 replies.
- [PR] [SPARK-58021][CONNECT] Generalize local Connect server launching [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/07/31 17:08:42 UTC, 3 replies.
- [PR] [SPARK-58477] Support `when/otherwise` in `Column` and `Functions` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/31 17:55:25 UTC, 3 replies.
- Re: [PR] [SPARK-58454][CORE] Fully decouple pipelined shuffles from the MapOutputTracker [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/07/31 17:57:54 UTC, 0 replies.
- [PR] [SPARK-58021][CONNECT] Add local server pool storage model [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/07/31 18:21:55 UTC, 0 replies.
- [PR] [SPARK-58021][CONNECT] Add local server pool lifecycle management [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/07/31 18:22:13 UTC, 0 replies.
- [PR] [SPARK-58021][CONNECT] Add local server pool acquisition engine [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/07/31 18:22:26 UTC, 0 replies.
- [PR] [SPARK-58021][CONNECT] Warm local server pool members before use [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/07/31 18:22:42 UTC, 1 replies.
- [PR] [SPARK-58479] Support math functions in `MathFunctions` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/31 18:38:19 UTC, 3 replies.
- [PR] [SPARK-58409][SDP] Add SCD2 AutoCDC end-to-end test suites [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/07/31 20:13:41 UTC, 1 replies.
- [PR] [SPARK-45900][SQL][PYTHON] Add xxh3_64 and xxh3_128 functions [spark] - posted by "SreeramaYeshwanthGowd (via GitHub)" <gi...@apache.org> on 2026/07/31 20:30:22 UTC, 1 replies.
- [PR] [SPARK-58480][PYTHON][TEST][FOLLOWUP] Declare DataFrame golden test cases as methods of a test class [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/07/31 20:55:32 UTC, 0 replies.
- [PR] [SPARK-58483] Support string functions in `StringFunctions` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/31 21:18:43 UTC, 3 replies.
- Re: [PR] [SPARK-58480][PYTHON][TEST] Declare DataFrame golden test cases as methods of a test class [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/07/31 21:28:06 UTC, 1 replies.
- [PR] [SPARK-58489] Support datetime functions in `DateTimeFunctions` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/31 23:06:28 UTC, 0 replies.
- [PR] [SPARK-58490] Support collection functions in `CollectionFunctions` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/07/31 23:12:01 UTC, 1 replies.