reviews@spark.apache.org, 2026-05

You are viewing a plain text version of this content. The canonical link for it is here.

- Re: [PR] [SPARK-56686][SQL] Support streaming row-level CDC post-processing [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/01 00:01:42 UTC, 14 replies.
- Re: [PR] [SPARK-56689][K8S] Improve `ExecutorResizePlugin` to reuse `KubernetesClusterSchedulerBackend.kubernetesClient` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/01 00:04:44 UTC, 4 replies.
- Re: [PR] [SPARK-56639][SQL] frozen path semantics [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2026/05/01 00:11:16 UTC, 1 replies.
- [PR] [DO-NOT-MERGE][SPARK-56692][INFRA] Check release date of upgrade of pom dependency [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/05/01 00:32:40 UTC, 1 replies.
- Re: [PR] [MINOR][PYTHON] Add missing docstrings to add_path and read_command functions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/01 00:58:34 UTC, 1 replies.
- [PR] [SPARK-56693][K8S] Support built-in K8s `ExecutorPVCResizePlugin` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/01 01:33:58 UTC, 22 replies.
- Re: [PR] [SPARK-56669][SQL] Implement group filtering for WriteDelta row level operations [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/01 02:13:55 UTC, 1 replies.
- [PR] fix: remove bare excepts and clean up lint issues (quantum-local-fixer) [spark] - posted by "fitzyracing1 (via GitHub)" <gi...@apache.org> on 2026/05/01 03:30:58 UTC, 0 replies.
- Re: [PR] [SPARK-56687][SQL] Support netChanges for DSv2 CDC streaming reads [spark] - posted by "zikangh (via GitHub)" <gi...@apache.org> on 2026/05/01 04:23:25 UTC, 21 replies.
- Re: [PR] [SPARK-56227][CORE] Fix GcmTransportCipher to correctly handle multiple messages per channel [spark] - posted by "aajisaka (via GitHub)" <gi...@apache.org> on 2026/05/01 07:10:44 UTC, 8 replies.
- Re: [PR] [SPARK-56642][SQL] Add pipelined JVM-Python UDF data transfer [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/01 07:15:16 UTC, 8 replies.
- Re: [I] Spark Declarative Pipelines and Unity Catalog [spark] - posted by "graemecash-spec (via GitHub)" <gi...@apache.org> on 2026/05/01 11:19:53 UTC, 0 replies.
- [PR] [SPARK-56694][SQL] Fix `DynamicPruningSubquery` canonicalization for `buildKeys` [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/05/01 12:01:01 UTC, 6 replies.
- Re: [PR] [SPARK-56677][SQL] Propagate filter conditions through `Join` nodes in `PlanMerger` [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/05/01 13:25:54 UTC, 10 replies.
- Re: [PR] [SPARK-55810][UI] Fix missing spacing between table and pagination controls in Jobs and Stages page [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/05/01 13:55:49 UTC, 10 replies.
- Re: [PR] [SPARK-56594][SQL] Add time_bucket scalar function [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/01 14:10:31 UTC, 1 replies.
- [PR] [SPARK-56696][BUILD] Exclude old `junit:junit` from the dependency tree for sbt build [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/05/01 14:26:40 UTC, 2 replies.
- [PR] [SPARK-56697][SQL][DML] Refactor Catalog Manager [spark] - posted by "andreaschat-db (via GitHub)" <gi...@apache.org> on 2026/05/01 14:40:31 UTC, 9 replies.
- Re: [PR] [SPARK-54119] Support METRIC_VIEW creation on V2 catalogs [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/01 14:45:06 UTC, 11 replies.
- [PR] [SPARK-56681][SQL] PATH cleanup [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/05/01 14:52:57 UTC, 8 replies.
- Re: [PR] [SPARK-55794][FOLLOWUP][SQL] Wrap outer star expansion results in Alias in ResolveReferences [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/01 15:07:17 UTC, 5 replies.
- Re: [PR] [SPARK-56598][SQL] Custom metrics support for TruncatableTable [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/05/01 15:22:13 UTC, 0 replies.
- [PR] [SPARK-XXXXX][PYTHON] Add Spark MCP (Model Context Protocol) server [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/01 17:04:32 UTC, 0 replies.
- [PR] [SPARK-56699][K8S] Default `ExecutorPVCResizePlugin` interval to 5minin 5-minute units [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/01 17:23:31 UTC, 2 replies.
- [PR] [SPARK-XXXXX][SQL] Public StructField.json / .fromJson + Column.fromStructField [spark] - posted by "chenwang-databricks (via GitHub)" <gi...@apache.org> on 2026/05/01 17:28:59 UTC, 0 replies.
- Re: [PR] [SPARK-56678][SQL] Use structured Catalog/Namespace/Table rows in DESCRIBE TABLE EXTENDED for v2 tables and views [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/01 17:31:09 UTC, 1 replies.
- Re: [PR] [SPARK-56395][SQL] Add NEAREST BY top-K ranking join (catalyst-side) [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/01 17:59:46 UTC, 57 replies.
- Re: [PR] [SPARK-56698][PYTHON] Add Spark MCP (Model Context Protocol) server [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/05/01 18:06:55 UTC, 3 replies.
- Re: [PR] [SPARK-56643][SQL][TESTS] Add DSv2 temp view with stored plan tests [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/05/01 18:07:57 UTC, 4 replies.
- Re: [PR] [SPARK-56535][BUILD] Fix base image build [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/05/01 18:54:22 UTC, 2 replies.
- Re: [PR] [SPARK-56699][K8S] Default `ExecutorPVCResizePlugin` interval to `5min` in 5-minute units [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/01 19:05:20 UTC, 1 replies.
- [PR] [SPARK-56700][SS] Make DataStreamReader.name public [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/05/01 19:07:41 UTC, 1 replies.
- Re: [PR] [SPARK-56680][SQL] DSv2 INSERT and Insert-Only MERGE Metrics [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/05/01 19:11:31 UTC, 19 replies.
- [PR] [SPARK-56701] Use Apache Spark 4.0.2 in `pi-with-comet` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/01 20:13:52 UTC, 3 replies.
- [PR] [SPARK-56702] Restrict `ExecutorPVCResizePlugin` to `direct` pods allocator [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/01 20:43:30 UTC, 0 replies.
- Re: [PR] [SPARK-56702][K8S] Restrict `ExecutorPVCResizePlugin` to `direct` pods allocator [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/01 21:53:15 UTC, 4 replies.
- Re: [PR] [SPARK-56633][SQL][TESTS] Add comprehensive Parquet vectorized-reader benchmark coverage [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/01 22:47:40 UTC, 1 replies.
- [PR] [SPARK-56686][FOLLOWUP][SQL] Address post-merge review on streaming CDC row-level rewrite [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/01 23:04:16 UTC, 2 replies.
- Re: [PR] [SPARK-56607][PYTHON][FOLLOWUP] Use pyspark.sql.DataFrame to support connect-only [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/05/01 23:51:32 UTC, 1 replies.
- Re: [PR] [SPARK-55107][SQL] Log TID for scanned file in FileScanRDD [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/02 00:52:09 UTC, 1 replies.
- Re: [PR] [SPARK-55012][PYTHON] Optimize ThreadPool usage in Arrow UDF concurrent execution [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/02 00:52:13 UTC, 1 replies.
- Re: [PR] [SPARK-56482][SQL] Enable whole-stage codegen fusion for `UnionExec` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/02 02:08:57 UTC, 4 replies.
- Re: [PR] [SPARK-56686][FOLLOWUP][SQL] Mark CDC streaming rewrite via attribute metadata; multi-batch test infra [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/02 03:20:24 UTC, 1 replies.
- Re: [PR] [SPARK-46367][SQL] Support narrowing projection of `KeyedPartitioning` in `PartitioningPreservingUnaryExecNode` [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/05/02 04:48:07 UTC, 21 replies.
- [PR] [SPARK-56703][SQL] Avoid redundant `propagatedFilter` aliases in `PlanMerger` [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/05/02 11:08:47 UTC, 7 replies.
- Re: [PR] [SPARK-56686][FOLLOWUP][SQL] Mark CDC streaming rewrite via attribute metadata [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/02 17:15:07 UTC, 2 replies.
- [PR] [SPARK-55872][UI] Highlight long-running SQL queries by duration [spark] - posted by "XdithyX (via GitHub)" <gi...@apache.org> on 2026/05/02 17:39:41 UTC, 13 replies.
- [PR] [WIP][SPARK-56705][PYSPARK][SS] Introduce a JVM-bridged MemoryStream wrapper for PySpark tests (Part 1 of [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/05/03 00:29:04 UTC, 0 replies.
- [PR] [SPARK-56709] Use Apache Spark 4.2.0-preview5 in CI [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/03 02:11:45 UTC, 0 replies.
- Re: [PR] [SPARK-56709] Use Apache Spark `4.2.0-preview5` in CI [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/03 03:49:15 UTC, 2 replies.
- Re: [PR] [GRAPHX] Unpersist sccWorkGraph in StronglyConnectedComponents [spark] - posted by "dkranchii (via GitHub)" <gi...@apache.org> on 2026/05/03 05:40:29 UTC, 2 replies.
- [PR] [SPARK-56413] Introduce the grpc protocol for UDF execution. [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2026/05/03 07:48:47 UTC, 0 replies.
- [PR] [SPARK-56570][SQL][FOLLOWUP] `PlanMerger` code cleanup followup [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/05/03 13:53:01 UTC, 0 replies.
- [PR] [SPARK-55203][PYTHON] Support PathLike in readwriter paths [spark] - posted by "201573 (via GitHub)" <gi...@apache.org> on 2026/05/03 14:43:31 UTC, 2 replies.
- Re: [PR] [SPARK-56454][DOCS][FOLLOWUP] Document supported SRIDs in geospatial types [spark] - posted by "pratham76 (via GitHub)" <gi...@apache.org> on 2026/05/03 14:46:28 UTC, 7 replies.
- [PR] [SPARK-56654][SQL] Reject unpaired UTF-16 surrogates in Variant JSON parsing [spark] - posted by "NJAHNAVI2907 (via GitHub)" <gi...@apache.org> on 2026/05/03 20:31:27 UTC, 13 replies.
- [PR] [SPARK-56710][INFRA] branch-4.x and branch-4.2 scheduled CI, snapshots, and build_and_test Python split [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/05/03 22:50:22 UTC, 7 replies.
- [PR] [SPARK-56711][SQL] Restrict CDC `_commit_version` column to LongType or StringType [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/03 23:46:41 UTC, 3 replies.
- [PR] [SPARK-56712][SQL][DOCS] Document predicate pushdown contract for CDC ChangelogTable [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/04 00:14:42 UTC, 0 replies.
- Re: [PR] [SPARK-56688][INFRA][PYTHON] Reorganize pyspark tests to empty a CI slot [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/05/04 00:28:26 UTC, 1 replies.
- [PR] [SPARK-56710][INFRA][FOLLOW-UP] Remove duplicates in fixed version in merge script [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/05/04 00:51:51 UTC, 3 replies.
- Re: [PR] [SPARK-56675][BUILD] Make sbt publishLocal work [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/05/04 06:20:06 UTC, 2 replies.
- Re: [PR] [SPARK-56712][SQL][DOCS] Document pushdown contract for CDC ChangelogTable [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/04 06:30:34 UTC, 6 replies.
- [PR] [SPARK-54419][SQL] Avoid expanding expensive alias chains in optimizer [spark] - posted by "201573 (via GitHub)" <gi...@apache.org> on 2026/05/04 08:05:58 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-56661] Introducing logical and physical planning nodes for language-agnostic Spark UDFs [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2026/05/04 08:21:17 UTC, 57 replies.
- Re: [PR] [SPARK-56324] Add ZeroCopyByteStream to enable PySpark <-> Spark message-based communication [spark] - posted by "sven-weber-db (via GitHub)" <gi...@apache.org> on 2026/05/04 08:59:13 UTC, 8 replies.
- Re: [PR] [SPARK-56413] Add gRPC UDF execution protocol [spark] - posted by "xianzhe-databricks (via GitHub)" <gi...@apache.org> on 2026/05/04 10:57:31 UTC, 64 replies.
- [PR] Remove `__metadata_col` metadata from aggregated access only columns [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/05/04 11:27:51 UTC, 0 replies.
- Re: [PR] [SPARK-56551][SQL][FOLLOW-UP] Fix setting numDeletedRows metric as -1 [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/05/04 15:02:52 UTC, 5 replies.
- Re: [PR] [SPARK-54710][SQL] Show Partitions As Json [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2026/05/04 15:13:03 UTC, 10 replies.
- Re: [PR] [SPARK-47444][SQL] Validate numeric table stats in ALTER TABLE SET TBLPROPERTIES [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/05/04 15:45:12 UTC, 1 replies.
- Re: [PR] [SPARK-56561][DOCS] Document order preservation for array_distinct, array_intersect, array_union, array_except [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/05/04 15:48:46 UTC, 1 replies.
- [PR] [SPARK-56715] Use `CrashOnOutOfMemoryError` with stderr redirection [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/04 15:51:17 UTC, 0 replies.
- Re: [PR] [SPARK-56715] Use `CrashOnOutOfMemoryError` with stderr redirection by default [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/04 15:53:16 UTC, 1 replies.
- [PR] [SPARK-50610][SQL] Fix decimal precision in HiveInspectors.toInspecto… [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/05/04 16:59:03 UTC, 0 replies.
- Re: [PR] [SPARK-56570][SQL][FOLLOWUP] `PlanMerger` correctness fix and code cleanup followup [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/04 17:04:43 UTC, 3 replies.
- [PR] [SPARK-46912][CORE] Preserve local environment variables' precedence [spark] - posted by "MeltonSmith (via GitHub)" <gi...@apache.org> on 2026/05/04 17:20:59 UTC, 2 replies.
- [PR] [SPARK-56584][PYTHON][4.1] Generalize `RESULT_TYPE_MISMATCH_FOR_ARROW_UDF` error class and remove dead `SCHEMA_MISMATCH_FOR_ARROW_PYTHON_UDF` [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/05/04 19:06:11 UTC, 8 replies.
- [PR] [SPARK-56584][PYTHON][4.0] Generalize `RESULT_TYPE_MISMATCH_FOR_ARROW_UDF` error class and remove dead `SCHEMA_MISMATCH_FOR_ARROW_PYTHON_UDF` [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/05/04 19:14:47 UTC, 3 replies.
- [PR] [SPARK-56719][SS] Add DataStreamWriter.name() API for sink evolution [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/05/04 19:36:23 UTC, 2 replies.
- Re: [PR] [SPARK-56682][Geo][CONNECT][PYTHON][SQL] Extend the ST_AsBinary function to take optional endianness [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/04 19:42:49 UTC, 15 replies.
- Re: [PR] [SPARK-52857] Add is_valid_variant expression. [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/04 19:55:11 UTC, 5 replies.
- [PR] [SPARK-56717][PYTHON][TESTS] Add ASV microbenchmark for SQL_ARROW_TABLE_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/05/04 20:17:45 UTC, 4 replies.
- [PR] [SPARK-56718][PYTHON] Refactor SQL_COGROUPED_MAP_PANDAS_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/05/04 20:21:29 UTC, 0 replies.
- [PR] [SPARK-56691][PYTHON] Refactor SQL_GROUPED_MAP_PANDAS_ITER_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/05/04 21:09:53 UTC, 2 replies.
- [PR] [SPARK][SS] Fail subsequent async log writes after a prior failure in async progress tracking [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2026/05/04 22:37:02 UTC, 0 replies.
- Re: [PR] [SPARK-56612][PYTHON] Unify verify_result and container-type checks into verify_return_type helper [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/05/04 22:46:26 UTC, 3 replies.
- Re: [PR] [SPARK-56648][PYTHON] Refactor SQL_SCALAR_PANDAS_UDF [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/05/04 23:32:07 UTC, 3 replies.
- [PR] [SPARK-56721][INFRA] Add master server vs 4.0 client CI for all PRs [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/05/05 00:07:19 UTC, 5 replies.
- [PR] [SPARK-36082][SQL] Restrict null-aware anti joins to broadcastable right sides [spark] - posted by "jbharadw-oai (via GitHub)" <gi...@apache.org> on 2026/05/05 00:21:28 UTC, 8 replies.
- Re: [PR] [SPARK-54944][PYTHON][TESTS] Add tests for pa.Array.to_pandas with default arguments [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/05 00:50:20 UTC, 1 replies.
- Re: [PR] [SPARK-54596][CORE][K8S] Burst-aware Memory Allocation Algorithm for Spark@K8S [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/05 00:50:24 UTC, 1 replies.
- [PR] Predicate Pushdown in Spark Structured Streaming (DataSource V2). [spark] - posted by "jalpan-randeri (via GitHub)" <gi...@apache.org> on 2026/05/05 02:10:56 UTC, 7 replies.
- [I] Support Filter pushdown in Spark Structured Streaming [spark] - posted by "jalpan-randeri (via GitHub)" <gi...@apache.org> on 2026/05/05 02:13:57 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-54810] Path [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/05/05 02:49:38 UTC, 1 replies.
- [PR] [SPARK-56395][DataFrame][CONNECT][PYTHON] Add NEAREST BY DataFrame API [spark] - posted by "dilipbiswal (via GitHub)" <gi...@apache.org> on 2026/05/05 07:24:41 UTC, 1 replies.
- [PR] [Spark-56413] Implement bidirectional streaming for grpc protocol. [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2026/05/05 07:33:25 UTC, 0 replies.
- [I] Error: Illegal Parquet type: FIXED_LEN_BYTE_ARRAY (UUID) [spark] - posted by "juchom (via GitHub)" <gi...@apache.org> on 2026/05/05 10:28:25 UTC, 2 replies.
- Re: [I] Take over `spark-connect-rs` and Update Crate [spark-connect-rust] - posted by "franciscoabsampaio (via GitHub)" <gi...@apache.org> on 2026/05/05 10:55:44 UTC, 0 replies.
- Re: [PR] [SPARK-56714] [SQL] Remove `__metadata_col` metadata from aggregated access only columns [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/05/05 12:23:15 UTC, 2 replies.
- Re: [PR] [SPARK-56588][CORE] Fix `PathOutputCommitProtocol` dynamic partition overwrite [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/05/05 12:42:47 UTC, 3 replies.
- Re: [PR] [SPARK-56663][SQL] Restore fast path for date_trunc MINUTE/HOUR/DAY [spark] - posted by "Licht-T (via GitHub)" <gi...@apache.org> on 2026/05/05 13:45:41 UTC, 8 replies.
- [PR] [MINOR][DOCS] Clarify when to ask the user before running tests in AGENTS.md [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/05 14:14:38 UTC, 2 replies.
- Re: [PR] [SPARK-56022][SQL] Preserve SparkThrowable error classes in parmap/awaitResult [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/05 14:57:27 UTC, 1 replies.
- Re: [PR] [SPARK-55658][PYTHON] SparkSessionBuilder.create in PySpark classic should mirror getOrCreate path as much as possible [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/05 15:23:13 UTC, 1 replies.
- [PR] [SPARK-56722] Upgrade Docker GitHub actions in `publish_image.yml` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/05 15:28:28 UTC, 0 replies.
- [PR] [SPARK-40337][PYTHON] Implement SeriesGroupBy.describe in pandas API on Spark [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/05/05 15:38:29 UTC, 0 replies.
- Re: [PR] [SPARK-56722] Upgrade Docker GitHub Actions in `publish_image.yml` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/05 15:39:59 UTC, 1 replies.
- [PR] [SPARK-56723] Use the latest `docker/*` GitHub Actions [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/05 15:42:43 UTC, 4 replies.
- [PR] [SPARK-56724][INFRA] Make `docker/*` GitHub Actions up-to-date [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/05 15:49:16 UTC, 3 replies.
- [PR] [SPARK-56725] Upgrade Swift to 6.3.1 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/05 16:13:42 UTC, 4 replies.
- [PR] [SPARK-56395][FOLLOWUP][SQL] Reject NearestByJoin when spark.sql.crossJoin.enabled is false [spark] - posted by "sezruby (via GitHub)" <gi...@apache.org> on 2026/05/05 16:23:03 UTC, 3 replies.
- Re: [PR] [SPARK-54293][SQL] Disable SNI host check in ThriftHttpCLIService [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/05 16:59:40 UTC, 9 replies.
- [PR] [SPARK-XXXXX][CONNECT] Add Dataset.getNumPartitions to Spark Connect client [spark] - posted by "andreAmorimF (via GitHub)" <gi...@apache.org> on 2026/05/05 17:25:09 UTC, 0 replies.
- Re: [PR] [SPARK-56676][SQL][DML] DSv2 Transaction API Improvements [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/05/05 17:42:58 UTC, 3 replies.
- [PR] [SPARK-40341][PYTHON] Implement Rolling.median and Expanding.median in pandas API on Spark [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/05/05 18:23:20 UTC, 5 replies.
- [PR] [SPARK-56727] Add `Comet` K8s integration test [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/05 18:47:01 UTC, 3 replies.
- [PR] [SPARK-56728] Simplify chainsaw test script via `apply` syntax [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/05 20:05:43 UTC, 0 replies.
- [PR] [SPARK-56716][PYTHON][TESTS] Add ASV microbenchmark for SQL_ARROW_UDTF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/05/05 20:51:32 UTC, 6 replies.
- Re: [PR] [SPARK-56727] Add `Apache DataFusion Comet` K8s integration test [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/05 21:31:27 UTC, 2 replies.
- [PR] [SPARK-56729][SQL] ReplaceData and WriteDelta should implement SupportsNonDeterministicExpression [spark] - posted by "pabloggarc (via GitHub)" <gi...@apache.org> on 2026/05/05 22:02:46 UTC, 2 replies.
- Re: [PR] [SPARK-40337][PS] Implement SeriesGroupBy.describe in pandas API on Spark [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/05/05 23:15:59 UTC, 2 replies.
- [PR] [SPARK-56730][PYTHON] Fix type annotation for DataFrame.sample [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/05/05 23:33:22 UTC, 2 replies.
- Re: [PR] [SPARK-56599][SQL] Add scan narrowing for column-level UPDATEs in DSv2 [spark] - posted by "anuragmantri (via GitHub)" <gi...@apache.org> on 2026/05/05 23:37:36 UTC, 22 replies.
- Re: [PR] [SPARK-56728] Simplify `chainsaw` test manifests via `apply` syntax [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/06 00:00:32 UTC, 2 replies.
- [PR] [SPARK-56731][PYTHON] Fix type annotation for DataFrame.replace [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/05/06 00:02:45 UTC, 2 replies.
- [PR] [SPARK-55554] Add `Apache Gluten` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/06 00:07:22 UTC, 5 replies.
- Re: [PR] [SPARK-56720][SS] Fail subsequent async log writes after a prior failure in async progress tracking [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/05/06 00:21:03 UTC, 9 replies.
- [PR] [SPARK-56732] Upgrade `Spark` to 4.2.0-preview5 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/06 01:22:23 UTC, 3 replies.
- [PR] [SPARK-56733] Improve `SparkAppResourceSpec` to use Java-friendly `KubernetesDriverSpec` APIs [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/06 02:08:15 UTC, 3 replies.
- [PR] [SPARK-56735] Improve `SparkClusterResourceSpec` to use Java-friendly `SparkConf` API [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/06 02:27:59 UTC, 3 replies.
- [PR] [MINOR][PYTHON][TESTS] Rename `test_utils` to `test_parity_utils` for Connect parity convention [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/06 02:30:43 UTC, 2 replies.
- [PR] [SPARK-56734][CORE] Optimize RocksDBPersistenceEngine with Column Families and zero-allocation prefix matching [spark] - posted by "darion-yaphet (via GitHub)" <gi...@apache.org> on 2026/05/06 02:33:29 UTC, 0 replies.
- Re: [PR] [SPARK-56543] Add RTM stateless benchmark [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/06 02:33:47 UTC, 47 replies.
- Re: [PR] [SPARK-56587][SQL] Show table names for V2 write nodes in UI [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/05/06 02:40:11 UTC, 0 replies.
- [PR] [SPARK-56736] Add `sparkVersion` method to `KubernetesConf` abstract class [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/06 02:53:42 UTC, 0 replies.
- Re: [PR] [SPARK-56736][K8S] Add `sparkVersion` method to `KubernetesConf` abstract class [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/06 02:55:55 UTC, 3 replies.
- Re: [PR] [SPARK-56546][SQL] Block-chunked segment-tree window frame for non-invertible sliding aggregates [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/05/06 03:06:45 UTC, 4 replies.
- Re: [PR] [SPARK-56674][SS][RTM][StreamingShuffle][Part1] Add streaming shuffle wire protocol [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/06 03:07:43 UTC, 24 replies.
- Re: [PR] [SPARK-56647][SQL] Optimize storage of SparkSQL Last Attempt Metrics [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/06 04:57:05 UTC, 1 replies.
- Re: [PR] [SPARK-56312][PYTHON] Refactor SQL_COGROUPED_MAP_ARROW_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/05/06 06:00:31 UTC, 4 replies.
- [PR] [WIP][PYTHON][TESTS] Skip string-to-decimal failure assertion on pandas 3 in test_type_coercion_string_to_numeric [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/06 06:21:42 UTC, 0 replies.
- [PR] [SPARK-56537][SS] Reset per-batch time fields and customMetrics on no batch trigger progress event [spark] - posted by "DHRUV6029 (via GitHub)" <gi...@apache.org> on 2026/05/06 06:49:09 UTC, 6 replies.
- [PR] fix: the hive thrift server's ldap authentication pr... in... [spark] - posted by "orbisai0security (via GitHub)" <gi...@apache.org> on 2026/05/06 06:54:30 UTC, 0 replies.
- [PR] [PYTHON] Restore string-to-decimal type mismatch error in Arrow Python UDF on Pandas 3 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/06 07:14:22 UTC, 0 replies.
- [PR] SPARK-56737[SQL] Avoid binary-incompatible mode method on BroadcastExchangeLike [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/06 07:18:54 UTC, 0 replies.
- Re: [PR] [SPARK-56737[SQL] Avoid binary-incompatible mode method on BroadcastExchangeLike [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/06 07:19:25 UTC, 0 replies.
- [PR] [SPARK-56740][BUILD] Change version in development branch to 5.0.0 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/05/06 08:06:01 UTC, 8 replies.
- [PR] [SPARK-56716][PYTHON][TESTS][4.x] Add ASV microbenchmark for SQL_ARROW_UDTF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/05/06 09:05:09 UTC, 2 replies.
- [PR] [SPARK-56741][PYTHON] Remove unused GroupPandasUDFSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/05/06 09:14:01 UTC, 2 replies.
- [PR] [SPARK-46625][SQL] Push WithCTE into CTEInChildren when materialised by ResolveIdentifierClause [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/05/06 10:43:12 UTC, 3 replies.
- Re: [PR] [SPARK-56744] Document test base class hierarchy in AGENTS.md [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/06 11:50:49 UTC, 0 replies.
- [PR] [SPARK-56744][INFRA] Document test base class hierarchy in AGENTS.md [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/06 11:53:56 UTC, 7 replies.
- [PR] [SPARK-56738][SQL] Normalize cteIds of orphan CTERelationRef in NormalizeCTEIds [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/05/06 12:15:19 UTC, 2 replies.
- [PR] [MINOR][SQL][TESTS] Drop redundant PlanTest/SQLHelper trait mixins [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/06 12:24:33 UTC, 0 replies.
- [PR] [SPARK-56747] Fix typos and stale examples in documentation [spark-kubernetes-operator] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/05/06 12:49:53 UTC, 4 replies.
- [PR] [MINOR][TESTS] Unify workspace test helpers via SparkTestPaths trait [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/06 13:03:13 UTC, 0 replies.
- Re: [PR] [SPARK-56611][SQL] Fix ALTER TABLE RENAME TO with catalog-qualified and table-only targets [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/06 13:23:50 UTC, 0 replies.
- [PR] [SPARK-56743][SQL] Use SQLLastAttemptMetric for DSv2 UPDATE and MERGE metrics [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2026/05/06 13:31:25 UTC, 1 replies.
- Re: [PR] [SPARK-56737][SQL] Avoid binary-incompatible mode method on `BroadcastExchangeLike` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/06 13:45:34 UTC, 3 replies.
- [PR] [SPARK-56324] Implementing UDFWorkerManager for new UDF worker sessions [spark] - posted by "sven-weber-db (via GitHub)" <gi...@apache.org> on 2026/05/06 14:05:17 UTC, 0 replies.
- [PR] [SPARK-56749][BUILD] Upgrade PostgreSQL JDBC driver to 42.7.11 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/06 14:06:29 UTC, 5 replies.
- [PR] [SPARK-56745][SQL] Cache foldable ZoneId in ConvertTimezone to avoid per-row lookup [spark] - posted by "TongWei1105 (via GitHub)" <gi...@apache.org> on 2026/05/06 14:28:06 UTC, 1 replies.
- Re: [PR] [SPARK-56743][SQL] Use SQLLastAttemptMetric for DSv2 UPDATE/DELETE/MERGE metrics [spark] - posted by "ZiyaZa (via GitHub)" <gi...@apache.org> on 2026/05/06 14:43:23 UTC, 10 replies.
- [PR] [MINOR][SQL][TESTS] Inline unnecessary asInstanceOf[classic.SparkSession] cast in QueryTest [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/06 14:45:19 UTC, 0 replies.
- [PR] [SPARK-56752] Enable `spark.kubernetes.driver.annotateExitException` by default [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/06 15:09:38 UTC, 4 replies.
- [PR] [SPARK-56753] Fix typos and code sample bugs in documentation [spark-connect-swift] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/05/06 15:48:24 UTC, 4 replies.
- [PR] [SPARK-56324] Introducing message-based communication to Spark -> PySpark communication channel [spark] - posted by "sven-weber-db (via GitHub)" <gi...@apache.org> on 2026/05/06 16:32:57 UTC, 39 replies.
- Re: [PR] Add Spark 4 protobuf definitions and basic working [spark-connect-rust] - posted by "franciscoabsampaio (via GitHub)" <gi...@apache.org> on 2026/05/06 17:45:59 UTC, 0 replies.
- Re: [PR] [DO NOT MERGE][SPARK-55952][SPARK-55953][SQL] Add ResolveChangelogTable analyzer rule for batch CDC post-processing [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/06 17:49:19 UTC, 0 replies.
- Re: [PR] [SPARK-55941] - Clean up CI Steps [spark-connect-rust] - posted by "franciscoabsampaio (via GitHub)" <gi...@apache.org> on 2026/05/06 17:49:36 UTC, 0 replies.
- [PR] [SPARK-56750] default path config [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/05/06 17:50:13 UTC, 27 replies.
- [PR] [SPARK-56755][SQL] Fix SHOW CREATE TABLE for v2 table partitioned by bucket transform [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/05/06 17:50:49 UTC, 7 replies.
- Re: [PR] [SPARK-55897][SQL] Handle UserDefinedType in ColumnarRow, ColumnarBatchRow, and ColumnarArray get() [spark] - posted by "jiayuasu (via GitHub)" <gi...@apache.org> on 2026/05/06 17:56:02 UTC, 8 replies.
- [PR] [SPARK-56482][SQL][FOLLOWUP] Simplify UnionExec codegen and narrow partition-index gate [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/06 18:04:24 UTC, 7 replies.
- [PR] [SPARK-56448][CONNECT] Fix NPE on Spark Connect client restart due to ammonite compile cache [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/06 18:31:49 UTC, 36 replies.
- [PR] [SPARK-56756][SQL] Add error class for recursiveFileLookup conflict with partitioned data source [spark] - posted by "markj-db (via GitHub)" <gi...@apache.org> on 2026/05/06 20:50:31 UTC, 4 replies.
- [PR] [4.0][SPARK-56759][INFRA] Update pip installation command for Python 3.9 [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/05/06 23:21:23 UTC, 0 replies.
- Re: [PR] [SPARK-56742][PYTHON][TESTS] Skip string-to-decimal failure assertion on pandas 3 in test_type_coercion_string_to_numeric [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/07 00:24:32 UTC, 1 replies.
- Re: [PR] [SPARK-56761][PYTHON][TESTS] Skip string-to-decimal assertions in test_type_coercion_string_to_numeric on Pandas 3 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/07 00:53:10 UTC, 0 replies.
- Re: [PR] [SPARK-55110][SQL] Order of application of 3 rules changed to achieve idempotency faster [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/07 00:54:27 UTC, 1 replies.
- Re: [PR] [SPARK-55201][CORE]: Add disableHttpPort to SSLOptions to prevent Jet… [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/07 00:54:34 UTC, 1 replies.
- Re: [PR] [SPARK-55185][SQL]. Fix for idempotency being broken, if InferFiltersFromConstraint rule is run as part of post optimization batch with fixed iterations [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/07 00:54:43 UTC, 1 replies.
- Re: [PR] [SPARK-55177][PYTHON] Support keyword arguments for df.groupby(...).agg(...) [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/07 00:54:49 UTC, 1 replies.
- [PR] [SPARK-56762][PYTHON][TESTS] Speed up test_crossvalidator_on_pipeline [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/05/07 01:17:19 UTC, 2 replies.
- Re: [PR] [SPARK-56661] Implementing UDFWorkerManager for new UDF worker sessions [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2026/05/07 02:07:01 UTC, 8 replies.
- Re: [PR] [SPARK-56746][SQL][TESTS] Drop redundant PlanTest/SQLHelper trait mixins [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/07 03:49:39 UTC, 1 replies.
- Re: [PR] [SPARK-55910][SQL][TESTS][FOLLOW-UP] Inline unnecessary asInstanceOf[classic.SparkSession] cast in QueryTest [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/07 03:51:18 UTC, 1 replies.
- [PR] [SPARK-56482][SQL][4.3] Enable whole-stage codegen fusion for `UnionExec` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/07 07:01:46 UTC, 2 replies.
- [PR] [SPARK-56482][SQL][4.2] Enable whole-stage codegen fusion for `UnionExec` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/07 07:06:14 UTC, 2 replies.
- Re: [PR] [SPARK-56759][INFRA][4.0] Update pip installation command for Python 3.9 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/05/07 07:13:24 UTC, 1 replies.
- [PR] [INFRA] Share SBT compile artifact across pyspark and sparkr CI jobs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/07 07:41:37 UTC, 0 replies.
- [PR] [SPARK-28587][SQL] Route JDBC partition bound literals through JdbcDialect.compileValue [spark] - posted by "AliaksandrAleksiukCollibra (via GitHub)" <gi...@apache.org> on 2026/05/07 08:21:10 UTC, 1 replies.
- Re: [PR] [SPARK-56611][SQL] Fix ALTER TABLE RENAME TO with catalog-qualified targets [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/05/07 08:32:45 UTC, 4 replies.
- [PR] [SPARK-34591] Add decision tree pruning as a parameter [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2026/05/07 08:38:24 UTC, 2 replies.
- [PR] [SPARK-56766][INFRA] Reduce the frequency of scheduled build in GitHub Actions [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/05/07 09:22:19 UTC, 4 replies.
- [PR] Bump io.netty:netty-transport-native-epoll from 4.2.12.Final to 4.2.13.Final [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/05/07 09:58:39 UTC, 2 replies.
- [PR] [MINOR][INFRA] Ignore AGENTS.md and CONTRIBUTING.md in determine_modules_for_files [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/07 10:42:04 UTC, 2 replies.
- Re: [PR] [SPARK-56661] Implementing UDFDispatcherManager for new UDF worker sessions [spark] - posted by "sven-weber-db (via GitHub)" <gi...@apache.org> on 2026/05/07 12:01:18 UTC, 8 replies.
- Re: [PR] [SPARK-34591][ML] Add decision tree pruning as a parameter [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/07 12:10:04 UTC, 16 replies.
- Re: [PR] [SPARK-56659][SQL] Show function resources in DESCRIBE FUNCTION output [spark] - posted by "TongWei1105 (via GitHub)" <gi...@apache.org> on 2026/05/07 12:31:09 UTC, 0 replies.
- [PR] [Backport 4.x][SPARK-56324] Add ZeroCopyByteStream to enable PySpark <-> Spark message-based communication [spark] - posted by "sven-weber-db (via GitHub)" <gi...@apache.org> on 2026/05/07 13:52:20 UTC, 3 replies.
- [PR] [SPARK-56770][DOCS] Update PROJ version to 9.8.1 in the documentation for geospatial types [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/05/07 14:43:58 UTC, 2 replies.
- [PR] [SPARK-56771][SQL] Enable geospatial support by default [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/05/07 14:57:32 UTC, 2 replies.
- [PR] [SPARK-56772] [SQL] [TESTS-ONLY] Improve `Window` testing [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/05/07 15:05:17 UTC, 2 replies.
- [PR] [SPARK-56769][SQL] Add fast path for date_trunc WEEK/MONTH/QUARTER/YEAR [spark] - posted by "Licht-T (via GitHub)" <gi...@apache.org> on 2026/05/07 15:10:52 UTC, 0 replies.
- [PR] Test Netty 4.2.13 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/07 15:29:13 UTC, 2 replies.
- [PR] [SPARK-XXXXX] Publish Apache Spark `4.2.0-preview5` to docker registry [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 15:43:05 UTC, 1 replies.
- [PR] [SPARK-56773][CORE][TESTS] Add more fetch-failure injection knobs for INJECT_SHUFFLE_FETCH_FAILURES [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2026/05/07 15:47:57 UTC, 7 replies.
- [PR] Update DataSketches Java to 9.0.0 version [spark] - posted by "medb (via GitHub)" <gi...@apache.org> on 2026/05/07 15:51:36 UTC, 0 replies.
- [PR] [SPARK-56525][INFRA] Run apt-get update before installing R dependencies [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/05/07 15:56:25 UTC, 0 replies.
- Re: [PR] [SPARK-56774] Publish Apache Spark `4.2.0-preview5` to docker registry [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 16:28:31 UTC, 2 replies.
- [PR] [SPARK-56765][PYTHON] Suppress pyarrow.compute mypy attr-defined errors [spark] - posted by "201573 (via GitHub)" <gi...@apache.org> on 2026/05/07 16:34:24 UTC, 5 replies.
- [PR] [SPARK-56775] Update docker/* GitHub Actions to ASF-approved commit hashes [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 16:57:38 UTC, 0 replies.
- Re: [I] Is this work still progressing? [spark-connect-rust] - posted by "franciscoabsampaio (via GitHub)" <gi...@apache.org> on 2026/05/07 16:58:04 UTC, 0 replies.
- [PR] [SPARK-56760][PYTHON] Remove dead numpy version check in pandas typehints [spark] - posted by "201573 (via GitHub)" <gi...@apache.org> on 2026/05/07 17:02:22 UTC, 2 replies.
- Re: [PR] [SPARK-56775] Update `docker/*` GitHub Actions to ASF-approved commit hashes [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 17:04:37 UTC, 4 replies.
- [PR] [SPARK-56753] Upgrade `Netty` to 4.2.13.Final [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 17:36:55 UTC, 2 replies.
- [PR] [SPARK-56753] Upgrade checkstyle to 13.4.2 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 17:38:49 UTC, 0 replies.
- [PR] [SPARK-56753] Upgrade Log4j to 2.26.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 17:39:01 UTC, 0 replies.
- [PR] [SPARK-56776] Upgrade `Netty` to 4.2.13.Final [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 17:39:14 UTC, 3 replies.
- Re: [PR] [SPARK-56778] Upgrade checkstyle to 13.4.2 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 17:44:05 UTC, 0 replies.
- Re: [PR] [SPARK-56777] Upgrade Log4j to 2.26.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 17:44:15 UTC, 0 replies.
- Re: [PR] [SPARK-56778] Upgrade `checkstyle` to 13.4.2 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 17:50:38 UTC, 2 replies.
- [PR] [SPARK-56779] Upgrade spotbugs-gradle-plugin to 6.5.4 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 17:50:53 UTC, 0 replies.
- [PR] [SPARK-56753] Upgrade PMD to 7.24.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 17:55:56 UTC, 0 replies.
- Re: [PR] [SPARK-56777] Upgrade `log4j` to 2.26.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 17:58:36 UTC, 2 replies.
- Re: [PR] [SPARK-56779] Upgrade `spotbugs-gradle-plugin` to 6.5.4 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 17:59:19 UTC, 2 replies.
- Re: [PR] [SPARK-56447][SHELL] Fix spark-shell REPL classpath initialization error [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/05/07 18:02:04 UTC, 0 replies.
- Re: [PR] [SPARK-56426][SQL] Fix LATERAL VIEW column alias with dot in name [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/05/07 18:07:10 UTC, 0 replies.
- [PR] [SPARK-56783] Disable `volcano` profile in K8S integration tests [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 18:08:37 UTC, 0 replies.
- [PR] [SPARK-56782][INFRA] Fix mypy attr-defined errors with PyArrow 24+ [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/05/07 18:11:22 UTC, 1 replies.
- Re: [PR] [SPARK-56783] Disable `volcano` profile in K8S IT [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 18:16:00 UTC, 3 replies.
- Re: [PR] [SPARK-56780] Upgrade PMD to 7.24.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 18:17:06 UTC, 2 replies.
- [PR] [SPARK-56784] Upgrade `medyagh/setup-minikube` to v0.0.21 [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 18:20:59 UTC, 3 replies.
- Re: [PR] [SPARK-56676][SQL][DML] DSv2 Transaction API Streaming Improvements [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/05/07 19:03:47 UTC, 3 replies.
- [PR] [SPARK-55731][Streaming] Assign error class for multiple event time columns [spark] - posted by "XdithyX (via GitHub)" <gi...@apache.org> on 2026/05/07 19:04:59 UTC, 3 replies.
- [PR] [SPARK-56785] Use the latest `actions/*` GitHub Actions [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 19:11:18 UTC, 3 replies.
- [PR] [MINOR] Add `.claude/` to `.gitignore` [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 19:21:18 UTC, 4 replies.
- [PR] [SPARK-56783][FOLLOWUP] Use `sed` instead because sbt-pom-reader is unable to disable [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 19:32:57 UTC, 4 replies.
- Re: [PR] [SPARK-56765][INFRA] Fix mypy attr-defined errors with PyArrow 24+ [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/05/07 20:26:08 UTC, 5 replies.
- Re: [PR] [SPARK-56768][PYTHON][INFRA] Share SBT compile artifact across pyspark CI jobs [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/05/07 20:27:22 UTC, 9 replies.
- [PR] [SPARK-56760][PYTHON] Remove dead numpy 1.21 version check in pandas typehints [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/05/07 20:28:47 UTC, 4 replies.
- [PR] [SPARK-56786] Add `pi-preview.yaml` with Apache Spark 4.2.0-preview5 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 20:31:43 UTC, 3 replies.
- [PR] [SPARK-56787] Add `Deployment`-based SparkApp example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 20:40:41 UTC, 2 replies.
- [PR] [SPARK-56788] Add `integration-test-ubuntu-spark42` GitHub Actions job [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 20:48:11 UTC, 3 replies.
- [I] Is Spark limited to split the Parquet read granularity by Row Group level only? [spark] - posted by "felipepessoto (via GitHub)" <gi...@apache.org> on 2026/05/07 20:54:16 UTC, 4 replies.
- [PR] [SPARK-56789] Add `ExecutorResizePlugin` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/07 21:36:35 UTC, 3 replies.
- [PR] [SPARK-46164][PYTHON] Add include/exclude parameters to DataFrame.describe in pandas API on Spark [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/05/07 21:48:14 UTC, 0 replies.
- [PR] [SPARK-56790][PYTHON][TESTS] Remove duplicated test cases for test_data_source_segfault [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/05/07 22:45:56 UTC, 2 replies.
- [PR] [SPARK-56758][PYTHON] Refactor SQL_MAP_PANDAS_ITER_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/05/07 23:45:05 UTC, 0 replies.
- Re: [PR] [SPARK-56519][PYTHON] Isolate communication part from python udf worker [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/05/07 23:45:25 UTC, 1 replies.
- Re: [PR] Upgrade Spark 4.1 + Affirm Specific Change [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/08 00:54:30 UTC, 1 replies.
- Re: [PR] [SPARK-51069][SQL] Add big-endian support to UnsafeRowUtils.validateStructuralIntegrityWithReasonImpl [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/08 00:54:33 UTC, 20 replies.
- Re: [PR] [SPARK-53327] Update DataSketches Java to 9.0.0 version [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/05/08 03:04:00 UTC, 2 replies.
- Re: [I] UNBOUND_SQL_PARAMETER in pyspark 4.1.1 when using named parameters [spark] - posted by "navvya31 (via GitHub)" <gi...@apache.org> on 2026/05/08 03:19:50 UTC, 1 replies.
- Re: [PR] [SPARK-56645][CORE] Fix History Server serving stale UI after app completes [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2026/05/08 03:27:46 UTC, 1 replies.
- [PR] [SPARK-56791][SQL] Add bulk read+widen path for INT32 to Long Parquet vector updater [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/08 03:35:10 UTC, 9 replies.
- [PR] Fix UNBOUND_SQL_PARAMETER regression in PySpark 4.1.1 [spark] - posted by "naan31 (via GitHub)" <gi...@apache.org> on 2026/05/08 04:24:57 UTC, 1 replies.
- [PR] [SPARK-56763][INFRA] Fix docker image build failures on branch-3.5 [spark] - posted by "aajisaka (via GitHub)" <gi...@apache.org> on 2026/05/08 06:07:56 UTC, 5 replies.
- Re: [PR] [WIP][SPARK-53327] Test datasketches-memory GH 272 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/05/08 06:52:31 UTC, 3 replies.
- [PR] [SPARK-56793][K8S] Avoid cluster-wide LIST in executor pods polling [spark] - posted by "TongWei1105 (via GitHub)" <gi...@apache.org> on 2026/05/08 08:32:56 UTC, 4 replies.
- [PR] [SPARK-56757][PYTHON] Refactor scalar iterator Pandas UDF worker path [spark] - posted by "201573 (via GitHub)" <gi...@apache.org> on 2026/05/08 08:35:12 UTC, 1 replies.
- [PR] [SPARK-56757][PYTHON] Refactor SQL_SCALAR_PANDAS_ITER_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/05/08 08:47:29 UTC, 0 replies.
- [PR] [SPARK-56540][INFRA] Add libuv1-dev to CI Docker images to fix R package fs build failure [spark] - posted by "aajisaka (via GitHub)" <gi...@apache.org> on 2026/05/08 09:33:09 UTC, 0 replies.
- [PR] Revert "[SPARK-34591][ML] Add decision tree pruning as a parameter" [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/08 10:20:39 UTC, 2 replies.
- Re: [PR] [SPARK-53840][SQL] Add AS JSON output support for SHOW TABLES and SHOW TABLE EXTENDED [spark] - posted by "ayushbilala (via GitHub)" <gi...@apache.org> on 2026/05/08 10:23:50 UTC, 11 replies.
- [PR] [SPARK-56794] [SQL] Move `WindowSubstitution` Pipe Sql resolution logic to `AstBuilder` [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/05/08 10:27:01 UTC, 3 replies.
- [PR] [INFRA] Share SBT precompile artifact with sparkr CI job [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/08 10:52:31 UTC, 0 replies.
- [PR] [INFRA] Share SBT precompile artifact with JVM build matrix [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/08 10:56:44 UTC, 1 replies.
- Re: [PR] [SPARK-56643][CONNECT][TESTS] Add DSv2 temp view with stored plan tests using Spark Connect mode [spark] - posted by "andreaschat-db (via GitHub)" <gi...@apache.org> on 2026/05/08 11:01:48 UTC, 7 replies.
- [PR] Test docker image build fix for branch-3.5 [spark] - posted by "aajisaka (via GitHub)" <gi...@apache.org> on 2026/05/08 11:30:11 UTC, 3 replies.
- [PR] [SPARK-XXXXX][TESTS] Make tests with `spark.sql.codegen.wholeStage.union.enabled=true` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/08 11:44:06 UTC, 2 replies.
- [PR] [INFRA] Share Maven precompile artifact across maven_test matrix [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/08 12:00:03 UTC, 0 replies.
- [PR] temp [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2026/05/08 13:16:33 UTC, 3 replies.
- [PR] [SPARK-56792][SQL] Support pan and zoom for SQL plan visualization [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/05/08 14:20:11 UTC, 6 replies.
- [PR] [SPARK-56797][BUILD] Upgrade `netty-tcnative` to 2.0.77.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/08 14:26:02 UTC, 2 replies.
- [PR] [SPARK-56796][UI] Fix sticky tooltips for Stage page additional metrics [spark] - posted by "XdithyX (via GitHub)" <gi...@apache.org> on 2026/05/08 17:12:00 UTC, 5 replies.
- [PR] [SPARK-40373][PS] Implement ps.show_versions [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/05/08 17:27:05 UTC, 2 replies.
- [PR] [SPARK-40553][PS] Support array-like value and sorter in Series.searchsorted [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/05/08 17:31:04 UTC, 1 replies.
- [PR] [SPARK-40340][SPARK-40343][PYTHON] Implement Rolling.sem and Expanding.sem in pandas API on Spark [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/05/08 19:52:04 UTC, 2 replies.
- [PR] [SPARK-40336][PS] Implement DataFrameGroupBy.cov [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/05/08 19:55:52 UTC, 2 replies.
- Re: [PR] [SPARK-56795][SQL] Reject column types unsupported by the data source on CREATE TABLE / ALTER TABLE [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2026/05/08 23:05:50 UTC, 1 replies.
- Re: [PR] [SPARK-56692][INFRA] Check release date of upgrade of pom dependency [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/05/08 23:30:05 UTC, 12 replies.
- [PR] [SPARK-56798][SQL][DOCS] Clarify streaming CDC emission timing and netChanges scope [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/09 00:14:42 UTC, 6 replies.
- [PR] Bump fast-uri from 3.1.0 to 3.1.2 in /dev [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/05/09 00:43:47 UTC, 2 replies.
- Re: [PR] [SPARK-34679][DOCS] Add inferTimestamp option to JSON data source doc… [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/09 00:54:06 UTC, 1 replies.
- Re: [PR] [PYTHON] Add missing docstrings to worker utility functions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/09 00:54:11 UTC, 1 replies.
- Re: [PR] [SPARK-53790][SQL] Support generic beans in Arrow Encoder [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/09 00:54:15 UTC, 4 replies.
- Re: [PR] [SPARK-56620][SQL] Fix stale entries in RuleIdCollection [spark] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2026/05/09 03:21:37 UTC, 0 replies.
- Re: [PR] [SPARK-53327][SQL] Workaround datasketches-memory Java 25 support [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/05/09 04:52:22 UTC, 7 replies.
- Re: [PR] [SPARK-56395][CONNECT][PYTHON] Add NEAREST BY DataFrame API [spark] - posted by "zhidongqu-db (via GitHub)" <gi...@apache.org> on 2026/05/09 05:48:36 UTC, 12 replies.
- [PR] [SPARK-56799][SQL] Search and highlight nodes in SQL plan visualization [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/05/09 06:16:11 UTC, 3 replies.
- [PR] [SPARK-56806][BUILD] Fix `jetty-proxy` artifact ID in `core/pom.xml`'s `includeArtifactIds` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/09 07:47:54 UTC, 2 replies.
- [PR] [SPARK-56755][SQL][TESTS][FOLLOWUP][4.1] Fix ShowCreateTableSuite [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/05/09 11:38:28 UTC, 2 replies.
- Re: [PR] [SPARK-55372][SQL] Fix `SHOW CREATE TABLE` for tables / views with default collation [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/05/09 11:52:05 UTC, 1 replies.
- [PR] [SPARK-56463][PYTHON][FOLLOWUP][3.5] Fix wrong kwargs [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/05/09 15:08:56 UTC, 5 replies.
- [PR] [SPARK-56638][SQL] Eliminate legacy error class for TABLESAMPLE fraction validation [spark] - posted by "XdithyX (via GitHub)" <gi...@apache.org> on 2026/05/09 15:45:26 UTC, 6 replies.
- [PR] [SPARK-55294][PYTHON] Add support for PyArrow-backed dtypes in pandas API [spark] - posted by "adith-os (via GitHub)" <gi...@apache.org> on 2026/05/09 16:03:36 UTC, 7 replies.
- Re: [PR] [SPARK-56805][SQL] Enable spark.sql.codegen.wholeStage.union.enabled by default [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/09 17:59:13 UTC, 3 replies.
- [PR] [SPARK-56807][INFRA] Downgrade black to 23.12.1 for older branches in Python CodeGen check [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/09 18:38:09 UTC, 5 replies.
- [PR] [SPARK-56808][INFRA][3.5] Fix branch-3.5 base image build against Ubuntu focal archive rotation [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/09 18:53:27 UTC, 6 replies.
- Re: [PR] [SPARK-56763][3.5][INFRA] Recover `Base image build` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/05/09 22:30:59 UTC, 4 replies.
- Re: [PR] [SPARK-55241][SQL]. Fix SQL Streaming idempotency broken, with PropagateEmptyRelation and InferFiltersFromConstraint run as part of Fixed Number of iterations [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/10 00:58:19 UTC, 1 replies.
- Re: [PR] [SPARK-55185][SPARK-55072][SPARK-55241][SQL] Combined PR to verify that SPARK-55072 is fixed with dependent PR of SPARK-55185 and SPARK-55241 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/10 00:58:24 UTC, 1 replies.
- Re: [PR] [SPARK-55072][SQL]. Ensure IsNotNull inferred filter is not missed for left leg of Inner Join ( obtained via conversion of Left Outer) [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/10 00:58:28 UTC, 1 replies.
- [PR] Test Fix foreach batch flaky test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/10 04:39:22 UTC, 0 replies.
- [PR] [SPARK-56811][UI] Restore sub-execution grouping on the SQL tab listing [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/05/10 16:46:01 UTC, 6 replies.
- [PR] [SPARK-56812][INFRA] Fix URL of get-pip.py in dev/infra/Dockerfile for Python 3.9 [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/05/10 17:26:00 UTC, 3 replies.
- Re: [PR] [SPARK-56763][SPARK-56535][SPARK-56810][INFRA][3.5] Recover branch-3.5 CI [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/05/10 17:37:47 UTC, 18 replies.
- [I] Dataset: Financial Data Bundle (3,518 records) - Free Sample Available [spark] - posted by "matisaar (via GitHub)" <gi...@apache.org> on 2026/05/10 17:59:26 UTC, 0 replies.
- [PR] [SPARK-56813][DOCS] Refine the documentation for geospatial types and functions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/05/10 23:16:07 UTC, 6 replies.
- Re: [PR] [SPARK-55038][SQL] Fix wrong results for array_agg(DISTINCT) with AQE… [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/11 00:58:32 UTC, 1 replies.
- Re: [PR] [SPARK-55120][K8S] Change driver/executor uuid to be val instead of def [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/11 00:58:36 UTC, 1 replies.
- Re: [PR] [SPARK-54880] [SQL] SELECT INTO statement support [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/11 00:58:38 UTC, 1 replies.
- Re: [PR] [SPARK-54310][SQL] Add `numSourceRows` metric for `MergeIntoExec` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/11 00:58:40 UTC, 1 replies.
- [PR] [SPARK-56755][SQL][TESTS][FOLLOWUP][4.0] Fix ShowCreateTableSuite [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/05/11 03:13:02 UTC, 2 replies.
- Re: [PR] [SPARK-54449][CORE] Storage Memory off heap size should be considered only when off heap is enabled [spark] - posted by "VindhyaG (via GitHub)" <gi...@apache.org> on 2026/05/11 04:13:32 UTC, 0 replies.
- Re: [PR] [SPARK-56586][CONNECT][TESTS] Bound and retry the flaky python foreachBatch termination test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/11 07:05:16 UTC, 2 replies.
- [PR] [SPARK-XXXXX][SQL][TESTS] Drop redundant QueryTest mixin from SharedSparkSession-based test suites [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/11 07:49:25 UTC, 0 replies.
- [PR] [WIP][PYTHON][TESTS] Patch pandas UDF input-type coercion golden in memory for Pandas 3 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/11 07:50:10 UTC, 0 replies.
- Re: [PR] [SPARK-56540][INFRA][3.5] Add libuv1-dev to CI Docker images to fix R package fs build failure [spark] - posted by "aajisaka (via GitHub)" <gi...@apache.org> on 2026/05/11 08:47:21 UTC, 5 replies.
- [PR] [SPARK-56814][SQL][TESTS] Add lateral join tests for outer attribute visibility after NATURAL/USING JOIN [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2026/05/11 09:05:11 UTC, 2 replies.
- [PR] [SPARK-56801][SQL] Add bulk read+widen path for INT32 to Double Parquet vector updater [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/11 09:36:21 UTC, 5 replies.
- [PR] [MINOR][INFRA][4.2] Fix `branch` input default in build_and_test.yml [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/11 09:44:02 UTC, 3 replies.
- [PR] [MINOR][INFRA][4.x] Fix `branch` input default in build_and_test.yml [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/11 09:44:11 UTC, 2 replies.
- Re: [PR] [SPARK-56535][BUILD] Fix CI & base image build issues [spark] - posted by "aajisaka (via GitHub)" <gi...@apache.org> on 2026/05/11 09:59:31 UTC, 0 replies.
- [PR] [SPARK-56815][SPARK-55852][DOCS] Document Java 25 support [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/05/11 10:24:36 UTC, 4 replies.
- [I] Optimizer failure: NormalizeCTEIds brakes CTE references for queries with nested CTEs [spark] - posted by "hkeller7kfw (via GitHub)" <gi...@apache.org> on 2026/05/11 10:54:57 UTC, 2 replies.
- Re: [PR] [SPARK-56817][BUILD] Upgrade Netty to 4.2.13.Final [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/11 14:43:10 UTC, 9 replies.
- [PR] [SPARK-56821][INFRA] Upgrade fast-uri to 3.1.2 and brace-expansion to 1.1.14 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/11 15:03:16 UTC, 0 replies.
- [PR] [SPARK-56823] Update GitHub Actions YAML file in `branch-0.9` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/11 15:20:04 UTC, 4 replies.
- [PR] [SPARK-56824] Bump version to 1.0.0-SNAPSHOT in `main` branch [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/11 15:29:47 UTC, 7 replies.
- [I] 1.0.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/11 15:30:00 UTC, 1 replies.
- Re: [PR] [SPARK-56805][SQL] Enable `spark.sql.codegen.wholeStage.union.enabled` by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/11 16:05:11 UTC, 4 replies.
- Re: [PR] [SPARK-30628][SQL] Support DPP and subquery partition pruning for V2 file sources [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/11 16:26:47 UTC, 3 replies.
- Re: [PR] [SPARK-50610][SQL] Fix decimal precision in HiveInspectors.toInspector [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/05/11 16:34:42 UTC, 4 replies.
- Re: [PR] [SPARK-55978][SQL] Add TABLESAMPLE SYSTEM block sampling with DSv2 pushdown [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/11 17:31:55 UTC, 8 replies.
- [PR] [SPARK-56827][INFRA] Clean stale genjavadoc output before JavaUnidoc [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/05/11 17:33:48 UTC, 5 replies.
- Re: [PR] [SPARK-56551][SQL][FOLLOW-UP] Fix setting `numDeletedRows` metric as -1 [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/11 17:54:56 UTC, 1 replies.
- [PR] [SPARK-56828] Upgrade `grpc-swift-2` to 2.4.1 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/11 19:10:31 UTC, 3 replies.
- Re: [PR] [SPARK-55731][SS] Assign error class for multiple event time columns [spark] - posted by "XdithyX (via GitHub)" <gi...@apache.org> on 2026/05/11 20:15:13 UTC, 3 replies.
- [PR] [SPARK-54953][PYTHON] Add type hints to NameTypeHolder and IndexNameTypeHolder classes [spark] - posted by "adith-os (via GitHub)" <gi...@apache.org> on 2026/05/11 20:48:27 UTC, 0 replies.
- Re: [PR] [SPARK-54993][PYTHON] Add type hints to NameTypeHolder and IndexNameTypeHolder classes [spark] - posted by "adith-os (via GitHub)" <gi...@apache.org> on 2026/05/11 20:50:22 UTC, 4 replies.
- [PR] [SPARK-56781][PYTHON] Refactor SQL_GROUPED_AGG_PANDAS_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/05/11 21:03:16 UTC, 2 replies.
- Re: [PR] [SPARK-56816][PYTHON][TESTS] Patch pandas UDF input-type coercion golden in memory for Pandas 3 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/05/11 22:08:54 UTC, 1 replies.
- Re: [PR] [SPARK-56429][DOCS] Clarify differences between nullValue and emptyValue CSV options [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/11 23:48:37 UTC, 0 replies.
- Re: [PR] [SPARK-54876][SQL] Fix splitSemiColon dropping statement ending with block comment [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/12 00:05:30 UTC, 16 replies.
- Re: [PR] [SPARK-56608][PYTHON] Migrate grouped/cogrouped map Arrow UDF verify checks into enforce_schema [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/12 00:30:09 UTC, 8 replies.
- Re: [PR] [SPARK-56591][SQL][TESTS][FOLLOW-UP] Drop redundant QueryTest mixin from SharedSparkSession-based test suites [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/12 01:06:10 UTC, 1 replies.
- Re: [PR] [SPARK-56821][INFRA] Upgrade `fast-uri` to 3.1.2 and `brace-expansion` to 1.1.14 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/12 02:56:44 UTC, 1 replies.
- [PR] [SPARK-XXXXX][SQL][TESTS] Drop redundant SparkFunSuite mixin from SharedSparkSession-based test suites [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/12 03:04:47 UTC, 0 replies.
- Re: [I] Supports write logs to S3 upon Driver/Executor termination [spark-kubernetes-operator] - posted by "melin (via GitHub)" <gi...@apache.org> on 2026/05/12 03:59:31 UTC, 0 replies.
- Re: [PR] [SPARK-56831][INFRA][R] Share SBT precompile artifact with sparkr CI job [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/12 04:19:12 UTC, 2 replies.
- [PR] [SPARK-56832][INFRA] Surface fatal javadoc errors in unidoc log summary and CI annotations [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/12 04:58:10 UTC, 4 replies.
- [PR] [SPARK-56546][SQL][FOLLOWUP] Address review comments in segment-tree window frame [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/12 05:01:01 UTC, 3 replies.
- [PR] [SPARK-56802][SQL] Add bulk read+widen path for FLOAT to Double Parquet vector updater [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/12 05:54:42 UTC, 6 replies.
- Re: [PR] [SPARK-56539][SS] Add state row format validation to prefixScan and rangeScan [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/12 06:43:28 UTC, 7 replies.
- Re: [PR] [SPARK-54560] Safe type filtering in QueryPlan._subqueries to prevent ClassCastException in AQE [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/12 06:51:54 UTC, 0 replies.
- Re: [PR] [SPARK-51961][SQL] Fix from_avro to handle union schemas [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/12 06:56:54 UTC, 1 replies.
- [PR] [SPARK-54434][PYTHON] Use return instead of exit in bin/find-spark-home short-circuit [spark] - posted by "1fanwang (via GitHub)" <gi...@apache.org> on 2026/05/12 07:48:50 UTC, 0 replies.
- [PR] [SPARK-56818][DOCS] Fix Binder build by pinning Debian Bookworm base … [spark] - posted by "stan-buren (via GitHub)" <gi...@apache.org> on 2026/05/12 09:30:36 UTC, 0 replies.
- Re: [PR] [SPARK-56829][SQL][TESTS] Drop redundant SparkFunSuite mixin from SharedSparkSession-based test suites [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/12 11:40:02 UTC, 1 replies.
- Re: [PR] [SPARK-56619][SQL][TESTS] Add DSv2 repeated table access tests with internal/external changes [spark] - posted by "andreaschat-db (via GitHub)" <gi...@apache.org> on 2026/05/12 11:52:20 UTC, 0 replies.
- [PR] [SPARK-XXXXX][SQL][TESTS] Drop redundant BeforeAndAfterEach and SharedSparkSession mixins [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/12 11:52:43 UTC, 0 replies.
- Re: [PR] [SPARK-56619][CONNECT][TESTS] Add DSv2 repeated table access tests with internal/external changes in Spark Connect [spark] - posted by "andreaschat-db (via GitHub)" <gi...@apache.org> on 2026/05/12 11:52:57 UTC, 3 replies.
- [PR] [SPARK-56819][SQL] Add option to trim CHAR trailing spaces on read [spark] - posted by "llphxd (via GitHub)" <gi...@apache.org> on 2026/05/12 11:57:51 UTC, 2 replies.
- [I] Pandas On Spark crashing on Windows when applying a custom function. [spark] - posted by "IMarvinTPA (via GitHub)" <gi...@apache.org> on 2026/05/12 13:29:45 UTC, 2 replies.
- [PR] [SPARK-56833][TESTS] Add `-XX:+EnableDynamicAgentLoading` to test JVM options [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/12 15:47:15 UTC, 0 replies.
- [PR] [SPARK-56826][SQL] Skip PushVariantIntoScan for VariantGet with null-evaluating path [spark] - posted by "Shekharrajak (via GitHub)" <gi...@apache.org> on 2026/05/12 15:48:48 UTC, 0 replies.
- Re: [PR] [SPARK-56833][TESTS] Add `-XX:+EnableDynamicAgentLoading` to test JVM options to suppress JEP 451 warnings [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/12 16:03:26 UTC, 3 replies.
- [PR] [SPARK-56815][DOCS][FOLLOWUP] Add Java 25 to `building-spark.md` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/12 16:29:42 UTC, 5 replies.
- [PR] [SPARK-56820][SQL] Add counter_diff window function for converting cumulative counters to delta format [spark] - posted by "pnikic-db (via GitHub)" <gi...@apache.org> on 2026/05/12 16:30:47 UTC, 18 replies.
- [PR] [SPARK-56834] Use Java `25-jre` instead of `21-jre` image in K8s Dockerfile [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/12 16:34:44 UTC, 0 replies.
- Re: [PR] [SPARK-56834][K8S] Use Java `25-jre` instead of `21-jre` image in K8s Dockerfile [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/12 16:40:15 UTC, 3 replies.
- [PR] [SPARK-56835][K8S][DOCS][INFRA] Upgrade Volcano to 1.14.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/12 17:38:14 UTC, 5 replies.
- [PR] [SPARK-56836][INFRA] Add Java 25 CI for `branch-4.2/4.x` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/12 18:00:06 UTC, 4 replies.
- [PR] [SPARK-56837][PYTHON][TESTS] Pass ArrowBatchedUDF benchmark input_type via EvalConf [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/05/12 18:57:46 UTC, 2 replies.
- [PR] [SPARK-56838][SDP][AutoCDC] Introduce AutoCDC parameters dataclass [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/05/12 21:12:17 UTC, 0 replies.
- [PR] [SPARK-56839] Remove dev loop config for new state format of stream-stream join [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/05/12 21:58:59 UTC, 0 replies.
- [PR] [SPARK-56840][SQL] Avoid unresolved NullIf type lookup [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/05/12 22:01:20 UTC, 3 replies.
- Re: [PR] [SPARK-52218][SS] RabbitMQ stream source [spark] - posted by "keksmd (via GitHub)" <gi...@apache.org> on 2026/05/12 22:24:21 UTC, 0 replies.
- Re: [PR] [SPARK-52382][PYTHON] Fix TypeError when collecting MapType with ArrayType keys [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/12 23:09:51 UTC, 0 replies.
- Re: [PR] [SPARK-55830][SQL] Fix JDBC predicate pushdown dropping driver properties [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/12 23:14:50 UTC, 0 replies.
- Re: [PR] [SPARK-49671][SQL] Remove the RTRIM collation config [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/05/12 23:18:14 UTC, 2 replies.
- Re: [PR] [SPARK-55532][Geo][SQL] Add SRID validation to Geo execution classes in catalyst [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/05/12 23:28:04 UTC, 4 replies.
- [PR] [SPARK-56842][SQL] Short-circuit AQE when materialized stages are empty [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/05/13 00:15:58 UTC, 1 replies.
- [PR] [SPARK-56843][BUILD] Update `checkJavaVersion` to ban 25.0.[0-3] properly [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/13 00:17:22 UTC, 0 replies.
- [PR] [SPARK-56844][SQL] Support ArrayType / MapType / StructType in ConstantColumnVector and FileSourceMetadataAttribute [spark] - posted by "mzhang (via GitHub)" <gi...@apache.org> on 2026/05/13 03:15:41 UTC, 4 replies.
- Re: [PR] docs: suggest documentation improvements for better user experience [spark] - posted by "myhearwillgoon (via GitHub)" <gi...@apache.org> on 2026/05/13 03:29:25 UTC, 0 replies.
- Re: [PR] [SPARK-55553][GRAPHX] Unpersist sccWorkGraph in StronglyConnectedComponents [spark] - posted by "dkranchii (via GitHub)" <gi...@apache.org> on 2026/05/13 05:15:47 UTC, 0 replies.
- Re: [PR] [SPARK-56470][SQL] Schema evolution for DSv2 sinks during streaming write [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2026/05/13 08:02:23 UTC, 0 replies.
- Re: [PR] [SPARK-56618][CONNECT][TESTS] Add DSv2 join refresh tests for incrementally constructed queries in Spark Connect [spark] - posted by "andreaschat-db (via GitHub)" <gi...@apache.org> on 2026/05/13 08:35:27 UTC, 1 replies.
- Re: [PR] [SPARK-56618][SQL][TESTS] Add DSv2 join refresh tests for incrementally constructed queries [spark] - posted by "andreaschat-db (via GitHub)" <gi...@apache.org> on 2026/05/13 08:36:02 UTC, 8 replies.
- [PR] [DOCS][CONNECT] Document DataFrame column resolution behavior in spark-connect-gotchas [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/13 09:12:51 UTC, 0 replies.
- [PR] [SPARK-54735][SQL][REVERT] Revert column comments preservation in view with SCHEMA EVOLUTION [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2026/05/13 09:52:00 UTC, 3 replies.
- Re: [PR] [MINOR][TESTS] Extract TestEnvHelper trait from SparkTestSuite [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/13 11:27:21 UTC, 0 replies.
- [PR] [SPARK-56803][SQL] Add bulk read+narrow path for INT64 DECIMAL to 32-bit Decimal Parquet vector updater [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/13 12:21:19 UTC, 20 replies.
- [PR] [SPARK-36458][ML] Allow approxSimilarityJoin and approxNearestNeighbors to work without inputCol [spark] - posted by "Phucvt123 (via GitHub)" <gi...@apache.org> on 2026/05/13 12:26:08 UTC, 0 replies.
- Re: [PR] [SPARK-56838][SDP] Introduce AutoCDC parameters dataclass [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/05/13 13:39:07 UTC, 26 replies.
- [PR] [SPARK-56804][SQL] Add bulk read+convert path for DATE to TimestampNTZ Parquet vector updater [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/13 14:37:12 UTC, 6 replies.
- Re: [PR] [SPARK-56843][BUILD] Update `checkJavaVersion` to ban 25.0.[0-2] properly [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/13 14:58:13 UTC, 2 replies.
- [PR] [SPARK-56847][CORE] Promote SerializableConfiguration to Stable [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/05/13 14:59:26 UTC, 0 replies.
- [PR] [SPARK-56848] Upgrade `Apache DataFusion Comet` to 0.16.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/13 15:07:52 UTC, 3 replies.
- Re: [PR] [SPARK-56847][CORE] Promote `SerializableConfiguration` to Stable [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/13 15:13:07 UTC, 3 replies.
- Re: [PR] [SPARK-56817][BUILD][4.3] Upgrade Netty to 4.2.13.Final [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/13 15:35:50 UTC, 4 replies.
- [PR] [SPARK-56817][BUILD][4.2] Upgrade Netty to 4.2.13.Final [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/13 15:40:38 UTC, 6 replies.
- Re: [PR] [SPARK-56325][SDP] Refactor FlowSystemMetadata.flowCheckpointsDirOpt to avoid scala.Option [spark] - posted by "jaceklaskowski (via GitHub)" <gi...@apache.org> on 2026/05/13 16:09:51 UTC, 3 replies.
- [PR] [SPARK-56849] Use Spark 4.1.1 in `Apache DataFusion Comet` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/13 16:14:11 UTC, 4 replies.
- [PR] [SPARK-56845] Truncate ConfigMap names that exceed DNS subdomain limit [spark] - posted by "shivadarshan-devadiga (via GitHub)" <gi...@apache.org> on 2026/05/13 16:33:21 UTC, 1 replies.
- [PR] [SPARK-56809][UI] Show SQL description and metadata on the execution detail page [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/05/13 16:43:23 UTC, 5 replies.
- Re: [PR] WIP [spark] - posted by "shivadarshan-devadiga (via GitHub)" <gi...@apache.org> on 2026/05/13 17:02:10 UTC, 0 replies.
- [PR] [SPARK-56850] Add Spark `4.2.0-preview5` K8s integration tests [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/13 17:31:33 UTC, 4 replies.
- [PR] [SPARK-56851] Remove `v1alpha` version of SparkApp and SparkCluster CRDs [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/13 17:44:11 UTC, 2 replies.
- [PR] [SPARK-56852] Upgrade `Gradle` to 9.5.1 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/13 18:14:48 UTC, 4 replies.
- [PR] [SPARK-56853] Improve PATH Tests [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/05/13 19:41:22 UTC, 5 replies.
- Re: [PR] [SPARK-56572][SDP] Inject Spark session into Python files [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/13 19:50:13 UTC, 10 replies.
- Re: [PR] [SPARK-56851] Remove `v1alpha1` version of SparkApp and SparkCluster CRDs [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/13 20:33:22 UTC, 1 replies.
- [PR] [SPARK-56855] Upgrade `kubernetes-client` to 7.6.0 and update CRDs for K8s 1.36 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/13 21:01:38 UTC, 4 replies.
- [PR] [SPARK-56857] Upgrade Swift to 6.3.2 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/13 21:52:19 UTC, 2 replies.
- [PR] [SPARK-56858] Use `Xcode 26.5` in CIs [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/13 21:58:01 UTC, 6 replies.
- [PR] [SPARK-56854][PYTHON] Filter None values in DataFrame[Stream]Reader/Writer .option(s) [spark] - posted by "lavanv11 (via GitHub)" <gi...@apache.org> on 2026/05/13 22:14:17 UTC, 5 replies.
- [PR] [SPARK-56860][PYTHON] Remove unused CogroupArrowUDFSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/05/14 00:47:20 UTC, 3 replies.
- Re: [PR] [SPARK-56841][SQL][TESTS] Drop redundant BeforeAndAfterEach and SharedSparkSession mixins [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/14 00:49:56 UTC, 1 replies.
- Re: [PR] [WIP] POC for serializer changes [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/14 00:59:12 UTC, 1 replies.
- [PR] [SPARK-56764][SQL] Add spark.jars to SharedState.jarClassLoader for persistent UDF resolution [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/14 01:36:28 UTC, 8 replies.
- [PR] [PS][TESTS] Fix `ArrowInterfaceTests` being silently skipped by unittest [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/14 03:20:16 UTC, 0 replies.
- [PR] [SPARK-56001][SQL][FOLLOWUP] Reject table alias for INSERT ... REPLACE WHERE [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/14 03:21:13 UTC, 4 replies.
- [PR] [INFRA] Consolidate python-ps-minimum image into python-minimum [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/14 03:59:46 UTC, 0 replies.
- [PR] [SPARK-56395][SQL][FOLLOWUP] Fix missing comma in MimaExcludes on branch-4.2 [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/14 05:32:52 UTC, 2 replies.
- [PR] [SPARK-56845][K8S] Truncate ConfigMap names that exceed DNS subdomain limit [spark] - posted by "TongWei1105 (via GitHub)" <gi...@apache.org> on 2026/05/14 06:47:15 UTC, 1 replies.
- Re: [PR] [SPARK-56845] [K8S] Truncate ConfigMap names that exceed DNS subdomain limit [spark] - posted by "shivadarshan-devadiga (via GitHub)" <gi...@apache.org> on 2026/05/14 06:59:13 UTC, 2 replies.
- Re: [PR] [SPARK-56861][PS][TESTS] Fix `ArrowInterfaceTests` being silently skipped by unittest [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/14 07:56:22 UTC, 1 replies.
- [PR] [PYTHON][CONNECT][TESTS] Drop redundant `SQLTestUtils` mixin from `ReusedMixedTestCase` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/14 08:03:04 UTC, 0 replies.
- [PR] [SPARK-46367][SQL][FOLLOWUP] Filter mixed-arity KPs in projectKeyedPartitionings [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/14 09:02:09 UTC, 0 replies.
- Re: [PR] [SPARK-46367][SQL][FOLLOWUP] Group mixed-arity KPs by arity in projectKeyedPartitionings [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/14 09:15:07 UTC, 1 replies.
- [PR] [SPARK-56859][SQL] Create user error for IllegalArgumentException in CSVOptions [spark] - posted by "shivadarshan-devadiga (via GitHub)" <gi...@apache.org> on 2026/05/14 09:30:09 UTC, 7 replies.
- Re: [PR] [SPARK-56152][SQL] Enable implicit cast from STRING to TIME type [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/14 10:00:43 UTC, 7 replies.
- [PR] [SPARK-56865][INFRA] Drop master's N.0.0 fix-version default when a branch-M.x is also being merged [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/14 11:02:49 UTC, 10 replies.
- [PR] [INFRA] Pin downstream actions/checkout to a single resolved SHA [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/14 11:08:47 UTC, 0 replies.
- [PR] [SPARK-XXXXX][CORE] Add IO_URING transport mode [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/14 12:19:36 UTC, 2 replies.
- Re: [PR] [SPARK-56846][DOCS][CONNECT] Document DataFrame column resolution behavior in spark-connect-gotchas [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/14 13:05:45 UTC, 4 replies.
- Re: [PR] [SPARK-46367][SQL][FOLLOWUP] Assert same arity in projectKeyedPartitionings [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/14 14:37:31 UTC, 7 replies.
- [PR] [SPARK-56867][SQL] Respect `spark.jars.ivySettings` when downloading Hive metastore jars [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/05/14 16:04:06 UTC, 2 replies.
- [I] User Defined Functions crash Spark Dataframes created directly, but not for ones made from Pandas on Spark. [spark] - posted by "IMarvinTPA (via GitHub)" <gi...@apache.org> on 2026/05/14 16:06:43 UTC, 4 replies.
- [PR] [SPARK-56840][SQL][FOLLOW-UP] Add a real NullIf repro test [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/05/14 17:23:30 UTC, 7 replies.
- [I] Feature request: inferSchema do not infer digit strings that start with 0 as integer [spark] - posted by "jxu (via GitHub)" <gi...@apache.org> on 2026/05/14 17:47:27 UTC, 3 replies.
- Re: [I] Github issues for spark bootstrap list [spark] - posted by "jxu (via GitHub)" <gi...@apache.org> on 2026/05/14 18:00:04 UTC, 1 replies.
- Re: [PR] [SPARK-56865][INFRA] Suggest a minimal Fix Versions set when resolving JIRA [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/14 18:21:20 UTC, 3 replies.
- [PR] [SPARK-50593][SQL] SPJ: Support truncate transform via generalized ReducibleFunction API [spark] - posted by "metanil (via GitHub)" <gi...@apache.org> on 2026/05/14 18:43:02 UTC, 18 replies.
- [PR] WIP Spark 56763 sarutak 3.5 restore additional functionality r2 [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/05/14 18:47:34 UTC, 2 replies.
- [PR] [SPARK-56868][SQL] Extract V2 runtime-filter + partition planning into a shared helper [spark] - posted by "vitaliili-db (via GitHub)" <gi...@apache.org> on 2026/05/14 20:38:22 UTC, 12 replies.
- [PR] [DO-NOT-MERGE][POC] RDD in Python Spark Connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/05/14 21:42:36 UTC, 1 replies.
- [PR] [SPARK-56869][SQL] Speed up TreeNode transforms when rule doesn't match [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/14 21:51:28 UTC, 2 replies.
- Re: [PR] [SQL] Update grammar/TableChange to allow CLUSTER BY expressions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/15 04:48:01 UTC, 0 replies.
- [PR] [SPARK-56872][SQL] Fix NPE in DowncastLongUpdater.decodeSingleDictionaryId [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/15 05:15:16 UTC, 4 replies.
- [PR] [SPARK-56873][CORE] Fix race condition in bounded k-way merge in UnsafeExternalSorter [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2026/05/15 06:53:40 UTC, 0 replies.
- [PR] [SPARK-48091][SQL] Preserve aliases inside lambda when ExtractGenerator restructures plan [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/05/15 07:55:53 UTC, 9 replies.
- [PR] [SPARK-56874][SQL] Fast-path DateTimeUtils.daysToMicros for ZoneOffset.UTC [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/15 08:05:18 UTC, 0 replies.
- Re: [PR] [SPARK-56874][SQL] Fast-path `DateTimeUtils.daysToMicros` for `ZoneOffset.UTC` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/15 08:06:26 UTC, 13 replies.
- Re: [PR] [SPARK-54022][SPARK-56617][SQL][TESTS] Add more CACHE TABLE tests and reorganize CACHE TABLE tests [spark] - posted by "andreaschat-db (via GitHub)" <gi...@apache.org> on 2026/05/15 08:07:50 UTC, 0 replies.
- Re: [PR] [SPARK-54022][SPARK-56617][CONNECT][TESTS] Add DSv2 CACHE TABLE tests using Spark Connect [spark] - posted by "andreaschat-db (via GitHub)" <gi...@apache.org> on 2026/05/15 08:08:00 UTC, 2 replies.
- [PR] [SPARK-56872][SQL][4.2] Fix NPE in DowncastLongUpdater.decodeSingleDictionaryId [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/15 09:11:59 UTC, 6 replies.
- [PR] [SPARK-56875][SQL] Refactor time/session window resolution code to be reused in the single-pass Analyzer [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2026/05/15 09:27:53 UTC, 2 replies.
- [PR] [SPARK-56872][SQL][4.1] Fix NPE in DowncastLongUpdater.decodeSingleDictionaryId [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/15 09:43:23 UTC, 2 replies.
- [PR] [SPARK-56872][SQL][4.0] Fix NPE in DowncastLongUpdater.decodeSingleDictionaryId [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/15 09:54:17 UTC, 4 replies.
- [PR] [SPARK-56872][SQL][3.5] Fix NPE in DowncastLongUpdater.decodeSingleDictionaryId [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/15 09:59:46 UTC, 5 replies.
- Re: [PR] [SPARK-56550][SQL] Support source with fewer columns/fields in INSERT INTO WITH SCHEMA EVOLUTION [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/15 10:50:30 UTC, 6 replies.
- [PR] [SPARK-55792][PS] Optimize DataFrame diff axis=0 [spark] - posted by "emanhthangngot (via GitHub)" <gi...@apache.org> on 2026/05/15 11:02:59 UTC, 2 replies.
- [I] Pyspark: `from_json` is missing `MapType` as a type hint for `schema` argument [spark] - posted by "Julian-J-S (via GitHub)" <gi...@apache.org> on 2026/05/15 14:59:52 UTC, 5 replies.
- [PR] [SPARK-56877][SQL] Enforce `KeyedPartitioning` invariant in `PartitioningCollection` [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/05/15 15:43:28 UTC, 7 replies.
- [PR] [SPARK-44734][PYTHON][DOCS] Expand PySpark type conversion guide [spark] - posted by "RaghunandanKumar (via GitHub)" <gi...@apache.org> on 2026/05/15 16:19:18 UTC, 0 replies.
- [PR] [SPARK-56878][BUILD] Upgrade Parquet to 1.17.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/15 16:25:34 UTC, 4 replies.
- [PR] [WIP][CONNECT] Support directory uploads in Spark Connect copyFromLocalToFs [spark] - posted by "RaghunandanKumar (via GitHub)" <gi...@apache.org> on 2026/05/15 16:31:34 UTC, 0 replies.
- [PR] [SPARK-51262][SQL] Fix exceptAll after dropDuplicates with subset [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/05/15 16:31:45 UTC, 11 replies.
- [PR] [SPARK-56468][UDF] Validate required worker capabilities in direct dispatcher [spark] - posted by "RaghunandanKumar (via GitHub)" <gi...@apache.org> on 2026/05/15 16:49:25 UTC, 0 replies.
- [PR] [SPARK-56879][CORE][TESTS] Improve `JavaUtilsSuite` to be robust [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/15 18:55:49 UTC, 0 replies.
- [PR] [SPARK-56881][CORE][TESTS] Improve `FsHistoryProviderSuite` to be more robust [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/15 19:16:44 UTC, 3 replies.
- Re: [PR] [SPARK-56879][CORE][TESTS] Improve `JavaUtilsSuite` to be more robust [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/15 20:18:10 UTC, 2 replies.
- [PR] [SPARK-56885][CORE][TESTS] Make `CompressionCodecSuite` be independent from the default value of io compression codec [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/15 20:37:10 UTC, 5 replies.
- [PR] [SPARK-56884][BUILD] Upgrade `zstd-jni` to 1.5.7-8 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/15 20:38:37 UTC, 3 replies.
- [PR] [SPARK-56886][CORE][TESTS] Improve `UtilsSuite` to be more robust [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/15 20:58:14 UTC, 4 replies.
- [PR] [SPARK-56887][SQL] Add dedicated sort-merge physical operator for AS-OF join [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/05/15 21:21:49 UTC, 11 replies.
- [PR] [SPARK-56888][PYTHON][DOCS] Simplify `get_caller_source_code_location` docstring [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/15 21:31:37 UTC, 5 replies.
- [PR] [SPARK-56889][PYTHON][INFRA] Drop Python 3.10 Support [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/15 21:47:23 UTC, 5 replies.
- [PR] [SPARK-56883][SQL] DESCRIBE FUNCTION for SQL UDFs [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/05/15 22:51:22 UTC, 5 replies.
- [PR] [INFRA] Set up default rulesets for default and release branches [spark-connect-go] - posted by "asf-gitbox-commits (via GitHub)" <gi...@apache.org> on 2026/05/15 22:56:06 UTC, 0 replies.
- [PR] [INFRA] Set up default rulesets for default and release branches [spark-connect-rust] - posted by "asf-gitbox-commits (via GitHub)" <gi...@apache.org> on 2026/05/15 22:56:11 UTC, 0 replies.
- [PR] [INFRA] Set up default rulesets for default and release branches [spark-connect-swift] - posted by "asf-gitbox-commits (via GitHub)" <gi...@apache.org> on 2026/05/15 22:56:21 UTC, 2 replies.
- [PR] [INFRA] Set up default rulesets for default and release branches [spark-docker] - posted by "asf-gitbox-commits (via GitHub)" <gi...@apache.org> on 2026/05/15 22:56:24 UTC, 2 replies.
- [PR] [INFRA] Set up default rulesets for default and release branches [spark-kubernetes-operator] - posted by "asf-gitbox-commits (via GitHub)" <gi...@apache.org> on 2026/05/15 22:56:30 UTC, 0 replies.
- [PR] [INFRA] Set up default rulesets for default and release branches [spark] - posted by "asf-gitbox-commits (via GitHub)" <gi...@apache.org> on 2026/05/15 22:56:40 UTC, 0 replies.
- [PR] [SPARK-56999][CONNECT] Propagate Spark Connect session user as a SparkContext local property [spark] - posted by "hit2024 (via GitHub)" <gi...@apache.org> on 2026/05/16 04:32:52 UTC, 0 replies.
- [PR] [SPARK-56710][INFRA][FOLLOWUP] Remove `build_branch4(x|2)_python_pypy3.10.yml` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/16 18:48:24 UTC, 3 replies.
- [PR] [SPARK-56892][SQL] Bulk read optimization for Parquet DELTA_BINARY_PACKED decoding [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/16 19:42:34 UTC, 7 replies.
- [PR] [SPARK-56893][SQL] Optimize Parquet dictionary decoding with hasNull fast path and per-class updater overrides [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/16 20:42:43 UTC, 0 replies.
- [PR] [SPARK-56894][SQL] Add vectorized Parquet BYTE_STREAM_SPLIT reader [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/16 22:32:22 UTC, 0 replies.
- Re: [I] PushPredicateThroughNonJoin assertion failure when pushing filter through Project into Union (Hive view) [spark] - posted by "puneetdixit200 (via GitHub)" <gi...@apache.org> on 2026/05/16 22:47:20 UTC, 1 replies.
- Re: [I] [GRAPHX] Fix sccWorkGraph cache leak in StronglyConnectedComponents [spark] - posted by "puneetdixit200 (via GitHub)" <gi...@apache.org> on 2026/05/16 22:47:32 UTC, 0 replies.
- [PR] [SPARK-56895][SQL] Batch ByteBuffer slice in RLE PACKED decode to reduce allocation overhead [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/16 23:18:27 UTC, 0 replies.
- [PR] [SPARK-56896][SQL] Add bulk read paths for timestamp/date Parquet vector updaters [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 00:09:52 UTC, 0 replies.
- [PR] [SPARK-56897][SQL] Reduce per-value allocations in DELTA_BYTE_ARRAY Parquet decoder [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 00:41:57 UTC, 0 replies.
- Re: [PR] [SPARK-55073][SQL][PYTHON] Don't capture SparkPlan in EvalPythonUDTFExec [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/17 00:59:36 UTC, 1 replies.
- [PR] [SPARK-56898] feat: rewrite COUNT(DISTINCT IF) to COUNT(DISTINCT) FILTER for Expand reduction [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/05/17 02:26:46 UTC, 0 replies.
- [PR] [SPARK-56840][SQL][3.5] Avoid unresolved NullIf type lookup [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/05/17 02:32:03 UTC, 6 replies.
- [PR] [SPARK-56903][SQL] Spread NULL outer join keys across shuffle partitions [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/05/17 03:10:31 UTC, 45 replies.
- [PR] [SPARK-56637][CORE] Fix Variant getFieldByKey to handle unsorted object fields [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/17 05:51:47 UTC, 9 replies.
- [PR] [SPARK-56904][SQL] Fix Int overflow in LongToUnsafeRowMap page size computations [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/17 06:07:50 UTC, 4 replies.
- [PR] [SPARK-56905][SQL] Support BYTE_STREAM_SPLIT encoding on Parquet write path [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 06:50:47 UTC, 2 replies.
- [PR] fix issue MapType as a type hint for schema 55900 [spark] - posted by "deepanshu36 (via GitHub)" <gi...@apache.org> on 2026/05/17 08:41:48 UTC, 1 replies.
- [PR] [SPARK-56907][SQL] Reduce per-value allocation in DELTA_LENGTH_BYTE_ARRAY Parquet vectorized reader [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/17 09:11:15 UTC, 0 replies.
- Re: [PR] [SPARK-56638][SQL] Replace legacy parser error for ParserUtils validation failures [spark] - posted by "XdithyX (via GitHub)" <gi...@apache.org> on 2026/05/17 16:18:31 UTC, 11 replies.
- [PR] Add AGENTS.md + SECURITY.md for scan-agent discoverability [spark-docker] - posted by "potiuk (via GitHub)" <gi...@apache.org> on 2026/05/17 22:50:06 UTC, 1 replies.
- [PR] Add AGENTS.md + SECURITY.md for scan-agent discoverability [spark-connect-rust] - posted by "potiuk (via GitHub)" <gi...@apache.org> on 2026/05/17 22:50:11 UTC, 2 replies.
- [PR] Add SECURITY.md + AGENTS.md Security section for scan-agent discoverability [spark] - posted by "potiuk (via GitHub)" <gi...@apache.org> on 2026/05/17 22:50:19 UTC, 1 replies.
- [PR] [SPARK-56909][SQL] Simplify Cast to int/long codegen under ANSI mode [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/17 23:29:20 UTC, 6 replies.
- [PR] [SPARK-56910][SQL] Simplify Cast to byte/short codegen under ANSI mode [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/17 23:30:04 UTC, 5 replies.
- [PR] [SPARK-56911][SQL] Simplify Cast to decimal codegen under ANSI mode [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/17 23:30:22 UTC, 8 replies.
- [PR] [SPARK-56912][SQL] Simplify Cast to boolean codegen under ANSI mode [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/17 23:30:25 UTC, 7 replies.
- [PR] [SPARK-56913][SQL] Simplify BinaryArithmetic byte/short codegen under ANSI mode [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/17 23:30:47 UTC, 14 replies.
- [PR] [SPARK-56914][SQL] Simplify decimal arithmetic codegen under ANSI mode [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/17 23:30:49 UTC, 6 replies.
- [PR] [SPARK-56915][SQL] Simplify MakeDate/MakeInterval codegen under ANSI mode [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/17 23:31:01 UTC, 11 replies.
- [PR] [SPARK-56916][SQL] Simplify ElementAt array codegen under ANSI mode [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/17 23:31:18 UTC, 10 replies.
- [PR] [SPARK-56440][CONNECT] Upgrade ammonite to 3.0.9 [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/18 00:00:01 UTC, 2 replies.
- [PR] [SPARK-53225][SQL] Upgrade datasketches-java to 7.0.1 and datasketches-memory to 4.1.0 [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/18 00:09:59 UTC, 2 replies.
- Re: [PR] [SPARK-XXXXX][SQL] Add CrossJoinArrayContainsToInnerJoin optimizer rule [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/18 01:00:57 UTC, 1 replies.
- Re: [PR] [SPARK-56864][INFRA][PYTHON] Consolidate python-ps-minimum image into python-minimum [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/18 02:27:19 UTC, 1 replies.
- [PR] [SPARK-56864][INFRA][PYTHON][4.x] Consolidate python-ps-minimum image into python-minimum [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/18 02:33:19 UTC, 2 replies.
- [PR] [SPARK-56864][INFRA][PYTHON][4.2] Consolidate python-ps-minimum image into python-minimum [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/18 02:33:26 UTC, 2 replies.
- [PR] [SPARK-56889][INFRA][FOLLOWUP] Restore python3.10 in dev/infra/Dockerfile [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/18 03:56:31 UTC, 5 replies.
- [PR] [TESTS][CONNECT] Expand Connect-specific tests for DataFrame column resolution [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/18 04:05:00 UTC, 0 replies.
- Re: [PR] [SPARK-56873][CORE] Fix potential race condition in bounded k-way merge in UnsafeExternalSorter as defensive protection [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2026/05/18 04:56:25 UTC, 5 replies.
- [PR] [SPARK-53520][SQL] Handle TimeType in javaBoxedType() [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/18 05:06:11 UTC, 3 replies.
- [PR] [SPARK-46625][SQL] Place IDENTIFIER placeholder in command name slot [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/18 05:19:28 UTC, 5 replies.
- [PR] [SPARK-52719][SQL] Support using scalar UDFs in TVF arguments [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/18 06:48:24 UTC, 3 replies.
- [PR] [MINOR][BUILD][3.5] Fix linter issue in `AmmoniteReplE2ESuite` [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/05/18 08:13:16 UTC, 3 replies.
- [PR] [WIP][SPARK-56876][SQL] Add TimestampNTZNanosType and TimestampLTZNanosType [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/05/18 08:50:18 UTC, 0 replies.
- [PR] [SPARK-56918][CORE] Add ManagedConsumer SPI for shrinkable external storage memory [spark] - posted by "baibaichen (via GitHub)" <gi...@apache.org> on 2026/05/18 10:23:00 UTC, 6 replies.
- [PR] [WIP] Fixing PySpark benchmark build & install [spark] - posted by "sven-weber-db (via GitHub)" <gi...@apache.org> on 2026/05/18 10:41:54 UTC, 1 replies.
- [PR] Add recursive read for partition [spark] - posted by "abhishek6s (via GitHub)" <gi...@apache.org> on 2026/05/18 11:05:08 UTC, 0 replies.
- Re: [PR] [SPARK-56920][SQL] Support METRIC_VIEW creation on V2 catalogs [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/18 11:56:49 UTC, 0 replies.
- Re: [PR] [SPARK-56661] Introducing logical and physical planning nodes for language-agnostic Spark UDFs [spark] - posted by "sven-weber-db (via GitHub)" <gi...@apache.org> on 2026/05/18 13:44:06 UTC, 32 replies.
- Re: [I] [SPARK-56921] Optimizer failure: NormalizeCTEIds brakes CTE references for queries with nested CTEs [spark] - posted by "hkeller7kfw (via GitHub)" <gi...@apache.org> on 2026/05/18 14:23:46 UTC, 1 replies.
- [PR] [SPARK-56889][INFRA][FOLLOWUP] Install `python3-pyparsing` before `add-apt-repository` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/18 15:11:42 UTC, 5 replies.
- [PR] [SPARK-56627][SQL] DecimalAggregates: peel scale-preserving widening Cast for SUM and AVG [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/05/18 15:12:10 UTC, 8 replies.
- Re: [PR] [SPARK-56592][K8S] Skip upgrading setuptools in K8s PySpark Dockerfile [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/18 18:32:23 UTC, 0 replies.
- Re: [PR] [SPARK-54293][SQL] Make ThriftHttpCLIService SNI host check configurable [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/18 21:00:51 UTC, 3 replies.
- [PR] [SPARK-56868][SQL][FOLLOW-UP] Clarify scaladoc for V2 runtime filter helpers [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/05/18 21:16:32 UTC, 5 replies.
- [PR] [SPARK-56928][PYTHON] Increase minimum numpy version to 1.23.2 [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/05/18 21:20:57 UTC, 6 replies.
- [PR] [SPARK-35158][INFRA] Add guidance to retrigger forked workflow runs [spark] - posted by "fallintoplace (via GitHub)" <gi...@apache.org> on 2026/05/18 21:24:30 UTC, 4 replies.
- Re: [PR] [MINOR][INFRA] Set up default rulesets for default and release branches [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/18 21:48:35 UTC, 1 replies.
- [PR] [SPARK-56929][PYTHON] Pass prefers_large_types when building expected schema for Arrow grouped/cogrouped map UDFs [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/05/18 22:02:07 UTC, 4 replies.
- [PR] [SPARK-56930] Upgrade `spotless-plugin-gradle` to 8.5.1 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/18 22:10:18 UTC, 2 replies.
- [PR] [SPARK-56931][SQL] Support complex constant metadata in row materialization path [spark] - posted by "mzhang (via GitHub)" <gi...@apache.org> on 2026/05/18 22:32:34 UTC, 5 replies.
- [PR] [SPARK-56084][PYTHON] Remove unused ArrowStreamGroupUDFSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/05/18 22:39:26 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-56479][SQL] df.cache() with DSv2 interfaces to enable V2ScanRelationPushDown optimizer rules [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/05/18 22:50:40 UTC, 2 replies.
- [PR] [SPARK-54476][PYTHON][TEST] Add coverage test for try_mod [spark] - posted by "fallintoplace (via GitHub)" <gi...@apache.org> on 2026/05/18 23:16:39 UTC, 3 replies.
- [PR] [SPARK-56889][INFRA][FOLLOWUP] Remove the unnecessary python3-pyparsing from dockerfile [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/05/18 23:18:43 UTC, 4 replies.
- [PR] [SPARK-56932][SQL] Rewrite top-level single-column NOT IN subqueries with UNION [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/05/18 23:25:30 UTC, 0 replies.
- [PR] [SQL] Cache SQL metrics in MergeRowsExec interpreted iterator [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/05/18 23:29:32 UTC, 0 replies.
- [PR] WIP [SPARK-56924][PYTHON][INFRA] Python lock files and unify python source of truth [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/05/18 23:40:55 UTC, 1 replies.
- Re: [PR] [SPARK-56863][PYTHON][PS][TESTS] Drop redundant `SQLTestUtils` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/19 00:56:03 UTC, 1 replies.
- Re: [PR] [SPARK-56866][INFRA] Pin downstream actions/checkout to a single resolved SHA [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/19 00:58:30 UTC, 2 replies.
- Re: [PR] [SPARK-56898] Rewrite COUNT(DISTINCT IF) to COUNT(DISTINCT) FILTER for Expand reduction [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/05/19 02:06:37 UTC, 0 replies.
- [PR] [SPARK-56856][SDP] SCD1 Microbatch Deduplication [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/05/19 02:29:01 UTC, 0 replies.
- [PR] [SPARK-56870][SDP] Extend Microbatch with CDC Metadata [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/05/19 02:32:56 UTC, 0 replies.
- [PR] [INFRA] Make build_infra_images_cache workflow error tolerant [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/19 02:44:27 UTC, 0 replies.
- Re: [PR] [SPARK-55568][SQL] Separate schema construction from field stats collection [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/19 04:42:16 UTC, 2 replies.
- [PR] [SPARK-56935][SQL] Simplify GetArrayItem codegen and consolidate ElementAtUtils into ArrayExpressionUtils [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/19 05:09:22 UTC, 4 replies.
- [PR] [PYTHON][TESTS] Fix PandasUDFReturnTypeTests for pandas 3 and Ubuntu 24.04 tzdata [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/19 06:12:07 UTC, 0 replies.
- [I] Automatically create the spark history log directory [spark] - posted by "melin (via GitHub)" <gi...@apache.org> on 2026/05/19 06:32:26 UTC, 0 replies.
- Re: [PR] [SPARK-56873][CORE] Fix potential race condition in bounded k-way merge in UnsafeExternalSorter [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2026/05/19 07:02:22 UTC, 4 replies.
- Re: [PR] [SPARK-56934][INFRA] Make build_infra_images_cache workflow error tolerant [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/19 07:07:17 UTC, 4 replies.
- [PR] [SPARK-56938][CONNECT][TESTS] Initialize base session in `AddArtifactsHandlerSuite` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/05/19 07:28:42 UTC, 3 replies.
- [PR] [SPARK-56939][SQL] Resolve deadlock between USE and function lookup [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/05/19 07:49:20 UTC, 9 replies.
- [PR] [SPARK-56937][PYTHON] Raise error on wrong column count in Arrow grouped/cogrouped map UDF (positional mode) [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/05/19 08:01:19 UTC, 0 replies.
- [PR] [SPARK-33902][SQL][FOLLOWUP] Add missing delegation methods to DelegatingCatalogExtension [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/05/19 08:12:30 UTC, 0 replies.
- Re: [PR] [SPARK-56937][PYTHON] Raise error on wrong column count in Arrow grouped/cogrouped map UDF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/19 08:14:20 UTC, 3 replies.
- [PR] [SPARK-56862][SQL] Preserve SQL UDF call-site origin in input Cast for runtime error context [spark] - posted by "mikhailnik-db (via GitHub)" <gi...@apache.org> on 2026/05/19 09:53:17 UTC, 2 replies.
- Re: [PR] [SPARK-56933][SQL] Cache SQL metrics in MergeRowsExec interpreted iterator [spark] - posted by "ZiyaZa (via GitHub)" <gi...@apache.org> on 2026/05/19 10:49:44 UTC, 8 replies.
- [PR] [SPARK-56942][SQL] Widen DSv2 row-id resolution to support nested columns [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2026/05/19 12:23:35 UTC, 1 replies.
- [PR] [SPARK-56940][SQL] Extend OptimizeRand optimizer to support arithmetic expressions [spark] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2026/05/19 13:15:22 UTC, 10 replies.
- [PR] [SPARK-54119][SQL][FOLLOWUP] Format METRIC_VIEW DESCRIBE output distinctly from VIEW [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/19 13:37:09 UTC, 3 replies.
- Re: [PR] [SPARK-54918][SQL] Normalize -0.0 to 0.0 in array operations [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/05/19 13:46:23 UTC, 7 replies.
- [PR] [SPARK-56944] [SQL] Trim alises from ListAgg expression subtree [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/05/19 14:29:53 UTC, 0 replies.
- [PR] [SPARK-56921][SQL] Fix CTE ID normalization for nested CTEs [spark] - posted by "puneetdixit200 (via GitHub)" <gi...@apache.org> on 2026/05/19 14:33:42 UTC, 7 replies.
- Re: [PR] [MINOR][INFRA] Set up default rulesets for default and release branches [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/19 14:59:22 UTC, 2 replies.
- [PR] [SPARK-56945][SQL] Fix stale nullability in CTE references containing SQL UDFs [spark] - posted by "mikhailnik-db (via GitHub)" <gi...@apache.org> on 2026/05/19 15:58:59 UTC, 8 replies.
- [PR] [SPARK-55791][PYTHON] Fix pandas-on-Spark equality comparisons under ANSI mode [spark] - posted by "fuxi611 (via GitHub)" <gi...@apache.org> on 2026/05/19 16:25:33 UTC, 1 replies.
- [PR] [SPARK-56948][SQL][TESTS] Make TPCDSQueryBenchmark heap/broadcast configurable [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/05/19 16:36:47 UTC, 2 replies.
- [PR] [SPARK-55897][SQL][4.1] Handle UserDefinedType in ColumnarRow, ColumnarBatchRow, and ColumnarArray get() [spark] - posted by "james-willis (via GitHub)" <gi...@apache.org> on 2026/05/19 16:58:43 UTC, 3 replies.
- [PR] [SPARK-55897][SQL][4.0] Handle UserDefinedType in ColumnarRow, ColumnarBatchRow, and ColumnarArray get() [spark] - posted by "james-willis (via GitHub)" <gi...@apache.org> on 2026/05/19 16:58:58 UTC, 5 replies.
- [PR] [SPARK-56882][SDP] Implement SCD1 Batch Processor; Target Column Projection [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/05/19 17:18:23 UTC, 5 replies.
- [PR] [SPARK-56950] Upgrade `gRPC Swift Protobuf` to 2.4.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/19 17:19:55 UTC, 3 replies.
- [PR] [SPARK-56926][CONNECT] Guard against null messageParameters in Connect error proto serialization [spark] - posted by "haoyangeng-db (via GitHub)" <gi...@apache.org> on 2026/05/19 17:27:40 UTC, 2 replies.
- [PR] [SPARK-56951] Use 4.1.2 RC1 for Spark 4.1 integration tests [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/19 17:27:48 UTC, 3 replies.
- [PR] [SPARK-56249][SDP] Implement SCD1 Batch Processor; Merge Tombstones onto Microbatch [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/05/19 17:39:01 UTC, 3 replies.
- [PR] [SPARK-56952] Preserve heartbeat timeout executor loss reason [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/05/19 17:40:20 UTC, 0 replies.
- [PR] [SPARK-56923][SDP] Implement SCD1 Batch Processor; Merge Microbatch onto Auxiliary [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/05/19 17:43:24 UTC, 2 replies.
- [PR] [SPARK-56927] Implement SCD1 Batch Processor; Merge Microbatch onto Target [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/05/19 17:52:34 UTC, 0 replies.
- [PR] [SPARK-56954][PYTHON] Annotate that we support MapType for from_json [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/05/19 18:50:37 UTC, 2 replies.
- Re: [PR] [SPARK-33902][SQL][FOLLOWUP] Add createTableLike delegation to DelegatingCatalogExtension [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/19 20:05:47 UTC, 3 replies.
- [I] Spark Declarative Pipelines: enable primary key check as expectation [spark] - posted by "br-valstream (via GitHub)" <gi...@apache.org> on 2026/05/19 20:13:39 UTC, 0 replies.
- [PR] [SPARK-56448][CONNECT][TESTS] Skip AmmoniteReplE2ESuite on JDK 25+ [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/19 20:23:19 UTC, 0 replies.
- Re: [PR] [SPARK-56856][SDP] Implement SCD1 Batch Processor; Microbatch Deduplication [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/05/19 20:44:33 UTC, 18 replies.
- Re: [PR] [SPARK-56870][SDP] Implement SCD1 Batch Processor; Extend Microbatch with CDC Metadata [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/05/19 21:40:20 UTC, 9 replies.
- [PR] [SPARK-56959][INFRA] Remove branch input for some workflows [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/05/19 23:56:01 UTC, 0 replies.
- [PR] [SPARK-56550][SQL] Support source with fewer columns/fields in INSERT INTO WITH SCHEMA EVOLUTION (branch-4.2) [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/05/20 00:26:56 UTC, 0 replies.
- Re: [PR] [SPARK-56550][SQL][4.2] Support source with fewer columns/fields in INSERT INTO WITH SCHEMA EVOLUTION [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/05/20 00:28:47 UTC, 4 replies.
- Re: [PR] [SPARK-56943][INFRA] Share SBT precompile artifact with JVM build matrix [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/20 01:16:02 UTC, 1 replies.
- [PR] [SPARK-56960][SQL][TESTS] Support custom Ivy settings file in `HiveVersionSuite` via environment variable [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/05/20 01:20:11 UTC, 10 replies.
- [PR] [SPARK-56955][CONNECT] Arrow/Netty memory allocator fails on JDK 25 [spark] - posted by "attilapiros (via GitHub)" <gi...@apache.org> on 2026/05/20 01:53:27 UTC, 4 replies.
- Re: [PR] [SPARK-56934][4.X][INFRA] Make build_infra_images_cache workflow error tolerant [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/20 02:01:32 UTC, 1 replies.
- Re: [PR] [SPARK-56955][CORE] Add --sun-misc-unsafe-memory-access=allow for JDK 25+ [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/20 02:01:35 UTC, 2 replies.
- Re: [PR] [SPARK-56934][4.2][INFRA] Make build_infra_images_cache workflow error tolerant [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/20 02:12:05 UTC, 0 replies.
- Re: [PR] [SPARK-56936][PYTHON][TESTS] Fix PandasUDFReturnTypeTests for pandas 3 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/20 02:14:49 UTC, 1 replies.
- [PR] [INFRA] Auto-close non-default-branch PRs in merge_spark_pr.py [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/20 04:19:46 UTC, 0 replies.
- [PR] [SPARK-56962][SS][RTM][StreamingShuffle][Part2] Add StreamingShuffleOutputTracker for streaming shuffle coordination [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/05/20 06:49:55 UTC, 8 replies.
- [PR] [SPARK-56949][SQL] DecimalAggregates drops evalMode when rewriting Sum/Average [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/05/20 07:02:10 UTC, 5 replies.
- Re: [PR] [SPARK-56944] [SQL] Trim aliases from ListAgg expression subtree [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/05/20 07:47:55 UTC, 10 replies.
- Re: [PR] [SPARK-56876][SQL] Add TimestampNTZNanosType and TimestampLTZNanosType [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/05/20 09:55:18 UTC, 7 replies.
- Re: [PR] [SPARK-56839][SS] Remove dev loop config for new state format of stream-stream join [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/05/20 10:23:09 UTC, 1 replies.
- Re: [PR] [SPARK-56963][INFRA] Auto-close non-default-branch PRs in merge_spark_pr.py [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/20 10:45:55 UTC, 1 replies.
- Re: [PR] [SPARK-56726][CONNECT] Add Dataset.getNumPartitions to Spark Connect client [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2026/05/20 13:38:19 UTC, 1 replies.
- [PR] [SPARK-54119][SQL][FOLLOWUP] Add CreateMetricView logical plan and pre-parse inputColumns [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/20 14:41:46 UTC, 0 replies.
- Re: [PR] [SPARK-56920][SQL][FOLLOWUP] Add CreateMetricView logical plan and pre-parse inputColumns [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/20 15:18:01 UTC, 2 replies.
- Re: [PR] [SPARK-53996][SQL] Improve InferFiltersFromConstraints to infer filters from complex join expressions [spark] - posted by "vanekjar (via GitHub)" <gi...@apache.org> on 2026/05/20 15:25:53 UTC, 0 replies.
- [I] [SPARK-56908][SQL] Parquet vectorized reader performance improvements (umbrella) [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/05/20 15:43:36 UTC, 2 replies.
- [I] importing `pyspark.testing` monkeypatch `unittest.main` [spark] - posted by "hoxbro (via GitHub)" <gi...@apache.org> on 2026/05/20 15:55:34 UTC, 1 replies.
- Re: [PR] [SPARK-56676][SQL][DML] DSv2 Transactional Streaming Writes need to Validate Target between Microbatches [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/05/20 16:34:53 UTC, 0 replies.
- Re: [PR] [SPARK-56955][CONNECT] Replace -Dio.netty.noUnsafe=false with --sun-misc-unsafe-memory-access=allow for a more complete JDK 25+ support [spark] - posted by "attilapiros (via GitHub)" <gi...@apache.org> on 2026/05/20 16:59:43 UTC, 4 replies.
- [PR] [SPARK-55846][DOCS] Update Web UI documentation for UI modernization [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/05/20 17:10:33 UTC, 4 replies.
- Re: [PR] [SPARK-52825][CORE] Support AWS protocols in MySQLDialect and PostgresDialect [spark] - posted by "aaron-congo (via GitHub)" <gi...@apache.org> on 2026/05/20 18:12:41 UTC, 0 replies.
- Re: [PR] [SPARK-56650][SDP][CONNECT] Add AutoCDC Spark Connect APIs [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/05/20 18:13:03 UTC, 14 replies.
- [PR] [SPARK-56968][SS] Force offset log VERSION_2 when streaming source evolution is enabled [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/05/20 18:23:24 UTC, 5 replies.
- Re: [PR] [WIP] Sequential Union Implementation [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/05/20 18:29:11 UTC, 0 replies.
- Re: [PR] [SPARK-55795][SS] Add automatic V1 to V2 offset log upgrade for streaming queries with named sources [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/05/20 18:29:13 UTC, 0 replies.
- [PR] [SPARK-56953][SDP] Implement SCD1 Batch Processor; foreachBatch Callback [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/05/20 18:38:46 UTC, 12 replies.
- [PR] Forbid user specified schema for Table [spark] - posted by "PorridgeSwim (via GitHub)" <gi...@apache.org> on 2026/05/20 20:14:15 UTC, 0 replies.
- [PR] [SPARK-56970][SS] Split CommitMetadata into CommitMetadataBase + V1/V2 case classes [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/05/20 20:46:54 UTC, 7 replies.
- [PR] [SPARK-56971][SS] Add CommitMetadataV3 and SinkMetadataInfo for sink evolution [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/05/20 20:47:10 UTC, 0 replies.
- [PR] [SPARK-56972][SS] Persist sink name in V3 commit log via MicroBatchExecution [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/05/20 20:47:25 UTC, 0 replies.
- Re: [PR] [4.x][SPARK-56959][INFRA] Remove branch input for some workflows [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/05/20 21:02:49 UTC, 1 replies.
- [PR] [SPARK-56973][PYTHON] Consolidate verify_pandas_result with verify_arrow_result via shared helper [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/05/20 22:28:39 UTC, 3 replies.
- [PR] [4.x][SPARK-56974][INFRA] Add Java 17 workflow and rename master -> branch-4.x [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/05/20 22:32:08 UTC, 2 replies.
- [PR] fix [spark] - posted by "zhidongqu-db (via GitHub)" <gi...@apache.org> on 2026/05/20 23:18:14 UTC, 0 replies.
- [PR] [SPARK-46625][SQL][FOLLOWUP] Resolve identifier expression in InsertIntoStatement/V2WriteCommand table slot [spark] - posted by "haoyangeng-db (via GitHub)" <gi...@apache.org> on 2026/05/20 23:25:36 UTC, 4 replies.
- [PR] [SPARK-56976][SQL] Support Two-Argument IF(condition, value) Returning NULL [spark] - posted by "Richard-Durkee (via GitHub)" <gi...@apache.org> on 2026/05/20 23:29:27 UTC, 2 replies.
- Re: [PR] [SPARK-56977][SQL] RewriteNearestByJoin should respect joinType in the synthetic join [spark] - posted by "andylam-db (via GitHub)" <gi...@apache.org> on 2026/05/21 00:21:35 UTC, 6 replies.
- [PR] [INFRA] Require [COMPONENT] tag in PR title at merge time [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/21 00:44:50 UTC, 0 replies.
- Re: [PR] [SPARK-54729][CORE] Proactively replicate shuffle data to the FallbackStorage [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/21 01:02:56 UTC, 1 replies.
- Re: [PR] [SPARK-55325][PYTHON] Introduce ArrowArrayToPandasConversion.convert_pyarrow [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/21 02:51:40 UTC, 0 replies.
- Re: [PR] [SPARK-56975][SS] Reject user-specified schema in DataStreamReader.table() [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/05/21 02:53:02 UTC, 4 replies.
- [PR] [SPARK-55250][SQL][FOLLOWUP] Skip createNamespace for IF NOT EXISTS on existing namespace [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/21 03:49:17 UTC, 2 replies.
- [PR] [SPARK-56966][SPARK-56967][CORE] Auto-create event log and history se… [spark] - posted by "sharma-0311 (via GitHub)" <gi...@apache.org> on 2026/05/21 05:56:36 UTC, 5 replies.
- [PR] [SPARK-56820][SQL] Change counter_diff available since version from 4.2 to 4.3 in doc comments [spark] - posted by "pnikic-db (via GitHub)" <gi...@apache.org> on 2026/05/21 09:20:40 UTC, 2 replies.
- [PR] [SPARK-55978][SQL][FOLLOWUP] Don't block V2 join pushdown when pushed Sample has fraction=1 [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/21 09:21:29 UTC, 5 replies.
- [PR] [WIP][SQL] DSv2 Write Timing Metrics [spark] - posted by "ZiyaZa (via GitHub)" <gi...@apache.org> on 2026/05/21 10:20:19 UTC, 0 replies.
- [PR] [SPARK-56966][SPARK-56967][CORE] Auto-create missing event log directories [spark] - posted by "sharma-0311 (via GitHub)" <gi...@apache.org> on 2026/05/21 10:49:05 UTC, 2 replies.
- Re: [PR] [SPARK-56964][INFRA] Share Maven precompile artifact across maven_test matrix [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/21 10:58:54 UTC, 4 replies.
- [PR] [SPARK-56983][SQL] DecimalAggregates widened-Cast peel must preserve query semantics [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/21 11:38:54 UTC, 3 replies.
- [PR] [MINOR][PYTHON][TESTS] Rename TVFParityTestsMixin to TVFParityTests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/21 12:14:57 UTC, 2 replies.
- [PR] [BACKPORT][BRANCH-4.x][SPARK-56750][SPARK-56853][SPARK-56939][SPARK-56681][SQL] Backport default SQL PATH stack to branch-4.x [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/05/21 13:02:59 UTC, 8 replies.
- Re: [PR] [SPARK-56979][INFRA] Require COMPONENT tag in PR title at merge time [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/21 13:19:55 UTC, 13 replies.
- [PR] [SPARK-56695][SQL][DML] Resolve Path Based Tables for both Reads and Writes [spark] - posted by "andreaschat-db (via GitHub)" <gi...@apache.org> on 2026/05/21 13:54:03 UTC, 8 replies.
- [PR] [SPARK-56984][DOCS] Document the SQL PATH feature [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/05/21 13:59:13 UTC, 6 replies.
- [PR] [SPARK-56965][SQL] Add SQL parser support for TIMESTAMP_NTZ(p) and TIMESTAMP_LTZ(p) [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/05/21 14:10:24 UTC, 10 replies.
- [PR] [SPARK-56985] Upgrade `Iceberg` example to use Iceberg 1.11.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/21 14:32:09 UTC, 3 replies.
- [PR] [SPARK-56986] Upgrade `java-operator-sdk` to 5.3.4 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/21 16:14:49 UTC, 4 replies.
- [PR] [SPARK-56987] Upgrade `JUnit` to 6.1.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/21 16:20:45 UTC, 4 replies.
- [PR] [SPARK-56956][SDP] Introduce AutoCDC Flow Dataclasses [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/05/21 16:21:53 UTC, 14 replies.
- [PR] [SPARK-56988] Add `dev/spark_jira_utils.py` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/21 17:13:22 UTC, 4 replies.
- [PR] [SPARK-56989] Publish Apache Spark 4.1.2 to docker registry [spark-docker] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/05/21 17:27:32 UTC, 3 replies.
- [PR] [WIP][SS] Stop dropping records with same event time when watermark delay is 0 [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2026/05/21 17:35:47 UTC, 2 replies.
- [PR] [SPARK-56961][SQL] Pass all options while loading changelog [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/05/21 18:10:10 UTC, 12 replies.
- [PR] [SPARK-56651][CONNECT][SDP] Add Python APIs for Auto CDC SCD Type 1 [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/05/21 18:13:26 UTC, 17 replies.
- [PR] [4.x][SPARK-56990][INFRA] Move scheduled CIs for 4.x to branch-4.x [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/05/21 18:15:03 UTC, 0 replies.
- Re: [PR] [SPARK-56990][INFRA] Move scheduled CIs for 4.x to branch-4.x [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/21 19:38:01 UTC, 2 replies.
- [PR] [SPARK-56643][SPARK-56619][CONNECT][SQL][TESTS] Share DSv2 test cases… [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/05/21 19:46:40 UTC, 1 replies.
- Re: [PR] [SPARK-33903][SQL] Add CREATE VIEW AS SELECT support for V2 ViewCatalog [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/21 20:00:27 UTC, 1 replies.
- [PR] [SPARK-56996] Use Spark 4.1.2 instead of RC1 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/21 20:12:54 UTC, 3 replies.
- [PR] [SPARK-56997][BUILD] Upgrade Maven to 3.9.16 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/21 20:45:55 UTC, 3 replies.
- Re: [PR] [SPARK-56998]Add SECURITY.md + AGENTS.md Security section for scan-agent discoverability [spark] - posted by "gatorsmile (via GitHub)" <gi...@apache.org> on 2026/05/21 22:40:39 UTC, 5 replies.
- [PR] [SPARK-56999][PYSPARK] Fix mapInArrow opaque getInt error by coercing output to declared schema [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/05/21 23:48:22 UTC, 0 replies.
- [PR] [SPARK-56990][INFRA][FOLLOWUP] Add java17 option to workflow dispatch [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/05/21 23:48:27 UTC, 0 replies.
- Re: [PR] [SPARK-55430][SQL] Cache ICU StringSearch for collation string predicates with constant patterns [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/22 01:01:08 UTC, 1 replies.
- [PR] [SPARK-54770][PYTHON] Replace dead assert with proper error in _create_converter [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/05/22 01:01:51 UTC, 3 replies.
- Re: [PR] [SPARK-56917][TESTS][CONNECT] Expand Connect-specific tests for DataFrame column resolution [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/22 01:37:48 UTC, 4 replies.
- [PR] [SPARK-56977][SQL] RewriteNearestByJoin should respect joinType in th… [spark] - posted by "zhidongqu-db (via GitHub)" <gi...@apache.org> on 2026/05/22 01:59:04 UTC, 0 replies.
- [PR] [DO-NOT-MERGE][POC] Python Spark Client UI [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/05/22 02:32:51 UTC, 1 replies.
- Re: [PR] [SPARK-37019][SQL] Add codegen support to array higher-order functions [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/05/22 03:31:34 UTC, 11 replies.
- Re: [PR] [SPARK-55271][SS] The error originates in KafkaMicroBatchStream.metrics() at line 520, where the code attempts to call .get() on a Scala Option that contains null, then immediately invokes .map() on the null result [spark] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2026/05/22 03:32:37 UTC, 3 replies.
- Re: [PR] [SPARK-56952][CORE] Preserve heartbeat timeout executor loss reason [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/05/22 03:33:48 UTC, 1 replies.
- [PR] [SPARK-55601][SS][FOLLOWUP] Cache offsetLog.getLatest() to avoid redundant ListStatus during MicroBatchExecution init [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/22 03:33:51 UTC, 2 replies.
- [PR] [SPARK-XXXXX][CORE] Add ConcurrentStageDAGScheduler for low-latency s… [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/05/22 03:46:29 UTC, 0 replies.
- [PR] [SPARK-52498][SQL] Fix false ambiguous self-join error with foldable condition [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/05/22 05:02:33 UTC, 4 replies.
- [PR] [SPARK-57001][SS] Hoist `isStateful` / `containsStatefulOperator` onto `LogicalPlan` [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/05/22 06:34:46 UTC, 12 replies.
- [PR] [SPARK-57002][INFRA] Enforce Upstream-First policy in merge_spark_pr.py cherry-pick prompts [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/22 07:54:00 UTC, 9 replies.
- [PR] [WIP][SPARK-56981][SQL] Add physical representation and UnsafeRow support for nanosecond timestamps [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/05/22 08:14:45 UTC, 0 replies.
- Re: [PR] [SPARK-56538][CONNECT] Add per-RPC deadlines to Spark Connect client [spark] - posted by "pranavdev022 (via GitHub)" <gi...@apache.org> on 2026/05/22 08:24:59 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-56586][CONNECT][TESTS] Retry flaky python foreachBatch termination test [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/22 09:35:43 UTC, 0 replies.
- [PR] [SPARK-50520][PySpark] Respect timeout in df.rdd.countApprox() [spark] - posted by "rishav23 (via GitHub)" <gi...@apache.org> on 2026/05/22 10:07:04 UTC, 1 replies.
- [PR] [SPARK-57003][SQL][SS] Widen stateful operator output and state schema nullability [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/05/22 10:53:00 UTC, 20 replies.
- Re: [PR] [SPARK-55886][SQL][PYTHON] Add DataFrame.zip for merging column-projected DataFrames [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/22 11:39:57 UTC, 6 replies.
- [PR] [SPARK-52812][SQL] Make Spark Connect Catalog.createTable eager [spark] - posted by "rishav23 (via GitHub)" <gi...@apache.org> on 2026/05/22 12:52:16 UTC, 6 replies.
- [PR] [SPARK-57004][SQL] Simplify CheckOverflowInSum codegen under ANSI mode [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/22 12:56:31 UTC, 3 replies.
- [PR] decompose [spark] - posted by "xianzhe-databricks (via GitHub)" <gi...@apache.org> on 2026/05/22 14:11:27 UTC, 1 replies.
- [PR] [SPARK-53053][PYTHON][PANDAS] Support Pandas Extension Properties [spark] - posted by "DinhLiu (via GitHub)" <gi...@apache.org> on 2026/05/22 14:41:34 UTC, 1 replies.
- [PR] [SPARK-57006] Use Spark 4.1.2 in docs, examples, tests, and default values [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/22 16:38:29 UTC, 4 replies.
- [PR] [SPARK-57007] Use Spark 4.1.2 in docs, examples, and tests [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/22 17:09:39 UTC, 3 replies.
- [PR] [SPARK-57008] Regenerate `Spark Connect`-generated Swift source code with `protoc-gen-grpc-swift-2` 2.4.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/22 17:24:34 UTC, 3 replies.
- [PR] [SPARK-57009] Add `dev/spark_jira_utils.py` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/22 17:37:55 UTC, 3 replies.
- Re: [PR] [SPARK-56674][SS][RTM][StreamingShuffle] Add streaming shuffle wire protocol [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/22 17:38:39 UTC, 1 replies.
- [PR] [SPARK-57010] Upgrade `Iceberg` to 1.11.0 in integration tests [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/22 19:45:12 UTC, 3 replies.
- [PR] [SPARK-57012] Drop Spark 3.5 Support [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/22 20:04:13 UTC, 3 replies.
- [PR] [SPARK-57013] Drop Spark 3.5 Support [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/22 20:33:49 UTC, 3 replies.
- [PR] [SPARK-57014] Update `Spark Connect`-generated `Swift` source code with `4.2.0-preview5` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/22 20:40:46 UTC, 3 replies.
- [PR] [SPARK-57015] Upgrade `slf4j` to 2.0.18 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/22 21:12:34 UTC, 3 replies.
- [PR] [SPARK-57016] Upgrade `spotbugs-gradle-plugin` to 6.5.5 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/22 21:16:39 UTC, 3 replies.
- [PR] [SPARK-57017] Upgrade `Netty` to 4.2.14.Final [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/22 21:29:28 UTC, 3 replies.
- [PR] [SPARK-57018] Upgrade `kubernetes-client` to 7.7.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/22 21:35:19 UTC, 0 replies.
- [PR] [SPARK-57019][BUILD] Upgrade jackson to 2.21.3 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/22 21:45:51 UTC, 2 replies.
- [PR] Spark 56651 autocdc python api [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/05/22 23:35:50 UTC, 1 replies.
- [PR] [SPARK-57022][SQL] Support nested column pruning for transform over arrays of structs [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/05/23 01:49:20 UTC, 12 replies.
- [PR] [SPARK-54593][SQL] Enable DPP for materialized filtering sides [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/05/23 02:08:34 UTC, 0 replies.
- [PR] [SPARK-57024][SQL] Use bulk fill APIs to materialize RLE runs in Parquet vectorized reader [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/23 05:23:44 UTC, 11 replies.
- [PR] [SPARK-57025][SQL] SortMergeJoinExec: extract JoinHelper.resetMatched for full-outer BitSet bookkeeping [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/23 06:13:08 UTC, 3 replies.
- [PR] [SPARK-57026][SQL] SortMergeJoinExec and ShuffledHashJoinExec: replace anonymous TaskCompletionListener with shared JoinHelper methods [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/23 06:13:17 UTC, 2 replies.
- [PR] [SPARK-57027][SQL] SortMergeJoinExec: skip statically-dead branches in codegen [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/23 06:13:31 UTC, 7 replies.
- [PR] [SPARK-57028][SQL] HashJoin: drop conditionPassed in codegenOuter when there is no join condition [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/23 06:13:39 UTC, 2 replies.
- Re: [PR] [SPARK-57021][CONNECT][PYTHON] Add SQLContext wrapper for Spark Connect [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/05/23 06:37:39 UTC, 19 replies.
- Re: [PR] [SPARK-56981][SQL] Add physical representation and UnsafeRow support for nanosecond timestamps [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/05/23 06:58:36 UTC, 15 replies.
- [PR] [SPARK-57005][SQL] Fix None.get in RewritePredicateSubquery when subquery predicates are eliminated [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/23 08:21:02 UTC, 14 replies.
- [PR] [SPARK-57023][SQL] DecimalAggregates: peel widened Cast on Min/Max [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/05/23 10:32:04 UTC, 2 replies.
- [PR] [SPARK-56980][SQL] Fix computeStats assertion on DSv2 relations before pushdown [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/23 17:36:36 UTC, 0 replies.
- [PR] [SPARK-57035][DOCS] Always target /docs/latest/ in DocSearch index [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/23 21:10:56 UTC, 10 replies.
- [PR] [SPARK-57036][SQL] Use intrinsic bulk-fill APIs for constant-value WritableColumnVector methods [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/24 00:15:26 UTC, 12 replies.
- [PR] [SPARK-56739][SQL] Normalize CTE ids of orphan CTERelationRef in NormalizeCTEIds [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/05/24 00:54:46 UTC, 10 replies.
- Re: [PR] [SPARK-55476][PYTHON] Refactor broadcast variable protocol [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/24 01:02:17 UTC, 1 replies.
- [PR] [MINOR][SQL][TESTS] Add WritableColumnVectorBulkFillBenchmark [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/24 01:12:18 UTC, 0 replies.
- [PR] [SPARK-53454][SQL] Handle AlwaysTrue/AlwaysFalse in V2ExpressionSQLBuilder [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/05/24 03:56:54 UTC, 5 replies.
- [PR] [SPARK-57037][CORE][TESTS] Force GC before allocating large array in SorterSuite to fix flaky OOM [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/24 04:31:24 UTC, 6 replies.
- Re: [PR] [SPARK-55968][SQL] Do not treat vectorized reader capacity overflow a… [spark] - posted by "naveenp2708 (via GitHub)" <gi...@apache.org> on 2026/05/24 07:35:14 UTC, 0 replies.
- [PR] [SPARK-51377][DOCS] Fix PYTHONPATH shell command in PySpark installation docs [spark] - posted by "nnguyen168 (via GitHub)" <gi...@apache.org> on 2026/05/24 08:37:47 UTC, 0 replies.
- [PR] [SPARK-57038][SQL] Use references/collectAttributes in SPJ planning [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/05/24 11:34:08 UTC, 0 replies.
- [PR] security(network): replace insecure trust-all fallback with JVM default trust managers [spark] - posted by "RinZ27 (via GitHub)" <gi...@apache.org> on 2026/05/24 12:34:12 UTC, 0 replies.
- [PR] [SPARK-55876][SQL] Add query statistics summary bar to SQL tab [spark] - posted by "XdithyX (via GitHub)" <gi...@apache.org> on 2026/05/24 13:26:55 UTC, 4 replies.
- [PR] [SPARK-57039][SQL] Fold InnerJoin with single-row LocalRelation/OneRowRelation into Project [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/05/24 14:10:31 UTC, 12 replies.
- Re: [PR] [SPARK-57018][BUILD] Upgrade `kubernetes-client` to 7.7.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/24 15:31:54 UTC, 1 replies.
- [PR] [SPARK-57040][SQL] JDBC connector supports pushdown TABLESAMPLE SYSTEM [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/05/24 16:56:10 UTC, 16 replies.
- [PR] [WIP][SPARK-56969][SQL] Enhance the SQL config `spark.sql.timestampNanosTypes.enabled` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/05/24 20:21:18 UTC, 0 replies.
- [PR] [WIP][SQL] Fix deadlock between waitForSubqueries and lazy val initialization in subquery [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/05/24 21:12:19 UTC, 0 replies.
- Re: [PR] [SPARK-57042][SQL][TESTS] Add WritableColumnVectorBulkFillBenchmark [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/25 00:17:02 UTC, 2 replies.
- Re: [PR] [SPARK-55301][SS] Re-enable all dimension in OfflineStateRepartitionIntegrationSuites [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/25 01:03:36 UTC, 1 replies.
- Re: [PR] [SPARK-52011][SQL] Reduce HDFS NameNode RPC on vectorized Parquet reader [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/25 01:03:40 UTC, 1 replies.
- [PR] [SPARK-57044] Support `(create|drop)Database` in `Catalog` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/25 02:52:55 UTC, 3 replies.
- Re: [PR] [SPARK-34577][SQL] Fix drop/add columns to a dataset of `DESCRIBE NAMESPACE` [spark] - posted by "cmovi011-sketch (via GitHub)" <gi...@apache.org> on 2026/05/25 03:03:17 UTC, 0 replies.
- [PR] [SPARK-57045] Support `drop(Table|View)` in `Catalog` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/25 03:06:13 UTC, 3 replies.
- [PR] [SPARK-57046] Support `truncateTable` in `Catalog` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/25 03:24:53 UTC, 3 replies.
- [PR] [SPARK-57047] Support `listViews` in `Catalog` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/25 03:36:06 UTC, 3 replies.
- [PR] [SPARK-57048] Add `*.pyc` and `*.pyo` to `.gitignore` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/25 03:46:48 UTC, 3 replies.
- [PR] [SPARK-57049] Support `listPartitions` in `Catalog` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/25 04:03:38 UTC, 3 replies.
- [PR] [SPARK-57050] Support `getTableProperties` in `Catalog` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/25 04:16:33 UTC, 3 replies.
- [PR] [SPARK-57051] Support `getCreateTableString` in `Catalog` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/25 04:23:26 UTC, 3 replies.
- Re: [PR] [SPARK-56927][SDP] Implement SCD1 Batch Processor; Merge Microbatch onto Target [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/05/25 05:03:41 UTC, 1 replies.
- [PR] [SPARK-57029][SQL][TESTS] Add byte-level visibility golden for ICU collation sort keys [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/05/25 05:16:19 UTC, 3 replies.
- Re: [PR] [SPARK-56969][SQL] Enhance the SQL config `spark.sql.timestampNanosTypes.enabled` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/05/25 06:18:51 UTC, 7 replies.
- Re: [PR] [SPARK-55855][SQL][DML] DSv2 Transaction Management [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/25 07:21:50 UTC, 0 replies.
- [PR] [SPARK-57052][SS] Add state row format validation to multiGet in RocksDBStateStoreProvider [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/25 08:00:37 UTC, 0 replies.
- Re: [PR] [SPARK-54918][SQL] Normalize floating numbers in array set operations [spark] - posted by "asugranyes (via GitHub)" <gi...@apache.org> on 2026/05/25 08:18:55 UTC, 10 replies.
- Re: [PR] [SPARK-57038][SQL] Use `Expression.references` in SPJ planning [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/05/25 10:28:43 UTC, 2 replies.
- Re: [PR] [SPARK-52669][PYSPARK] Fix Python executable selection for YARN client mode #51357 [spark] - posted by "gwdgithubnom (via GitHub)" <gi...@apache.org> on 2026/05/25 10:38:36 UTC, 1 replies.
- Re: [PR] [SPARK-56505][SQL][TESTS] SharedSparkSession provides sql.SparkSession, add SharedClassicSparkSession, ClassicQueryTest [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/25 13:17:21 UTC, 0 replies.
- [PR] [SPARK-57053][SQL][TESTS] Expand time-window.sql SQL test coverage [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2026/05/25 13:59:17 UTC, 2 replies.
- [PR] [SPARK-56876][SQL][4.X] Add TimestampNTZNanosType and TimestampLTZNanosType [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/05/25 14:22:33 UTC, 3 replies.
- Re: [PR] [SPARK-55978][SQL][FOLLOWUP] Don't block V2 join pushdown when pushed Sample has fraction=1 without replacement [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/25 17:03:16 UTC, 2 replies.
- [PR] [SPARK-XXXXX][SQL] Add streaming heap operator for NearestByJoin [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/25 17:43:08 UTC, 0 replies.
- [PR] [SPARK-57056][SQL] Add SupportsBranching DSv2 interface and branching DDL [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/25 17:58:42 UTC, 0 replies.
- [PR] [SPARK-57057][SQL] Target a specific branch on SELECT / INSERT via temporal clause and session config [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/25 17:59:25 UTC, 0 replies.
- Re: [PR] [SPARK-57041][SQL] Fix deadlock between waitForSubqueries and lazy val initialization in subquery [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/05/25 22:55:31 UTC, 8 replies.
- [PR] [SPARK-57059] Add `integration-test-mac-spark41-iceberg` GitHub Actions job [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/26 00:25:51 UTC, 3 replies.
- [PR] [SPARK-57058][SQL] Introduce BinaryView and migrate geo types to it for zero-copy reads [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/26 00:45:43 UTC, 3 replies.
- [PR] [SPARK-57060] Support `analyzeTable` in `Catalog` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/26 00:49:22 UTC, 3 replies.
- [PR] [SPARK-57061] Support `xml(DataFrame)` in `DataFrameReader` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/26 01:10:47 UTC, 3 replies.
- [PR] [SPARK-57062] Support `json(DataFrame)` in `DataFrameReader` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/26 01:42:46 UTC, 3 replies.
- Re: [PR] [SPARK-57056][SQL] Add `SupportsBranching` DSv2 interface and branching DDL [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/26 01:51:05 UTC, 33 replies.
- [PR] [SPARK-57063] Support `csv(DataFrame)` in `DataFrameReader` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/26 02:00:24 UTC, 3 replies.
- Re: [PR] [SPARK-55090][PYTHON][CONNECT] Implement `DataFrame.toJSON` in Python Client [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/26 02:03:04 UTC, 1 replies.
- [PR] [SPARK-57064][SQL] Widen bucketing rule pattern matches to use FileSourceScanLike trait [spark] - posted by "rdtr (via GitHub)" <gi...@apache.org> on 2026/05/26 02:35:25 UTC, 1 replies.
- [PR] [MINOR][PYTHON][TESTS] Add with_sql_conf decorator in SQLTestUtils [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/26 05:28:18 UTC, 0 replies.
- [PR] [INFRA] Share SBT compile artifact with python hosted runner CI jobs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/26 06:41:32 UTC, 0 replies.
- [PR] [SPARK-57066][SECURITY] Use constant-time comparison for authentication secrets [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/05/26 06:48:52 UTC, 5 replies.
- [PR] [SS][PYTHON][TESTS] Fix flaky test_listener_events_spark_command [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/26 07:08:25 UTC, 0 replies.
- [PR] [INFRA] Share SBT precompile artifact with docker/k8s integration test CI jobs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/26 07:17:05 UTC, 0 replies.
- [PR] [SPARK-57068][SQL] Make SaveMode.Overwrite create the table when missing for SupportsCatalogOptions sources [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/26 07:46:37 UTC, 1 replies.
- [PR] [SPARK-56965][SQL][4.x] Add SQL parser support for TIMESTAMP_NTZ(p) and TIMESTAMP_LTZ(p) [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/05/26 07:59:56 UTC, 4 replies.
- [PR] [SPARK-56956][SDP][FOLLOWUP] Address review comments for AutoCDC flow dataclasses [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/26 08:06:23 UTC, 0 replies.
- [PR] [SPARK-57055][SQL][DOCS] Document non-binary collation gap in DataFrameStatFunctions.bloomFilter [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/05/26 08:09:21 UTC, 0 replies.
- Re: [PR] [SPARK-56659][SQL] Show function resources in DESCRIBE FUNCTION EXTENDED output [spark] - posted by "TongWei1105 (via GitHub)" <gi...@apache.org> on 2026/05/26 08:24:57 UTC, 0 replies.
- [PR] [PYTHON][DOCS] Add time_from_*/time_to_* functions to Python API reference [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/26 09:20:24 UTC, 0 replies.
- [PR] [PYTHON][DOCS] Add missing 4.2 methods to PySpark API reference [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/26 09:30:26 UTC, 0 replies.
- Re: [PR] [SPARK-56956][SPARK-56651][CONNECT][SDP][FOLLOWUP] Address review comments for AutoCDC flow dataclasses and Python APIs [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/26 09:38:22 UTC, 3 replies.
- Re: [PR] [SPARK-57054][SQL] Make view collation sticky across ALTER SCHEMA DEFAULT COLLATION [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/26 09:58:56 UTC, 4 replies.
- [PR] [INFRA] Skip Build workflow on fork master pushes [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/26 10:08:11 UTC, 0 replies.
- Re: [PR] [SPARK-57069][INFRA] Share SBT precompile artifact with docker/k8s integration test CI jobs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/26 10:34:48 UTC, 2 replies.
- [PR] [INFRA] Share precompile Coursier cache with test/pyspark/sparkr jobs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/26 10:38:25 UTC, 0 replies.
- Re: [PR] [SPARK-56619][SQL][TESTS] Add DSv2 repeated table access tests with internal/external changes in Classic/Connect mode [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/26 10:38:53 UTC, 4 replies.
- [PR] [MINOR][INFRA] Prevent merging draft PRs in merge script [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/26 10:47:48 UTC, 0 replies.
- Re: [PR] [SPARK-57072][PYTHON][DOCS] Add missing 4.2 methods to PySpark API reference [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/26 10:52:38 UTC, 3 replies.
- Re: [PR] [SPARK-57077][INFRA] Prevent merging draft PRs in merge script [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/26 10:53:42 UTC, 4 replies.
- [PR] [SPARK-56995][SQL][DML] Allow dataframe caching in the DSv2 Transaction API [spark] - posted by "andreaschat-db (via GitHub)" <gi...@apache.org> on 2026/05/26 15:06:13 UTC, 3 replies.
- [PR] [SPARK-57078] Upgrade `Dropwizard` metrics to 4.2.39 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/26 16:21:30 UTC, 4 replies.
- [PR] [SPARK-57079] Add `*.pyc` and `*.pyo` to `.gitignore` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/26 16:23:32 UTC, 4 replies.
- [PR] [SPARK-56957] AutoCDC Flow Execution; Introduce and Integrate SCD1 `Scd1MergeStreamingWrite` [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/05/26 17:02:22 UTC, 3 replies.
- Re: [PR] [SPARK-57073][SS][PYTHON][TESTS] Fix flaky test_listener_events_spark_command [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/05/26 17:10:03 UTC, 2 replies.
- [PR] [SPARK-57082][INFRA] Remove master tag from workflow names [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/05/26 17:30:28 UTC, 2 replies.
- [PR] [SPARK-57080][SDP] Register AutoCDC Flows from `PipelinesHandler` [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/05/26 17:39:39 UTC, 18 replies.
- [PR] [SPARK-57081][TESTS] Fix percent-encoding issue in SparkTestUtils classpath handling [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/05/26 17:52:46 UTC, 2 replies.
- [PR] [SPARK-56919][SQL] Move setupJob before materializeAdaptiveSparkPlan to prevent table path loss [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/05/26 18:20:09 UTC, 1 replies.
- [PR] [SQL] Preserve geography SRID across encoders, Parquet readers, and Python conversion [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/05/26 18:36:51 UTC, 0 replies.
- [PR] [SPARK-57084] Add `geometry` and `geography` SQL tests and answer files [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/26 18:40:47 UTC, 5 replies.
- Re: [PR] [SPARK-56957][SDP] AutoCDC Flow Execution; Introduce and Integrate SCD1 `Scd1MergeStreamingWrite` [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/05/26 18:52:19 UTC, 17 replies.
- [PR] [SPARK-57085] Support `getFunction` in `Catalog` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/26 20:11:06 UTC, 3 replies.
- [PR] [SPARK-57086] Support `recoverPartitions` in `Catalog` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/26 20:19:22 UTC, 3 replies.
- [PR] draft [spark] - posted by "zhidongqu-db (via GitHub)" <gi...@apache.org> on 2026/05/26 20:24:55 UTC, 0 replies.
- [PR] [SPARK-57087] Support `listFunctions` in `Catalog` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/26 20:38:23 UTC, 3 replies.
- [PR] [SPARK-57043][SQL] Collapse grouped SUM(COUNT(1)) rollups [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/05/26 20:42:09 UTC, 20 replies.
- [PR] [SPARK-51579][SQL] Avoid EOFException in CSV parseLine by appending line terminator [spark] - posted by "Richard-Durkee (via GitHub)" <gi...@apache.org> on 2026/05/26 21:23:15 UTC, 0 replies.
- Re: [PR] [SPARK-56426][SQL] Fix SQL failure when LATERAL VIEW column alias contains dot in name [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/05/26 22:03:54 UTC, 5 replies.
- [PR] [SPARK-57090] Make `Documentation` up-to-date [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/26 22:26:34 UTC, 3 replies.
- [PR] [SPARK-57089] [SQL] Preserve collation name as `COLLATE` expression origin [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/05/26 23:19:09 UTC, 3 replies.
- [PR] [SPARK-57094] Use `exact` always instead of `branch` in `Package.swift` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/27 01:54:33 UTC, 3 replies.
- Re: [PR] [SPARK-57083][SQL] Preserve geography SRID across encoders, Parquet readers, and Python conversion [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/27 02:03:48 UTC, 4 replies.
- [I] DSv2 spark streaming doesn't support SupportsMetadataColumns [spark] - posted by "zikangh (via GitHub)" <gi...@apache.org> on 2026/05/27 04:01:02 UTC, 0 replies.
- [PR] [GH-56132][STREAMING] Call pruneColumns on V2 streaming scan builders in MicroBatchExecution [spark] - posted by "zikangh (via GitHub)" <gi...@apache.org> on 2026/05/27 04:06:23 UTC, 0 replies.
- [PR] [SPARK-43877][PYTHON] Fix behavior difference for compare binary functions. [spark] - posted by "TrNhDuong (via GitHub)" <gi...@apache.org> on 2026/05/27 04:20:48 UTC, 0 replies.
- Re: [PR] [SPARK-56132][STREAMING] Call pruneColumns on V2 streaming scan builders in MicroBatchExecution [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/27 05:04:20 UTC, 0 replies.
- Re: [PR] [SPARK-57000][CORE][SS][RTM] Add concurrent scheduling capabilites for Real-time Mode [spark] - posted by "jiangxb1987 (via GitHub)" <gi...@apache.org> on 2026/05/27 05:07:49 UTC, 7 replies.
- Re: [PR] [SPARK-57070][PYTHON][DOCS] Add `time_(from|to)_*` functions to Python API reference [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/27 05:30:53 UTC, 1 replies.
- Re: [PR] [SPARK-57088] [SQL] Allow non-deterministic ranking expression for EXACT NEAREST BY [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/27 05:45:59 UTC, 1 replies.
- [PR] [PYTHON][DOCS] 4.2 audit follow-ups: document TwsTester, fix kll_merge_agg_* versionadded [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/27 06:09:26 UTC, 0 replies.
- Re: [PR] [SPARK-54805][SS][PYTHON] Implement TwsTester in PySpark [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/27 06:17:08 UTC, 0 replies.
- Re: [PR] [PYTHON][DOCS] Fix versionadded for kll_merge_agg_* (4.1.0 -> 4.2.0) [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/27 06:20:10 UTC, 1 replies.
- Re: [PR] [SPARK-54785][SQL] Add support for binary sketch aggregations in KLL [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/27 06:30:31 UTC, 0 replies.
- [PR] [SPARK-52610][BUILD] Upgrade rocksdbjni to 10.2.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/27 07:31:25 UTC, 3 replies.
- Re: [PR] [SPARK-54785][SQL][PYTHON][DOCS][FOLLOWUP] Fix versionadded/@since for kll_merge_agg_* (4.1.0 -> 4.1.2) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/05/27 07:39:10 UTC, 0 replies.
- Re: [PR] [SPARK-57065][PYTHON][TESTS] Add with_sql_conf decorator in SQLTestUtils [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/27 08:06:15 UTC, 2 replies.
- Re: [PR] [SPARK-57074][INFRA] Skip Build workflow on fork master pushes [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/27 08:08:45 UTC, 1 replies.
- [PR] [MINOR][INFRA] Prevent merging Epic/Umbrella PRs in merge script [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/27 08:18:39 UTC, 0 replies.
- [PR] Add regression test for issue #55392 - Named parameters without legacy config [spark] - posted by "naan31 (via GitHub)" <gi...@apache.org> on 2026/05/27 08:31:09 UTC, 2 replies.
- Re: [PR] [SPARK-57091][SQL] Add BroadcastNearestByJoinExec to avoid cross-product materialization [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/27 08:50:40 UTC, 0 replies.
- Re: [PR] [SPARK-57097][INFRA] Prevent merging Epic/Umbrella PRs in merge script [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/27 09:57:15 UTC, 3 replies.
- [PR] [SPARK-57098][UI] Worker UI json endpoint redaction [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/05/27 10:27:26 UTC, 0 replies.
- [PR] [SPARK-55326][PYTHON][CONNECT][FOLLOWUP] Avoid blocking process exit when server is unreachable in SparkConnectClient._on_exit [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/27 11:06:38 UTC, 5 replies.
- Re: [PR] [SPARK-53504][SQL] Type framework [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/05/27 11:19:25 UTC, 0 replies.
- Re: [PR] [SPARK-54022][SPARK-56617][SQL][TESTS] Add DSv2 CACHE TABLE impact on reads tests [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/27 12:14:11 UTC, 3 replies.
- [I] Pyspark: `DataFrame` methods behind `is_remote_only()` statically evaluate to `Union` [spark] - posted by "iamkhav (via GitHub)" <gi...@apache.org> on 2026/05/27 12:23:47 UTC, 0 replies.
- [PR] [PYTHON][DOCS] Fix single-colon ``.. versionadded:`` typos in docstrings [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/27 12:39:16 UTC, 0 replies.
- [PR] [SPARK-XXXXX][INFRA] Document canonical and primary component tags in AGENTS.md [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/27 12:58:26 UTC, 0 replies.
- [PR] [SPARK-XXXXX][SQL] Fix StringIndexOutOfBoundsException in parameteriz… [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2026/05/27 15:49:04 UTC, 0 replies.
- [PR] [SPARK-54918][SQL] Clean up text of `NormalizeFloatingNumbers` docstring [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/05/27 16:12:09 UTC, 3 replies.
- Re: [PR] [SPARK-57098][UI] Worker UI JSON endpoint redaction [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/05/27 16:29:27 UTC, 3 replies.
- [PR] [SPARK-57098][UI][3.5] Worker UI JSON endpoint redaction [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/05/27 16:57:22 UTC, 2 replies.
- Re: [PR] [SPARK-57098][UI][4.2] Worker UI JSON endpoint redaction [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/27 17:03:40 UTC, 3 replies.
- [PR] [SPARK-57106] Disallow watched namespace changes via dynamic config [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/27 17:37:28 UTC, 3 replies.
- [PR] [SPARK-57034][SQL][TESTS] Add TimestampNanosTestUtils and RandomDataGenerator support for nanosecond timestamps [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/05/27 17:48:49 UTC, 7 replies.
- [PR] [PYTHON] Improve static typing for methods behind is_remote_only [spark] - posted by "durgaprasadml (via GitHub)" <gi...@apache.org> on 2026/05/27 17:52:12 UTC, 3 replies.
- [PR] [SPARK-56991][SQL] Add helper method for deriving Changelog DeduplicationMode [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/05/27 17:54:14 UTC, 5 replies.
- [PR] [SPARK-57107] Pin `apache/skywalking-eyes` to `v0.8.0` commit SHA [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/27 17:57:34 UTC, 4 replies.
- Re: [PR] [SPARK-53890][SDP] Test (and fix) read/readstream options are respected for pipelines [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/05/27 18:00:57 UTC, 5 replies.
- [PR] [SPARK-57108][INFRA] Skip core/utils build matrix entry for unrelated changes [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/27 18:43:01 UTC, 5 replies.
- [PR] [SPARK-56975][SS][FOLLOWUP] Gate user-specified schema rejection in D… [spark] - posted by "PorridgeSwim (via GitHub)" <gi...@apache.org> on 2026/05/27 19:14:10 UTC, 0 replies.
- [PR] [SPARK-49798][DOCS] Fix inaccurate documentation of RuntimeConfig.get [spark] - posted by "brijrajk (via GitHub)" <gi...@apache.org> on 2026/05/27 19:32:15 UTC, 1 replies.
- Re: [PR] [SPARK-38719][SQL] Test the error class: CANNOT_CAST_DATATYPE [spark] - posted by "deepujain (via GitHub)" <gi...@apache.org> on 2026/05/27 20:05:24 UTC, 0 replies.
- Re: [PR] [SPARK-38743][SQL] Test the error class: MISSING_STATIC_PARTITION_COLUMN [spark] - posted by "deepujain (via GitHub)" <gi...@apache.org> on 2026/05/27 20:05:28 UTC, 0 replies.
- Re: [PR] [SPARK-49642][SQL] Remove the ANSI config suggestion in DATETIME_FIEL… [spark] - posted by "deepujain (via GitHub)" <gi...@apache.org> on 2026/05/27 20:05:35 UTC, 0 replies.
- Re: [PR] [SPARK-56975][SS][FOLLOWUP] Gate user-specified schema rejection behind a config [spark] - posted by "zikangh (via GitHub)" <gi...@apache.org> on 2026/05/27 20:32:21 UTC, 8 replies.
- [PR] [SPARK-57110][BUILD] Simplify jjwt deps management by using BOM [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/27 21:06:56 UTC, 2 replies.
- Re: [PR] [SPARK-56132][SS] Call pruneColumns on V2 streaming scan builders in MicroBatchExecution [spark] - posted by "zikangh (via GitHub)" <gi...@apache.org> on 2026/05/27 21:22:59 UTC, 1 replies.
- [PR] [SPARK-57111][SQL] Use intrinsic bulk-fill APIs for putNotNulls [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/27 21:27:26 UTC, 12 replies.
- Re: [PR] [SPARK-57104][SQL] Enable schema-level collations by default [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2026/05/27 21:30:27 UTC, 0 replies.
- [PR] [SPARK-46776][PYTHON] Support pa.ChunkedArray columns in createDataFrame from pandas [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/05/27 21:34:14 UTC, 4 replies.
- [PR] [WIP][SPARK-57033][SQL] Add java.time LocalDateTime/Instant conversion and Dataset roundtrip for nanosecond timestamps [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/05/27 21:35:28 UTC, 0 replies.
- Re: [PR] [SPARK-57110][BUILD] Simplify `jjwt` deps management by using BOM [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/27 21:36:48 UTC, 3 replies.
- Re: [PR] [MINOR][PYTHON][DOC] Fix single-colon ``.. versionadded:`` typos in docstrings [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/05/27 21:40:01 UTC, 1 replies.
- [PR] [SPARK-57112][SQL][TESTS] Add putNotNulls case to WritableColumnVectorBulkFillBenchmark [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/27 21:53:07 UTC, 4 replies.
- [PR] [SPARK TICKET PLACEHOLDER][SDP] Prevent AutoCDC keys from changing across SDP runs [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/05/27 22:09:19 UTC, 0 replies.
- [PR] [SPARK-57114] Upgrade `spotless-plugin-gradle` to 8.6.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/27 22:52:21 UTC, 3 replies.
- [PR] [SPARK-57109] SYSTEM.SESSION shoudl not be part of SYSTEM_PATH [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/05/27 23:00:02 UTC, 0 replies.
- Re: [PR] [SPARK-57113][SDP] Prevent AutoCDC keys from changing across SDP runs [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/05/27 23:51:35 UTC, 10 replies.
- [PR] [SPARK-57115][INFRA] Add Java 17 workflow file [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/05/27 23:56:54 UTC, 3 replies.
- Re: [PR] [SPARK-57116][SQL][PYTHON][DOC] Fix versionadded/@since for kll_merge_agg_* (4.1.0 -> 4.1.2) [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/28 00:25:20 UTC, 2 replies.
- [PR] [SPARK-57117][BUILD] Upgrade `zstd-jni` to 1.5.7-9 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/28 00:28:18 UTC, 8 replies.
- [PR] [SPARK-55347][SQL] Pass Generated Column as Expression to DSV2 [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/05/28 01:00:56 UTC, 8 replies.
- [PR] [SPARK-57118] Make `actions/*` GitHub Actions jobs up-to-date [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/28 01:23:26 UTC, 0 replies.
- [PR] [SPARK-57119][INFRA] Use `ubuntu-slim` for GitHub Actions `notify_test_workflow.yml` workflow [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/28 01:37:38 UTC, 5 replies.
- [PR] [SPARK-56120][PYTHON][TESTS][FOLLOWUP] Make _WindowAggArrowBenchMixin scenarios lazy [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/28 01:50:39 UTC, 2 replies.
- [PR] [SPARK-55934][PYTHON][TESTS][FOLLOWUP] Fix MAP_ARROW_ITER bench UDF return type [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/28 01:57:33 UTC, 2 replies.
- Re: [PR] [SPARK-55934][PYTHON][TEST] Add ASV microbenchmark for SQL_MAP_ARROW_ITER_UDF [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/28 02:06:46 UTC, 1 replies.
- [PR] [SPARK-55754][PYTHON][TESTS][FOLLOWUP] Fix pure_ints type mismatch in bench [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/28 02:20:22 UTC, 2 replies.
- [PR] [SPARK-57120][INFRA] Use `ubuntu-slim` for GitHub Actions `update_build_status.yml` workflow [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/28 03:06:36 UTC, 6 replies.
- [PR] [SPARK-55724][PYTHON][TESTS][FOLLOWUP] Unify wide_values to wide_cols in bench [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/28 03:08:20 UTC, 2 replies.
- [PR] [SPARK-57121][BUILD] Upgrade Jetty to 12.1.9 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/28 03:32:57 UTC, 3 replies.
- [PR] [SPARK-55724][PYTHON][TESTS][FOLLOWUP] Share base mixin across Arrow/Pandas siblings [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/28 03:37:41 UTC, 1 replies.
- Re: [PR] [SPARK-52610][BUILD] Upgrade rocksdbjni to 10.10.1.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/28 03:44:59 UTC, 4 replies.
- [PR] [SPARK-43847][PYTHON] Throw structured error when reading Protobuf descriptor file fails [spark] - posted by "brijrajk (via GitHub)" <gi...@apache.org> on 2026/05/28 03:54:01 UTC, 1 replies.
- [PR] [SPARK-57122][BUILD] Upgrade gson to 2.14.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/28 04:06:44 UTC, 0 replies.
- [PR] [SPARK-57123][BUILD] Upgrade `joda-time` to 2.14.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/28 04:14:36 UTC, 3 replies.
- Re: [PR] [SPARK-51579][SQL] Avoid EOFException in CSV Parsing by Appending Line Terminator [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/05/28 04:29:57 UTC, 0 replies.
- [PR] [SPARK-57124][INFRA] Fix `update_build_status.yml` to map non-standard workflow run statuses [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/28 04:32:03 UTC, 4 replies.
- Re: [PR] [SPARK-56132][SS] Call pruneColumns on V2 streaming to fix metadata reading issue [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/28 04:42:48 UTC, 3 replies.
- [PR] [SPARK-40437][PYTHON] Support string representation of durationMs in GroupState.setTimeoutDuration [spark] - posted by "brijrajk (via GitHub)" <gi...@apache.org> on 2026/05/28 04:50:42 UTC, 1 replies.
- [PR] git commit -m '[SPARK-55982][SQL] Fix function cache coherence on dro… [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/05/28 05:31:26 UTC, 0 replies.
- [PR] [SPARK-57125][SQL] LimitPushDown should fold literal Limit+Offset sum so plan stays planable without ConstantFolding [spark] - posted by "rdtr (via GitHub)" <gi...@apache.org> on 2026/05/28 05:50:13 UTC, 9 replies.
- Re: [PR] [SPARK-57118][INFRA] Make `actions/*` GitHub Actions jobs up-to-date [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/28 06:07:05 UTC, 3 replies.
- Re: [PR] [SPARK-57109][SQL] SYSTEM.SESSION should not be part of SYSTEM_PATH [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/28 06:45:22 UTC, 0 replies.
- [PR] [WIP][SPARK-57126][SQL]. Fixing the broken canonicalization of DynamicPruningSubq… [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2026/05/28 07:04:58 UTC, 1 replies.
- Re: [I] Pyspark: `DataFrame` methods behind `is_remote_only()` statically evaluate to `Union` during typechecking [spark] - posted by "durgaprasadml (via GitHub)" <gi...@apache.org> on 2026/05/28 07:17:08 UTC, 3 replies.
- [PR] [WIP][SPARK-57127][SQL]. Fixing the canonicalization of JoinExec nodes as it does… [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2026/05/28 07:17:17 UTC, 1 replies.
- [PR] Revert "[SPARK-57065][PYTHON][TEST] Add with_sql_conf decorator in SQLTestUtils" [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/28 07:42:50 UTC, 2 replies.
- [PR] [SPARK-57128][SQL][TESTS] SQLQueryTestHelper --SET parser must preserve commas in config values [spark] - posted by "rdtr (via GitHub)" <gi...@apache.org> on 2026/05/28 07:48:34 UTC, 0 replies.
- Re: [PR] git commit -m '[SPARK-55982][SQL] Fix function cache coherence on drop namespace in V2 catalogs [spark] - posted by "rdtr (via GitHub)" <gi...@apache.org> on 2026/05/28 08:01:34 UTC, 2 replies.
- [PR] [WIP][INFRA] Sample branch-4.x post-merge CI every 10th commit [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/28 09:58:19 UTC, 0 replies.
- Re: [PR] [SPARK-55326][PYTHON][CONNECT][FOLLOWUP] Skip cleanup RPCs in _on_exit when client is already closed [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/28 10:22:17 UTC, 1 replies.
- [PR] [SPARK-57130][BUILD] `make-distribution.sh` copies only git-tracked files for python [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/05/28 10:37:50 UTC, 10 replies.
- Re: [PR] [SPARK-57033][SQL] Add java.time LocalDateTime/Instant conversion and Dataset roundtrip for nanosecond timestamps [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/05/28 11:29:51 UTC, 12 replies.
- [PR] Dynamic config map name [spark-kubernetes-operator] - posted by "csviri (via GitHub)" <gi...@apache.org> on 2026/05/28 13:15:13 UTC, 0 replies.
- [PR] [WIP][SPARK-57103][SQL] Add Comparable to TimestampNanosVal [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/05/28 14:59:28 UTC, 0 replies.
- Re: [PR] [SPARK-57122][BUILD] Upgrade `gson` to 2.14.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/28 15:13:50 UTC, 2 replies.
- Re: [PR] [SPARK-53454][SQL] Handle AlwaysTrue/AlwaysFalse in JDBCSQLBuilder [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/05/28 16:34:27 UTC, 4 replies.
- Re: [PR] [SPARK-57103][SQL] Add Comparable to TimestampNanosVal [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/05/28 16:39:42 UTC, 3 replies.
- Re: [PR] [SPARK-57127][SQL]. Fixing the canonicalization of JoinExec nodes as it does… [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2026/05/28 16:45:49 UTC, 0 replies.
- [PR] [SPARK-57132][SQL] Rename _LEGACY_ERROR_TEMP_1037 and add sqlState [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2026/05/28 16:58:00 UTC, 2 replies.
- Re: [PR] [SPARK-54698][SQL] Support hashing for all data types for array set like operations [spark] - posted by "asugranyes (via GitHub)" <gi...@apache.org> on 2026/05/28 17:09:40 UTC, 0 replies.
- Re: [PR] [SPARK-57129][INFRA] Disable post-merge CI on branch-4.x [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/05/28 18:23:08 UTC, 4 replies.
- [PR] Revert "[SPARK-56975][SS] Reject user-specified schema in DataStreamR… [spark] - posted by "PorridgeSwim (via GitHub)" <gi...@apache.org> on 2026/05/28 18:52:22 UTC, 0 replies.
- Re: [PR] [SPARK-31179] Fast fail the connection while last connection failed in fast fail time window [spark] - posted by "boryaferz (via GitHub)" <gi...@apache.org> on 2026/05/28 19:35:07 UTC, 0 replies.
- [PR] [SPARK-56505][SQL][TESTS] Add SparkSessionBinder to replace SharedSparkSession [spark] - posted by "fwc (via GitHub)" <gi...@apache.org> on 2026/05/28 20:17:35 UTC, 5 replies.
- [PR] [SPARK-57136][INFRA] Disable `build-core-utils` in Non-ANSI scheduled builds [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/28 20:50:29 UTC, 4 replies.
- [PR] [SPARK-57020][PYTHON][TESTS] Add ASV microbenchmark for SQL_TRANSFORM_WITH_STATE_PANDAS_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/05/28 20:52:57 UTC, 1 replies.
- [PR] [SPARK-57135][SQL] Add ArchiveFormat for reading .tar/.tar.gz/.tgz archives as files [spark] - posted by "akshatshenoi-eng (via GitHub)" <gi...@apache.org> on 2026/05/28 21:29:58 UTC, 2 replies.
- Re: [PR] [SPARK-57137][PYTHON][TESTS] Share base mixin across Arrow/Pandas siblings [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/28 23:59:26 UTC, 1 replies.
- [PR] [SPARK-57138][PYTHON][TEST] Share base mixin across Window and Cogroup Arrow/Pandas siblings [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/29 00:20:18 UTC, 2 replies.
- [PR] [SPARK-57139][SQL] Skip deriving PartitionPredicate for partially pushed down filters [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/05/29 00:24:28 UTC, 8 replies.
- Re: [PR] [SPARK-55562][SQL] Simplify null handling for error classes in Spark exceptions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/29 01:05:06 UTC, 1 replies.
- Re: [PR] [SPARK-55372][4.1][SQL] Fix `SHOW CREATE TABLE` for tables / views with default collation [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/29 01:05:08 UTC, 1 replies.
- Re: [PR] [SPARK-57075][INFRA] Share precompile Coursier cache with host-runner SBT jobs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/29 01:32:55 UTC, 1 replies.
- Re: [PR] [SPARK-56564][SQL] Fix V2 write path to use CommitDeniedException for proper speculation handling [spark] - posted by "wudanzy (via GitHub)" <gi...@apache.org> on 2026/05/29 05:59:18 UTC, 0 replies.
- [PR] [SPARK-56664][SS][RTM][StreamingShuffle][Part3] Add StreamingShuffleManager and MultiShuffleManager [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/05/29 06:40:01 UTC, 0 replies.
- Re: [PR] [SPARK-57109] SYSTEM.SESSION should not be part of SYSTEM_PATH [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/05/29 06:58:36 UTC, 5 replies.
- Re: [PR] [SPARK-57126][SQL]. Fixing the broken canonicalization of DynamicPruningSubq… [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/05/29 06:59:55 UTC, 3 replies.
- [PR] [SPARK-57140][INFRA] Disable merge button in .asf.yaml [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/05/29 08:04:36 UTC, 5 replies.
- [PR] [SPARK-57100][SQL] Add columnar (ColumnVector) support for nanosecond timestamp types [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/05/29 09:03:28 UTC, 7 replies.
- Re: [PR] [SPARK-45658][SQL] Fix canonicalization of DynamicPruningSubquery to canonicalize build keys relative to build query output [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/05/29 09:05:55 UTC, 0 replies.
- [PR] [SPARK-57101][SQL] Register nanosecond timestamp types in the Types Framework (server-side) [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/05/29 09:36:10 UTC, 1 replies.
- [PR] [INFRA] Share SBT precompile artifact with tpcds-1g CI job [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/29 10:48:40 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-57101][SQL] Register nanosecond timestamp types in the Types Framework (server-side) [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/05/29 12:01:12 UTC, 0 replies.
- [PR] [INFRA] Unify Coursier cache to a single key across all jobs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/29 12:23:35 UTC, 0 replies.
- [PR] [SPARK-57143][SQL][TESTS] Add SQL test coverage for grouping analytics [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2026/05/29 12:34:51 UTC, 1 replies.
- [PR] [SPARK-57103][SQL] Add hashing for nanosecond timestamp types [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/05/29 13:11:20 UTC, 5 replies.
- [PR] [INFRA] Reuse docs Docker image and composite action in pages.yml [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/29 13:33:12 UTC, 0 replies.
- [PR] [SPARK-57032][SQL] Extend timestamp string parsing for nanosecond fractional precision [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/05/29 13:45:59 UTC, 2 replies.
- [PR] [SPARK-56661] Fixing MapPartitionsExternalUDF to generate output attributes only once [spark] - posted by "sven-weber-db (via GitHub)" <gi...@apache.org> on 2026/05/29 14:08:34 UTC, 2 replies.
- [PR] [SPARK-57103][SQL] Wire ordering for nanosecond timestamp types [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/05/29 16:25:31 UTC, 4 replies.
- [PR] [SPARK-57134][SDP] Implement SCD2 Batch Processor; Preprocess Microbatch [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/05/29 16:39:03 UTC, 4 replies.
- [PR] [SPARK-56032][SQL] Skip FilterExec subexpression elimination codegen when there is no common subexpression [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/05/29 16:40:53 UTC, 0 replies.
- [PR] [SPARK-57146] Add `AGENTS.md` and symlink `CLAUDE.md` to it [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/29 16:52:01 UTC, 3 replies.
- [PR] [SPARK-57147] Add `AGENTS.md` and symlink `CLAUDE.md` to it [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/29 17:13:15 UTC, 6 replies.
- [PR] [SPARK-57149][SQL] Skip statically-dead common sub-expression scaffold in Project and aggregate codegen [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/29 18:08:22 UTC, 2 replies.
- [PR] [SPARK-57151] Run CI in forked repositories and report build status to PRs [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/29 18:33:39 UTC, 5 replies.
- [PR] test [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/29 18:58:39 UTC, 0 replies.
- [PR] [SPARK-57153] Run CI in forked repositories and report build status to PRs [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/29 19:21:47 UTC, 5 replies.
- [PR] CI test [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/29 19:39:53 UTC, 1 replies.
- [PR] [SPARK-52812][CONNECT] Preserve spark.sql.sources.default for eager createTable(tableName, path) [spark] - posted by "haoyangeng-db (via GitHub)" <gi...@apache.org> on 2026/05/29 20:02:12 UTC, 3 replies.
- [PR] [SPARK-54999] Re-enable `ConstraintTests` by moving into `IcebergTests` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/29 20:11:36 UTC, 1 replies.
- [PR] [SPARK-57154][INFRA] Harden `notify_test_workflow` against fork run/check-run race [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/29 20:23:47 UTC, 4 replies.
- [PR] [SPARK-57155][INFRA] Fix `update_build_status` check-run pagination and output parsing [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/29 20:23:50 UTC, 4 replies.
- [PR] [SPARK-57150] SCD1 Out-of-order Convergence Suite [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/05/29 20:38:16 UTC, 1 replies.
- Re: [PR] CI test [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/05/29 21:40:21 UTC, 0 replies.
- Re: [PR] [SPARK-57143][SQL][TESTS] Extend SQL test coverage for grouping analytics [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/05/29 21:43:28 UTC, 1 replies.
- [PR] [SPARK-56305][SQL] Fix collation-aware PIVOT to use collation-sensitive comparison in PivotFirst [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/05/29 22:25:10 UTC, 2 replies.
- Re: [PR] [SPARK-57150][SDP] SCD1 Out-of-order Convergence Suite [spark] - posted by "jose-torres (via GitHub)" <gi...@apache.org> on 2026/05/29 22:51:18 UTC, 0 replies.
- Re: [PR] [SPARK-56462][SQL]Fix UPDATE/INSERT schema evolution failure when source col contains special characters like dot/space [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/05/29 23:51:07 UTC, 13 replies.
- Re: [PR] Revert "[SPARK-56975][SS] Reject user-specified schema in DataStreamReader.table()" [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2026/05/30 00:01:13 UTC, 0 replies.
- [PR] [SPARK-57156] Harden fork CI status workflows against run/check-run race and pagination [spark-connect-swift] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/30 00:42:13 UTC, 2 replies.
- [PR] [SPARK-57157] Harden fork CI status workflows against run/check-run race and pagination [spark-kubernetes-operator] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/05/30 00:42:16 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-53928][SQL] Enhance DSV2 partition filtering using catalyst expression [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/05/30 00:48:46 UTC, 1 replies.
- Re: [PR] [SPARK-57142][INFRA] Share SBT precompile artifact with tpcds-1g CI job [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/05/30 01:30:10 UTC, 0 replies.
- [PR] [SPARK-57158][SQL] ExplainUtils: extract operator ID assignment phase from processPlan into a private helper [spark] - posted by "markj-db (via GitHub)" <gi...@apache.org> on 2026/05/30 02:27:57 UTC, 0 replies.
- Re: [I] NullPointerException in KafkaMicroBatchStream.metrics when latestPartitionOffsets is uninitialized [spark] - posted by "ntnhaatj (via GitHub)" <gi...@apache.org> on 2026/05/30 06:33:21 UTC, 0 replies.
- Re: [PR] [SPARK-56413][SQL][UDF] gRPC implementation of the UDF worker protocol dispatcher [spark] - posted by "sven-weber-db (via GitHub)" <gi...@apache.org> on 2026/05/30 09:06:04 UTC, 0 replies.
- [PR] [SPARK-57167][SQL] Simplify MakeTimestamp codegen under ANSI mode [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/30 10:35:08 UTC, 2 replies.
- [PR] [SPARK-57168][SQL] Simplify GetTimestamp codegen under ANSI mode [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/30 10:43:24 UTC, 1 replies.
- [PR] [SPARK-57169][SQL] Simplify NextDay codegen under ANSI mode [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/30 10:46:52 UTC, 1 replies.
- [PR] [SPARK-57170][SQL] Simplify Cast string to float/double codegen under ANSI mode [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/30 10:53:33 UTC, 0 replies.
- [PR] [SPARK-57171][SQL] Simplify Slice codegen by extracting index arithmetic into a static Java helper [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/30 11:01:01 UTC, 0 replies.
- [PR] [SPARK-57172][SQL] Simplify Crc32 codegen by extracting a static Java helper [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/30 11:06:41 UTC, 0 replies.
- [PR] [SPARK-57173][SQL] Simplify regexp pattern-compile codegen by extracting a static Java helper [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/30 11:11:01 UTC, 0 replies.
- [PR] [SPARK-57174][SQL] Simplify Chr codegen by extracting a static Java helper [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/30 11:14:55 UTC, 1 replies.
- [PR] [SPARK-47017][SQL] Show internal SQL plans for RDDScanExec [spark] - posted by "alexandrefimov (via GitHub)" <gi...@apache.org> on 2026/05/30 16:08:48 UTC, 1 replies.
- [PR] [SPARK-57175][SQL] Extend nested column pruning to exists and forall over arrays of structs [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/05/30 17:22:29 UTC, 0 replies.
- Re: [PR] [SPARK-57105][SQL] Fix `StringIndexOutOfBoundsException` in parameterized SQL scripts [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/05/30 17:39:01 UTC, 0 replies.
- [PR] [SPARK-57176][SQL] Extend nested column pruning through array-returning functions [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/05/30 18:13:31 UTC, 0 replies.
- [PR] [SPARK-57177][SQL] Simplify Acosh codegen by extracting a static Java helper [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/30 23:35:55 UTC, 0 replies.
- [PR] [SPARK-57178][SQL] Simplify Asinh codegen by extracting a static Java helper [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/30 23:38:33 UTC, 0 replies.
- [PR] [SPARK-57179][SQL] Skip statically-dead null branches in GenerateOrdering for non-nullable sort keys [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/31 00:01:53 UTC, 0 replies.
- [PR] [SPARK-57180][SQL] Skip statically-dead setNullAt branch in GenerateSafeProjection for non-nullable fields [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/31 00:05:53 UTC, 0 replies.
- [PR] [SPARK-57181][SQL] Simplify Pmod codegen by sharing a MathUtils.pmod helper with eval [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/05/31 00:22:08 UTC, 0 replies.
- Re: [PR] [SPARK-55500][4.1][SQL] Fix analyzer cycle between `ApplyDefaultCollation`, `ExtractWindowExpressions` and `CollationTypeCasts` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/31 01:06:23 UTC, 1 replies.
- [PR] [SPARK-XXXXX][BUILD] Upgrade sbt to 1.12.11 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/05/31 08:22:05 UTC, 1 replies.
- [PR] [SPARK-57183][SS] Close LRUCache on RocksDB.close() in unbounded memory mode [spark] - posted by "kete1987 (via GitHub)" <gi...@apache.org> on 2026/05/31 14:32:44 UTC, 0 replies.
- [PR] [SPARK-57184][SQL] Recurse into CalendarInterval children when appending a null struct [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/05/31 19:57:06 UTC, 0 replies.
- [PR] [SPARK-57185][SQL] Use thread-local ICU collators to fix lock contention in CollationFactory [spark] - posted by "dejankrak-db (via GitHub)" <gi...@apache.org> on 2026/05/31 20:42:52 UTC, 0 replies.
- [PR] [SPARK-57186][SQL] Handle NullType in ExtractValue to return NULL instead of throwing [spark] - posted by "dejankrak-db (via GitHub)" <gi...@apache.org> on 2026/05/31 21:44:29 UTC, 0 replies.
- [PR] [SPARK-57187][SQL] Fix INTERNAL_ERROR when current_user() is used as DEFAULT for CHAR/VARCHAR columns [spark] - posted by "dejankrak-db (via GitHub)" <gi...@apache.org> on 2026/05/31 22:05:48 UTC, 0 replies.
- Re: [PR] [SPARK-56462][SQL]Fix MERGE UPDATE */INSERT * schema evolution failure when source col contains special characters like dot/space [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/05/31 22:24:14 UTC, 2 replies.
- [PR] [SPARK-57188][SQL] Parameterless function takes precedence over UDF parameter [spark] - posted by "dejankrak-db (via GitHub)" <gi...@apache.org> on 2026/05/31 22:27:07 UTC, 0 replies.