reviews@spark.apache.org, 2026-06

You are viewing a plain text version of this content. The canonical link for it is here.

- Re: [I] [TEST] `test_session.py` does not work properly [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/01 01:09:36 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-55531] [CORE] Start pending barrier stages immediately when enough cores are available [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/01 01:09:38 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-51224][BUILD] Test Maven 4 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/01 01:09:40 UTC, 1 replies.
- Re: [PR] [SPARK-57168][SQL] Simplify GetTimestamp codegen under ANSI mode [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/06/01 02:08:24 UTC, 1 replies.
- Re: [PR] [SPARK-56032][SQL][FOLLOWUP] Skip FilterExec subexpression elimination codegen when there is no common subexpression [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/01 02:46:09 UTC, 3 replies.
- [PR] [SPARK-57190][SQL] Resolve API inconsistency for 4-argument regexp_replace [spark] - posted by "pchintar (via GitHub)" <gi...@apache.org> on 2026/06/01 03:45:15 UTC, 0 replies.
- [PR] [SPARK-57189][CONNECT] Fix double execution and guard bypass in handleSqlCommand for WITH_RELATIONS [spark] - posted by "rdtr (via GitHub)" <gi...@apache.org> on 2026/06/01 03:52:25 UTC, 0 replies.
- Re: [PR] [SPARK-57183][SS] Close LRUCache on RocksDB.close() in unbounded memory mode [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/06/01 04:03:31 UTC, 16 replies.
- Re: [PR] [SPARK-56638][SQL] Replace legacy parser error for ParserUtils validation failures [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/01 04:42:54 UTC, 2 replies.
- Re: [PR] [SPARK-57021][CONNECT][PYTHON] Add SQLContext wrapper for Spark Connect [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/01 04:50:00 UTC, 18 replies.
- [PR] [SPARK-56462][SQL][FOLLOWUP] Add test coverage for merge into schema evolution [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/06/01 05:01:28 UTC, 0 replies.
- Re: [PR] [SPARK-56391] [SQL] Support unwrap string type to date type in UnwrapCastInBinaryComparison [spark] - posted by "daijy (via GitHub)" <gi...@apache.org> on 2026/06/01 05:35:06 UTC, 0 replies.
- [PR] [SPARK-56145][SQL] Enforce minimum partition count for join stages in CoalesceShufflePartitions [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/06/01 05:51:34 UTC, 11 replies.
- Re: [PR] [SPARK-57064][SQL] Widen bucketing rule pattern matches to use FileSourceScanLike trait [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/01 05:59:36 UTC, 0 replies.
- Re: [PR] [SPARK-55326][PYTHON][CONNECT][FOLLOWUP] Skip cleanup RPCs in _on_exit when client is already closed [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/01 06:03:33 UTC, 1 replies.
- [PR] [SPARK-56660][SQL] Decompose struct equality into field-level predicates for filter pushdown [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/06/01 06:44:34 UTC, 10 replies.
- Re: [PR] [SPARK-57056][SQL] Add `SupportsBranching` DSv2 interface and branching DDL [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/06/01 07:05:23 UTC, 13 replies.
- Re: [PR] [SPARK-56887][SQL] Add dedicated sort-merge physical operator for AS-OF join [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/01 08:00:13 UTC, 8 replies.
- Re: [PR] [SPARK-57103][SQL] Wire ordering for nanosecond timestamp types [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/01 09:02:19 UTC, 1 replies.
- Re: [PR] [SPARK-57103][SQL] Add hashing for nanosecond timestamp types [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/01 09:16:20 UTC, 3 replies.
- Re: [PR] [SPARK-57184][SQL] Recurse into CalendarInterval children when appending a null struct [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/01 09:17:14 UTC, 1 replies.
- Re: [PR] [SPARK-57101][SQL] Register nanosecond timestamp types in the Types Framework (server-side) [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/06/01 09:27:41 UTC, 5 replies.
- Re: [PR] [SPARK-57032][SQL] Extend timestamp string parsing for nanosecond fractional precision [spark] - posted by "dejankrak-db (via GitHub)" <gi...@apache.org> on 2026/06/01 09:33:44 UTC, 11 replies.
- [PR] [SPARK-57192][PYSPARK] Fix classic addArtifacts with multiple paths [spark] - posted by "wbo4958 (via GitHub)" <gi...@apache.org> on 2026/06/01 09:53:53 UTC, 3 replies.
- Re: [PR] [SPARK-57091][SQL] Add BroadcastNearestByJoinExec to avoid cross-product materialization [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/01 10:01:54 UTC, 16 replies.
- [PR] [SPARK-57193][SQL] Refactor some helpers out of TimeWindowResolution [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2026/06/01 11:00:38 UTC, 2 replies.
- Re: [PR] [SPARK-57029][SQL][TESTS] Add byte-level visibility golden for ICU collation sort keys [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/06/01 11:39:20 UTC, 0 replies.
- Re: [PR] [SPARK-46367][SQL] Support narrowing projection of `KeyedPartitioning` in `PartitioningPreservingUnaryExecNode` [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/06/01 11:56:25 UTC, 2 replies.
- Re: [PR] [SPARK-56413][SQL][UDF] gRPC implementation of the UDF worker protocol dispatcher [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2026/06/01 12:36:12 UTC, 33 replies.
- Re: [PR] [SPARK-57185][SQL] Use thread-local ICU collators to fix lock contention in CollationFactory [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/01 13:11:12 UTC, 1 replies.
- [PR] [SPARK-57133][SQL] Add BIN BY relation operator parsing and resolution [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/06/01 13:17:41 UTC, 25 replies.
- Re: [PR] [SPARK-57186][SQL] Handle NullType in ExtractValue to return NULL instead of throwing [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/01 13:30:53 UTC, 9 replies.
- Re: [PR] [SPARK-57058][SQL] Introduce BinaryView and migrate geo types to it for zero-copy reads [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/01 13:38:39 UTC, 3 replies.
- Re: [PR] [SPARK-57187][SQL] Fix INTERNAL_ERROR when current_user() is used as DEFAULT for CHAR/VARCHAR columns [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/01 13:45:59 UTC, 7 replies.
- Re: [I] Add TryRepurpose.com — AI content repurposing tool [spark] - posted by "technical-debt-collector (via GitHub)" <gi...@apache.org> on 2026/06/01 13:47:47 UTC, 0 replies.
- Re: [PR] [SPARK-57188][SQL] Parameterless function takes precedence over UDF parameter [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/01 14:09:25 UTC, 3 replies.
- Re: [PR] [SPARK-54710][SQL] Show Partitions As Json [spark] - posted by "ashutosh-jindal (via GitHub)" <gi...@apache.org> on 2026/06/01 15:13:05 UTC, 12 replies.
- Re: [PR] [SPARK-57169][SQL] Simplify NextDay codegen under ANSI mode [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/06/01 16:42:57 UTC, 1 replies.
- Re: [PR] [SPARK-57170][SQL] Simplify Cast string to float/double codegen under ANSI mode [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/06/01 16:45:05 UTC, 1 replies.
- [PR] [SPARK-34679][DOCS] Add inferTimestamp option to JSON data source options table [spark] - posted by "brijrajk (via GitHub)" <gi...@apache.org> on 2026/06/01 16:49:05 UTC, 3 replies.
- Re: [PR] [SPARK-53840][SQL] Add AS JSON output support for SHOW TABLES and SHOW TABLE EXTENDED [spark] - posted by "ayushbilala (via GitHub)" <gi...@apache.org> on 2026/06/01 16:59:47 UTC, 14 replies.
- Re: [PR] [SPARK-56637][CORE] Fix Variant getFieldByKey to handle unsorted object fields [spark] - posted by "steveloughran (via GitHub)" <gi...@apache.org> on 2026/06/01 17:45:25 UTC, 1 replies.
- Re: [PR] [SPARK-57134][SDP] Implement SCD2 Batch Processor; Preprocess Microbatch [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/06/01 18:45:38 UTC, 9 replies.
- [PR] [SPARK-XXXXX] Fix JVM Codegen Bug - NULL for 3-arg form with column nullReplacement [spark] - posted by "rgyhuang (via GitHub)" <gi...@apache.org> on 2026/06/01 18:51:07 UTC, 0 replies.
- Re: [PR] [SPARK-56462][SQL][FOLLOWUP] Improve test coverage for merge into schema evolution [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/06/01 18:59:33 UTC, 1 replies.
- Re: [PR] [SQL][DML] Resolve Path Based Tables Read in Transactional Writes [spark] - posted by "andreaschat-db (via GitHub)" <gi...@apache.org> on 2026/06/01 19:03:06 UTC, 0 replies.
- Re: [PR] [SPARK-57073][SS][PYTHON][TESTS] Skip flaky test_listener_events_spark_command on macOS [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/01 19:03:12 UTC, 3 replies.
- [PR] [SPARK-56561][PYTHON][DOCS] Document order preservation for array_distinct, array_intersect, array_union, array_except [spark] - posted by "brijrajk (via GitHub)" <gi...@apache.org> on 2026/06/01 19:23:00 UTC, 3 replies.
- Re: [PR] [SPARK-56956][SPARK-56651][CONNECT][SDP][FOLLOWUP] Address review comments for AutoCDC flow dataclasses and Python APIs [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/06/01 19:42:29 UTC, 2 replies.
- [PR] [SPARK-XXXXX][PYSPARK] Fix type hint in SparkSession.sql() [spark] - posted by "jdayton3 (via GitHub)" <gi...@apache.org> on 2026/06/01 19:44:47 UTC, 1 replies.
- Re: [PR] [SPARK-57175][SQL] Extend nested column pruning to exists and forall over arrays of structs [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/06/01 20:07:12 UTC, 2 replies.
- Re: [PR] [SPARK-57171][SQL] Simplify Slice codegen by extracting index arithmetic into a static Java helper [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/06/01 20:16:58 UTC, 1 replies.
- [PR] [SPARK-57196][SQL] Make UnionExec whole-stage codegen thread-safe [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/06/01 20:20:07 UTC, 6 replies.
- [PR] [SPARK-57198][SQL] Skip the divide-by-zero check in codegen when the divisor is a non-zero literal [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/06/01 21:33:31 UTC, 2 replies.
- [PR] [SPARK-57135][SQL] Infer CSV schema from tar archives (stacked on #56193) [spark] - posted by "akshatshenoi-eng (via GitHub)" <gi...@apache.org> on 2026/06/01 21:46:01 UTC, 0 replies.
- Re: [PR] [SPARK-51377][DOCS] Fix PYTHONPATH shell command in PySpark installation docs [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/01 21:48:17 UTC, 1 replies.
- [PR] [SPARK-55347][SDP][FOLLOW-UP] Cleanup AutoCDC Flow code [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/06/01 22:12:02 UTC, 0 replies.
- [PR] [SPARK-57199][SQL] Extract the aggregate out-of-memory error into a QueryExecutionErrors factory [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/06/01 22:25:11 UTC, 1 replies.
- Re: [PR] [SPARK-57135][SQL] Support reading CSV files inside tar archives [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/01 22:37:10 UTC, 7 replies.
- [PR] [SPARK-57201][SQL] Skip the null check in UnsafeProjection codegen for statically non-null values [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/06/01 22:46:52 UTC, 2 replies.
- [PR] [SPARK-57202][SQL] Skip dead null checks in In expression codegen for non-null list elements [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/06/01 22:51:40 UTC, 3 replies.
- Re: [PR] [SPARK-57000][CORE][SS][RTM] Add concurrent scheduling capabilites for Real-time Mode [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2026/06/01 22:54:22 UTC, 19 replies.
- Re: [PR] [SPARK-56028][CORE] Fix shuffle block GC not cleanup checksum file [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2026/06/01 23:11:20 UTC, 0 replies.
- [PR] [SPARK-56651][CONNECT][SDP][FOLLOWUP] Move Auto CDC flow tests into a dedicated test file [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/01 23:16:13 UTC, 7 replies.
- Re: [I] [SPARK-38101] execuors fail fetching map statuses with `INTERNAL_ERROR_BROADCAST` [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2026/06/01 23:18:59 UTC, 0 replies.
- [PR] [SPARK-57195][SQL] Surface MALFORMED_CSV_RECORD instead of ArrayIndexOutOfBoundsException in CSV schema inference [spark] - posted by "yashtc (via GitHub)" <gi...@apache.org> on 2026/06/01 23:24:05 UTC, 6 replies.
- Re: [PR] [SPARK-38101][CORE] Make metadata fetch failure repeat the task, not restart stages [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2026/06/01 23:26:52 UTC, 3 replies.
- Re: [PR] [SPARK-56999][PYSPARK] Fix mapInArrow opaque getInt error by coercing output to declared schema [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/02 00:29:00 UTC, 0 replies.
- [PR] [SPARK-57203][INFRA] Improve dev/merge_spark_pr.py to continue on mistyped branch name [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/06/02 00:31:07 UTC, 1 replies.
- Re: [PR] [SPARK-57200] Fix JVM Codegen Bug - NULL for 3-arg form with column nullReplacement [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/02 01:08:20 UTC, 3 replies.
- Re: [I] Suggestion: reference WFGY Problem Map (RAG / LLM debugging checklist) for Spark + LLM workloads [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/02 01:08:34 UTC, 0 replies.
- Re: [PR] [SPARK-57158][SQL] ExplainUtils: extract operator ID assignment phase from processPlan into a private helper [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/02 01:48:52 UTC, 0 replies.
- Re: [PR] [SPARK-57203][INFRA] Improve dev/merge_spark_pr.py to continue prompting on mistyped branch name [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/06/02 02:16:51 UTC, 3 replies.
- Re: [PR] [SPARK-56695][SQL][DML] Resolve Path Based Tables for both Reads and Writes [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/06/02 04:49:15 UTC, 5 replies.
- Re: [PR] [SPARK-55876][SQL] Add query statistics summary bar to SQL tab [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/02 05:01:01 UTC, 2 replies.
- [PR] [SPARK-XXXXX][K8S] Write Spark driver stderr to Kubernetes termination log on failure [spark] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2026/06/02 05:05:31 UTC, 0 replies.
- Re: [PR] [SPARK-57204][K8S] Write Spark driver stderr to Kubernetes termination log on failure [spark] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2026/06/02 05:34:47 UTC, 0 replies.
- Re: [PR] [SPARK-57182][BUILD] Upgrade sbt to 1.12.11 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/02 05:40:46 UTC, 1 replies.
- [PR] [SPARK-53454][SQL][FOLLOWUP] Parenthesize AlwaysTrue/AlwaysFalse SQL so it is valid as a nested operand [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/02 06:35:29 UTC, 6 replies.
- [PR] [SPARK-57205][SQL] Add SupportsScanMerging to merge equivalent V2 file scans [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/02 07:51:03 UTC, 7 replies.
- [PR] [SPARK-57206][SQL] Simplify WidthBucket codegen by reusing the computeBucketNumber helper [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/02 08:09:35 UTC, 2 replies.
- Re: [PR] [SPARK-52011][SQL] Reduce HDFS NameNode RPC on vectorized Parquet reader [spark] - posted by "ahmarsuhail (via GitHub)" <gi...@apache.org> on 2026/06/02 08:47:26 UTC, 3 replies.
- [PR] [SPARK-57207][SQL] Register nanosecond timestamp types in the Types Framework via TypeOps overrides [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/02 08:54:20 UTC, 8 replies.
- [PR] [SPARK-57208][SQL] Simplify Ascii codegen by extracting a static Java helper [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/02 09:07:21 UTC, 2 replies.
- Re: [PR] [SPARK-56661] Introducing logical and physical planning nodes for language-agnostic Spark UDFs [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/02 09:17:29 UTC, 3 replies.
- [PR] [SPARK-57209][YARN] Log application ID once is assigned [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/06/02 10:08:51 UTC, 2 replies.
- [PR] [SPARK-57166][SQL] Reject nanosecond-capable timestamp types in built-in datasources and JDBC [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/02 10:22:40 UTC, 3 replies.
- [PR] [SPARK-57210][SQL] Skip statically-dead null-write branch in CreateNamedStruct codegen for non-nullable fields [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/02 10:38:00 UTC, 3 replies.
- [PR] [SPARK-56032][SQL][FOLLOWUP] Add conf to gate subexpression elimination in FilterExec codegen [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/02 10:47:31 UTC, 2 replies.
- Re: [PR] [SPARK-54770][PYTHON] Replace dead assert with proper error in _create_converter [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/06/02 11:47:32 UTC, 2 replies.
- Re: [PR] [SPARK-57190][SQL] Fix API inconsistency for 4-argument regexp_replace [spark] - posted by "pchintar (via GitHub)" <gi...@apache.org> on 2026/06/02 12:16:10 UTC, 9 replies.
- [PR] [SPARK-57213][SQL] Skip dead null checks in AtLeastNNonNulls codegen for non-nullable children [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/02 12:28:16 UTC, 3 replies.
- [PR] [SPARK-56661] Fix grpc dep - separate test-only grpc away from udf core module. [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2026/06/02 12:38:39 UTC, 0 replies.
- Re: [PR] [SPARK-56651][CONNECT][SDP] Add Python APIs for Auto CDC SCD Type 1 [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/06/02 13:00:23 UTC, 0 replies.
- [PR] [SPARK-57191][YARN] Fix driver hang when MonitorThread encounters unexpected exception [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/06/02 13:24:55 UTC, 10 replies.
- [PR] [SPARK-57212][SQL] Track preparation rule timing in QueryPlanningTracker [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/06/02 13:43:59 UTC, 8 replies.
- Re: [PR] [SPARK-56919][SQL] Move setupJob before materializeAdaptiveSparkPlan to prevent table path loss [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/06/02 13:46:24 UTC, 5 replies.
- Re: [PR] [SPARK-50520][PySpark] Respect timeout in df.rdd.countApprox() [spark] - posted by "rishav23 (via GitHub)" <gi...@apache.org> on 2026/06/02 14:03:54 UTC, 8 replies.
- [PR] [SPARK-57216][SQL] Skip dead null-check branches in NaNvl codegen for non-nullable children [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/02 14:21:16 UTC, 3 replies.
- [PR] [SPARK-57194][SQL] Add earlyOperatorOptimizationRules extension point to Optimizer [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/06/02 14:27:45 UTC, 6 replies.
- [PR] [SPARK-57217][SQL] Skip dead null assignments in If codegen when branch values are non-nullable [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/02 15:44:11 UTC, 3 replies.
- [PR] [SPARK-57218][PYTHON] Fix mypy errors with the latest pandas-stubs [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/02 15:46:26 UTC, 7 replies.
- Re: [PR] [SPARK-56447][SHELL] Fix spark-shell REPL classpath initialization error [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/06/02 15:47:34 UTC, 0 replies.
- [PR] [SPARK-XXXXX][INFRA] Pin `pandas-stubs==3.0.3.260530` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/02 15:48:12 UTC, 0 replies.
- Re: [PR] [SPARK-57219][INFRA] Pin `pandas-stubs==3.0.3.260530` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/02 15:52:18 UTC, 2 replies.
- [PR] [SPARK-57183][SS][4.2] Close LRUCache on RocksDB.close() in unbounded memory mode [spark] - posted by "kete1987 (via GitHub)" <gi...@apache.org> on 2026/06/02 16:33:17 UTC, 7 replies.
- Re: [PR] [SPARK-56763] Branch 3.5 restore Python 3.8 & R in CI (Continuation of Sarutak's PR) [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/06/02 16:59:07 UTC, 3 replies.
- Re: [PR] [SPARK-56538][CONNECT] Add per-RPC deadlines to Spark Connect client [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2026/06/02 17:09:19 UTC, 2 replies.
- [PR] [SPARK-57221][INFRA] Make merge_spark_pr.py fail fast on missing JIRA setup and stale script versions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/02 17:36:32 UTC, 6 replies.
- [PR] [SPARK-57152][SDP] Implement SCD2 Batch Processor; Find Affected Aux/Target Table Rows [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/06/02 17:52:38 UTC, 20 replies.
- [PR] [SPARK-46158][PYTHON][PS] Support axis columns in DataFrame.xs [spark] - posted by "manhha2502 (via GitHub)" <gi...@apache.org> on 2026/06/02 18:48:27 UTC, 8 replies.
- Re: [PR] [SPARK-57197][SQL][FOLLOWUP] Improve test coverage for merge into schema evolution [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/06/02 19:01:56 UTC, 2 replies.
- [PR] [SPARK-57224][INFRA] Add input check for merge script [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/02 19:03:15 UTC, 2 replies.
- Re: [PR] [SPARK-57181][SQL] Simplify Pmod codegen by sharing a MathUtils.pmod helper with eval [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/06/02 19:04:01 UTC, 1 replies.
- Re: [PR] [SPARK-57180][SQL] Skip statically-dead setNullAt branch in GenerateSafeProjection for non-nullable fields [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/06/02 19:04:02 UTC, 1 replies.
- Re: [PR] [SPARK-57179][SQL] Skip statically-dead null branches in GenerateOrdering for non-nullable sort keys [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/06/02 19:04:03 UTC, 1 replies.
- Re: [PR] [SPARK-57178][SQL] Simplify Asinh codegen by extracting a static Java helper [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/06/02 19:04:05 UTC, 1 replies.
- Re: [PR] [SPARK-57177][SQL] Simplify Acosh codegen by extracting a static Java helper [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/06/02 19:04:07 UTC, 1 replies.
- Re: [PR] [SPARK-57174][SQL] Simplify Chr codegen by extracting a static Java helper [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/06/02 19:04:07 UTC, 1 replies.
- Re: [PR] [SPARK-57173][SQL] Simplify regexp pattern-compile codegen by extracting a static Java helper [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/06/02 19:04:09 UTC, 1 replies.
- Re: [PR] [SPARK-57172][SQL] Simplify Crc32 codegen by extracting a static Java helper [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/06/02 19:04:11 UTC, 1 replies.
- [PR] [SPARK-56632][CONNECT][TESTS][4.1] Add E2E test for self-join reusing a DataFrame [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/06/02 20:04:03 UTC, 0 replies.
- [PR] [SPARK-56632][CONNECT][TESTS][4.2] Add E2E test for self-join reusing a DataFrame [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/06/02 20:05:33 UTC, 0 replies.
- [PR] [SPARK-57211][SQL] Cast strings to TIMESTAMP_NTZ(p)/TIMESTAMP_LTZ(p) [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/02 20:46:32 UTC, 7 replies.
- Re: [PR] [SPARK-57233][PYSPARK] Fix type hint in SparkSession.sql() [spark] - posted by "jdayton3 (via GitHub)" <gi...@apache.org> on 2026/06/02 22:09:11 UTC, 5 replies.
- [PR] [SPARK-57218][PYTHON] Pin pandas and pandas stub version for lint image [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/02 22:22:32 UTC, 4 replies.
- Re: [PR] [SPARK-55982][SQL] Fix function cache coherence on drop namespace in V2 catalogs [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/06/02 23:12:53 UTC, 10 replies.
- [PR] [SPARK-57239][PYTHON][TESTS] Use sqlite uri for mlflow model [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/02 23:42:37 UTC, 2 replies.
- Re: [PR] [SPARK-57113][SDP][FOLLOW-UP] Cleanup AutoCDC Flow code [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/06/03 00:16:30 UTC, 4 replies.
- Re: [PR] [SPARK-55347][SQL] Pass Generated Column as Expression to DSV2 [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/06/03 00:23:35 UTC, 7 replies.
- Re: [PR] [SPARK-56729][SQL] ReplaceData and WriteDelta should implement SupportsNonDeterministicExpression [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/06/03 01:09:21 UTC, 11 replies.
- Re: [I] Catalyst optimizer non-convergence with iterative withColumn rewrite + filter pushdown in Spark [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/03 01:14:20 UTC, 0 replies.
- [PR] [SPARK-57220][SQL] Extend block-chunked segment-tree window frame to shrinking frames [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/06/03 01:27:51 UTC, 11 replies.
- Re: [PR] [SPARK-56892][SQL] Bulk read optimization for Parquet DELTA_BINARY_PACKED decoding [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/06/03 02:00:06 UTC, 24 replies.
- [PR] [FEAT] Cancel server-side query when caller context is cancelled (#126) [spark-connect-go] - posted by "40u5 (via GitHub)" <gi...@apache.org> on 2026/06/03 02:20:50 UTC, 0 replies.
- Re: [PR] [SPARK-57068][SQL] Make SaveMode.Overwrite create the table when missing for SupportsCatalogOptions sources [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/06/03 03:50:43 UTC, 3 replies.
- [PR] [SPARK-57241][SQL] Skip statically-dead null checks in StringLocate codegen for non-nullable children [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/03 04:58:41 UTC, 3 replies.
- [PR] [SPARK-57242][CORE] Avoid unbounded page allocation retries after allocator OOM [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/06/03 05:14:04 UTC, 20 replies.
- [PR] Spark 57223 to sql id special char error msg [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/06/03 05:28:34 UTC, 0 replies.
- [PR] [WIP][SPARK-57162][SQL] Add nanosecond-aware TimestampFormatter for parsing and formatting TimestampNanosVal [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/03 09:14:07 UTC, 0 replies.
- [PR] Wrap IsNull and IsNotNull in brackets for V2 SQL builder [spark] - posted by "milastdbx (via GitHub)" <gi...@apache.org> on 2026/06/03 10:12:35 UTC, 0 replies.
- Re: [PR] [SPARK-57162][SQL] Add nanosecond-aware TimestampFormatter for parsing and formatting TimestampNanosVal [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/03 10:14:30 UTC, 9 replies.
- Re: [PR] [SPARK-57243] Wrap IsNull and IsNotNull in brackets for V2 SQL builder [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/06/03 10:20:36 UTC, 12 replies.
- [PR] [SPARK-57244][SQL] Skip the statically-dead branch in DateAddInterval codegen when the interval is a constant [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/03 11:01:00 UTC, 3 replies.
- Re: [PR] [SPARK-57207][SQL] Support nanosecond timestamp types in the Types Framework [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2026/06/03 11:16:41 UTC, 7 replies.
- [PR] [SPARK-57165][SQL][TESTS] Add LiteralGenerator support for nanosecond-capable timestamp types [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/03 11:43:05 UTC, 2 replies.
- [PR] [SPARK-57245][SQL] Simplify FormatNumber codegen by extracting a static Java helper [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/03 11:51:32 UTC, 5 replies.
- Re: [PR] [SPARK-40437][SS][PYTHON] Support string representation of durationMs in GroupState.setTimeoutDuration [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/03 12:12:48 UTC, 6 replies.
- Re: [PR] [SPARK-49798][DOCS] Fix inaccurate documentation of RuntimeConfig.get [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/03 12:17:13 UTC, 4 replies.
- [PR] [WIP][SQL][PYTHON][CONNECT] Support DataFrame.zip in Spark Connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/03 12:20:43 UTC, 0 replies.
- [PR] [SPARK-57246][SQL] Skip the dead result null assignment in MakeDecimal codegen when overflow cannot produce null [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/03 12:22:59 UTC, 3 replies.
- [PR] [SPARK-57163][SQL] Map TIMESTAMP_LTZ(6) and TIMESTAMP_NTZ(6) to TimestampType and TimestampNTZType [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/03 12:40:51 UTC, 3 replies.
- [PR] [SPARK-57248][SQL] Skip the dead result null assignment in CheckOverflow codegen when overflow cannot produce null [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/03 12:48:27 UTC, 3 replies.
- [PR] [SPARK-57249][SQL] Skip the dead result null assignment in DecimalDivideWithOverflowCheck codegen when overflow cannot produce null [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/03 13:50:39 UTC, 3 replies.
- Re: [PR] [SPARK-56413][SPARK-56661][UDF][BUILD] Confine gRPC to a dedicated udf-worker-grpc module [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/03 14:09:47 UTC, 1 replies.
- Re: [PR] [SPARK-57144][INFRA] Unify Coursier cache to a single key across all jobs [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/03 15:10:00 UTC, 4 replies.
- [PR] Bump org.apache.thrift:libthrift from 0.16.0 to 0.23.0 [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/06/03 16:14:54 UTC, 2 replies.
- Re: [PR] [SPARK-56970][SS] Split CommitMetadata into CommitMetadataBase + V1/V2 case classes [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2026/06/03 16:18:12 UTC, 7 replies.
- [PR] [SPARK-57250][SQL] Construct sub-microsecond timestamp typed literals with precision derived from fractional digits [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/03 16:28:04 UTC, 6 replies.
- Re: [PR] [SPARK-56995][SQL][DML] Allow dataframe caching in the DSv2 Transaction API [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/06/03 17:58:19 UTC, 25 replies.
- Re: [PR] [SPARK-51262][SQL] Fix exceptAll after dropDuplicates with subset [spark] - posted by "acruise (via GitHub)" <gi...@apache.org> on 2026/06/03 19:26:18 UTC, 3 replies.
- [PR] [SPARK-57183][SS][4.x] Close LRUCache on RocksDB.close() in unbounded memory mode [spark] - posted by "kete1987 (via GitHub)" <gi...@apache.org> on 2026/06/03 19:41:17 UTC, 8 replies.
- Re: [PR] [SPARK-57197][SQL] Improve test coverage for merge into schema evolution [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/06/03 19:54:01 UTC, 1 replies.
- [PR] [SPARK-57073][SS][PYTHON][TESTS] Catch AnalysisException for test_parity_listener [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/03 21:09:25 UTC, 7 replies.
- [PR] [SPARK-57253][SQL] Add `jaro_winkler_similarity` built-in function [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/03 21:14:36 UTC, 7 replies.
- Re: [PR] [SPARK-56721][INFRA] Add master server vs 4.0 client CI for all PRs [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/03 22:14:17 UTC, 1 replies.
- [PR] [SPARK-57222][SDP] Implement SCD2 Batch Processor; Decompose affected rows [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/06/03 22:17:29 UTC, 3 replies.
- [PR] [SPARK-57254][INFRA] Put CI-unrelated files in a module so CI won't be triggered [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/03 23:01:56 UTC, 4 replies.
- Re: [PR] [SPARK-50593][SQL] SPJ: Support truncate transform via generalized ReducibleFunction API [spark] - posted by "metanil (via GitHub)" <gi...@apache.org> on 2026/06/03 23:39:55 UTC, 29 replies.
- Re: [PR] [SPARK-54698][SQL] Support hashing for all data types for array set like operations [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2026/06/04 00:54:26 UTC, 0 replies.
- [PR] [SPARK-56663][FOLLOWUP] Fix silent overflow in date_trunc fast path. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2026/06/04 00:59:44 UTC, 3 replies.
- Re: [PR] [SPARK-53753][BUILD][SQL] shade antlr4-runtime [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/04 01:14:36 UTC, 1 replies.
- [PR] [SPARK-57234][SS][DOCS] Add Real-time Mode documentation page to the Structured Streaming guide [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/06/04 01:16:47 UTC, 8 replies.
- Re: [PR] [SPARK-56505][SQL][TESTS] Add SparkSessionBinder to replace SharedSparkSession [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/04 02:56:26 UTC, 2 replies.
- Re: [PR] [SPARK-57142][INFRA] Share SBT precompile artifact with tpcds-1g CI job [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/04 05:38:32 UTC, 1 replies.
- [PR] [SPARK-57255][SQL] Simplify RegExpReplace codegen by extracting the match/replace loop into a shared helper [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/04 05:39:28 UTC, 7 replies.
- [PR] [SPARK-56695][SQL][DML] Remove Path Based Table support in SQL [spark] - posted by "andreaschat-db (via GitHub)" <gi...@apache.org> on 2026/06/04 07:05:16 UTC, 2 replies.
- Re: [PR] [SQL][DML] Resolve Path Based Tables for both Reads and Writes [spark] - posted by "andreaschat-db (via GitHub)" <gi...@apache.org> on 2026/06/04 07:07:01 UTC, 1 replies.
- [PR] [SPARK-57256][SQL] Cast nanosecond-precision timestamps to string [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/04 08:23:55 UTC, 9 replies.
- [PR] [SPARK-57258][SQL] Reduce regexp_extract/regexp_extract_all generated code size via shared extract helpers [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/04 09:07:12 UTC, 3 replies.
- [PR] [SPARK-57225][SS] Reject write operations on state data sources with clear error [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/06/04 09:25:15 UTC, 4 replies.
- [PR] [SPARK-57257][SQL] Support nanosecond-precision timestamps in Hive results [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/04 10:41:10 UTC, 8 replies.
- [PR] [SPARK-57260][SQL] Fix variable resolution in REPLACE WHERE clause of INSERT INTO [spark] - posted by "joelrobin18 (via GitHub)" <gi...@apache.org> on 2026/06/04 10:45:43 UTC, 5 replies.
- [PR] [SPARK-54713][SPARK-55030][SPARK-55031][SQL][FOLLOWUP] Add PySpark bindings for vector functions [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/04 12:08:07 UTC, 0 replies.
- [PR] [SPARK-57261][SQL] Allow to disable HashAggregateExec by config [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/06/04 13:37:26 UTC, 7 replies.
- [PR] [INFRA] Fix Coursier cache for container CI jobs via volume mount [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/04 13:56:30 UTC, 0 replies.
- Re: [PR] [SPARK-56663][SQL][FOLLOWUP] Fix silent overflow in date_trunc fast path. [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/04 14:32:30 UTC, 1 replies.
- [PR] [SPARK-56413][UDF][BUILD][FOLLOWUP] Fix parent POM version in udf-worker-grpc module on branch-4.x [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/04 14:48:44 UTC, 8 replies.
- [PR] [SPARK-57262][SQL] Job description derived from a query should respect `spark.sql.redaction.string.regex` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/04 15:16:48 UTC, 0 replies.
- [PR] [WIP][SPARK-55206][PYTHON][SQL] Transpilation minimal functional implementation with python [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/06/04 16:30:28 UTC, 6 replies.
- Re: [PR] [POC][DONOTMERGE] Explore transpilation yet again spark 14083 but this time with some python too [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/06/04 16:32:23 UTC, 0 replies.
- Re: [PR] [SPARK-56645][CORE] Fix History Server serving stale UI after app completes [spark] - posted by "thejdeep (via GitHub)" <gi...@apache.org> on 2026/06/04 16:46:19 UTC, 2 replies.
- Re: [PR] [SPARK-57176][SQL] Extend nested column pruning through array-returning functions [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/06/04 16:54:52 UTC, 5 replies.
- [PR] [SPARK-56721][INFRA][FOLLOWUP] Fix pyspark-connect-old-client CI failure on fork PRs [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/04 17:42:53 UTC, 3 replies.
- [PR] Update docs/control-flow/leave-stmt.md [spark] - posted by "mingjialiu (via GitHub)" <gi...@apache.org> on 2026/06/04 18:03:00 UTC, 1 replies.
- [PR] [4.1][SPARK-57267][INFRA] Prepare branch-4.1 build workflows for decoupling [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/04 18:14:24 UTC, 0 replies.
- [I] Fix name for frequent items/heavy hitters sketch from highly misleading "approx top k" [spark] - posted by "jmalkin (via GitHub)" <gi...@apache.org> on 2026/06/04 18:33:45 UTC, 1 replies.
- [PR] [SPARK-57225][SS] Enforce read-only access in the state data source read path [spark] - posted by "liviazhu (via GitHub)" <gi...@apache.org> on 2026/06/04 18:45:44 UTC, 0 replies.
- Re: [PR] [SPARK-56971][SS] Add CommitMetadataV3 and SinkMetadataInfo for sink evolution [spark] - posted by "liviazhu (via GitHub)" <gi...@apache.org> on 2026/06/04 19:08:06 UTC, 7 replies.
- [PR] refactor: replace misleading approx_top_k terminology with frequent items naming [spark] - posted by "durgaprasadml (via GitHub)" <gi...@apache.org> on 2026/06/04 20:11:00 UTC, 3 replies.
- [PR] [SPARK-57268][SQL] Add Apache Arrow as a native cache format for in-memory Dataset caching [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/06/04 20:36:46 UTC, 18 replies.
- [PR] [SPARK-57270][INFRA][4.0] Fix `spark-rm` Dockerfile to use Python 3.9 specific get-pip.py [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/04 20:47:33 UTC, 7 replies.
- Re: [PR] [SPARK-53540][INFRA] Remove `pypy3` from `spark-rm` image [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/04 22:02:03 UTC, 0 replies.
- [PR] [SPARK-57271][PYTHON] Add capability to print locals in traceback for Python UDF [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/04 23:10:06 UTC, 2 replies.
- [PR] [SPARK-57272] Upgrade `Netty` to 4.2.15.Final [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/04 23:12:41 UTC, 3 replies.
- Re: [PR] [SPARK-56642][SQL] Add pipelined JVM-Python UDF data transfer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/06/04 23:37:52 UTC, 6 replies.
- Re: [PR] [SPARK-56758][PYTHON] Refactor SQL_MAP_PANDAS_ITER_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/06/05 00:19:09 UTC, 3 replies.
- Re: [PR] [SPARK-55597][INFRA] Add initial issue templates for spark [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/05 01:05:32 UTC, 2 replies.
- Re: [PR] [SPARK-51654][BUILD] Add a dev script to compare SBT and Maven builds [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/05 01:05:37 UTC, 1 replies.
- Re: [PR] [SPARK-53746][PYTHON] Update pyyaml to 6.0.3 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/05 01:05:41 UTC, 1 replies.
- Re: [PR] [SPARK-53745][PYTHON] Update mlflow to 3.1.0 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/05 01:05:46 UTC, 1 replies.
- [PR] [SPARK-57263][SQL] Support Hive 4.2 metastore [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/05 02:58:19 UTC, 5 replies.
- Re: [PR] [SPARK-56664][SS][RTM][StreamingShuffle][Part3] Add StreamingShuffleManager and MultiShuffleManager [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/06/05 03:14:48 UTC, 9 replies.
- Re: [PR] [SPARK-57262][SQL][WEBUI] Job description derived from a query should respect `spark.sql.redaction.string.regex` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/05 03:38:12 UTC, 14 replies.
- [PR] [SPARK-57273][BUILD] Upgrade jackson to 2.21.4 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/05 03:58:39 UTC, 3 replies.
- Re: [PR] [SPARK-56891][CONNECT] Propagate Spark Connect session user as a SparkContext local property [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/05 06:55:44 UTC, 2 replies.
- [PR] Spark 56375 set axis[SPARK-56375][PANDAS/PS] Implement DataFrame.set_axis and Series.set_axis [spark] - posted by "HenryBui777 (via GitHub)" <gi...@apache.org> on 2026/06/05 07:54:59 UTC, 0 replies.
- [PR] [SPARK-55818][PANDAS/PS] Decimal-float mixed arithmetic should always raise TypeError [spark] - posted by "HenryBui777 (via GitHub)" <gi...@apache.org> on 2026/06/05 07:58:14 UTC, 2 replies.
- [PR] [SPARK-57274][CONNECT] Support fetch/type accessors and getMoreResults for SparkConnectStatement [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/06/05 08:35:08 UTC, 13 replies.
- Re: [PR] [SPARK-XXXXX][INFRA] Document canonical and primary component tags in AGENTS.md [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/05 10:02:08 UTC, 0 replies.
- Re: [PR] [INFRA] Install zstd in CI container images to fix Coursier cache [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/05 12:17:46 UTC, 0 replies.
- [PR] [CI] Prefix all CI cache keys with ${{ runner.os }} [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/05 12:18:40 UTC, 0 replies.
- [PR] [SPARK-57275][CONNECT] Validate row count after consuming all arrow batches [spark] - posted by "biruktesf-db (via GitHub)" <gi...@apache.org> on 2026/06/05 12:25:23 UTC, 5 replies.
- Re: [PR] [SPARK-54713][SPARK-55030][SPARK-55031][SQL][FOLLOWUP] Add Scala/Python bindings for vector functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/05 12:31:10 UTC, 0 replies.
- [PR] [SPARK-57279] Add `SECURITY.md` for scan-agent discoverability [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/05 15:42:37 UTC, 4 replies.
- [PR] [SPARK-57280] Add `SECURITY.md` for scan-agent discoverability [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/05 15:52:03 UTC, 3 replies.
- [PR] fix: upgrade com.squareup.okhttp3:okhttp to 4.9.2 (CVE-2021-0341) [spark] - posted by "orbisai0security (via GitHub)" <gi...@apache.org> on 2026/06/05 16:24:26 UTC, 3 replies.
- Re: [PR] [SPARK-37019][SQL] Add codegen support to array higher-order functions [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/06/05 17:17:17 UTC, 5 replies.
- [PR] [SPARK-57176][SQL][4.x] Extend nested column pruning through array-returning functions [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/06/05 17:19:20 UTC, 0 replies.
- [PR] [SPARK-57281][SQL][SS] Remove @Experimental annotation from Real-time mode [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/06/05 17:54:29 UTC, 13 replies.
- Re: [PR] [SPARK-49634][SQL] Remove the ANSI config suggestion in NUMERIC_VALUE_OUT_OF_RANGE.WITH_SUGGESTION [spark] - posted by "alexeyklimov (via GitHub)" <gi...@apache.org> on 2026/06/05 18:24:44 UTC, 0 replies.
- Re: [PR] [SPARK-57269][SS] Enforce read-only access in the StateDateSource/StateMetadataSource [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/06/05 18:58:47 UTC, 3 replies.
- Re: [PR] [SPARK-54027] Kafka Source RTM support [spark] - posted by "Tom-Newton (via GitHub)" <gi...@apache.org> on 2026/06/05 19:11:53 UTC, 0 replies.
- [PR] [SPARK-57283] Upgrade `wildfly-openssl` to 2.3.0.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/05 19:21:12 UTC, 0 replies.
- [PR] [SPARK-57282][SQL] Spread NULL left anti join keys across shuffle partitions [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/06/05 19:25:14 UTC, 4 replies.
- Re: [PR] [SPARK-57283][BUILD] Upgrade `wildfly-openssl` to 2.3.0.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/05 20:04:29 UTC, 4 replies.
- Re: [PR] [SPARK-57194][SQL] Add preOperatorOptimizationRules extension point to Optimizer [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/06/05 20:06:31 UTC, 4 replies.
- Re: [PR] [SPARK-57284][PYTHON][SQL] Add Scala/Python bindings for vector functions [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/05 20:10:21 UTC, 2 replies.
- Re: [PR] [SPARK-54876][SQL] Fix splitSemiColon dropping statement ending with block comment [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/06/05 21:27:39 UTC, 3 replies.
- [PR] [SPARK-57286][BUILD] Add `wildfly-openssl-macosx-aarch64` dependency to support Apple Silicon [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/05 21:47:26 UTC, 5 replies.
- [PR] [SPARK-57287][SQL] Escape backslash in LIKE pattern for STARTS_WITH/ENDS_WITH/CONTAINS pushdown [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/06/05 22:21:16 UTC, 3 replies.
- [PR] [SPARK-57223][SQL] Fix/Quote verbatim column/field names containing dots in table-write error messages [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/06/05 22:51:18 UTC, 0 replies.
- Re: [PR] [SPARK-57223][SQL]Wrong display of column or struct field containing a dot or space in error messages [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/06/05 22:59:12 UTC, 1 replies.
- [PR] [SPARK-57288][SQL][TESTS] Reorganize MERGE INTO schema evolution tests by scenario [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/06/05 23:08:34 UTC, 7 replies.
- [PR] [SPARK-57289] Remove Spark 3.3.x and 3.4.x GPG keys [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/06 00:27:06 UTC, 2 replies.
- Re: [PR] [SPARK-54838][SQL] A new feature to optimize partition size and count [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/06 01:01:32 UTC, 1 replies.
- Re: [PR] skew-detector [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/06 01:01:35 UTC, 1 replies.
- Re: [PR] [SHUFFLE][WIP]Prototype using remote storage for shuffle [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/06 01:01:38 UTC, 1 replies.
- Re: [PR] [SPARK-53744][PYTHON][TESTS] Update `black` python to 24.3.0 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/06 01:01:40 UTC, 1 replies.
- Re: [PR] [SPARK-57247][SQL][CONNECT] Support DataFrame.zip in Spark Connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/06 01:39:52 UTC, 1 replies.
- [PR] [SPARK-57290] Remove Spark 3.3/3.4 logic from `add-dockerfiles.sh` [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/06 02:27:25 UTC, 2 replies.
- Re: [PR] [SPARK-57278][INFRA] Install zstd in CI container images to fix GitHub Actions cache [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/06 02:42:12 UTC, 2 replies.
- [PR] [SPARK-57291] Support Java 25 in `add-dockerfiles.sh` for Spark 4.2+ [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/06 05:19:49 UTC, 3 replies.
- [PR] [SPARK-57292] Add `publish-java25.yaml` to publish Java 25-based docker images [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/06 05:45:01 UTC, 4 replies.
- Re: [PR] [SPARK-57223][SQL] INCOMPATIBLE_DATA_FOR_TABLE errors mis-quote a column/field name that contains a dot [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/06/06 06:35:48 UTC, 4 replies.
- [I] Merge driver and executor into the same JVM. [spark] - posted by "melin (via GitHub)" <gi...@apache.org> on 2026/06/06 12:14:19 UTC, 4 replies.
- Re: [PR] [SPARK-55271][SS] The error originates in KafkaMicroBatchStream.metrics() at line 520, where the code attempts to call .get() on a Scala Option that contains null, then immediately invokes .map() on the null result [spark] - posted by "kiyeonjeon21 (via GitHub)" <gi...@apache.org> on 2026/06/06 12:20:34 UTC, 4 replies.
- [PR] [SPARK-57293][SQL] Cast between nanosecond-precision and microsecond-precision timestamp types [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/06 13:22:42 UTC, 7 replies.
- [PR] [SPARK-57285][SQL] Route nanosecond timestamp cast-to-string through the Types Framework [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/06 16:04:43 UTC, 19 replies.
- [PR] [SPARK-57295][SQL] Make database location validation consistent for w… [spark] - posted by "AnuragKDwivedi (via GitHub)" <gi...@apache.org> on 2026/06/06 16:32:48 UTC, 6 replies.
- Re: [I] PushPredicateThroughNonJoin assertion failure when pushing filter through Project into Union (Hive view) [spark] - posted by "Varunsls (via GitHub)" <gi...@apache.org> on 2026/06/06 17:55:42 UTC, 0 replies.
- Re: [PR] [SPARK-47017][SQL] Show internal SQL plans for RDDScanExec [spark] - posted by "alexandrefimov (via GitHub)" <gi...@apache.org> on 2026/06/06 18:14:46 UTC, 1 replies.
- [PR] [WIP] Fix order by agg with grouping analytics [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2026/06/06 23:14:37 UTC, 0 replies.
- [PR] [SPARK-57297][SQL][TESTS] Add a test that SQL execution description respects `spark.sql.redaction.string.regex` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/07 00:15:36 UTC, 6 replies.
- Re: [PR] [SPARK-55661][CORE] Ensure TaskRunner.run() sends StatusUpdate on setup failures [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/07 01:08:16 UTC, 1 replies.
- Re: [PR] [SPARK-55708][SQL] TransformingEncoder with primitive inside OptionEncoder [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/07 01:08:18 UTC, 1 replies.
- Re: [PR] [SPARK-55589][SQL] TransformingEncoder support from Option to nullable [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/07 01:08:20 UTC, 1 replies.
- Re: [PR] [SPARK-47230][SQL] Improving pruning over explodes [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/07 01:08:23 UTC, 1 replies.
- [PR] [SPARK-57294][PS] Support DataFrame.combine in fallback mode [spark] - posted by "tonghuaroot (via GitHub)" <gi...@apache.org> on 2026/06/07 01:38:15 UTC, 3 replies.
- [PR] [SPARK-57299] Upgrade `Swift System` to 1.6.5 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/07 03:21:31 UTC, 3 replies.
- [PR] [SPARK-57298][SQL] collect_set returns duplicate NaN values for float/double columns [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/06/07 03:34:07 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-57285][SQL] Route nanosecond timestamp cast-to-string through the Types Framework [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/07 07:26:54 UTC, 0 replies.
- [PR] [SPARK-57300] Recommend `apache/*` images [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/07 14:27:52 UTC, 3 replies.
- [PR] [SPARK-57301] Support `create_spark_jira.py` and `create_jira_and_branch.py` [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/07 15:00:27 UTC, 5 replies.
- [PR] [SPARK-57302] Support `withColumn/withColumns` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/07 16:38:36 UTC, 3 replies.
- [PR] [SPARK-57304] Support `na.(fill|drop|replace)` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/07 19:47:56 UTC, 3 replies.
- [PR] [SPARK-57305] Support `stat.(cov|corr)` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/07 20:51:05 UTC, 3 replies.
- [PR] [SPARK-57306] Move DataFrameNaFunctions tests to new `DataFrameNaFunctionsTests` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/07 20:58:03 UTC, 0 replies.
- Re: [PR] [SPARK-57306] Move `DataFrameNaFunctions` tests to new `DataFrameNaFunctionsTests` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/07 21:10:59 UTC, 2 replies.
- [PR] [SPARK-57307] Support `stat.crosstab` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/07 21:26:35 UTC, 4 replies.
- Re: [PR] [SPARK-57141][SS][RTM][StreamingShuffle][Part3] Add StreamingShuffleManager and MultiShuffleManager [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/06/07 22:13:44 UTC, 0 replies.
- [PR] [SPARK-57308] Support `stat.approxQuantile` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/07 22:36:30 UTC, 3 replies.
- [PR] [SPARK-57309] Support `stat.sampleBy` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/07 23:03:55 UTC, 3 replies.
- [PR] [SPARK-57310] Support `stat.freqItems` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/07 23:06:56 UTC, 3 replies.
- [PR] [SPARK-57311] Check the startup logs to make Iceberg integration tests robust [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/08 00:22:32 UTC, 3 replies.
- Re: [PR] [WIP][SPARK-57296][SQL] Fix incorrect aggregate resolution in ORDER BY with GROUPING ANALYTICS [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/06/08 01:46:49 UTC, 1 replies.
- [PR] [SPARK-57312] Use 4.0.3 RC1 for Spark 4.0 integration tests [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/08 03:50:53 UTC, 3 replies.
- [PR] [FEAT] Add SparkSession tag management for Interrupt() [spark-connect-go] - posted by "40u5 (via GitHub)" <gi...@apache.org> on 2026/06/08 03:56:17 UTC, 0 replies.
- [PR] [SPARK-57314][PS][TESTS] Add tests for Index.equals in pandas-on-Spark [spark] - posted by "tonghuaroot (via GitHub)" <gi...@apache.org> on 2026/06/08 06:37:49 UTC, 2 replies.
- [PR] [SPARK-57313][SQL] Fix SampleExec numOutputRows metric when whole-stage codegen is disabled [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/06/08 06:50:15 UTC, 5 replies.
- [PR] [SPARK-57262][SQL][WEBUI][4.1] Job description derived from a query should respect `spark.sql.redaction.string.regex` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/08 07:06:29 UTC, 2 replies.
- [PR] [SPARK-57262][SQL][WEBUI][4.0] Job description derived from a query should respect `spark.sql.redaction.string.regex` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/08 07:09:40 UTC, 5 replies.
- Re: [PR] [SPARK-56773][CORE][TESTS] Add more fetch-failure injection knobs for INJECT_SHUFFLE_FETCH_FAILURES [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2026/06/08 09:13:23 UTC, 7 replies.
- [PR] [SPARK-57315][SQL] Support HOUR, MINUTE and SECOND functions over nanosecond-precision timestamps [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/08 09:17:25 UTC, 15 replies.
- Re: [PR] [SPARK-57277][INFRA] Make CI cache keys OS-specific [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/08 09:17:34 UTC, 1 replies.
- [PR] [DRAFT][SPARK-56661] Addressing review comments from PR #55768 [spark] - posted by "sven-weber-db (via GitHub)" <gi...@apache.org> on 2026/06/08 09:37:15 UTC, 0 replies.
- Re: [PR] [SPARK-56830][INFRA] Share SBT compile artifact with python hosted runner CI jobs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/08 09:44:32 UTC, 1 replies.
- Re: [PR] [SPARK-43877][PYTHON] Fix behavior difference for compare binary functions. [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/08 10:53:10 UTC, 1 replies.
- [PR] [INFRA] Switch shared CI compile artifacts to zstd compression [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/08 12:21:08 UTC, 0 replies.
- [PR] [SPARK-54971][DOCS] Document WITH SCHEMA EVOLUTION syntax for SQL INSERT [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/06/08 13:23:31 UTC, 0 replies.
- Re: [PR] [SPARK-56661] Addressing review comments from PR #55768 [spark] - posted by "asf-gitbox-commits (via GitHub)" <gi...@apache.org> on 2026/06/08 13:59:28 UTC, 0 replies.
- Re: [PR] [SPARK-57212][SQL] Track preparation and AQE rule timing in `QueryPlanningTracker` [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/06/08 15:11:47 UTC, 7 replies.
- [PR] [SPARK-57317][SQL] Fix Literal.create for external nanosecond timestamp values [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/08 15:23:21 UTC, 3 replies.
- [PR] [SPARK-57259][SQL][TESTS] Add nanosecond timestamp types to DataTypeTestUtils type sets [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/08 15:32:42 UTC, 3 replies.
- Re: [PR] [SPARK-57298][SQL] collect_set fails to dedupe float/double NaN/-0.0 by their semantics [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/06/08 16:03:13 UTC, 4 replies.
- [PR] [SPARK-57320][BUILD] Upgrade Netty to 4.2.15.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/08 18:11:29 UTC, 3 replies.
- [PR] [SPARK-XXXXX][SQL] Add listHiddenFiles data source option [spark] - posted by "CalvQ (via GitHub)" <gi...@apache.org> on 2026/06/08 20:19:09 UTC, 0 replies.
- [PR] [SPARK-57323][SQL] Support casting between DATE and nanosecond-precision timestamp types TIMESTAMP_NTZ(p) and TIMESTAMP_LTZ(p) [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/08 21:23:14 UTC, 6 replies.
- [PR] [MINOR][SQL][TESTS] Honor DEFAULT_ARTIFACT_REPOSITORY in IsolatedClientLoaderIvySettingsSuite [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/08 21:36:13 UTC, 0 replies.
- [PR] [WIP] [CONNECT] Stop streaming queries registered while the Connect session is closing [spark] - posted by "dbtsai (via GitHub)" <gi...@apache.org> on 2026/06/08 21:55:54 UTC, 0 replies.
- [PR] [SPARK-56995][SQL][DML][FOLLOWUP] Fix AutoCdcScd1FullRefreshSuite by returning live table from SharedTablesInMemoryRowLevelOperationTableCatalog [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/08 22:56:34 UTC, 2 replies.
- Re: [PR] [SPARK-57326][SQL][TESTS] Honor DEFAULT_ARTIFACT_REPOSITORY in IsolatedClientLoaderIvySettingsSuite [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/08 23:29:47 UTC, 1 replies.
- Re: [PR] [SPARK-57325][CONNECT] Stop streaming queries registered while the Connect session is closing [spark] - posted by "dbtsai (via GitHub)" <gi...@apache.org> on 2026/06/08 23:31:21 UTC, 9 replies.
- Re: [PR] [SPARK-57267][INFRA][4.1] Prepare branch-4.1 build workflows for decoupling [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/08 23:39:34 UTC, 1 replies.
- [PR] [SPARK-57327][INFRA] Move scheduled CIs for 4.1 to branch-4.1 [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/09 00:20:13 UTC, 2 replies.
- [PR] [SPARK-46776][PYTHON][FOLLOWUP] Cast large_string/large_binary to the requested type on pyarrow < 19 [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/06/09 00:25:05 UTC, 6 replies.
- [PR] [SPARK-57328][SQL] Add JoinStrategyHint.isJoinStrategyHintName helper [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/06/09 00:45:42 UTC, 4 replies.
- Re: [I] Add `Information for new contributors` in Issues [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/09 01:00:20 UTC, 0 replies.
- [PR] fix mode() when input contains both -0.0 and 0.0 [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/06/09 01:23:26 UTC, 0 replies.
- Re: [PR] [SPARK-57330][INFRA] Switch shared CI compile artifacts to zstd compression [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/09 01:38:07 UTC, 2 replies.
- [PR] [SPARK-57331][SDP] Support native CDC changelog sources as input to AutoCDC flows [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/06/09 01:49:39 UTC, 2 replies.
- [PR] [SPARK-57332][SQL] Fix MySQL backslash escaping in LIKE predicate pushdown via a dialect string-literal escaping hook [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/09 02:34:36 UTC, 3 replies.
- [PR] [SPARK-57333] Use 4.2.0 RC1 for Spark 4.2 integration tests [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/09 02:43:42 UTC, 5 replies.
- Re: [PR] [SPARK-52719][SQL] Support using scalar UDFs in TVF arguments [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/09 03:50:48 UTC, 1 replies.
- [PR] [SPARK-57334] Upgrade `gRPC Swift NIO Transport` to 2.8.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/09 04:21:59 UTC, 3 replies.
- Re: [PR] [SPARK-57176][SQL][4.X] Extend nested column pruning through array-returning functions [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/06/09 05:04:26 UTC, 1 replies.
- [I] [SPARK-AVRO] Dataproc Serverless runtime 3.0 (Spark 4.0.1): AvroFileFormat V1 shim compiled for Scala 2.12 causes ClassNotFoundException on Scala 2.13 runtime [spark] - posted by "krisztiansala (via GitHub)" <gi...@apache.org> on 2026/06/09 05:43:24 UTC, 4 replies.
- [PR] [SPARK-57148][SQL] Rename splitSemiColonWithIndex to splitSemiColon [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/06/09 06:11:50 UTC, 2 replies.
- [PR] [SPARK-57337][SS][RTM][StreamingShuffle][Part3]Add streaming shuffle shared transport and error plumbing [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/06/09 06:16:47 UTC, 0 replies.
- [PR] [SPARK-57335][SQL] Fix element_at internal error on Int.MinValue index [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/06/09 06:19:31 UTC, 6 replies.
- [PR] [SPARK-57336][CONNECT] Send the bearer token in the standard Authorization header [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/06/09 06:43:16 UTC, 4 replies.
- [PR] [SPARK-57263][SQL] Follow up Hive 4.2 getTablesByName compatibility [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/09 07:07:08 UTC, 0 replies.
- Re: [PR] [SPARK-57316][DOCS] Document WITH SCHEMA EVOLUTION syntax for SQL INSERT [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2026/06/09 07:34:40 UTC, 0 replies.
- [PR] split service vs. message [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2026/06/09 09:18:24 UTC, 0 replies.
- [PR] [SPARK-57338][SQL] Render external values in Row JSON via formatExternal [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/09 09:29:30 UTC, 6 replies.
- [PR] [INFRA] Make pages.yml reuse the documentation image used in build_and_test [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/09 09:51:27 UTC, 0 replies.
- [PR] [PYSPARK][DOC] Fix broken See Also links in pyspark.sql.functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/09 11:09:19 UTC, 0 replies.
- [PR] [CORE] Reuse precomputed indices when an ancestor is already zipWithIndex [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/09 11:19:17 UTC, 4 replies.
- [PR] [MINOR][PYTHON][TEST] Use assertEqual instead of assertTrue in PySpark tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/09 11:27:44 UTC, 2 replies.
- [PR] [SQL] Refactor WorkerSession into a state-machine interface with Ter… [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2026/06/09 11:28:54 UTC, 0 replies.
- [PR] [PYTHON][CONNECT] Add tests for DataFrame.col resolution through DataFrame.zip [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/09 11:28:59 UTC, 1 replies.
- [PR] [INFRA] Reconcile primary JIRA components with the PR title in merge_spark_pr.py [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/09 11:55:12 UTC, 0 replies.
- Re: [PR] [SPARK-55444][SQL] Types Framework - Phase 3a - Storage Formats (Parquet) [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/06/09 12:01:10 UTC, 32 replies.
- [PR] [SPARK-56995][SQL][DML][FOLLOWUP] Fix row-level test catalog truncate snapshots [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/09 12:08:29 UTC, 0 replies.
- [PR] [WIP][PYTHON][TESTS] Use dedicated Pandas 3 golden files for pandas UDF coercion tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/09 12:10:41 UTC, 0 replies.
- [PR] [CORE] Reuse start indices from an ancestor ZippedWithIndexRDD [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/09 12:11:08 UTC, 0 replies.
- Re: [PR] [SPARK-56995][SQL][TESTS][FOLLOWUP] Fix row-level test catalog truncate snapshots [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/09 12:15:01 UTC, 2 replies.
- [PR] [PYSPARK][DOC] Improve See Also cross-references in pyspark.sql.functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/09 12:16:29 UTC, 0 replies.
- [PR] [SPARK-57344][INFRA] Ensure tests for `pipelines` module triggered when sql-related modules are modified [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/09 12:38:10 UTC, 2 replies.
- [PR] [SPARK-57133][PYTHON][FOLLOWUP] Replace sql_keywords doctest show() with columns check [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/09 14:16:32 UTC, 2 replies.
- Re: [PR] [SPARK-56995][SQL][DML][TESTS][FOLLOWUP] Fix AutoCdcScd1FullRefreshSuite by returning live table from SharedTablesInMemoryRowLevelOperationTableCatalog [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/09 14:27:07 UTC, 12 replies.
- [PR] [SPARK-57102][SQL] Support nanosecond-precision timestamps in the Parquet data source [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/06/09 14:37:27 UTC, 27 replies.
- [I] [Quick Question] Duplicate set of user_context in SparkConnect Client [spark] - posted by "franciscoabsampaio (via GitHub)" <gi...@apache.org> on 2026/06/09 14:59:35 UTC, 0 replies.
- Re: [PR] [SPARK-57316][DOCS] Document WITH SCHEMA EVOLUTION and BY NAME for SQL INSERT [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2026/06/09 15:06:50 UTC, 4 replies.
- [PR] [SPARK-57347] Remove `spark.sql.geospatial.enabled=true` from `integration-test-mac-spark42` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/09 15:52:12 UTC, 3 replies.
- Re: [PR] [SQL][SPARK-57318] Refactor WorkerSession into a state-machine interface [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2026/06/09 15:56:47 UTC, 6 replies.
- Re: [PR] [SPARK-57348][PYTHON][CONNECT] Replace sql_keywords doctest show() with columns check [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/09 15:57:05 UTC, 1 replies.
- Re: [PR] [SPARK-54879][CORE] Add final status to Spark History Server for failed executions [spark] - posted by "robreeves (via GitHub)" <gi...@apache.org> on 2026/06/09 16:05:59 UTC, 8 replies.
- Re: [I] Expose `preOptimizerRules` in session extensions API [spark] - posted by "zhztheplayer (via GitHub)" <gi...@apache.org> on 2026/06/09 16:16:29 UTC, 0 replies.
- Re: [PR] [SPARK-55278] Split udf protocol into message and grpc service. [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/09 16:27:49 UTC, 2 replies.
- [PR] [SPARK-57323][SQL] Support casting between DATE and nanosecond-precision timestamps via an analyzer rule [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/09 16:30:10 UTC, 14 replies.
- Re: [PR] [WIP][SPARK-57315][SQL] Support HOUR, MINUTE and SECOND functions over nanosecond-precision timestamps [spark] - posted by "acruise (via GitHub)" <gi...@apache.org> on 2026/06/09 16:39:55 UTC, 1 replies.
- [PR] [SPARK-57212][SQL][FOLLOWUP] Record AQE rule timing into the shared tracker via a lock instead of per-node trackers [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/09 17:06:58 UTC, 3 replies.
- Re: [PR] [SPARK-57321][SQL] Infer CSV schema from tar archives (stacked on #56193) [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/09 18:10:44 UTC, 0 replies.
- [PR] [SPARK-57350] Enable `spark.kubernetes.executor.useDriverPodIP` by default [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/09 18:28:34 UTC, 5 replies.
- [PR] [SPARK-56877][SQL][FOLLOWUP] Make PartitioningCollection invariant check O(1) per nesting level [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/09 18:38:14 UTC, 3 replies.
- [PR] [SPARK-57351] Enable `spark.kubernetes.executor.useDriverPodIP` by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/09 18:45:22 UTC, 1 replies.
- Re: [PR] [SPARK-57349][CONNECT] Split udf protocol into message and grpc service. [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/09 19:00:42 UTC, 0 replies.
- Re: [PR] [SPARK-57348][PYTHON][TESTS] Replace sql_keywords doctest show() with columns check [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/09 19:12:03 UTC, 12 replies.
- [PR] Revert "[SPARK-57133][SQL] Add BIN BY relation operator parsing and resolution" [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/09 19:39:04 UTC, 14 replies.
- Re: [PR] [SPARK-57351][K8S][CORE] Enable `spark.kubernetes.executor.useDriverPodIP` by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/09 20:12:35 UTC, 3 replies.
- [PR] [SPARK-56648][PYTHON][4.X] Refactor SQL_SCALAR_PANDAS_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/06/09 21:08:50 UTC, 0 replies.
- [PR] [SPARK-57355][PYTHON] Fix __module__ check in udf profiler [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/09 21:58:30 UTC, 4 replies.
- Re: [PR] [SPARK-56648][PYTHON][4.x] Refactor SQL_SCALAR_PANDAS_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/06/09 22:48:22 UTC, 1 replies.
- [PR] [SPARK-57353][SQL] Fix single-pass resolver crash on GROUPING SETS with HAVING/ORDER BY [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/06/09 23:37:17 UTC, 4 replies.
- [PR] [SPARK-57357] Remove `web` example [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/10 00:02:18 UTC, 3 replies.
- [PR] [DO-NOT-MERGE][POC] In-browser PySpark shell in PySpark documentation [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/10 00:17:02 UTC, 1 replies.
- [PR] [CONNECT][SDP][SPARK-56249] Create AUTO CDC syntax for SCD Type 1 in SQL [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/06/10 00:23:34 UTC, 24 replies.
- [PR] [SPARK-57359][DOCS] Document the MERGE INTO statement in the SQL reference [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/06/10 00:30:13 UTC, 5 replies.
- [PR] [SPARK-57360][SQL] Block temporary variables in generated column expressions [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/06/10 00:38:40 UTC, 4 replies.
- Re: [PR] [MINOR][PYTHON][DOC] Fix broken See Also links in pyspark.sql.functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/10 01:09:58 UTC, 1 replies.
- [PR] [SPARK-53368][SQL] Supporting Parquet TIME data with isAdjustedToUTC=true [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/06/10 03:40:35 UTC, 13 replies.
- [PR] [SPARK-57363][PS][TESTS] Add tests for Index.identical in pandas-on-Spark [spark] - posted by "tonghuaroot (via GitHub)" <gi...@apache.org> on 2026/06/10 03:48:29 UTC, 0 replies.
- [PR] [SPARK-57362][INFRA] Prevent content from overlapping left navigation [spark] - posted by "llphxd (via GitHub)" <gi...@apache.org> on 2026/06/10 06:47:23 UTC, 5 replies.
- Re: [PR] [MINOR] Fix typo errors in code comments across multiple modules [spark] - posted by "r266-tech (via GitHub)" <gi...@apache.org> on 2026/06/10 07:59:14 UTC, 0 replies.
- [PR] [SPARK-57364][SQL] Fix Oracle TRUNC pushdown to map Spark format stri… [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/06/10 08:12:38 UTC, 0 replies.
- Re: [PR] [SPARK-28239][SHUFFLE] Allow TCP connections created by shuffle service auto close on YARN NodeManagers [spark] - posted by "yikerainbow (via GitHub)" <gi...@apache.org> on 2026/06/10 09:17:14 UTC, 0 replies.
- [PR] [SPARK-57365][SS] Fix flaky KafkaRelationSuite resolved-offset test by using distinct message timestamps [spark] - posted by "kete1987 (via GitHub)" <gi...@apache.org> on 2026/06/10 09:25:35 UTC, 1 replies.
- Re: [PR] [SPARK-51579][SQL] Avoid EOFException in CSV Parsing by Appending Line Terminator [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/10 11:15:31 UTC, 1 replies.
- Re: [PR] [SPARK-54593][SQL] Enable DPP for materialized filtering sides [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/10 11:18:43 UTC, 4 replies.
- Re: [PR] [SPARK-43253][SQL] Assign a name to the error class _LEGACY_ERROR_TEMP_2017 [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/10 11:24:56 UTC, 0 replies.
- Re: [PR] [SPARK-56896][SQL] Add bulk read paths for timestamp/date Parquet vector updaters [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/10 11:26:07 UTC, 8 replies.
- Re: [PR] [SPARK-57367][PYTHON][DOC] Improve See Also cross-references in pyspark.sql.functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/10 11:31:25 UTC, 1 replies.
- Re: [PR] [SPARK-49642][SQL] Remove the ANSI config suggestion in DATETIME_FIEL… [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/10 11:52:20 UTC, 2 replies.
- [PR] [PYTHON][TEST] Fix assertTrue misuse in PySpark tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/10 11:58:11 UTC, 0 replies.
- Re: [PR] [SPARK-57263][SQL][FOLLOWUP] Fix Hive 4.2 getTablesByName compatibility [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/10 13:00:33 UTC, 2 replies.
- Re: [PR] [SPARK-56325][SDP] Refactor FlowSystemMetadata.flowCheckpointsDirOpt to avoid scala.Option [spark] - posted by "jaceklaskowski (via GitHub)" <gi...@apache.org> on 2026/06/10 13:15:05 UTC, 4 replies.
- [PR] [SPARK-57369] [SQL] Move main EXECUTE IMMEDIATE resolution logic to common code [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/06/10 13:36:18 UTC, 7 replies.
- [PR] [SPARK-57370][SQL] Add a JDK (javac) compiler backend for whole-stage codegen [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/10 13:38:46 UTC, 11 replies.
- [PR] [MINOR][SQL] Fix StackOverflowError when setting timestampNanosTypes.enabled via SparkConf [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/06/10 15:34:52 UTC, 2 replies.
- [PR] [SPARK-57373][K8S][DOCS][INFRA] Upgrade Volcano to 1.15.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/10 16:10:31 UTC, 1 replies.
- [PR] [SPARK-57374][BUILD] Upgrade `netty-tcnative` to 2.0.78.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/10 16:32:03 UTC, 6 replies.
- [PR] [CONNECT][SDP][SPARK-57375] Fix flaky AutoCdcScd1SchemaEvolutionSuite [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/06/10 16:57:39 UTC, 2 replies.
- Re: [PR] [SPARK-56896][SQL] Add benchmark coverage for timestamp/date Parquet vector updaters [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/06/10 17:19:25 UTC, 1 replies.
- Re: [PR] [SPARK-57207][SQL][FOLLOWUP] Fix StackOverflowError when setting timestampNanosTypes.enabled via SparkConf [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/06/10 17:26:03 UTC, 2 replies.
- [PR] fix data race in ArrowDeserializers [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2026/06/10 17:52:38 UTC, 0 replies.
- [PR] [SPARK-57322][SDP] Implement SCD2 Batch Processor; Reconcile StartAt/EndAt [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/06/10 18:18:26 UTC, 0 replies.
- Re: [PR] [SPARK-57321][SQL] Infer CSV schema from tar archives [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/10 18:37:55 UTC, 3 replies.
- Re: [PR] [SPARK-57354][SQL] Add listHiddenFiles data source option [spark] - posted by "sandip-db (via GitHub)" <gi...@apache.org> on 2026/06/10 19:42:56 UTC, 21 replies.
- [PR] [SPARK-57377][INFRA] Add CI check to prevent new entries in the config binding policy exceptions file [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/10 19:52:04 UTC, 10 replies.
- [PR] [DO NOT SUBMIT] Prototype to add a versioning header to sketch-based aggregate functions [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/06/10 21:17:19 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-57323][SQL] Support casting between DATE and nanosecond-precision timestamp types TIMESTAMP_NTZ(p) and TIMESTAMP_LTZ(p) [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/10 21:32:11 UTC, 0 replies.
- [PR] [SPARK-57372][SQL] Remove the Types Framework feature flag [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2026/06/10 21:36:31 UTC, 10 replies.
- [PR] [SPARK-57361][PYTHON] Refactor SQL_ARROW_UDTF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/06/10 21:38:33 UTC, 3 replies.
- Re: [PR] [SPARK-57020][PYTHON][TESTS] Add ASV microbenchmark for SQL_TRANSFORM_WITH_STATE_PANDAS_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/06/10 21:40:13 UTC, 4 replies.
- Re: [PR] [SPARK-56757][PYTHON] Refactor SQL_SCALAR_PANDAS_ITER_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/06/10 21:42:16 UTC, 4 replies.
- Re: [PR] [SPARK-57243][SQL] Wrap IsNull and IsNotNull in brackets for V2 SQL builder [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/10 21:49:37 UTC, 5 replies.
- [PR] [SPARK-57332][SQL][FOLLOWUP] Fix line length exceeding 100 characters in JDBCSuite [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/10 23:36:51 UTC, 1 replies.
- [PR] [SPARK-57381][PYTHON] Refactor SQL_WINDOW_AGG_PANDAS_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/06/10 23:56:52 UTC, 2 replies.
- [PR] [SPARK-57382][INFRA] Default merge script JIRA assignee prompt to reporter [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/06/11 00:43:28 UTC, 4 replies.
- Re: [PR] [DOCS] Add welcome section for new contributors in CONTRIBUTING.md [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/11 01:07:32 UTC, 1 replies.
- Re: [PR] [MINOR][DOCS] Add welcome section for new contributors to CONTRIBUTING.md [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/11 01:07:37 UTC, 1 replies.
- Re: [PR] [SPARK-55617] Add VariantGet to V2ExpressionBuilder for DSv2 filter pushdown [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/11 01:07:46 UTC, 5 replies.
- [PR] [SPARK-57383][SQL][PYTHON] Honor configured Arrow zstd compression level when writing Arrow batches [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/06/11 01:54:55 UTC, 2 replies.
- [PR] [SPARK-37856][KUBERNETES] Clean up terminal executor pods on driver restart [spark] - posted by "abtqian (via GitHub)" <gi...@apache.org> on 2026/06/11 02:20:37 UTC, 0 replies.
- Re: [PR] [SPARK-37856][K8S] Clean up terminal executor pods on driver restart [spark] - posted by "abtqian (via GitHub)" <gi...@apache.org> on 2026/06/11 02:25:00 UTC, 6 replies.
- Re: [I] Automatically create the spark history log directory [spark] - posted by "rajendrag (via GitHub)" <gi...@apache.org> on 2026/06/11 03:11:24 UTC, 2 replies.
- Re: [PR] [SPARK-56903][SQL] Spread NULL outer join keys across shuffle partitions [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/06/11 03:33:57 UTC, 1 replies.
- Re: [PR] [SPARK-57364][SQL] Fix Oracle TRUNC pushdown to map Spark format strings to Oracle format [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/06/11 05:05:38 UTC, 8 replies.
- [PR] [MINOR][HOTFIX] Wrap overlong comment line in JDBCSuite to fix scalastyle [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/06/11 06:17:19 UTC, 2 replies.
- [PR] [SPARK-57380][CONNECT] Support complex types (ARRAY, MAP, STRUCT) in ResultSetMetaData and DatabaseMetaData.getColumns [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/06/11 07:27:28 UTC, 4 replies.
- [PR] [SPARK-57385] Publish Apache Spark 4.0.3 to docker registry [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/11 07:29:47 UTC, 3 replies.
- Re: [PR] [SPARK-57332][SQL][FOLLOWUP] Fix line length exceeding 100 characters in JDBCSuite and V2ExpressionSQLBuilder [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/11 07:42:48 UTC, 1 replies.
- [PR] [SPARK-57387][YARN] Make executor JVM options `-XX:OnOutOfMemoryError` configurable on YARN [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/06/11 09:37:32 UTC, 10 replies.
- [PR] [MINOR][SQL] Make TypeOps extend TypeApiOps in the Types Framework [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2026/06/11 10:43:39 UTC, 8 replies.
- [PR] [INFRA] Pin downstream actions/checkout to a single resolved SHA in maven_test.yml and python_hosted_runner_test.yml [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/11 12:45:58 UTC, 0 replies.
- Re: [PR] [Connect][SPARK-57371] Fix data race in ArrowDeserializers [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2026/06/11 12:47:33 UTC, 2 replies.
- Re: [PR] [SPARK-57368][PYTHON][ML][TEST] Fix assertTrue misuse in PySpark tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/11 12:48:38 UTC, 1 replies.
- Re: [PR] [SPARK-53015][BUILD] Upgrade log4j to 2.25.1 [spark] - posted by "ramanathan1504 (via GitHub)" <gi...@apache.org> on 2026/06/11 13:00:34 UTC, 10 replies.
- Re: [PR] [SPARK-57389][PYTHON][TESTS] Use dedicated Pandas 3 golden files for pandas UDF coercion tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/11 13:07:30 UTC, 3 replies.
- [PR] [SPARK-57385][FOLLOWUP] Fix tag path of 4.0.3/scala2.13-java17-r-ubuntu [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/11 14:01:18 UTC, 3 replies.
- [PR] [SPARK-57390] Use `apache/spark:4.0.2-scala` image in `integration-test-ubuntu` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/11 14:14:59 UTC, 3 replies.
- Re: [PR] [SPARK-57296][SPARK-57346][SQL] Fix incorrect aggregate resolution in ORDER BY with GROUPING ANALYTICS [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/11 14:56:56 UTC, 0 replies.
- [PR] [SPARK-57383][SQL][PYTHON][4.1] Honor configured Arrow zstd compression level when writing Arrow batches [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/06/11 16:04:34 UTC, 2 replies.
- Re: [I] Is Spark limited to split the Parquet read granularity by Row Group level only? [spark] - posted by "acruise (via GitHub)" <gi...@apache.org> on 2026/06/11 16:05:01 UTC, 0 replies.
- [PR] [SPARK-57348][PYTHON][TESTS][4.0] Replace sql_keywords doctest show() with columns check [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/11 16:21:51 UTC, 2 replies.
- [PR] [SPARK-57391] Use Apache Spark 4.0.3 instead of 4.0.2 in examples [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/11 16:37:04 UTC, 0 replies.
- [PR] [SPARK-57392] Use Apache Spark 4.0.3 in integration tests [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/11 16:38:49 UTC, 3 replies.
- [PR] [SPARK-57393] Build: PySpark and SparkR source distributions are missing LICENSE and NOTICE files [spark] - posted by "huaxingao (via GitHub)" <gi...@apache.org> on 2026/06/11 16:53:10 UTC, 10 replies.
- Re: [PR] [SPARK-57391] Use Apache Spark 4.0.3 in examples [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/11 16:54:33 UTC, 2 replies.
- Re: [PR] [SPARK-57388][INFRA] Pin actions/checkout to resolved SHA in maven_test.yml and python_hosted_runner_test.yml [spark] - posted by "aarushisingh04 (via GitHub)" <gi...@apache.org> on 2026/06/11 17:00:26 UTC, 1 replies.
- [PR] [SPARK-57339][SQL] Format nanosecond-precision timestamp literals in Literal.toString and Literal.sql [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/06/11 20:20:23 UTC, 16 replies.
- [PR] [SPARK-57356][SDP] Implement SCD2 Batch Processor; Cleanup Delete Encoding Rows Post-Reconciliation [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/06/11 20:27:31 UTC, 0 replies.
- [PR] Spark 57378 scd2 merge reconciled rows [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/06/11 20:36:51 UTC, 0 replies.
- [PR] [SPARK-57394][PYTHON] Refactor SQL_ARROW_TABLE_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/06/11 21:07:24 UTC, 2 replies.
- [PR] [SPARK-56975][SS] Reject user-specified schema in DataStreamReader.table() in Classic and Connect, behind a config [spark] - posted by "PorridgeSwim (via GitHub)" <gi...@apache.org> on 2026/06/11 21:34:04 UTC, 0 replies.
- Re: [PR] [SPARK-56975][SS][FOLLOWUP] Gate user-specified schema rejection in DataStreamReader.table() behind a config [spark] - posted by "PorridgeSwim (via GitHub)" <gi...@apache.org> on 2026/06/11 21:34:11 UTC, 1 replies.
- [PR] [SPARK-57397][PYTHON] Raise an exception when parsed UDT is the wrong type [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/11 21:51:02 UTC, 3 replies.
- Re: [PR] [SPARK-56718][PYTHON] Refactor SQL_COGROUPED_MAP_PANDAS_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/06/11 22:43:41 UTC, 2 replies.
- [PR] [SPARK-57398][INFRA][4.0] Make branch-4.0 scheduled build workflows self-contained [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/11 23:02:50 UTC, 8 replies.
- [PR] [SPARK-56903][SQL][FOLLOWUP] Fix null join key shuffle config version [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/06/11 23:07:52 UTC, 2 replies.
- [PR] [SPARK-57396][PYTHON] Remove unused ArrowStreamArrowUDTFSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/06/11 23:21:37 UTC, 2 replies.
- Re: [PR] [SQL] Update grammar/TableChange to allow CLUSTER BY expressions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/12 00:54:02 UTC, 0 replies.
- [PR] [SPARK-57400][PYTHON] Refactor SQL_TRANSFORM_WITH_STATE_PANDAS_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/06/12 01:17:43 UTC, 6 replies.
- Re: [PR] [SPARK-55617] [SQL] Add VariantGet to V2ExpressionBuilder for DSv2 filter pushdown [spark] - posted by "qlong (via GitHub)" <gi...@apache.org> on 2026/06/12 03:58:49 UTC, 6 replies.
- Re: [PR] [SPARK-55886][PYTHON][TESTS][FOLLOWUP] Add tests for DataFrame.col resolution through DataFrame.zip [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/12 04:23:27 UTC, 3 replies.
- [PR] [SPARK-57412][SQL] Apply default collation to generated column expression references [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/06/12 04:38:06 UTC, 6 replies.
- Re: [PR] [SPARK-34679][SQL][DOCS] Add inferTimestamp option to JSON data source options table [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/12 05:52:16 UTC, 3 replies.
- Re: [PR] [SPARK-57329][SQL] mode() returns incorrect result when input contains both -0.0 and 0.0 [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/06/12 07:33:29 UTC, 3 replies.
- Re: [I] [SPARK-57415][SQL] Parquet vectorized reader performance improvements (umbrella) [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/06/12 07:59:56 UTC, 1 replies.
- [PR] [SPARK-57340][SQL] Support EXTRACT/date_part HOUR, MINUTE and SECOND over nanosecond-precision timestamps [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/06/12 08:50:27 UTC, 5 replies.
- Re: [PR] [SPARK-57388][INFRA] Pin downstream actions/checkout to a single resolved SHA in maven_test.yml and python_hosted_runner_test.yml [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/12 09:01:43 UTC, 2 replies.
- Re: [PR] [SPARK-57341][INFRA] Reconcile JIRA components with the PR title in merge script [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/12 09:06:57 UTC, 5 replies.
- [PR] [INFRA] Add backport confirmation and show push target branch in merge_spark_pr.py [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/12 09:40:39 UTC, 0 replies.
- Re: [PR] [SPARK-56596][SQL] Enable dual runs for single-pass analyzer [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2026/06/12 13:18:54 UTC, 1 replies.
- [PR] [SPARK-57418][DOCS] Add singleVariantColumn option to CSV, JSON, and XML data source options tables [spark] - posted by "brijrajk (via GitHub)" <gi...@apache.org> on 2026/06/12 16:45:18 UTC, 5 replies.
- Re: [PR] [SPARK-56842][SQL] Short-circuit AQE when materialized stages are empty [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/06/12 17:14:30 UTC, 1 replies.
- [PR] [SPARK-57414][PYTHON][TEST] Unify classmethod and eval type conventions across bench_eval_type.py mixins [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/06/12 17:16:15 UTC, 5 replies.
- [PR] [SPARK-57417] Add `variant_delete` expression [spark] - posted by "bojana-db (via GitHub)" <gi...@apache.org> on 2026/06/12 17:29:43 UTC, 8 replies.
- [PR] [SPARK-57379][SQL] Block temporary variables in CHECK constraint expressions [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/06/12 17:57:31 UTC, 11 replies.
- [PR] [SPARK-56367][SS][PYTHON][DOCS] Fix latestOffset docstring, update tutorial signature, and add Trigger.AvailableNow documentation [spark] - posted by "brijrajk (via GitHub)" <gi...@apache.org> on 2026/06/12 18:06:03 UTC, 6 replies.
- [PR] [SPARK-57395][SDP] Implement SCD2 Batch Processor; foreachBatch Callback [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/06/12 18:14:38 UTC, 0 replies.
- [PR] Add example JSON shuffle plugin and tests [spark] - posted by "builderhitesh (via GitHub)" <gi...@apache.org> on 2026/06/12 18:33:34 UTC, 1 replies.
- [PR] [SPARK-57397][PYTHON][3.5] Raise an exception when parsed UDT is the wrong type [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/12 18:34:05 UTC, 2 replies.
- [PR] [SPARK-57328][SQL] Extract coalesce hint-building helpers into CoalesceHintUtils [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/06/12 18:35:10 UTC, 7 replies.
- [PR] [SPARK-57328][SQL] Extract matchedIdentifier into a static, resolver-parameterized helper [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/06/12 18:47:39 UTC, 3 replies.
- [PR] [SPARK-57420][INFRA] Only generate TPC-DS data when required and check CPU compatibility early in benchmark workflow [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/06/12 18:53:30 UTC, 12 replies.
- [PR] [SPARK-57419][SQL] Read and infer JSON schema from tar archives [spark] - posted by "akshatshenoi-db (via GitHub)" <gi...@apache.org> on 2026/06/12 18:58:14 UTC, 7 replies.
- [PR] [WIP][SPARK-57421][SQL][CONNECT] Support @-syntax version and timestamp time travel on table names [spark] - posted by "sotikoug83 (via GitHub)" <gi...@apache.org> on 2026/06/12 20:16:39 UTC, 8 replies.
- [PR] [SPARK-57422][PYTHON] Remove unused CogroupPandasUDFSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/06/12 21:04:41 UTC, 2 replies.
- [PR] [SPARK-57423][PYTHON][TEST] Share base mixin across MapInBatch Arrow/Pandas siblings [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/06/13 00:25:35 UTC, 2 replies.
- Re: [PR] [SPARK-55817][SQL] Enable Parquet row-group skipping for shredded variant [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/13 01:08:57 UTC, 2 replies.
- Re: [PR] [SPARK-55816][SQL] Rename _LEGACY_ERROR_TEMP_3058 to DUPLICATE_PARTITION_TRANSFORM with SQL state 42711 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/13 01:09:02 UTC, 1 replies.
- Re: [PR] [SPARK-55815][SQL] Add proper error class and SQL state for _LEGACY_ERROR_TEMP_1310 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/13 01:09:06 UTC, 1 replies.
- Re: [PR] [SPARK-55814][SQL] Add proper error class and SQL state for defineTempViewWithIfNotExistsError [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/13 01:09:11 UTC, 1 replies.
- Re: [PR] [SPARK-55813][SQL] Rename _LEGACY_ERROR_TEMP_2078 to JDBC_TABLE_AND_QUERY_BOTH_SPECIFIED with SQL state 42000 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/13 01:09:16 UTC, 1 replies.
- Re: [PR] [SPARK-55812][SQL] Consolidate dataSchemaNotSpecifiedError to use UNABLE_TO_INFER_SCHEMA [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/13 01:09:20 UTC, 1 replies.
- [PR] [SPARK-56395][SQL][FOLLOWUP] Fix RewriteNearestByJoin nullability for LEFT OUTER [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/13 15:20:18 UTC, 2 replies.
- [PR] [SPARK-57424][SQL] Add First/Last to segment-tree window aggregate allowlist [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/06/13 17:02:31 UTC, 0 replies.
- [PR] [SPARK-56504][SQL] Extend join pushdown to accept pushed samples [spark] - posted by "XdithyX (via GitHub)" <gi...@apache.org> on 2026/06/13 18:11:32 UTC, 21 replies.
- [PR] [SPARK-57133][SQL] Gate BIN BY behind spark.sql.binBy.enabled [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/06/13 20:46:42 UTC, 2 replies.
- [PR] [SPARK-57426][CORE] Validate length before allocation in `Encoders.Strings.decode` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/13 21:11:29 UTC, 7 replies.
- [PR] [SPARK-57427][CORE] Improve `UTF8String` bounds checks with `Objects.checkIndex` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/13 22:57:03 UTC, 3 replies.
- [PR] [SPARK-57428][CORE] Improve `read` bounds checks with `Objects.checkFromIndexSize` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/13 23:02:18 UTC, 4 replies.
- [PR] [SPARK-57429][SQL] Revise debug message in `ThriftHttpServlet` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/13 23:31:31 UTC, 4 replies.
- [PR] [MINOR][SQL][TESTS] Move JavaGeographyTypeSuite and JavaGeometryTypeSuite to the Java test source root [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/14 00:31:46 UTC, 1 replies.
- Re: [I] Spark Docker Image Release Discrepancy Between apache/spark and Docker Library [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/14 01:10:42 UTC, 0 replies.
- Re: [PR] [SPARK-55742][SQL] Support TransformingEncoder inside RowEncoder [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/14 01:10:44 UTC, 1 replies.
- Re: [PR] [SPARK-54418][SQL][PYSPARK] Support path-like targets in DataFrame.mergeInto [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/14 01:10:49 UTC, 1 replies.
- [PR] [SPARK-57430][CORE] Validate length before allocation in `Encoders.ByteArrays.decode` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/14 01:52:41 UTC, 3 replies.
- [PR] [SPARK-57431] Upgrade `Swift System` to 1.7.2 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/14 03:54:04 UTC, 3 replies.
- [PR] [SPARK-57432] Upgrade `spotbugs-gradle-plugin` to 6.5.6 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/14 03:57:12 UTC, 3 replies.
- [PR] [SPARK-57433] Upgrade `spotbugs-tool` to 4.10.2 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/14 04:01:40 UTC, 3 replies.
- [PR] [SPARK-57435][CORE][SQL][K8S] Avoid fully-qualified `o.a.s.internal.config` reference repetition [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/14 04:41:53 UTC, 2 replies.
- [PR] [SPARK-57425][CONNECT] Fix reattach iterator to recover from expired credentials mid-stream [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/06/14 05:05:33 UTC, 2 replies.
- [PR] [SPARK-57425][CONNECT][PYTHON] Make reattach iterator recover from short-TTL credential expiry [spark] - posted by "dtaniwaki (via GitHub)" <gi...@apache.org> on 2026/06/14 08:20:41 UTC, 8 replies.
- [PR] [SPARK-57436][SQL] Support start and occurrence parameters in instr function [spark] - posted by "loftiest (via GitHub)" <gi...@apache.org> on 2026/06/14 13:10:07 UTC, 33 replies.
- [PR] [SPARK-57437][SQL] Infer additional constraints by substituting attribute-to-literal bindings [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/06/14 13:52:43 UTC, 10 replies.
- Re: [PR] [SPARK-57434][SQL][TESTS] Move JavaGeographyTypeSuite and JavaGeometryTypeSuite to the Java test source root [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/14 14:47:57 UTC, 1 replies.
- [PR] [SPARK-57439][CORE] Validate length before allocation in `Encoders.(Int|Long)Arrays` decode [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/14 16:48:40 UTC, 4 replies.
- Re: [PR] [SPARK-57440][SQL] Gate BIN BY behind spark.sql.binByRelationOperator.enabled [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/06/14 17:46:29 UTC, 4 replies.
- [PR] [SPARK-57441][SQL] Disallow setting JVM system properties in `Spark Thrift Server` sessions [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/14 17:50:36 UTC, 5 replies.
- [PR] [SPARK-57442][SQL] Add opt-in nullability check to logical plan integrity validation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/14 17:53:32 UTC, 3 replies.
- [PR] [SPARK-57443][BUILD] Change version in branch-4.x to 4.3.0 [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/14 18:09:36 UTC, 3 replies.
- [PR] [SPARK-57444][INFRA] Document versioning and branch policy in AGENTS.md [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/14 18:18:46 UTC, 2 replies.
- [PR] [SPARK-57445] Fix PushVariantIntoScan exception semantics. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2026/06/14 18:57:56 UTC, 1 replies.
- [PR] [SPARK-57446][SQL] Apply `escapeSql` to `comment` in JDBC `table/schema` comment queries [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/14 19:35:43 UTC, 5 replies.
- [PR] [SPARK-37019][SQL][FOLLOWUP] Defer ArrayAggregate accumulator widening [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/06/14 20:23:11 UTC, 0 replies.
- [PR] [SPARK-57447] Escape the index name in `(H2|MySQL|Postgres)Dialect.indexExists` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/14 20:56:52 UTC, 0 replies.
- Re: [PR] [SPARK-57447][SQL] Escape the index name in `(H2|MySQL|Postgres)Dialect.indexExists` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/14 21:05:09 UTC, 5 replies.
- [PR] [SPARK-57448][SQL] Support `spark.sql.reflect.allowList` to restrict methods invoked by `reflect/java_method` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/14 22:37:53 UTC, 6 replies.
- [PR] [SPARK-57443][BUILD][FOLLOWUP] Add 4.3 MiMa excludes section to master [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/14 22:39:47 UTC, 0 replies.
- Re: [PR] [SPARK-56740][BUILD][FOLLOWUP] Add 4.3 MiMa excludes section to master [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/14 22:42:20 UTC, 2 replies.
- [PR] [SPARK-57450] Add JWSFilter-enabled Spark Cluster example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/15 01:52:15 UTC, 3 replies.
- Re: [PR] [SPARK-56898] Rewrite COUNT(DISTINCT IF) to COUNT(DISTINCT) FILTER for Expand reduction [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/06/15 02:13:09 UTC, 7 replies.
- [PR] [SPARK-57451][CORE] Remove the check rejecting `spark.authenticate.secret` with Master REST server [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/15 04:58:20 UTC, 4 replies.
- Re: [I] [FEATURE REQUEST] Add ADBC (Arrow Database Connectivity) Data Source [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/15 05:31:07 UTC, 2 replies.
- [PR] [SPARK-57453] Support `spark.master.rest.allowedAppResourcePatterns` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/15 06:27:38 UTC, 0 replies.
- Re: [PR] [SPARK-57453][CORE] Support `spark.master.rest.allowedAppResourcePatterns` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/15 07:18:35 UTC, 2 replies.
- Re: [PR] [SPARK-57380][CONNECT] Support complex types (ARRAY, MAP, STRUCT) in the Connect JDBC driver [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/06/15 08:22:07 UTC, 4 replies.
- [PR] Replace dynamic-config informer with mounted-ConfigMap file watcher [spark-kubernetes-operator] - posted by "csviri (via GitHub)" <gi...@apache.org> on 2026/06/15 08:23:39 UTC, 0 replies.
- [PR] [SPARK-57386][SQL] Render nanosecond timestamp types in HiveResult through the Types Framework [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/15 09:29:21 UTC, 5 replies.
- Re: [PR] [SPARK-55791][PYTHON] Fix pandas-on-Spark equality comparisons under ANSI mode [spark] - posted by "fuxi611 (via GitHub)" <gi...@apache.org> on 2026/06/15 09:31:32 UTC, 4 replies.
- [PR] [SPARK-57164][SQL][TESTS] Add parser test coverage for nanosecond-capable timestamp types across data-type string entry points [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/15 10:06:48 UTC, 3 replies.
- Re: [PR] [SPARK-57466] Replace dynamic-config controller with mounted-ConfigMap file watcher [spark-kubernetes-operator] - posted by "csviri (via GitHub)" <gi...@apache.org> on 2026/06/15 10:24:47 UTC, 5 replies.
- [I] MERGE INTO over Iceberg temp-view source can fail with assertion failed: No plan for TableReference[...] [spark] - posted by "mrjoe7 (via GitHub)" <gi...@apache.org> on 2026/06/15 11:10:44 UTC, 2 replies.
- [PR] [SPARK-57467][SCHEDULER] Reuse identical resource profiles when available [spark] - posted by "psavalle (via GitHub)" <gi...@apache.org> on 2026/06/15 11:57:33 UTC, 8 replies.
- [PR] [SPARK-57470][INFRA][4.x] Update docker action SHAs to match the allowlist on `branch-4.x` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/15 13:56:46 UTC, 2 replies.
- [PR] [SPARK-57469][SQL] Support date field functions on nanosecond-precision timestamps in ANSI mode [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/15 14:04:36 UTC, 2 replies.
- [PR] [SPARK-57463][SQL] Render nanosecond-precision timestamp types in the Thrift server via the Types Framework [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/15 15:37:09 UTC, 3 replies.
- [PR] [WIP][SPARK-57472][SQL] Make FileTable.mergedOptions merge table and relation options case-insensitively [spark] - posted by "matthewbayer (via GitHub)" <gi...@apache.org> on 2026/06/15 16:23:35 UTC, 0 replies.
- [PR] [SPARK-57474][CORE] Validate length before allocation in `Encoders.StringArrays.decode` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/15 17:53:09 UTC, 4 replies.
- Re: [PR] [SPARK-55617][SQL] Add VariantGet to V2ExpressionBuilder for DSv2 filter pushdown [spark] - posted by "qlong (via GitHub)" <gi...@apache.org> on 2026/06/15 18:04:26 UTC, 6 replies.
- [PR] [SPARK-45154][ML]Fixed an issue where CrossValidator yields non-deterministic trees in Spark 3 due to Python's hash randomization on the default seed. Replaced it with a stable zlib.crc32 seed. [spark] - posted by "thangnguyennbk-sys (via GitHub)" <gi...@apache.org> on 2026/06/15 18:49:37 UTC, 3 replies.
- [PR] [SPARK-57475] Validate length before allocation in `Encoders.BitmapArrays.decode` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/15 19:39:30 UTC, 1 replies.
- Re: [PR] [SPARK-56350][SQL] Skip ColumnarToRow for Arrow-backed input to Python UDFs [spark] - posted by "FelixYBW (via GitHub)" <gi...@apache.org> on 2026/06/15 19:55:41 UTC, 0 replies.
- [PR] [SPARK-57477][PYTHON][TESTS] Remove `labels` test for boxplot [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/15 20:55:20 UTC, 4 replies.
- [PR] [SPARK-56724][INFRA][4.1] Make docker/* GitHub Actions up-to-date [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/15 20:55:59 UTC, 3 replies.
- Re: [PR] [SPARK-56724][INFRA][4.x] Make docker/* GitHub Actions up-to-date [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/15 20:58:02 UTC, 9 replies.
- Re: [PR] [SPARK-57444][INFRA] Document versioning and branch policy in AGENTS.md and add dev/next_version_candidates.py [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/15 21:04:47 UTC, 1 replies.
- Re: [PR] [SPARK-57475][CORE] Validate length before allocation in `Encoders.BitmapArrays.decode` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/15 21:05:04 UTC, 6 replies.
- [PR] [SPARK-57438][SS] Fix NullPointerException in Kafka source metrics when latest partition offsets are unavailable [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/06/15 21:15:35 UTC, 13 replies.
- [PR] [SPARK-57478][SQL] Read text files from tar archives [spark] - posted by "akshatshenoi-db (via GitHub)" <gi...@apache.org> on 2026/06/15 21:32:20 UTC, 4 replies.
- [PR] [SPARK-57480][SQL] Stash allowSettingSystemProperties on a static field to prevent set:hiveconf bypass [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/06/15 21:45:07 UTC, 9 replies.
- [PR] [SPARK-57482][CORE][TESTS] Fix flaky SparkLauncherSuite.testInProcessLauncher under CI load [spark] - posted by "dbtsai (via GitHub)" <gi...@apache.org> on 2026/06/15 21:54:53 UTC, 1 replies.
- [PR] [SPARK-57483][INFRA] Move scheduled CIs for 4.0 to branch-4.0 [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/15 22:17:11 UTC, 3 replies.
- [PR] [SPARK-56724][INFRA][4.0] Make docker/* GitHub Actions up-to-date [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/15 23:47:09 UTC, 2 replies.
- [PR] [SPARK-56724][INFRA][3.5] Make docker/* GitHub Actions up-to-date [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/15 23:51:08 UTC, 2 replies.
- [PR] [SPARK-42751][PS] Support str.findall with capture groups [spark] - posted by "nguyen1hc (via GitHub)" <gi...@apache.org> on 2026/06/16 00:47:29 UTC, 7 replies.
- Re: [I] Fix various typo errors in code comments across multiple modules [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/16 01:15:39 UTC, 0 replies.
- Re: [PR] [SPARK-48942][SQL][TESTS] Add regression tests for Array of Structs with UDT fields in Parquet [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/16 01:15:41 UTC, 1 replies.
- [PR] [SPARK-55707][SQL][TESTS] Re-enable DB2 JDBC tests by shading the driver's bundled lz4-java [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/16 02:28:44 UTC, 2 replies.
- [PR] [SPARK-54593][SQL] Fix DPP eligibility for materialized filtering sides [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/06/16 03:07:13 UTC, 4 replies.
- Re: [PR] [SPARK-55707][SQL][TESTS] Re-enable DB2 JDBC tests by upgrading jcc to 12.1.4.0 [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/16 03:31:25 UTC, 5 replies.
- Re: [PR] [SPARK-57480][SQL] Stash allowSettingSystemProperties on a static field to prevent `set:hiveconf` bypass [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/16 04:17:47 UTC, 0 replies.
- [PR] [SPARK-57484][SQL] Preserve row nullability after ColumnarToRowExec [spark] - posted by "ZitingShen (via GitHub)" <gi...@apache.org> on 2026/06/16 04:30:28 UTC, 3 replies.
- [PR] [SPARK-55617][SQL][FOLLOWUP] Correct VariantGet @since to 4.3.0 and expand its class doc [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/06/16 05:08:00 UTC, 1 replies.
- [PR] [SPARK-57485][BUILD] Exclude package-private Scala types from the generated Javadoc [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/16 05:48:26 UTC, 2 replies.
- [I] exitStatusCode:0 The return code of spark-submit is 0 [spark] - posted by "matianhe3 (via GitHub)" <gi...@apache.org> on 2026/06/16 06:07:44 UTC, 3 replies.
- [PR] [SPARK-57486][SQL] Reuse AnyTimestampNanoType for nanosecond-precision timestamp type checks [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/16 07:39:10 UTC, 6 replies.
- [PR] [SPARK-53209][YARN][FOLLOWUP] Move `spark.yarn.am.limitActiveProcessorCount.enabled` to yarn module [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/06/16 08:50:14 UTC, 7 replies.
- [PR] [SPARK-57487][SQL] Support distributed map join for medium-sized tables via SQL hint [spark] - posted by "yugan95 (via GitHub)" <gi...@apache.org> on 2026/06/16 09:06:33 UTC, 5 replies.
- [PR] [SPARK-57490][SQL] Support CAST between nanosecond timestamp types of different precision [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/16 11:11:53 UTC, 2 replies.
- [PR] [SPARK-57476][SQL] Support BIN BY in the single-pass analyzer [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/06/16 12:38:23 UTC, 0 replies.
- [PR] [SPARK-57489][SS] Deterministic dropDuplicates key resolution via shared analyzer rule [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/06/16 13:12:07 UTC, 8 replies.
- Re: [PR] [SPARK-57466] Add option for dynamic-config to use mounted-ConfigMap [spark-kubernetes-operator] - posted by "csviri (via GitHub)" <gi...@apache.org> on 2026/06/16 13:37:00 UTC, 14 replies.
- [PR] [SPARK-57492] Use K8s Garbage Collection to delete executors only when restart is disabled [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/16 15:20:23 UTC, 3 replies.
- Re: [PR] [SPARK-54918][SQL] Clean up text of `NormalizeFloatingNumbers` docstring [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2026/06/16 15:58:25 UTC, 4 replies.
- [PR] [SPARK-47670][SQL] Share repeated top-level JSON path parsing [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/06/16 16:18:42 UTC, 19 replies.
- Re: [PR] [SPARK-55617][SQL][FOLLOWUP] Correct VariantGet `@since` to 4.3.0 and expand its class doc [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/16 18:23:00 UTC, 3 replies.
- Re: [PR] [SPARK-56599][SQL] Add scan narrowing for column-level UPDATEs in DSv2 [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/06/16 20:08:07 UTC, 9 replies.
- [PR] [SPARK-57493][K8S] Set `allowPrivilegeEscalation` to false for driver/executor pods by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/16 20:18:34 UTC, 1 replies.
- [PR] [SPARK-57471][SQL] Populate input/output size metrics for JDBC reads and writes [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/06/16 20:49:27 UTC, 14 replies.
- [PR] [SPARK-57494] Add `Pod Security Admission` section to `SECURITY.md` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/16 21:25:55 UTC, 4 replies.
- [PR] [SPARK-57495] Default `driver/master/worker` container `allowPrivilegeEscalation` to false if unset [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/16 21:59:43 UTC, 3 replies.
- Re: [PR] [SPARK-57493][K8S] Set `allowPrivilegeEscalation` to false for driver/executor containers by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/16 22:05:26 UTC, 5 replies.
- [PR] [SPARK-57496][SQL][BUILD] Keep the Types Framework ops and UDF worker packages out of the published API [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/16 22:37:35 UTC, 6 replies.
- [PR] [SPARK-57497] Fix NPE in AppInitStep restart backoff check when stateTransitionHistory is null [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2026/06/16 23:18:01 UTC, 6 replies.
- [PR] [SPARK-57498][SQL] Strengthen cookie-signing secret in ThriftHttpServlet [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/17 00:05:35 UTC, 5 replies.
- [PR] [SPARK-57452][DOCS] Add missing 4.2 behavior changes to migration guides [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/17 00:12:39 UTC, 5 replies.
- [PR] Bump js-yaml and eslint in /dev [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/06/17 00:21:55 UTC, 2 replies.
- [PR] [SPARK-56724][INFRA][4.2] Make docker/* GitHub Actions up-to-date [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/17 03:47:31 UTC, 5 replies.
- [PR] [SPARK-57499][SQL] Variant extraction pushdown bypasses column pruning on DSvs scans [spark] - posted by "qlong (via GitHub)" <gi...@apache.org> on 2026/06/17 05:16:51 UTC, 0 replies.
- Re: [PR] [SPARK-54656][SQL] Refactor SupportsPushDownVariants to be a ScanBuilder mix-in [spark] - posted by "qlong (via GitHub)" <gi...@apache.org> on 2026/06/17 05:30:08 UTC, 0 replies.
- Re: [PR] [SPARK-57445][SQL] Fix PushVariantIntoScan exception semantics. [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/06/17 05:57:49 UTC, 11 replies.
- [PR] [SPARK-57455][SQL] Support nanosecond timestamp types in ORC [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/17 06:29:56 UTC, 15 replies.
- [PR] [SPARK-57500][SQL] Escape backslash in MySQL JDBC pushdown for string literals in comparison/IN predicates [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/06/17 06:36:31 UTC, 0 replies.
- [PR] [SPARK-57491][CORE] Prevent and detect stale push-based shuffle data from duplicate map task attempts [spark] - posted by "gaoyajun02 (via GitHub)" <gi...@apache.org> on 2026/06/17 07:07:55 UTC, 13 replies.
- [PR] [SPARK-57502][TESTS] Fix npm vulnerabilities in ui-test and dev [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/17 08:34:02 UTC, 3 replies.
- [PR] [SPARK-57503][CORE] Simplify removePendingChunks to avoid redundant re-iteration in ShuffleBlockFetcherIterator [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/17 08:34:18 UTC, 1 replies.
- [PR] [SPARK-57501][SQL] Add +/- ANSI day-time interval support for TIMESTAMP_NTZ/LTZ(p) [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/17 08:37:21 UTC, 6 replies.
- [PR] [SPARK-53209][YARN][FOLLOWUP][4.2] Move `spark.yarn.am.limitActiveProcessorCount.enabled` to yarn module [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/06/17 08:53:49 UTC, 2 replies.
- [PR] [SPARK-57504][CORE] Avoid a potential NullPointerException in IndexShuffleBlockResolver.getChecksums when the checksum file cannot be opened [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/17 09:52:26 UTC, 1 replies.
- Re: [PR] [SPARK-36458][ML] Allow approxSimilarityJoin and approxNearestNeighbors to work without inputCol [spark] - posted by "Phucvt123 (via GitHub)" <gi...@apache.org> on 2026/06/17 12:58:05 UTC, 0 replies.
- [PR] Fix: enable spark archive reader config [spark] - posted by "palakkhinvasara (via GitHub)" <gi...@apache.org> on 2026/06/17 13:49:35 UTC, 2 replies.
- [PR] [SPARK-57372][SQL][FOLLOWUP] Remove dead TimeType code paths after Types Framework flag removal [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2026/06/17 13:56:06 UTC, 2 replies.
- [PR] [SPARK-57506][SQL] Fix RTRIM-collation trimRight dropping trailing spaces for strings with supplementary characters [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/17 14:01:02 UTC, 6 replies.
- [PR] [MINOR][INFRA] Mention SBT profile activation in AGENTS.md [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/06/17 14:29:28 UTC, 8 replies.
- [PR] [SPARK-57507][SQL] Fix UTF8String.reverse reading past the end of a truncated trailing UTF-8 sequence [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/17 14:55:00 UTC, 0 replies.
- [PR] [SPARK-57505][SQL] Do not wrap window functions in an `AggregateExpression` when converting an expression-backed `Column` [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/06/17 15:27:32 UTC, 3 replies.
- Re: [PR] [SPARK-53848][SQL] Add ability to support Alpha family in Theta Aggregates [spark] - posted by "karuppayya (via GitHub)" <gi...@apache.org> on 2026/06/17 17:09:39 UTC, 0 replies.
- [PR] [SPARK-57508] Upgrade `java-operator-sdk` to 5.3.5 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/17 17:36:55 UTC, 3 replies.
- Re: [PR] [SPARK-44790][SQL] XML: to_xml implementation and bindings for python, connect and SQL [spark] - posted by "vjanelle (via GitHub)" <gi...@apache.org> on 2026/06/17 17:45:47 UTC, 0 replies.
- Re: [PR] [SPARK-57496][SQL][BUILD][4.2] Keep the Types Framework ops and UDF worker packages out of the published API [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/17 18:19:28 UTC, 2 replies.
- [PR] [SPARK-57479][SQL] Read and infer XML schema from tar archives [spark] - posted by "akshatshenoi-db (via GitHub)" <gi...@apache.org> on 2026/06/17 18:37:21 UTC, 7 replies.
- [PR] [SPARK-57509][CORE] Return 403 instead of 405 for disallowed `/workers/kill` requests [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/17 19:29:10 UTC, 0 replies.
- [PR] [SPARK-57510][CORE] Enforce the modify ACL on the `/workers/kill` endpoint in MasterWebUI [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/17 20:05:04 UTC, 5 replies.
- Re: [PR] [SPARK-57509][CORE] Return `FORBIDDEN` instead of `METHOD_NOT_ALLOWED` for disallowed `/workers/kill` requests [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/17 20:05:26 UTC, 3 replies.
- Re: [PR] [SPARK-48486][SQL] To solve the issue of generating excessively large execution plans when encountering multiple levels of subqueries while enabling DynamicPartitionPruning. [spark] - posted by "nikhil-zlai (via GitHub)" <gi...@apache.org> on 2026/06/17 20:46:26 UTC, 0 replies.
- [PR] [WIP][SPARK-57512][SQL] Allow evaluable RuntimeReplaceable to survive into the physical plan [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/17 21:04:36 UTC, 0 replies.
- [PR] [SPARK-57513][INFRA] Remove `Hadoop 3` from GitHub Action workflow names [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/17 21:25:49 UTC, 5 replies.
- [PR] [SPARK-57511][SQL] Support explicit CAST between TIMESTAMP_LTZ(p) and TIMESTAMP_NTZ(q) for p, q in [6, 9] [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/17 21:30:27 UTC, 9 replies.
- Re: [PR] [SPARK-57507][SQL] Fix `UTF8String.reverse` reading past the end of a truncated trailing UTF-8 sequence [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/17 21:37:24 UTC, 7 replies.
- [PR] [SPARK-57352][SDP] Detect resolved table references in pipeline flow lineage [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/06/17 21:56:16 UTC, 5 replies.
- [PR] [SPARK-57514][INFRA] Remove `Java 17` Maven build test from `build_and_test.yml` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/17 22:06:26 UTC, 4 replies.
- [PR] [SPARK-57516][DOCS] Update Data Source V2 docs for ViewCatalog and TableViewCatalog [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/06/17 22:52:18 UTC, 3 replies.
- [PR] [SPARK-57515][SQL] Surface MALFORMED_CSV_RECORD instead of ArrayIndexOutOfBoundsException when CSV header exceeds maxColumns [spark] - posted by "jubins (via GitHub)" <gi...@apache.org> on 2026/06/17 22:58:45 UTC, 12 replies.
- Re: [PR] [SPARK-57499][SQL] Variant extraction pushdown bypasses column pruning on DSvs2 scans [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/17 23:02:56 UTC, 1 replies.
- [PR] [SPARK-57517][SQL] Fix schema_of_json to return proper error on non-string literal input [spark] - posted by "jubins (via GitHub)" <gi...@apache.org> on 2026/06/18 00:03:02 UTC, 6 replies.
- Re: [PR] [SPARK-57150][SDP] SCD1 Out-of-order Convergence Suite [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/06/18 00:24:16 UTC, 1 replies.
- Re: [PR] [SPARK-55523][SQL] Fix inputMetrics.recordsRead to report rows instead of CachedBatches [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/18 01:09:47 UTC, 1 replies.
- Re: [I] Rename TABLESAMPLE-related legacy error conditions to descriptive names [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/18 01:09:49 UTC, 0 replies.
- Re: [PR] [SPARK-57342][CORE] Reuse start indices from an ancestor ZippedWithIndexRDD [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2026/06/18 03:01:08 UTC, 4 replies.
- [PR] [SPARK-57519][CORE] Fix NoSuchElementException in ErrorClassesJsonReader.isValidErrorClass for error classes without sub-classes [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/18 03:02:21 UTC, 3 replies.
- [PR] [SPARK-57521][ML][CONNECT] Exclude parent from Model.estimatedSize to fix overcounting in ML cache [spark] - posted by "mkincaid (via GitHub)" <gi...@apache.org> on 2026/06/18 04:09:08 UTC, 8 replies.
- [PR] [SPARK-57522] Update `Spark Connect`-generated `Swift` source code with `4.2.0-rc3` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/18 04:43:20 UTC, 3 replies.
- Re: [PR] [SPARK-56249][SDP] Implement SCD1 Batch Processor; Merge Tombstones onto Microbatch [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/18 04:51:03 UTC, 1 replies.
- [PR] [SPARK-57520][SQL] Fix UTF8String.codePointFrom and copyUTF8String reading past the end of a truncated trailing UTF-8 sequence [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/18 05:29:33 UTC, 4 replies.
- Re: [PR] [SPARK-57504][CORE] Avoid a potential NPE in `IndexShuffleBlockResolver.getChecksums` when the checksum file cannot be opened [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/18 06:25:07 UTC, 4 replies.
- [PR] [CONNECT] Use Authorization header for JVM client token auth [spark] - posted by "drewrukin (via GitHub)" <gi...@apache.org> on 2026/06/18 06:59:39 UTC, 3 replies.
- [PR] [SPARK-57524][SQL] Correct SHOW TABLE EXTENDED property formatting [spark] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2026/06/18 07:10:13 UTC, 9 replies.
- [PR] [SPARK-57523][SQL] Declarative Pipelines should not retry flows that fail due to streaming source changes [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/18 07:48:56 UTC, 2 replies.
- [PR] [SPARK-57529][SQL] Fix possible ORC reader leak in OrcPartitionReaderFactory [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2026/06/18 09:05:28 UTC, 2 replies.
- [PR] [SPARK-57530][CORE] Make SparkFileUtils.recursiveList null-safe and linear-time [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/18 09:40:27 UTC, 9 replies.
- [PR] [SPARK-57531][SQL] Reuse OrcTail in non-vectorized ORC reader path [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2026/06/18 10:14:15 UTC, 3 replies.
- [PR] [SPARK-57502][SQL][TESTS] Add test coverage for MIN/MAX over nanosecond-precision timestamp types [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/06/18 10:53:45 UTC, 5 replies.
- [PR] [SPARK-57528][SQL] Support nanosecond-precision timestamps in the unix_timestamp function [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/18 10:59:39 UTC, 1 replies.
- [PR] [SPARK-57525][CONNECT] Declarative Pipelines should not throw NoSuchElementException when a run fails without an attached cause [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/18 12:05:25 UTC, 8 replies.
- Re: [PR] [SPARK-57528][SQL] Support nanosecond-precision timestamps in the `unix_timestamp` function [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/06/18 12:38:33 UTC, 4 replies.
- Re: [PR] [SPARK-56818][DOCS] Fix Binder build by pinning Debian Bookworm base … [spark] - posted by "stan-buren (via GitHub)" <gi...@apache.org> on 2026/06/18 14:31:10 UTC, 0 replies.
- [PR] [SPARK-56887][SQL][FOLLOWUP] Add spill support and extend ShuffledJoin in SortMergeAsOfJoinExec [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/18 15:13:43 UTC, 8 replies.
- [PR] [SPARK-57533] Move `merge_spark_docker_pr.py` to `dev` directory [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/18 16:38:53 UTC, 3 replies.
- Re: [PR] [SPARK-56237] Fix links in `awesome-spark-docker.md` [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/18 16:44:24 UTC, 0 replies.
- [PR] [SPARK-57534] Add `Apache Spark K8s Operator` to awesome-spark-docker.md [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/18 16:49:33 UTC, 3 replies.
- [PR] [SPARK-57535] Add `*.pyc` and `*.pyo` to `.gitignore` [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/18 17:06:48 UTC, 3 replies.
- [PR] [SPARK-57536][SS] Use maxOption instead of sorted.lastOption in HDFSMetadataLog [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/18 17:30:07 UTC, 0 replies.
- [PR] [SPARK-56743][SPARK-56773][SQL][CORE][TESTS] Exercise writer-stage retries in DSv2 DML metric tests and fix injection-state cleanup under AQE [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2026/06/18 17:30:58 UTC, 9 replies.
- Re: [PR] [SPARK-57103][FOLLOWUP][SQL][TESTS] Add test coverage for MIN/MAX over nanosecond-precision timestamp types [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/06/18 17:44:38 UTC, 3 replies.
- [PR] [SPARK-57537][SS] Add metrics support for deleteRange operation in RocksDB [spark] - posted by "trisjain-db (via GitHub)" <gi...@apache.org> on 2026/06/18 18:28:42 UTC, 6 replies.
- [PR] [SPARK-57538][YARN] Revise a warning message in `YarnShuffleService` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/18 19:14:19 UTC, 5 replies.
- Re: [PR] [SPARK-57536][SS] Use `maxOption` instead of `sorted.lastOption` in `HDFSMetadataLog` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/18 20:02:16 UTC, 1 replies.
- [PR] [SPARK-57540][SQL] Instantiate Woodstox `WstxOutputFactory` directly in `StaxXmlGenerator` [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/18 20:10:07 UTC, 5 replies.
- [PR] [SPARK-57541] Use 4.2.0 RC3 for Spark 4.2 integration tests [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/18 20:56:17 UTC, 4 replies.
- Re: [PR] [SPARK-57354][SQL] Add ignoredPathSegmentRegex data source option and config [spark] - posted by "brkyvz (via GitHub)" <gi...@apache.org> on 2026/06/18 21:14:55 UTC, 4 replies.
- [PR] [SPARK-57542] Support `nearestByJoin` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/18 21:39:46 UTC, 3 replies.
- [PR] [SPARK-57021][CONNECT][PYTHON][TESTS][FOLLOWUP] Use sql.SQLContext explicitly for classic SQLContext tests [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/18 21:41:15 UTC, 3 replies.
- [PR] [SPARK-57527][SQL] Add the `unix_nanos` function returning nanoseconds since the epoch for timestamps [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/18 21:47:35 UTC, 7 replies.
- [PR] [SPARK-54593][SQL][FOLLOWUP] Only inject DPP for a materialized filtering side when it can reuse a broadcast [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/18 22:07:28 UTC, 9 replies.
- [PR] [SPARK-57543] Make ConfigOption dynamic override opt-in and filter dynamic config refresh [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2026/06/18 22:20:07 UTC, 2 replies.
- Re: [PR] [SPARK-56555][K8S] Add ubuntu mirror repositories to K8s Dockerfile for redundancy [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/18 23:44:27 UTC, 5 replies.
- [PR] [SPARK-56032][SQL][FOLLOWUP] Skip FilterExec CSE codegen when the only common subexpression is a leaf [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/19 00:09:13 UTC, 4 replies.
- [PR] [SPARK-57545][K8S] Make `docker-image-tool.sh` and K8s IT readme up-to-date [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/19 00:11:00 UTC, 7 replies.
- [PR] [SPARK-52729][SQL][FOLLOWUP] Introduce RelationInfo as a common base for TableInfo and ViewInfo [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/19 00:30:16 UTC, 3 replies.
- [PR] [SPARK-57546][K8S] Use `eclipse-temurin` to use `Ubuntu 26.04` and `Python 3.14` by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/19 00:53:47 UTC, 4 replies.
- [PR] [SPARK-56573][SQL] Widen the default tablesample seed to reduce collisions [spark] - posted by "wilmerdooley (via GitHub)" <gi...@apache.org> on 2026/06/19 01:28:35 UTC, 0 replies.
- [PR] [MINOR][DOCS] Fix typo in protobuf guide [spark] - posted by "AgenticSpark (via GitHub)" <gi...@apache.org> on 2026/06/19 03:11:39 UTC, 2 replies.
- Re: [PR] [SPARK-56227][CORE] Fix GcmTransportCipher to correctly handle multiple messages per channel [spark] - posted by "aajisaka (via GitHub)" <gi...@apache.org> on 2026/06/19 05:42:00 UTC, 5 replies.
- [PR] [SPARK-57416][SQL] Align the Types Framework Parquet read guard for TimeType with the legacy reader [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/06/19 10:00:52 UTC, 3 replies.
- Re: [PR] [SPARK-56505][SQL][TESTS] Add SessionQueryTest to replace SharedSparkSession [spark] - posted by "ionagamed (via GitHub)" <gi...@apache.org> on 2026/06/19 12:02:11 UTC, 45 replies.
- [PR] [SPARK-57576] [SQL] Fix SET_OPERATION_ON_MAP_TYPE and SET_OPERATION_ON_VARIANT_TYPE exception messages [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/06/19 14:38:18 UTC, 0 replies.
- [PR] [SPARK-57103][SQL][TEST][FOLLOWUP] Add test coverage for max_by/min_by over nanosecond-precision timestamp types [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/06/19 14:41:55 UTC, 5 replies.
- [PR] [SPARK-54203][SQL] Support TimeType in RowToColumnConverter [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/19 15:07:04 UTC, 2 replies.
- [PR] SPARK-57576: [SQL] Generalize error messages for set operations on MAP and VARIANT types [spark] - posted by "KenanAdel (via GitHub)" <gi...@apache.org> on 2026/06/19 15:23:07 UTC, 0 replies.
- Re: [PR] [SPARK-57576][SQL] Generalize error messages for set operations on MAP and VARIANT types [spark] - posted by "KenanAdel (via GitHub)" <gi...@apache.org> on 2026/06/19 15:46:21 UTC, 1 replies.
- [I] [SQL] Ceiling and floor do not throw on overflow [spark] - posted by "matthewalex4 (via GitHub)" <gi...@apache.org> on 2026/06/19 15:55:45 UTC, 0 replies.
- [PR] [SPARK-57526][SQL] Add the `timestamp_nanos` function to create nanosecond-precision timestamps from numeric nanoseconds [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/19 15:56:40 UTC, 8 replies.
- Re: [PR] [SPARK-57365][SS][TEST-ONLY] Fix flaky KafkaRelationSuite resolved-offset test by using distinct message timestamps [spark] - posted by "kete1987 (via GitHub)" <gi...@apache.org> on 2026/06/19 16:32:22 UTC, 0 replies.
- Re: [PR] [SPARK-37019][SQL][FOLLOWUP] Resolve nested higher-order function arguments first [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/06/19 16:48:09 UTC, 3 replies.
- [PR] Extend SupportsCatalogOptions to allow migration from DSv1 file based data source [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2026/06/19 17:13:08 UTC, 0 replies.
- [PR] [MINOR][PYTHON] Fix try_to_date docstring typo [spark] - posted by "mh0w (via GitHub)" <gi...@apache.org> on 2026/06/19 17:25:28 UTC, 3 replies.
- Re: [PR] [SPARK-57365][SS][TESTS] Fix flaky KafkaRelationSuite resolved-offset test by using distinct message timestamps [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/19 17:37:44 UTC, 5 replies.
- [PR] [SPARK-57544][SQL] Rework column ID validation for nested fields in DSv2 [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/06/19 18:40:23 UTC, 49 replies.
- Re: [PR] [SPARK-57337][SS][RTM][StreamingShuffle][Part3.5]Add streaming shuffle shared transport and error plumbing [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/06/19 18:54:09 UTC, 10 replies.
- [PR] [SPARK-57547][SQL] Fix incorrect InMemoryRelation materialization under conrrent queries [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2026/06/19 19:45:10 UTC, 8 replies.
- [PR] [SPARK-52163][SQL] Cap estimated size in bytes at Long.MaxValue in SizeInBytesOnlyStatsPlanVisitor [spark] - posted by "wilmerdooley (via GitHub)" <gi...@apache.org> on 2026/06/19 20:30:52 UTC, 6 replies.
- Re: [PR] [SPARK-53418][SQL] Support `TimeType` in `ColumnAccessor` [spark] - posted by "wilmerdooley (via GitHub)" <gi...@apache.org> on 2026/06/19 20:30:55 UTC, 0 replies.
- [PR] [SPARK-57551][SQL] Extend the TIME data type precision to nanoseconds (up to 9) [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/19 21:49:29 UTC, 14 replies.
- [PR] [SPARK-53478] Resolve SparkFiles.get against root directory when job artifact UUID is set in local mode [spark] - posted by "wilmerdooley (via GitHub)" <gi...@apache.org> on 2026/06/19 21:57:39 UTC, 0 replies.
- Re: [PR] [SPARK-46166][PS] Implementation of pandas.DataFrame.any with axis=None [spark] - posted by "wilmerdooley (via GitHub)" <gi...@apache.org> on 2026/06/19 21:57:41 UTC, 0 replies.
- [PR] [Spark-55299][PYTHON] Infer the correct unit for calculated timedeltas [spark] - posted by "fangchenli (via GitHub)" <gi...@apache.org> on 2026/06/19 22:25:11 UTC, 0 replies.
- Re: [PR] [SPARK-55299][PYTHON] Infer the correct unit for calculated timedeltas [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/06/20 00:02:37 UTC, 0 replies.
- Re: [PR] [SPARK-55299][PS] Infer the correct unit for calculated timedeltas [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/06/20 00:07:24 UTC, 2 replies.
- [PR] [SPARK-57578][SQL] Fix UTF8String.codePointFrom/trimLeft/trimRight out-of-bounds read on truncated trailing UTF-8 sequences [spark] - posted by "jubins (via GitHub)" <gi...@apache.org> on 2026/06/20 00:26:36 UTC, 3 replies.
- [PR] [SPARK-57579][PYTHON] Add PySpark support for unix_nanos function [spark] - posted by "jubins (via GitHub)" <gi...@apache.org> on 2026/06/20 00:40:30 UTC, 11 replies.
- Re: [I] [SQL] dropDuplicates and Window dedup produce incorrect results with SPJ partiallyClusteredDistribution [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/20 01:04:55 UTC, 0 replies.
- Re: [PR] [SPARK-54088][CORE] When TaskSchedulerImpl searches for an executor to schedule an unschedulable task, it should exclude executors that are pending to remove [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/20 01:04:57 UTC, 1 replies.
- Re: [PR] [SPARK-52729][SQL][FOLLOWUP] Model table and view as a common Relation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/20 01:12:12 UTC, 5 replies.
- [PR] [SPARK-57518][SQL] Make ThriftServer JDBC metadata operations DataSource V2 catalog-aware [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/06/20 01:46:21 UTC, 0 replies.
- [PR] [SPARK-57465][CORE] Do not count RejectedExecutionException from a shutting-down executor toward task failures [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/06/20 02:08:20 UTC, 7 replies.
- [PR] [SQL] Throw on ceil/floor overflow in ANSI mode [spark] - posted by "ravikiranpagidi (via GitHub)" <gi...@apache.org> on 2026/06/20 04:52:42 UTC, 1 replies.
- [PR] [SPARK-57580][SQL] Redact credentials embedded in JDBC URLs [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/20 06:48:56 UTC, 5 replies.
- [PR] [SPARK-56773][CORE][TESTS][FOLLOWUP] Always allocate INJECT_SHUFFLE_FETCH_FAILURES injection maps [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/20 07:14:42 UTC, 5 replies.
- [PR] [SPARK-56947][SQL] Add `SortLike` trait similar to `ShuffleLike` [spark] - posted by "wilmerdooley (via GitHub)" <gi...@apache.org> on 2026/06/20 07:19:55 UTC, 4 replies.
- [PR] [SPARK-57581][SQL] Encode the TIME data type in Avro with a unit-correct logical type [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/20 10:04:22 UTC, 9 replies.
- Re: [PR] [SPARK-54473][SQL] Add Avro read and write support for TIME type [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/20 10:11:51 UTC, 0 replies.
- Re: [PR] [SPARK-57420][INFRA] Add generate-tpcds input and early CPU check to benchmark workflow [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/06/20 16:45:06 UTC, 7 replies.
- [PR] [SPARK-57572][SQL] Infer TimeType during CSV and JSON schema inference [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/06/20 17:27:40 UTC, 15 replies.
- [PR] [SPARK-57574][PANDAS] Support the TIME data type in pandas API on Spark [spark] - posted by "marcuslin123 (via GitHub)" <gi...@apache.org> on 2026/06/20 23:10:14 UTC, 4 replies.
- Re: [PR] [SPARK-56947][SQL] Add `SortLike` trait for sort physical operators [spark] - posted by "wilmerdooley (via GitHub)" <gi...@apache.org> on 2026/06/21 00:53:35 UTC, 0 replies.
- Re: [PR] [SPARK-55694][SQL][FOLLOW-UP] Add test for CREATE OR REPLACE TABLE AS SELECT with constraints [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/21 01:12:37 UTC, 1 replies.
- Re: [PR] Fix potential NPE/IllegalArgumentException by wrapping toBoolean call with Try and defaulting to false for LEGACY_PARQUET_NANOS_AS_LONG config [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/21 01:13:35 UTC, 1 replies.
- Re: [PR] [SPARK-55818][PS] Decimal-float mixed arithmetic should always raise TypeError [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/21 01:13:39 UTC, 2 replies.
- Re: [PR] [MINOR] Fix typos in MD files [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/21 01:14:19 UTC, 1 replies.
- [PR] [SPARK-54593][SQL][FOLLOWUP] Do not narrow materialized-input DPP eligibility based on operators above the materialized input [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/21 07:08:24 UTC, 3 replies.
- [PR] [SPARK-57575][SQL] Support TIME type in to_char/to_varchar formatting [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/06/21 07:17:54 UTC, 11 replies.
- [PR] [SPARK-57454][SQL] Add type coercion and widening rules for nanosecond-precision timestamp types [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/21 07:38:51 UTC, 8 replies.
- Re: [PR] [SPARK-56032][SQL][FOLLOWUP] Skip FilterExec CSE codegen when every common subexpression is cheap [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/06/21 14:33:33 UTC, 1 replies.
- [PR] SPARK-57584: Add Spark Connect gRPC health checks [spark] - posted by "Shekharrajak (via GitHub)" <gi...@apache.org> on 2026/06/21 18:22:40 UTC, 0 replies.
- Re: [PR] [SPARK-54593][SQL][FOLLOWUP] Frame materialized-input DPP eligibility as a recompute-cost guard [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/21 20:35:33 UTC, 8 replies.
- Re: [PR] [SPARK-57576] [SQL] Fix `SET_OPERATION_ON_MAP_TYPE` and `SET_OPERATION_ON_VARIANT_TYPE` exception messages [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/21 20:41:14 UTC, 5 replies.
- Re: [PR] [SPARK-57512][SQL] Allow RuntimeReplaceable to opt out of eager replacement and survive into the physical plan [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/21 20:41:52 UTC, 14 replies.
- [PR] [MINOR][CORE][TESTS] Make "log4j log level change" assert on the root logger [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/21 21:00:43 UTC, 2 replies.
- [PR] [SPARK-57588][SQL] Report the actual target precision in CAST_INVALID_INPUT when casting strings to TIME(p) [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/21 21:19:41 UTC, 2 replies.
- Re: [PR] [SPARK-56898][SQL] Rewrite COUNT(DISTINCT IF) to COUNT(DISTINCT) FILTER for Expand reduction [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/21 21:26:27 UTC, 1 replies.
- Re: [PR] [SPARK-57499][SQL] Fix column pruning and invalid plans in variant extraction pushdown on DSv2 scans [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/21 22:43:02 UTC, 4 replies.
- [PR] [SPARK-57589][CORE] Support `spark.ui.contentSecurityPolicy.enabled` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/21 23:26:44 UTC, 5 replies.
- Re: [PR] [SPARK-55324][PYTHON] Make convert_numpy support ArrayType [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/21 23:54:17 UTC, 1 replies.
- Re: [PR] [SPARK-54665][PS] Fix comparison between boolean Series and string literals [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/22 01:12:38 UTC, 1 replies.
- Re: [PR] [SPARK-53501][PYTHON][CORE] Extract PythonWorkerFactory cache from SparkEnv [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/22 01:12:43 UTC, 1 replies.
- [PR] [MINOR][BUILD][3.5] Pin black to 22.6.0 for the branch-3.5 Python linter [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/22 01:26:12 UTC, 0 replies.
- [PR] [CONNECT][PYTHON][TESTS] Keep test_sql_context importable in remote-only (Connect client-only) mode [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/22 02:23:21 UTC, 0 replies.
- [PR] [SPARK-XXXXX][SQL][TESTS] Extend OracleIntegrationSuite connection timeout to avoid flaky ORA-12541 aborts [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/22 04:07:17 UTC, 0 replies.
- [PR] [DO-NOT-MERGE][SPARK-XXXXX][CORE][TESTS] Use a short base dir for UDF worker test sockets to avoid AF_UNIX path-too-long [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/22 04:09:38 UTC, 0 replies.
- [PR] [SPARK-57565][PYSPARK] Add PySpark test coverage for the TIME data type [spark] - posted by "marcuslin123 (via GitHub)" <gi...@apache.org> on 2026/06/22 04:09:59 UTC, 0 replies.
- [PR] [SPARK-57532][CORE][TESTS] Add a test suite for StringSubstitutor and tidy its default-value length bookkeeping [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/22 04:46:48 UTC, 9 replies.
- Re: [PR] [SPARK-56972][SS] Persist sink name in V3 commit log via MicroBatchExecution [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2026/06/22 05:02:04 UTC, 3 replies.
- [PR] [SPARK-57593][SQL] Byte-bound and instrument the pickle Python UDF input batch [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2026/06/22 05:37:18 UTC, 3 replies.
- [PR] [DO-NOT-MERGE][PS][PYTHON][TESTS] Make pandas-on-Spark doctests and UDF input-type coercion test pass under pandas 3 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/22 06:12:21 UTC, 0 replies.
- Re: [PR] [SPARK-56845] [K8S] Truncate ConfigMap names that exceed DNS subdomain limit [spark] - posted by "shivadarshan-devadiga (via GitHub)" <gi...@apache.org> on 2026/06/22 06:33:18 UTC, 1 replies.
- Re: [PR] [DO-NOT-MERGE][SPARK-XXXXX][PS][PYTHON] Fix sem(), legacy UDF null-string conversion, and doctests for pandas 3 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/22 06:47:36 UTC, 1 replies.
- Re: [PR] [SPARK-57581][SQL][4.2] Encode the TIME data type in Avro with a unit-correct logical type [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/22 06:57:18 UTC, 2 replies.
- [PR] [SPARK-57595][PYTHON] Declarative Pipelines analysis context should not mask the original error when registration fails [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/22 06:58:48 UTC, 4 replies.
- [PR] [SPARK-57555][SQL] Support TIME data type in built-in JDBC data source [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/06/22 07:20:57 UTC, 13 replies.
- [PR] [DO-NOT-MERGE][PYTHON][TESTS] Guard Connect grpc imports so connect SQLContext/HiveContext tests skip on grpc-less builds (Python 3.14 free-threaded) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/22 07:33:25 UTC, 0 replies.
- [PR] [SPARK-57597][CORE] Guard ByteUnit.toBytes against long overflow [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/22 08:31:39 UTC, 6 replies.
- Re: [PR] [DO-NOT-MERGE][CONNECT][PYTHON][TESTS] Keep test_sql_context importable in remote-only (Connect client-only) mode [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/22 08:39:04 UTC, 0 replies.
- Re: [PR] [DO-NOT-MERGE][CORE][TESTS] Use a short base dir for UDF worker test sockets to avoid AF_UNIX path-too-long [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/22 09:03:13 UTC, 0 replies.
- [PR] [SPARK-55444][SQL][FOLLOWUP] Remove dead TimeType branches from the Parquet *Default methods [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/06/22 09:35:26 UTC, 0 replies.
- Re: [PR] [SPARK-56893][SQL] Optimize Parquet dictionary decoding with hasNull fast path and per-class updater overrides [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/22 09:36:48 UTC, 6 replies.
- [PR] [DO-NOT-MERGE][SPARK-57501][SQL][TESTS] Update stale JDK 21 golden file for nonansi/try_arithmetic.sql [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/22 09:46:50 UTC, 0 replies.
- [PR] [DO-NOT-MERGE][BUILD] Upgrade log4j to 2.26.0 to fix JDK25 ThrowableStackTraceRenderer NPE [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/22 09:47:48 UTC, 3 replies.
- Re: [PR] [SPARK-55444][SQL] Remove dead TimeType branches from the Parquet *Default methods [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/06/22 09:52:27 UTC, 4 replies.
- [PR] [SPARK-57599][SQL] Decode Variant strings and keys as UTF-8 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/22 10:30:41 UTC, 4 replies.
- [PR] [SPARK-57604][BUILD] Upgrade log4j to 2.26.0 to fix JDK 25 ThrowableStackTraceRenderer NPE [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/22 10:52:29 UTC, 7 replies.
- [PR] [SPARK-55444][SQL] Introduce and Route TimeType to Parquet vectorized read through the Types Framework [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/06/22 11:34:28 UTC, 8 replies.
- [PR] [SPARK-57600][SQL] Declarative Pipelines should isolate per-flow SQL confs during parallel flow resolution [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/22 11:49:32 UTC, 12 replies.
- Re: [PR] [WIP][SPARK-55444][SQL] Introduce and Route TimeType to Parquet vectorized read through the Types Framework [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/06/22 12:37:41 UTC, 5 replies.
- [PR] [SPARK-56539][CORE] Fix exitStatusCode 0 for unrecognized spark-submit options [spark] - posted by "arham0254A (via GitHub)" <gi...@apache.org> on 2026/06/22 13:17:34 UTC, 7 replies.
- Re: [PR] [SPARK-57055][SQL][DOCS] Document non-binary collation gap in DataFrameStatFunctions.bloomFilter [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/22 13:33:28 UTC, 0 replies.
- Re: [PR] [SPARK-48275][SQL][DOCS] Improve array_sort default comparator documentation [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/22 13:44:53 UTC, 3 replies.
- Re: [PR] [SPARK-56769][SQL] Add fast path for date_trunc WEEK/MONTH/QUARTER/YEAR [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/22 13:58:40 UTC, 5 replies.
- [PR] [DO-NOT-MERGE][SPARK-57610][SQL][TESTS] Tolerate null ArithmeticException message in TruncTimestamp overflow test on JDK 25 (branch-4.2) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/22 14:00:42 UTC, 0 replies.
- [PR] [DO-NOT-MERGE][SPARK-56663][SQL][TESTS] Make TruncTimestamp overflow test tolerant of JDK 25 codegen exception message [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/22 14:01:54 UTC, 0 replies.
- [PR] [SPARK-57582][SQL] Remove dead TimeType fallback branches shadowed by the Parquet types framework dispatch [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2026/06/22 14:24:29 UTC, 5 replies.
- [PR] [SPARK-57612] Upgrade `Apache DataFusion Comet` to 0.17.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/22 14:50:29 UTC, 5 replies.
- [PR] [SPARK-57613][PYTHON] Stop the Spark session when a Declarative Pipelines run step fails [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/22 15:08:49 UTC, 9 replies.
- Re: [PR] [SPARK-57466] Support `s.k.o.dynamicConfig.source` to use mounted-`ConfigMap` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/22 15:26:45 UTC, 6 replies.
- [PR] [SPARK-57614][WEBUI] Use CSP `frame-ancestors` instead of deprecated `X-Frame-Options: ALLOW-FROM` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/22 15:32:37 UTC, 13 replies.
- [PR] [SPARK-56893][SQL][TESTS] Add ParquetDictionaryDecodeBenchmark for dictionary ID decode throughput [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/06/22 16:13:29 UTC, 3 replies.
- [PR] [SPARK-57594][SS] Add spark_confs support to create_auto_cdc_flow [spark] - posted by "trisjain-db (via GitHub)" <gi...@apache.org> on 2026/06/22 16:43:00 UTC, 1 replies.
- [I] [PYTHON][PYSPARK][FUNCTIONS] pyspark.sql.functions.try_to_date is missing in PySpark 4.0.0-4.0.4 but the docs say it became available in 4.0.0 [spark] - posted by "mh0w (via GitHub)" <gi...@apache.org> on 2026/06/22 16:56:11 UTC, 2 replies.
- [PR] [SPARK-43322][SQL] Document null/empty behavior in explode_outer and posexplode_outer [spark] - posted by "brijrajk (via GitHub)" <gi...@apache.org> on 2026/06/22 17:22:23 UTC, 1 replies.
- Re: [PR] [SPARK-57362][DOCS] Prevent content from overlapping left navigation [spark] - posted by "llphxd (via GitHub)" <gi...@apache.org> on 2026/06/22 17:38:30 UTC, 1 replies.
- [PR] [SPARK-57617][SQL] Clean up BIN BY error conditions and SQLSTATEs [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/06/22 17:40:39 UTC, 0 replies.
- Re: [PR] [SPARK-57593][SQL][PYTHON] Byte-bound and instrument the pickle Python UDF input batch [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/06/22 17:44:07 UTC, 13 replies.
- [PR] [SPARK-47013][SS] Document spark.sql.streaming.minBatchesToRetain config [spark] - posted by "brijrajk (via GitHub)" <gi...@apache.org> on 2026/06/22 18:44:33 UTC, 2 replies.
- [PR] [SPARK-57615][CONNECT][TESTS] Wait for the Connect server before creating a ResourceProfile in test_profile_before_sc_for_connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/22 19:07:04 UTC, 7 replies.
- Re: [PR] [SPARK-54593][SQL][FOLLOWUP] Require a statistics-based benefit, not the fallback ratio, for materialized-input DPP [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/22 20:18:13 UTC, 10 replies.
- Re: [PR] [SPARK-57598][CONNECT][PYTHON][TESTS] Make test_sql_context importable in Spark Connect client-only mode [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/22 21:14:43 UTC, 1 replies.
- [PR] [SPARK-57618][SQL] Support casting between TIME(p) and TIMESTAMP_NTZ(q) [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/22 21:22:40 UTC, 15 replies.
- [PR] [SPARK-57620][CORE] Remove redundant Vectored IO Hadoop configurations [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/22 21:37:43 UTC, 0 replies.
- [PR] [SPARK-57621][INFRA][3.5] Make branch-3.5 scheduled build workflows self-contained [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/22 21:39:27 UTC, 16 replies.
- Re: [PR] [SPARK-57608][PYTHON][TESTS] Guard Spark Connect grpc imports so connect SQLContext/HiveContext tests skip on grpc-less builds (Python 3.14 free-threaded) [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/22 21:56:25 UTC, 3 replies.
- Re: [PR] [SPARK-57620][CORE] Remove redundant S3A Vectored IO Hadoop configurations [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/22 22:14:56 UTC, 1 replies.
- [PR] [SPARK-57622][DOCS] Add navigation subsections to the Data Source V2 documentation page [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/06/22 22:20:47 UTC, 5 replies.
- Re: [PR] [DO-NOT-MERGE][POC] Python Spark Client UI [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/22 22:40:07 UTC, 0 replies.
- Re: [PR] [DO-NOT-MERGE][POC] RDD in Python Spark Connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/22 22:40:18 UTC, 1 replies.
- Re: [PR] [SPARK-57610][SQL][TESTS] Tolerate null ArithmeticException message in TruncTimestamp overflow test on JDK 25 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/22 22:40:54 UTC, 3 replies.
- [PR] [WIP][SQL] from_xml to variant should honor the parse mode [spark] - posted by "mzhang (via GitHub)" <gi...@apache.org> on 2026/06/22 22:50:04 UTC, 0 replies.
- [PR] [SPARK-57601][CONNECT][UI] Make the Spark Connect tab available in the History Server [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/06/22 22:59:50 UTC, 3 replies.
- [PR] [SPARK-57623][SDP] Drop AutoCDC `requireDestinationSupportsRowLevelOps` Check [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/06/22 23:19:39 UTC, 3 replies.
- [PR] [SPARK-57625][SDP][1/2] Manage Auxiliary Table Lifecycle in DatasetManager [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/06/22 23:49:37 UTC, 9 replies.
- [PR] [SPARK-57626][SQL] Share repeated nested JSON path parsing [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/06/23 00:33:30 UTC, 12 replies.
- [PR] [SPARK-57625] Manage Auxiliary Table Lifecycle from `DatasetManager` [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2026/06/23 00:34:21 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-55805] fixed ignore type override for linter in _SimpleStreamReaderWrapper [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/23 00:59:49 UTC, 1 replies.
- Re: [PR] [SPARK-57501][SQL][TESTS] Update stale JDK 21 golden file for nonansi/try_arithmetic.sql [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/23 01:32:25 UTC, 2 replies.
- [PR] [SPARK-57627][CONNECT] Support primary key, foreign key, and SQL type metadata in DatabaseMetaData [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/06/23 03:17:56 UTC, 16 replies.
- Re: [PR] [SPARK-57603][SQL][TESTS] Dump DB container logs on docker-integration connection failure and extend Oracle connection timeout [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/23 03:39:33 UTC, 2 replies.
- Re: [PR] [SPARK-57602][CORE][TESTS] Use a short base directory for UDF worker test sockets to avoid AF_UNIX path-too-long [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/23 03:40:37 UTC, 1 replies.
- Re: [PR] [SPARK-57610][SQL][TESTS][4.2] Tolerate null ArithmeticException message in TruncTimestamp overflow test on JDK 25 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/23 03:42:52 UTC, 1 replies.
- Re: [PR] [SPARK-57607][BUILD][3.5] Pin black to a Python 3.9-compatible version for the branch-3.5 linter [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/23 03:45:41 UTC, 1 replies.
- [PR] Bump concurrent-ruby from 1.3.5 to 1.3.7 in /docs [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/06/23 03:47:11 UTC, 2 replies.
- [PR] [SPARK-57563][SQL] Add SQL golden-file test coverage for TIME to match DATE/TIMESTAMP [spark] - posted by "vboo123 (via GitHub)" <gi...@apache.org> on 2026/06/23 04:01:48 UTC, 5 replies.
- [PR] [SPARK-57628] Upgrade `Gradle` to 9.6.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/23 04:31:09 UTC, 3 replies.
- [PR] [SPARK-57629] Upgrade `spotless-plugin-gradle` to 8.7.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/23 04:37:45 UTC, 3 replies.
- [PR] [SPARK-57630] Fix `publish_snapshot_chart` GitHub Actions job [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/23 04:44:56 UTC, 3 replies.
- [PR] [SPARK-57611][SQL] Reuse JsonFactory instances in the variant module [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/23 05:59:25 UTC, 5 replies.
- [PR] [SPARK-56972][SS][FOLLOWUP] Reject sink evolution combined with async progress tracking [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/23 06:05:39 UTC, 4 replies.
- [PR] [SPARK-57631][WEBUI] Require modifier key for wheel-zoom on SQL plan DAG to restore page scrolling [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/23 06:23:13 UTC, 29 replies.
- [PR] [SPARK-57632][CORE] Remove unused method addVariantValueVariant in VariantShreddingWriter [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/23 06:31:39 UTC, 0 replies.
- Re: [PR] [SPARK-56505][SQL][TESTS] SharedSparkSession provides sql.SparkSession, add SharedClassicSparkSession, ClassicQueryTest [spark] - posted by "fwc (via GitHub)" <gi...@apache.org> on 2026/06/23 07:09:24 UTC, 1 replies.
- [PR] [SPARK-57633][DOC] Update `concurrent-ruby` gem version to 1.3.7 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/23 07:13:46 UTC, 4 replies.
- [PR] [SPARK-57634][SQL] Support TIME type inference in XML data source [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/06/23 07:25:28 UTC, 10 replies.
- [PR] [SPARK-57635][SQL] Make Declarative Pipelines run-termination reason deterministic [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/23 07:58:35 UTC, 3 replies.
- Re: [PR] [SPARK-56895][SQL] Batch ByteBuffer slice in RLE PACKED decode to reduce allocation overhead [spark] - posted by "iemejia (via GitHub)" <gi...@apache.org> on 2026/06/23 08:11:21 UTC, 5 replies.
- Re: [PR] [SPARK-56894][SQL] Add vectorized Parquet BYTE_STREAM_SPLIT reader [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/23 08:12:47 UTC, 5 replies.
- [PR] [SPARK-57637][BUILD][TESTS] Upgrade `oracle-free` docker image to `23.26.2-slim` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/23 11:45:11 UTC, 5 replies.
- [PR] [SPARK-57638][SQL] Avoid busy-waiting in Declarative Pipelines flow resolution [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/23 11:50:46 UTC, 2 replies.
- [PR] [SPARK-57639][CORE] Fix NPE in InMemoryStore.count for a type with no instances [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/23 12:12:03 UTC, 0 replies.
- [PR] grpc session. [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2026/06/23 13:13:36 UTC, 0 replies.
- [PR] init [spark] - posted by "bojana-db (via GitHub)" <gi...@apache.org> on 2026/06/23 14:22:09 UTC, 0 replies.
- Re: [PR] [SPARK-57617][SQL] Refine BIN BY error conditions and SQLSTATEs [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/23 15:43:21 UTC, 3 replies.
- [PR] [SPARK-56672][PYTHON][DOCS] Correct try_to_date docstring versionadded annotation [spark] - posted by "mh0w (via GitHub)" <gi...@apache.org> on 2026/06/23 16:19:28 UTC, 4 replies.
- Re: [PR] [SPARK-57624][SQL] from_xml to variant should honor the parse mode [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/06/23 17:01:18 UTC, 2 replies.
- Re: [PR] [SPARK-57563][SQL][TESTS] Add SQL golden-file test coverage for TIME to match DATE/TIMESTAMP [spark] - posted by "vboo123 (via GitHub)" <gi...@apache.org> on 2026/06/23 18:21:59 UTC, 6 replies.
- [PR] [SPARK-57636][SQL] Support REPLACE USING with row-level DSv2 writes [spark] - posted by "liucao-dd (via GitHub)" <gi...@apache.org> on 2026/06/23 20:06:54 UTC, 12 replies.
- Re: [PR] [SPARK-56147][SQL] `spark-sql` cli correctly handles SQL Scripting compound blocks [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/23 20:27:23 UTC, 2 replies.
- [PR] [SPARK-XXXXX][SQL][TESTS] Refactor some DSv2 tests to use SessionQueryTest [spark] - posted by "fwc (via GitHub)" <gi...@apache.org> on 2026/06/23 20:40:56 UTC, 0 replies.
- Re: [PR] [SPARK-57632][SQL] Remove unused method addVariantValueVariant in VariantShreddingWriter [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/06/23 21:16:09 UTC, 2 replies.
- [PR] [SPARK-57481][SQL] Read and infer Avro schema from tar archives [spark] - posted by "akshatshenoi-db (via GitHub)" <gi...@apache.org> on 2026/06/23 22:22:50 UTC, 3 replies.
- [PR] [SPARK-57643][DOCS] Document MERGE INTO schema evolution [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/06/23 23:03:48 UTC, 3 replies.
- [PR] [SPARK-57642][SQL] Require predicateSql to be present for the DSv2 CHECK constraint [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/06/23 23:10:17 UTC, 2 replies.
- [PR] [SPARK-57644][SQL] Support generated column values on V2 table writes [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/06/23 23:17:52 UTC, 3 replies.
- [PR] [SPARK-57644][SQL][TEST] TxnTableCatalog should delegate capabilities to underlying catalog [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/06/23 23:23:52 UTC, 0 replies.
- [PR] [DO-NOT-MERGE] Stabilize failing/flaky CI jobs [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/24 00:10:01 UTC, 1 replies.
- [PR] [DO-NOT-MERGE][YARN][TESTS] Allow AMs to use the whole queue in BaseYarnClusterSuite to fix ACCEPTED-state hangs [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/24 00:15:24 UTC, 0 replies.
- [PR] [DO-NOT-MERGE][CONNECT][TESTS] Stabilize flaky SparkSessionE2ESuite interrupt-all tests [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/24 00:17:45 UTC, 0 replies.
- Re: [PR] Spark 46959 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/24 00:58:05 UTC, 1 replies.
- Re: [PR] [SPARK-54878][SQL] Support sort_keys option inside to_json [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/24 00:58:09 UTC, 1 replies.
- Re: [PR] [SPARK-57639][CORE] Fix NPE in `InMemoryStore.count` for a type with no instances [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/24 03:14:58 UTC, 1 replies.
- [PR] [SPARK-57647][SQL][TESTS] Make `FileSourceStrategySuite` be independent from the default value of `maxPartitionBytes` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/24 03:39:49 UTC, 7 replies.
- [PR] [DO-NOT-MERGE][SS] Report available snapshot versions when a state snapshot load fails [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/24 04:25:33 UTC, 0 replies.
- [PR] [SPARK-57648][SQL] Spread unmatchable left outer join rows across shuffle partitions [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/06/24 04:45:04 UTC, 0 replies.
- [PR] [SPARK-57649][SQL][TESTS] Regenerate stale datetime-formatting.sql.out.java21 golden file [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/24 05:20:54 UTC, 3 replies.
- [PR] [SPARK-57652][SS][TESTS] Deflake snapshotStartBatchId-with-transformWithState StateDataSource test [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/24 05:22:28 UTC, 6 replies.
- [PR] [SPARK-57651][CONNECT][SS][TESTS] Deflake PythonPipelineSuite and add FileStreamSink batch-commit race diagnostics [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/24 05:22:36 UTC, 5 replies.
- [PR] [SPARK-57653][CORE] Make UTF8String.getByte honor its documented out-of-bounds contract [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/24 05:23:17 UTC, 2 replies.
- [PR] [SPARK-57654][SQL][TESTS] Deflake MetricsFailureInjectionSuite 'Force checksum mismatch aborts a downstream ResultStage' [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/24 05:24:33 UTC, 3 replies.
- [PR] [SPARK-57655][CONNECT][PYTHON] Avoid re-entrant Spark Connect ML cache cleanup RPC hang [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/24 05:24:52 UTC, 3 replies.
- [PR] [SPARK-38483][PYTHON][CONNECT] Add Column._name property exposing a column's name [spark] - posted by "AgenticSpark (via GitHub)" <gi...@apache.org> on 2026/06/24 05:31:21 UTC, 5 replies.
- [PR] [SPARK-42839][SQL] Convert _LEGACY_ERROR_TEMP_2003 to an internal error [spark] - posted by "AgenticSpark (via GitHub)" <gi...@apache.org> on 2026/06/24 05:32:17 UTC, 3 replies.
- [PR] [SPARK-57656][CONNECT][TESTS] Stabilize flaky SparkSessionE2ESuite interrupt-all tests [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/24 05:32:25 UTC, 2 replies.
- [PR] [SPARK-57657][CONNECT] Don't drop streaming listener events on a transient send failure [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/24 05:32:26 UTC, 1 replies.
- Re: [PR] [DO-NOT-MERGE][CONNECT] Stabilize flaky SparkSessionE2ESuite + ClientStreamingQuerySuite listener events [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/24 05:32:50 UTC, 1 replies.
- [PR] [SPARK-57645][PYTHON][TESTS] Add ASV microbenchmark for SQL_GROUPED_AGG_PANDAS_ITER_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/06/24 07:11:45 UTC, 4 replies.
- [PR] [SPARK-57659][CORE] Fix integer/long overflow in ArrayWrappers numeric array key comparators [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/24 07:19:50 UTC, 5 replies.
- [PR] [SPARK-57295][SQL] Extend whitespace-only path validation consistency to direct file-path queries [spark] - posted by "AnuragKDwivedi (via GitHub)" <gi...@apache.org> on 2026/06/24 08:41:02 UTC, 6 replies.
- Re: [PR] [SPARK-57584][CONNECT] Add Spark Connect gRPC health checks [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/06/24 09:47:42 UTC, 5 replies.
- [PR] [SPARK-57660][SQL] Support casting between TIME(p) and TIMESTAMP_LTZ(q) [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/24 09:59:05 UTC, 7 replies.
- Re: [PR] [SPARK-57616][SQL] Extend SupportsCatalogOptions to allow migration from DSv1 file based data source [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/06/24 10:01:57 UTC, 4 replies.
- [PR] Fix try to date version annotations [spark] - posted by "mh0w (via GitHub)" <gi...@apache.org> on 2026/06/24 10:14:43 UTC, 0 replies.
- Re: [PR] [SPARK-56672][PYTHON][DOCS] Fix remaining try to date version annotations [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/24 10:48:11 UTC, 1 replies.
- Re: [PR] [SPARK-57658][SS] Report available snapshot versions when a RocksDB state snapshot load fails [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/06/24 10:50:48 UTC, 4 replies.
- Re: [PR] [SPARK-55330][K8S] Make spark.kubernetes.legacy.useReadWriteOnceAccessMode a public config [spark] - posted by "Pluies (via GitHub)" <gi...@apache.org> on 2026/06/24 10:52:22 UTC, 0 replies.
- [PR] [SQL][WIP] Route nanosecond timestamp Parquet support through the Types Framework [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/06/24 10:53:31 UTC, 0 replies.
- [PR] [SPARK-56539][CORE] Fix zero exit code on Standalone remote driver failure [spark] - posted by "arham0254A (via GitHub)" <gi...@apache.org> on 2026/06/24 10:55:29 UTC, 10 replies.
- Re: [PR] [SPARK-57565][PYTHON] Add PySpark test coverage for the TIME data type [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/06/24 11:26:29 UTC, 6 replies.
- [PR] [SPARK-34525][DOCS] Document optional equals sign in OPTIONS and TBLPROPERTIES [spark] - posted by "AgenticSpark (via GitHub)" <gi...@apache.org> on 2026/06/24 11:47:05 UTC, 2 replies.
- [I] OracleDialect: Hardcoded scale of 10 in Decimal(38,10) causes silent precision loss for bare NUMBER columns [spark] - posted by "sivakumardg (via GitHub)" <gi...@apache.org> on 2026/06/24 11:52:20 UTC, 0 replies.
- Re: [PR] [SPARK-55444][SQL] Route nanosecond timestamp Parquet support through the Types Framework [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/06/24 12:27:58 UTC, 4 replies.
- [PR] [SPARK-57159][SQL] Add Arrow type mapping for nanosecond-capable timestamp types [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/24 12:34:51 UTC, 9 replies.
- [PR] [SPARK-57662][CORE] Use unsigned byte comparison for KVStore iterator keys [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/24 12:42:08 UTC, 5 replies.
- [PR] [SPARK-57663][BUILD] Simplify gRPC deps management by using BOM [spark] - posted by "gillespeiffer-db (via GitHub)" <gi...@apache.org> on 2026/06/24 13:15:59 UTC, 8 replies.
- Re: [PR] [SPARK-56975][SS] Warn when DataStreamReader.table() is given a user-specified schema [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/06/24 13:59:50 UTC, 1 replies.
- [PR] [SPARK-57664][CONNECT] Make dropped pipeline events observable in PipelineEventSender [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/24 14:04:02 UTC, 4 replies.
- [PR] [SPARK-57659][CORE] Fix ArrayWrappers int[]/long[] comparator overflow for opposite-sign values [spark] - posted by "aviyehuda (via GitHub)" <gi...@apache.org> on 2026/06/24 14:33:13 UTC, 3 replies.
- Re: [PR] [SPARK-52621][SQL] Cast TIME to/from VARIANT [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/24 14:57:36 UTC, 0 replies.
- [PR] [SPARK-56822][SQL][WIP] Add Timestamp nano benchmarks [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/06/24 15:00:11 UTC, 1 replies.
- [PR] [SPARK-57637][BUILD][TESTS][4.1] Upgrade `oracle-free` docker image to `23.26.2-slim` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/24 15:11:48 UTC, 3 replies.
- [PR] [SPARK-57665][SQL] Fix slice() returning empty for large length in the interpreted path [spark] - posted by "SEPURI-SAI-KRISHNA (via GitHub)" <gi...@apache.org> on 2026/06/24 15:32:15 UTC, 5 replies.
- Re: [PR] [SPARK-56972][SS][4.x] Persist sink name in V3 commit log via MicroBatchExecution [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/24 16:52:34 UTC, 1 replies.
- [PR] [SPARK-57667][SQL][TESTS] Make SQL tests be independent from the default value of `maxShuffledHashJoinLocalMapThreshold` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/24 17:17:03 UTC, 6 replies.
- [PR] [SPARK-57668][BUILD] Upgrade `netty-tcnative` to 2.0.79.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/24 17:37:28 UTC, 5 replies.
- Re: [PR] [SPARK-56147][SQL] Use parser-based SQL splitter in `spark-sql` CLI [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/06/24 18:10:40 UTC, 3 replies.
- [PR] [SPARK-57669][BUILD] Upgrade Jackson to 2.22.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/24 18:30:34 UTC, 5 replies.
- [PR] [SPARK-57671][BUILD] Upgrade `tink` to 1.22.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/24 18:54:58 UTC, 3 replies.
- [PR] [SPARK-57672][BUILD] Upgrade Jetty to 12.1.10 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/24 19:03:45 UTC, 3 replies.
- Re: [PR] [SPARK-56535][BUILD] Fix CI & base image build issues [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/06/24 19:07:46 UTC, 0 replies.
- Re: [PR] [SPARK-56488][BUILD][3.5] Bump Scala 2.13 to 2.13.9 on branch-3.5 [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/06/24 19:09:22 UTC, 0 replies.
- Re: [PR] [SPARK-57650][YARN][TESTS] Allow AMs to use the whole queue in BaseYarnClusterSuite to fix ACCEPTED-state timeouts [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/24 20:08:47 UTC, 2 replies.
- [PR] [SPARK-57674][INFRA] Explain in AGENTS.md how to check if and where a PR was merged [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/24 20:37:12 UTC, 1 replies.
- Re: [PR] [SPARK-57644][SQL] TxnTableCatalog should delegate capabilities to underlying catalog [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/06/24 20:56:01 UTC, 1 replies.
- Re: [PR] [SPARK-57666][SQL] Add Timestamp nano benchmarks [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/24 21:02:39 UTC, 5 replies.
- [PR] [SPARK-57675] Mark `StateDataSourceTransformWithStateSuiteCheckpointV2` as `ExtendedSQLTest` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/24 21:14:12 UTC, 0 replies.
- [PR] [SPARK-57676][PYTHON] Refactor SQL_GROUPED_AGG_PANDAS_ITER_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/06/24 21:41:55 UTC, 7 replies.
- Re: [PR] [SPARK-57675][SQL][TESTS] Mark `StateDataSourceTransformWithStateSuiteCheckpointV2` as `ExtendedSQLTest` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/24 21:44:32 UTC, 3 replies.
- Re: [PR] [SPARK-57674][INFRA] Add dev/pr_merge_status.py and document PR merge-status checking in AGENTS.md [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/06/24 21:46:05 UTC, 4 replies.
- [PR] [SPARK-57677][PYTHON][TESTS] Make UDTF cleanup tests tolerate task retries [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/24 21:50:31 UTC, 4 replies.
- [PR] Add explodeEmbeddedArray JSON option for streaming scans of embedded arrays. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2026/06/24 22:22:21 UTC, 0 replies.
- Re: [PR] [SPARK-57678] Add explodeEmbeddedArray JSON option for streaming scans of embedded arrays. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2026/06/24 23:07:24 UTC, 2 replies.
- [PR] Fix numpy type checking [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/24 23:19:22 UTC, 0 replies.
- Re: [PR] [SPARK-56672][SQL][DOCS] Fix remaining try to date version annotations [spark] - posted by "mh0w (via GitHub)" <gi...@apache.org> on 2026/06/24 23:56:10 UTC, 3 replies.
- Re: [PR] [SPARK-55559][SQL] Fix BIT_COUNT for negative tinyint/smallint/int [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/25 01:02:17 UTC, 1 replies.
- Re: [PR] [SPARK-54923][SQL] Add configuration for directory traversal depth before parallel partition discovery [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/25 01:02:24 UTC, 1 replies.
- Re: [PR] [SPARK-55974][CORE][YARN] Relaunch new executors if the executor launching take too long time [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/25 01:02:28 UTC, 1 replies.
- Re: [PR] [SPARK-55970][CORE] Cap spark.executor.cores to max worker cores when set too large [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/25 01:02:33 UTC, 1 replies.
- Re: [PR] [MINOR][CORE][SQL][YARN] Fix various typo errors in comments [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/25 01:02:38 UTC, 1 replies.
- [PR] [SPARK-57683][SQL][TESTS] Move `StateDataSourceTransformWithStateSuiteWithRowChecksum` to `ExtendedSQLTest` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/25 02:15:51 UTC, 4 replies.
- [PR] [SPARK-57684][CORE] Avoid throwaway allocation in InMemoryStore parent-index lookups [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/25 03:13:47 UTC, 2 replies.
- [PR] [PYTHON][DOCS] Fix session window example usage [spark] - posted by "Israelobuk (via GitHub)" <gi...@apache.org> on 2026/06/25 04:12:51 UTC, 0 replies.
- [PR] [SPARK-57686][BUILD] Fix `log4j-slf4j2-impl` artifact name in `LICENSE-binary` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/25 05:03:55 UTC, 5 replies.
- [PR] [SPARK-57687][BUILD] Add `arrow-compression` to LICENSE-binary [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/25 05:25:05 UTC, 1 replies.
- [PR] [SPARK-57682][BUILD] Add `javax.servlet-api` to `LICENSE-binary` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/25 05:36:46 UTC, 4 replies.
- Re: [PR] [SPARK-57687][BUILD] Add `arrow-compression` to `LICENSE-binary` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/25 05:37:16 UTC, 3 replies.
- [PR] [SPARK-57564][SQL][TESTS] Add unit-test coverage for TIME to match DATE/TIMESTAMP [spark] - posted by "vboo123 (via GitHub)" <gi...@apache.org> on 2026/06/25 05:39:43 UTC, 5 replies.
- [PR] [SPARK-57689][BUILD] Replace `kubernetes-httpclient-okhttp` with `kubernetes-httpclient-vertx` in `LICENSE-binary` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/25 05:57:23 UTC, 4 replies.
- [PR] [SPARK-57558][SQL] Add the LOCALTIME datetime value function [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/06/25 05:58:36 UTC, 11 replies.
- [PR] [SPARK-57685][SQL] Support non-deterministic expressions in MERGE INTO action assignments on DSv2 tables [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/06/25 06:19:11 UTC, 2 replies.
- Re: [PR] [SPARK-38483][PYTHON][CONNECT] Add Column.col_name property exposing a column's name [spark] - posted by "AgenticSpark (via GitHub)" <gi...@apache.org> on 2026/06/25 07:00:22 UTC, 2 replies.
- Re: [PR] [SPARK-57679][PYTHON][PANDAS] Fix numpy type checking [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/06/25 07:02:57 UTC, 1 replies.
- [PR] [SPARK-57691][INFRA] Use default oracle docker image for the scheduled CIs [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/25 08:29:51 UTC, 4 replies.
- [PR] [SPARK-57692][INFRA] Skip test report when no test results exist [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/25 09:10:32 UTC, 4 replies.
- [PR] [SPARK-56887][SQL][FOLLOWUP] Add spill tests for forward, nearest, and left outer AS-OF joins [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/25 09:16:52 UTC, 2 replies.
- Re: [PR] [SPARK-57691][INFRA] Use default oracle docker image for the CIs [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/06/25 10:26:31 UTC, 3 replies.
- [PR] [SPARK-57030][SPARK-57031][DOCS] Document the TIME data type, functions, and ANSI behavior in the SQL reference [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/25 11:09:34 UTC, 7 replies.
- Re: [PR] [SPARK-56887][SQL][FOLLOWUP][TESTS] Add spill tests for forward, nearest, and left outer AS-OF joins [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/25 11:39:55 UTC, 3 replies.
- Re: [PR] [MINOR][DOCS] Correct try_to_date docstring versionadded annotation [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/06/25 11:58:28 UTC, 2 replies.
- [PR] [SPARK-56586][CONNECT][SS] Abort wedged foreachBatch worker read on query stop [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/25 12:13:49 UTC, 1 replies.
- [PR] [SPARK-57669][BUILD] Remove redundant Jackson version declarations managed by jackson-bom [spark] - posted by "gillespeiffer-db (via GitHub)" <gi...@apache.org> on 2026/06/25 12:20:29 UTC, 0 replies.
- [PR] [SPARK-57693][BUILD] Simplify k8s-client deps management by using BOM [spark] - posted by "gillespeiffer-db (via GitHub)" <gi...@apache.org> on 2026/06/25 12:20:33 UTC, 2 replies.
- [PR] [SPARK-21529][SQL] Improve the error message for unsupported Hive union type [spark] - posted by "AgenticSpark (via GitHub)" <gi...@apache.org> on 2026/06/25 12:57:34 UTC, 7 replies.
- [PR] [SPARK-57694][INFRA] Upgrade test-summary/action to `v2.6` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/25 13:43:35 UTC, 4 replies.
- [PR] [SPARK-57688][SQL] Add spark.sql.execution.bypassPartialAggregation to skip partial agg [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/06/25 14:30:13 UTC, 11 replies.
- [PR] [SPARK-57661][SQL] Preserve TIME precision in the Spark <-> Arrow type mapping [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/25 14:57:01 UTC, 9 replies.
- Re: [PR] [SPARK-57476][SQL] Extract BIN BY validation to lay groundwork for single-pass resolver [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/25 16:01:29 UTC, 4 replies.
- [PR] [SPARK-57587][SQL][TEST] Generate TIME values with the declared precision in RandomDataGenerator [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/25 16:41:04 UTC, 2 replies.
- [PR] [SPARK-57697][SQL][TESTS] Mark `HiveClientSuite` as `SlowHiveTest` like `HiveClientSuites` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/25 17:04:44 UTC, 5 replies.
- [PR] [SPARK-57698][KUBERNETES] Set MALLOC_ARENA_MAX in Kubernetes entrypoint [spark] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2026/06/25 17:56:14 UTC, 4 replies.
- [PR] [SPARK-57700][K8S] Support opt-in `jemalloc` in Spark Docker images [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/25 18:40:07 UTC, 4 replies.
- [PR] [SPARK-57701] Install `libjemalloc2` in `Dockerfile.template` [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/25 19:39:08 UTC, 2 replies.
- [PR] [SPARK-57702][INFRA] Move scheduled CIs for 3.5 to branch-3.5 [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/25 21:00:06 UTC, 4 replies.
- [PR] [SPARK-57705][SQL] Read CSV, JSON, text, and XML files from zip archives [spark] - posted by "akshatshenoi-db (via GitHub)" <gi...@apache.org> on 2026/06/25 22:11:07 UTC, 5 replies.
- [PR] [SPARK-57650][YARN][TESTS][FOLLOWUP] Reduce YarnClusterSuite flakiness from CI runner contention [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/25 22:11:48 UTC, 0 replies.
- [PR] Make small optimizations to StatefulProcessorApiClient [spark] - posted by "funrollloops (via GitHub)" <gi...@apache.org> on 2026/06/25 22:15:00 UTC, 0 replies.
- [PR] [SPARK-50110][SQL] Fix CSV parsing when numeric values have surrounding whitespace [spark] - posted by "aviyehuda (via GitHub)" <gi...@apache.org> on 2026/06/25 22:16:17 UTC, 4 replies.
- [PR] [DO-NOT-MERGE][PS][PYTHON] Make as_spark_type handle numpy>=2.5 NDArray annotations [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/25 22:35:59 UTC, 3 replies.
- [PR] [DO-NOT-MERGE][PYTHON][PS] Support numpy 2.5 PEP 695 NDArray type hints in pandas-on-Spark [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/25 22:36:45 UTC, 2 replies.
- Re: [PR] [SPARK-53368][SQL] Support reading Parquet TIME data with isAdjustedToUTC=true [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/06/25 22:36:59 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-?????][STREAMING] Make small optimizations to StatefulProcessorApiClient [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/25 22:39:57 UTC, 3 replies.
- [PR] [DO-NOT-MERGE][SQL][TEST] Deflake SQLAppStatusListenerMemoryLeakSuite "no memory leak" [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/25 22:42:30 UTC, 0 replies.
- [PR] [DO-NOT-MERGE][SS][TEST][4.2] Deflake snapshotStartBatchId-with-transformWithState StateDataSource test [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/25 22:42:58 UTC, 0 replies.
- [PR] [SPARK-57681][SQL] Support dynamic table options for DELETE and UPDATE [spark] - posted by "anuragmantri (via GitHub)" <gi...@apache.org> on 2026/06/25 23:07:25 UTC, 8 replies.
- [PR] [SPARK-57706] Add one-zone `Spark Connect Server` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/25 23:20:09 UTC, 3 replies.
- [PR] [SPARK-56498][SS] Implement decoupled state store maintenance [spark] - posted by "liviazhu (via GitHub)" <gi...@apache.org> on 2026/06/25 23:23:15 UTC, 1 replies.
- [PR] [SPARK-57704][PYTHON][TESTS] Add ASV microbenchmark for SQL_TRANSFORM_WITH_STATE_PANDAS_INIT_STATE_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/06/25 23:36:17 UTC, 0 replies.
- [PR] [SPARK-57707][PYTHON][TESTS] Skip doctest for shuffle [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/26 00:06:54 UTC, 2 replies.
- [PR] [SPARK-57566][CONNECT][TESTS] Add test coverage for the TIME data type [spark] - posted by "vboo123 (via GitHub)" <gi...@apache.org> on 2026/06/26 00:55:33 UTC, 2 replies.
- [PR] [SPARK-57708][4.1][INFRA] Backport CI precompile artifact sharing and Coursier cache unification [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/26 01:03:52 UTC, 5 replies.
- Re: [PR] [SPARK-54724][SQL] Fix dropDuplicates(columns) followed by exceptAll causing INTERNAL_ERROR_ATTRIBUTE_NOT_FOUND [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/26 01:05:03 UTC, 6 replies.
- Re: [PR] [SPARK-55353][SQL] Disable SQLAppStatusListener when UI is disabled [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/26 01:05:06 UTC, 1 replies.
- [PR] [SPARK-57650][YARN][TESTS][FOLLOWUP] Reduce YarnClusterSuite flakiness from runner contention [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/26 02:53:50 UTC, 0 replies.
- [PR] [DO-NOT-MERGE][SS][KAFKA] Work around JDK-8298446 C2 miscompilation causing IllegalMonitorStateException in Kafka tests on branch-4.2 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/26 04:45:42 UTC, 2 replies.
- [PR] [SPARK-57709][CORE] Fail the stream callback and close the channel when installing the stream interceptor fails [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/26 04:48:18 UTC, 2 replies.
- Re: [PR] [DO-NOT-MERGE][CONNECT][SS] Abort wedged foreachBatch worker read on query stop [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/26 05:46:44 UTC, 2 replies.
- Re: [PR] [SPARK-57650][YARN][TESTS][FOLLOW-UP] Reduce YarnClusterSuite flakiness from runner contention [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/26 05:46:48 UTC, 1 replies.
- Re: [PR] [DO-NOT-MERGE][CONNECT] Don't drop streaming listener events on a transient send failure [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/26 06:01:44 UTC, 0 replies.
- [PR] [SPARK-57712][SS][KAFKA] Work around JDK-8298446 C2 miscompilation causing IllegalMonitorStateException in Kafka tests [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/26 06:07:43 UTC, 4 replies.
- [PR] [SPARK-57714][CORE] Add loser tree based k-way merger for UnsafeExternalSorter spill merge [spark] - posted by "s-unscrupulous (via GitHub)" <gi...@apache.org> on 2026/06/26 06:31:03 UTC, 5 replies.
- Re: [PR] [SPARK-57652][SS][TEST][4.2] Deflake snapshotStartBatchId-with-transformWithState StateDataSource test [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/26 07:09:18 UTC, 1 replies.
- Re: [PR] [SPARK-57711][SQL][TEST] Deflake SQLAppStatusListenerMemoryLeakSuite "no memory leak" [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/06/26 07:12:04 UTC, 4 replies.
- Re: [PR] [SPARK-57710][YARN][TESTS][FOLLOW-UP] Reduce YarnClusterSuite flakiness from CI runner contention [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/06/26 07:15:51 UTC, 1 replies.
- [PR] [SPARK-57585][SQL] Resolve a common TIME(p) type for mixed-precision operands in set and conditional operations [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/26 07:55:21 UTC, 5 replies.
- [PR] [SPARK-57713][CORE] Deduplicate AUTO IOMode resolution in NettyUtils [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/26 09:28:18 UTC, 2 replies.
- [PR] [SPARK-57573][PROTOBUF] Support the TIME data type in the Protobuf connector [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/26 09:49:38 UTC, 7 replies.
- Re: [PR] [SPARK-54582][SQL] Add Time Type Statistics Collection Support [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/26 09:51:49 UTC, 7 replies.
- [PR] Fix PIVOT [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2026/06/26 11:53:45 UTC, 0 replies.
- [PR] Add benchmarks for the TIME data type [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/06/26 11:56:05 UTC, 0 replies.
- Re: [PR] [SPARK-57573][CONNECT] Support the TIME data type in the Protobuf connector [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/26 12:41:10 UTC, 1 replies.
- [PR] [SPARK-57303][SQL] Store-assignment and up-cast rules for nanosecond-precision timestamp types [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/26 12:49:21 UTC, 4 replies.
- [PR] [SQL][TESTS][WIP] Add SORT / ORDER BY and window correctness tests for nanosecond-precision timestamp types [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/06/26 12:56:30 UTC, 0 replies.
- Re: [PR] [SPARK-57715][SQL] PIVOT count() empty buckets should return 0 instead of NULL [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2026/06/26 13:04:09 UTC, 1 replies.
- Re: [PR] [SPARK-57716][SQL][TESTS] Add SORT / ORDER BY and window correctness tests for nanosecond-precision timestamp types [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/06/26 13:13:12 UTC, 2 replies.
- [PR] [SQL][TESTS] Add JOIN correctness tests for nanosecond-precision timestamp types [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/06/26 14:32:21 UTC, 0 replies.
- Re: [PR] [SPARK-57718][SQL][TESTS] Add JOIN correctness tests for nanosecond-precision timestamp types [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/06/26 15:08:06 UTC, 2 replies.
- [PR] [SPARK-57719] Move `IdentifierClauseParserSuite` to the catalyst parser package [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/26 15:24:32 UTC, 0 replies.
- Re: [PR] [SPARK-57719][SQL][TESTS] Move `IdentifierClauseParserSuite` to the catalyst parser package [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/26 15:31:35 UTC, 4 replies.
- [PR] [SPARK-57720][SQL] Fix `RealTimeModeAllowlist` package to match its directory [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/26 15:39:54 UTC, 5 replies.
- Re: [PR] [SPARK-38719][SQL] Test the error class: CANNOT_CAST_DATATYPE [spark] - posted by "deepujain (via GitHub)" <gi...@apache.org> on 2026/06/26 15:46:13 UTC, 0 replies.
- Re: [PR] [SPARK-38743][SQL] Test the error class: MISSING_STATIC_PARTITION_COLUMN [spark] - posted by "deepujain (via GitHub)" <gi...@apache.org> on 2026/06/26 15:53:30 UTC, 0 replies.
- [PR] [SPARK-57717][SQL] Pin BIN_BY_ENABLED explicitly in BIN BY tests [spark] - posted by "vranes (via GitHub)" <gi...@apache.org> on 2026/06/26 15:59:50 UTC, 4 replies.
- Re: [PR] [SPARK-54588][SQL] Add time_format function to convert TIME values to formatted string representations [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/26 16:00:14 UTC, 1 replies.
- Re: [PR] [SPARK-54507][SQL] Add time_bucket function for TIME type bucketing [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/26 16:15:10 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-54281][SQL] Support casting from Numeric types to Time type [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/26 16:28:00 UTC, 0 replies.
- [I] [SparkConnect] Support url path in SparkConnect connection string [spark] - posted by "hiboyang (via GitHub)" <gi...@apache.org> on 2026/06/26 16:30:17 UTC, 2 replies.
- [PR] [SPARK-57721][SQL] Fix `LowLatencyMemoryStream` package to match its directory [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/26 17:08:07 UTC, 5 replies.
- [PR] [SPARK-57457][SQL] Support nanosecond-precision timestamp types in the CSV datasource (v1 and v2) [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/06/26 17:26:43 UTC, 2 replies.
- [PR] [SPARK-57560][SQL] Support TRY eval mode for TIME datetime arithmetic [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/26 17:30:22 UTC, 0 replies.
- [PR] [SPARK-57722][INFRA] Merge `binding-policy` GHA job into the `lint` job [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/26 17:41:13 UTC, 8 replies.
- [PR] [MINOR][PYTHON][DOCS] Improve PySpark contributing documentation wording [spark] - posted by "Israelobuk (via GitHub)" <gi...@apache.org> on 2026/06/26 18:07:04 UTC, 0 replies.
- [PR] [MINOR][PYTHON][DOCS] Clarify PySpark installation options [spark] - posted by "Israelobuk (via GitHub)" <gi...@apache.org> on 2026/06/26 18:10:09 UTC, 2 replies.
- [PR] [SPARK-57571][SQL] Support TIME predicate pushdown to ORC [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/26 18:40:22 UTC, 4 replies.
- Re: [PR] [SPARK-57560][SQL][TESTS] Add tests for TRY eval mode of TIME datetime arithmetic [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/26 19:02:02 UTC, 4 replies.
- [PR] [SPARK-57723][CORE] Enable `spark.rdd.compress` by default like PySpark [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/26 20:18:40 UTC, 5 replies.
- [PR] [SPARK-57459][SQL] Support nanosecond-precision timestamp types in the Avro datasource (v1 and v2) [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/26 20:34:38 UTC, 15 replies.
- Re: [PR] [WIP][SPARK-57101][SQL] Wire codegen and row accessors through the Types Framework (TypeOps) [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/26 20:56:23 UTC, 0 replies.
- Re: [PR] [SPARK-57512][SQL] Introduce DelegateExpression, a logical-plan wrapper stripped before planning [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/26 23:26:06 UTC, 6 replies.
- [PR] [SPARK-57724][SQL] Add missing error class MISSING_CLAUSES_FOR_OPERATION [spark] - posted by "anew (via GitHub)" <gi...@apache.org> on 2026/06/26 23:39:14 UTC, 6 replies.
- [PR] [SPARK-57590][SQL] Read and infer Parquet schema from tar archives [spark] - posted by "akshatshenoi-db (via GitHub)" <gi...@apache.org> on 2026/06/26 23:57:30 UTC, 0 replies.
- Re: [PR] [SPARK-52687][PYTHON] Fix SPARK_CONNECT_MODE parsing [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/27 01:00:47 UTC, 1 replies.
- Re: [PR] [SPARK-49825][SQL] Fix the default warehouse dir for case with white spaces. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/27 01:00:52 UTC, 1 replies.
- Re: [PR] [SPARK-55930][SPARK-55931][CONNECT] Byte-aware gRPC metadata size checks and errorClassFallback [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/27 01:00:56 UTC, 1 replies.
- Re: [PR] [SPARK-57710][YARN][TESTS] Reduce YarnClusterSuite flakiness from CI runner contention [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/27 02:08:44 UTC, 1 replies.
- Re: [PR] [SPARK-57562][SQL] Add benchmarks for the TIME data type [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/27 06:42:43 UTC, 4 replies.
- [PR] [SPARK-57711][SQL][TEST] Fix linter failure [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/27 09:27:48 UTC, 0 replies.
- Re: [PR] [SPARK-57711][SQL][TEST][FOLLOWUP] Fix linter failure [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/06/27 09:30:01 UTC, 2 replies.
- [PR] Revert "[SPARK-57694][INFRA] Upgrade test-summary/action to `v2.6`" [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/27 09:49:29 UTC, 2 replies.
- [PR] [SPARK-57725][SQL] Fix NPE in AttributeSeq column resolution when an attribute has a null name [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/27 10:10:12 UTC, 7 replies.
- [PR] [SPARK-57726][SQL] Fix NPE in AttributeReference.hashCode when the attribute name is null [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/27 12:38:04 UTC, 3 replies.
- [I] Addition of a partition function in datalake V1 tables [spark] - posted by "0xAJX (via GitHub)" <gi...@apache.org> on 2026/06/27 14:24:20 UTC, 0 replies.
- [PR] Addition of a partitions function in datalake V1 tables [spark] - posted by "0xAJX (via GitHub)" <gi...@apache.org> on 2026/06/27 14:27:17 UTC, 0 replies.
- Re: [PR] [SPARK-56093][CORE][HISTORY] Allow AppStatus to be cached and reused by the history server. [spark] - posted by "lefteryx (via GitHub)" <gi...@apache.org> on 2026/06/27 18:43:16 UTC, 0 replies.
- [PR] [SPARK-57728] Make `HadoopFsRelationTest` independent of the `ignoreDataLocality` default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/27 19:14:37 UTC, 0 replies.
- [PR] [SPARK-57727][SQL] Fix incorrect query result due to inferAdditionalConstraints incorrectly substituting attributes with non-binary-stable collations [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2026/06/27 19:31:30 UTC, 4 replies.
- Re: [PR] [SPARK-57728][SQL][TESTS] Make SQL tests independent of the `ignoreDataLocality` default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/27 20:06:47 UTC, 3 replies.
- [PR] [SPARK-57725][SQL][4.2] Fix NPE in AttributeSeq column resolution when an attribute has a null name [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/27 21:11:10 UTC, 2 replies.
- [PR] [SPARK-57725][SQL][4.1] Fix NPE in AttributeSeq column resolution when an attribute has a null name [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/27 21:30:02 UTC, 2 replies.
- [PR] [SPARK-57725][SQL][4.0] Fix NPE in AttributeSeq column resolution when an attribute has a null name [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/27 21:38:49 UTC, 2 replies.
- [PR] [SPARK-57725][SQL][3.5] Fix NPE in AttributeSeq column resolution when an attribute has a null name [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/27 21:50:52 UTC, 4 replies.
- Re: [I] Update Derby and Hive version [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/28 01:05:48 UTC, 0 replies.
- Re: [PR] [SPARK-39382][WEBUI] UI show the duration of the failed task when the executor lost [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/28 01:05:50 UTC, 1 replies.
- [PR] [SPARK-57730][SQL][TESTS] Mark `Hive(PartitionFiltering|ClientUserName)Suite` as `SlowHiveTest` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/28 02:34:53 UTC, 2 replies.
- [PR] [SPARK-57731] Upgrade `gRPC Swift Protobuf` to 2.4.1 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/28 02:50:14 UTC, 3 replies.
- [PR] [SPARK-57732] Upgrade `grpc-swift-2` to 2.4.2 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/28 02:53:31 UTC, 3 replies.
- [PR] [SPARK-57733] Upgrade `gRPC Swift NIO Transport` to 2.9.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/28 03:06:06 UTC, 3 replies.
- [PR] [SPARK-57734] Use 4.2.0 RC4 for Spark 4.2 integration tests [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/28 03:35:59 UTC, 3 replies.
- [PR] [SPARK-57735][SQL] Support nanosecond-precision timestamp types in the in-memory columnar cache [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/06/28 03:59:05 UTC, 8 replies.
- [PR] ci: pin GitHub Actions to full commit SHAs [spark] - posted by "XananasX7 (via GitHub)" <gi...@apache.org> on 2026/06/28 04:05:23 UTC, 2 replies.
- Re: [PR] [SPARK-57730][SQL][TESTS] Mark `HiveClientUserNameSuite` as `SlowHiveTest` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/28 05:22:48 UTC, 2 replies.
- [PR] [SPARK-57736][SQL] Fix NPE in CreateNamedStruct.dataType when a struct field name is null [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/28 10:11:43 UTC, 3 replies.
- [PR] [SPARK-57568][SQL] Support TimeType in Parquet/ORC aggregate push-down [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/28 14:35:17 UTC, 5 replies.
- [PR] [WIP][SPARK-57421][SQL][CONNECT] Support @-syntax timestamp time travel on table names [spark] - posted by "sotikoug83 (via GitHub)" <gi...@apache.org> on 2026/06/28 15:01:13 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-57421][SQL][CONNECT] Support @-syntax version time travel on table names [spark] - posted by "sotikoug83 (via GitHub)" <gi...@apache.org> on 2026/06/28 15:03:28 UTC, 1 replies.
- [PR] [SPARK-57737][SQL] Cache zone offset per task in date_trunc [spark] - posted by "Licht-T (via GitHub)" <gi...@apache.org> on 2026/06/28 15:22:09 UTC, 2 replies.
- [PR] [SPARK-57738][CONNECT] Restore fast-fail guard for nanosecond timestamp types in ArrowVectorReader [spark] - posted by "jubins (via GitHub)" <gi...@apache.org> on 2026/06/28 15:29:28 UTC, 1 replies.
- [PR] [SPARK-57556][SQL] Raise a clear error for the TIME data type in Hive SerDe interop [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/28 15:29:45 UTC, 10 replies.
- [PR] [SPARK-57740][PYTHON] Fix unix_micros truncation disclaimer and add unix_nanos cross-references to unix_* See Also sections [spark] - posted by "jubins (via GitHub)" <gi...@apache.org> on 2026/06/28 15:47:32 UTC, 1 replies.
- [PR] [SPARK-57741][PYTHON] Add timestamp_nanos to PySpark public API [spark] - posted by "jubins (via GitHub)" <gi...@apache.org> on 2026/06/28 17:20:28 UTC, 2 replies.
- [PR] [SPARK-57742][PYTHON] Add truncation disclaimer to unix_micros docstring [spark] - posted by "jubins (via GitHub)" <gi...@apache.org> on 2026/06/28 17:29:43 UTC, 1 replies.
- [PR] [SPARK-57458][SQL] Support nanosecond-precision timestamp types in the XML datasource [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/06/28 19:02:26 UTC, 4 replies.
- [PR] [MINOR][PYTHON][TESTS] Add PySpark session_window behavior test [spark] - posted by "Israelobuk (via GitHub)" <gi...@apache.org> on 2026/06/28 19:25:49 UTC, 1 replies.
- [PR] [MINOR][PYTHON][EXAMPLES] Clarify basic SQL example output column [spark] - posted by "Israelobuk (via GitHub)" <gi...@apache.org> on 2026/06/28 19:27:59 UTC, 1 replies.
- [PR] [SPARK-57745][SQL] Assign named error class for unsupported datatype [spark] - posted by "michaelmitchell-bit (via GitHub)" <gi...@apache.org> on 2026/06/28 19:49:59 UTC, 6 replies.
- [PR] [SPARK-57570][SQL] Support TimeType in vectorized-reader column population [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/28 19:52:38 UTC, 6 replies.
- [PR] [SPARK-57746][SQL] Assign a name to the error conditions _LEGACY_ERROR_TEMP_3171, 3172 [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/28 21:28:44 UTC, 5 replies.
- Re: [PR] Update dataprep.ipynb [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/29 01:06:42 UTC, 1 replies.
- Re: [PR] [SPARK-53675][PYTHON] Add str support in withColumn and withColumns in PySpark [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/06/29 01:06:44 UTC, 1 replies.
- [PR] [SPARK-57600][SQL][4.1] Declarative Pipelines should isolate per-flow SQL confs during parallel flow resolution [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/29 05:35:03 UTC, 0 replies.
- [I] spark read data from clickhouse org.apache.hc.core5.http.TruncatedChunkException:Truncated chunk [spark] - posted by "nanjing922 (via GitHub)" <gi...@apache.org> on 2026/06/29 07:39:40 UTC, 2 replies.
- Re: [PR] [SPARK-57740][PYTHON] Fix unix_micros truncation disclaimer and add unix_nanos cross-references [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/29 10:07:55 UTC, 1 replies.
- [PR] [SPARK-57749][SQL][TESTS] Remove midnight-sensitive inline-table TIME -> TIMESTAMP_NTZ/LTZ golden cases [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/29 12:23:42 UTC, 2 replies.
- Re: [PR] [SPARK-46707][SQL] Added throwable field to expressions to improve predicate pushdown [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2026/06/29 12:35:20 UTC, 0 replies.
- Re: [PR] [SPARK-52825][CORE] Support AWS protocols in MySQLDialect and PostgresDialect [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/29 14:42:59 UTC, 0 replies.
- [PR] Add `variant_strip_nulls` expression [spark] - posted by "bojana-db (via GitHub)" <gi...@apache.org> on 2026/06/29 15:11:46 UTC, 0 replies.
- Re: [PR] [SPARK-57052][SS] Add state row format validation to multiGet in RocksDBStateStoreProvider [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/06/29 15:24:04 UTC, 1 replies.
- Re: [PR] [SPARK-54434][PYTHON] Use return instead of exit in bin/find-spark-home short-circuit [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/06/29 15:25:44 UTC, 3 replies.
- [PR] [SPARK-57456][SQL] Support nanosecond-precision timestamp types in the JSON datasource (v1 and v2) [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/29 15:29:06 UTC, 2 replies.
- [PR] [SPARK-57751][INFRA] Fix `spark-rm` Dockerfile comments to Spark 5 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/29 17:24:39 UTC, 2 replies.
- Re: [PR] [SPARK-57678][SQL] Add explodeEmbeddedArray JSON option for streaming scans of embedded arrays. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2026/06/29 17:38:20 UTC, 1 replies.
- [PR] [SPARK-57750][SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_3084 and set its cause [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/29 19:21:27 UTC, 2 replies.
- [PR] [SPARK-57755][INFRA] Replace deprecated `apt-key` with `/etc/apt/trusted.gpg.d` keyring file [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/29 19:33:48 UTC, 1 replies.
- Re: [PR] [SPARK-48580][CORE] Add consistency check and fallback for mapIds in push-merged block meta [spark] - posted by "boryaferz (via GitHub)" <gi...@apache.org> on 2026/06/29 19:50:21 UTC, 0 replies.
- Re: [PR] [SPARK-56990][INFRA][FOLLOWUP] Add java17 option to workflow dispatch [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/29 20:30:17 UTC, 1 replies.
- [PR] [SPARK-57757] Upgrade `Gradle` to 9.6.1 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/29 20:34:35 UTC, 0 replies.
- Re: [PR] [SPARK-57758][SQL] Restore O(1) built-in function resolution in the analyzer [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/30 06:10:52 UTC, 3 replies.
- Re: [PR] [SPARK-57772][INFRA][R] Fix to use `noble-cran40` CRAN repository in SparkR test image [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/30 06:30:33 UTC, 0 replies.
- [PR] [WIP][SQL] Return one row for GROUP BY GROUPING SETS (()) over empty input [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/06/30 06:41:53 UTC, 0 replies.
- Re: [PR] [SPARK-57557][SQL] Support the TIME data type in quantile aggregates [spark] - posted by "vboo123 (via GitHub)" <gi...@apache.org> on 2026/06/30 07:22:30 UTC, 3 replies.
- Re: [PR] [SPARK-57774][CORE] DriverLogger should not propagate log4j internal exception to caller [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/06/30 07:28:23 UTC, 4 replies.
- Re: [PR] [SPARK-57773][SQL] Strip leaked internal metadata in DataSourceV2Relation.create while preserving column IDs [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/06/30 07:32:25 UTC, 0 replies.
- Re: [PR] [SPARK-44800][SQL] Assign names to legacy error classes [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/06/30 07:33:39 UTC, 5 replies.
- Re: [PR] [SPARK-57764][PIPELINES] Add missing error class DUPLICATE_GRAPH_ELEMENT [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/06/30 07:37:40 UTC, 0 replies.
- Re: [PR] [SPARK-57761][SQL] Add missing error class INVALID_XML_SCHEMA_MAP_TYPE [spark] - posted by "uros-b (via GitHub)" <gi...@apache.org> on 2026/06/30 07:40:10 UTC, 0 replies.
- [PR] [SPARK-57777][SQL][CONNECT] Distinguish explicit collation when rendering string literals to SQL [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/30 08:02:37 UTC, 3 replies.
- Re: [PR] [SPARK-57766][SQL] Validate WKB element counts before allocation [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/06/30 08:03:41 UTC, 1 replies.
- [PR] [SPARK-57776][CORE] Add History Server access logging [spark] - posted by "qijiale76 (via GitHub)" <gi...@apache.org> on 2026/06/30 08:13:37 UTC, 0 replies.
- [PR] [SPARK-57560][SQL][TESTS][FOLLOWUP] Update the Java 21 golden file for TIME try arithmetic tests [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/30 08:17:04 UTC, 2 replies.
- [PR] [SPARK-57756][SQL] Move SQL UDF resolution SQLConf construction to common code [spark] - posted by "daniel-lunin-db (via GitHub)" <gi...@apache.org> on 2026/06/30 08:39:41 UTC, 4 replies.
- Re: [PR] [SPARK-57748][SQL] Use a dedicated tree-pattern bit for the TIME to TIMESTAMP cast rewrite in ComputeCurrentTime [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/30 08:58:26 UTC, 2 replies.
- Re: [PR] [SPARK-57555][FOLLOWUP][SQL] Add escape-hatch conf to keep legacy JDBC TIME-to-timestamp mapping [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/30 09:23:32 UTC, 0 replies.
- [PR] [INFRA] Upgrade GitHub Actions artifact actions to v7/v8 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/30 09:24:04 UTC, 0 replies.
- [PR] [MINOR][CORE] Fix swapped depth/width formulas in CountMinSketch class doc [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/30 09:28:22 UTC, 3 replies.
- [PR] [SPARK-57778][SQL] Handle Oracle JDBC objects that are not selectable as tables [spark] - posted by "ivan-leventsov (via GitHub)" <gi...@apache.org> on 2026/06/30 09:38:58 UTC, 6 replies.
- [PR] [SPARK-57780][SQL] Do not classify Postgres permission-denied as a sy… [spark] - posted by "vladanvasi-db (via GitHub)" <gi...@apache.org> on 2026/06/30 09:56:54 UTC, 0 replies.
- Re: [PR] [SPARK-57780][SQL] Do not classify Postgres permission-denied as a syntax error [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2026/06/30 10:03:47 UTC, 3 replies.
- Re: [PR] [INFRA] Reuse docs Docker image and composite action in pages.yml [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/06/30 10:26:13 UTC, 0 replies.
- [PR] [SPARK-57525][CONNECT][4.1] Declarative Pipelines should not throw NoSuchElementException when a run fails without an attached cause [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/30 10:54:40 UTC, 0 replies.
- [PR] [SPARK-57695][CORE] Make TestUtils.recursiveList null-safe by reusing Utils.recursiveList [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/06/30 11:14:20 UTC, 2 replies.
- [PR] [SPARK-57756][SQL] Move SQL UDF default-argument padding to common code [spark] - posted by "daniel-lunin-db (via GitHub)" <gi...@apache.org> on 2026/06/30 12:29:52 UTC, 1 replies.
- [PR] [SPARK-57786][CORE] Disable Spark History Server log access by default [spark] - posted by "benny20xx (via GitHub)" <gi...@apache.org> on 2026/06/30 12:49:34 UTC, 0 replies.
- Re: [PR] [SPARK-57771][INFRA] Use Python 3.11 in `spark-rm` release image [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/06/30 12:58:52 UTC, 3 replies.
- Re: [PR] [SPARK-52825][SQL] Recognize aws-advanced-jdbc-wrapper URL prefix in MySQL/PostgresDialect [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/30 13:27:28 UTC, 3 replies.
- [PR] [SPARK-57555][FOLLOWUP][SQL] Add TimeType support to PostgresDialect [spark] - posted by "shrirangmhalgi (via GitHub)" <gi...@apache.org> on 2026/06/30 14:41:06 UTC, 3 replies.
- [PR] [SPARK-57752][SPARK-57753][SPARK-57754][SQL] Assign names to Hive UDF Java type error conditions [spark] - posted by "michaelmitchell-bit (via GitHub)" <gi...@apache.org> on 2026/06/30 15:49:15 UTC, 4 replies.
- [PR] [SPARK-57577][SQL] Surface timestamp constructor overflow as Spark error condition [spark] - posted by "michaelmitchell-bit (via GitHub)" <gi...@apache.org> on 2026/06/30 17:00:13 UTC, 0 replies.
- Re: [PR] [SPARK-57775][SQL] Return one row for GROUP BY GROUPING SETS (()) over empty input [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/30 17:05:41 UTC, 0 replies.
- [PR] [SPARK-57787][CONNECT] Reuse a persistent local Spark Connect server for faster local startup [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/06/30 17:47:08 UTC, 4 replies.
- [PR] [SPARK-57769][SQL] Add a config to use the earliest offset for date_trunc at a DST fall-back overlap [spark] - posted by "thepinetree (via GitHub)" <gi...@apache.org> on 2026/06/30 19:44:47 UTC, 1 replies.
- Re: [PR] [SPARK-57693][BUILD] Simplify `kubernetes-client` deps management by using BOM [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/30 20:24:17 UTC, 2 replies.
- Re: [PR] [SPARK-56763][SPARK-56535][SPARK-56810][INFRA][3.5] Recover branch-3.5 CI [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/06/30 20:42:28 UTC, 1 replies.
- [PR] [SPARK-57160][CONNECT] Add Spark Connect protocol support for nanosecond-capable timestamp types and literals [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2026/06/30 20:48:54 UTC, 0 replies.
- [PR] [SPARK-57784][SQL] Support the TIME data type in cost-based optimizer statistics estimation [spark] - posted by "yadavay-amzn (via GitHub)" <gi...@apache.org> on 2026/06/30 20:50:53 UTC, 2 replies.
- Re: [PR] [SPARK-57131] Provide configuration option to specify ConfigMap name for dynamic configs [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/30 20:51:12 UTC, 0 replies.
- Re: [PR] [SPARK-57106] Disallow watched namespace changes via dynamic config [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/30 20:51:37 UTC, 1 replies.
- Re: [PR] [SPARK-57679][PYTHON] Fix numpy type checking [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/30 21:14:38 UTC, 1 replies.
- [PR] [SPARK-57708][INFRA] Install zstd in CI container images used by the branch-4.1 scheduler [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/30 21:44:41 UTC, 0 replies.
- Re: [PR] [SPARK-57764][SDP] Add missing error class DUPLICATE_GRAPH_ELEMENT [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/06/30 21:47:34 UTC, 1 replies.
- [PR] [SPARK-57788] Prevent Build CI cancellation between different commits [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/30 22:12:58 UTC, 0 replies.
- [PR] [SPARK-57789] Update `LICENSE-binary` and add `licenses-binary` to describe all bundled libraries [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/30 22:27:29 UTC, 0 replies.
- Re: [PR] [SPARK-57788] Prevent Build CI cancellation between different commits in `main` branch [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/30 22:39:14 UTC, 1 replies.
- [PR] [SPARK-57790][BUILD] Remove `LICENSE-machinist.txt` from `licenses-binary` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/06/30 22:41:50 UTC, 4 replies.
- [PR] [SPARK-57791][4.0][INFRA] Backport CI precompile artifact sharing, Coursier cache unification, and zstd in CI images [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/30 22:56:34 UTC, 0 replies.
- [PR] [SPARK-57792][INFRA][R] Add sparkr docker image to sparkr module [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/30 23:07:31 UTC, 0 replies.
- [PR] [MINOR] Remove branch-4.x "build" icon in README [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/30 23:26:45 UTC, 2 replies.
- Re: [PR] [MINOR] Remove branch-4.x "build_main" icon in README [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/06/30 23:32:21 UTC, 1 replies.