reviews@spark.apache.org, 2025-12

You are viewing a plain text version of this content. The canonical link for it is here.

- Re: [PR] [WIP][SPARK-54316][CORE][PYTHON][SQL] Consolidate `GroupPandasIterUDFSerializer` with `GroupPandasUDFSerializer` [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/12/01 00:16:05 UTC, 0 replies.
- Re: [PR] [SPARK-53446][CORE] Optimize BlockManager remove operations with cached block mappings [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2025/12/01 01:20:03 UTC, 8 replies.
- [PR] [SPARK-54478][SPARK-54479][SPARK-54480][SPARK-54484] Re-enable streaming tests for connect compat test CI [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/12/01 01:30:53 UTC, 3 replies.
- Re: [PR] [SPARK-54548][INFRA] Install `zstandard` python library in Spark Connect post-merge builds [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/12/01 01:51:07 UTC, 0 replies.
- Re: [PR] [SPARK-54536[CORE] Shuffle FetchWaitTime missing first call fetchUpToMaxBytes() open block rpc response time [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2025/12/01 02:22:38 UTC, 3 replies.
- Re: [PR] [SPARK-54088][CORE] When TaskSchedulerImpl searches for an executor to schedule an unschedulable task, it should exclude executors that are pending to remove [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2025/12/01 02:52:59 UTC, 4 replies.
- Re: [PR] [SPARK-54282][BUILD] Read bom version from pom in SBT [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/01 05:30:57 UTC, 7 replies.
- [PR] [WIP][UI] Disallow newline in spark.ui.allowFramingFrom [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/01 06:16:08 UTC, 1 replies.
- [PR] [SPARK-52334][CORE][K8S] update all files, jars, and pyFiles to reference the working directory after they are downloaded [spark] - posted by "TongWei1105 (via GitHub)" <gi...@apache.org> on 2025/12/01 06:37:02 UTC, 8 replies.
- Re: [PR] [SPARK-54550][CONNECT] Handle `ConnectException` gracefully in `SparkConnectStatement.close()` [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/01 06:55:14 UTC, 8 replies.
- Re: [PR] [SPARK-54305][SQL][PYTHON] Add admission control support to Python DataSource streaming API [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/12/01 07:53:09 UTC, 5 replies.
- Re: [PR] [4.0][SPARK-54481][SPARK-54495][SPARK-54483][TEST][PYTHON][CONNECT]Fix failing tests [spark] - posted by "xianzhe-databricks (via GitHub)" <gi...@apache.org> on 2025/12/01 09:20:07 UTC, 4 replies.
- [PR] [SPARK-54557] [SQL] Make `XmlOptions` and `XmlInferSchema` comparable [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/12/01 09:38:25 UTC, 6 replies.
- Re: [PR] [SPARK-54481][SPARK-54495][SPARK-54483][TESTS][PYTHON][CONNECT] Reenable a few spark connect tests [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/12/01 09:47:18 UTC, 2 replies.
- Re: [PR] [SPARK-53733][SQL] Delay `resolveColsLastResort` until all previous `UnresolvedAlias`es are resolved [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/12/01 10:35:46 UTC, 3 replies.
- Re: [PR] [SPARK-54501][SQL] Improve error handling for Hive metastore partition filter failures [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2025/12/01 11:16:03 UTC, 2 replies.
- Re: [PR] [SPARK-54534][SQL] Migrate Hive-related legacy error codes to proper error conditions [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2025/12/01 11:29:35 UTC, 3 replies.
- [PR] [WIP][PYTHON][ML] Don't use pickle to save/load models in `pyspark.ml.connect` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/01 11:35:52 UTC, 4 replies.
- [PR] [SQL][MINOR] Defensive code for number of Partitions in rCTEs [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/12/01 12:34:26 UTC, 1 replies.
- [PR] [SPARK-54558][SQL] Fix Internal Exception when Exception Handlers with no BEGIN/END are used [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2025/12/01 16:54:25 UTC, 9 replies.
- Re: [PR] [SPARK-54468][SDP] Add missing error classes [spark] - posted by "jaceklaskowski (via GitHub)" <gi...@apache.org> on 2025/12/01 17:25:19 UTC, 5 replies.
- Re: [PR] [SPARK-54551][CONNECT][TESTS] Fix random hangs in SparkConnectJdbcDataTypeSuite [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/01 17:46:23 UTC, 7 replies.
- Re: [PR] [SPARK-54549][SDP] Allow full-refresh-all with dp.create_sink (and no flows) [spark] - posted by "jaceklaskowski (via GitHub)" <gi...@apache.org> on 2025/12/01 17:50:32 UTC, 1 replies.
- Re: [PR] [SPARK-54424][SQL] Failures during recaching must not fail operations [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/01 18:08:52 UTC, 3 replies.
- Re: [PR] [SPARK-54439][SQL] KeyGroupedPartitioning and join key size mismatch [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/12/01 18:33:57 UTC, 0 replies.
- Re: [PR] Open source Canon: Burst-aware Memory Allocation Algorithm for Spark@K8S [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2025/12/01 18:52:01 UTC, 11 replies.
- Re: [PR] [SPARK-54450][INFRA] Allow run-tests to accept unittest style string for test names [spark] - posted by "fedimser (via GitHub)" <gi...@apache.org> on 2025/12/01 19:50:47 UTC, 5 replies.
- Re: [PR] [SPARK-54545][INFRA] Allow test case pattern for run-tests [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/12/01 19:52:53 UTC, 2 replies.
- Re: [PR] [SPARK-54325][TESTS] Use custom matcher in ExecutorSuite testThrowable [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/12/01 20:18:10 UTC, 3 replies.
- Re: [PR] [SPARK-53880][SQL] Fix DSv2 in PushVariantIntoScan by adding SupportsPushDownVariants [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/12/01 21:49:01 UTC, 10 replies.
- Re: [PR] [SPARK-54555][PYTHON] Enable Arrow-optimized Python UDFs and Arrow-based PySpark IPC by default [spark] - posted by "dbtsai (via GitHub)" <gi...@apache.org> on 2025/12/01 23:05:38 UTC, 8 replies.
- Re: [PR] [SPARK-54179][SQL] Add Native Support for Apache Tuple Sketches [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2025/12/01 23:25:09 UTC, 42 replies.
- Re: [PR] [SPARK-54544][PYTHON] Enable flake8 F811 check [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/12/01 23:52:57 UTC, 1 replies.
- [PR] [SPARK-54560][SQL] Safe type casting in `QueryPlan._subqueries` [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2025/12/02 00:35:28 UTC, 1 replies.
- Re: [PR] [SPARK-54533][UI] Set metric ExecutorSource.METRIC_RESULT_SIZE with correct value [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/02 01:08:40 UTC, 2 replies.
- [PR] [SPARK-54561][PYTHON] Support breakpoint() for `run-tests.py` [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/02 01:27:31 UTC, 9 replies.
- Re: [PR] [SPARK-54554][SQL] Enable Dynamic Partition Pruning with CommandResult [spark] - posted by "dwsmith1983 (via GitHub)" <gi...@apache.org> on 2025/12/02 01:28:07 UTC, 2 replies.
- [PR] [SPARK-54556][CORE] Rollback succeeding shuffle map stages when shuffle checksum mismatch detected [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2025/12/02 01:31:32 UTC, 12 replies.
- Re: [PR] [SPARK-54423][SS] Introducing OffsetMap to enable Named Streaming Sources [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/12/02 01:31:52 UTC, 1 replies.
- Re: [PR] [SPARK-54388][SS] Introduce StatePartitionReader that scan raw bytes for Single ColFamily [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2025/12/02 01:32:52 UTC, 11 replies.
- Re: [PR] [SPARK-54446][SQL][ML][CONNECT] FPGrowth supports local filesystem with Arrow file format [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/12/02 01:50:32 UTC, 1 replies.
- Re: [PR] [SPARK-54563][UI] Disallow newline in `spark.ui.allowFramingFrom` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/02 04:38:53 UTC, 11 replies.
- [PR] [SPARK-54551][CONNECT][TESTS][FOLLOWUP] Redirect Test Spark connect server output stream to files [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/12/02 04:43:03 UTC, 24 replies.
- Re: [PR] [SPARK-53615][PYTHON] Introduce iterator API for Arrow grouped aggregation UDF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/02 05:54:55 UTC, 1 replies.
- Re: [PR] [SPARK-54536][CORE] Shuffle FetchWaitTime missing collect create client/wait cost [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2025/12/02 06:19:36 UTC, 3 replies.
- [PR] [SPARK-XXXXX][SQL] Refactor SupportsPushDownVariants to be a ScanBuilder mix-in [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/12/02 09:03:20 UTC, 19 replies.
- [PR] [SPARK-54564] [SQL] Make QueryPlanningTracker as HybridAnalyzer field [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/12/02 09:33:22 UTC, 3 replies.
- [PR] [Spark 54563][Config] Disallow newline in spark.ui.allowFramingFrom [spark] - posted by "VindhyaG (via GitHub)" <gi...@apache.org> on 2025/12/02 09:47:10 UTC, 3 replies.
- [PR] [SPARK-54565][CORE] SparkBuildInfo should load `spark-version-info.properties` from its own classloader [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/02 10:00:32 UTC, 6 replies.
- [PR] [SPARK-54568][PYTHON] Avoid unnecessary pandas conversion in create dataframe from ndarray [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/02 11:58:03 UTC, 0 replies.
- [PR] [SPARK-54566][SQL] Enhance SparkSql FileSourceScanExec for easy integration [spark] - posted by "jinchengchenghh (via GitHub)" <gi...@apache.org> on 2025/12/02 12:08:52 UTC, 1 replies.
- [PR] skew-detector [spark] - posted by "zirtoshka (via GitHub)" <gi...@apache.org> on 2025/12/02 13:08:54 UTC, 0 replies.
- [PR] [DOCS] Fix Missing Documentation for SparkSession in Declarative Pipelines (Python) [spark] - posted by "avriiil (via GitHub)" <gi...@apache.org> on 2025/12/02 13:09:49 UTC, 1 replies.
- [PR] [DOCS] Fix typo in spark-standalone.md [spark] - posted by "kepler62f (via GitHub)" <gi...@apache.org> on 2025/12/02 15:04:46 UTC, 6 replies.
- [PR] [SPARK-53095][SQL][FOLLOWUP] Consider Hive 4.1 in HiveVersionSuite and HiveClientImpl [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/12/02 17:19:19 UTC, 1 replies.
- Re: [PR] [SPARK-54412][SQL][TEST] Clean up `v` properly in `identifier-clause.sql` SQL golden file [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/12/02 17:28:29 UTC, 2 replies.
- Re: [PR] [SPARK-54541][SQL] Rename _LEGACY_ERROR_TEMP_1007 and add sqlState [spark] - posted by "AbinayaJayaprakasam (via GitHub)" <gi...@apache.org> on 2025/12/02 17:42:28 UTC, 9 replies.
- [PR] [SPARK-54420][SS] Introduce StatePartitionWriter for Offline Repartitioning [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2025/12/02 18:11:24 UTC, 1 replies.
- Re: [PR] [SPARK-54525][SQL] Disable nested struct coercion in MERGE INTO under a config [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/12/02 18:22:44 UTC, 0 replies.
- Re: [PR] Refactor PythonException so it can take errorClass with sqlstate [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/02 19:03:13 UTC, 2 replies.
- Re: [PR] [SPARK-54572][PYTHON] Support VSCode breakpoints for pyspark [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/02 22:55:37 UTC, 4 replies.
- [PR] [SPARK-54573][SQL] Add test for CONSTRAINTS in case of source with less nested struct field than target [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/12/02 23:00:03 UTC, 1 replies.
- [PR] [SPARK-54450][FOLLOWUP] Relax the restriction of run-tests [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/02 23:14:32 UTC, 4 replies.
- [PR] Revert "[SPARK-54310][SQL] Add `numSourceRows` metric for `MergeIntoExec`" [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/12/02 23:54:44 UTC, 9 replies.
- [PR] [SPARK-54576][SQL] Add documentation for new Datasketches-based aggregate functions [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2025/12/03 01:25:41 UTC, 4 replies.
- Re: [PR] [SPARK-54574][ML][CONNECT] Reenable FPGrowth on connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/03 01:34:43 UTC, 1 replies.
- [PR] [SPARK-54555][PYTHON][TESTS][FOLLOW-UP] Doc build [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/12/03 01:37:37 UTC, 0 replies.
- Re: [PR] [SPARK-54521][SQL] Add to and from WKB for Geometry type [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/12/03 01:39:21 UTC, 5 replies.
- Re: [PR] [SPARK-54555][PYTHON][TESTS][FOLLOW-UP] Skip pyspark-pandas doctest [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/03 02:14:37 UTC, 1 replies.
- Re: [PR] [SPARK-54570][PYTHON] Propagate the error class correctly in Spark Connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/03 02:28:10 UTC, 7 replies.
- [PR] [SPARK-54577][PYTHON] Optimize Py4J calls in schema inference [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/03 03:01:46 UTC, 2 replies.
- [PR] [SPARK-54555][PYTHON][TESTS][FOLLOW-UP] Fix pyspark-pandas doctest [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/12/03 04:26:36 UTC, 0 replies.
- [PR] [SPARK-54578][SQL] Perform Code Cleanup on `AssignmentUtils` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/12/03 05:30:43 UTC, 2 replies.
- [PR] [SPARK-54562] Block eager analysis / execution inside flow function from the server side [spark] - posted by "SCHJonathan (via GitHub)" <gi...@apache.org> on 2025/12/03 06:56:51 UTC, 6 replies.
- Re: [PR] [SPARK-54555][PYTHON][TESTS] Set `spark.sql.execution.pandas.structHandlingMode` in pyspark pandas doctest [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/03 07:43:21 UTC, 2 replies.
- [PR] [SPARK-54575][PYTHON][TESTS] Reenable test `SparkConnectCreationTests.test_with_none_and_nan` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/03 10:13:26 UTC, 2 replies.
- Re: [PR] [SPARK-54539][SQL] TaskMetrics add spillTime metrics [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2025/12/03 10:24:32 UTC, 6 replies.
- [PR] [SPARK-51966][PYTHON] Replace select.select() with select.poll() when running on POSIX os [spark] - posted by "wjszlachta-man (via GitHub)" <gi...@apache.org> on 2025/12/03 11:21:14 UTC, 29 replies.
- [PR] [WIP][SPARK-54553][VOLCANO] Supports receiving podgroup JSON format configurations when using Volcano. [spark] - posted by "ruanwenjun (via GitHub)" <gi...@apache.org> on 2025/12/03 12:12:43 UTC, 0 replies.
- Re: [PR] [SPARK-54580][SQL] Consider Hive 4.1 in HiveVersionSuite and HiveClientImpl [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/12/03 13:38:45 UTC, 8 replies.
- Re: [PR] [WIP][SPARK-54571][CORE] Use LZ4 safeDecompressor [spark] - posted by "yawkat (via GitHub)" <gi...@apache.org> on 2025/12/03 14:08:17 UTC, 19 replies.
- [PR] [SPARK-54581] Making fetchsize option case-insensitive for Postgres connector [spark] - posted by "marko-sisovic-db (via GitHub)" <gi...@apache.org> on 2025/12/03 15:48:15 UTC, 1 replies.
- Re: [PR] [SPARK-54279][CONNECT] Fix empty observation results caused by delayed asynchronous metrics processing [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/12/03 16:17:05 UTC, 0 replies.
- [PR] [WIP] Adding `.name()` to DataStreamReader to enable naming streaming sources [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/12/03 18:05:40 UTC, 0 replies.
- Re: [PR] Add Options for DataFrameWriter [spark-connect-go] - posted by "caldempsey (via GitHub)" <gi...@apache.org> on 2025/12/03 18:39:42 UTC, 3 replies.
- [PR] [WIP][SPARK-54579][SPARK-54575] Fix NaN handling in `createDataFrame` with Arrow [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/12/03 19:07:17 UTC, 2 replies.
- [PR] [SPARK-54583] Add SQLConf to enable use of OffsetMap [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/12/03 19:11:39 UTC, 0 replies.
- [PR] [SPARK-54582][SQL] Add Time Type Statistics Collection Support [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/12/03 19:20:39 UTC, 2 replies.
- Re: [PR] [INFRA] Cancel workflow if a new commit is pushed [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/03 19:44:29 UTC, 2 replies.
- [PR] [SPARK-54585][SS] Always set changelogWriter to None on rollback [spark] - posted by "dylanwong250 (via GitHub)" <gi...@apache.org> on 2025/12/03 20:06:24 UTC, 4 replies.
- [PR] [SPARK-5192] Fix type handling of namedTuple for transfromWithStateInPandas [spark] - posted by "zeruibao (via GitHub)" <gi...@apache.org> on 2025/12/03 22:04:18 UTC, 0 replies.
- Re: [PR] [SPARK-5192] Fix type handling of namedTuple for transfromWithState [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/03 22:38:03 UTC, 4 replies.
- Re: [PR] [SPARK-54583][SS] Add SQLConf to enable use of OffsetMap [spark] - posted by "dylanwong250 (via GitHub)" <gi...@apache.org> on 2025/12/03 22:39:14 UTC, 11 replies.
- [PR] [SPARK-54587][PYTHON] Consolidate all runner_conf related code [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/03 22:57:29 UTC, 2 replies.
- Re: [PR] refactor: Remove python 2 code [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/04 00:29:34 UTC, 1 replies.
- Re: [PR] [SPARK-53347][PROTOBUF] Fix proto deserialization to allow false and null values [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/04 00:29:35 UTC, 0 replies.
- Re: [PR] Update supported_api_gen.py: remove an invalid escape sequence "\_" using a raw string [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/04 00:29:36 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-52090] retry fetch on ExecutorDeadException if block is found on another executor [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/04 00:29:37 UTC, 1 replies.
- Re: [PR] [SPARK-53296][CORE] ESS exit main thread in case boss thread exits [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/04 00:29:38 UTC, 0 replies.
- Re: [PR] [SPARK-54253][Geo][CONNECT][FOLLOWUP] Enforce geospatial support config in Spark Connect [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/04 00:35:14 UTC, 2 replies.
- [PR] [SPARK-54419][SS] Offline Repartition State Reader Supports Multi-Column Families [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2025/12/04 00:53:54 UTC, 13 replies.
- [PR] [SPARK-53616] Introduce iterator API for pandas grouped agg UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/12/04 01:06:22 UTC, 0 replies.
- Re: [PR] [SPARK-54316][CORE][PYTHON][SQL] Consolidate `GroupPandasIterUDFSerializer` with `GroupPandasUDFSerializer` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/04 01:16:07 UTC, 1 replies.
- Re: [PR] [SPARK-54386][CONNECT][TESTS] Fix for potential deadlock in the JavaEncoderSuite [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/04 02:33:19 UTC, 4 replies.
- [PR] [SPARK-54572][PYTHON][FOLLOWUP] Add a file lock for the VSCode magic file [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/04 03:18:26 UTC, 3 replies.
- Re: [PR] [SPARK-51559][SQL] Make max broadcast table size configurable [spark] - posted by "pratham76 (via GitHub)" <gi...@apache.org> on 2025/12/04 05:49:21 UTC, 0 replies.
- [PR] [SPARK-54591][BUILD] Upgrade `commons-lang3` to 3.20.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/12/04 06:40:09 UTC, 4 replies.
- [PR] [SPARK-54588][SQL] Add time_format function to convert TIME values to formatted string representations [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/12/04 07:26:58 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-54314][PYTHON][CONNECT] Improve Server-Side debuggability in Spark Connect by capturing client application's file name and line numbers [spark] - posted by "sfc-gh-saroskar (via GitHub)" <gi...@apache.org> on 2025/12/04 07:51:04 UTC, 0 replies.
- [PR] [SPARK-54592][ML] Make `estimatedSize` private [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/04 10:28:10 UTC, 2 replies.
- [PR] [SPARK-54592][ML][4.1] Make `estimatedSize` private [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/04 10:39:48 UTC, 1 replies.
- [PR] [SPARK-54330][PYTHON][FOLLOW-UP] Fetch `spark.sql.execution.pandas.inferPandasDictAsMap` with other configs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/04 10:47:57 UTC, 1 replies.
- [PR] [SPARK-54593][SQL] Expand DPP for LogicalRelation and LogicalRDD [spark] - posted by "dwsmith1983 (via GitHub)" <gi...@apache.org> on 2025/12/04 13:09:53 UTC, 0 replies.
- [PR] [SPARK-54594][UI] Skip duplicated edges starting from subqueries in plan dot [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/12/04 13:25:04 UTC, 2 replies.
- Re: [PR] [SPARK-54320][UI] Fix Job DAG overlapping [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/12/04 13:35:55 UTC, 1 replies.
- Re: [PR] [SPARK-54573][SQL][TESTS] Add test for CONSTRAINTS in case of source with less nested struct field than target [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/04 16:53:34 UTC, 1 replies.
- Re: [PR] [SPARK-54367][Connect]Propagate close() from SessionState to CatalogPlugins to prevent leak [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/12/04 18:07:44 UTC, 6 replies.
- Re: [PR] [SPARK-54581][SQL] Making fetchsize option case-insensitive for Postgres connector [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/04 18:28:15 UTC, 9 replies.
- Re: [PR] [SPARK-54403][SQL][Metric View] Add YAML serde infrastructure for metric views [spark] - posted by "linhongliu-db (via GitHub)" <gi...@apache.org> on 2025/12/04 19:13:18 UTC, 21 replies.
- Re: [PR] [SPARK-54405][SQL][Metric View] CREATE command and SELECT query resolution [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/04 19:24:43 UTC, 36 replies.
- [PR] [SPARK-54595][SQL] Keep existing behavior without SCHEMA EVOLUTION clause [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/12/04 20:06:59 UTC, 2 replies.
- Re: [PR] [SPARK-49635][SQL] Remove ANSI config suggestion in CAST error messages [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/12/04 20:09:05 UTC, 8 replies.
- Re: [PR] [SPARK-53805][SQL] Push Variant into DSv2 scan [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/04 20:47:56 UTC, 0 replies.
- [PR] [SPARK-54597][BUILD] Upgrade `lz4-java` to 1.10.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/04 22:49:01 UTC, 18 replies.
- [PR] [SPARK-54438] Consolidate ArrowStreamAggArrowIterUDFSerializer into ArrowStreamAggArrowUDFSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/12/04 23:02:23 UTC, 0 replies.
- [PR] Revert "[SPARK-54423][SS] Introducing OffsetMap to enable Named Streaming Sources" [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/12/04 23:13:59 UTC, 5 replies.
- [PR] [SPARK-54598] Extract logic of `read_all_udfs` [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/12/05 00:22:55 UTC, 0 replies.
- Re: [PR] [SPARK-54599] Refactor PythonException so it can take errorClass with sqlstate [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/05 00:27:26 UTC, 0 replies.
- Re: [PR] [SPARK-54598][PYTHON] Extract logic to read UDFs [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/05 01:32:54 UTC, 5 replies.
- [PR] [SPARK-54563][FOLLOW-UP][UI][TEST] Add test to ensure Jetty sanitizes newlines in X-Frame-Options header [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/12/05 01:39:11 UTC, 4 replies.
- Re: [PR] [SPARK-54600][PYTHON][ML] Don't use pickle to save/load models in `pyspark.ml.connect` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/05 01:53:48 UTC, 2 replies.
- [PR] [SPARK-54600][PYTHON][ML][3.5] Don't use pickle to save/load models in pyspark.ml.connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/05 02:32:59 UTC, 10 replies.
- Re: [PR] [SPARK-54563][UI][TEST] Add test to ensure Jetty sanitizes newlines in X-Frame-Options header [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/05 02:55:45 UTC, 3 replies.
- Re: [PR] [SPARK-54420][SS] Introduce Offline Repartitioning StatePartitionWriter for Single Column Family [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2025/12/05 03:24:55 UTC, 10 replies.
- [PR] [SPARK-46741][SQL] Cache Table with CTE won't work [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2025/12/05 03:25:14 UTC, 35 replies.
- Re: [PR] [SPARK-53616][PYTHON] Introduce iterator API for pandas grouped agg UDF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/05 03:40:02 UTC, 9 replies.
- [PR] [SPARK-54601][SQL] Use DATETIME2 for TimestampType in MSSQL Server to preserve microseconds precision [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/12/05 04:10:53 UTC, 0 replies.
- [PR] [SPARK-54602][BUILD] Update `NOTICE-binary` with `Netty 4.2.7` license [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/05 04:17:30 UTC, 0 replies.
- Re: [PR] [SPARK-54602][BUILD] Update `NOTICE-binary` with `Netty` `4.2.7.Final` license [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/05 04:22:19 UTC, 10 replies.
- Re: [PR] [SPARK-54392][SS] Optimize JVM-Python communication for TWS initial state [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/12/05 04:22:26 UTC, 10 replies.
- [PR] fix: typo [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/12/05 06:05:41 UTC, 0 replies.
- [PR] [SPARK-54603][DOCS] Fix grammar issues in python_data_source.rst [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/12/05 06:11:51 UTC, 0 replies.
- [PR] [SPARK-54605][K8S] Append custom driver env after spark-env.sh to ensure precedence [spark] - posted by "littlexyw (via GitHub)" <gi...@apache.org> on 2025/12/05 07:06:11 UTC, 3 replies.
- [PR] [SPARK-54606][DOCS] Fix `spark.eventLog.rolling.enabled` deafult value [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/05 07:34:06 UTC, 1 replies.
- [PR] [SPARK-51165][DOCS] Fix typo in migration guide [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/05 07:38:00 UTC, 0 replies.
- Re: [PR] [SPARK-51165][DOCS][FOLLOWUP] Fix typo in migration guide [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/05 07:39:40 UTC, 2 replies.
- [PR] [SPARK-54607][CORE] Remove the unused method `toStringHelper` from `AbstractFetchShuffleBlocks.java` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/12/05 07:45:04 UTC, 0 replies.
- [PR] [DRAFT][SQL] Allow DROP TABLE to drop VIEW [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/12/05 09:15:55 UTC, 2 replies.
- Re: [PR] [WIP][DRAFT][SQL] Allow DROP TABLE to drop VIEW [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/12/05 10:03:56 UTC, 1 replies.
- [PR] [SPARK-54608][PYTHON] Avoid double caching of type converter in UDTF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/05 10:59:16 UTC, 1 replies.
- [PR] [SPARK-54609] Disable TIME type by default [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2025/12/05 14:37:51 UTC, 0 replies.
- [PR] Allow name patterns for run-tests.py [spark] - posted by "canyang25 (via GitHub)" <gi...@apache.org> on 2025/12/05 16:11:57 UTC, 2 replies.
- Re: [PR] [SPARK-54609][SQL] Disable TIME type by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/05 17:32:35 UTC, 53 replies.
- Re: [PR] [SPARK-54607][CORE] Remove unused method `toStringHelper` from `AbstractFetchShuffleBlocks.java` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/05 18:08:58 UTC, 5 replies.
- [PR] [SPARK-54610][SDP][DOCS] Improve SDP Programming Guide [spark] - posted by "jaceklaskowski (via GitHub)" <gi...@apache.org> on 2025/12/05 18:09:58 UTC, 7 replies.
- [PR] [SPARK-54611][BUILD] Upgrade `lz4-java` to 1.10.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/05 18:32:33 UTC, 3 replies.
- [PR] Bump at.yawk.lz4:lz4-java from 1.10.0 to 1.10.1 [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/12/05 18:56:11 UTC, 2 replies.
- Re: [PR] [SPARK-53747][CORE] escape spark.app.name [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/12/05 19:17:55 UTC, 4 replies.
- [PR] [SPARK-54612][BUILD] Upgrade `scala-maven-plugin` to 4.9.7 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/05 19:47:57 UTC, 5 replies.
- [PR] [SPARK-54613][BUILD] Upgrade `ammonite` to 3.0.4 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/05 19:53:51 UTC, 4 replies.
- Re: [PR] [SPARK-5192][SS][PYTHON] Fix type handling of namedTuple for transfromWithState [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/05 20:37:09 UTC, 1 replies.
- [PR] Deploy the assembly as an artifact [spark] - posted by "rmannibucau (via GitHub)" <gi...@apache.org> on 2025/12/05 21:11:06 UTC, 0 replies.
- [PR] [SPARK-54614][BUILD] Upgrade `tink` to 1.19.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/05 21:12:13 UTC, 4 replies.
- Re: [PR] [SPARK-54438][PYTHON] Consolidate ArrowStreamAggArrowIterUDFSerializer into ArrowStreamAggArrowUDFSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/12/05 22:31:08 UTC, 4 replies.
- Re: [PR] [SPARK-54595][SQL] Keep existing behavior of MERGE INTO without SCHEMA EVOLUTION clause [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/12/05 22:35:54 UTC, 15 replies.
- [PR] [SPARK-54615] Always pass runner_conf to python worker [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/05 22:40:07 UTC, 0 replies.
- [PR] [SPARK-54616][SQL][4.1] Mark `SupportsPushDownVariants` as `Experimental` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/05 22:40:41 UTC, 3 replies.
- [PR] [SPARK-54443][SS] Partition key extraction for all streaming stateful operators [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2025/12/05 22:43:15 UTC, 9 replies.
- [PR] [SPARK-54618][SQL] Promote `LocalScan` to `Stable` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/05 23:08:23 UTC, 4 replies.
- [PR] [SPARK-54617] Enable Arrow Grouped Iter Aggregate UDF registration for SQL [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/12/05 23:11:19 UTC, 0 replies.
- [PR] [SPARK-XXXXX][SQL] Add safety check in ObservationManager to avoid Observation blocking [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/12/05 23:29:03 UTC, 4 replies.
- [PR] [SPARK-54619] Add a sanity check for configuration numbers [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/05 23:50:47 UTC, 1 replies.
- Re: [PR] [SPARK-53396][SQL] Improve error message when input of `GetStructField` is not `StructType` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/06 00:27:58 UTC, 1 replies.
- Re: [PR] [SPARK-53293][SQL] Modify exprIdToOrdinal implementation for speedup on queries with wide tables [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/06 00:28:00 UTC, 1 replies.
- [PR] [SPARK-54621][SQL] Merge Into Update Set * preserve nested fields if …coerceNestedTypes is enabled [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/12/06 00:46:21 UTC, 41 replies.
- [PR] [SPARK-54622][SQL] Promote `RequiresDistributionAndOrdering` and its required interfaces to `Evolving` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/06 01:38:11 UTC, 5 replies.
- Re: [PR] [SPARK-54620][SQL] Add safety check in ObservationManager to avoid Observation blocking [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/12/06 02:18:21 UTC, 10 replies.
- Re: [PR] Change volumeMounts and volumes types to array [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/12/06 02:55:42 UTC, 0 replies.
- [PR] [SPARK-54623][PYTHON][TEST] Add coverage test for UDTF null checker [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/06 03:26:13 UTC, 2 replies.
- [PR] Spark 54595 reapply [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/12/06 05:32:47 UTC, 0 replies.
- [PR] [SPARK-54624][UI] Ensure user name in historypage get escaped [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/12/06 05:48:13 UTC, 4 replies.
- [PR] [WIP][SS] Adding versioning and SQLConf to control OffsetLog version [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/12/06 06:16:40 UTC, 3 replies.
- [PR] [SPARK-54625][SQL] UTF8String#reverse should check offset and length on copying [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/12/06 06:20:53 UTC, 1 replies.
- Re: [PR] Naming sources again [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/12/06 06:34:50 UTC, 0 replies.
- Re: [PR] Wip naming sources [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/12/06 06:34:55 UTC, 0 replies.
- Re: [PR] [WIP] Sequential Union PoC [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/12/06 06:35:09 UTC, 0 replies.
- [PR] [SPARK-54626][BUILD] Upgrade gson to `2.13.2` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/12/06 06:45:50 UTC, 1 replies.
- Re: [PR] [SPARK-53622][CORE][TEST] Improve `UninterruptibleThreadSuite` [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/12/06 07:20:31 UTC, 11 replies.
- Re: [PR] [SPARK-53575][CORE] Retry entire consumer stages when checksum mismatch detected for a retried shuffle map task [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/12/06 07:44:26 UTC, 12 replies.
- Re: [PR] [SPARK-53807][SPARK-50771][CORE] Fix race condition issues between `unlock` and `releaseAllLocksForTask` in `BlockInfoManager` [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/12/06 08:16:06 UTC, 1 replies.
- Re: [PR] Update DAGScheduler.scala [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/12/06 08:21:32 UTC, 1 replies.
- Re: [PR] [SPARK-38117][CORE] Expose stage level metrics in prometheus endpoint [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/12/06 08:42:13 UTC, 0 replies.
- Re: [PR] [SPARK-53636][CORE] Fix thread-safety issue in SortShuffleManager.unregisterShuffle [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/12/06 08:45:36 UTC, 0 replies.
- Re: [PR] [SPARK-53955][CORE][3.5] Prefer to detect Java Home from env JAVA_HOME on finding jmap for JDK 8 [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/12/06 08:49:44 UTC, 1 replies.
- Re: [PR] [SPARK-54086][CORE][SHUFFLE] Support `IO_URING` Netty IO Mode [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/12/06 09:18:00 UTC, 2 replies.
- Re: [PR] [SPARK-54193][SHUFFLE] Deprecated spark.shuffle.server.finalizeShuffleMergeThreadsPercent [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/12/06 09:28:54 UTC, 3 replies.
- Re: [PR] [SPARK-53898][CORE] Fix race conditions between query cancellation and task completion triggered by eager shuffle cleanup [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/12/06 09:35:24 UTC, 1 replies.
- Re: [PR] [SPARK-54259][CORE] Downgrade "Shutdown hook called" messages from INFO to DEBUG [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/12/06 09:39:10 UTC, 4 replies.
- Re: [PR] [SPARK-54087][CORE] Spark Executor launch task failed should return task killed message [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/12/06 09:48:10 UTC, 3 replies.
- Re: [PR] [SPARK-53209][YARN] Add ActiveProcessorCount JVM option to YARN executor and AM [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/12/06 09:54:20 UTC, 8 replies.
- Re: [PR] [SPARK-54395][SHUFFLE] RemoteBlockPushResolver class repeatedly initializes ObjectMapper [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/12/06 09:56:57 UTC, 0 replies.
- Re: [PR] [SPARK-54489][CORE] Avoid returning corrupted Kryo objects [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/12/06 10:03:59 UTC, 2 replies.
- Re: [PR] [SPARK-53791][CORE][SQL] Make the rename operations multi-threaded. [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/12/06 10:14:59 UTC, 0 replies.
- Re: [PR] [SPARK-44976] Utils.getCurrentUserName should return the full principal name [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/12/06 10:17:40 UTC, 0 replies.
- Re: [PR] [MINOR][DOCS] Update DAGScheduler.scala [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/06 15:15:25 UTC, 0 replies.
- [PR] [SPARK-54627][PYTHON] Remove redundant initializations in serializers [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/12/06 17:09:04 UTC, 2 replies.
- Re: [PR] [SPARK-54619][PYTHON] Add a sanity check for configuration numbers [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/06 18:48:18 UTC, 7 replies.
- [PR] [SPARK-54628][PYTHON] Remove all unnecessary explicit super() arguments [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/06 19:58:50 UTC, 2 replies.
- Re: [PR] [SPARK-54442][SQL] Add numeric conversion functions for TIME type [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/12/06 23:07:25 UTC, 1 replies.
- [PR] [SPARK-54442][SQL][FOLLOWUP]Add codegen for TIME numeric conversion functions [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/12/07 04:24:14 UTC, 0 replies.
- [PR] [SPARK-54629][CONNECT][TEST] Supplement test coverage for getString with BINARY type (UTF-8) [spark] - posted by "xu20160924 (via GitHub)" <gi...@apache.org> on 2025/12/07 05:08:08 UTC, 4 replies.
- [PR] [SPARK-53615][FOLLOWUP][PYTHON][TEST] Fix test case for arrow grouped agg UDF partial consumption [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/12/07 06:07:44 UTC, 3 replies.
- [PR] [SPARK-54372][SQL] ANSI mode should reject avg/sum on timestamp types [spark] - posted by "ashrithb (via GitHub)" <gi...@apache.org> on 2025/12/07 06:16:23 UTC, 0 replies.
- [PR] [SPARK-54631][PYTHON] Add profiler support for Arrow Grouped Iter Aggregate UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/12/07 07:04:41 UTC, 1 replies.
- [PR] [SPARK-27853][SQL] Enable custom partitioning logic for Dataset via Partitioner [spark] - posted by "yushesp (via GitHub)" <gi...@apache.org> on 2025/12/07 09:16:40 UTC, 4 replies.
- [PR] [SPARK-54630][SQL] Add date_bucket function for arbitrary interval bucketing of dates [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/12/07 17:09:30 UTC, 0 replies.
- [PR] [SPARK-54068][PYTHON] Fix PySpark feather serialization with PyArrow 22.0.0 [spark] - posted by "ashrithb (via GitHub)" <gi...@apache.org> on 2025/12/07 17:50:57 UTC, 4 replies.
- Re: [PR] [SPARK-33863][PYTHON] Respect session timezone in udf workers [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/07 18:47:10 UTC, 6 replies.
- [PR] [SPARK-54632][PYTHON] Add the option to use ruff for lint [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/07 19:57:37 UTC, 5 replies.
- Re: [PR] [SPARK-54442][SQL][FOLLOWUP] Add codegen for TIME numeric conversion functions [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/12/07 22:39:48 UTC, 35 replies.
- Re: [PR] [SPARK-54615][PYTHON] Always pass runner_conf to python worker [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/12/07 22:49:44 UTC, 1 replies.
- [PR] [SPARK-54087][CORE][FOLLOWUP] Spark Executor launch task failed return task killed message should not special handling OOM [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2025/12/08 02:29:25 UTC, 9 replies.
- Re: [PR] [SPARK-54068][PYTHON] Fix `to_feather` to support PyArrow 22.0.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/08 05:19:07 UTC, 1 replies.
- [PR] [SPARK-54635][BUILD] Remove commons-lang3 from network-shuffle [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/08 06:33:14 UTC, 1 replies.
- [PR] [SPARK-54620][SQL][3.5] Add safety check in ObservationManager to avoid Observation blocking [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/12/08 07:25:53 UTC, 9 replies.
- [PR] [SPARK-54636][BUILD][YARN] Correctly relocate Netty native libs for YARN ESS [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/08 07:55:46 UTC, 3 replies.
- Re: [PR] [SPARK-54553][VOLCANO] Supports receiving podgroup JSON format configurations when using Volcano. [spark] - posted by "ruanwenjun (via GitHub)" <gi...@apache.org> on 2025/12/08 09:03:28 UTC, 0 replies.
- [PR] [SPARK-54449][SPARK-UI] : Storage Memory off heap size should be considered only when off heap is enabled [spark] - posted by "VindhyaG (via GitHub)" <gi...@apache.org> on 2025/12/08 09:40:03 UTC, 0 replies.
- Re: [PR] [WIP] Deploy the assembly as an artifact [spark] - posted by "rmannibucau (via GitHub)" <gi...@apache.org> on 2025/12/08 12:39:06 UTC, 11 replies.
- [PR] [SPARK-54637][CONNECT] Add SQL API test helpers to SparkConnectServerTest [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2025/12/08 14:56:03 UTC, 2 replies.
- [PR] [SPARK-54638][SQL][TEST] reuse statement instaces if possible in SparkConnectJdbcDataTypeSuite [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/08 15:46:14 UTC, 3 replies.
- [PR] [SPARK-54411][SS] Introduce Repartition Writer that Support Multi-CF [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2025/12/08 17:52:13 UTC, 8 replies.
- Re: [PR] [SPARK-54596][CORE][K8S] Burst-aware Memory Allocation Algorithm for Spark@K8S [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/08 18:03:53 UTC, 4 replies.
- Re: [PR] [SPARK-54638][SQL][TEST] Reuse statement instances if possible in `SparkConnectJdbcDataTypeSuite` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/08 19:06:59 UTC, 1 replies.
- [PR] [SPARK-54639][PYTHON] Avoid unnecessary Table creation in Arrow serializers [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/12/08 19:47:22 UTC, 3 replies.
- [PR] [SPARK-54640][PYTHON] Replace select.select with select.poll on UNIX [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/08 20:04:38 UTC, 3 replies.
- [PR] [SPARK-54641][BUILD] Upgrade `ammonite` to 3.0.5 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/08 20:50:39 UTC, 6 replies.
- [PR] [SPARK-54634][SQL] Add clear error message for empty IN predicate [spark] - posted by "sahilkumarsingh (via GitHub)" <gi...@apache.org> on 2025/12/08 20:56:22 UTC, 4 replies.
- [PR] [SPARK-54337][PS] Add support for PyCapsule to Pyspark [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2025/12/08 20:58:43 UTC, 19 replies.
- [PR] [SPARK-54642][BUILD] Upgrade AWS SDK v2 to 2.35.4 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/08 21:33:18 UTC, 3 replies.
- [PR] [SPARK-54643] Run missing pyspark pipelines tests [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/12/08 22:22:06 UTC, 0 replies.
- [PR] [SPARK-54644][PYTHON][TEST] Always stop the query before await it [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/08 22:30:01 UTC, 0 replies.
- [PR] Spark 51376 - TransformWithState should prescribe RocksDB in its error message when HDFS is in use [spark] - posted by "SidGanesh41053 (via GitHub)" <gi...@apache.org> on 2025/12/08 22:41:12 UTC, 1 replies.
- [PR] [SPARK-54645][BUILD] Upgrade Scala to 2.13.18 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/08 22:52:33 UTC, 6 replies.
- [PR] [SPARK-54646][BUILD] Upgrade `gcs-connector` to 2.2.29 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/08 23:37:28 UTC, 4 replies.
- [PR] [SPARK-54572][PYTHON][FOLLOWUP] Rule out some process and add a warning for zip file [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/09 00:17:33 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-53292] Make CreateResourceProfileCommand in SparkConnectPlanner side effect free [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/09 00:29:54 UTC, 1 replies.
- Re: [PR] [DRAFT] Cluster mode HiveThriftServer2 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/09 00:29:55 UTC, 1 replies.
- Re: [PR] [DRAFT][DO-NOT-REVIEW][SPARK-51XXX][SQL] Enable implicit cast from STRING to TIME type [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/09 00:29:57 UTC, 2 replies.
- Re: [PR] [WIP][SQL] Clarify schema mismatch types in insertInto error [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/09 00:29:59 UTC, 1 replies.
- Re: [PR] [DRAFT] Parameter markers in DDL. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/09 00:30:00 UTC, 1 replies.
- Re: [PR] Fix-AQE-OOM [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/09 00:30:01 UTC, 1 replies.
- Re: [PR] Initial commit [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/09 00:30:03 UTC, 1 replies.
- Re: [PR] [Test] [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/09 00:30:06 UTC, 1 replies.
- Re: [PR] Fabric Spark - EH Connector [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/09 00:30:06 UTC, 1 replies.
- [PR] [SPARK-54441][INFRA][FOLLOWUP] Save coverage even when an exception is raised [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/09 00:31:27 UTC, 2 replies.
- [PR] [SPARK-54647][PYTHON] Support User-Defined Aggregate Functions (UDAF) [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/12/09 00:35:13 UTC, 1 replies.
- [PR] [DOCS] Add cross-session note to cache/persist public APIs [spark] - posted by "yyanyy (via GitHub)" <gi...@apache.org> on 2025/12/09 01:51:20 UTC, 2 replies.
- Re: [PR] [SPARK-54629][CONNECT][TEST] Refactor fully-qualified class references to imports in SparkConnectJdbcDataTypeSuite [spark] - posted by "xu20160924 (via GitHub)" <gi...@apache.org> on 2025/12/09 04:30:14 UTC, 5 replies.
- [PR] [SPARK-54648][BUILD][4.0] Upgrade Jersey to 3.0.18 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/09 05:07:46 UTC, 6 replies.
- [PR] [SPARK-54649][BUILD][3.5] Upgrade Jersey to 2.47 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/09 05:15:13 UTC, 6 replies.
- [PR] [SPARK-54650][PYTHON] Move int to decimal conversion into `_create_converter_from_pandas` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/09 06:01:59 UTC, 2 replies.
- Re: [PR] [SPARK-54617][PYTHON][SQL] Enable Arrow Grouped Iter Aggregate UDF registration for SQL [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/09 06:39:19 UTC, 1 replies.
- [PR] [SPARK-54651][CORE] Driver should delete temporary files when exiting during commit process [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2025/12/09 08:09:03 UTC, 31 replies.
- [PR] [SPARK-54652] Complete conversion of IDENTIFIER() [spark] - posted by "aleksandr-chernousov-db (via GitHub)" <gi...@apache.org> on 2025/12/09 15:32:42 UTC, 0 replies.
- Re: [PR] [SPARK-54643][SDP][PYTHON][TESTS] Run missing pyspark pipelines tests in CI [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/09 15:59:09 UTC, 1 replies.
- Re: [PR] [SPARK-54637][CONNECT][TESTS] Add SQL API test helpers to SparkConnectServerTest [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/09 16:02:26 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-54652] Complete conversion of IDENTIFIER() [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2025/12/09 18:02:25 UTC, 17 replies.
- Re: [PR] [SPARK-53998][TESTS] Add addition E2E tests for RTM [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2025/12/09 18:22:51 UTC, 5 replies.
- Re: [PR] [SPARK-54653][DOCS] Add cross-session note to cache/persist public APIs [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/12/09 18:30:17 UTC, 4 replies.
- [PR] [SPARK-54441][INFRA][FOLLOWUP] Enforce new forked process to create its own coverage object [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/09 19:12:57 UTC, 0 replies.
- [PR] [MINOR][TEST] Remove some unnecessary imports in tests [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/09 20:06:23 UTC, 0 replies.
- [PR] [SPARK-54450][FOLLOWUP] Add py4j to sys path to support import check [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/09 22:01:24 UTC, 5 replies.
- Re: [PR] [MINOR][TESTS] Remove some unnecessary imports in tests [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/12/09 22:18:34 UTC, 1 replies.
- Re: [PR] [SPARK-54441][INFRA][FOLLOW-UP] Enforce new forked process to create its own coverage object [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/12/09 22:19:47 UTC, 1 replies.
- Re: [PR] [SPARK-54644][PYTHON][SS][TESTS] Always stop the query before await it [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/12/09 22:20:10 UTC, 2 replies.
- [PR] [SPARK-54655] [SS] Reduce test time for StateStoreCoordinatorSuite [spark] - posted by "liviazhu (via GitHub)" <gi...@apache.org> on 2025/12/09 23:14:00 UTC, 8 replies.
- Re: [PR] [SPARK-54656][SQL] Refactor SupportsPushDownVariants to be a ScanBuilder mix-in [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/12/09 23:29:31 UTC, 17 replies.
- [PR] [SPARK-54632][FOLLOWUP] Enable ruff on our CI and lint-python [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/10 00:27:05 UTC, 4 replies.
- [PR] [SPARK-54658] Add `Apache DataFusion Comet` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/10 00:34:35 UTC, 8 replies.
- [PR] Optimize partitions feature [spark] - posted by "dotsering (via GitHub)" <gi...@apache.org> on 2025/12/10 01:02:36 UTC, 1 replies.
- [PR] A new feature to optimize partitions size and thus count [spark] - posted by "dotsering (via GitHub)" <gi...@apache.org> on 2025/12/10 01:35:37 UTC, 1 replies.
- Re: [PR] [SPARK-54585][SS] Fix State Store rollback when thread is in interrupted state [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/12/10 01:55:37 UTC, 6 replies.
- Re: [PR] [SPARK-54605][K8S] Override default spark env in driver pod [spark] - posted by "littlexyw (via GitHub)" <gi...@apache.org> on 2025/12/10 02:39:18 UTC, 5 replies.
- [PR] [SPARK-54659]Enhance gradle task 'generateConfPropsDoc' to account for recent changes [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/12/10 03:48:14 UTC, 2 replies.
- [PR] [WIP][SPARK-54660][SS] Add RTM trigger to python and tests [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2025/12/10 05:49:05 UTC, 1 replies.
- [PR] [SPARK-54650][PYTHON][FOLLOW-UP] Apply `pandas.api.types.is_integer_dtype` to check the series dtype [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/10 06:20:09 UTC, 2 replies.
- [PR] [SPARK-54340][PYTHON][FOLLOW-UP] Add link and examples for `run-with-viztracer` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/10 09:01:04 UTC, 1 replies.
- [PR] [SPARK-54662][PYTHON] Add `viztracer` and `debugpy` in `dev/requirements.txt` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/10 09:09:11 UTC, 5 replies.
- [PR] [CONNECT] Clean up the code related to `listenerCache` from `connect.StreamingQueryManager` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/12/10 09:14:20 UTC, 0 replies.
- [PR] [SPARK-54625][SQL][4.0] UTF8String#reverse should check offset and length on copying [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/12/10 10:07:18 UTC, 5 replies.
- [PR] [SPARK-54625][SQL][3.5] UTF8String#reverse should check offset and length on copying [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/12/10 10:09:02 UTC, 4 replies.
- [PR] [SPARK-54532][PYTHON] Add sqlstate for a set of PySparkException error classes [spark] - posted by "khakhlyuk (via GitHub)" <gi...@apache.org> on 2025/12/10 10:09:16 UTC, 2 replies.
- [PR] [SPARK-54624][UI][4.0] Ensure user name in historypage get escaped [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/12/10 10:13:20 UTC, 4 replies.
- [PR] [SPARK-54624][UI][3.5] Ensure user name in historypage get escaped [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/12/10 10:14:26 UTC, 4 replies.
- [PR] Rm host files from container [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/10 12:52:05 UTC, 5 replies.
- Re: [PR] [SPARK-45720][BUILD][DSTREAM][KINESIS] Upgrade KCL to 2.7.2 and remove AWS SDK for Java 1.x dependency [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/12/10 14:17:41 UTC, 2 replies.
- [PR] [SPARK-53836][INFRA][3.5] Update script `free_disk_space_container` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/12/10 14:55:30 UTC, 8 replies.
- [PR] [SQL][MINOR] Remove redundant casting in rCTEs [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/12/10 16:01:36 UTC, 3 replies.
- [PR] [SPARK-54667] Upgrade `Gradle` to 9.2.1 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/10 16:20:51 UTC, 2 replies.
- [PR] [WIP] backport libthrift update to fix CVE-2019-0205 & CVE-2020-13949 [spark] - posted by "LaurentGoderre (via GitHub)" <gi...@apache.org> on 2025/12/10 16:25:49 UTC, 0 replies.
- Re: [PR] [SPARK-54553][K8S] Supports receiving `Volcano` podgroup JSON format configurations [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/10 16:37:53 UTC, 20 replies.
- Re: [PR] [MINOR][DOCS] Fix a typo in `spark-standalone.md` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/10 17:04:49 UTC, 1 replies.
- Re: [PR] [SPARK-54664][CONNECT] Clean up the code related to `listenerCache` from `connect.StreamingQueryManager` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/10 17:09:00 UTC, 1 replies.
- Re: [PR] [SPARK-53753][BUILD][SQL] shade antlr4-runtime [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/12/10 17:37:57 UTC, 1 replies.
- [PR] Test PR [spark-connect-rust] - posted by "hntd187 (via GitHub)" <gi...@apache.org> on 2025/12/10 17:38:46 UTC, 1 replies.
- Re: [PR] [SQL][SPARK-54669] Remove redundant casting in rCTEs [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/12/10 17:50:51 UTC, 0 replies.
- Re: [PR] [SPARK-47672][SQL] Avoid double eval from filter pushDown w/ projection pushdown [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2025/12/10 18:27:46 UTC, 20 replies.
- Re: [PR] [SPARK-54659] Enhance gradle task 'generateConfPropsDoc' to account for recent changes [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/10 19:16:30 UTC, 0 replies.
- [PR] [SPARK-54671] Upgrade `operator-sdk` to 5.2.1 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/10 19:27:28 UTC, 3 replies.
- [PR] [SPARK-54672] Upgrade `mockito` to 5.21.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/10 19:36:38 UTC, 3 replies.
- [PR] [SPARK-54670][CONNECT] Rework Connect Literal handling [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/12/10 19:40:37 UTC, 3 replies.
- [PR] [SPARK-54673][SQL] Refactor SQL pipe syntax analysis code for sharing and reuse [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2025/12/10 20:10:11 UTC, 5 replies.
- [PR] [SPARK-54674] Fix `AppValidateStep` to prevent `ClientMode` deployment [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/10 21:24:56 UTC, 1 replies.
- [PR] Add configurable force shutdown timeout for StateStore maintenance thread pool [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/12/10 21:35:01 UTC, 0 replies.
- Re: [PR] [SPARK-54674] Fix `AppValidateStep` to prevent `ClientMode` deployment correctly [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/10 21:59:38 UTC, 2 replies.
- [PR] [SPARK-54676] Upgrade `Spotless` to 8.1.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/10 22:03:45 UTC, 2 replies.
- [PR] [SPARK-54677] Upgrade `pmd` to 7.19.0 and apply `EnumComparison` rules [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/10 22:12:20 UTC, 4 replies.
- Re: [PR] [SPARK-54655][SS] Make `StateStore.MaintenanceThreadPool.stop` to wait minimum of 60s and maintenanceShutdownTimeout [spark] - posted by "liviazhu (via GitHub)" <gi...@apache.org> on 2025/12/10 22:15:09 UTC, 1 replies.
- [PR] [SPARK-54678] Upgrade `spotbugs-tool` to 4.9.8 and `spotbugs-plugin` to 6.4.7 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/10 22:24:00 UTC, 2 replies.
- Re: [PR] [SPARK-54604][PYTHON][DOCS] Fix grammar issues in python_data_source.rst [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/12/10 23:56:38 UTC, 1 replies.
- Re: [PR] [SPARK-54603][PYTHON][DOCS] Fix typo in contributing.rst [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/12/10 23:56:53 UTC, 1 replies.
- Re: [PR] [SPARK-54632][INFRA][FOLLOW-UP] Enable ruff on our CI and lint-python [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/12/10 23:58:02 UTC, 8 replies.
- Re: [PR] [SPARK-54675][SPARK-54655][SS] Add configurable force shutdown timeout for StateStore maintenance thread pool [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/12/11 00:00:40 UTC, 1 replies.
- [PR] [SPARK-54679][SQL] Rename `spark.sql.(xml.legacyXMLParser.enabled -> legacy.useLegacyXMLParser)` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/11 00:15:08 UTC, 4 replies.
- Re: [PR] [SPARK-53482][SQL] MERGE INTO support for when source has less nested field than target [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/11 00:29:24 UTC, 1 replies.
- Re: [PR] Increase report interval of spaming logs to 10 seconds [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/11 00:30:30 UTC, 1 replies.
- [PR] [SPARK-53482][SQL][FOLLOWUP] Rename `spark.sql.merge(.nested.type.coercion.enabled -> NestedTypeCoercion.enabled)` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/11 00:32:39 UTC, 4 replies.
- Re: [PR] [WIP][SPARK-54647][PYTHON] Support User-Defined Aggregate Functions (UDAF) [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/12/11 01:12:25 UTC, 8 replies.
- [PR] [SPARK-54680] Upgrade `actions/checkout` to v6 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/11 02:24:04 UTC, 2 replies.
- [PR] [SPARK-54681] Upgrade `actions/checkout` to v6 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/11 02:27:43 UTC, 2 replies.
- [PR] [WIP] Zero Copy Pandas UDF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/11 02:40:42 UTC, 0 replies.
- [PR] [SPARK-52837][PYTHON][FOLLOWUP] Add `versionadded` to `TimeType` doc [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/11 02:44:13 UTC, 4 replies.
- [PR] [SPARK-54682][SQL] Support showing parameters in DESCRIBE PROCEDURE [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/12/11 04:35:05 UTC, 12 replies.
- [PR] [SPARK-54609][SQL][FOLLOWUP] Unify geo and time types blocking [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/11 04:36:12 UTC, 2 replies.
- Re: [PR] [SPARK-54683][SQL] Unify geo and time types blocking [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/11 04:58:02 UTC, 13 replies.
- Re: [PR] [SPARK-54629][CONNECT][TEST] Supplement getString with BINARY type (UTF-8) test [spark] - posted by "xu20160924 (via GitHub)" <gi...@apache.org> on 2025/12/11 06:03:35 UTC, 2 replies.
- Re: [PR] [SPARK-52326][SQL] Add partitions related ExternalCatalogEvent and post them in corresponding operations [spark] - posted by "waterlx (via GitHub)" <gi...@apache.org> on 2025/12/11 06:09:51 UTC, 4 replies.
- [PR] Add partitions related ExternalCatalogEvent and post them in corresponding operations [spark] - posted by "waterlx (via GitHub)" <gi...@apache.org> on 2025/12/11 06:39:26 UTC, 2 replies.
- [PR] [SPARK-54643][PYTHON][TESTS][FOLLOW-UP] Restore classic only workflows [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/11 07:05:22 UTC, 2 replies.
- Re: [PR] [SPARK-44988][SQL] Support reading Parquet TIMESTAMP(NANOS,false) [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/11 07:11:44 UTC, 2 replies.
- [PR] [SPARK-54632][INFRA][FOLLOW-UP] Reenable ruff on our CI and lint-python [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/11 07:57:01 UTC, 2 replies.
- Re: [PR] [SPARK-54669][SQL] Remove redundant casting in rCTEs [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/12/11 08:41:50 UTC, 5 replies.
- [PR] [SPARK-54668] [SQL] [TEST-ONLY] Add tests for CTEs in multi-children operators [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/12/11 10:57:52 UTC, 4 replies.
- Re: [PR] backport libthrift update to fix CVE-2019-0205 & CVE-2020-13949 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/11 11:54:21 UTC, 7 replies.
- Re: [PR] [SPARK-51920][SS][PYTHON] Fix type handling of namedTuple for transfromWithState [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/12/11 13:11:14 UTC, 1 replies.
- [PR] [SPARK-54684][SS] Introduce stream-stream join operations microbenchmark [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/12/11 13:48:10 UTC, 1 replies.
- [PR] [WIP][API AUDITING] Make `org.apache.spark.sql.pipelines` internal package and make `EstimatorUtils` private [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/11 14:34:40 UTC, 0 replies.
- [PR] [SPARK-54137][CONNECT] Remove redundant observed-metrics responses [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/12/11 16:28:33 UTC, 0 replies.
- [PR] test ci [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/12/11 17:43:19 UTC, 2 replies.
- [PR] [SPARK-54687][SQL] Add golden file with generators resolution edge cases [spark] - posted by "mikhailnik-db (via GitHub)" <gi...@apache.org> on 2025/12/11 18:08:30 UTC, 2 replies.
- Re: [PR] [SPARK-54137][SQL][CONNECT] Remove redundant observed-metrics responses [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/12/11 18:11:19 UTC, 6 replies.
- [PR] [WIP][SPARK-54660][SS] Add RTM trigger to python [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2025/12/11 19:08:48 UTC, 0 replies.
- Re: [PR] [WIP][PYTHON] Zero Copy Pandas UDF [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2025/12/11 19:22:25 UTC, 1 replies.
- Re: [PR] [SPARK-53991][SQL] Add SQL support for KLL quantiles functions based on DataSketches [spark] - posted by "figure-shao (via GitHub)" <gi...@apache.org> on 2025/12/12 00:45:23 UTC, 2 replies.
- Re: [PR] [SPARK-54690][PS] Make `Frame.__repr__` insensitive to arrow optimization [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/12 01:13:25 UTC, 3 replies.
- [PR] [SPARK-54589][PYTHON] Consolidate ArrowStreamAggPandasIterUDFSerializer into ArrowStreamAggPandasUDFSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/12/12 01:15:28 UTC, 2 replies.
- Re: [PR] [SPARK-7008][SDP][ML] Make `org.apache.spark.sql.pipelines` internal package and make `EstimatorUtils` private [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/12 01:49:51 UTC, 3 replies.
- [PR] [SPARK-54686][SQL] Relax DSv2 table checks in temp views to allow new top-level columns [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/12/12 02:46:10 UTC, 13 replies.
- [PR] [SPARK-54692][DOCS] Add python_worker_logs tvf doc to API reference [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/12/12 03:00:25 UTC, 3 replies.
- [PR] [WIP][CONNECT] Clean-up ArrowBuffers in Connect [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/12/12 04:36:48 UTC, 4 replies.
- [PR] [SPARK-54693][CORE][TESTS] Add LZ4TPCDSDataBenchmark [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/12 08:35:44 UTC, 10 replies.
- [PR] WIP [SPARK-54571] Use safeDecompressor [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/12 08:44:59 UTC, 0 replies.
- [PR] [SPARK-54694][K8S] Fail app on ConfigMap size over limit [spark] - posted by "littlexyw (via GitHub)" <gi...@apache.org> on 2025/12/12 11:54:28 UTC, 1 replies.
- [PR] Changed isObjectNotFoundException and isSyntaxErrorBestEffort to be O… [spark] - posted by "SavicStefan (via GitHub)" <gi...@apache.org> on 2025/12/12 12:07:37 UTC, 6 replies.
- [PR] [SPARK-54695][TEST][CORE] StandaloneDynamicAllocationSuite.syncExecutors should ensure executors have fully setup [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2025/12/12 12:59:14 UTC, 2 replies.
- [PR] [SPARK-54586][SQL] Validate UTF-8 when casting Binary to String [spark] - posted by "qlong (via GitHub)" <gi...@apache.org> on 2025/12/12 17:12:08 UTC, 3 replies.
- [PR] [SPARK-54443][SS] Integrate PartitionKeyExtractor in Re-partition reader [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2025/12/12 19:16:49 UTC, 4 replies.
- [PR] [SPARK-54700][SQL] Quote constraint name and columns for dsv2 constraints [spark] - posted by "yhuang-db (via GitHub)" <gi...@apache.org> on 2025/12/12 19:30:02 UTC, 0 replies.
- [PR] [SPARK-54688][SQL] Introduce ArrowBatch case class to encapsulate Arrow batch metadata [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/12/12 19:49:19 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-47031] Union determinism fix [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2025/12/12 20:46:11 UTC, 0 replies.
- [PR] [SPARK-54701] Improve the runnerConf chain for Python workers [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/12 22:11:53 UTC, 0 replies.
- [PR] [SPARK-53991][SQL][FOLLOWUP] Enforce KLL_SKETCH_AGG_GET_RANK/QUANTILE arguments are foldable [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2025/12/12 23:20:22 UTC, 6 replies.
- [PR] [SPARK-54702] Recognize existing coverage object to install worker hooks [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/12 23:24:23 UTC, 0 replies.
- Re: [PR] [SPARK-XXXX] Rocks db state store orphan removal protection [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/13 00:28:46 UTC, 1 replies.
- [PR] [SPARK-54450][INFRA][FOLLOWUP] Support unittest style string in run-tests [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/13 01:13:18 UTC, 3 replies.
- [PR] [SPARK-54125][SQL] Support AS JSON output for SHOW DATABASES/SCHEMAS [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/12/13 03:13:48 UTC, 1 replies.
- [PR] [MINOR][PYTHON] Fix `_create_converter` overload signature [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/13 03:49:55 UTC, 0 replies.
- [PR] [SPARK-54698] Support hashing for all data types for array set like operations [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2025/12/13 13:31:10 UTC, 0 replies.
- Re: [PR] [SPARK-54698][SQL] Support hashing for all data types for array set like operations [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2025/12/13 13:48:02 UTC, 6 replies.
- Re: [PR] [SPARK-53483][SQL] Support disable code-gen for sort merge join other than FULL OUTER and Existence [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/14 00:33:04 UTC, 1 replies.
- Re: [PR] [SPARK-53378][PYTHON] Enable @udtf decorator to support returnType as first positional argument [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/14 00:33:06 UTC, 1 replies.
- Re: [PR] [SPARK-53351][CORE] Use consistent string type blockId for block data access in external block handler [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/14 00:33:08 UTC, 1 replies.
- [PR] [SPARK-54124][SQL] Add SHOW VIEWS AS JSON support [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/12/14 02:21:02 UTC, 1 replies.
- Re: [PR] [SPARK-54125][SQL] Support SHOW DATABASES AS JSON [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/14 10:50:49 UTC, 5 replies.
- [PR] [SPARK-53839][SQL] Add V2 table support to DESCRIBE TABLE AS JSON [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/12/14 17:59:12 UTC, 2 replies.
- Re: [PR] WIP [SPARK-54571] Use LZ4 safeDecompressor [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/14 19:30:41 UTC, 1 replies.
- Re: [PR] [SPARK-52564] configuration changes not require deleting the checkpoint [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/15 00:32:42 UTC, 1 replies.
- [PR] [SPARK-54632][FOLLOW-UP] Add `ruff` in dev/requirement [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/15 01:10:21 UTC, 2 replies.
- Re: [PR] [MINOR][PYTHON] Fix `_create_converter` and `covert` overload signature [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/15 01:12:19 UTC, 1 replies.
- Re: [PR] [SPARK-54689][SDP][ML] Make `org.apache.spark.sql.pipelines` internal package and make `EstimatorUtils` private [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/15 03:01:42 UTC, 0 replies.
- [PR] Upgrade js-yaml to `3.14.2` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/12/15 04:53:13 UTC, 0 replies.
- Re: [PR] [SPARK-54705][BUILD][TESTS] Upgrade js-yaml to `3.14.2` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/12/15 07:48:17 UTC, 1 replies.
- [PR] [SPARK-54706][ML][CONNECT] Make DistributedLDAModel work with local file system [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/15 13:14:16 UTC, 2 replies.
- [PR] [SPARK-54707] [SQL] Refactor `PIVOT` resolution main logic to the `PivotTransformer` [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/12/15 13:51:55 UTC, 14 replies.
- [PR] [SPARK-54708][CONNECT] Optimize ML cache cleanup with lazy directory creation [spark] - posted by "xi-db (via GitHub)" <gi...@apache.org> on 2025/12/15 14:17:17 UTC, 0 replies.
- [PR] Add Spark 4 protobuf definitions and basic working [spark-connect-rust] - posted by "hntd187 (via GitHub)" <gi...@apache.org> on 2025/12/15 17:06:06 UTC, 0 replies.
- Re: [PR] Update deps, fix some warnings [spark-connect-rust] - posted by "hntd187 (via GitHub)" <gi...@apache.org> on 2025/12/15 17:07:29 UTC, 0 replies.
- [PR] [SPARK-54711] Add a timeout for daemon created worker connection [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/15 19:22:18 UTC, 4 replies.
- [PR] [SPARK-53991][SQL][FOLLOWUP] Remove wrong comments added in PR #53463 [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2025/12/15 19:40:28 UTC, 2 replies.
- Re: [PR] [SPARK-54599][PYTHON] Refactor PythonException so it can take errorClass with sqlstate [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/15 19:48:59 UTC, 6 replies.
- [PR] [SPARK-46166][PS] Implementation of pandas.DataFrame.any with axis=None [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2025/12/15 19:52:05 UTC, 6 replies.
- Re: [PR] [SPARK-54696][CONNECT] Clean-up ArrowBuffers in Connect [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/15 23:44:10 UTC, 3 replies.
- [PR] [SPARK-54453][PYTHON][TEST] Add more coverage tests to conversion [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/16 00:57:40 UTC, 3 replies.
- [PR] [SPARK-54696][CONNECT] Clean-up Arrow Buffers - follow-up [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/12/16 01:08:10 UTC, 5 replies.
- Re: [PR] [SPARK-54708][CONNECT][ML] Optimize ML cache cleanup with lazy directory creation [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/12/16 01:53:16 UTC, 1 replies.
- Re: [PR] [SPARK-54702][INFRA] Recognize existing coverage object to install worker hooks [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/16 02:16:10 UTC, 1 replies.
- [PR] [SPARK-54713][SQL] Add vector similarity/distance function expressions support [spark] - posted by "zhidongqu-db (via GitHub)" <gi...@apache.org> on 2025/12/16 02:49:45 UTC, 4 replies.
- Re: [PR] [SPARK-54449][CORE] Storage Memory off heap size should be considered only when off heap is enabled [spark] - posted by "VindhyaG (via GitHub)" <gi...@apache.org> on 2025/12/16 03:28:42 UTC, 0 replies.
- Re: [PR] [SPARK-54714][PYTHON][TEST] Add more coverage tests to conversion [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/16 06:16:36 UTC, 0 replies.
- [PR] [SPARK-54709][BUILD] Upgrade Derby to 10.16.1.2 [spark] - posted by "emanuele-marchetta-db (via GitHub)" <gi...@apache.org> on 2025/12/16 09:47:11 UTC, 7 replies.
- [PR] [SPARK-52764][ML][CONNECT] Make `RemoteModelRef.release_ref` async [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/16 12:08:56 UTC, 3 replies.
- [PR] [TESTS] Fix npm vulnerabilities by `npm audit fix` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/12/16 12:57:35 UTC, 1 replies.
- [PR] [SQL] Preserve attributes names during CTE newInstance() [spark] - posted by "mikhailnik-db (via GitHub)" <gi...@apache.org> on 2025/12/16 17:04:40 UTC, 0 replies.
- [PR] [DO NOT MERGE] define configs in text files [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/16 17:10:00 UTC, 12 replies.
- [PR] [SPARK-54720][SQL] Add SparkSession.emptyDataFrame with a schema [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/12/16 18:21:05 UTC, 5 replies.
- [PR] [SPARK-54721][SQL] Completely disable feature 'nested struct coercion' for MERGE INTO [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/12/16 20:19:07 UTC, 5 replies.
- Re: [PR] [SPARK-51035][BUILD] Upgrade Janino to 3.1.12 [spark] - posted by "YanivKunda (via GitHub)" <gi...@apache.org> on 2025/12/16 20:21:22 UTC, 0 replies.
- [PR] [SPARK-54122] [WIP] Implement TwsTester in PySpark [spark] - posted by "fedimser (via GitHub)" <gi...@apache.org> on 2025/12/16 20:27:04 UTC, 0 replies.
- [PR] [SPARK-54703][PYTHON] Consolidate SQL_GROUPED_AGG_ARROW_ITER_UDF and SQL_GROUPED_AGG_PANDAS_ITER_UDF mapper logic [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/12/17 00:16:09 UTC, 1 replies.
- [PR] [SPARK-54722][PYTHON] Register Pandas Grouped Iter Aggregate UDF for SQL usage [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/12/17 00:29:03 UTC, 0 replies.
- [PR] [SPARK-54723][PYTHON][TESTS] Add test for @udf usage on arrow grouped aggregate iter UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/12/17 00:38:18 UTC, 0 replies.
- [PR] [SPARK-54724][INFRA] Hook worker exception handler to dump report before sending exception [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/17 01:47:18 UTC, 2 replies.
- [PR] [SPARK-54725][SQL] Add inferring transitive join conditions in CostBasedJoinReorder [spark] - posted by "juntaozhang (via GitHub)" <gi...@apache.org> on 2025/12/17 02:38:38 UTC, 0 replies.
- Re: [PR] [SPARK-54717][TESTS] Fix npm vulnerabilities by `npm audit fix` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/12/17 03:00:35 UTC, 1 replies.
- [PR] [WIP][CONNECT] Read ChunkedLocalRelation from BlockManager [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/12/17 03:20:40 UTC, 3 replies.
- [PR] [SPARK-54726][SQL] Improve a bit of performance for InsertAdaptiveSparkPlan [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/12/17 03:37:55 UTC, 3 replies.
- Re: [PR] [SPARK-54314][PYTHON][CONNECT] Improve Server-Side debuggability in Spark Connect by capturing client application's file name and line numbers [spark] - posted by "huaxingao (via GitHub)" <gi...@apache.org> on 2025/12/17 04:11:24 UTC, 4 replies.
- [PR] [SPARK-54727][BUILD] Upgrade Netty to `4.2.9` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/12/17 04:23:41 UTC, 2 replies.
- [PR] [SPARK-54728][PYTHON][DOCS] Remove a wrong note in `dataframe.isEmpty` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/17 06:18:16 UTC, 2 replies.
- Re: [PR] [SPARK-52819][SQL] Making KryoSerializationCodec serializable to fix java.io.NotSerializableException errors in various use cases [spark] - posted by "Kontinuation (via GitHub)" <gi...@apache.org> on 2025/12/17 06:19:39 UTC, 3 replies.
- [PR] [SPARK-41916] [ML] Torch distributor: support multiple torchrun processes per task if task.gpu.amount > 1 [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/12/17 07:46:42 UTC, 5 replies.
- Re: [PR] [SPARK-54718][SQL] Preserve attributes names during CTE newInstance() [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/17 08:12:58 UTC, 2 replies.
- Re: [PR] [SPARK-51902][SQL] Enforce check constraint on table insertion [spark] - posted by "melin (via GitHub)" <gi...@apache.org> on 2025/12/17 08:34:01 UTC, 1 replies.
- [PR] [SPARK-54729][Core] Proactively replicate shuffle data to the FallbackStorage [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2025/12/17 08:54:21 UTC, 0 replies.
- [PR] [SPARK-54730][SQL][CONNECT] Delay failure of dataframe column resolution [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/17 09:16:38 UTC, 5 replies.
- [PR] [SPARK-52764][ML][CONNECT][TESTS] Restore `test_parity_classification` and `test_parity_regression` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/17 11:21:54 UTC, 2 replies.
- [PR] [SPARK-41916][FOLLOW-UP] Restore python linter [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/17 11:54:18 UTC, 2 replies.
- Re: [PR] [SPARK-51688][PYTHON] Use Unix Domain Socket between Python and JVM communication [spark] - posted by "Kontinuation (via GitHub)" <gi...@apache.org> on 2025/12/17 12:15:24 UTC, 2 replies.
- [PR] [SPARK-41916][FOLLOW-UP] Remove unused imports [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/17 13:19:24 UTC, 3 replies.
- [PR] [SPARK-46165][PS] Add support for pandas.DataFrame.any axis=1 [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2025/12/17 17:17:26 UTC, 0 replies.
- [PR] Init commit [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2025/12/17 18:39:44 UTC, 0 replies.
- [PR] [PYTHON] [WIP] Add intersectByKey method to RDD [spark] - posted by "SalerSimo (via GitHub)" <gi...@apache.org> on 2025/12/17 19:04:25 UTC, 0 replies.
- Re: [PR] Properly preserve column comments in view with SCHEMA EVOLUTION [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2025/12/17 19:39:38 UTC, 1 replies.
- Re: [PR] [SPARK-54735][SQL] Properly preserve column comments in view with SCHEMA EVOLUTION [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/12/17 19:57:40 UTC, 32 replies.
- [PR] [SPARK-54736][TEST][INFRA] Change the default executable to sys.executable [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/17 20:01:38 UTC, 3 replies.
- Re: [PR] [SPARK-54711][PYTHON] Add a timeout for daemon created worker connection [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/12/17 22:09:53 UTC, 0 replies.
- [PR] [SPARK-54738][PYTHON] Add Profiler Support for Pandas Grouped Iter Aggregate UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/12/17 23:04:09 UTC, 2 replies.
- [PR] Add DSv2 Constraint to CatalogTable [spark] - posted by "yhuang-db (via GitHub)" <gi...@apache.org> on 2025/12/17 23:12:42 UTC, 1 replies.
- Re: [PR] [SPARK-54739][INFRA] Cancel workflow if a new commit is pushed [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/17 23:28:15 UTC, 3 replies.
- [PR] [SPARK-54740][PYTHON] Start faulthandler early in daemon mode [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/17 23:40:45 UTC, 0 replies.
- Re: [PR] [SPARK-53342][SQL][3.5] Fix Arrow converter to handle multiple record batches in single IPC stream [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/18 00:27:01 UTC, 1 replies.
- Re: [PR] [SPARK-53230][SQL] Assign a name to error class _LEGACY_ERROR_TEMP_1011 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/18 00:27:03 UTC, 1 replies.
- [PR] [SPARK-54741][ML][CONNECT][TESTS] Restore ClusteringParityTests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/18 00:41:19 UTC, 2 replies.
- [PR] [SPARK-54742][ML][CONNECT][TESTS] Add tests for connect ML model offloading [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/18 00:43:29 UTC, 2 replies.
- [PR] Fix ss join null handling [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/12/18 00:49:10 UTC, 0 replies.
- [PR] [SPARK-51019][SQL][TESTS] Fix flaky test: SPARK-47148 AQE should avoid to submit shuffle job on cancellation [spark] - posted by "ashrithb (via GitHub)" <gi...@apache.org> on 2025/12/18 01:31:11 UTC, 0 replies.
- [PR] [SPARK-54744][PYTHON] Only invalidate cache when necessary [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/18 01:34:48 UTC, 2 replies.
- Re: [PR] [SPARK-54723][PYTHON][TESTS] Add Test for @udf Usage on Arrow Grouped Aggregate Iter UDF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/18 02:22:03 UTC, 1 replies.
- Re: [PR] [SPARK-54722][PYTHON][SQL] Register Pandas Grouped Iter Aggregate UDF for SQL usage [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/18 02:24:24 UTC, 1 replies.
- [PR] [SPARK-54746][DOC] Fix wrong link in SQL Scripting page [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/18 03:12:14 UTC, 1 replies.
- [PR] [SPARK-54747] Upgrade Spark to 4.1.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/18 03:14:34 UTC, 2 replies.
- [PR] [SPARK-54748] Publish Apache Spark `4.1.0` to docker registry [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/18 03:51:46 UTC, 3 replies.
- Re: [PR] [SPARK-54415][SQL] CREATE GLOBAL TEMPORARY VIEW / TEMPORARY VIEW supports IF NOT EXISTS clause [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/18 05:11:00 UTC, 5 replies.
- Re: [PR] [SPARK-54553][K8S] Support `spark.kubernetes.scheduler.volcano.podGroupTemplateJson` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/18 05:16:10 UTC, 2 replies.
- [PR] [SPARK-52060] Fix incorrect numOutputRows metric in OneRowRelationExec [spark] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2025/12/18 05:20:45 UTC, 0 replies.
- Re: [PR] [SPARK-52060][SQL] Fix incorrect numOutputRows metric in OneRowRelationExec [spark] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2025/12/18 05:22:50 UTC, 2 replies.
- [PR] [SPARK-49921][CORE] Add task write data time to SQL tab's graph node [spark] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2025/12/18 07:10:05 UTC, 0 replies.
- [PR] [SPARK-54748][FOLLOWUP] Add 4.1.0 to `publish-java*.yaml` and `test.yml` files [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/18 07:11:33 UTC, 3 replies.
- Re: [PR] [SPARK-54749][SQL] Fix incorrect numOutputRows metric in OneRowRelationExec [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/18 07:56:12 UTC, 3 replies.
- [PR] [SPARK-54751][SQL] Add version information to the configuration of SQL [spark] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2025/12/18 08:17:22 UTC, 1 replies.
- [PR] [SPARK-48750][SQL] AQEPropagateEmptyRelation convert broadcast query stage plan to empty relation causing error [spark] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2025/12/18 08:35:26 UTC, 2 replies.
- [PR] [SPARK-54752][ML][CONNECT][TESTS] Test model offloading of LDA and FPGrowth [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/18 08:40:07 UTC, 2 replies.
- [PR] [SPARK-54754][SQL] OrcSerializer should not parse the schema every time it is serialized [spark] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2025/12/18 09:20:23 UTC, 3 replies.
- [PR] [SPARK-54755] Promote all preview examples with 4.1.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/18 09:36:38 UTC, 8 replies.
- [PR] [SPARK-46741][SQL] Cache Table with CTE should work when CTE in plan expression subquery [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2025/12/18 10:00:42 UTC, 20 replies.
- [PR] [SPARK-54756] Use `4.1.0` instead of `preview` in GitHub Action CIs [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/18 10:01:51 UTC, 4 replies.
- [PR] [SPARK-54757] Update `SparkClusterResourceSpec` to use `apache/spark:4.1.0` as the default value of container image [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/18 10:13:58 UTC, 2 replies.
- [PR] [SPARK-54758] Fix generator resolution order in Project [spark] - posted by "mikhailnik-db (via GitHub)" <gi...@apache.org> on 2025/12/18 11:58:38 UTC, 0 replies.
- [PR] [WIP][PYTHON][INFRA] Fail hanging tests and log the tracebacks [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/18 13:31:15 UTC, 3 replies.
- Re: [PR] [SPARK-54758][SQL] Fix generator resolution order in Project [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/18 14:08:47 UTC, 5 replies.
- [PR] [SPARK-54750][SQL] Fix ROUND returning NULL for Decimal values with l… [spark] - posted by "qindongliang (via GitHub)" <gi...@apache.org> on 2025/12/18 15:00:33 UTC, 9 replies.
- [PR] [SPARK-54759][SQL][WIP] Cursor support [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2025/12/18 16:08:49 UTC, 0 replies.
- Re: [PR] [SPARK-54660][SS] Add RTM trigger to python [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/12/18 17:23:05 UTC, 0 replies.
- [PR] [SPARK-54760][SQL] DelegatingCatalogExtension as session catalog supports both V1 and V2 functions [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/18 18:07:16 UTC, 23 replies.
- [PR] [SPARK-54761] Throw unsupportedTableOperation for constraint operation on DSv1/HMS table [spark] - posted by "yhuang-db (via GitHub)" <gi...@apache.org> on 2025/12/18 18:32:25 UTC, 0 replies.
- Re: [PR] [SPARK-54762][PYTHON] Fix `_create_converter` and `covert` overload signature [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/12/18 19:46:21 UTC, 1 replies.
- Re: [PR] [SPARK-54122] Implement TwsTester in Scala [spark] - posted by "nyaapa (via GitHub)" <gi...@apache.org> on 2025/12/18 20:28:14 UTC, 2 replies.
- [PR] [SPARK-54763][TEST] Accelerate test_udf_return_types with multi-threading [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/18 21:04:33 UTC, 4 replies.
- Re: [PR] [SPARK-54761][SQL] Throw unsupportedTableOperation for constraint operation on DSv1/HMS table [spark] - posted by "yhuang-db (via GitHub)" <gi...@apache.org> on 2025/12/18 22:16:49 UTC, 13 replies.
- [PR] [SPARK-54764] Use 4.1.0 instead of 4.0.1 for tests and benchmark [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/18 23:37:32 UTC, 1 replies.
- Re: [PR] [SPARK-53454][SQL] Fix AlwaysTrue/AlwaysFalse predicate translation in JDBC connectors [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/19 00:30:45 UTC, 1 replies.
- Re: [PR] [SPARK-53445][SQL]Add if to avoid unnecessary calls [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/19 00:30:46 UTC, 1 replies.
- [PR] [SPARK-54765] Make `README.md` and `examples` up-to-date with 4.1.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/19 00:32:58 UTC, 2 replies.
- [PR] [SPARK-54766] Update CI to test K8s 1.35 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/19 00:40:08 UTC, 2 replies.
- [PR] [SPARK-54767][K8S][INFRA] Update K8s IT CI to use K8s 1.35 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/19 00:44:51 UTC, 4 replies.
- [PR] WIP [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2025/12/19 00:57:10 UTC, 0 replies.
- [PR] [SPARK-54769][PYTHON] Remove dead code in conversion.py [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/19 01:12:16 UTC, 2 replies.
- Re: [PR] [SPARK-54652][SQL] Complete conversion of IDENTIFIER() [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/19 03:42:26 UTC, 1 replies.
- [PR] [SPARK-54771][SQL] Remove ResolveUserSpecifiedColumns from RuleIdCollection [spark] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2025/12/19 03:43:22 UTC, 0 replies.
- Re: [PR] [SPARK-47086][SPARK-48022][BUILD][CORE][WEBUI] Upgrade Jetty to 12.1.5, Jersey to 3.1.11 and Servlet to 6.0 [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/12/19 07:13:21 UTC, 1 replies.
- [PR] [SPARK-54772][Core] Introduce failedChunks metrics in ChunkFetchHandler [spark] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2025/12/19 07:50:14 UTC, 1 replies.
- Re: [PR] [SPARK-54701][PYTHON] Improve the runnerConf chain for Python workers [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/12/19 08:32:07 UTC, 3 replies.
- [PR] [SPARK-54773] Make `README.md` and `Examples` up-to-date with 4.1.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/19 09:31:04 UTC, 2 replies.
- [PR] test [spark-kubernetes-operator] - posted by "ashangit (via GitHub)" <gi...@apache.org> on 2025/12/19 09:35:34 UTC, 0 replies.
- [PR] [SPARK-54774][CORE] k8s submit failed should keep same exit code with app exit code [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2025/12/19 09:41:43 UTC, 7 replies.
- [PR] [SPARK-54775][Core] Add logging for the execution steps of Spark shutdown hooks [spark] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2025/12/19 10:27:56 UTC, 1 replies.
- [PR] Changed dropTable error handling in JDBCTableCatalog.dropTable(...) [spark] - posted by "SavicStefan (via GitHub)" <gi...@apache.org> on 2025/12/19 11:28:39 UTC, 7 replies.
- [PR] Improved the logs message regarding lambda function with SQL UDF [spark] - posted by "Shubhambhusate (via GitHub)" <gi...@apache.org> on 2025/12/19 11:53:05 UTC, 0 replies.
- [PR] [SPARK-54778] Upgrade `grpc-swift-2` to 2.2.1 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/19 12:30:16 UTC, 2 replies.
- [PR] [SPARK-54779] Upgrade `gRPC Swift NIO Transport` to 2.4.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/19 12:38:45 UTC, 2 replies.
- [PR] [SPARK-54780][K8S][DOCS] Drop K8s v1.32 Support [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/19 13:24:03 UTC, 4 replies.
- [PR] [SPARK-54781][ML][CONNECT] Return model cache information in JSON format [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/19 14:11:57 UTC, 2 replies.
- [PR] [SPARK-54782][SQL] Correct the config versions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/19 14:37:26 UTC, 5 replies.
- [PR] [WIP][SPARK-54745][PYTHON] Workaround `import pyspark` error caused by `socketserver.UnixStreamServer` not supported on Windows [spark] - posted by "Kontinuation (via GitHub)" <gi...@apache.org> on 2025/12/19 15:21:42 UTC, 0 replies.
- Re: [PR] [SPARK-40366][INFRA] Add `spark` namespace to spark ci image [spark] - posted by "qindongliang (via GitHub)" <gi...@apache.org> on 2025/12/19 15:29:51 UTC, 0 replies.
- Re: [PR] [SPARK-54777] Changed dropTable error handling in JDBCTableCatalog.dropTable(...) [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2025/12/19 17:29:02 UTC, 0 replies.
- Re: [PR] [SPARK-54450][PYTHON][FOLLOW-UP] Add py4j to sys path to support import check [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/19 17:31:26 UTC, 0 replies.
- [PR] [POC][DONOTMERGE] Explore transpilation yet again spark 14083 but this time with some python too [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2025/12/19 20:01:37 UTC, 0 replies.
- Re: [PR] [SPARK-54768][SS]Python Stream Data Source should classify error if data returned doesn't match configured schema [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2025/12/19 20:50:57 UTC, 3 replies.
- [PR] Add support for binary sketch aggregations in KLL [spark] - posted by "cboumalh (via GitHub)" <gi...@apache.org> on 2025/12/19 20:52:03 UTC, 0 replies.
- [PR] [SPARK-54786] Upgrade `gRPC Swift Protobuf` to 2.1.2 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/19 20:58:16 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-54785][SQL] Add support for binary sketch aggregations in KLL [spark] - posted by "cboumalh (via GitHub)" <gi...@apache.org> on 2025/12/19 21:03:15 UTC, 3 replies.
- [PR] [SPARK-53991][SQL][FOLLOWUP] Make KLL quantile golden file tests deterministic [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2025/12/19 21:24:01 UTC, 2 replies.
- Re: [PR] [SPARK-39800][SQL][WIP] DataSourceV2: View Support [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2025/12/19 21:27:49 UTC, 0 replies.
- [PR] [SPARK-54787][PS] Use list comprehension in pandas _bool_column_labels [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2025/12/19 22:05:18 UTC, 2 replies.
- [PR] [SPARK-54572][PYTHON][FOLLOWUP] Cleanup all child processes for vscode script [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/19 22:17:37 UTC, 2 replies.
- [PR] [SPARK-52407][SQL][FOLLOWUP] Expression description fix for ThetaIntersectionAgg [spark] - posted by "cboumalh (via GitHub)" <gi...@apache.org> on 2025/12/19 22:31:26 UTC, 3 replies.
- [PR] [SPARK-54788] Upgrade the minimum K8s version to v1.33 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/19 22:55:13 UTC, 2 replies.
- [PR] Bump org.apache.logging.log4j:log4j-core from 2.24.3 to 2.25.3 [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/12/19 23:52:11 UTC, 2 replies.
- Re: [PR] [SPARK-51534][Core] Improve parquet read performance by reducing unnecessary operations when converting parquet to row [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/20 00:28:48 UTC, 1 replies.
- [PR] [SPARK-54789] Support label selector based filter on resources to reconcile [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/12/20 02:07:18 UTC, 16 replies.
- [PR] [SPARK-54790][PYTHON][TEST] Add UDTF analyze coverage tests [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/20 03:29:57 UTC, 0 replies.
- Re: [PR] [SPARK-52545][SQL][DOCS] Update string literal docs for quote escaping rules [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2025/12/20 04:12:11 UTC, 0 replies.
- [PR] [SPARK-54791] Increase `setup-minikube` resources to 3 cores and 10240m [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/20 07:34:23 UTC, 2 replies.
- [PR] [SPARK-54792] Update `setup-minikube` to v0.0.21 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/20 07:44:39 UTC, 2 replies.
- Re: [PR] Add Helm configuration for spark operator HA [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/20 08:09:51 UTC, 1 replies.
- Re: [PR] [SPARK-52813][CONNECT] Allow DAGs in Spark Connect [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/21 00:32:54 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-54745][PYTHON] Fix PySpark import error caused by missing UnixStreamServer on Windows [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/12/21 00:35:55 UTC, 0 replies.
- Re: [PR] [SPARK-54790][PYTHON][TESTS] Add UDTF analyze coverage tests [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/12/21 01:25:37 UTC, 1 replies.
- Re: [PR] [SPARK-54745][PYTHON] Fix PySpark import error caused by missing UnixStreamServer on Windows [spark] - posted by "Kontinuation (via GitHub)" <gi...@apache.org> on 2025/12/21 02:57:14 UTC, 3 replies.
- [PR] [SPARK-54794][CORE] Suppress verbose `FsHistoryProvider.checkForLogs` scanning logs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/21 22:34:06 UTC, 4 replies.
- [PR] [SPARK-54795] Suppress Hadoop warnings in History Server example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/21 22:41:00 UTC, 2 replies.
- Re: [PR] [SPARK-54173][K8S] Add support for Deployment API on K8s [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/21 23:19:11 UTC, 0 replies.
- Re: [PR] [SPARK-53340][CONNECT] Make StreamingQueryCommand in SparkConnectPlanner side effect free [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/22 00:32:04 UTC, 1 replies.
- [PR] [SPARK-54597][BUILD][FOLLOW-UP] Explicitly exclude lz4-java in SBT build [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/12/22 02:13:33 UTC, 6 replies.
- Re: [PR] [SPARK-54777][SQL] Changed dropTable error handling in JDBCTableCatalog.dropTable(...) [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/22 03:18:05 UTC, 5 replies.
- [PR] Fix deprecation warning in `GlobalSyncClockClient.getTimeMillis` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/12/22 03:47:22 UTC, 0 replies.
- [PR] [WIP] Introduce a new callback "onQueryExecutionStart" to StreamingQueryListener [spark] - posted by "JevonCowell (via GitHub)" <gi...@apache.org> on 2025/12/22 03:47:50 UTC, 0 replies.
- Re: [PR] [SS] Fix deprecation warning in `GlobalSyncClockClient.getTimeMillis` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/12/22 03:48:03 UTC, 0 replies.
- Re: [PR] [SPARK-54122] Implement TwsTester in PySpark [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/12/22 04:21:58 UTC, 0 replies.
- Re: [PR] [SPARK-54597][BUILD][FOLLOW-UP] Explicitly exclude `org.lz4:lz4-java` in SBT build [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/22 05:47:48 UTC, 4 replies.
- Re: [PR] [SPARK-54797][SS][TESTS] Fix deprecation warning in `GlobalSyncClockClient.getTimeMillis` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/22 05:49:07 UTC, 3 replies.
- Re: [PR] [SPARK-53991][SQL][TEST][FOLLOWUP] Make KLL quantile golden file tests deterministic [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/22 05:56:41 UTC, 0 replies.
- [PR] [SPARK-54798][BUILD] Upgrade commons-text to 1.15.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/12/22 07:34:36 UTC, 3 replies.
- Re: [PR] [SPARK-54771][SQL] Remove ResolveUserSpecifiedColumns rule from RuleIdCollection [spark] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2025/12/22 09:44:35 UTC, 0 replies.
- [PR] Add SupportsUpdateV2 and UpdateTableExec [spark] - posted by "SavicStefan (via GitHub)" <gi...@apache.org> on 2025/12/22 12:01:14 UTC, 2 replies.
- [PR] [MINOR][PYTHON][TESTS] Move `test_query_execution_unsupported_in_classic` in `DataFrameTestsMixin` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/22 12:44:04 UTC, 2 replies.
- [PR] [SPARK-54758][SQL] Revert fix generator resolution order in Project [spark] - posted by "mikhailnik-db (via GitHub)" <gi...@apache.org> on 2025/12/22 13:45:13 UTC, 0 replies.
- [PR] [SPARK-54801][SQL] Mark a few new 4.1 configs as internal [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/22 14:01:14 UTC, 6 replies.
- [PR] [SPARK-54799] [SQL] Refactor `UnpivotCoercion` [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/12/22 14:58:58 UTC, 3 replies.
- [PR] [SPARK-54787][PS] Use list comprehension instead of for loops in pandas [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2025/12/22 15:41:13 UTC, 2 replies.
- Re: [PR] [SPARK-54800] Changed default implementation for isObjectNotFoundException [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/22 16:06:03 UTC, 1 replies.
- [PR] [SPARK-54802][SQL][DOCS] Fix typos in OrderedFilters.scala [spark] - posted by "cboumalh (via GitHub)" <gi...@apache.org> on 2025/12/22 16:46:04 UTC, 3 replies.
- [PR] [SPARK-54803] Support BY NAME with INSERT INTO ... REPLACE WHERE [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/12/22 17:46:06 UTC, 1 replies.
- [PR] [SPARK-54804][CONNECT] Reduce conf RPCs SparkSession.createDataset(..) [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/12/22 18:17:44 UTC, 6 replies.
- [PR] [SPARK-54528][CONNECT][FOLLOWUP] Do not close the class loader of the session state if session is still in use [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/22 18:36:35 UTC, 2 replies.
- Re: [PR] [SPARK-54776][SQL] Improved the logs message regarding lambda function with SQL UDF [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/12/22 18:48:11 UTC, 3 replies.
- [PR] [SPARK-54807] Allow qualified names for built-in and session functions [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2025/12/22 19:56:12 UTC, 0 replies.
- [PR] [SPARK-54811] Use Spark 4.1.0 to regenerate `Spark Connect`-based `Swift` source code [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/22 23:42:54 UTC, 2 replies.
- [PR] [SPARK-54310][SQL] Add `numSourceRows` metric for `MergeIntoExec` [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/12/23 00:01:55 UTC, 0 replies.
- [PR] [SPARK-54812][SQL] Make executable commands not execute on resultDf.cache() [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/12/23 02:07:25 UTC, 2 replies.
- [PR] A new feature to optimize partitions size. [spark] - posted by "dotsering (via GitHub)" <gi...@apache.org> on 2025/12/23 02:24:31 UTC, 1 replies.
- [PR] [SPARK-54813] Remove `cores` configs from `tests/e2e/watched-namespaces/spark-example.yaml` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/23 02:33:10 UTC, 0 replies.
- [PR] [SPARK-54814] Set `parallel` to 1 for K8s integration tests [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/23 03:14:55 UTC, 2 replies.
- Re: [PR] Revert [SPARK-54758][SQL] Fix generator resolution order in Project [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/23 04:39:54 UTC, 1 replies.
- [PR] [WIP][SPARK-54556][CORE][FOLLOWUP] Enable checksum based indeterminate shuffle retry by default [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2025/12/23 06:59:36 UTC, 0 replies.
- Re: [PR] [SPARK-53504][SQL] Type framework [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/12/23 07:28:55 UTC, 0 replies.
- Re: [PR] [SPARK-54815][CONNECT] Do not close the class loader of the session state if session is still in use [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/23 07:45:43 UTC, 1 replies.
- [PR] [SPARK-54816][SQL] Make SQL configs not lazy [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/23 08:07:31 UTC, 2 replies.
- [PR] [SPARK-49671][SQL] Remove the RTRIM collation config [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/12/23 09:58:24 UTC, 1 replies.
- [PR] [SPARK-54817] [SQL] Refactor `Unpivot` resolution logic to `UnpivotTransformer` [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/12/23 10:27:19 UTC, 5 replies.
- [PR] [SPARK-54818][SQL] TaskMemoryManager allocate failed should log errorstack to help check memory usage [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2025/12/23 10:37:05 UTC, 12 replies.
- [PR] [SPARK-54819][SQL][TESTS] Refactor basic test classes [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/23 11:35:11 UTC, 8 replies.
- [PR] [SPARK-54820][PYTHON] Make `pandas_on_spark_type` compatible with 2.4.0 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/23 12:25:54 UTC, 0 replies.
- [PR] [SPARK-54821][SQL] Deprecate support for Derby JDBC datasource [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/23 12:34:25 UTC, 10 replies.
- [PR] [SPARK-54822][BUILD] Bump Parquet 1.17.0 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/23 13:02:02 UTC, 1 replies.
- Re: [PR] [SPARK-54823] Add SupportsUpdateV2 and UpdateTableExec [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2025/12/23 13:04:46 UTC, 1 replies.
- [PR] [SPARK-54824] Add support for multiGet and deleteRange for Rocksdb State Store [spark] - posted by "zeruibao (via GitHub)" <gi...@apache.org> on 2025/12/23 20:19:50 UTC, 2 replies.
- Re: [PR] [SPARK-54820][PYTHON] Make `pandas_on_spark_type` compatible with numpy 2.4.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/12/23 20:55:59 UTC, 1 replies.
- [PR] [BUILD] Bump Apache Parquet to 1.17.0 [spark] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2025/12/23 22:25:36 UTC, 2 replies.
- [PR] Test log4j 2.25.3 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/12/24 02:45:17 UTC, 0 replies.
- Re: [PR] [SPARK-54774][CORE] Submit failed should keep same exit code with app exit code [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2025/12/24 02:47:36 UTC, 5 replies.
- [PR] [SPARK-54826][INFRA] Delete scheduled job for numpy 2.1.3 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/24 03:33:00 UTC, 2 replies.
- Re: [PR] [SPARK-50483][CORE][SQL] BlockMissingException should be thrown even if ignoreCorruptFiles is enabled [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/24 03:45:04 UTC, 0 replies.
- [PR] [SPARK-54827][SQL] Add helper function `TreeNode.containsTag` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/24 03:57:45 UTC, 2 replies.
- [PR] [SPARK-54828][PYTHON][INFRA] Set up a scheduled builder for free-threaded Python 3.14 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/24 04:49:12 UTC, 4 replies.
- [PR] [SPARK-54829][PYTHON][INFRA] Refresh docker images for numpy 2.4 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/24 04:58:19 UTC, 2 replies.
- Re: [PR] [SPARK-54556][CORE][FOLLOWUP] Enable checksum based indeterminate shuffle retry by default [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2025/12/24 06:20:30 UTC, 1 replies.
- [PR] handle command return code in launch_gateway function [spark] - posted by "peterxcli (via GitHub)" <gi...@apache.org> on 2025/12/24 08:06:01 UTC, 0 replies.
- [PR] fix memory leak in cleaner [SPARK-54753] [spark] - posted by "scottme (via GitHub)" <gi...@apache.org> on 2025/12/24 08:11:03 UTC, 0 replies.
- [PR] [SPARK-54753] fix memory leak in cleaner of artifactManager [spark] - posted by "scottme (via GitHub)" <gi...@apache.org> on 2025/12/24 08:16:20 UTC, 0 replies.
- Re: [PR] [SPARK-54830][CORE] Enable checksum based indeterminate shuffle retry by default [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2025/12/24 08:40:46 UTC, 7 replies.
- [PR] [SPARK-54831][SQL] Add COMMENT ON COLUMN support to set and remove column comments [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2025/12/24 08:55:11 UTC, 0 replies.
- [PR] [SPARK-54832][UI] Spark executor page show driver gc times [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2025/12/24 10:01:35 UTC, 4 replies.
- [PR] [SPARK-54834][SQL] Add a new interface StaticProcedure [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/24 13:13:33 UTC, 3 replies.
- [PR] [SPARK-54835][SQL] Avoid unnecessary temp QueryExecution for nested command execution [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/24 14:40:26 UTC, 10 replies.
- [PR] [SPARK-54836][SQL] Include timestamp value in ArithmeticException for timestamp overflow errors [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2025/12/24 15:08:58 UTC, 0 replies.
- [PR] [SPARK-54837][DOCS] Document all built-in JDBC datasource providers [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/24 16:42:32 UTC, 3 replies.
- [PR] A new feature to optimize partition size and count [spark] - posted by "dotsering (via GitHub)" <gi...@apache.org> on 2025/12/24 19:39:30 UTC, 0 replies.
- [PR] SPARK-34519 ExecutorPodsAllocator applies exponential backoff delays … [spark] - posted by "fe2s (via GitHub)" <gi...@apache.org> on 2025/12/24 23:24:27 UTC, 0 replies.
- Re: [PR] [SPARK-53551][SQL] Improve `OffsetAndLimit` by avoiding duplicate evaluation [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/25 00:30:16 UTC, 1 replies.
- Re: [PR] [SPARK-54759][SQL] SQL scripting Cursor support [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/25 03:08:25 UTC, 26 replies.
- [PR] [SPARK-54826][INFRA][FOLLOW-UP] Delete removed path from build image caches [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/25 03:40:50 UTC, 2 replies.
- [PR] [SPARK-54829][PYTHON][INFRA][FOLLOW-UP] Also refresh pypy images [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/25 03:44:44 UTC, 2 replies.
- [PR] [SPARK-54839][PYTHON] Upgrade the minimum version of `numpy` to 2.0.0 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/25 05:04:27 UTC, 4 replies.
- [PR] [SPARK-54820][PYTHON][4.0][4.1] Make pandas_on_spark_type compatible with numpy 2.4.0 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/25 05:22:52 UTC, 2 replies.
- [PR] [SPARK-54840][SQL] OrcList Pre-allocation [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/12/25 06:11:33 UTC, 4 replies.
- [PR] [MINOR] Add Python 3.14 no GIL workflow in README [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/25 08:28:06 UTC, 2 replies.
- [PR] [SPARK-54842][PYTHON][TESTS] Fix `test_arrow_udf_chained_iii` in Python-Only MacOS26 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/25 09:19:07 UTC, 2 replies.
- Re: [PR] [SPARK-54838] A new feature to optimize partition size and count [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2025/12/25 09:53:41 UTC, 1 replies.
- [PR] [SPARK-XXXXX][SQL] Propagate session level Hive configs to shared Hive client [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/25 10:07:35 UTC, 8 replies.
- [PR] [SPARK-54843] Try_to_number expression not working for empty string input [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2025/12/25 10:12:08 UTC, 0 replies.
- Re: [PR] [SPARK-54843][SQL] Try_to_number expression not working for empty string input [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2025/12/25 10:15:48 UTC, 2 replies.
- [PR] [BUILD] Upgrade maven.version to 3.9.12 [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/12/25 10:26:30 UTC, 0 replies.
- [PR] Revert "[SPARK-54839][PYTHON] Upgrade the minimum version of `numpy` to 2.0.0" [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/25 10:55:51 UTC, 2 replies.
- [PR] [SPARK-50186][CORE] Clarify executor OOM handling documentation [spark] - posted by "Raviston6296 (via GitHub)" <gi...@apache.org> on 2025/12/25 14:06:29 UTC, 1 replies.
- [PR] [SPARK-50186][CORE] Clarify executor OutOfMemoryError handling docs [spark] - posted by "Raviston6296 (via GitHub)" <gi...@apache.org> on 2025/12/25 14:35:47 UTC, 7 replies.
- [PR] [SPARK-54846][SQL] Add codegen support for KLL sketch GetN functions [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/12/25 18:04:39 UTC, 0 replies.
- [PR] [SQL][MINOR] Add timezone to replacement of Uniform [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/12/25 18:59:34 UTC, 0 replies.
- [PR] [SPARK-54847][SQL] unify the proto output folder between sbt and maven [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/25 19:43:42 UTC, 1 replies.
- [PR] Refs/heads/spark 54666 fix to numeric float64 [spark] - posted by "mhferjani (via GitHub)" <gi...@apache.org> on 2025/12/25 20:33:57 UTC, 0 replies.
- Re: [PR] [SPARK-53596][SQL] Put translatable filters to the left side of untranslatable filters [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/26 00:30:31 UTC, 1 replies.
- Re: [PR] [SPARK-54753][SQL]fix memory leak of ArtifactManager [spark] - posted by "rainbowxq (via GitHub)" <gi...@apache.org> on 2025/12/26 01:52:58 UTC, 6 replies.
- [PR] Make num bins holding range more accurate [spark] - posted by "xunxunmimi5577 (via GitHub)" <gi...@apache.org> on 2025/12/26 02:01:08 UTC, 1 replies.
- Re: [PR] [SPARK-54844][BUILD] Upgrade maven.version to 3.9.12 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/12/26 02:15:58 UTC, 1 replies.
- [PR] [SPARK-54849][PYTHON] Upgrade the minimum version of `pyarrow` to 18.0.0 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/26 02:43:35 UTC, 2 replies.
- [PR] [SPARK-53413][SQL][FOLLOWUP] Fix `extractShuffleIds` to find `AdaptiveSparkPlanExec` anywhere in plan tree [spark] - posted by "baibaichen (via GitHub)" <gi...@apache.org> on 2025/12/26 05:35:38 UTC, 1 replies.
- Re: [PR] [SPARK-54122][SS] Implement TwsTester in Scala [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/12/26 07:30:13 UTC, 1 replies.
- Re: [PR] [SPARK-54847][SQL] unify the proto/antlr output folder between sbt and maven [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/26 08:35:38 UTC, 2 replies.
- Re: [PR] [SPARK-54834][SQL] Add new interfaces SimpleProcedure and SimpleFunction [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/26 08:41:24 UTC, 1 replies.
- Re: [PR] [SPARK-54850][SQL][FOLLOWUP] Improve `extractShuffleIds` to find `AdaptiveSparkPlanExec` anywhere in plan tree [spark] - posted by "baibaichen (via GitHub)" <gi...@apache.org> on 2025/12/26 08:58:14 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-54849][PYTHON] Upgrade the minimum version of `pyarrow` to 18.0.0 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/26 11:10:51 UTC, 1 replies.
- [PR] [SPARK-54851][BUILD] Support generating bloop files via sbt [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/26 11:20:12 UTC, 5 replies.
- [PR] [SPARK-54852] `NOT IN` subquery returns incorrect results with a collated table [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2025/12/26 13:06:19 UTC, 0 replies.
- [PR] [MINOR][SQL] Change withTimeZone in Cast to only put it if needed [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/12/26 17:23:00 UTC, 0 replies.
- [PR] [SPARK-54853][SQL] Check `hive.exec.max.dynamic.partitions` on spark side [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/26 17:40:05 UTC, 0 replies.
- Re: [PR] [SPARK-54853][SQL] Always check `hive.exec.max.dynamic.partitions` on the spark side [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/26 18:10:06 UTC, 4 replies.
- Re: [PR] [SPARK-52669][PySpark]Improvement PySpark choose pythonExec in cluster yarn client mode [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/27 00:29:52 UTC, 1 replies.
- Re: [PR] [SPARK-54847][BUILD] unify the proto/antlr output folder between sbt and maven [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/27 01:22:16 UTC, 0 replies.
- [PR] [SPARK-54854][SQL] Add queryId (UUIDv7) to SQL Execution Events [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/12/27 01:26:07 UTC, 0 replies.
- [PR] [SPARK-54321] Add Kafka 4.x Share Groups support for Structured Strea… [spark] - posted by "Shekharrajak (via GitHub)" <gi...@apache.org> on 2025/12/27 07:05:05 UTC, 0 replies.
- [PR] [SPARK-54856][SQL] Refactor scalar function lookup and resolution [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/27 13:34:28 UTC, 7 replies.
- [PR] [SPARK-54857][WEBUI][TESTS] Add test ensuring user name and app name in historypage get escaped [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/12/27 14:37:24 UTC, 4 replies.
- Re: [PR] [SPARK-54854][SQL] Add a UUIDv7 queryId to SQLExecution Events [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/27 15:19:21 UTC, 55 replies.
- Re: [PR] [SPARK-52502][UI] Thread count overview [spark] - posted by "Trouptuluptu (via GitHub)" <gi...@apache.org> on 2025/12/27 15:54:25 UTC, 0 replies.
- [PR] [SPARK-54858][INFRA] Fix syntax error in `test_report.yml` and recover GA workflow [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/12/27 17:55:04 UTC, 3 replies.
- [PR] [SPARK-54808] Qualified session view [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2025/12/28 03:44:00 UTC, 0 replies.
- [PR] [DO NOT MERGE] Improve code comments for column default value and small refactor [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/28 13:44:06 UTC, 0 replies.
- [PR] [SPARK-54859] Arrow by default API reference doc for PySpark UDFs (Spark 4.2) [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/12/29 04:38:25 UTC, 0 replies.
- Re: [PR] [SPARK-54821][DOCS] Deprecate support for Derby JDBC datasource [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/29 04:54:40 UTC, 0 replies.
- Re: [PR] [SPARK-54850][SQL] Improve `extractShuffleIds` to find `AdaptiveSparkPlanExec` anywhere in plan tree [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/12/29 06:39:35 UTC, 4 replies.
- [PR] [SPARK-54860][SPARK-999999][INFRA] Add JIRA Ticket Validating in GHA [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/12/29 07:09:48 UTC, 0 replies.
- [PR] [SPARK-54861][CORE] Reset task thread name to IDLE_TASK_THREAD_NAME when task completes [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2025/12/29 08:05:38 UTC, 2 replies.
- Re: [PR] [SPARK-54860][INFRA] Add JIRA Ticket Validating in GHA [spark] - posted by "Copilot (via GitHub)" <gi...@apache.org> on 2025/12/29 08:06:09 UTC, 5 replies.
- [PR] [SPARK-54862] Remove unused private object `RawTextHelper` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/12/29 09:41:56 UTC, 0 replies.
- Re: [PR] [SPARK-33737][K8S] Support getting pod state using Informers + Listers [spark] - posted by "skonto (via GitHub)" <gi...@apache.org> on 2025/12/29 11:57:35 UTC, 1 replies.
- [PR] [SPARK-54864][SQL] Add rCTE nodes to NormalizePlan [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/12/29 15:44:53 UTC, 3 replies.
- [PR] [SPARK-54865] Add foreachWithSubqueriesAndPruning method to QueryPlan [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/12/29 17:11:48 UTC, 0 replies.
- [PR] [SPARK-54866][SQL] Refactor Drop/RefreshFunction to avoid catalog lookup [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/29 18:17:32 UTC, 0 replies.
- Re: [PR] [SPARK-54630][SQL] Add timestamp_bucket function for temporal bucketing [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/12/29 18:30:38 UTC, 5 replies.
- [PR] [SPARK-54867][SS] Introduce NamedStreamingRelation wrapper for source identification during analysis [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/12/29 20:35:06 UTC, 0 replies.
- Re: [PR] [SPARK-54868][PYTHON][INFRA] Fail hanging tests and log the tracebacks [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/30 01:02:22 UTC, 11 replies.
- [PR] [SPARK-54869][PYTHON][TESTS] Apply the standard import of pyarrow compute in `test_arrow_udf_scalar` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/30 01:48:04 UTC, 7 replies.
- [PR] SELECT INTO [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2025/12/30 02:45:20 UTC, 0 replies.
- [PR] Revert "[SPARK-54830][CORE] Enable checksum based indeterminate shuff… [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/12/30 02:53:22 UTC, 0 replies.
- Re: [PR] Revert "[SPARK-54830][CORE] Enable checksum based indeterminate shuffle retry by default [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/30 05:34:40 UTC, 1 replies.
- Re: [PR] [SPARK-54862][DSTREAM] Remove unused private object `RawTextHelper` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/12/30 05:50:22 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-54812][SQL] Make executable commands not execute on resultDf.cache() [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/30 10:45:40 UTC, 0 replies.
- [PR] [SPARK-54870][SQL] Collation support for char/varchar and CTAS/RTAS [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/30 10:50:04 UTC, 4 replies.
- Re: [PR] [SPARK-54872][SQL] Unify column default value handling between v1 and v2 commands [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/30 11:47:35 UTC, 3 replies.
- [PR] [SPARK-54871] [SQL] Trim aliases from grouping and aggregate expressions before handling grouping analytics [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/12/30 11:50:13 UTC, 6 replies.
- [PR] [SPARK-54849][PYTHON][FOLLOW-UP] Update the version in `require_minimum_pyarrow_version` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/30 13:25:09 UTC, 3 replies.
- [PR] [SPARK-54873][SQL] Error out when seeing V2TableReference in resolved plan [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/12/30 14:40:08 UTC, 4 replies.
- [PR] [SPARK-54868][PYTHON][INFRA][FOLLOWUP] Increase test timeout to 450s [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/30 18:40:54 UTC, 4 replies.
- [PR] [SPARK-54874][TEST][INFRA] Avoid interleave failed test logs with test outputs [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/30 19:38:01 UTC, 1 replies.
- [PR] [SPARK-54868][PYTHON][INFRA][FOLLOWUP] Combine timeout path into TestRunner [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/30 22:36:45 UTC, 1 replies.
- Re: [PR] [DO_NOT_MERGE][SPARK-54390][SS] Fix JSON Deserialize in StreamingQueryListenerBus [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/12/31 00:05:01 UTC, 0 replies.
- [PR] [SPARK-54543][PYTHON][INFRA] Retire flake8 [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/12/31 00:37:22 UTC, 1 replies.
- [PR] [SPARK-54868][PYTHON][INFRA][FOLLOW-UP] Also enable `faulthandler` in classic tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/31 01:18:54 UTC, 3 replies.
- Re: [PR] [SPARK-54859][PYTHON] Arrow by default PySpark UDF API reference doc [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/12/31 01:27:14 UTC, 1 replies.
- [PR] [WIP][SPARK-54830][CORE] Enable checksum based indeterminate shuffle retry by default [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2025/12/31 02:04:57 UTC, 2 replies.
- [PR] [SPARK-54753][SQL] backport the fix in trunk branch to branch-4.0 [spark] - posted by "scottme (via GitHub)" <gi...@apache.org> on 2025/12/31 03:26:51 UTC, 1 replies.
- Re: [PR] [SPARK-54753][SQL] Fix memory leak of ArtifactManager (to branch 4.1) [spark] - posted by "scottme (via GitHub)" <gi...@apache.org> on 2025/12/31 03:27:51 UTC, 0 replies.
- [PR] Spark 54753 4.1 [spark] - posted by "scottme (via GitHub)" <gi...@apache.org> on 2025/12/31 03:56:52 UTC, 1 replies.
- Re: [PR] [SPARK-54753][SQL] backport the fix in trunk branch to branch-4.1 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/31 06:25:17 UTC, 1 replies.
- [PR] [MINOR][BUILD] Remove undefined -Pscala-2.13 profile from dev scripts [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/12/31 09:11:35 UTC, 0 replies.
- [PR] [SPARK-54877][UI] Make display stacktrace on UI error page configurable [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/12/31 10:11:55 UTC, 2 replies.
- Re: [PR] [SPARK-54753][SQL][4.1] Fix memory leak of ArtifactManager [spark] - posted by "scottme (via GitHub)" <gi...@apache.org> on 2025/12/31 11:44:14 UTC, 0 replies.
- [PR] [SPARK-54879][CORE] Add final status to Spark History Server [spark] - posted by "robreeves (via GitHub)" <gi...@apache.org> on 2025/12/31 23:24:03 UTC, 1 replies.