You are viewing a plain text version of this content. The canonical link for it is here.

---

- Re: [PR] [SPARK-54753][SQL][4.1] Fix memory leak of ArtifactManager [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/01/01 00:03:03 UTC, 2 replies.
- Re: [PR] [DO-NOT-MERGE][DRAFT] Test workflow for python 3.11 and spark connect 3.5 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/01 00:35:24 UTC, 1 replies.
- Re: [PR] [SPARK-53658][CONNECT] Accept literal data_type field in ExecutePlanResponse [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/01 00:35:25 UTC, 1 replies.
- Re: [PR] [SPARK-54854][SQL] Add a UUIDv7 queryId to SQLExecution Events [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2026/01/01 00:35:51 UTC, 4 replies.
- Re: [PR] [SPARK-54122][SS] Implement TwsTester in Scala [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/01 00:44:53 UTC, 50 replies.
- Re: [PR] [SPARK-47672][SQL] Avoid double eval from filter pushDown w/ projection pushdown [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/01/01 15:20:29 UTC, 11 replies.
- Re: [PR] [WIP] SELECT INTO [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/01 18:15:43 UTC, 0 replies.
- [PR] [WIP][SPARK-54881][SQL]Fix to simplify boolean expression of form like !(expr1 || expr2) in a single pass, where expr1 and expr2 are binary comparison expression [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2026/01/01 23:03:07 UTC, 2 replies.
- Re: [PR] [SPARK-54753][SQL][4.0] Fix memory leak of ArtifactManager [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/01/02 00:03:26 UTC, 1 replies.
- Re: [PR] [SPARK-54701][PYTHON] Improve the runnerConf chain for Python workers [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/01/02 00:05:11 UTC, 1 replies.
- Re: [PR] [SPARK-53676][PYTHON] Extend to support column name [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/02 00:31:15 UTC, 1 replies.
- Re: [PR] [SPARK-52011][SQL] Reduce HDFS NameNode RPC on vectorized Parquet reader [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/02 00:31:20 UTC, 5 replies.
- [PR] Clean up error messages for CLI and add new error mode DEBUG [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/01/02 01:42:26 UTC, 1 replies.
- [PR] [WIP][PYTHON] Remove legacy PYARROW_IGNORE_TIMEZONE [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/02 01:43:22 UTC, 1 replies.
- Re: [PR] [MINOR][BUILD] Remove undefined -Pscala-2.13 profile from dev scripts [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/02 02:04:54 UTC, 1 replies.
- [PR] Revert "[SPARK-54182][SQL][PYTHON] Optimize non-arrow conversion of df.toPandas`" [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/02 02:09:36 UTC, 3 replies.
- Re: [PR] [SPARK-54877][UI] Make display stacktrace on UI error page configurable [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/01/02 03:58:29 UTC, 1 replies.
- Re: [PR] [SPARK-49960][SQL] Custom ExpressionEncoder support and TransformingEncoder fixes [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/02 08:26:17 UTC, 2 replies.
- Re: [PR] [SPARK-54882][PYTHON] Remove legacy PYARROW_IGNORE_TIMEZONE [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/02 09:07:00 UTC, 1 replies.
- [PR] [SPARK-54884][CORE][TESTS] Remove private function `totalRunningTasksPerResourceProfile` from `ExecutorAllocationManager` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/02 09:20:57 UTC, 4 replies.
- [PR] [SPARK-54885][PYTHON] Remove unreachable code after upgrading pyarrow minimum version to 18.0.0 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/02 11:48:36 UTC, 3 replies.
- Re: [PR] [SPARK-54886] Add base session created in SparkConnectService [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/02 13:33:46 UTC, 7 replies.
- Re: [PR] [SPARK-53116][CONNECT] Fix conf setter when client is built with jar containing SQLConf but not its engine counterparts [spark] - posted by "garlandz-db (via GitHub)" <gi...@apache.org> on 2026/01/02 13:40:45 UTC, 0 replies.
- Re: [PR] [SPARK-53882][CONNECT] Add optional sqlstate to sparkthrowables [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/02 13:42:35 UTC, 0 replies.
- Re: [PR] SPARK-34519 ExecutorPodsAllocator applies exponential backoff delays … [spark] - posted by "fe2s (via GitHub)" <gi...@apache.org> on 2026/01/02 17:51:02 UTC, 2 replies.
- Re: [PR] [SPARK-54713][SQL] Add vector similarity/distance function expressions support [spark] - posted by "zhidongqu-db (via GitHub)" <gi...@apache.org> on 2026/01/02 18:34:59 UTC, 10 replies.
- [PR] [WIP] Allow non determinism in VALUES [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/01/02 19:02:39 UTC, 1 replies.
- Re: [PR] [SPARK-54390][SS] Fix JSON Deserialize in StreamingQueryListenerBus [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2026/01/02 19:53:42 UTC, 0 replies.
- Re: [PR] [SPARK-54867][SS] Introduce NamedStreamingRelation wrapper for source identification during analysis [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2026/01/02 19:55:34 UTC, 0 replies.
- Re: [PR] [SPARK-54883][MINOR] Clean up error messages for CLI and add new error mode DEBUG [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/01/02 22:49:19 UTC, 8 replies.
- Re: [PR] [SPARK-54789] Support label selector based filter on resources to reconcile [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2026/01/02 23:24:14 UTC, 1 replies.
- Re: [PR] [WIP] Default PySpark BinaryType to bytes. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/03 00:29:25 UTC, 1 replies.
- Re: [PR] [SPARK-53442]Make PrometheusServlet compatible with OpenMetrics [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/03 00:29:27 UTC, 1 replies.
- [PR] [WIP] Report test results to codecov [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/03 01:20:58 UTC, 1 replies.
- Re: [PR] [SPARK-54865][CONNECT][SQL] Add foreachWithSubqueriesAndPruning method to QueryPlan [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/03 14:41:00 UTC, 21 replies.
- Re: [PR] [SPARK-54871] [SQL] Trim aliases from grouping and aggregate expressions before handling grouping analytics [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/03 14:52:15 UTC, 1 replies.
- [PR] [WIP][SPARK-54891](https://issues.apache.org/jira/browse/SPARK-54891) Unified type coercion for Arrow-backed Python UDFs [spark] - posted by "fangchenli (via GitHub)" <gi...@apache.org> on 2026/01/03 22:29:50 UTC, 1 replies.
- [PR] [SPARK-54890][PYTHON] Allow users to enforce timezone match for timestamp conversion [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/03 22:32:44 UTC, 2 replies.
- Re: [PR] [SPARK-54868][PYTHON][INFRA][FOLLOW-UP] Combine timeout path into TestRunner [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/04 00:32:12 UTC, 1 replies.
- Re: [PR] [SPARK-54874][TESTS][INFRA] Avoid interleave failed test logs with test outputs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/04 00:34:02 UTC, 1 replies.
- Re: [PR] Fix nested char padding [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/04 00:35:04 UTC, 1 replies.
- Re: [PR] [SPARK-53686][SQL] DESC column should print out default value [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/04 00:35:05 UTC, 1 replies.
- Re: [PR] [SPARK-54543][PYTHON][INFRA] Retire flake8 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/04 00:36:40 UTC, 1 replies.
- Re: [PR] [SPARK-54879][CORE] Add final status to Spark History Server for failed executions [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/01/04 02:32:23 UTC, 11 replies.
- [PR] [SPARK-54892] Support `list` data type [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/04 04:44:57 UTC, 5 replies.
- Re: [PR] [DRAFT][SQL] Propagate session level Hive configs to shared Hive client [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/04 09:42:25 UTC, 0 replies.
- Re: [PR] [SPARK-54813] Remove `cores` configs from `tests/e2e/watched-namespaces/spark-example.yaml` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/04 09:52:28 UTC, 1 replies.
- [PR] [SPARK-54893] Support `listTables` and `getTable` in `Catalog` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/04 11:08:35 UTC, 2 replies.
- Re: [PR] [SPARK-54468][SDP] Add missing error classes [spark] - posted by "jaceklaskowski (via GitHub)" <gi...@apache.org> on 2026/01/04 13:15:54 UTC, 2 replies.
- Re: [PR] [SPARK-54610][SDP][DOCS] Improve SDP Programming Guide [spark] - posted by "jaceklaskowski (via GitHub)" <gi...@apache.org> on 2026/01/04 13:16:06 UTC, 3 replies.
- [PR] [SPARK-54894][PYTHON] Fix argument passing in `to_arrow_type` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/04 13:21:19 UTC, 3 replies.
- [PR] [SPARK-54876][SQL][FOLLOWUP] Spark SQL CLI：Incorrectly split the SQL statements [spark] - posted by "fusheng9399 (via GitHub)" <gi...@apache.org> on 2026/01/04 13:55:22 UTC, 1 replies.
- [PR] [SPARK-45846][SQL] optimizeNullAwareAntiJoin should respect autoBroadcastJoinThreshold [spark] - posted by "callmepandey (via GitHub)" <gi...@apache.org> on 2026/01/04 18:03:52 UTC, 3 replies.
- [PR] [SPARK-54895][SDP][DOCS] Fix markdown issues in Spark Declarative Pipelines Programming Guide [spark] - posted by "jaceklaskowski (via GitHub)" <gi...@apache.org> on 2026/01/04 19:38:26 UTC, 10 replies.
- [PR] [MINOR] Fix an invalid escape string [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/04 19:59:22 UTC, 2 replies.
- Re: [PR] Improve Helm templates to use Spark Operator HA feature easily [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/04 21:16:20 UTC, 8 replies.
- [PR] [SPARK-54897] Upgrade `Iceberg` to 1.10.1 in integration tests [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/04 21:54:40 UTC, 2 replies.
- [PR] [SPARK-54898] Upgrade `Iceberg` to 1.10.1 in `spark-connect-server-iceberg.yaml` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/04 22:10:18 UTC, 2 replies.
- [PR] [SPARK-54899] Upgrade `FlatBuffers` to v25.12.19 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/04 22:56:48 UTC, 4 replies.
- Re: [PR] [SPARK-53718][SQL] Add a new Optimizer rule to flatten nested MapConcat expressions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/05 00:34:18 UTC, 1 replies.
- Re: [PR] [SPARK-42746][SQL] Fix optimizer failure for SortOrder in the LISTAGG function [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/05 00:34:25 UTC, 1 replies.
- Re: [PR] [SPARK-54891] Unified type coercion for Arrow-backed Python UDFs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/05 01:16:20 UTC, 4 replies.
- Re: [PR] [SPARK-54830][CORE] Enable checksum based indeterminate shuffle retry by default [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2026/01/05 01:24:22 UTC, 7 replies.
- Re: [PR] [SPARK-54566][SQL] Enhance SparkSql FileSourceScanExec for easy integration [spark] - posted by "jinchengchenghh (via GitHub)" <gi...@apache.org> on 2026/01/05 02:15:38 UTC, 0 replies.
- Re: [PR] [SPARK-54660][SS] Add RTM trigger to python [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/01/05 02:44:45 UTC, 2 replies.
- Re: [PR] [SPARK-54876][SQL] The splitSemiColon function should correctly split SQL statements [spark] - posted by "fusheng9399 (via GitHub)" <gi...@apache.org> on 2026/01/05 04:02:14 UTC, 3 replies.
- [PR] [SPARK-54900][BUILD] Upgrade `ORC` to 1.9.8 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/05 04:22:51 UTC, 1 replies.
- Re: [PR] [SPARK-54900][BUILD][3.5] Upgrade `ORC` to 1.9.8 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/05 04:25:40 UTC, 3 replies.
- Re: [PR] [SPARK-53807][SPARK-50771][CORE] Fix race condition issues between `unlock` and `releaseAllLocksForTask` in `BlockInfoManager` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/01/05 04:28:09 UTC, 4 replies.
- Re: [PR] [SPARK-54367][Connect]Propagate close() from SessionState to CatalogPlugins to prevent leak [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/05 04:44:50 UTC, 5 replies.
- Re: [PR] [SPARK-54775][Core] Add logging for the execution steps of Spark shutdown hooks [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2026/01/05 04:55:56 UTC, 3 replies.
- [PR] [SPARK-54901] Selective column conversion for scalar pandas UDFs [spark] - posted by "fangchenli (via GitHub)" <gi...@apache.org> on 2026/01/05 05:21:27 UTC, 1 replies.
- Re: [PR] [SPARK-54759][SQL] SQL scripting Cursor support [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/05 05:22:22 UTC, 91 replies.
- [PR] Improve test coverage for Dataset API CoGroup [spark] - posted by "anchovYu (via GitHub)" <gi...@apache.org> on 2026/01/05 05:22:53 UTC, 1 replies.
- Re: [PR] [SPARK-54313][CORE] Add --extra-properties-file option for configuration layering [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/01/05 05:57:13 UTC, 3 replies.
- Re: [PR] [Minor] Improve test coverage for Dataset API CoGroup [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/05 06:05:10 UTC, 0 replies.
- Re: [PR] [MINOR] Improve test coverage for Dataset API CoGroup [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/05 06:06:35 UTC, 0 replies.
- Re: [PR] [SPARK-54889][INFRA] Report test results to codecov [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/05 09:03:46 UTC, 1 replies.
- [PR] [SPARK-54902][PYTHON][TESTS] Rename testing helper contextmanager for temp view [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/05 09:12:19 UTC, 3 replies.
- [PR] [SPARK-54903][PYTHON] Make to_arrow_schema/to_arrow_type able to set timezone [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/05 09:42:16 UTC, 6 replies.
- [PR] Fix buildFileDescriptor for any proto [spark] - posted by "gwy1995 (via GitHub)" <gi...@apache.org> on 2026/01/05 10:37:53 UTC, 1 replies.
- [PR] [SPARK-54904] Upgrade SBT to `1.12.0` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/01/05 11:15:46 UTC, 0 replies.
- Re: [PR] [SPARK-54904][BUILD] Upgrade SBT to `1.12.0` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/05 11:15:57 UTC, 3 replies.
- Re: [PR] [SPARK-54819][SQL][TESTS] Refactor basic test classes [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/05 11:26:40 UTC, 1 replies.
- Re: [PR] [SPARK-54901][Python] Selective column conversion for scalar pandas UDFs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/05 12:13:04 UTC, 4 replies.
- Re: [PR] [SPARK-54873][SQL] Error out when seeing V2TableReference in resolved plan [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/05 12:28:38 UTC, 0 replies.
- Re: [PR] [SPARK-54873][SQL] Simplify V2TableReference resolution as only temp view may contain it [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/05 12:32:46 UTC, 12 replies.
- [PR] [SPARK-54905][SQL] Simplify the traversal implementation of foreachWithSubqueries [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2026/01/05 13:16:07 UTC, 2 replies.
- [PR] [WIP] SELECT FROM INSERT [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/01/05 19:03:31 UTC, 1 replies.
- Re: [PR] [SPARK-54803] Support BY NAME with INSERT INTO ... REPLACE WHERE [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/01/05 19:37:41 UTC, 1 replies.
- Re: [PR] [SPARK-54682][SQL] Support showing parameters in DESCRIBE PROCEDURE [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/01/05 20:07:00 UTC, 2 replies.
- Re: [PR] [SPARK-54905][SQL] Add comments to foreachWithSubqueries [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/05 20:16:41 UTC, 7 replies.
- [PR] [SPARK-54906][TEST] Unify test entry for all pyspark tests [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/05 20:59:37 UTC, 2 replies.
- [PR] [SPARK-54684][SS] Introduce NameStreamingSources analyzer rule for streaming source evolution [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/01/05 21:28:21 UTC, 1 replies.
- Re: [PR] [SPARK-54521][SQL] Add to and from WKB for Geometry type [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/01/05 21:48:19 UTC, 41 replies.
- [PR] [SPARK-54632][PYTHON][FOLLOWUP] Add ruff to cli help options [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/05 21:56:03 UTC, 3 replies.
- [PR] [SPARK-54867][SS] Add streamingSourceIdentifyingName field to CatalogTable [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/01/05 22:04:00 UTC, 1 replies.
- [PR] [SPARK-54908] Apply dateFormat option during JSON schema inference [spark] - posted by "AMRUTH-ASHOK (via GitHub)" <gi...@apache.org> on 2026/01/05 22:10:03 UTC, 4 replies.
- [PR] [SPARK-54911][BUILD][TESTS] Upgrade `bouncycastle` to 1.83 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/05 23:59:37 UTC, 3 replies.
- [PR] [SPARK-54912][BUILD] Upgrade `commons-pool2` to 2.13.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/06 00:12:48 UTC, 4 replies.
- Re: [PR] [SPARK-54866][SQL] Refactor Drop/RefreshFunction to avoid catalog lookup [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2026/01/06 01:46:28 UTC, 3 replies.
- Re: [PR] [SPARK-54685][SQL][CONNECT] Remove redundant observed-metrics responses [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/06 03:51:41 UTC, 2 replies.
- [PR] [SPARK-54913][BUILD] Upgrade `gcs-connector` to 2.2.31 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/06 04:35:43 UTC, 4 replies.
- Re: [PR] [WIP][SPARK-54912][BUILD] Upgrade `commons-pool2` to 2.13.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/06 05:31:29 UTC, 0 replies.
- Re: [PR] [SPARK-54088][CORE] When TaskSchedulerImpl searches for an executor to schedule an unschedulable task, it should exclude executors that are pending to remove [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2026/01/06 08:04:19 UTC, 1 replies.
- Re: [PR] [SPARK-54881][SQL]Fix to simplify boolean expression of form like !(expr1 || expr2) in a single pass, where expr1 and expr2 are binary comparison expression [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/01/06 08:31:40 UTC, 16 replies.
- Re: [PR] [SPARK-54729][CORE] Proactively replicate shuffle data to the FallbackStorage [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/06 09:12:12 UTC, 0 replies.
- Re: [PR] [SPARK-54776][SQL] Improved the logs message regarding lambda function with SQL UDF [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/06 09:50:57 UTC, 4 replies.
- Re: [PR] [SPARK-54896] Improve Helm templates to use Spark Operator HA feature easily [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/06 10:45:14 UTC, 16 replies.
- [PR] [SPARK-54914] [SQL] Fixing DROP operator in pipe syntax to support qualified column names [spark] - posted by "Shubhambhusate (via GitHub)" <gi...@apache.org> on 2026/01/06 10:53:19 UTC, 6 replies.
- [PR] [SPARK-54915][K8S][INFRA][DOCS] Upgrade Volcano to 1.13.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/06 11:00:12 UTC, 4 replies.
- [PR] [SPARK-54916][K8S][BUILD] Enable `volcano` profile by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/06 11:29:16 UTC, 4 replies.
- [PR] [SPARK-54917][BUILD] Upgrade ORC to 2.1.4 [spark] - posted by "williamhyun (via GitHub)" <gi...@apache.org> on 2026/01/06 11:53:43 UTC, 1 replies.
- Re: [PR] [SPARK-54771][SQL] Remove ResolveUserSpecifiedColumns rule from RuleIdCollection [spark] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2026/01/06 12:21:20 UTC, 2 replies.
- [PR] [SPARK-54918][SQL] Normalize -0.0 to 0.0 in array operations [spark] - posted by "asugranyes (via GitHub)" <gi...@apache.org> on 2026/01/06 15:12:43 UTC, 1 replies.
- Re: [PR] [SPARK-54872][SQL] Unify column default value handling between v1 and v2 commands [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/06 16:36:40 UTC, 1 replies.
- [PR] [SPARK-54920] [SQL] Move grouping analytics extraction logic to a common `GroupingAnalyticsExtractor` [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/01/06 16:37:42 UTC, 3 replies.
- [PR] [SPARK-54919][SQL] Remove AgnosticExpressionPathEncoder usage tech-debt [spark] - posted by "chris-twiner (via GitHub)" <gi...@apache.org> on 2026/01/06 18:55:20 UTC, 2 replies.
- [PR] [SPARK-XXXXX][CORE] Add parentIds to StageData and fix compilation in JobPage [spark] - posted by "warrenzhu25 (via GitHub)" <gi...@apache.org> on 2026/01/06 19:33:17 UTC, 1 replies.
- Re: [PR] [SPARK-54599][PYTHON] Refactor PythonException so it can take errorClass with sqlstate [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/06 19:41:23 UTC, 2 replies.
- [PR] [SPARK-54922][PYTHON] Unify how args are passed to python workers [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/06 20:07:48 UTC, 3 replies.
- [PR] Analyze in query function [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2026/01/06 20:42:27 UTC, 1 replies.
- [PR] [SPARK-54787][PS] Improve performance in pandas by using list comprehension [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/01/06 20:48:51 UTC, 4 replies.
- Re: [PR] [SPARK-54443][SS] Integrate PartitionKeyExtractor in Re-partition reader [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2026/01/06 21:16:53 UTC, 7 replies.
- [PR] [SPARK-53991][SQL][TEST][FOLLOWUP] Improve KLL quantile errors by removing internal details [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/01/06 21:17:39 UTC, 4 replies.
- Re: [PR] [SPARK-54910][SS] Add streamingSourceIdentifyingName field to CatalogTable [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/01/06 21:39:38 UTC, 0 replies.
- [PR] [SPARK-54924][SS] State Rewriter to read state, transform it and write new state [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2026/01/06 22:35:05 UTC, 21 replies.
- Re: [PR] [SPARK-54768][SS]Python Stream Data Source should classify error if data returned doesn't match configured schema [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2026/01/06 22:39:46 UTC, 0 replies.
- [PR] [SPARK-54910][SS] Add sourceIdentifyingName parameter to StreamingRelationV2 [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/01/06 23:47:06 UTC, 3 replies.
- [PR] [SPARK-54925][PYTHON] Add the capability to dump threads for pyspark [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/07 00:02:42 UTC, 5 replies.
- [PR] [SPARK-54926] Improve Helm chart for adding labels and annotations for operator config map [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2026/01/07 00:14:40 UTC, 8 replies.
- [PR] [SPARK-54927] Add `Volcano` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/07 00:26:19 UTC, 2 replies.
- Re: [PR] [SPARK-49933][SQL] Push WHEN NOT MATCHED BY SOURCE predicates to target [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/07 00:30:14 UTC, 1 replies.
- Re: [PR] [SPARK-54532][PYTHON] Add support for sqlstate for PySparkException [spark] - posted by "gatorsmile (via GitHub)" <gi...@apache.org> on 2026/01/07 00:59:18 UTC, 1 replies.
- [PR] [SPARK-54928] Add shuffle migration statistics to MigrationInfo [spark] - posted by "warrenzhu25 (via GitHub)" <gi...@apache.org> on 2026/01/07 01:04:30 UTC, 1 replies.
- [PR] [SPARK-54929][PYTHON] Fix taskContext._resources reset in loop causes only last resource to be kept [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/07 01:05:53 UTC, 3 replies.
- [PR] [SPARK-54930][PYTHON][MINOR] Remove redundant _accumulatorRegistry.clear() call in worker.py [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/07 01:20:10 UTC, 1 replies.
- Re: [PR] [SPARK-54634][SQL] Add clear error message for empty IN predicate [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2026/01/07 01:20:45 UTC, 6 replies.
- Re: [PR] [SPARK-54906][PYTHON][TESTS] Unify test entry for all pyspark tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/07 01:21:43 UTC, 1 replies.
- [PR] [SPARK-54931] Support `Pod Disruption Budget` for Spark cluster workers [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/07 01:31:44 UTC, 4 replies.
- Re: [PR] [SPARK-54314][PYTHON][CONNECT] Improve Server-Side debuggability in Spark Connect by capturing client application's file name and line numbers [spark] - posted by "susheel-aroskar (via GitHub)" <gi...@apache.org> on 2026/01/07 03:24:55 UTC, 9 replies.
- [PR] [SPARK-54932] Use `(pi|pi-with-driver-timeout).yaml` to show `ttlAfterStopMillis` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/07 05:21:16 UTC, 2 replies.
- [PR] [SPARK-54933][PYTHON][CONNECT] Avoid repeatedly fetching config `binary_as_bytes` in `toLocalIterator` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/07 05:39:16 UTC, 3 replies.
- Re: [PR] Add Spark 4 protobuf definitions and basic working [spark-connect-rust] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/01/07 06:32:08 UTC, 1 replies.
- [PR] [SPARK-54934][CORE] Make UnsafeInMemorySorter free memory thread-safety [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2026/01/07 06:33:00 UTC, 4 replies.
- Re: [PR] [SPARK-47086][SPARK-48022][BUILD][CORE][WEBUI] Upgrade Jetty to 12.1.5, Jersey to 3.1.11 and Servlet to 6.0 [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/01/07 06:35:12 UTC, 7 replies.
- [PR] [SPARK-54935] Improve `Row.==` to support array types [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/07 07:07:29 UTC, 2 replies.
- [PR] [SPARK-49872][FOLLOWUP] Remove Jackson JSON string length limit in KVStoreScalaSerializer [spark] - posted by "rednaxelafx (via GitHub)" <gi...@apache.org> on 2026/01/07 07:23:16 UTC, 3 replies.
- Re: [PR] [SPARK-54930][PYTHON] Remove redundant _accumulatorRegistry.clear() call in worker.py [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/01/07 08:01:16 UTC, 5 replies.
- Re: [PR] [SPARK-54852][SQL] `NOT IN` subquery returns incorrect results with a collated table [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/07 08:09:55 UTC, 1 replies.
- Re: [PR] [SPARK-53991][SQL][TEST][FOLLOW-UP] Improve KLL quantile errors by removing internal details [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/07 11:21:56 UTC, 3 replies.
- Re: [PR] [SPARK-54881][SQL] Improve `BooleanSimplification` to handle negation of conjunction and disjunction in one pass [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/07 11:32:37 UTC, 16 replies.
- [PR] [SPARK-54937][PYTHON][TESTS] Add tests for timezone conversion w/o PYARROW_IGNORE_TIMEZONE [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/07 13:23:14 UTC, 3 replies.
- [PR] [SPARK-54947][CORE] Refactor block mapping with BlockInfoGroup for better block management [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2026/01/07 14:03:52 UTC, 1 replies.
- Re: [PR] [SPARK-54905][SQL] Simplify foreachWithSubqueries implementation in QueryPlan [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2026/01/07 14:25:46 UTC, 7 replies.
- [PR] [SPARK-54948][PYTHON][TEST] Use the same testsuite name for same tests [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/07 19:21:38 UTC, 3 replies.
- [PR] [SPARK-54949][PYTHON] Move pyproject.toml to repo root [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/07 20:01:20 UTC, 7 replies.
- [PR] [SPARK-54950][PYTHON][TEST] Move unittest magic to unittestutils [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/07 21:29:40 UTC, 3 replies.
- Re: [PR] [SPARK-54698][SQL] Support hashing for all data types for array set like operations [spark] - posted by "asugranyes (via GitHub)" <gi...@apache.org> on 2026/01/07 21:44:09 UTC, 0 replies.
- [PR] [SPARK-54938][PYTHON][TESTS] Add tests for pa.array type inference [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/07 22:57:57 UTC, 21 replies.
- [PR] [SPARK-54922][PYTHON] Remove ignore[arg-type] for np.set_printoptions [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/07 23:08:16 UTC, 4 replies.
- Re: [PR] [SPARK-53991][SQL] Add SQL support for KLL quantiles functions based on DataSketches [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/01/08 00:21:49 UTC, 0 replies.
- Re: [PR] [SPARK-54785][SQL] Add support for binary sketch aggregations in KLL [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/08 00:22:25 UTC, 14 replies.
- [PR] [SPARK-54590][SS] Support CheckpointV2 for StatePartitionAllColumnFamiliesWriter [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2026/01/08 00:29:28 UTC, 10 replies.
- Re: [PR] [SPARK-51519][SQL] MERGE INTO/UPDATE/DELETE support join hint [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/08 00:31:43 UTC, 1 replies.
- Re: [PR] [SPARK-54342][BUILD] Unify scalatest format reports between SBT and maven builds [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2026/01/08 01:01:15 UTC, 0 replies.
- Re: [PR] [SPARK-54325][TESTS] Use custom matcher in ExecutorSuite testThrowable [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2026/01/08 01:04:04 UTC, 0 replies.
- [PR] [SPARK-54939][PYTHON][TESTS] Add tests for pa.array type coercion [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/08 01:04:13 UTC, 8 replies.
- [PR] [SPARK-54954][PYTHON] Add overload stubs for remote_only [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/08 01:21:25 UTC, 1 replies.
- [PR] Revert "[SPARK-54922][PYTHON] Remove ignore[arg-type] for np.set_prin… [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/08 01:55:09 UTC, 4 replies.
- [PR] [SPARK-54957][PYTHON][TEST] Remove the unnecessary sleep in streaming tests [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/08 04:57:15 UTC, 3 replies.
- [PR] [SPARK-54958][PYTHON][TEST] Accelerate test_cv_io_pipeline.py [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/08 06:33:52 UTC, 1 replies.
- [PR] [SPARK-54959][CORE] Disable shuffle checksum mismatch fully retry when push based shuffle enabled [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2026/01/08 08:31:38 UTC, 4 replies.
- [PR] [SPARK-54940][Python] Add tests for pa.scalar type inference [spark] - posted by "fangchenli (via GitHub)" <gi...@apache.org> on 2026/01/08 08:42:41 UTC, 6 replies.
- [PR] [SPARK-54960][INFRA] Simplify generating contributors of the release process [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/08 09:11:17 UTC, 10 replies.
- [PR] [SPARK-54961] [SQL] Introduce `GroupingAnalyticsTransformer` [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/01/08 09:14:02 UTC, 10 replies.
- [PR] [SPARK-54962][PYTHON] Fix nullable integers handling in Pandas UDF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/08 11:33:35 UTC, 15 replies.
- [PR] [SPARK-54963][PYTHON][CONNECT] Make `createDataFrame` respect `prefer_timestamp_ntz` when `infer_pandas_dict_as_map` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/08 11:52:06 UTC, 3 replies.
- [PR] [SPARK-54964] Bump Java Operator SDK to version 5.2.2 [spark-kubernetes-operator] - posted by "csviri (via GitHub)" <gi...@apache.org> on 2026/01/08 12:39:51 UTC, 6 replies.
- [PR] [SPARK-54971] Recognizing the existence of the SQL Syntax WITH SCHEMA EVOLUTION for SQL INSERT statements in the Parser [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/01/08 15:10:05 UTC, 1 replies.
- [PR] [SPARK-54972][SQL] Improve NOT IN subqueries with non-nullable columns [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/01/08 15:53:55 UTC, 6 replies.
- [PR] [SPARK-54974][SQL] Always propagate static confs to views/UDFs from active session [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2026/01/08 16:43:42 UTC, 1 replies.
- [PR] [SPARK-54973][Python] Fix TVF with column reference works in `lateralJoin` without `.outer()` [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2026/01/08 16:45:21 UTC, 1 replies.
- Re: [PR] [SPARK-54973][SQL][Python] Fix TVF with column reference works in `lateralJoin` without `.outer()` [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2026/01/08 17:06:24 UTC, 8 replies.
- Re: [PR] [SHUFFLE][WIP]Prototype using remote storage for shuffle [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/01/08 17:54:12 UTC, 2 replies.
- [PR] [MINOR][SQL] SQL state code change from XX000 to 42704 for MISSING_ATTRIBUTES [spark] - posted by "linhongliu-db (via GitHub)" <gi...@apache.org> on 2026/01/08 18:53:44 UTC, 0 replies.
- Re: [PR] [SPARK-54954][PYTHON] Fix remote related type hints in util.py [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/08 20:17:50 UTC, 2 replies.
- [PR] [DRAFT][SQL][PYTHON][CONNECT] Enable xxhash64 with seed parameter [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/01/08 20:39:59 UTC, 1 replies.
- Re: [PR] [SPARK-54337][PS] Add support for PyCapsule to Pyspark [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/01/08 21:34:00 UTC, 4 replies.
- [PR] [SPARK-54975][SQL][TESTS] Refactor Merge Into Schema Evolution Tests [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/01/08 22:53:39 UTC, 9 replies.
- [PR] [SPARK-54976][PYTHON][TEST] Accelerate test_job_cancellation [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/08 23:08:19 UTC, 3 replies.
- Re: [PR] [SPARK-54971] Add WITH SCHEMA EVOLUTION syntax for SQL INSERT [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/01/08 23:46:56 UTC, 20 replies.
- [PR] [SPARK-54977][PYTHON][TEST] Accelerate test_observation.py [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/08 23:47:51 UTC, 4 replies.
- Re: [PR] [SPARK-54179][SQL] Add Native Support for Apache Tuple Sketches [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/01/08 23:51:12 UTC, 44 replies.
- Re: [PR] [SPARK-53756][SQL][TESTS] Avoid NoSuchFileException when traversing walk files iterator to fix flaky test [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/09 00:31:16 UTC, 1 replies.
- Re: [PR] [SPARK-54958][PYTHON][ML][TEST] Accelerate test_cv_io_pipeline.py [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/09 01:41:41 UTC, 1 replies.
- Re: [PR] [SPARK-33863][PYTHON] Respect session timezone in udf workers [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/09 01:55:38 UTC, 0 replies.
- [PR] Fix threaddump for run-tests [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/09 02:33:57 UTC, 1 replies.
- [PR] [SPARK-54978][CORE] Change log level to waring in UnifiedMemoryManager [spark] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2026/01/09 03:18:41 UTC, 1 replies.
- [PR] [SPARK-54979][BUILD] Upgrade ORC to 2.2.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/09 03:31:12 UTC, 7 replies.
- [PR] [MINOR][BUILD] Use commands that work for more OS and more portable [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/01/09 06:11:19 UTC, 0 replies.
- Re: [PR] [MINOR][BUILD] Use commands that work for more OS and more portable in release script [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/01/09 06:29:19 UTC, 0 replies.
- [PR] [SPARK-54980][SQL] Convert the JDBC isolation level to a string [spark] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2026/01/09 06:49:56 UTC, 6 replies.
- [PR] [SPARK-54981] Improve `DataFrame.collect` to support `Bool|Int|Float|Double` types via `[any Sendable]` cast [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/09 06:50:58 UTC, 2 replies.
- Re: [PR] [SPARK-54982][INFRA] Use ASF_NEXUS_TOKEN to release and drop staging repository when finalizing the RC [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/09 06:53:23 UTC, 10 replies.
- [PR] [SPARK-54122][FOLLOWUP] Fix Javadoc generation error [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/01/09 07:05:56 UTC, 2 replies.
- [PR] [SPARK-54983] Upgrade Spark to 4.1.1 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/09 07:08:29 UTC, 4 replies.
- Re: [PR] [SPARK-54925][PYTHON][FOLLOWUP] Fix threaddump for run-tests [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/09 07:13:47 UTC, 4 replies.
- [PR] [SPARK-54984][SS] State Repartition execution and integrate with State Rewriter [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2026/01/09 07:28:08 UTC, 10 replies.
- Re: [PR] [SPARK-54122][SS][FOLLOWUP] Fix Javadoc generation error [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/01/09 07:41:31 UTC, 4 replies.
- [PR] [SPARK-54985][CORE] Show memory usage when task memory manager can't allocate memory page [spark] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2026/01/09 08:33:31 UTC, 6 replies.
- Re: [PR] [SPARK-54864][SQL] Add rCTE nodes to NormalizePlan [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/09 09:30:06 UTC, 1 replies.
- [PR] [SPARK-54986][PYTHON][ML][CONNECT] Do not retry `_delete_ml_cache` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/09 11:39:35 UTC, 4 replies.
- [PR] [SPARK-54987][PYTHON] Change the default value of prefer_timestamp_ntz to True in `from_arrow_type/from_arrow_schema` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/09 12:00:55 UTC, 5 replies.
- Re: [PR] [SPARK-54807][SQL] Allow qualified names for built-in and session functions [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2026/01/09 12:14:50 UTC, 17 replies.
- [PR] [WIP] Proposal on state store change to prepare for new state format [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/01/09 12:50:10 UTC, 2 replies.
- Re: [PR] [SPARK-54887][CONNECT] Add optional sqlstate to sparkthrowables [spark] - posted by "asf-gitbox-commits (via GitHub)" <gi...@apache.org> on 2026/01/09 13:59:33 UTC, 5 replies.
- Re: [PR] [SPARK-53882][CONNECT][DOCS] Add documentation comparing behavioral differences between Spark Connect and Spark Classic [spark] - posted by "asf-gitbox-commits (via GitHub)" <gi...@apache.org> on 2026/01/09 14:02:27 UTC, 0 replies.
- [PR] [SPARK-54988][SQL] Simplify the implementation of Observation.tryComplete [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2026/01/09 16:30:41 UTC, 1 replies.
- [PR] [SPARK-54864][SQL] Fix rCTEs in NormalizePlan [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2026/01/09 17:43:37 UTC, 1 replies.
- [PR] [MINOR][PS] Convert loop append in Pyspark to list comprehension [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/01/09 19:43:47 UTC, 2 replies.
- [PR] [SPARK-54989][PYTHON][TEST] Improve eventually util [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/09 19:52:01 UTC, 3 replies.
- Re: [PR] [SPARK-54907][SS] Introduce NameStreamingSources analyzer rule for streaming source evolution [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/01/09 20:25:44 UTC, 2 replies.
- [PR] [SPARK-54889][INFRA][FOLLOWUP] Enable codecov test report on all stable workflows [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/09 21:23:11 UTC, 10 replies.
- Re: [PR] Add option to skip Unix native rm explicitly [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/10 00:31:01 UTC, 1 replies.
- [PR] [SPARK-54994] Publish Apache Spark `4.1.1` to docker registry [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/10 00:32:01 UTC, 3 replies.
- [PR] [SPARK-54995][PYTHON] Make a fast path for foreachPartition [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/10 00:55:46 UTC, 5 replies.
- [PR] [SPARK-54997] Use Spark 4.1.1 instead of 4.1.0 in docs, examples, tests, and default values [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/10 03:04:30 UTC, 0 replies.
- Re: [PR] [SPARK-54122] [WIP] Implement TwsTester (old version) [spark] - posted by "fedimser (via GitHub)" <gi...@apache.org> on 2026/01/10 03:34:56 UTC, 0 replies.
- Re: [PR] [SPARK-54997] Use Spark 4.1.1 in docs, examples, tests, and default values [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/10 03:59:53 UTC, 1 replies.
- [PR] [SPARK-54998] Disable `ConstraintTests` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/10 04:02:57 UTC, 3 replies.
- [PR] [SPARK-54805] Implement TwsTester in PySpark [spark] - posted by "fedimser (via GitHub)" <gi...@apache.org> on 2026/01/10 04:24:22 UTC, 2 replies.
- [PR] [SPARK-55001] Update GitHub Action YAML file in branch-0.7 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/10 04:41:12 UTC, 4 replies.
- [PR] [SPARK-55002] Bump version to 0.8.0-SNAPSHOT in `main` branch [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/10 04:50:42 UTC, 2 replies.
- [PR] [SPARK-55005] Fix CONTINUE HANDLER to continue loop execution after handling exceptions in loop body [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2026/01/10 18:03:07 UTC, 3 replies.
- [PR] [SPARK-53758] Fix EXIT handler not exiting properly if triggered from another EXIT handler [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2026/01/10 18:25:25 UTC, 3 replies.
- [PR] Optimize BestEffortLazyVal. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2026/01/10 22:05:39 UTC, 5 replies.
- [PR] [SPARK-54941][Python] Add tests for pa.scalar type coercion [spark] - posted by "fangchenli (via GitHub)" <gi...@apache.org> on 2026/01/11 07:50:34 UTC, 2 replies.
- Re: [PR] [SPARK-54917][BUILD][4.0] Upgrade ORC to 2.1.4 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/11 08:09:25 UTC, 1 replies.
- [PR] [SPARK-54944][Python] Add tests for pa.Array.to_pandas with default arguments [spark] - posted by "fangchenli (via GitHub)" <gi...@apache.org> on 2026/01/11 23:06:29 UTC, 4 replies.
- [PR] [MINOR][DOCS] Add a bit of more description for `ASF_NEXUS_TOKEN` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/01/11 23:46:19 UTC, 4 replies.
- Re: [PR] SPARK-53790 support generic beans in arrow encoder [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/12 00:33:25 UTC, 6 replies.
- [PR] [SPARK-55006] Use Spark 4.1.1 for Spark 4.1 integration tests [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/12 01:13:53 UTC, 2 replies.
- Re: [PR] [SPARK-55005][SQL] Fix CONTINUE HANDLER to continue loop execution after handling exceptions in loop body [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/12 01:55:00 UTC, 0 replies.
- [PR] [SPARK-55007] Make `README.md` and `Examples` up-to-date with 4.1.1 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/12 02:19:04 UTC, 2 replies.
- Re: [PR] [SPARK-54988][SQL] Simplify the implementation of ObservationManager.tryComplete [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/12 02:28:00 UTC, 1 replies.
- [PR] [SPARK-55008] Display Query ID in SparkUI [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2026/01/12 04:41:22 UTC, 1 replies.
- [PR] [SPARK-55009][CORE] Remove unnecessary memory copy from the constructor of `LevelDBTypeInfo/RocksDBTypeInfo.Index` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/12 04:51:06 UTC, 4 replies.
- Re: [PR] [SPARK-54821][DOCS] Deprecate support for Derby JDBC datasource [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/12 06:23:40 UTC, 1 replies.
- [PR] [SPARK-47086][BUILD][CORE][FOLLOWUP] Fix `NoClassFoundError` related to Jetty 12 when building with Maven [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/01/12 12:59:23 UTC, 7 replies.
- Re: [PR] [SPARK-54864][SQL][FOLLOWUP] Fix rCTEs in NormalizePlan [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2026/01/12 14:38:50 UTC, 3 replies.
- Re: [PR] [SPARK-46165][PS] Add support for pandas.DataFrame.all axis=1 [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/01/12 16:31:58 UTC, 4 replies.
- [PR] [SPARK-55011][DOCS] CURSORs docs [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/01/12 17:22:16 UTC, 3 replies.
- [PR] [SPARK-55012][Python] Optimize ThreadPool usage in Arrow UDF concurrent execution [spark] - posted by "fangchenli (via GitHub)" <gi...@apache.org> on 2026/01/12 18:20:23 UTC, 4 replies.
- [PR] [SPARK-53074][SQL][3.5] Avoid partial clustering in SPJ to meet a child's required distribution [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/01/12 18:51:43 UTC, 5 replies.
- Re: [PR] [SPARK-54310][SQL] Add `numSourceRows` metric for `MergeIntoExec` [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/01/12 19:06:49 UTC, 7 replies.
- [PR] [SPARK-55013][STREAMING][SQL] Add SQL parser support for streaming source naming infrastructure [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/01/12 19:59:09 UTC, 1 replies.
- [PR] [SPARK-54990][PYTHON] Fix how classproperty is implemented in session.py [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/12 19:59:32 UTC, 4 replies.
- [PR] [WIP][FOLLOW-ON][SPARK-55014][SQL] Split projection with splitting complex non-pushable filters [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/01/12 21:00:03 UTC, 2 replies.
- [PR] [SPARK-54991][PYTHON] Correct type hint for streaming/listener.py [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/12 21:17:39 UTC, 3 replies.
- [PR] [SS][SQL] Fix decodeRemainingKey numFields calculation in PrefixKeyScanStateEncoder [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/01/12 22:20:15 UTC, 1 replies.
- [PR] [SPARK-54992][PYTHON] Replace cast with a runtime check for make_timestamp [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/12 22:33:30 UTC, 4 replies.
- Re: [PR] [SPARK-54870][SQL] Collation support for char/varchar and CTAS/RTAS [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/01/12 22:34:00 UTC, 1 replies.
- Re: [PR] [SPARK-55012][PYTHON] Optimize ThreadPool usage in Arrow UDF concurrent execution [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/01/12 23:03:34 UTC, 8 replies.
- [PR] [SPARK-XXXXX][SQL] Prevent stack overflow when SQLConf.get is called during sessionState initialization [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/01/12 23:33:58 UTC, 1 replies.
- [PR] [SPARK-54942][PYTHON][TESTS] Add tests for pa.Array.cast with default arguments [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/13 00:15:55 UTC, 4 replies.
- Re: [PR] [SPARK-55016][SQL] Prevent stack overflow when SQLConf.get is called during sessionState initialization [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/01/13 00:47:47 UTC, 9 replies.
- [PR] [SPARK-55018][PYTHON][TEST] Fix test_convergence by not overflowing the list [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/13 01:27:24 UTC, 3 replies.
- [PR] [DRAFT][SQL] Allow DROP TABLE to drop VIEW [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/01/13 01:53:47 UTC, 1 replies.
- Re: [PR] [WIP][DRAFT][SQL] Allow DROP TABLE to drop VIEW [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/01/13 01:54:10 UTC, 0 replies.
- [PR] [MINOR][INFRA] Add Github copilot instructions/agents/prompts/skills to .gitIgnore [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/01/13 02:44:00 UTC, 0 replies.
- [PR] [WIP] Unify the indeterminate shuffle retry solution [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2026/01/13 04:42:37 UTC, 1 replies.
- [PR] [SPARK-55020][PYTHON] Do not delete remote cache in __del__ [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/13 05:09:17 UTC, 11 replies.
- Re: [PR] [SPARK-55008][SQL][WEBUI] Display Query ID in SparkUI [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/13 06:48:03 UTC, 1 replies.
- Re: [PR] [SPARK-55019][SQL] Allow DROP TABLE to drop VIEW [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/13 06:58:53 UTC, 5 replies.
- [PR] [SPARK-55021][CORE][TESTS] Introduce `SparkTestSuite` as the base class for all scalatest styles [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/13 07:07:31 UTC, 11 replies.
- [PR] [SPARK-55020][PYTHON][TEST] Skip flaky test_distributed_lda test temporarily [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/13 07:49:30 UTC, 4 replies.
- [PR] [SPARK-55022][SQL][TESTS] Remove unnecessary mixins with `SharedSparkSession` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/13 09:22:01 UTC, 3 replies.
- [PR] [SPARK-55023][CORE][SQL][TESTS] Remove unnecessary `BeforeAndAfterAll` and `BeforeAndAfterEach` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/13 09:26:10 UTC, 3 replies.
- Re: [PR] [SPARK-54822][BUILD] Bump Parquet 1.17.0 [spark] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2026/01/13 11:53:55 UTC, 3 replies.
- [PR] [SPARK-55024][SQL] Use REQUIRES_SINGLE_PART_NAMESPACE error for session catalog namespace validation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/13 14:23:34 UTC, 3 replies.
- Re: [PR] [MINOR][SQL] Change withTimeZone in Cast to only put it if needed [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2026/01/13 14:55:55 UTC, 0 replies.
- Re: [PR] [SQL][MINOR] Extend Uniform to be TimeZoneAwareExpression [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/13 15:40:23 UTC, 0 replies.
- Re: [PR] [SPARK-55025][PS] Improve performance in pandas by using list comprehension [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/01/13 16:28:01 UTC, 2 replies.
- Re: [PR] [SPARK-54838][SQL] A new feature to optimize partition size and count [spark] - posted by "dotsering (via GitHub)" <gi...@apache.org> on 2026/01/13 18:40:11 UTC, 0 replies.
- Re: [PR] [SPARK-55013][SS][SQL] Add SQL parser support for streaming source naming infrastructure [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2026/01/13 19:35:07 UTC, 0 replies.
- [PR] [SPARK-55027] Move writeConf to PythonWorkerUtils [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/13 21:22:46 UTC, 1 replies.
- [PR] [SPARK-54870][FOLLOWUP][SQL] Add unapply methods to CharType and VarcharType for backward compatible pattern matching [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/01/13 21:41:01 UTC, 1 replies.
- [PR] [SPARK-55028] Pass result_id unconditionally to UDF workers [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/13 22:02:46 UTC, 1 replies.
- Re: [PR] [SPARK-54944][Python][TESTS] Add tests for pa.Array.to_pandas with default arguments [spark] - posted by "fangchenli (via GitHub)" <gi...@apache.org> on 2026/01/13 22:05:47 UTC, 0 replies.
- [PR] Propagate streaming source identifying name through resolution pipeline [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/01/13 22:25:27 UTC, 2 replies.
- Re: [PR] [MINOR][INFRA] Add GitHub copilot instructions/agents/prompts/skills to .gitignore [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/01/13 23:14:04 UTC, 1 replies.
- [PR] [SPARK-55032][PYTHON] Refactor profilers in workers.py [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/13 23:55:56 UTC, 3 replies.
- Re: [PR] [SPARK-XXXXX][BUILD] Migrate from javax.servlet to jakarta.servlet and add enforcer rules [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/14 00:32:09 UTC, 1 replies.
- Re: [PR] [SPARK-52088][CORE] Refactor the `ClosureCleaner#clean` and avoid using the `-Djdk.reflect.useDirectMethodHandle=false` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/14 00:32:11 UTC, 1 replies.
- Re: [PR] [SPARK-55026][CORE] Optimize BestEffortLazyVal. [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/14 01:25:40 UTC, 0 replies.
- Re: [PR] [SPARK-55028][PYTHON] Pass result_id unconditionally to UDF workers [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/01/14 01:31:38 UTC, 1 replies.
- Re: [PR] [SPARK-54870][FOLLOW-UP][SQL] Add unapply methods to CharType and VarcharType for backward compatible pattern matching [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/14 04:52:24 UTC, 1 replies.
- Re: [PR] [MINOR][SQL] Extend Uniform to be TimeZoneAwareExpression [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/14 05:12:48 UTC, 1 replies.
- Re: [PR] [SPARK-55026][CORE][SQL] Optimize BestEffortLazyVal. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2026/01/14 05:29:07 UTC, 8 replies.
- [PR] [SPARK-55033][SQL] Fix stringArgs of DSv2 writing commands [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/01/14 06:22:48 UTC, 7 replies.
- Re: [PR] [SPARK-55015][SS][SQL] Fix decodeRemainingKey numFields calculation in PrefixKeyScanStateEncoder [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/01/14 07:56:21 UTC, 3 replies.
- [PR] [SPARK-54870][SQL][FOLLOWUP] Remove dead code and fix typo [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/14 10:20:16 UTC, 9 replies.
- [PR] [SPARK-55034][PYTHON][TESTS] Test `test_arrow_udf_output_timestamps_ltz` without timezone conversion to UTC [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/14 11:04:10 UTC, 3 replies.
- [PR] [SPARK-54987][PYTHON][DOCS][FOLLOW-UP] Update the docstring of `to_arrow_type` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/14 11:18:12 UTC, 3 replies.
- [PR] [SPARK-55035] Perform shuffle cleanup in child executions [spark] - posted by "bozhang2820 (via GitHub)" <gi...@apache.org> on 2026/01/14 12:01:01 UTC, 4 replies.
- [PR] [SPARK-55036][PYTHON] Add `ArrowTimeStampeConversion` for arrow timezone handling [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/14 13:18:14 UTC, 2 replies.
- [PR] [SPARK-55037][CONNECT][SQL] Re-implement Observation Without Using the QueryExecutionListener [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2026/01/14 16:58:16 UTC, 57 replies.
- [PR] Add documentation for TwsTester [spark] - posted by "fedimser (via GitHub)" <gi...@apache.org> on 2026/01/14 19:31:50 UTC, 1 replies.
- Re: [PR] [SPARK-55029][SS] Propagate streaming source identifying name through resolution pipeline [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/01/14 19:46:59 UTC, 1 replies.
- [PR] [SPARK-54921][CORE] Add parentIds in StageData [spark] - posted by "callmepandey (via GitHub)" <gi...@apache.org> on 2026/01/14 19:53:15 UTC, 1 replies.
- [PR] [SPARK-54559] Use runnerConf to pass profiler option [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/14 19:56:27 UTC, 3 replies.
- Re: [PR] [SPARK-54942][PYTHON][TESTS] Add tests for pa.Array.cast of numerical types with default arguments [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/14 21:36:23 UTC, 8 replies.
- [PR] [SPARK-55039][SS][SQL] Add IDENTIFIED BY syntax for naming streaming sources [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/01/14 21:41:30 UTC, 3 replies.
- [PR] [SPARK-55018][PYTHON][TEST][FOLLOWUP] Revert the interval for test_convergence [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/14 21:54:54 UTC, 1 replies.
- Re: [PR] [SPARK-54824] Add support for multiGet and deleteRange for Rocksdb State Store [spark] - posted by "zeruibao (via GitHub)" <gi...@apache.org> on 2026/01/14 22:02:05 UTC, 9 replies.
- Re: [PR] [WIP][SPARK-54647][PYTHON] Support User-Defined Aggregate Functions (UDAF) [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/15 00:28:00 UTC, 0 replies.
- [PR] [SPARK-55040][PYTHON] Refactor TaskContext and related worker protocol [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/15 00:53:12 UTC, 3 replies.
- Re: [PR] [SPARK-54956][CORE] Unify the indeterminate shuffle retry solution [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2026/01/15 01:39:12 UTC, 8 replies.
- Re: [PR] [SPARK-55018][PYTHON][TESTS][FOLLOWUP] Revert the interval for test_convergence [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/15 02:35:14 UTC, 1 replies.
- [PR] [MINOR][PYTHON][TESTS] Add test for Row with duplicated field names [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/15 02:51:36 UTC, 2 replies.
- [PR] [SPARK-55041][CORE] Cleanup some unused private `funcion/val` from core module [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/15 05:58:31 UTC, 4 replies.
- [PR] [SPARK-55042][WEBUI][BUILD][TESTS] Upgrade Node.js used for UI test to `24.13.0` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/01/15 07:03:43 UTC, 3 replies.
- [PR] [SPARK-XXXXX][SQL] Fix time travel with subquery containing table references [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/15 08:49:40 UTC, 1 replies.
- Re: [PR] [SPARK-55043][SQL] Fix time travel with subquery containing table references [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/15 08:52:05 UTC, 8 replies.
- [PR] [SPARK-54886] Lazily create Spark Connect reuse session [spark] - posted by "garlandz-db (via GitHub)" <gi...@apache.org> on 2026/01/15 09:44:29 UTC, 3 replies.
- [PR] [SPARK-55044][SQL] Keep the metadata in toArrowSchema/fromArrowSchema [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/15 10:40:24 UTC, 4 replies.
- [PR] [SPARK-55045][CORE][TESTS] Fix a flaky test in ExecutorSuite [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/01/15 11:15:41 UTC, 14 replies.
- Re: [PR] [SPARK-53882][CONNECT] Always set a sql state in spark connect client [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/15 11:19:47 UTC, 0 replies.
- Re: [PR] [SPARK-53226][SPARK-52088][CORE] Make ClosureCleaner work with Java22+ [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/01/15 12:45:02 UTC, 8 replies.
- [PR] [SPARK-55047][CONNECT] Add client-side limit for local relation size [spark] - posted by "khakhlyuk (via GitHub)" <gi...@apache.org> on 2026/01/15 14:45:40 UTC, 2 replies.
- [PR] [SPARK-55051][CORE] Byte string accepts KiB, MiB, GiB, TiB, PiB [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/01/15 17:13:14 UTC, 4 replies.
- Re: [PR] [SPARK-54590][SS] Support Checkpoint V2 for State Rewriter and Repartitioning [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2026/01/15 18:30:12 UTC, 12 replies.
- [PR] [SPARK-55052][SQL] Add AQEShuffleRead properties to Physical Plan Tree [spark] - posted by "erenavsarogullari (via GitHub)" <gi...@apache.org> on 2026/01/15 18:43:48 UTC, 2 replies.
- [PR] [SPARK-55053] Refactor data source/udtf analysis workers so they have a unified entry [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/15 19:43:32 UTC, 2 replies.
- [PR] [SPARK-55054][SS][SQL] Add IDENTIFIED BY support for streaming table-valued functions [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/01/15 19:49:54 UTC, 3 replies.
- [PR] Support SparkSession.Builder.create for PySpark Classic [spark] - posted by "jonmio (via GitHub)" <gi...@apache.org> on 2026/01/15 20:22:51 UTC, 1 replies.
- [PR] [SS] Add streaming source naming infrastructure and resolution pipeline [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/01/15 21:27:14 UTC, 1 replies.
- [PR] [SPARK-55056][SQL][PYTHON] Fix toPandas() SIGSEGV on nested empty arrays [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/15 21:55:07 UTC, 7 replies.
- [PR] [SPARK-53991][SQL][FOLLOWUP] Catch ArrayIndexOutOfBoundsException in Datasketches HLL functions [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/01/15 22:34:55 UTC, 7 replies.
- [PR] [WIP][SPARK-55059][PYTHON] Remove empty table workaround in toPandas [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/15 23:30:32 UTC, 2 replies.
- [PR] [SPARK-55060] Publish Apache Spark 3.5.8 to docker registry [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/15 23:48:40 UTC, 4 replies.
- [PR] [SPARK-54337][PS][FOLLOWUP] Fix test_arrow_c_stream when pandas/arrow does not exist [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/15 23:53:21 UTC, 2 replies.
- [PR] [SPARK-55061][PYTHON][TESTS] Make module missing message consistently string [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/16 00:17:47 UTC, 3 replies.
- Re: [PR] Added Execution Frame Subclasses [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/16 00:32:01 UTC, 1 replies.
- [PR] [SPARK-54365][SS] Add Repartition Integration Test for Aggregate, Dedup, FMGWS and SessionWindow Operators [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2026/01/16 00:50:21 UTC, 9 replies.
- [PR] [SPARK-55062][Protobuf] Support proto2 extensions in protobuf functions [spark] - posted by "dichlorodiphen (via GitHub)" <gi...@apache.org> on 2026/01/16 04:20:52 UTC, 9 replies.
- Re: [PR] [SPARK-54337][PS][TESTS][FOLLOWUP] Fix test_arrow_c_stream when pandas/arrow does not exist [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/16 05:18:49 UTC, 3 replies.
- [PR] [SPARK-55063][SQL][DOCS] Reorganize built-in functions documentation by category [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/01/16 06:05:29 UTC, 6 replies.
- [PR] Stefan savic data/jdbc/two api calls [spark] - posted by "SavicStefan (via GitHub)" <gi...@apache.org> on 2026/01/16 10:16:01 UTC, 1 replies.
- Re: [PR] [SPARK-55065] Avoid making two JDBC API calls [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2026/01/16 10:22:12 UTC, 12 replies.
- [PR] [WIP][SPARK-55046] add udf processing time metric [spark] - posted by "eddiebkheet (via GitHub)" <gi...@apache.org> on 2026/01/16 10:23:20 UTC, 1 replies.
- Re: [PR] [SPARK-54279][CONNECT] Fix empty observation results caused by delayed asynchronous metrics processing [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2026/01/16 11:05:09 UTC, 1 replies.
- [PR] [WIP] Allow Join hidden column be selected [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/16 11:40:09 UTC, 1 replies.
- [PR] [SPARK-55066] Use `Spark 3.5.8` for Spark 3 integration tests [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/16 11:42:35 UTC, 4 replies.
- [PR] [SPARK-55067] Update Spark 3 examples and tests to use 3.5.8 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/16 11:59:03 UTC, 3 replies.
- [PR] [SPARK-55068] Upgrade `kubernetes-client` to 7.5.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/16 12:12:14 UTC, 3 replies.
- [PR] [SPARK-55069] Upgrade `kubernetes-client` to 7.5.1 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/16 12:24:32 UTC, 0 replies.
- [PR] [SPARK-55071][CONNECT] Make spark.addArtifact work with Windows paths [spark] - posted by "khakhlyuk (via GitHub)" <gi...@apache.org> on 2026/01/16 15:57:02 UTC, 1 replies.
- [PR] [SPARK-50984][SQL] Fix DROP FUNCTION IF EXISTS to not fail when namespace doesn't exist [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/16 18:01:00 UTC, 1 replies.
- Re: [PR] [SPARK-54866][SQL][FOLLOWUP] Fix DROP FUNCTION IF EXISTS to not fail when namespace doesn't exist [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/16 18:03:37 UTC, 4 replies.
- Re: [PR] [SPARK-43986][SQL][FOLLOWUP] Catch ArrayIndexOutOfBoundsException in Datasketches HLL functions [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/01/16 18:20:21 UTC, 0 replies.
- [PR] [MINOR] add .venv into .gitignore [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/01/16 18:22:37 UTC, 4 replies.
- [PR] [WIP][SPARK-55073] don't capture SparkPlan in EvalPythonUDTFExec [spark] - posted by "timarmstrong (via GitHub)" <gi...@apache.org> on 2026/01/16 19:17:55 UTC, 1 replies.
- Re: [PR] [SPARK-55055] Support SparkSession.Builder.create for PySpark Classic [spark] - posted by "gatorsmile (via GitHub)" <gi...@apache.org> on 2026/01/16 19:28:16 UTC, 1 replies.
- [PR] [WIP][SPARK-55072][SQL]. Ensure IsNotNull inferred filter is not missed for left leg of Inner Join ( obtained via conversion of Left Outer) [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2026/01/16 19:53:34 UTC, 4 replies.
- [PR] [SPARK-54922][PYTHON][FOLLOWUP] Ignore ununsed-ignore because we support both numpy 1 and 2 [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/16 20:08:27 UTC, 3 replies.
- [PR] [SPARK-55075][K8S] Fail application after too many executor pod creation errors [spark] - posted by "parthchandra (via GitHub)" <gi...@apache.org> on 2026/01/16 22:53:11 UTC, 10 replies.
- [PR] [SPARK-55076][PYTHON] Fix the type hint issue in ml/mllib and add scipy requirement [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/16 22:59:24 UTC, 3 replies.
- [PR] [SPARK-XXXXX][DOCS][SS][PYTHON] Fix streaming query listener documentation and update return type docstrings [spark] - posted by "dylanwong250 (via GitHub)" <gi...@apache.org> on 2026/01/16 23:32:17 UTC, 1 replies.
- [PR] [SPARK-55074][SQL] Add test for Merge Into ANSI type coercion [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/01/16 23:39:22 UTC, 6 replies.
- Re: [PR] [MINOR][DOCS][SS][PYTHON] Fix streaming query listener documentation and update return type docstrings [spark] - posted by "dylanwong250 (via GitHub)" <gi...@apache.org> on 2026/01/16 23:50:21 UTC, 0 replies.
- Re: [PR] [SPARK-55069] Upgrade `kubernetes-client` to 7.5.1 and update CRDs [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/16 23:51:41 UTC, 1 replies.
- Re: [PR] [SPARK-55057][SS] Add streaming source naming infrastructure and resolution pipeline [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2026/01/17 00:13:44 UTC, 0 replies.
- Re: [PR] [SPARK-53776][CONNECT] Support Spark Context Manager Support in Connect Mode [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/17 00:30:07 UTC, 1 replies.
- Re: [PR] Feature/spark 47230 column prunning under explode [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/17 00:30:09 UTC, 1 replies.
- [PR] Throw error on inconsistent checkpoint metadata [spark] - posted by "jerrytqz (via GitHub)" <gi...@apache.org> on 2026/01/17 01:03:04 UTC, 1 replies.
- [PR] [SPARK-55077][CORE][K8S]: Support spark.kubernetes.archives.avoidDownloadSchemes for K8s Cluster Mode [spark] - posted by "xumanbu (via GitHub)" <gi...@apache.org> on 2026/01/17 02:10:46 UTC, 6 replies.
- [PR] [SPARK-55078] Upgrade `Gradle` to 9.3.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/17 02:44:29 UTC, 2 replies.
- [PR] [SPARK-55079] Log `Java Version` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/17 03:26:34 UTC, 2 replies.
- [PR] [SPARK-55080] Improve `MANIFEST.MF` to include `Implementation-(Title|Version)` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/17 03:49:44 UTC, 3 replies.
- [PR] [SPARK-55081] Log `Version` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/17 06:57:17 UTC, 3 replies.
- [PR] [SPARK-55082] Upgrade `Dropwizard` metrics to 4.2.37 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/17 07:31:41 UTC, 3 replies.
- [PR] [SPARK-55083] Upgrade `checkstyle` to 13.0.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/17 07:49:49 UTC, 3 replies.
- [PR] [SPARK-55084] Update docs to recommend K8s 1.33+ [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/17 08:43:14 UTC, 2 replies.
- [PR] [SPARK-55085] Support `NetworkPolicy` for `SparkApplication` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/17 12:02:08 UTC, 2 replies.
- Re: [PR] [SPARK-53742][SQL] Push down the filter used in the count_if function [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/18 00:34:32 UTC, 1 replies.
- Re: [PR] [SPARK-53764][SQL] Collapse nested get_json_object [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/18 00:34:35 UTC, 1 replies.
- Re: [PR] [SPARK-51332][SQL] DS V2 supports push down BIT_AND, BIT_OR, BIT_XOR, BIT_COUNT and BIT_GET [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/18 00:34:37 UTC, 1 replies.
- [PR] [SPARK-49110][SQL] Fix reading metadata columns for tables with CHAR columns [spark] - posted by "tomvanbussel (via GitHub)" <gi...@apache.org> on 2026/01/18 20:47:29 UTC, 3 replies.
- Re: [PR] [SPARK-55046] PySpark add udf processing time metric [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/19 00:44:59 UTC, 0 replies.
- Re: [PR] [SPARK-55027][PYTHON] Move writeConf to PythonWorkerUtils [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/19 00:55:28 UTC, 1 replies.
- Re: [PR] [SPARK-55055][PYTHON] Support SparkSession.Builder.create for PySpark Classic [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/01/19 01:41:09 UTC, 8 replies.
- Re: [PR] [SPARK-55070][SQL][CONNECT] Allow hidden column in dataframe column resolution [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/19 03:36:27 UTC, 2 replies.
- [PR] Test with maven [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/19 04:55:45 UTC, 3 replies.
- [PR] [SPARK-55088][PYTHON] Keep the metadata in to/from_arrow_type/schema [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/19 04:58:56 UTC, 4 replies.
- Re: [PR] [SPARK-55036][PYTHON] Add `ArrowTimestampeConversion` for arrow timezone handling [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/19 05:57:46 UTC, 1 replies.
- Re: [PR] [SPARK-55036][PYTHON] Add `ArrowTimestampConversion` for arrow timezone handling [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/19 06:54:07 UTC, 4 replies.
- Re: [PR] [SPARK-54830][SQL][TESTS][FOLLOWUP] Increase `-Xmx` for the sql module to 6g for maven test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/19 07:05:43 UTC, 8 replies.
- [PR] [SPARK-55089][CONNECT] Correct the output schema of toJSON [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/19 08:58:27 UTC, 5 replies.
- Re: [PR] [SPARK-55090][PYTHON] Implement `DataFrame.toJSON` in Python Client [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/19 09:29:57 UTC, 3 replies.
- [PR] [SPARK-54830][SQL][BUILD][FOLLOWUP] Add comments to remind that the SQL module should use the same `-Xmx` setting in both Maven and SBT tests [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/19 09:31:09 UTC, 5 replies.
- Re: [PR] [SPARK-54888][SQL] Allow non determinism in VALUES [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/19 10:40:59 UTC, 11 replies.
- [PR] [SQL] Fix re-adding cached artifacts drops blocks silently issue [spark] - posted by "pranavdev022 (via GitHub)" <gi...@apache.org> on 2026/01/19 10:43:00 UTC, 1 replies.
- [PR] [WIP] Cursors debug iterator issue [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/01/19 10:44:54 UTC, 2 replies.
- [PR] [SPARK-55016][SQL] Make SQLConf a direct property of SparkSession to prevent stack overflow [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/19 12:23:20 UTC, 8 replies.
- [PR] [SPARK-55033][SQL][3.5] Fix stringArgs of DSv2 writing commands [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/01/19 13:31:37 UTC, 3 replies.
- [PR] [SPARK-55033][SQL][4.0] Fix stringArgs of DSv2 writing commands [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/01/19 13:58:38 UTC, 3 replies.
- [PR] [SPARK-45414][SQL][TESTS] Add regression tests for XML mixed type serialization [spark] - posted by "jdavidroberts (via GitHub)" <gi...@apache.org> on 2026/01/19 15:33:00 UTC, 1 replies.
- [PR] [SPARK-55091][SQL] Reduce Hive RPC calls for DROP TABLE command [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/19 15:51:52 UTC, 5 replies.
- [PR] [SPARK-55092][SQL] `KeyGroupedPartitioning` don't group partitions when not needed [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/01/19 18:53:47 UTC, 1 replies.
- [PR] [DOCS] Fix typos in MD files [spark] - posted by "ostronaut (via GitHub)" <gi...@apache.org> on 2026/01/19 19:54:16 UTC, 1 replies.
- Re: [PR] [SPARK-55090][PYTHON][CONNECT] Implement `DataFrame.toJSON` in Python Client [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/01/19 23:37:28 UTC, 2 replies.
- [PR] [SPARK-XXXXX][SQL] Simplify SubqueryAlias.metadataOutput to always propagate metadata columns [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/20 01:55:38 UTC, 1 replies.
- [PR] [PYTHON] Add missing docstrings to add_path and read_command functions [spark] - posted by "bodhisilberling-2027 (via GitHub)" <gi...@apache.org> on 2026/01/20 03:36:13 UTC, 1 replies.
- Re: [PR] [MINOR][PYTHON] Add missing docstrings to add_path and read_command functions [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/01/20 03:45:03 UTC, 2 replies.
- Re: [PR] [SPARK-55053][PYTHON] Refactor data source/udtf analysis workers so they have a unified entry [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/01/20 03:45:42 UTC, 1 replies.
- [PR] [SPARK-54849][PYTHON][FOLLOW-UP] Update minimum version of pyarrow in `setup.py` and `pyspark_upgrade.rst` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/20 04:58:29 UTC, 3 replies.
- Re: [PR] [SPARK-49110][SQL] Simplify SubqueryAlias.metadataOutput to always propagate metadata columns [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/20 06:19:06 UTC, 2 replies.
- [PR] [SPARK-54374][SQL][UI] Enlarge the SVG viewBox attribute of SQL plan visualization initialization [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/01/20 07:07:22 UTC, 4 replies.
- [PR] [SPARK-55094] Enable `spark.authenticate` by default [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/20 07:24:47 UTC, 2 replies.
- [PR] [SPARK-55095] Enable `spark.io.encryption.enabled` by default [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/20 07:53:32 UTC, 3 replies.
- [PR] 55093 [spark] - posted by "ChuckLin2025 (via GitHub)" <gi...@apache.org> on 2026/01/20 07:56:25 UTC, 2 replies.
- [PR] [SPARK-55096][PYTHON] Update pandas minimum version in `connect/setup.py` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/20 07:57:34 UTC, 3 replies.
- [PR] [SPARK-55098][PYTHON] Vectorized UDFs with output batch control fail with memory leak [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/20 09:15:12 UTC, 6 replies.
- [PR] [WIP] Support query level indeterminate shuffle retry [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2026/01/20 09:17:21 UTC, 1 replies.
- [PR] [SPARK-55099] Support `NetworkPolicy` for `SparkCluster` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/20 10:30:27 UTC, 2 replies.
- [PR] [SPARK-55101] Add `Swift 6.3` build test CI [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/20 10:58:37 UTC, 3 replies.
- Re: [PR] [SPARK-55092][SQL] Disable partition grouping in `KeyGroupedPartitioning` when not needed [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/01/20 11:42:11 UTC, 29 replies.
- [PR] [SPARK-55102] Upgrade `com.gradleup.shadow` to 8.3.9 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/20 12:16:39 UTC, 3 replies.
- Re: [PR] [SPARK-55097][SQL] Fix re-adding cached artifacts drops blocks silently issue [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2026/01/20 12:30:41 UTC, 6 replies.
- [PR] [SPARK-54103][Geo][FOLLOWUP] Move the client-side Geo suites to `sql/api` [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/01/20 13:45:01 UTC, 2 replies.
- [PR] [SPARK-55103][CORE][TESTS] Fix a flaky test in `RpcIntegrationSuite` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/01/20 15:25:21 UTC, 4 replies.
- Re: [PR] [SPARK-54507][SQL] Add time_bucket function for TIME type bucketing [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/01/20 16:51:13 UTC, 0 replies.
- Re: [PR] [SPARK-54582][SQL] Add Time Type Statistics Collection Support [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/01/20 16:51:28 UTC, 0 replies.
- Re: [PR] [SPARK-54588][SQL] Add time_format function to convert TIME values to formatted string representations [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/01/20 16:51:58 UTC, 0 replies.
- Re: [PR] [SPARK-54601][SQL] Use DATETIME2 for TimestampType in MSSQL Server to preserve microseconds precision [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/01/20 16:52:13 UTC, 0 replies.
- Re: [PR] [SPARK-55071][CONNECT][PYTHON] Make spark.addArtifact work with Windows paths [spark] - posted by "asf-gitbox-commits (via GitHub)" <gi...@apache.org> on 2026/01/20 17:22:51 UTC, 1 replies.
- Re: [PR] [SPARK-55073] don't capture SparkPlan in EvalPythonUDTFExec [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2026/01/20 19:33:25 UTC, 4 replies.
- [PR] [SPARK-54925][PYTHON][FOLLOWUP] Ignore missing import for pystack [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/20 19:54:25 UTC, 3 replies.
- [PR] [CONNECT][PYTHON] Add Spark Connect support for DataStreamReader.name() [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/01/20 21:02:38 UTC, 0 replies.
- Re: [PR] [CONNECT][PYTHON][SS] Add Spark Connect support for DataStreamReader.name() [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/20 21:02:48 UTC, 0 replies.
- [PR] [SPARK-54939][PYTHON][TESTS][FOLLOWUP] Handle PyArrow version difference in type coercion tests [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/20 21:20:14 UTC, 6 replies.
- Re: [PR] [SPARK-55058][SS] Throw error on inconsistent checkpoint metadata [spark] - posted by "liviazhu (via GitHub)" <gi...@apache.org> on 2026/01/20 21:43:52 UTC, 4 replies.
- [PR] [SPARK-55105][SS] Add Integration Test for Join Operator [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2026/01/20 21:55:27 UTC, 8 replies.
- [PR] [SPARK-54996][SS] Report ArrivalTime for records from LowLatencyMemoryStream [spark] - posted by "nyaapa (via GitHub)" <gi...@apache.org> on 2026/01/20 22:05:11 UTC, 3 replies.
- Re: [PR] [SPARK-55098][PYTHON] Vectorized UDFs with output batch size control fail with memory leak [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/01/20 22:15:36 UTC, 1 replies.
- [PR] [SPARK-55107] Log TID for scanned file in FileScanRDD [spark] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2026/01/20 23:13:55 UTC, 3 replies.
- [PR] [SPARK-55108][PYTHON] Use the latest pandas-stubs for type check [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/20 23:39:01 UTC, 3 replies.
- Re: [PR] [SPARK-54941][PYTHON][TESTS] Add tests for pa.scalar type coercion for numerical types [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/21 00:43:33 UTC, 3 replies.
- Re: [PR] [SPARK-54217][PYTHON] Synchronize PythonRunner's MonitorThread kill decision [spark] - posted by "st-tran (via GitHub)" <gi...@apache.org> on 2026/01/21 01:01:20 UTC, 2 replies.
- [PR] [SPARK-54371][SPARK-39959][INFRA][3.5] Pin roxygen2 and pkgdown versions for SparkR doc generation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/21 01:01:33 UTC, 5 replies.
- Re: [PR] [SPARK-55104][CONNECT][PYTHON][SS] Add Spark Connect support for DataStreamReader.name() [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/01/21 01:12:32 UTC, 16 replies.
- [PR] [WIP][SPARK-55110][SQL] Order of application of 3 rules changed to achieve idempotency faster [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2026/01/21 04:03:22 UTC, 1 replies.
- Re: [PR] [SPARK-54630][SQL] Add timestamp_bucket function for temporal bucketing [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/01/21 04:19:43 UTC, 0 replies.
- Re: [PR] [SPARK-54846][SQL] Add codegen support for KLL sketch GetN functions [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2026/01/21 04:19:54 UTC, 0 replies.
- [PR] [WIP][PYTHON][TESTS] Refactor tests for python udf return type coercion [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/21 04:33:57 UTC, 1 replies.
- [PR] [SPARK-55111][SS] Unfinished repartitioning detection on query restart [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2026/01/21 05:22:13 UTC, 6 replies.
- [PR] [SPARK-55112][SQL][TESTS] Add micro-benchmark for `o.a.spark.util.sketch.BloomFilter` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/21 07:43:17 UTC, 3 replies.
- Re: [PR] [SPARK-35482][K8S][3.0] Use `spark.blockManager.port` not the wrong `spark.blockmanager.port` in `BasicExecutorFeatureStep` [spark] - posted by "zuotingbing (via GitHub)" <gi...@apache.org> on 2026/01/21 07:57:25 UTC, 0 replies.
- [PR] [SPARK-55044][SPARK-55088][TESTS][FOLLOW-UP] Add test for passing metadata in arrow batches from JVM to Python [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/21 08:50:49 UTC, 3 replies.
- [PR] [SPARK-55113][SQL] `EnsureRequirements` should copy tags [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/01/21 08:51:27 UTC, 5 replies.
- Re: [PR] [SPARK-54449][CORE] Storage Memory off heap size should be considered only when off heap is enabled [spark] - posted by "qiaojizhen (via GitHub)" <gi...@apache.org> on 2026/01/21 09:05:55 UTC, 2 replies.
- [PR] [SPARK-XXXXX] Use master branch's Dockerfile for release builds [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/21 09:21:25 UTC, 1 replies.
- Re: [PR] [SPARK-55115][INFRA] Use master branch's Dockerfile for release builds [spark] - posted by "codecov-commenter (via GitHub)" <gi...@apache.org> on 2026/01/21 09:24:41 UTC, 7 replies.
- [PR] [BUILD] Upgrade Jackson to 2.21.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/21 11:06:18 UTC, 1 replies.
- Re: [PR] [SPARK-55114][PYTHON][TESTS] Refactor tests for python udf return type coercion [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/21 13:31:20 UTC, 4 replies.
- [PR] [SPARK-55117] [SQL] `EventTimeWatermark` should be resolved when referencing recursive type [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/01/21 17:27:41 UTC, 2 replies.
- [PR] [SPARK-XXXXX] Install both Java 8 and Java 17 in release Docker image [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/21 18:17:28 UTC, 3 replies.
- [PR] [SPARK-55118][CORE] Replace ASM Opcodes wildcard imports [spark] - posted by "fangchenli (via GitHub)" <gi...@apache.org> on 2026/01/21 18:18:27 UTC, 4 replies.
- [PR] [SPARK-55115][INFRA] Install both Java 8 and Java 17 in release Docker image [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/21 18:34:26 UTC, 3 replies.
- [PR] [SPARK-55115][INFRA] Auto-detect Java version in release scripts [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/21 18:40:38 UTC, 3 replies.
- Re: [PR] [SPARK-46036][SQL] Removing error-class from raise_error function [spark] - posted by "felipepessoto (via GitHub)" <gi...@apache.org> on 2026/01/21 20:14:56 UTC, 4 replies.
- [PR] [SPARK-54942][PYTHON][TESTS][FOLLOWUP] Add non-numerical type cast tests for PyArrow [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/21 20:18:04 UTC, 7 replies.
- Re: [PR] [WIP][SPARK-54942][PYTHON][TESTS][FOLLOWUP] Add non-numerical type cast tests for PyArrow [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/21 20:18:30 UTC, 0 replies.
- [PR] [SQL][SCRIPTING] Fix Internal Error when CONTINUE HANDLER handles exception raised before Conditional Statement (IF, WHILE, ...) [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2026/01/21 20:30:45 UTC, 1 replies.
- [PR] [SPARK-54941][PYTHON][TESTS][FOLLOWUP] pa.scalar type coercion non-numerical [spark] - posted by "fangchenli (via GitHub)" <gi...@apache.org> on 2026/01/21 21:01:44 UTC, 1 replies.
- [PR] [MINOR][KUBERNETES] Change driver/executor uuid to be val instead of def [spark] - posted by "vjanelle (via GitHub)" <gi...@apache.org> on 2026/01/21 21:18:05 UTC, 1 replies.
- [PR] [SPARK-55120][KUBERNETE$S] Change driver/executor uuid to be val instead of def [spark] - posted by "vjanelle (via GitHub)" <gi...@apache.org> on 2026/01/21 21:26:55 UTC, 1 replies.
- [PR] [SPARK-XXXXX][PYTHON] Add DataStreamReader.name() to Classic PySpark [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/01/21 21:54:56 UTC, 0 replies.
- Re: [PR] [SPARK-XXXXX][PYTHON][SS] Add DataStreamReader.name() to Classic PySpark [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/21 21:55:05 UTC, 0 replies.
- [PR] [SPARK-55106][SS] Add Repartition Integration test for TransformWithState Operators [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2026/01/21 22:09:41 UTC, 3 replies.
- Re: [PR] [SPARK-55121][PYTHON][SS] Add DataStreamReader.name() to Classic PySpark [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/01/21 22:22:40 UTC, 9 replies.
- [PR] [SPARK-XXXXX][SS] Add SequentialUnionOffset for tracking sequential source processing [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/01/21 22:37:33 UTC, 1 replies.
- Re: [PR] [SPARK-54941][PYTHON][TESTS][FOLLOW-UP] pa.scalar type coercion non-numerical [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/01/22 00:24:08 UTC, 2 replies.
- Re: [PR] [SPARK-53793][SQL] Use DSv2 predicate to evaluate InternalRow [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/22 00:33:18 UTC, 1 replies.
- [PR] [SPARK-55124][PS][CONNECT][TESTS] Move `test_spark_arrow_c_streamer_arrow_consumer` to PS and also enable the connect parity test [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/22 01:24:54 UTC, 0 replies.
- Re: [PR] [SPARK-55124][PS][CONNECT][TESTS] Move `test_spark_arrow_c_streamer_arrow_consumer` to PS and enable the connect parity test [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/22 01:25:04 UTC, 2 replies.
- [PR] [SPARK-52825][CORE] Support AWS protocols in MySQLDialect and PostgresDialect [spark] - posted by "aaron-congo (via GitHub)" <gi...@apache.org> on 2026/01/22 01:33:10 UTC, 1 replies.
- [PR] [SPARK-55125][PYTHON] Remove redundant `__init__` methods in Arrow serializers [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/22 01:34:21 UTC, 5 replies.
- [PR] [SPARK-55126][PYTHON] Remove unused timezone and assign_cols_by_name from ArrowStreamArrowUDFSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/22 01:44:57 UTC, 5 replies.
- Re: [PR] [SPARK-55119][SQL] CONTINUE handler should not interrupt conditional if exception thrown by previous statement [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2026/01/22 02:28:39 UTC, 2 replies.
- Re: [PR] [SPARK-55116][BUILD] Upgrade Jackson to 2.21.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/22 03:03:53 UTC, 1 replies.
- [PR] [SPARK-55115][INFRA][MASTER] Use composable Dockerfile for release builds [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/22 03:33:04 UTC, 4 replies.
- [PR] [SPARK-55115][INFRA][4.1] Use composable Dockerfile for release builds [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/22 03:33:17 UTC, 5 replies.
- [PR] [SPARK-55115][INFRA][4.0] Use composable Dockerfile for release builds [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/22 03:33:28 UTC, 5 replies.
- [PR] [SPARK-55115][INFRA][3.5] Use composable Dockerfile for release builds [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/22 03:33:42 UTC, 3 replies.
- [PR] [SPARK-55127][SQL] Add avro_funcs group for Avro SQL functions [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/01/22 03:35:17 UTC, 3 replies.
- Re: [PR] [SPARK-54805] Add documentation for TwsTester [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/01/22 03:39:41 UTC, 0 replies.
- [PR] [SPARK-55128][INFRA] Restore Restore SQL tests by pin 'pandas<3' [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/22 03:45:25 UTC, 1 replies.
- Re: [PR] Test log4j 2.25.3 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/22 04:40:34 UTC, 0 replies.
- [PR] [SPARK-55129][SS] Introduce State Store API and key encoder for event-time as a first class (UnsafeRow) [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/01/22 04:41:55 UTC, 7 replies.
- [PR] [SPARK-55130][BUILD] Upgrade log4j to 2.25.3 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/22 04:44:14 UTC, 4 replies.
- [PR] [SPARK-55132][INFRA] Upgrade numpy version on lint image [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/22 05:35:52 UTC, 6 replies.
- [PR] [SPARK-XXXX][CORE] Fix race condition in IsolatedSessionState lifecycle management [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/22 05:39:16 UTC, 1 replies.
- Re: [PR] [SPARK-55133][CONNECT] Fix race condition in IsolatedSessionState lifecycle management [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/22 05:45:00 UTC, 18 replies.
- Re: [PR] [WIP][SPARK-54571] Use LZ4 safeDecompressor [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/22 06:30:28 UTC, 0 replies.
- [PR] Use `CompressionHandler` as a replacement for the deprecated `GzipHandler` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/22 06:53:38 UTC, 1 replies.
- Re: [PR] Use `CompressionHandler` as a replacement for the deprecated `GzipHandler` in `JettyUtils` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/22 06:54:26 UTC, 4 replies.
- Re: [PR] [SPARK-55128][INFRA] Restore SQL tests by pin 'pandas==2.3.3' [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/22 07:08:24 UTC, 5 replies.
- Re: [PR] [SPARK-54571][CORE][SQL] Use LZ4 safeDecompressor [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/01/22 08:00:02 UTC, 4 replies.
- [PR] Remove deprecated annotation [spark] - posted by "garlandz-db (via GitHub)" <gi...@apache.org> on 2026/01/22 10:34:12 UTC, 1 replies.
- [PR] [WIP][PYTHON][TESTS] Refactor tests for pandas udf return type coercion [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/22 11:00:25 UTC, 1 replies.
- [PR] [SPARK-54965][PYTHON] Factor out legacy pa.Array -> pd.Series converter [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/22 11:08:34 UTC, 3 replies.
- [PR] [MINOR][PYTHON][TESTS] Delete obsolete `test_connect_plotting` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/22 11:39:12 UTC, 2 replies.
- Re: [PR] [SPARK-54887][CONNECT] Remove deprecated annotation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/22 12:45:43 UTC, 9 replies.
- [PR] [SPARK-55136][BUILD] Bump Db2 JDBC driver 12.1.3.0_special_74723 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/01/22 13:09:53 UTC, 5 replies.
- [PR] [SPARK-55137] [SQL] Refactor `GroupingAnalyticsTransformer` and `Analyzer` code [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/01/22 15:07:25 UTC, 4 replies.
- [PR] [SPARK-55138] Fix `convertToMapData` throwing a `NullPointerException` [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2026/01/22 15:50:55 UTC, 1 replies.
- [PR] [PYTHON] Add missing docstrings to worker utility functions [spark] - posted by "bodhisilberling-2027 (via GitHub)" <gi...@apache.org> on 2026/01/22 17:03:02 UTC, 1 replies.
- Re: [PR] [SPARK-55104][CONNECT][PYTHON][SS] Add Python and Spark Connect support for DataStreamReader.name() [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/22 17:51:41 UTC, 15 replies.
- Re: [PR] [SPARK-55138][SQL] Fix `convertToMapData` throwing a `NullPointerException` [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2026/01/22 18:00:03 UTC, 1 replies.
- [PR] [SPARK-55030][SQL] Add vector norm/normalize function expressions support [spark] - posted by "zhidongqu-db (via GitHub)" <gi...@apache.org> on 2026/01/22 19:37:25 UTC, 8 replies.
- Re: [PR] [SPARK-55135][PYTHON][TESTS] Refactor tests for pandas udf return type coercion [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/22 23:07:56 UTC, 4 replies.
- Re: [PR] [SPARK-53901][CONNECT] Handle potential memory leaks in`SparkConnectAddArtifactsHandler` upon flush/error [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/23 00:32:17 UTC, 1 replies.
- Re: [PR] [SPARK-53439][SQL] Support DSv2 ParquetScan Dynamic Partition Pruning [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/23 00:32:19 UTC, 1 replies.
- Re: [PR] [SPARK-52969][SQL] Support DSv2 OrcScan Dynamic Partition Pruning [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/23 00:32:21 UTC, 1 replies.
- [PR] [SPARK-55140][PYTHON][PS] Do not map builtin functions to numpy version for pandas 3 [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/23 01:52:49 UTC, 10 replies.
- Re: [PR] [WIP][SPARK-54571][CORE] Use LZ4 safeDecompressor [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/01/23 02:50:41 UTC, 0 replies.
- [PR] [SPARK-55141][PYTHON][INFRA] Set up a scheduled builder for Pandas 3 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/23 02:52:44 UTC, 5 replies.
- [PR] [SPARK-55142][PYTHON][INFRA] Apply Python 3.12 in PR build [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/23 03:12:25 UTC, 1 replies.
- [PR] [SPARK-55143][PYTHON][INFRA] Drop Python 3.10 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/23 03:26:10 UTC, 5 replies.
- Re: [PR] [SPARK-55141][PYTHON][INFRA] Set up a scheduled workflow for Pandas 3 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/23 03:49:33 UTC, 0 replies.
- [PR] [SPARK-55144][SS] Introduce new state format version for performant stream-stream join [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/01/23 05:18:29 UTC, 16 replies.
- [PR] [SPARK-55146][SS] State Repartition API for PySpark [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2026/01/23 05:37:49 UTC, 10 replies.
- Re: [PR] [SPARK-55142][PYTHON][INFRA] Apply Python 3.12 for PySpark Tests in PR build [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/23 06:47:44 UTC, 1 replies.
- [PR] [SPARK-55149][PYTHON][INFRA] Upgrade python to 3.12 in SQL tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/23 07:00:46 UTC, 3 replies.
- [PR] [SPARK-55128][INFRA][FOLLOWUP] Restore SQL tests by pin 'pandas==2.3.3' for maven daily test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/23 07:53:13 UTC, 5 replies.
- Re: [PR] [SPARK-55115][INFRA] Use composable Dockerfile for release builds [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/23 09:37:04 UTC, 1 replies.
- Re: [PR] [SPARK-55115][INFRA] Use master branch's base Dockerfile for release builds [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/23 09:49:44 UTC, 1 replies.
- Re: [PR] [SPARK-53289][SQL] Invoke cancelJobsWithTag before start passing the SparkListenerSQLExecutionEnd event to prevent execution of canceled tasks. [spark] - posted by "JkSelf (via GitHub)" <gi...@apache.org> on 2026/01/23 10:29:31 UTC, 1 replies.
- [PR] [SPARK-55021][CORE][TESTS] Move timezone/locale initialization to constructor in SparkTestSuite [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/23 12:47:00 UTC, 1 replies.
- Re: [PR] [SPARK-54887][CONNECT] Always set a sql state in spark connect client [spark] - posted by "garlandz-db (via GitHub)" <gi...@apache.org> on 2026/01/23 13:41:50 UTC, 4 replies.
- Re: [PR] [SPARK-55021][CORE][TESTS][FOLLOWUP] Move timezone/locale initialization to constructor in SparkTestSuite [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/23 14:04:57 UTC, 3 replies.
- [PR] [SPARK-55150][CONNECT][SQL] Improve ObservationManager.tryComplete error handling [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2026/01/23 14:23:40 UTC, 1 replies.
- Re: [PR] [SPARK-54586][SQL] Validate UTF-8 when casting Binary to String [spark] - posted by "attilapiros (via GitHub)" <gi...@apache.org> on 2026/01/23 18:00:16 UTC, 3 replies.
- [PR] [SPARK-55151] Fix RocksDBSuite testWithStateStoreCheckpointIds [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2026/01/23 18:28:15 UTC, 2 replies.
- Re: [PR] [SPARK-55153] Add documentation for TwsTester [spark] - posted by "fedimser (via GitHub)" <gi...@apache.org> on 2026/01/23 19:01:53 UTC, 0 replies.
- [PR] [SPARK-54942][PYTHON][TESTS][FOLLOWUP] Fix PyArrow < 21 compatibility for float16 array creation in tests [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/23 19:22:47 UTC, 4 replies.
- [PR] [SPARK-55154][PYTHON][PS] Remove fastpath to pd.Series for pandas 3 [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/23 19:36:49 UTC, 1 replies.
- [PR] [SPARK-54942][PYTHON][TESTS][FOLLOWUP] Add tests for pa.Array.cast of nested/container types [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/23 20:41:10 UTC, 3 replies.
- Re: [PR] [SPARK-55046][PYTHON] PySpark add udf processing time metric [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/01/23 21:33:36 UTC, 1 replies.
- [PR] [SPARK-53807][CORE][FOLLOWUP] Fix a race condition issue between `unlock` and `releaseAllLocksForTask` for write lock in `BlockInfoManager` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/01/23 21:57:49 UTC, 4 replies.
- [PR] [SPARK-55155][SQL] Support foldable expressions in `SET CATALOG` statement [spark] - posted by "tangrizzly (via GitHub)" <gi...@apache.org> on 2026/01/23 22:24:45 UTC, 15 replies.
- [PR] [SPARK-55158][PYTHON][TESTS] Make the test acknowledge of new string data type [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/23 23:11:20 UTC, 5 replies.
- [PR] [SPARK-55157] Replace classutil with ClassGraph in GenerateMiMAIgnore [spark] - posted by "fangchenli (via GitHub)" <gi...@apache.org> on 2026/01/24 00:00:15 UTC, 1 replies.
- Re: [PR] [SPARK-53877] [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/24 00:30:40 UTC, 1 replies.
- [PR] [SPARK-55160][PYTHON] Directly pass input schema to serializers [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/24 00:58:57 UTC, 2 replies.
- [PR] [SPARK-55161][PYTHON] Support profilers on python data source [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/24 01:21:53 UTC, 3 replies.
- [PR] [SPARK-55162][PYTHON] Extract transformers from ArrowStreamUDFSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/24 01:43:01 UTC, 7 replies.
- [PR] [SPARK-55164][PYTHON][TESTS] Refactor tests for python udf input type coercion [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/24 05:44:05 UTC, 3 replies.
- [PR] [SPARK-55134] Fix `BasicExecutorFeatureStep` to throw `IllegalArgumentException` for executor cpu misconfigs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/24 06:45:21 UTC, 4 replies.
- Re: [PR] [SPARK-54596][CORE][K8S] Burst-aware Memory Allocation Algorithm for Spark@K8S [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2026/01/24 09:55:20 UTC, 0 replies.
- Re: [PR] [DO NOT MERGE] define configs in text files [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2026/01/24 09:58:18 UTC, 2 replies.
- [PR] [SPARK-55165] Upgrade `kubernetes-client` to 7.5.2 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/24 13:02:29 UTC, 3 replies.
- [PR] [SPARK-55166][BUILD] Upgrade `kubernetes-client` to 7.5.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/24 13:08:35 UTC, 5 replies.
- [PR] Create pylint.yml [spark] - posted by "Kcato1 (via GitHub)" <gi...@apache.org> on 2026/01/24 18:13:48 UTC, 5 replies.
- [PR] [SPARK-55168][PYTHON] Use ArrowBatchTransformer.flatten_struct in GroupArrowUDFSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/24 20:51:10 UTC, 4 replies.
- [PR] [WIP][SPARK-55169][PYTHON] Use ArrowBatchTransformer.flatten_struct in ArrowStreamArrowUDTFSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/24 21:05:31 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-55168][PYTHON] Use ArrowBatchTransformer.flatten_struct in GroupArrowUDFSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/24 21:06:01 UTC, 0 replies.
- [PR] [SPARK-55170][PYTHON] Extract grouped stream reading pattern from serializers [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/24 22:12:36 UTC, 3 replies.
- Re: [PR] [SPARK-54703][PYTHON] Consolidate SQL_GROUPED_AGG_ARROW_ITER_UDF and SQL_GROUPED_AGG_PANDAS_ITER_UDF mapper logic [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/24 23:26:57 UTC, 1 replies.
- [PR] [SPARK-55171][PYTHON] Fix memory profiler on iter UDF [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/25 01:12:59 UTC, 3 replies.
- [PR] [SPARK-55172][PYTHON][INFRA] Remove unused packages from python test images [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/25 02:44:43 UTC, 1 replies.
- Re: [PR] [SPARK-55172][PYTHON][INFRA] Remove unused packages from python 3.12 test image [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/25 02:52:11 UTC, 2 replies.
- [PR] [SPARK-55173][K8S][TESTS] Improve K8s IT to use `TestConstants` consistently and `match` syntax for extensibility [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/25 14:15:07 UTC, 3 replies.
- Re: [PR] [SPARK-55174][Geo][FOLLOWUP] Move the client-side Geo suites to `sql/api` [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/01/25 18:43:48 UTC, 0 replies.
- [PR] [SPARK-55176][PYTHON] Extract arrow_to_pandas converter into ArrowArrayToPandasConversion [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/25 19:49:01 UTC, 4 replies.
- [PR] [SPARK-55177][PYTHON] Support keyword arguments for df.groupby(...).agg(...) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/01/25 23:26:41 UTC, 5 replies.
- Re: [PR] [SPARK-51728][SQL] Add SELECT EXCEPT Support [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/26 00:34:23 UTC, 1 replies.
- [PR] [SPARK-55178][K8S][TESTS] Remove `redirectingInput` from `o.a.s.deploy.k8s.integrationtest.Utils.executeCommand` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/26 01:04:17 UTC, 1 replies.
- Re: [PR] [SPARK-55179][PYTHON][CONNECT][FOLLOW-UP] Skip eager column name validation in `df.col_name` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/26 01:09:34 UTC, 0 replies.
- [PR] [SPARK-55180][PYTHON][INFRA] Remove scheduled job python 3.13 with no gil [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/26 01:35:41 UTC, 3 replies.
- Re: [PR] [SPARK-55154][PS] Remove fastpath to pd.Series for pandas 3 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/26 01:45:32 UTC, 3 replies.
- [PR] [WIP][SPARK-55181][PYTHON][INFRA] Remove unused packages from python 3.10 test images [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/26 01:56:24 UTC, 1 replies.
- [PR] [WIP][SPARK-55182][PYTHON][INFRA] Remove unused packages from python 3.11 test images [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/26 01:57:40 UTC, 1 replies.
- [PR] [SPARK-55175][PYTHON] Extract `to_pandas` transformer from ArrowStreamPandasSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/26 02:08:37 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-55175][PYTHON] Extract `to_pandas` transformer from ArrowStreamPandasSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/26 02:09:59 UTC, 0 replies.
- [PR] [SPARK-34679][DOCS] Add inferTimestamp option to JSON data source doc… [spark] - posted by "anirudh83 (via GitHub)" <gi...@apache.org> on 2026/01/26 02:16:52 UTC, 1 replies.
- Re: [PR] [SPARK-55176][PYTHON] Extract `arrow_to_pandas` converter into ArrowArrayToPandasConversion [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/26 02:29:24 UTC, 8 replies.
- [PR] [SPARK-55183][PYTHON] Extract `reorder_columns` transformer from ArrowStreamGroupUDFSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/26 02:47:24 UTC, 1 replies.
- [PR] Upgrade python to 3.12 in maven daily test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/26 02:52:29 UTC, 3 replies.
- Re: [PR] [SPARK-55093][CORE] Handle TaskRunner construction failures in launchTask [spark] - posted by "ChuckLin2025 (via GitHub)" <gi...@apache.org> on 2026/01/26 02:54:41 UTC, 1 replies.
- Re: [PR] [SPARK-55184][INFRA] Upgrade Python to 3.12 for Maven's daily testing [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/26 02:56:50 UTC, 2 replies.
- [PR] [SPARK-55186][PYTHON] Make ArrowArrayToPandasConversion.convert_legacy able to return pd.DataFrame [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/26 03:33:07 UTC, 8 replies.
- [PR] [WIP][SPARK-55185][SQL]. Fix for idempotency being broken, if InferFiltersFromCon… [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2026/01/26 03:36:39 UTC, 1 replies.
- [PR] [SPARK-55187][PYTHON][INFRA] Remove unused packages from python 3.13 test images [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/26 03:39:42 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-55187][PYTHON][INFRA] Remove unused packages from python 3.13 test images [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/26 03:39:52 UTC, 0 replies.
- [PR] [SPARK-55188][PYTHON][INFRA] Remove unused packages from python 3.14 test images [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/26 03:45:48 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-55188][PYTHON][INFRA] Remove unused packages from python 3.14 test images [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/26 03:45:56 UTC, 0 replies.
- [PR] [SPARK-55189][BUILD] Upgrade lz4-java to 1.10.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/26 04:55:15 UTC, 1 replies.
- Re: [PR] [SPARK-55189][BUILD] Upgrade lz4-java to 1.10.3 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/26 05:14:21 UTC, 2 replies.
- [PR] [SPARK-55164][PYTHON][TESTS][FOLLOW-UP] Fix golden file prefix [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/26 05:58:05 UTC, 3 replies.
- [PR] [SPARK-55190] Improve `ClusterInitStep` to use Server-Side Apply APIs [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/26 06:15:34 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-55064][SQL][CORE] Support query level indeterminate shuffle retry [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2026/01/26 06:35:52 UTC, 0 replies.
- [PR] [SPARK-55191][INFRA] Adjust the Python version used in the Python-only daily test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/26 06:51:39 UTC, 5 replies.
- [PR] [SPARK-55192] Improve HTTP response security [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/26 07:35:13 UTC, 4 replies.
- Re: [PR] [SPARK-55191][INFRA][DOCS] Adjust the Python version used in the Python-only daily test [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/26 07:44:53 UTC, 2 replies.
- Re: [PR] [SPARK-55193][CORE][BUILD] Use `CompressionHandler` as a replacement for the deprecated `GzipHandler` in `JettyUtils` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/26 07:49:20 UTC, 4 replies.
- [PR] [SPARK-55194][PYTHON] Remove GroupArrowUDFSerializer by moving flatten logic to mapper [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/26 08:05:52 UTC, 6 replies.
- [PR] [SPARK-55195] Add `MacOS` integration test with Apache Spark `4.2.0-preview1` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/26 08:08:08 UTC, 2 replies.
- [PR] [SPARK-55196][K8S][TESTS] Add `commandTestTag` to K8s Integration Test [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/26 08:46:34 UTC, 4 replies.
- Re: [PR] [SPARK-55179][PYTHON][CONNECT] Skip eager column name validation in `df.col_name` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/26 09:01:43 UTC, 9 replies.
- [PR] [SPARK-55197][PYTHON] Extract `_write_stream_start` helper to deduplicate START_ARROW_STREAM signal logic [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/26 09:25:40 UTC, 5 replies.
- [PR] [SPARK-55198][SQL] spark-sql should skip comment line with leading whitespaces [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/01/26 11:56:57 UTC, 6 replies.
- [PR] [SPARK-55200][K8S][TESTS] Add `RancherDesktopBackend` for K8s integration tests [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/26 12:22:13 UTC, 5 replies.
- Re: [PR] [SPARK-55174][SQL][TESTS] Move `Geo*ClientSuite` from `sql/core` to `sql/api` module [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/26 14:01:30 UTC, 1 replies.
- [PR] 3.5 [spark] - posted by "wqx-229 (via GitHub)" <gi...@apache.org> on 2026/01/26 15:38:50 UTC, 3 replies.
- [PR] [SPARK-55201][CORE]: Add disableHttpPort to SSLOptions to prevent Jet… [spark] - posted by "aipszilon (via GitHub)" <gi...@apache.org> on 2026/01/26 15:40:54 UTC, 1 replies.
- [PR] [SPARK-46165][PS] Add support for DataFrame.all axis=None [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/01/26 17:21:32 UTC, 2 replies.
- Re: [PR] [SPARK-55110][SQL] Order of application of 3 rules changed to achieve idempotency faster [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2026/01/26 19:19:05 UTC, 2 replies.
- [PR] [SPARK-55202] Fix UNEXPECTED_USE_OF_PARAMETER_MARKER wehn using param… [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/01/26 19:26:54 UTC, 0 replies.
- Re: [PR] [SPARK-55202] Fix UNEXPECTED_USE_OF_PARAMETER_MARKER when using param… [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/26 19:27:04 UTC, 3 replies.
- [PR] [WIP][SPARK-55185][SPARK-55072][SQL] Combined PR to verify that SPARK-55072 is fixed with dependent PR of SPARK-55185 [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2026/01/26 19:30:42 UTC, 1 replies.
- [PR] [SPARK-52407][SQL][FOLLOW-UP] Remove Theta Sketch aggregation buffer re-wrapping [spark] - posted by "cboumalh (via GitHub)" <gi...@apache.org> on 2026/01/26 19:45:15 UTC, 1 replies.
- [PR] [SPARK-55205][PYTHON][PS] Fix tests where it assumes string type will convert to object [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/26 20:25:01 UTC, 3 replies.
- Re: [PR] [SPARK-55185][SQL]. Fix for idempotency being broken, if InferFiltersFromConstraint rule is run as part of post optimization batch with fixed iterations [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2026/01/26 20:39:44 UTC, 0 replies.
- Re: [PR] [SPARK-55072][SQL]. Ensure IsNotNull inferred filter is not missed for left leg of Inner Join ( obtained via conversion of Left Outer) [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2026/01/26 20:52:59 UTC, 1 replies.
- [PR] [SPARK-55204][PYTHON] Extract `PandasBatchTransformer` for pandas batch transformations [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/26 21:30:52 UTC, 1 replies.
- [PR] [MINOR][PYTHON][TESTS] Consolidate DataStreamReader.name() tests into test_streaming.py [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/01/26 22:24:24 UTC, 2 replies.
- Re: [PR] [SPARK-55182][PYTHON][INFRA] Remove unused packages from python 3.11 test images [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/01/26 22:29:05 UTC, 1 replies.
- Re: [PR] [SPARK-55181][PYTHON][INFRA] Remove unused packages from python 3.10 test images [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/01/26 22:31:25 UTC, 1 replies.
- [PR] [SPARK-55221][PYTHON] Add `to_arrow` transformer and remove `_create_struct_array` [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/26 22:38:48 UTC, 1 replies.
- Re: [PR] [SPARK-54743][SS] Fix NullPointerException in stream-stream join with state format v2/v3 [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/01/26 22:45:45 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-55221][PYTHON] Add `to_arrow` transformer and remove `_create_struct_array` [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/26 22:50:51 UTC, 0 replies.
- Re: [PR] [SPARK-54584][SS] Adding `.name()` to DataStreamReader to enable naming streaming sources [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/01/26 22:50:59 UTC, 0 replies.
- [PR] Upgrade Spark 4.0 [spark] - posted by "li-isabella (via GitHub)" <gi...@apache.org> on 2026/01/26 23:08:08 UTC, 1 replies.
- [PR] [SPARK-55223] Document sinks in declarative pipelines programming guide [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2026/01/26 23:35:14 UTC, 1 replies.
- [PR] [SPARK-55224][PYTHON] Use Spark DataType as ground truth in Pandas-Arrow serialization [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/27 00:23:57 UTC, 11 replies.
- [PR] [SPARK-55226][PYTHON][PS] Recognize datetime and timedelta with units other than [ns] [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/27 00:41:15 UTC, 3 replies.
- Re: [PR] [WIP][SPARK-55056][SQL][PYTHON] Fix toPandas() SIGSEGV on nested empty arrays [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/27 01:01:43 UTC, 0 replies.
- Re: [PR] [SPARK-55169][PYTHON] Use ArrowBatchTransformer.flatten_struct in ArrowStreamArrowUDTFSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/27 01:22:58 UTC, 11 replies.
- [PR] [SPARK-54942][PYTHON][TESTS][FOLLOWUP] Fix struct cast tests for PyArrow < 21 compatibility [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/27 01:51:18 UTC, 8 replies.
- [PR] [SPARK-48455][DOCS][MINOR] Remove unused DECLARE statement from IF statement example in Docs [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2026/01/27 02:08:26 UTC, 3 replies.
- Re: [PR] [SPARK-54780][K8S][DOCS] Drop K8s v1.32 Support [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/27 03:04:31 UTC, 0 replies.
- [PR] [SPARK-55232][BUILD][TESTS] Upgrade `bytebuddy` to 1.18.4 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/27 03:31:00 UTC, 4 replies.
- [PR] [SPARK-55233][BUILD] Upgrade ASM to 9.9.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/27 03:48:28 UTC, 6 replies.
- Re: [PR] [SPARK-55150][CONNECT][SQL] Improve observation error handling [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/27 07:07:03 UTC, 11 replies.
- [PR] [SPARK-55234][PYTHON][INFRA] Remove unused packages from remaining pyspark test images [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/27 07:17:21 UTC, 3 replies.
- [PR] [SPARK-55235][PYTHON][TESTS] Refactor tests for pandas udf input type coercion [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/27 07:22:43 UTC, 3 replies.
- [PR] Spark 47996 cross merge [spark] - posted by "fangchenli (via GitHub)" <gi...@apache.org> on 2026/01/27 07:58:05 UTC, 1 replies.
- [PR] [SPARK-55236][CORE] Address unexpected exception in some CoarseGrainedExecutorBackendSuite test cases [spark] - posted by "ChuckLin2025 (via GitHub)" <gi...@apache.org> on 2026/01/27 08:08:51 UTC, 4 replies.
- [PR] [SPARK-55237][SQL] Suppress annoying messages when looking up nonexistent DBs [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/01/27 08:11:19 UTC, 12 replies.
- Re: [PR] [SPARK-55064][SQL][CORE] Support query level indeterminate shuffle retry [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/27 08:23:49 UTC, 5 replies.
- [PR] [SPARK-55238][Geo][SQL] Move Geo SRS mapping logic from `main/scala` to `main/java` [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/01/27 08:59:05 UTC, 4 replies.
- [PR] [SPARK-55239][CONNECT][YARN] Allow to launch SparkConnectServer in YARN cluster mode [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/01/27 11:25:05 UTC, 13 replies.
- [PR] [SPARK-XXXXX][CORE] Refactor LazyTry stacktrace handling to use wrapper instead of suppressed exception [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/27 11:51:22 UTC, 4 replies.
- Re: [PR] [SPARK-55240][CORE] Refactor LazyTry stacktrace handling to use wrapper instead of suppressed exception [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/01/27 11:56:51 UTC, 13 replies.
- [PR] Added Variant Implementation in ColumnarBatchRow.java [spark] - posted by "mohitkundu1213 (via GitHub)" <gi...@apache.org> on 2026/01/27 12:33:42 UTC, 1 replies.
- Re: [PR] [MINOR] Added Variant Implementation in ColumnarBatchRow.java [spark] - posted by "mohitkundu1213 (via GitHub)" <gi...@apache.org> on 2026/01/27 12:42:37 UTC, 2 replies.
- [PR] Add previously removed legacy error class back in [spark] - posted by "garlandz-db (via GitHub)" <gi...@apache.org> on 2026/01/27 14:31:57 UTC, 1 replies.
- [PR] [SPARK-46167][PS] Add axis implementation to DataFrame.rank [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/01/27 15:55:18 UTC, 5 replies.
- Re: [PR] [SPARK-55223][DOCS] Document sinks in declarative pipelines programming guide [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2026/01/27 16:27:19 UTC, 0 replies.
- Re: [PR] [SPARK-51069][SQL] Add big-endian support to UnsafeRowUtils.validateStructuralIntegrityWithReasonImpl [spark] - posted by "jonathan-albrecht-ibm (via GitHub)" <gi...@apache.org> on 2026/01/27 16:28:37 UTC, 0 replies.
- Re: [PR] [SPARK-55119][SQL] Fix Continue Handler: prevent INTERNAL_ERROR and incorrect conditional statements interruption [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2026/01/27 16:48:32 UTC, 3 replies.
- Re: [PR] [SPARK-53652][SQL]Codegen for MergeRowExec [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/01/27 17:41:05 UTC, 1 replies.
- [PR] [SPARK-54943][PYTHON][TESTS] Add test coverage for `pa.Array.cast` with `safe=False` [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/27 18:46:51 UTC, 6 replies.
- Re: [PR] [SPARK-55020][PYTHON] Disable gc when executing gRPC command [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/27 18:56:09 UTC, 3 replies.
- [PR] [SPARK-55031][SQL] Add vector avg/sum aggregation function expressions [spark] - posted by "zhidongqu-db (via GitHub)" <gi...@apache.org> on 2026/01/27 20:07:08 UTC, 9 replies.
- [PR] Upgrade Spark 4.1 + Affirm Specific Change [spark] - posted by "li-isabella (via GitHub)" <gi...@apache.org> on 2026/01/27 21:03:39 UTC, 1 replies.
- [PR] Test without join [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2026/01/27 21:45:09 UTC, 2 replies.
- Re: [PR] [SPARK-47996][PS] support cross merge in pandas API [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/01/27 21:59:15 UTC, 6 replies.
- [PR] [SPARK-55228][SQL] Implement Dataset.zipWithIndex in Scala API [spark] - posted by "fangchenli (via GitHub)" <gi...@apache.org> on 2026/01/27 22:09:22 UTC, 2 replies.
- [PR] [SPARK-55244][PYTHON][PS] Use np.nan as default value for pandas string types [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/27 22:53:08 UTC, 5 replies.
- [PR] [SPARK-55243][CONNECT] Allow setting binary headers via the -bin suffix in the Scala Connect client [spark] - posted by "dillitz (via GitHub)" <gi...@apache.org> on 2026/01/27 23:28:53 UTC, 28 replies.
- [PR] [SPARK-55225][PYTHON][PS] Restore to the original dtype for Datetime [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/28 00:02:53 UTC, 5 replies.
- [PR] [SPARK-55245][PYTHON][PS][TESTS] Fix all timestamp freq usage from M to ME [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/28 00:22:16 UTC, 3 replies.
- [PR] [SPARK-55246][SS] Add Test for Pyspark TWS and TWSInPandas and Fix StatePartitionAllColumnFamiliesWriter Bug [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2026/01/28 00:37:58 UTC, 7 replies.
- [PR] [SPARK-54906][PYTHON][TESTS][FOLLOW_UP] Try to use a real module name instead of `__main__` [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/01/28 01:14:49 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-54986][PYTHON][ML][CONNECT] Disable reattachable in `_delete_ml_cache` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/28 01:30:51 UTC, 0 replies.
- Re: [PR] [SPARK-54906][PYTHON][TESTS][FOLLOWUP] Try to use a real module name instead of `__main__` [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/28 01:44:41 UTC, 2 replies.
- [PR] [SPARK-55038][SQL] Fix wrong results for array_agg(DISTINCT) with AQE… [spark] - posted by "anirudh83 (via GitHub)" <gi...@apache.org> on 2026/01/28 01:49:04 UTC, 1 replies.
- Re: [PR] [SPARK-55228][SPARK-55230][SQL] Implement Dataset.zipWithIndex in Scala API [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/28 01:52:59 UTC, 2 replies.
- Re: [PR] [SPARK-54812][SQL] Make executable commands not execute on resultDf.cache() [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/01/28 02:01:30 UTC, 6 replies.
- [PR] [WIP][SPARK-55241][SQL]. Fix SQL Streaming idempotency broken, with PropagateEmptyRelation and InferFiltersFromConstraint run as part of Fixed Number of iterations [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2026/01/28 02:37:50 UTC, 1 replies.
- [PR] [SPARK-55247][CONNECT] Clean up deprecated API usage related to `o.a.c.io.input.BoundedInputStream` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/28 02:59:29 UTC, 4 replies.
- [PR] [SPARK-55248][SS] Clean up Jackson deprecated API usage in `streaming.checkpointing.Checksum` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/28 03:25:56 UTC, 4 replies.
- [PR] [SPARK-55249][PYTHON] Make DataFrame.toJSON able to return dataframe [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/28 03:58:58 UTC, 3 replies.
- [PR] [SPARK-55250][SQL] Reduce Hive client calls on CREATE NAMESPACE [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/01/28 05:19:07 UTC, 7 replies.
- [PR] [SPARK-55251][INFRA] Make `Python Coverage` test with Python 3.12 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/28 05:28:59 UTC, 5 replies.
- [PR] [SPARK-55252][CORE] Improve `HttpSecurityFilter` to add `Content-Security-Policy` header [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/28 07:01:40 UTC, 4 replies.
- [PR] [WIP][SPARK-54276][BUILD] Bump Hadoop 3.4.3 RC0 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/01/28 07:47:00 UTC, 7 replies.
- [PR] [SPARK-55253][Geo][SQL][TESTS] Remove nonansi golden files for ST functions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/01/28 09:28:21 UTC, 3 replies.
- [PR] [SPARK-55254][BUILD] Upgrade `analyticsaccelerator-s3` to 1.3.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/28 09:37:26 UTC, 4 replies.
- [PR] [SPARK-55255][BUILD] Upgrade `objenesis` to 3.5 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/28 10:12:11 UTC, 4 replies.
- [PR] [SPARK-54830][TESTS][FOLLOWUP] Disable shuffle checksum for the test case of SPARK-48037 to avoid memory issues [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2026/01/28 10:26:42 UTC, 6 replies.
- [PR] [SPARK-55256][SQL] Support IGNORE NULLS / RESPECT NULLS for array_agg and collect_list [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/01/28 12:20:21 UTC, 12 replies.
- Re: [PR] [SPARK-53745][PYTHON] Update mlflow to 3.1.0 [spark] - posted by "eschcam (via GitHub)" <gi...@apache.org> on 2026/01/28 15:00:39 UTC, 0 replies.
- Re: [PR] [SPARK-53746][PYTHON] Update pyyaml to 6.0.3 [spark] - posted by "eschcam (via GitHub)" <gi...@apache.org> on 2026/01/28 15:16:51 UTC, 0 replies.
- [PR] [SPARK-55258][DOCS] Document CLI parameters in declarative pipelines programming guide [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2026/01/28 15:37:58 UTC, 4 replies.
- [PR] Raise exception if no active Spark context [spark] - posted by "amarvin (via GitHub)" <gi...@apache.org> on 2026/01/28 16:29:13 UTC, 1 replies.
- [PR] [SPARK-55259][Geo][SQL] Implement Parquet schema conversion for Geo types [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/01/28 18:07:01 UTC, 8 replies.
- [PR] [SPARK-55262][Geo][SQL] Block Geo types in all file based data sources except Parquet [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/01/28 18:07:23 UTC, 6 replies.
- [PR] [SPARK-55260][Geo][SQL] Implement Parquet write support for Geo types [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/01/28 18:08:18 UTC, 12 replies.
- [PR] [SPARK-55261][Geo][SQL] Implement Parquet read support for Geo types [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/01/28 18:08:25 UTC, 1 replies.
- [PR] [SPARK-54179][SQL][FOLLOW-UP] Add Dataframe API support for Tuple sketches [spark] - posted by "cboumalh (via GitHub)" <gi...@apache.org> on 2026/01/28 18:16:21 UTC, 2 replies.
- [PR] [SPARK-55263][PYTHON][INFRA] Upgrade Python linter from 3.11 to 3.12 in CI [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/28 19:32:39 UTC, 10 replies.
- [PR] [SPARK-42025][SHUFFLE] Improve logs level in removeBlocks [spark] - posted by "varun-lakhyani (via GitHub)" <gi...@apache.org> on 2026/01/28 20:13:14 UTC, 3 replies.
- [PR] [SPARK-46168][PS] Add axis argument for idxmax [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/01/28 22:14:36 UTC, 1 replies.
- [PR] [SPARK-55265][INFRA] Increase timeout to 150 mins in GitHub Actions [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/01/28 22:15:42 UTC, 3 replies.
- Re: [PR] [SPARK-53790][SQL] Support generic beans in Arrow Encoder [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/01/28 22:36:07 UTC, 0 replies.
- [PR] [SPARK-41398][SQL][FOLLOWUP] Update runtime filtering javadoc to reflect relaxed partition constraints [spark] - posted by "yyanyy (via GitHub)" <gi...@apache.org> on 2026/01/28 22:42:21 UTC, 4 replies.
- [PR] [SPARK-54943][PYTHON][TESTS] Add test coverage for pa.Array.cast with safe=False [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/29 00:00:35 UTC, 4 replies.
- Re: [PR] [WIP][SPARK-53855][SQL] Fix PlanID preservation in ResolveSQLFunctions with UDFs [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/29 00:36:13 UTC, 1 replies.
- Re: [PR] [SPARK-51489][SQL]Represent SQL scripts in Spark UI [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/29 00:36:15 UTC, 1 replies.
- Re: [PR] [SPARK-53298][SQL] Make an isolation to control Shuffle partitionSizeInBytes converted from `REBALANCE` hint [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/29 00:36:17 UTC, 1 replies.
- [PR] [SPARK-55266][INFRA] Add pre-commit hooks for format/lint [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/29 01:36:20 UTC, 13 replies.
- [PR] [SPARK-54943][PYTHON][TESTS][FOLLOW-UP] Disable `test_pyarrow_array_cast` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/29 02:54:27 UTC, 3 replies.
- [PR] Revert "[SPARK-54943][PYTHON][TESTS][FOLLOW-UP] Mistake Commit" [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/29 02:58:29 UTC, 2 replies.
- [PR] [SPARK-54943][PYTHON][TESTS][FOLLOW-UP] Disable `test_pyarrow_array_cast` for now [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/29 03:00:50 UTC, 3 replies.
- [PR] [SPARK-55267][INFRA] Make sbt less verbose in github actions [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/29 03:07:45 UTC, 15 replies.
- [PR] SPARK-55268: Fix `ConfigOption.getValue` not to invoke `resolveValue` twice [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/29 06:05:33 UTC, 0 replies.
- [PR] [SPARK-55269] Fix a wrong comment of `testHandleSentinelResourceReconciliation` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/29 06:16:02 UTC, 2 replies.
- Re: [PR] [SPARK-55268] Fix `ConfigOption.getValue` not to invoke `resolveValue` twice [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/29 06:56:14 UTC, 1 replies.
- [PR] [SPARK-55270] Disallow all HTTP methods except `GET` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/29 07:16:04 UTC, 0 replies.
- [PR] [SPARK-55114][PYTHON][TESTS][FOLLOW-UP] Update the result format to be more friendly to markdown [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/29 07:35:38 UTC, 3 replies.
- Re: [PR] [SPARK-37377][SQL] Initial implementation of Storage-Partitioned Join [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/01/29 07:51:08 UTC, 0 replies.
- [PR] [SPARK-55272][BUILD] Upgrade SBT to 1.12.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/29 08:17:54 UTC, 5 replies.
- Re: [PR] [SPARK-55270] Disallow all HTTP methods except `GET` and `HEAD` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/29 08:18:25 UTC, 1 replies.
- [PR] Replace `ParquetFileReader.open().getFooter()` with `readFooter()` to avoid unnecessary operational overhead in ParquetFooterReader [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/29 08:52:39 UTC, 1 replies.
- Re: [PR] [SPARK-55273][SQL] Replace `ParquetFileReader.open().getFooter()` with `readFooter()` to avoid unnecessary operations in `ParquetFooterReader` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/01/29 09:07:43 UTC, 2 replies.
- [PR] [SPARK-55274] Set `-XX:+AlwaysPreTouch` by default [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/29 09:16:54 UTC, 4 replies.
- [PR] [SPARK-55275] SQL State Coverage: IllegalStateException [spark] - posted by "garlandz-db (via GitHub)" <gi...@apache.org> on 2026/01/29 10:55:48 UTC, 1 replies.
- [PR] [SPARK-55276][BUILD] Upgrade `scala-maven-plugin` to 4.9.9 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/29 11:22:48 UTC, 4 replies.
- [PR] [SPARK-55271][Structured Streaming] The error originates in KafkaMicroBatchStream.metrics() at line 520, where the code attempts to call .get() on a Scala Option that contains null, then immediately invokes .map() on the null result [spark] - posted by "dipeshmr1 (via GitHub)" <gi...@apache.org> on 2026/01/29 11:26:34 UTC, 1 replies.
- [PR] [SPARK-55277][SQL] Add protobuf_funcs group for Protobuf SQL functions [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/01/29 11:28:11 UTC, 2 replies.
- [PR] [SPARK-55086][PYTHON] Add DataSourceReader.pushFilters to Python Data Source API docs [spark] - posted by "yamayuki-hub (via GitHub)" <gi...@apache.org> on 2026/01/29 11:55:52 UTC, 1 replies.
- [PR] [SPARK-55279][SQL] Add sketch_funcs group for DataSketches SQL functions [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/01/29 13:03:43 UTC, 1 replies.
- [PR] [SPARK-55280][CONNECT] Add GetStatus proto to support execution status monitoring [spark] - posted by "terana (via GitHub)" <gi...@apache.org> on 2026/01/29 14:04:35 UTC, 14 replies.
- Re: [PR] [SPARK-54887] Add previously removed legacy error class back in [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2026/01/29 15:27:25 UTC, 19 replies.
- [PR] [SPARK-55281][PYTHON] Add ipykernel and IPython to mypy optional package list [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/29 22:05:30 UTC, 3 replies.
- [PR] [SPARK-54812][SQL][4.1] Make executable commands not execute on resultDf.cache() [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/01/29 22:50:56 UTC, 2 replies.
- [PR] [SPARK-55282][PYTHON][CONNECT] Avoid using worker_util in the Driver-side [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/01/30 00:22:00 UTC, 4 replies.
- [PR] [SPARK-55283][PYTHON][PS][TESTS] Add a new argument ignore_null to assert_eq [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/30 00:31:55 UTC, 1 replies.
- Re: [PR] [SPARK-55228][SPARK-55230][SQL][CONNECT] Implement Dataset.zipWithIndex in Scala API [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/30 00:34:49 UTC, 4 replies.
- [PR] [SPARK-55284][PYTHON][TEST] Move mypy-data related configs to the script [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/30 01:32:45 UTC, 1 replies.
- [PR] [WIP][SQL][PYTHON] Delay the initialization of `PythonArrowInput` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/30 02:25:48 UTC, 1 replies.
- Re: [PR] [SPARK-55285][SQL][PYTHON] Delay the initialization of `PythonArrowInput` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/30 03:28:44 UTC, 2 replies.
- [PR] [SPARK-55286][INFRA] Add test summary to GitHub Actions for better failure visibility [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/01/30 05:02:11 UTC, 2 replies.
- Re: [PR] [SPARK-55277][SQL] Add `protobuf_funcs` group for Protobuf SQL functions [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/01/30 06:56:40 UTC, 5 replies.
- [PR] [SPARK-55287][INFRA] consolidate steps in lint [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/30 08:38:29 UTC, 1 replies.
- Re: [PR] [SPARK-54727][BUILD] Upgrade Netty to `4.2.9.Final` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/30 10:19:47 UTC, 0 replies.
- [PR] [SPARK-55288] Upgrade Netty to `4.2.9.Final` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/01/30 11:02:37 UTC, 3 replies.
- Re: [PR] [SPARK-54805][SS][PYTHON] Implement TwsTester in PySpark [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/01/30 12:58:27 UTC, 1 replies.
- Re: [PR] [SPARK-55287][INFRA] Consolidate steps in `lint` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/01/30 13:31:20 UTC, 1 replies.
- Re: [PR] [SPARK-53744][PYTHON][TESTS] Update `black` python to 24.3.0 [spark] - posted by "eschcam (via GitHub)" <gi...@apache.org> on 2026/01/30 15:09:26 UTC, 0 replies.
- [PR] [SPARK-55289][SQL] Fix flaky test in-set-operations.sql by disabling broadcast join [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/01/30 17:57:08 UTC, 5 replies.
- Re: [PR] [SPARK-55279][SQL] Add `sketch_funcs` group for DataSketches SQL functions [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/01/30 18:22:28 UTC, 1 replies.
- [PR] [SPARK-55290][NETWORK][TEST] Fix testReloadMissingTrustStore cross-device link error with JDK 21 [spark] - posted by "efaracci018 (via GitHub)" <gi...@apache.org> on 2026/01/30 19:46:26 UTC, 1 replies.
- Re: [PR] [SPARK-53873][SQL] ExplodeBase.eval IterableOnce directly on input [spark] - posted by "asautins (via GitHub)" <gi...@apache.org> on 2026/01/30 20:45:15 UTC, 0 replies.
- [PR] [SPARK-55291][CONNECT] Pre-process metadata headers at client interceptor construction time [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2026/01/30 21:25:40 UTC, 1 replies.
- [PR] [WIP] POC for serializer changes [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/01/30 21:47:55 UTC, 1 replies.
- [PR] init [spark] - posted by "tangrizzly (via GitHub)" <gi...@apache.org> on 2026/01/30 22:19:24 UTC, 1 replies.
- [PR] [SPARK-55292] Add discover latency metric to track operator processing delay [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2026/01/30 22:21:32 UTC, 1 replies.
- [PR] [SPARK-55293][PS][TESTS Avoid using old offset aliases [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/01/30 23:14:32 UTC, 5 replies.
- [PR] [SPARK-55295][Geo][SQL] Extend the ST_GeomFromWKB function to take an optional SRID value [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/01/30 23:49:47 UTC, 1 replies.
- [PR] [SPARK-55297][PYTHON][PS] Restore timedelta dtype based on the original dtype [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/01/30 23:58:21 UTC, 1 replies.
- [PR] [SPARK-55298] Fix "Argument list too long" error in assertGeneratedCRDMatchesHelmChart task [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2026/01/31 00:05:58 UTC, 0 replies.
- [PR] [SPARK-55300][Docs] Add timestamp offset option visualization in Kafka docs [spark] - posted by "kavpreetgrewal (via GitHub)" <gi...@apache.org> on 2026/01/31 00:19:20 UTC, 1 replies.
- Re: [PR] [SPARK-55123][SS] Add SequentialUnionOffset for tracking sequential source processing [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2026/01/31 01:25:21 UTC, 0 replies.
- Re: [PR] [SPARK-55290][NETWORK][TESTS] Fix testReloadMissingTrustStore cross-device link error with JDK 21 [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/01/31 07:52:41 UTC, 1 replies.
- [PR] [SPARK-55302][SQL] Fix custom metrics in case of `KeyGroupedPartitioning` [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/01/31 09:04:50 UTC, 2 replies.
- Re: [PR] [SPARK-55153][SS][PYTHON][DOC] Add documentation for TwsTester [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/01/31 12:59:51 UTC, 0 replies.
- [PR] Bump protobuf from 6.33.0 to 6.33.5 in /dev [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/01/31 20:12:25 UTC, 1 replies.