You are viewing a plain text version of this content. The canonical link for it is here.

---

- Re: [PR] [SPARK-54106][SS] State store row checksum implementation [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/11/01 00:16:52 UTC, 7 replies.
- [PR] [SPARK-54123][PYTHON] Add timezone to make the timestamp an absolute time [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/11/01 00:25:44 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-52764][PYTHON][ML][CONNECT][TESTS] Retry flaky tests in `test_parity_classification` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/01 00:30:51 UTC, 1 replies.
- Re: [PR] [SPARK-52767][SQL] Optimize the performance of maxRows for join and union [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/01 00:30:53 UTC, 2 replies.
- Re: [PR] [SPARK-51554][SQL] Add the time_trunc() function for TIME datatype [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/01 00:30:54 UTC, 0 replies.
- [PR] [SPARK-54122] Implement TwsTester [spark] - posted by "fedimser (via GitHub)" <gi...@apache.org> on 2025/11/01 01:11:59 UTC, 0 replies.
- [PR] [SPARK-54127][BUILD] Fix sbt inconsistent shading package [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/01 04:29:05 UTC, 4 replies.
- Re: [PR] [SPARK-54118][SS] Improve the put/merge operation in ListState when there are multiple values [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/11/01 04:41:50 UTC, 0 replies.
- Re: [PR] [SPARK-54121][SS] Automatic Snapshot Repair for State store [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/11/01 04:47:34 UTC, 2 replies.
- Re: [PR] [SPARK-53448][PYTHON] Conversion of a pyspark DataFrame with a Variant column to pandas fails with an error [spark] - posted by "VindhyaG (via GitHub)" <gi...@apache.org> on 2025/11/01 05:00:58 UTC, 11 replies.
- Re: [PR] [SPARK-53991][SQL] Add SQL support for KLL quantiles functions based on DataSketches [spark] - posted by "cboumalh (via GitHub)" <gi...@apache.org> on 2025/11/01 05:13:37 UTC, 6 replies.
- Re: [PR] [SPARK-54027] Kafka Source RTM support [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/11/01 06:01:35 UTC, 1 replies.
- Re: [PR] [SPARK-53898][CORE] Shuffle cleanup should not clean MapOutputTrackerMaster.shuffleStatuses in local cluster [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2025/11/01 06:16:45 UTC, 15 replies.
- Re: [PR] [SPARK-54088][CORE] When TaskSchedulerImpl searches for an executor to schedule an unschedulable task, it should exclude executors that are pending to remove [spark] - posted by "maheshk114 (via GitHub)" <gi...@apache.org> on 2025/11/01 07:25:21 UTC, 13 replies.
- Re: [PR] [SPARK-53809][SQL] Add canonicalization for DataSourceV2ScanRelation [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/11/01 09:11:15 UTC, 1 replies.
- Re: [PR] [SPARK-54110][Geo][SQL] Introduce type encoders for Geography and Geometry types [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/11/01 09:22:29 UTC, 3 replies.
- Re: [PR] [SPARK-54010] Support `applicationTolerations.restartConfig.restartCounterResetMillis` [spark-kubernetes-operator] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/11/01 09:36:57 UTC, 3 replies.
- Re: [PR] [SPARK-54120] Update assertGeneratedCRDMatchesHelmChart to include diff [spark-kubernetes-operator] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/11/01 09:39:36 UTC, 1 replies.
- Re: [PR] [SPARK-54056][SQL] resolve substitution for SQLConf settings in Catalogs [spark] - posted by "EugeneYushin (via GitHub)" <gi...@apache.org> on 2025/11/01 14:26:58 UTC, 6 replies.
- [PR] [SPARK-54130][SQL] Add detailed error messages for catalog assertion failures [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2025/11/01 15:25:54 UTC, 1 replies.
- Re: [PR] [SPARK-54049][BUILD] Shade com.google.thirdparty package to fix Guava class conflicts in spark 4.0 [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/11/01 15:50:52 UTC, 3 replies.
- [PR] Revert "[SPARK-54106][SS] State store row checksum implementation" [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2025/11/01 16:27:41 UTC, 7 replies.
- [PR] [WIP] Pandas 2 3 3 [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2025/11/01 16:51:31 UTC, 0 replies.
- [PR] [SPARK-54106][SS] Recheckin State store row checksum implementation [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2025/11/01 20:03:02 UTC, 1 replies.
- [PR] [SPARK-54132][SQL][TESTS] Cover HashedRelation#close in HashedRelationSuite [spark] - posted by "zhztheplayer (via GitHub)" <gi...@apache.org> on 2025/11/01 20:38:18 UTC, 5 replies.
- Re: [PR] approx_top_k_combine [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/02 00:30:35 UTC, 1 replies.
- Re: [PR] [SPARK-52617][SQL] Cast TIME to/from TIMESTAMP_NTZ [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/02 00:30:36 UTC, 1 replies.
- Re: [PR] [SPARK-51359][CORE][SQL] Set INT64 as the default timestamp type for Parquet files [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/02 00:30:38 UTC, 1 replies.
- Re: [PR] [SPARK-xxxxx][SQL] Optimize Arrow memory usage [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/11/02 00:58:45 UTC, 0 replies.
- [PR] [SDP] Add support for cluster_by in Python Pipelines APIs [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/11/02 01:55:08 UTC, 0 replies.
- [PR] [SPARK-54133][BUILD] Setting version to 4.2.0-SNAPSHOT [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/02 02:05:56 UTC, 5 replies.
- [PR] [SPARK-54135][INFRA] Add GitHub Action jobs for branch-4.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/02 02:15:12 UTC, 0 replies.
- Re: [PR] [SPARK-54135][INFRA][4.1] Add GitHub Action jobs for branch-4.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/02 02:15:36 UTC, 5 replies.
- Re: [PR] [SPARK-54052][PYTHON] Add a bridge object to workaround Py4J limitation [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/11/02 07:01:40 UTC, 1 replies.
- [PR] [SPARK-54136][SQL] Extract plan merging logic from `MergeScalarSubqueries` to `PlanMerger` [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/11/02 12:24:55 UTC, 21 replies.
- Re: [PR] [SPARK-54131][PYTHON] Update `Pandas` version 2.3.3 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/02 16:36:11 UTC, 4 replies.
- [PR] [SPARK-54138][SQL] Enforce constant configuration parameter for Theta and HLL [spark] - posted by "cboumalh (via GitHub)" <gi...@apache.org> on 2025/11/02 17:13:50 UTC, 4 replies.
- [PR] [SPARK-54139][PYTHON] Incorrect parameter passed CANNOT_PARSE_DATATYPE error class [spark] - posted by "khalidmammadov (via GitHub)" <gi...@apache.org> on 2025/11/02 17:34:55 UTC, 2 replies.
- Re: [PR] Avoid traversing nested folders if recursiveFileLookup = false [spark] - posted by "mzhang (via GitHub)" <gi...@apache.org> on 2025/11/02 17:56:47 UTC, 0 replies.
- [PR] [SPARK-54140][INFRA] Add `libwebp-dev` to fix `dev/spark-test-image/lint/Dockerfile` building [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/02 21:23:49 UTC, 7 replies.
- [PR] [DRAFT] [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/11/02 21:55:12 UTC, 3 replies.
- [PR] [SPARK-54141][INFRA] Add `libwebp-dev` to fix `dev/infra/Dockerfile` building [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/02 22:51:21 UTC, 2 replies.
- Re: [PR] [SPARK-54099][SQL] XML variant parser should fall back to string on decimal parsing errors [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/11/02 23:02:51 UTC, 1 replies.
- [PR] [SPARK-54142][Geo][SQL] Implement the st_srid function in Scala [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/11/02 23:03:54 UTC, 0 replies.
- Re: [PR] [SPARK-39328][SQL][TESTS] Fix flaky test `SPARK-37753: Inhibit broadcast in left outer join when there are many empty partitions on outer/left side` [spark] - posted by "Last-remote11 (via GitHub)" <gi...@apache.org> on 2025/11/02 23:20:17 UTC, 4 replies.
- Re: [PR] [SPARK-54115][CORE][UI][CONNECT] Display connect server execution threads first in thread dump page [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/11/02 23:24:06 UTC, 1 replies.
- Re: [PR] [SPARK-52953][SQL] Incorrect parameter order in some ExpressionEvalHelper.checkResult() method invocations [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/03 00:29:46 UTC, 1 replies.
- [PR] [SPARK-54143][INFRA] Add `branch-4.1` Daily GitHub Action jobs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/03 01:48:41 UTC, 5 replies.
- [PR] [SPARK-54144][PYTHON] Short Circuit Eval Type Inferences [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/03 01:57:47 UTC, 2 replies.
- Re: [PR] [SPARK-54079][Geo][SQL][FOLLOWUP] Fix catalyst expressions ST package and imports [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/03 02:16:29 UTC, 3 replies.
- [PR] [SPARK-54145][PYTHON][CONNECT] Fix column check of nested type in numeric agg [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/03 02:58:54 UTC, 0 replies.
- [PR] [SPARK-54146][CORE][SQL] Clean up the usage of deprecated Jackson API [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/03 03:14:59 UTC, 9 replies.
- Re: [PR] [SPARK-54003][SQL] Use the staging directory as the output path then move to final path. [spark] - posted by "zhengchenyu (via GitHub)" <gi...@apache.org> on 2025/11/03 03:22:37 UTC, 3 replies.
- [PR] [SPARK-54148][INFRA] Add `libwebp-dev` to all `dev/spark-test-image/*/Dockerfile` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/03 04:00:17 UTC, 3 replies.
- Re: [PR] [MINOR][PYTHON][DOCS] Fix the doctest of `pivot` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/03 04:24:26 UTC, 1 replies.
- Re: [PR] [SPARK-54128][CONNECT][SQL] Convert IllegalArgumentException to SparkException with proper error classes in Spark Connect server [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/03 04:29:27 UTC, 1 replies.
- Re: [PR] [SPARK-53803][ML][Feature] Added ArimaRegression for time series forecasting in MLlib [spark] - posted by "anandexplore (via GitHub)" <gi...@apache.org> on 2025/11/03 05:10:41 UTC, 4 replies.
- Re: [PR] [SPARK-54087][CORE] Spark Executor launch task failed should return task killed message [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2025/11/03 06:22:38 UTC, 29 replies.
- Re: [PR] [SPARK-54108][CONNECT] Revise execute* methods of SparkConnectStatement [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/03 06:31:12 UTC, 5 replies.
- Re: [PR] [SPARK-54111][CONNECT] Support getCatalogs for SparkConnectDatabaseMetaData [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/03 06:35:03 UTC, 1 replies.
- Re: [PR] [SPARK-54112][CONNECT] Support getSchemas for SparkConnectDatabaseMetaData [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/03 06:47:40 UTC, 11 replies.
- Re: [PR] [SPARK-48750][SQL] AQEPropagateEmptyRelation convert broadcast query stage plan to empty relation causing error [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2025/11/03 07:18:03 UTC, 0 replies.
- [PR] [SPARK-54149][SQL][CONNECT] Enable tail-recursion wherever possible [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/03 07:19:15 UTC, 0 replies.
- Re: [PR] [SPARK-54149][SQL][SS][CONNECT] Enable tail-recursion wherever possible [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/03 07:22:07 UTC, 2 replies.
- Re: [PR] [SPARK-54014][CONNECT] Support max rows for SparkConnectStatement [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/03 08:38:40 UTC, 16 replies.
- Re: [PR] Enable -Xsource:3 compiler flag [spark] - posted by "nob13 (via GitHub)" <gi...@apache.org> on 2025/11/03 08:45:09 UTC, 0 replies.
- [PR] Ensure the application name in historypage get escaped [spark] - posted by "Chhida (via GitHub)" <gi...@apache.org> on 2025/11/03 08:51:08 UTC, 4 replies.
- Re: [PR] [SPARK-38498][DSTREAM] Support customized StreamingListener by configuration [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2025/11/03 09:15:27 UTC, 5 replies.
- [PR] [SPARK-54151][Geo][PYTHON] Introduce the framework for adding ST functions in PySpark [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/11/03 09:28:28 UTC, 2 replies.
- Re: [PR] [SPARK-54131][PYTHON][TESTS] Update `Pandas` version 2.3.3 [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2025/11/03 09:28:37 UTC, 10 replies.
- [PR] [SPARK-54147][SQL] Set OMP_NUM_THREADS to spark.task.cpus by default in Ba… [spark] - posted by "TongWei1105 (via GitHub)" <gi...@apache.org> on 2025/11/03 09:38:59 UTC, 4 replies.
- Re: [PR] [SPARK-53791][CORE][SQL] Make the rename operations multi-threaded. [spark] - posted by "maheshk114 (via GitHub)" <gi...@apache.org> on 2025/11/03 11:44:30 UTC, 0 replies.
- [PR] [CONNECT]Add BatchExecutePlan RPC and reattach support [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2025/11/03 12:59:54 UTC, 1 replies.
- Re: [PR] [SPARK-53525][CONNECT][FOLLOWUP] Spark Connect ArrowBatch Result Chunking - Scala Client [spark] - posted by "xi-db (via GitHub)" <gi...@apache.org> on 2025/11/03 14:15:32 UTC, 15 replies.
- Re: [PR] [SPARK-53128][CORE] Include unmanaged memory bytes in the usage log before execution memory OOM [spark] - posted by "zhztheplayer (via GitHub)" <gi...@apache.org> on 2025/11/03 16:07:33 UTC, 2 replies.
- [PR] [SPARK-54153] Support profiling iterator based Python UDFs [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2025/11/03 16:19:11 UTC, 7 replies.
- [PR] [SPARK-54154][INFRA] Run `build_branch35*.yml` every two days [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/03 16:48:20 UTC, 4 replies.
- [PR] Bump com.microsoft.sqlserver:mssql-jdbc from 12.8.1.jre11 to 12.8.2.jre11 [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/11/03 17:30:39 UTC, 2 replies.
- [PR] [SPARK-54155][BUILD][TESTS] Upgrade `mssql-jdbc` to `13.2.1.jre11` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/03 17:35:43 UTC, 4 replies.
- [PR] [SPARK-47672][SQL] Avoid double eval from filter pushDown w/ projection pushdown [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2025/11/03 18:24:03 UTC, 22 replies.
- [PR] [CORE][SPARK-49788] Add optional TTL based cleaning for blocks to better support notebooks [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2025/11/03 18:28:54 UTC, 7 replies.
- [PR] [SPARK-54159][INFRA] Fix `pip install` commands to use proper quotation marks [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/03 19:10:10 UTC, 3 replies.
- [PR] [SPARK-54160][Geo][SQL] Implement the ST_SetSrid expression in SQL [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/11/03 20:31:21 UTC, 9 replies.
- Re: [PR] [SPARK-54134][SQL] Optimize Arrow memory usage [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/03 21:07:46 UTC, 10 replies.
- [PR] [SPARK-54161][BUILD] Upgrade `extra-enforcer-rules` to 1.11.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/03 21:14:19 UTC, 3 replies.
- Re: [PR] [SPARK-54145][PYTHON][CONNECT] Fix column check of nested type in numeric aggregation [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/03 21:27:47 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-53757] Upgrade Jetty to 12.0.12 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/03 21:36:41 UTC, 1 replies.
- Re: [PR] feat: add indiamart_clone Flutter+Firebase starter app (dual login) [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/03 21:41:42 UTC, 0 replies.
- Re: [PR] [EXPERIMENT][DO NOT MERGE] Automated pyspark sdp build workflow [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/03 21:46:04 UTC, 1 replies.
- [PR] [SPARK-54164][INFRA] Add `branch-4.1` to daily `Publish Snapshot` GitHub Action job [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/03 22:36:50 UTC, 2 replies.
- Re: [PR] [SPARK-54165][CONNECT]Add BatchExecutePlan RPC and reattach support [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2025/11/03 22:59:24 UTC, 1 replies.
- [PR] [SPARK-54166][Geo][PYTHON] Introduce type encoders for geospatial types in PySpark [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/11/03 23:06:20 UTC, 3 replies.
- Re: [PR] [SPARK-53666][DOCS] Add script to generate llms.txt file for Spark main website [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/11/03 23:10:32 UTC, 6 replies.
- [PR] [SPARK-54167] Update GitHub Action YAML file in branch-0.6 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/03 23:10:50 UTC, 3 replies.
- [PR] [SPARK-54156][PROTOBUF] Classify errors for ProtobufOptions casting failure [spark] - posted by "nyaapa (via GitHub)" <gi...@apache.org> on 2025/11/03 23:17:54 UTC, 1 replies.
- [PR] [SPARK-54168] Bump version to 0.7.0-SNAPSHOT in `main` branch [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/03 23:20:23 UTC, 3 replies.
- [PR] [SPARK-54169][Geo][CONNECT] Introduce Geography and Geometry types in Arrow writer [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/11/03 23:40:46 UTC, 0 replies.
- [PR] [SPARK-54170] Use StructuredLogging message in Scala side [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/11/04 00:42:49 UTC, 0 replies.
- [PR] [MINOR][PYTHON][TESTS] Enable `test_pivot_exceed_max_values` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/04 01:23:39 UTC, 2 replies.
- [PR] [SPARK-54172][SQL] Merge Into Schema Evolution should only add referenced columns [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/11/04 01:36:15 UTC, 44 replies.
- [PR] [todo] Add support for Deployment API on K8s [spark] - posted by "ForVic (via GitHub)" <gi...@apache.org> on 2025/11/04 01:54:52 UTC, 0 replies.
- Re: [PR] [DO-NOT-MERGE] Prototype: runtime profiling of Python workers [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/11/04 02:03:25 UTC, 1 replies.
- Re: [PR] [SPARK-54153][PYTHON] Support profiling iterator based Python UDFs [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/11/04 02:03:59 UTC, 10 replies.
- Re: [PR] [SPARK-54115][CORE][UI][CONNECT] Escalate display ordering priority of connect server execution threads in thread dump page [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/04 02:23:45 UTC, 0 replies.
- Re: [PR] [SPARK-54086][CORE][SHUFFLE] Support `IO_URING` Netty IO Mode [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/11/04 02:28:50 UTC, 6 replies.
- [PR] [SPARK-54174][TESTS] Remove override of deprecated method `SparkThrowable#getErrorClass` in Spark code [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/04 03:00:25 UTC, 0 replies.
- [PR] [SPARK-54049][BUILD] Backport to Spark 4.0. Shade com.google.thirdparty package to fix Guava class conflicts in spark 4.0 [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/11/04 03:37:11 UTC, 0 replies.
- Re: [PR] [SPARK-54115][CORE][UI] Escalate display ordering priority of connect server operation threads in thread dump page [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/04 04:28:43 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-53998] Add addition E2E tests for RTM [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2025/11/04 05:15:44 UTC, 0 replies.
- [PR] [SPARK-53998] Add addition E2E tests for RTM [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2025/11/04 05:17:27 UTC, 6 replies.
- Re: [PR] [SPARK-54174][CORE][CONNECT][TESTS] Remove override of deprecated method `SparkThrowable#getErrorClass` in Spark code [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/04 05:36:41 UTC, 2 replies.
- Re: [PR] [SPARK-54049][BUILD][4.0] Shade com.google.thirdparty package to fix Guava class conflicts in spark 4.0 [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/11/04 06:13:07 UTC, 2 replies.
- [PR] [SPARK-54175][Geo][CONNECT] Add Geography and Geometry types to Spark Connect proto [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/11/04 07:32:32 UTC, 2 replies.
- [PR] [WIP][SPARK-XXXXX][BUILD] Guava dependency governance [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/04 07:52:51 UTC, 0 replies.
- Re: [PR] [SPARK-54142][Geo][SQL][PYTHON] Implement the st_srid function in Scala and PySpark [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/11/04 07:56:47 UTC, 2 replies.
- Re: [PR] [SPARK-53337] XSS: Ensure the application name in historypage get escaped [spark] - posted by "Chhida (via GitHub)" <gi...@apache.org> on 2025/11/04 08:35:28 UTC, 0 replies.
- [PR] [SPARK-54177][BUILD] Upgrade gRPC 1.76.0 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/04 08:57:58 UTC, 10 replies.
- Re: [PR] [SPARK-53882][CONNECT][DOCS] Add documentation comparing behavioral differences between Spark Connect and Spark Classic [spark] - posted by "tsarid (via GitHub)" <gi...@apache.org> on 2025/11/04 09:10:18 UTC, 5 replies.
- [PR] [SPARK-54178][SQL] Improve error for ResolveSQLOnFile [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/11/04 14:04:49 UTC, 3 replies.
- [PR] [WIP][SPARK-53924] Reload DSv2 tables in views created using plans on each view access [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/11/04 15:36:51 UTC, 3 replies.
- Re: [PR] [SPARK-53967][PYTHON] Avoid intermediate pandas dataframe creation in `df.toPandas` [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/11/04 16:00:41 UTC, 2 replies.
- Re: [PR] [SPARK-54177][BUILD] Upgrade gRPC to 1.76 and protobuf to 6.33 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/04 17:18:29 UTC, 11 replies.
- [PR] [SPARK-54078][SS] New test for StateStoreSuite SPARK-40492: maintenance before unload [spark] - posted by "liviazhu (via GitHub)" <gi...@apache.org> on 2025/11/04 17:45:42 UTC, 1 replies.
- Re: [PR] [SPARK-54063] Trigger snapshot for next batch when upload lag [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2025/11/04 18:02:17 UTC, 6 replies.
- Re: [PR] [SPARK-54170][CORE] Use StructuredLogging message in Scala side [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/04 18:02:43 UTC, 1 replies.
- [PR] [SPARK-53595][doc] Add see-also for XML functions [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/11/04 18:03:19 UTC, 0 replies.
- [PR] [DRAFT][Geo][SQL] Implement the ST_GeogFromWKB expression in SQL [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/11/04 18:28:16 UTC, 0 replies.
- Re: [PR] [SPARK-54078][SS] New test for `StateStoreSuite SPARK-40492: maintenance before unload` and remove infra from old test [spark] - posted by "liviazhu (via GitHub)" <gi...@apache.org> on 2025/11/04 19:08:20 UTC, 1 replies.
- Re: [PR] [SPARK-54162][Geo][SQL] Allow casting from GeographyType to GeometryType [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/11/04 19:09:50 UTC, 3 replies.
- Re: [PR] [SPARK-51069][SQL] Add big-endian support to UnsafeRowUtils.validateStructuralIntegrityWithReasonImpl [spark] - posted by "jonathan-albrecht-ibm (via GitHub)" <gi...@apache.org> on 2025/11/04 20:49:24 UTC, 0 replies.
- [PR] [SPARK-54180] Override the toString of BinaryFileFormat [spark] - posted by "brkyvz (via GitHub)" <gi...@apache.org> on 2025/11/04 21:41:47 UTC, 0 replies.
- Re: [PR] [SPARK-53797][SQL] Improve performance of maxBytesPerTrigger for file stream sources [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2025/11/04 21:52:25 UTC, 0 replies.
- [PR] [SPARK-54181][TESTS] Fix typo withConvertMetastore [spark] - posted by "kazuyukitanimura (via GitHub)" <gi...@apache.org> on 2025/11/04 22:00:20 UTC, 0 replies.
- Re: [PR] [SPARK-53996][SQL] Improve InferFiltersFromConstraints to infer filters from complex join expressions [spark] - posted by "vanekjar (via GitHub)" <gi...@apache.org> on 2025/11/04 22:32:07 UTC, 0 replies.
- [PR] [WIP][SPARK-54179][SQL] Add Native Support for Apache Tuple Sketches [spark] - posted by "cboumalh (via GitHub)" <gi...@apache.org> on 2025/11/05 00:42:47 UTC, 1 replies.
- Re: [PR] [SPARK-53731][PYTHON] Update the type hints of iterator APIs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/05 01:07:58 UTC, 1 replies.
- Re: [PR] [SPARK-54173][K8S] Add support for Deployment API on K8s [spark] - posted by "ForVic (via GitHub)" <gi...@apache.org> on 2025/11/05 01:10:30 UTC, 7 replies.
- Re: [PR] [SDP][SPARK-52463] Add support for cluster_by in Python Pipelines APIs [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/11/05 01:14:53 UTC, 11 replies.
- Re: [PR] [SPARK-54181][SQL][TESTS] Fix typo `withConvertMetastore` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/05 01:57:46 UTC, 1 replies.
- [PR] [SPARK-54184][K8S] Support `spark.kubernetes.executor.deletedExecutorsCacheTTLSeconds` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/05 02:56:22 UTC, 3 replies.
- [PR] [SPARK-54186][PYTHON][TESTS] Fix doctests for `PandasCogroupedOps.applyInPandas` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/05 03:35:21 UTC, 4 replies.
- [PR] [SPARK-54185][SHUFFLE] Deprecated spark.shuffle.server.chunkFetchHandlerThreadsPercent [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/11/05 03:35:39 UTC, 2 replies.
- [PR] [SPARK-54187][PYTHON][CONNECT] Get all configs in a batch in toPandas [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/05 03:38:03 UTC, 2 replies.
- [PR] [SPARK-54188][K8S] Improve `ExecutorPodsWatchSnapshotSource` to watch only active executors [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/05 03:44:30 UTC, 4 replies.
- [PR] [SPARK-54189][K8S] Remove `spark.kubernetes.pyspark.pythonVersion` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/05 04:15:25 UTC, 5 replies.
- Re: [PR] [SPARK-54190][BUILD] Guava dependency governance [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/05 05:36:38 UTC, 19 replies.
- Re: [PR] [SPARK-53595][DOCS][PYTHON][SQL] Add see-also for XML functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/05 05:37:33 UTC, 1 replies.
- Re: [PR] [SPARK-54184][K8S] Support `spark.kubernetes.executor.deletedExecutorsCacheTimeout` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/05 05:56:39 UTC, 2 replies.
- [PR] [SPARK-54191][SDP] Add StandaloneFlowDetails Proto [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/11/05 06:28:14 UTC, 2 replies.
- [PR] [WIP][SPARK-53823] Implement allow list for real time mode [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2025/11/05 06:41:31 UTC, 3 replies.
- [PR] [SPARK-54192][BUILD] Upgrade roaringbitmap from 1.3.0 to 1.5.3 [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/11/05 07:13:32 UTC, 16 replies.
- [PR] [SPARK-54193][SHUFFLE] Deprecated spark.shuffle.server.finalizeShuffleMergeThreadsPercent [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/11/05 07:23:05 UTC, 2 replies.
- Re: [PR] [SPARK-54176][Geo][PYTHON] Introduce Geography and Geometry data types to PySpark Connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/05 07:44:45 UTC, 5 replies.
- Re: [PR] [SPARK-54147][SQL] Set OMP_NUM_THREADS to spark.task.cpus by default in BaseScriptTransformationExec [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2025/11/05 09:42:37 UTC, 1 replies.
- [PR] [SPARK-54194] Spark Connect Proto Plan Compression [spark] - posted by "xi-db (via GitHub)" <gi...@apache.org> on 2025/11/05 10:20:59 UTC, 0 replies.
- [PR] Add base session created in SparkConnectService [spark] - posted by "garlandz-db (via GitHub)" <gi...@apache.org> on 2025/11/05 10:22:00 UTC, 15 replies.
- Re: [PR] [SPARK-54194][CONNECT] Spark Connect Proto Plan Compression [spark] - posted by "vicennial (via GitHub)" <gi...@apache.org> on 2025/11/05 13:26:53 UTC, 12 replies.
- Re: [PR] [SPARK-54180][SQL] Override the toString of BinaryFileFormat [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/05 16:20:37 UTC, 1 replies.
- [PR] [SPARK-47010][K8S] Support csi driver for volume type [spark] - posted by "zgzzbws (via GitHub)" <gi...@apache.org> on 2025/11/05 16:56:38 UTC, 6 replies.
- Re: [PR] [SPARK-54169][Geo][SQL] Introduce Geography and Geometry types in Arrow writer [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/11/05 17:27:46 UTC, 6 replies.
- [PR] [WIP][Spark-54182] avoid intermedia dataframe creation in non-arrow codepath of `df.toPandas` [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/11/05 17:45:20 UTC, 0 replies.
- Re: [PR] [SPARK-54191][SDP] Add once to Defineflow Proto [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/11/05 19:23:16 UTC, 2 replies.
- [PR] ExecutorsPodsLifecycleManager: do not call delete requests if the deletionTimestamp is set on the Pod [spark] - posted by "atosatto (via GitHub)" <gi...@apache.org> on 2025/11/05 19:25:34 UTC, 0 replies.
- [PR] [WIP][SPARK-54198][SQL] Delete Kubernetes executor pods only once per event processing interval [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/11/05 19:46:04 UTC, 8 replies.
- [PR] [SPARK-54199][SQL] Add DataFrame API support for new KLL quantiles sketch functions [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2025/11/05 19:55:58 UTC, 15 replies.
- [PR] [MINOR][DOCS] Replace pyspark[connect] with pyspark-client in the Connect overview [spark] - posted by "gerashegalov (via GitHub)" <gi...@apache.org> on 2025/11/05 20:34:14 UTC, 4 replies.
- [PR] [SPARK-54197][K8S] Improve `ExecutorsPodsLifecycleManager` not to request to delete if `deletionTimestamp` exists [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/05 20:48:10 UTC, 11 replies.
- [PR] [SPARK-54200][SS] Call close() against underlying InputPartition when LowLatencyReaderWrap.close() is called [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/11/05 21:04:10 UTC, 8 replies.
- Re: [PR] [SPARK-54117][SS] Throw better error to indicate that TWS is only supported with RocksDB state store provider [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/11/05 21:19:30 UTC, 2 replies.
- Re: [PR] [SDP] Allow full-refresh-all with dp.create_sink (and no flows) [spark] - posted by "jaceklaskowski (via GitHub)" <gi...@apache.org> on 2025/11/05 21:20:18 UTC, 2 replies.
- Re: [PR] [SDP] typo hunting and code (re)formatting [spark] - posted by "jaceklaskowski (via GitHub)" <gi...@apache.org> on 2025/11/05 21:28:31 UTC, 3 replies.
- [PR] [SPARK-54202][Geo][SQL] Allow casting from GeometryType(srid) to GeometryType(ANY) [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/11/05 22:49:41 UTC, 3 replies.
- [PR] [SPARK-54201][Geo][SQL] Allow casting from GeographyType(srid) to GeographyType(ANY) [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/11/05 22:50:52 UTC, 5 replies.
- [PR] [SPARK-54101][Geo][FOLLOWUP] Re-enable Scala/Python parity check for ST functions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/11/05 22:58:18 UTC, 2 replies.
- Re: [PR] [SPARK-52444][SQL][CONNECT] Add support for Variant/Char/Varchar Literal [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/06 00:28:26 UTC, 1 replies.
- Re: [PR] [SPARK-52020][TEST] Build hive-test-udfs.jar from source [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/06 00:28:28 UTC, 1 replies.
- [PR] [SPARK-54204][INFRA] Run `build_branch40*.yml` every two days [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/06 02:58:55 UTC, 6 replies.
- Re: [PR] [BUILD] Upgrade `RoaringBitmap` to 1.5.2 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/06 03:11:52 UTC, 0 replies.
- [PR] [SPARK-54211][PYTHON][DOCS] Update exmple of mapInArrow to use arrow builtin function [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/06 03:42:52 UTC, 5 replies.
- [PR] [SPARK-54212][PYTHON][DOCS] Fix the doctest of PandasGroupedOpsMixin.applyInArrow [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/06 04:04:52 UTC, 2 replies.
- [PR] [SPARK-54213][PYTHON][CONNECT] Remove Python 3.9 from Spark Connect [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/06 04:48:23 UTC, 3 replies.
- [PR] [SPARK-54214][INFRA] Increase pyspark job execution time to 150 minutes on MacOS [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/06 05:06:37 UTC, 1 replies.
- Re: [PR] [SPARK-34234][SQL] Remove TreeNodeException that didn't work [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/06 05:24:17 UTC, 4 replies.
- [PR] [SPARK-54215][SQL] Add the SessionStateHelper trait to FilePartition [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/11/06 05:48:25 UTC, 2 replies.
- [PR] [SPARK-54216] Fix cache refresh for DataSource V2 tables with immutable Table instances [spark] - posted by "vitaliili-db (via GitHub)" <gi...@apache.org> on 2025/11/06 06:05:40 UTC, 0 replies.
- [PR] [SPARK-54217] Synchronize PythonRunner's MonitorThread kill decision [spark] - posted by "st-tran (via GitHub)" <gi...@apache.org> on 2025/11/06 06:35:50 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-54198][K8S] Delete Kubernetes executor pods only once per event processing interval [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/11/06 07:19:15 UTC, 2 replies.
- [PR] [SPARK-54218][PYTHON][SQL][TESTS] Add integrated tests for Scalar Pandas Iterator UDF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/06 07:41:27 UTC, 14 replies.
- Re: [PR] [SPARK-53944][K8S] Support `spark.kubernetes.executor.useDriverPodIP` [spark] - posted by "littlexyw (via GitHub)" <gi...@apache.org> on 2025/11/06 09:07:42 UTC, 4 replies.
- [PR] [MINOR][BUILD] Upload test reports generated by the surefire plug-in too [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/11/06 09:34:32 UTC, 0 replies.
- [PR] [SPARK-54177][BUILD][FOLLOWUP] Exclude Guava from connect-common shading artifacts [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/06 10:16:15 UTC, 1 replies.
- [PR] [SPARK-54219][CORE] Driver can't create thread causing ContextCleaner… [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2025/11/06 10:27:56 UTC, 1 replies.
- Re: [PR] [SPARK-54219][CORE] Driver can't create thread causing ContextCleaner stuck and stuck stop process [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2025/11/06 10:30:56 UTC, 28 replies.
- Re: [PR] [SPARK-54177][BUILD][FOLLOWUP] Restore Guava exclusion from connect-common shading artifacts [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/06 12:51:42 UTC, 1 replies.
- Re: [PR] [SPARK-54198][K8S] Delete Kubernetes executor pods only once per event processing interval [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/06 15:36:38 UTC, 3 replies.
- [PR] [SPARK-54157][SQL] Fix refresh of DSv2 tables in Dataset [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/11/06 15:51:11 UTC, 36 replies.
- [PR] [SPARK-54221][INFRA] Add PyPy 3.11 GitHub Action job [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/06 16:23:34 UTC, 4 replies.
- Re: [PR] [SPARK-53823][SS] Implement allow list for real time mode [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/11/06 16:43:38 UTC, 20 replies.
- [PR] [SPARK-54220][SQL] NullType/VOID/UNKNOWN Type Support in Parquet [spark] - posted by "ZiyaZa (via GitHub)" <gi...@apache.org> on 2025/11/06 16:43:45 UTC, 17 replies.
- Re: [PR] [SPARK-53652][SQL]Codegen for MergeRowExec [spark] - posted by "karuppayya (via GitHub)" <gi...@apache.org> on 2025/11/06 17:40:05 UTC, 0 replies.
- Re: [PR] [SPARK-53573][SQL] IDENTIFIER everywhere [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2025/11/06 19:00:33 UTC, 32 replies.
- [PR] [SPARK-53944][K8S][CORE][FOLLOWUP] Fix SparkEnv to use `DRIVER_BIND_ADDRESS` in case of `useDriverPodIP=true` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/06 20:48:19 UTC, 23 replies.
- [PR] [MINOR][TESTS][DOCS] Make bfill/backfill tests not dependent on natural order [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/11/06 23:25:10 UTC, 2 replies.
- [PR] [SPARK-XXXXX][SQL] Extend Arrow compression to Pandas UDF [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/11/07 00:26:48 UTC, 0 replies.
- Re: [PR] [SPARK-52867][SQL] Remove redundant GetTimestamp [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/07 00:28:43 UTC, 1 replies.
- Re: [PR] [SPARK-52226] [SQL] Fix unusual equality checks in three operators [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/07 00:28:45 UTC, 1 replies.
- Re: [PR] [SPARK-54227][INFRA] Upload test reports generated by the surefire plug-in too [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/11/07 02:15:19 UTC, 2 replies.
- Re: [PR] [SPARK-54226][SQL] Extend Arrow compression to Pandas UDF [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/07 02:31:26 UTC, 12 replies.
- [PR] [SPARK-54229][PYTHON] Make PySparkLogger in UDFs store one log entry per log function call [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/11/07 02:48:13 UTC, 2 replies.
- [PR] [SPARK-54228][K8S][CORE][FOLLOWUP] Remove Driver's K8s Service in case of useDriverPodIP=true [spark] - posted by "littlexyw (via GitHub)" <gi...@apache.org> on 2025/11/07 03:25:59 UTC, 0 replies.
- [PR] [CORE][SQL] Clean up the usage of obsolete/deprecated selenium API [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/07 03:27:55 UTC, 0 replies.
- Re: [PR] [SPARK-53289][SQL] Invoke cancelJobsWithTag before start passing the SparkListenerSQLExecutionEnd event to prevent execution of canceled tasks. [spark] - posted by "JkSelf (via GitHub)" <gi...@apache.org> on 2025/11/07 03:33:18 UTC, 3 replies.
- Re: [PR] [SPARK-54230][CORE][SQL][TESTS] Clean up the usage of deprecated selenium API [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/07 03:52:07 UTC, 3 replies.
- Re: [PR] [SPARK-54228][K8S][CORE] Remove Driver's K8s Service in case of useDriverPodIP=true [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/07 03:54:47 UTC, 3 replies.
- [PR] [SPARK-54231][SDP] Fill gaps in SDP docs [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/11/07 04:24:56 UTC, 2 replies.
- [PR] [SPARK-54232][Geo][CONNECT] Enable Arrow serialization for Geography and Geometry types [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/11/07 05:09:42 UTC, 2 replies.
- [PR] [SPARK-54223] Add task context and data metrics to Python runner logs [spark] - posted by "Nishanth28 (via GitHub)" <gi...@apache.org> on 2025/11/07 05:21:20 UTC, 0 replies.
- [PR] [SPARK-54233][PYTHON][DOCS] Fix the doctest of cogrouped applyInArrow and applyInPandas [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/07 05:28:44 UTC, 2 replies.
- [PR] [SPARK-54234][PYTHON][CONNECT] Not need to attach PlanId in grouping column names in df.groupBy [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/07 06:08:33 UTC, 2 replies.
- [PR] [SPARK-53666][INFRA] Use absolute output path for `generate-llms-txt.py` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/07 06:09:00 UTC, 0 replies.
- [PR] Revert "[SPARK-54218][PYTHON][SQL][TESTS] Add integrated tests for Scalar Pandas Iterator UDF" [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/07 06:27:59 UTC, 2 replies.
- Re: [PR] [SPARK-53666][INFRA][FOLLOWUP] Use absolute output path for `generate-llms-txt.py` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/07 06:42:51 UTC, 2 replies.
- [PR] [SPARK-54235][UI][DOCS] Upgrade jQuery from 3.5.1 to 3.7.1 [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/11/07 06:55:21 UTC, 3 replies.
- [PR] Reapply "[SPARK-54218][PYTHON][SQL][TESTS] Add integrated tests for Scalar Pandas Iterator UDF" [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/07 07:17:46 UTC, 0 replies.
- Re: [PR] [SPARK-52767][SQL] Change maxRows and maxRowsPerPartition to lazy val [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2025/11/07 09:38:51 UTC, 1 replies.
- [PR] [SPARK-54238][CORE][TESTS] Clean up unused `private val regenerateCommand` from `SparkThrowableSuite` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/07 09:39:19 UTC, 2 replies.
- [PR] [SPARK-54239][BUILD] Bump Guava 33.4.8 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/07 10:10:40 UTC, 4 replies.
- [PR] [SPARK-54240] Translate get array item catalyst expression to connector expression [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2025/11/07 12:42:29 UTC, 12 replies.
- [PR] [SPARK-53525][CONNECT][FOLLOWUP] Spark Connect ArrowBatch Result Chunking - Allow io.grpc classes in Spark Connect testing [spark] - posted by "xi-db (via GitHub)" <gi...@apache.org> on 2025/11/07 14:41:52 UTC, 0 replies.
- Re: [PR] [SPARK-53525][CONNECT][FOLLOWUP] Allow io.grpc classes in Spark Connect testing [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/07 15:49:06 UTC, 2 replies.
- [PR] [SPARK-54241][INFRA] Enable `NOLINT_ON_COMPILE` for all PySpark GitHub Action jobs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/07 16:04:14 UTC, 4 replies.
- [PR] [SPARK-54242][BUILD] Skip `Checkstyle` if `NOLINT_ON_COMPILE` is true [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/07 16:39:01 UTC, 4 replies.
- [PR] [SPARK-54243][Geo][SpatialSQL] Introduce type coercion support for GEOGRAPHY data types [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/11/07 19:57:42 UTC, 0 replies.
- [PR] [SPARK-54244][Geo][SpatialSQL] Introduce type coercion support for GEOMETRY data types [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/11/07 20:14:48 UTC, 0 replies.
- Re: [PR] [SPARK-54046][INFRA] Upgrade PyArrow to 22.0.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/07 21:17:34 UTC, 2 replies.
- [PR] [MINOR][INFRA] Fix the install version comment to Python 3.10 in python-minimum Dockerfile [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/07 22:19:20 UTC, 4 replies.
- [PR] [SPARK-53484][CONNECT] Supports Decimal type data in SparkConnectResultSet. [spark] - posted by "cty123 (via GitHub)" <gi...@apache.org> on 2025/11/07 23:17:56 UTC, 1 replies.
- [PR] [SPARK-54245][INFRA] Install `mlflow` at Python 3.14 Docker image [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/07 23:40:26 UTC, 4 replies.
- [PR] [SPARK-54246][PYTHON][DOCS] Add the user guide for python worker logging [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/11/08 00:20:53 UTC, 3 replies.
- [PR] [WIP][SPARK-47031] Union determinism fix [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2025/11/08 00:24:23 UTC, 7 replies.
- Re: [PR] [SPARK-52978][SQL] Make FileFormatWriter customizable via SQL configuration [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/08 00:26:11 UTC, 1 replies.
- [PR] [SPARK-54211][PYTHON][TESTS][FOLLOWUP] Disable `mapInArrow` doc test back [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/08 02:21:41 UTC, 1 replies.
- Re: [PR] [SPARK-54243][SQL] Introduce type coercion support for GEOGRAPHY data types [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/08 03:42:53 UTC, 0 replies.
- Re: [PR] [SPARK-54244][SQL] Introduce type coercion support for GEOMETRY data types [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/08 03:43:44 UTC, 0 replies.
- [PR] [SPARK-49862][INFRA][FOLLOWUP] Update `dev/infra/Dockerfile` too [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/08 03:53:31 UTC, 4 replies.
- [PR] [SPARK-53525][CONNECT][FOLLOWUP][4.1] Spark Connect ArrowBatch Result Chunking - Scala Client [spark] - posted by "xi-db (via GitHub)" <gi...@apache.org> on 2025/11/08 10:00:43 UTC, 2 replies.
- Re: [PR] [SPARK-54244][Geo][SQL] Introduce type coercion support for GEOMETRY data types [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/11/08 10:06:11 UTC, 2 replies.
- Re: [PR] [SPARK-52621][SQL] Cast TIME to/from VARIANT [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/08 15:47:36 UTC, 3 replies.
- [PR] [SPARK-53944][K8S][CORE][FOLLOWUP] Override DRIVER_HOST_ADDRESS instead of SparkEnv when useDriverPodIP is true [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/08 17:29:05 UTC, 0 replies.
- Re: [PR] [SPARK-53944][K8S][CORE][FOLLOWUP] Override DRIVER_HOST_ADDRESS in SparkContext instead of SparkEnv when useDriverPodIP is true [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/08 17:45:09 UTC, 6 replies.
- Re: [PR] [SPARK-54205][CONNECT] Supports Decimal type data in SparkConnectResultSet. [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/08 18:15:53 UTC, 11 replies.
- Re: [PR] [SPARK-53038][SQL][HIVE] Call initialize only once per GenericUDF instance [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/09 00:30:36 UTC, 1 replies.
- Re: [PR] [SPARK-53022][TESTS] Add MemoryConsumerBenchmark [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/09 00:30:38 UTC, 1 replies.
- [PR] [SPARK-54259] Downgrade "Shutdown hook called" messages from INFO to DEBUG [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/11/09 14:51:40 UTC, 0 replies.
- [PR] [SPARK-53226][CORE] Make ClosureCleaner work with Java22+ [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/11/09 16:56:12 UTC, 2 replies.
- [PR] [SPARK-54260][CORE][K8S] Unify K8s cluster checks to use the single regex via `SparkMasterRegex.isK8s` methods [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/09 19:52:55 UTC, 10 replies.
- [PR] [SPARK-54261][SQL][4.1] Disable `spark.sql.scripting.enabled` by default in Apache Spark 4.1.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/09 21:39:00 UTC, 4 replies.
- Re: [PR] [SPARK-53060] Test to showcase Aggregate followed by ORDER BY doesn't preserve orders [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/10 00:30:06 UTC, 1 replies.
- Re: [PR] [SPARK-52819][SQL] Making KryoSerializationCodec serializable to fix java.io.NotSerializableException errors in various use cases [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/10 00:30:11 UTC, 3 replies.
- Re: [PR] [SPARK-54259][CORE] Downgrade "Shutdown hook called" messages from INFO to DEBUG [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/10 00:52:33 UTC, 4 replies.
- [PR] [SPARK-54263][INFRA] Fix `run-in-container` script to use Python 3.11 instead of 3.9 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/10 01:25:30 UTC, 3 replies.
- [PR] [SPARK-54264][SS]DeDup Operator can use RocksDB's keyExists() [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2025/11/10 01:31:38 UTC, 4 replies.
- [PR] [SPARK-54265][INFRA] Use Python 3.11 in `spark-rm` Dockerfile [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/10 01:56:11 UTC, 1 replies.
- [PR] [SPARK-54226][SQL][FOLLOWUP] Remove zstd compression level value check and update config names [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/11/10 02:09:50 UTC, 4 replies.
- [PR] [SPARK-54267][BUILD] Upgrade actions/setup-node@v4 to v6 [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/11/10 03:21:07 UTC, 3 replies.
- Re: [PR] [SPARK-53659][SQL] Infer Variant shredding schema when writing to Parquet [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/10 03:38:27 UTC, 2 replies.
- Re: [PR] [SPARK-52214][PYTHON] Arrow UDF for aggregation [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/10 03:44:58 UTC, 4 replies.
- [PR] [SPARK-54269][PYTHON] Upgrade `cloudpickle` to 3.1.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/10 04:05:12 UTC, 1 replies.
- Re: [PR] [SPARK-54205][CONNECT] Supports Decimal type data in SparkConnectResultSet [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/10 04:41:49 UTC, 8 replies.
- Re: [PR] [SPARK-54269][PYTHON] Upgrade `cloudpickle` to 3.1.2 for Python 3.14 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/10 05:27:55 UTC, 3 replies.
- [PR] [SPARK-54211][FOLLOW-UP] Fix doctests of mapInArrow [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/10 05:50:24 UTC, 0 replies.
- [PR] [SPARK-54271][UI][BUILD] Upgrade node version for UI test module to the latest LTS 24.11.0 [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/11/10 06:13:22 UTC, 3 replies.
- [PR] [SPARK-54065][PYTHON][TESTS] Enable `test_in_memory_data_source` in Python 3.14 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/10 06:49:54 UTC, 4 replies.
- [PR] SPARK-54272 Add aggTime for SortAggregateExec [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2025/11/10 07:02:58 UTC, 0 replies.
- [PR] [SPARK-54273][UI][TESTS] Upgrade jest to 30.0.0 [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/11/10 07:37:08 UTC, 3 replies.
- Re: [PR] [SPARK-53226][SPARK-52088][CORE] Make ClosureCleaner work with Java22+ [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/11/10 08:19:40 UTC, 9 replies.
- [PR] [SPARK-54065][FOLLOWUP] [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/11/10 08:48:55 UTC, 0 replies.
- Re: [PR] [SPARK-54065][PYTHON][TESTS][FOLLOWUP] Remove unused import module from `test_python_datasource.py` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/11/10 08:54:54 UTC, 3 replies.
- Re: [PR] [SPARK-54272][SQL] Add aggTime for SortAggregateExec [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2025/11/10 09:29:44 UTC, 11 replies.
- [PR] Revert "[SPARK-54218][PYTHON][SQL][TESTS] Add integrated tests for Scalar Pandas Iterator UDF" Again [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/10 10:04:03 UTC, 2 replies.
- Re: [PR] [SPARK-54211][PYTHON][FOLLOW-UP] Fix doctests of mapInArrow [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/10 10:26:12 UTC, 1 replies.
- [PR] [SPARK-54275] Remove unused functions from `pipeline` module [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/10 10:29:38 UTC, 0 replies.
- [PR] [SPARK-53917][CONNECT] Support large local relations - follow-ups [spark] - posted by "khakhlyuk (via GitHub)" <gi...@apache.org> on 2025/11/10 10:49:05 UTC, 8 replies.
- [PR] [SPARK-54277][INFRA] Make `dev/run-tests` to ban `Python 3.9` and older versions [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/10 16:36:14 UTC, 3 replies.
- [PR] [SPARK-54278][PYTHON][TESTS] Simplify `pyspark/util.py` doctests by removing Python 3.9+ condition [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/10 16:45:20 UTC, 3 replies.
- Re: [PR] [SPARK-54217][PYTHON] Synchronize PythonRunner's MonitorThread kill decision [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/11/10 16:51:10 UTC, 0 replies.
- [PR] [SPARK-54279][CONNECT] Fix empty observation results caused by slow metrics processing [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/11/10 17:22:17 UTC, 2 replies.
- [PR] [SPARK-54281][SQL] Support casting from Numeric types to Time type [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/11/10 17:33:34 UTC, 0 replies.
- Re: [PR] [SPARK-54116][SQL] Add off-heap mode support for LongHashedRelation [spark] - posted by "zhztheplayer (via GitHub)" <gi...@apache.org> on 2025/11/10 17:49:50 UTC, 20 replies.
- Re: [PR] [SPARK-54275][SQL] Clean up unused code from `pipeline` module [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/10 17:58:59 UTC, 2 replies.
- [PR] [SPARK-54282][BUILD] Read bom version from pom in SBT [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/11/10 18:17:36 UTC, 4 replies.
- [PR] [SPARK-54183] remove one intermediate temp data frame [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/11/10 19:13:22 UTC, 0 replies.
- [PR] [SPARK-54285][PYTHON] Cache timezone info to avoid expensive timestamp conversion [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/10 19:35:01 UTC, 37 replies.
- [PR] [SPARK-54287][PYTHON] Add Python 3.14 support in `pyspark-client` and `pyspark-connect` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/10 19:42:40 UTC, 5 replies.
- [PR] [SPARK-54288][INFRA] Add a daily Python 3.14 CI for branch-4.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/10 19:54:13 UTC, 5 replies.
- [PR] [SPARK-51518][SQL] Support | as an alternative to |> for the SQL pipe operator token [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2025/11/10 22:55:16 UTC, 10 replies.
- [PR] [SPARK-54291][BUILD] Upgrade Jackson to 2.20.1 [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/11/10 23:18:24 UTC, 2 replies.
- [PR] [SPARK-54290][SS] Skip checksum creation if path already exists without checksum [spark] - posted by "dylanwong250 (via GitHub)" <gi...@apache.org> on 2025/11/10 23:42:41 UTC, 4 replies.
- [PR] [PYTHON] Add the capability to use viztracer on pyspark daemon/workers [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/11 00:01:22 UTC, 6 replies.
- [PR] commit [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2025/11/11 00:40:09 UTC, 0 replies.
- Re: [PR] [SPARK-54292][SQL] Create a configuration to support aggregation in |> SELECT pipe operators [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2025/11/11 00:56:05 UTC, 11 replies.
- [PR] [SPARK-54270][CONNECT] SparkConnectResultSet get* methods should call checkOpen and check index boundary [spark] - posted by "cty123 (via GitHub)" <gi...@apache.org> on 2025/11/11 01:41:17 UTC, 28 replies.
- Re: [PR] [SPARK-53882][CONNECT] Add optional sqlstate to sparkthrowables [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/11/11 02:23:39 UTC, 3 replies.
- Re: [PR] [SPARK-53882][CONNECT] Always set a sql state in spark connect client [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/11/11 02:28:12 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-54285][PYTHON] Cache timezone info to avoid expensive timestamp conversion [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/11 02:48:16 UTC, 4 replies.
- Re: [PR] [SPARK-54116][SQL] Add off-heap mode support for LongHashedRelation to avoid JVM heap OOMs under off-heap memory mode [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/11/11 02:59:34 UTC, 1 replies.
- [PR] [SPARK-54294][CONNECT] Normalize Connect server printed IP address [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/11 03:00:30 UTC, 5 replies.
- [PR] [SPARK-54295][INFRA] Remove redundant ASFLv2 full-text in NOTICE [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/11/11 03:17:33 UTC, 1 replies.
- [PR] [SPARK-54296][PYTHON][TESTS] Optimize the arrow batch slicing tests for cogrouped [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/11 03:27:15 UTC, 1 replies.
- [PR] [SPARK-54298][PYTHON][DOCS] Fix doctest of UDFRegistration [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/11 03:32:40 UTC, 1 replies.
- [PR] [SPARK-54299][SQL] Fix the wrong example query in `WindowGroupLimit` [spark] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2025/11/11 03:40:56 UTC, 9 replies.
- [PR] [SPARK-54300][PYTHON] Optimize Py4J config calls in df.toPandas [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/11 07:11:00 UTC, 0 replies.
- [PR] [SPARK-54113][CONNECT] Support getTables for SparkConnectDatabaseMetaData [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/11 07:25:54 UTC, 13 replies.
- Re: [PR] [SPARK-54183][SQL][PYTHON][CONNECT] Avoid one intermediate temp data frame during spark connect toPandas() [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/11 07:40:20 UTC, 0 replies.
- Re: [PR] [SPARK-54182][SQL][PYTHON] Optimize non-arrow conversion of `df.toPandas` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/11 07:46:39 UTC, 6 replies.
- [PR] [SPARK-54301][SQL][TESTS] Enhance Spark SQL test suites for easier integration with other projects [spark] - posted by "IrenaPan (via GitHub)" <gi...@apache.org> on 2025/11/11 09:27:26 UTC, 3 replies.
- [PR] [SPARK-54303][SQL] Canonicalize error condition MISSING_CATALOG_ABILITY [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/11 10:41:28 UTC, 3 replies.
- [PR] [SPARK-54304][SQL][TESTS] MergeScalarSubqueriesSuite code cleanup [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/11/11 11:27:05 UTC, 3 replies.
- Re: [PR] [SPARK-53898][CORE] Fix race conditions between query cancellation and task completion triggered by eager shuffle cleanup [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/11/11 14:52:44 UTC, 3 replies.
- [PR] [SPARK-54280] Require pipeline checkpoint storage dir to be absolute path [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/11/11 15:00:50 UTC, 0 replies.
- [PR] [SPARK-XXXXX][SQL][PYSPARK] Add admission control support to Python DataSource streaming API [spark] - posted by "jiteshsoni (via GitHub)" <gi...@apache.org> on 2025/11/11 19:17:07 UTC, 1 replies.
- Re: [PR] [SPARK-XXXXX][SQL][PYTHON] Add admission control support to Python DataSource streaming API [spark] - posted by "jiteshsoni (via GitHub)" <gi...@apache.org> on 2025/11/11 19:28:04 UTC, 0 replies.
- [PR] [SPARK-54297] Optimize tests for iterator of dataframe API in `applyInPandas` [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/11/11 19:30:12 UTC, 0 replies.
- [PR] [WIP][SPARK-54194][CONNECT][FOLLOWUP] Spark Connect Proto Plan Compression - Scala Client [spark] - posted by "xi-db (via GitHub)" <gi...@apache.org> on 2025/11/11 20:22:11 UTC, 1 replies.
- [PR] [SPARK-52439][SQL] Support check constraint with null value [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/11/11 20:51:24 UTC, 3 replies.
- [PR] [SPARK-54306] Annotate Variant columns with Variant logical type annotation [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2025/11/11 21:43:03 UTC, 7 replies.
- [PR] [SPARK-53666][FOLLOWUP] Update generated llms.txt file location [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/11/11 22:20:16 UTC, 5 replies.
- [PR] [SPARK-54307] [SS] Throw an error if streaming query is restarted with stateful op but empty state dir [spark] - posted by "liviazhu (via GitHub)" <gi...@apache.org> on 2025/11/11 22:26:19 UTC, 0 replies.
- [PR] [INFRA] Cancel workflow if a new commit is pushed [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/11 22:54:29 UTC, 16 replies.
- Re: [PR] [SPARK-54307] [SS] Throw an error if streaming query is restarted with stateful op but there is empty state dir [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/11/11 22:58:28 UTC, 3 replies.
- Re: [PR] [SPARK-52578][SQL] Add `numSourceRows` metric for `MergeIntoExec` [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/11/11 23:22:14 UTC, 0 replies.
- Re: [PR] Fix invalid exit codes and enhance CLI validation tools [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/12 00:28:48 UTC, 1 replies.
- Re: [PR] [SPARK-52545][SQL][DOCS] Update string literal docs for quote escaping rules [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2025/11/12 01:24:18 UTC, 6 replies.
- Re: [PR] [SPARK-54295][INFRA] Remove redundant ASFLv2 full-text in `NOTICE-binary` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/12 01:48:49 UTC, 1 replies.
- Re: [PR] [SPARK-54297][PYTHON][SQL][TESTS] Optimize tests for iterator of dataframe API in `applyInPandas` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/12 01:57:29 UTC, 1 replies.
- Re: [PR] [SPARK-54300][PYTHON] Optimize Py4J calls in `df.toPandas` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/12 02:40:27 UTC, 1 replies.
- [PR] [SPARK-54253] Add a guarding config for geospatial support [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/11/12 03:43:17 UTC, 0 replies.
- Re: [PR] [SPARK-54253][Geo][SQL] Add a guarding config for geospatial support [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/12 04:01:22 UTC, 57 replies.
- Re: [PR] [WIP][INFRA] Cancel workflow if a new commit is pushed [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/12 04:20:09 UTC, 3 replies.
- [PR] [SPARK-54207][CONNECT] Supports Date type data in SparkConnectResultSet [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/11/12 04:38:09 UTC, 6 replies.
- Re: [PR] [SPARK-54310][SQL] Add `numSourceRows` metric for `MergeIntoExec` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/12 05:12:56 UTC, 4 replies.
- Re: [PR] [SPARK-53469][SQL] Ability to cleanup shuffle in Thrift server [spark] - posted by "karuppayya (via GitHub)" <gi...@apache.org> on 2025/11/12 05:38:10 UTC, 16 replies.
- [PR] [SPARK-54315][PYTHON][TESTS] Optimize test `ApplyInArrowTests.test_arrow_batch_slicing` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/12 06:23:38 UTC, 5 replies.
- Re: [PR] [SPARK-54183][PYTHON][CONNECT] Avoid one intermediate temp data frame during spark connect toPandas() [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/12 06:34:10 UTC, 1 replies.
- Re: [PR] [SPARK-53209][YARN] Add ActiveProcessorCount JVM option to YARN executor and AM [spark] - posted by "jzhuge (via GitHub)" <gi...@apache.org> on 2025/11/12 06:49:29 UTC, 1 replies.
- [PR] [SPARK-54313][CORE] Add --extra-properties-file option for configuration layering [spark] - posted by "jzhuge (via GitHub)" <gi...@apache.org> on 2025/11/12 08:16:12 UTC, 1 replies.
- [PR] [SPARK-54318][PYTHON][DOCS] Fix doctests in `pyspark.sql.dataframe` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/12 08:24:34 UTC, 2 replies.
- [PR] [SPARK-54319][SQL] BHJ LeftAnti update numOutputRows wrong when codegen is disabled [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2025/11/12 08:48:49 UTC, 5 replies.
- Re: [PR] [SPARK-47836][SQL] Use doubles sketch replace the GK algorithm for ap… [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2025/11/12 10:29:18 UTC, 8 replies.
- [PR] [SPARK-54320][UI] Fix Job DAG overlapping [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/11/12 10:36:47 UTC, 5 replies.
- [PR] [WIP] Refactor code a bit to simplify faulthandler integration extension [spark] - posted by "antban (via GitHub)" <gi...@apache.org> on 2025/11/12 10:57:23 UTC, 2 replies.
- Re: [PR] [SPARK-54194][CONNECT][FOLLOWUP] Spark Connect Proto Plan Compression - Scala Client [spark] - posted by "xi-db (via GitHub)" <gi...@apache.org> on 2025/11/12 15:31:25 UTC, 3 replies.
- Re: [PR] [SPARK-54179][SQL] Add Native Support for Apache Tuple Sketches [spark] - posted by "cboumalh (via GitHub)" <gi...@apache.org> on 2025/11/12 15:54:35 UTC, 24 replies.
- [PR] [MINOR][DOCS] Document minimum executor memory requirement [spark] - posted by "pratham76 (via GitHub)" <gi...@apache.org> on 2025/11/12 16:45:28 UTC, 8 replies.
- [PR] [SPARK-54206][[CONNECT]] Supports BINARY type data in SparkConnectResultSet [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/11/12 17:03:04 UTC, 0 replies.
- Re: [PR] [SPARK-54206][CONNECT] Support BINARY type data in SparkConnectResultSet [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/12 17:04:14 UTC, 8 replies.
- [PR] [SPARK-44571][SQL] Merge subplans with one row result [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/11/12 17:33:40 UTC, 28 replies.
- [PR] Port client-user-context-extensions changes [spark] - posted by "cookiedough77 (via GitHub)" <gi...@apache.org> on 2025/11/12 18:55:31 UTC, 0 replies.
- [PR] [SPARK-54323][PYTHON] Change the way to access logs to TVF instead of system view [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/11/12 20:02:10 UTC, 3 replies.
- Re: [PR] [SPARK-54280][SDP] Require pipeline checkpoint storage dir to be absolute path [spark] - posted by "jaceklaskowski (via GitHub)" <gi...@apache.org> on 2025/11/12 21:21:01 UTC, 11 replies.
- Re: [PR] [SPARK-54324] Add support for client-user-context-extensions [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/11/12 21:38:28 UTC, 5 replies.
- [PR] [SPARK-54325][TESTS] Use custom matcher in ExecutorSuite testThrowable [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/11/12 22:08:46 UTC, 4 replies.
- [PR] [SPARK-XXX][INFRA] Increase build_python_connect job timeout to 150m [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/12 22:11:10 UTC, 1 replies.
- [PR] Jonathan chang data/spark sql [spark] - posted by "SCHJonathan (via GitHub)" <gi...@apache.org> on 2025/11/12 22:56:06 UTC, 5 replies.
- [PR] [SPARK-54326][INFRA] Recover MacOS CIs by installing `zstandard==0.25.0` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/12 23:24:13 UTC, 6 replies.
- [PR] [SPARK-54208][CONNECT] Support TIME type data in SparkConnectResultSet [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/11/13 00:08:32 UTC, 0 replies.
- [PR] [SPARK-53635][SQL] Support Scala UDFs with input args of type Seq[Row] [spark] - posted by "james-willis (via GitHub)" <gi...@apache.org> on 2025/11/13 00:14:33 UTC, 7 replies.
- [PR] [SHUFFLE][WIP]Prototype using remote storage for shuffle [spark] - posted by "karuppayya (via GitHub)" <gi...@apache.org> on 2025/11/13 00:34:14 UTC, 1 replies.
- [PR] [SPARK-54328] Add configurable startupProbe and enhance liveness/readiness probes in Helm chart [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/11/13 01:48:18 UTC, 4 replies.
- Re: [PR] [SPARK-54208][CONNECT] Support TIME type in SparkConnectResultSet [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/13 02:02:36 UTC, 9 replies.
- [PR] [SPARK-54320][UI][4.0] Fix Job DAG overlapping [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/11/13 02:25:47 UTC, 3 replies.
- [PR] [SPARK-54329][INFRA] Use shorter prefix before build name [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/13 03:15:04 UTC, 2 replies.
- [PR] [SPARK-54330][PYTHON] Optimize Py4J calls in `spark.createDataFrame` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/13 03:35:59 UTC, 2 replies.
- Re: [PR] [SPARK-54020] Support `spark.sql(...)` Python API inside query functions for Spark Declarative Pipeline [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/11/13 05:28:40 UTC, 26 replies.
- [PR] [PYTHON][TESTS] Optimize `pyspark.sql.tests.connect.test_connect_plan` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/13 06:49:13 UTC, 0 replies.
- [PR] [SPARK-54332][PYTHON][CONNECT] No need to attach PlanId in grouping column names in rollup/cube/groupingSets [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/13 07:05:41 UTC, 2 replies.
- [PR] [SPARK-54333][BUILD] Upgrade `commons-io` to 2.21.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/13 07:43:17 UTC, 3 replies.
- [PR] [SPARK-53615][PYTHON] Introduce iterator API for Arrow grouped aggregation UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/11/13 10:03:09 UTC, 25 replies.
- [PR] [SPARK-54334] [SQL] Move the validation of subquery expressions under lambda and higher order functions to `SubqueryExpressionInLambdaOrHigherOrderFunctionValidator` [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/11/13 11:26:41 UTC, 7 replies.
- [PR] [SPARK-54194][PYTHON][FOLLOWUP] Fix `connectutils.py` to import `pb2` conditionally [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/13 16:14:52 UTC, 6 replies.
- [PR] [SPARK-54336][SQL] Fix BloomFilterMightContain type check with ScalarSubqueryReference [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/11/13 16:31:53 UTC, 0 replies.
- [PR] Bump com.squareup.okhttp3:okhttp from 3.12.12 to 4.9.2 in /hadoop-cloud [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/11/13 16:36:59 UTC, 3 replies.
- Re: [PR] [SPARK-54336][SQL] Fix BloomFilterMightContain input type check with ScalarSubqueryReference [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/13 16:37:21 UTC, 1 replies.
- [PR] [SPARK-54335][SQL] Reducing skew in the number of file splits per partition [spark] - posted by "marin-ma (via GitHub)" <gi...@apache.org> on 2025/11/13 17:24:37 UTC, 14 replies.
- Re: [PR] [SPARK-54223][PYTHON] Add task context and data metrics to Python runner logs [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/11/13 17:39:12 UTC, 20 replies.
- [PR] [SPARK-50906][SQL] Fix Avro nullability check for reordered struct fields [spark] - posted by "fanyue-xia (via GitHub)" <gi...@apache.org> on 2025/11/13 18:09:54 UTC, 7 replies.
- Re: [PR] [SPARK-54336][SQL] Fix `BloomFilterMightContain` input type check with `ScalarSubqueryReference` [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/11/13 18:20:46 UTC, 4 replies.
- [PR] [SPARK-54338][INFRA] Add pyspark-pandas to coverage run [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/13 19:24:48 UTC, 7 replies.
- [PR] [SPARK-54316][PYTHON] Consolidate GroupPandasIterUDFSerializer with GroupPandasUDFSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/11/13 19:58:13 UTC, 2 replies.
- [PR] [SPARK-54339][SQL] Fix AttributeMap non-determinism [spark] - posted by "kelvinjian-db (via GitHub)" <gi...@apache.org> on 2025/11/13 20:09:29 UTC, 5 replies.
- Re: [PR] [SPARK-54338][INFRA] Enable `pyspark-pandas` in `build_coverage.yml` [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/13 20:34:26 UTC, 5 replies.
- Re: [PR] [SPARK-54331][PYTHON][TESTS] Optimize `pyspark.sql.tests.connect.test_connect_plan` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/13 20:35:35 UTC, 1 replies.
- Re: [PR] [SPARK-54340][PYTHON] Add the capability to use viztracer on pyspark daemon/workers [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/13 21:27:07 UTC, 2 replies.
- [PR] [SPARK-54317][PYTHON][CONNECT] Unify Arrow conversion logic for Classic and Connect toPandas [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/11/13 21:57:38 UTC, 19 replies.
- [PR] [SPARK-54209][CONNECT] Support TIMESTAMP type in SparkConnectResultSet [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/11/13 22:30:40 UTC, 8 replies.
- [PR] [SPARK-54343] Docs for parameter markers, identifier improvements, string coalescing. [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2025/11/13 23:58:38 UTC, 4 replies.
- [PR] [SPARK-54341][SQL] Remember TimeTravelSpec for tables loaded via TableProvider [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/11/14 00:04:52 UTC, 3 replies.
- [PR] [SPARK-54209][CONNECT] [Followup] Fix compiler error in SparkConnectJdbcDataTypeSuite [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/11/14 00:05:37 UTC, 1 replies.
- Re: [PR] [SPARK-54343][DOCS] Docs for parameter markers, identifier improvements, string coalescing. [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/14 00:14:09 UTC, 6 replies.
- Re: [PR] [SPARK-54209][CONNECT] [Followup] Fix linter error in `SparkConnectJdbcDataTypeSuite` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/14 00:18:46 UTC, 2 replies.
- [PR] core [spark] - posted by "cookiedough77 (via GitHub)" <gi...@apache.org> on 2025/11/14 00:46:40 UTC, 0 replies.
- [PR] Zifei feng data/state reader [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2025/11/14 00:48:31 UTC, 1 replies.
- [PR] [SPARK-54324] Testing whether adding dummy message to test_client will break check [spark] - posted by "cookiedough77 (via GitHub)" <gi...@apache.org> on 2025/11/14 00:51:22 UTC, 1 replies.
- [PR] [SPARK-54342][BUILD] Unify scalatest format reports between SBT and maven builds [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/11/14 01:41:01 UTC, 2 replies.
- [PR] [SPARK-54312][CORE] Avoid repeatedly scheduling tasks for SendHeartbeat/WorkDirClean in standalone worker [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2025/11/14 01:55:23 UTC, 9 replies.
- [PR] [SPARK-54344][PYTHON] Kill the worker if flush fails in daemon.py [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/11/14 02:29:18 UTC, 12 replies.
- [PR] [SPARK-54346][SS] Introduce state repartition API and repartition runner [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2025/11/14 05:37:47 UTC, 17 replies.
- [PR] [SPARK-54347][PYTHON] Optimize Py4J calls in classic dataframe [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/14 06:01:08 UTC, 2 replies.
- Re: [PR] [SPARK-53339][CONNECT] Fix an issue which occurs when an operation in pending state is interrupted [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/11/14 06:01:42 UTC, 0 replies.
- [PR] [SPARK-54348] Recover Python unit tests CI by installing `zstandard==0.25.0` [spark] - posted by "SCHJonathan (via GitHub)" <gi...@apache.org> on 2025/11/14 06:11:32 UTC, 0 replies.
- [PR] [SPARK-52751][PYTHON][CONNECT][FOLLOW-UP] Skip eager column name validation in `df.col_name` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/14 07:49:34 UTC, 0 replies.
- [PR] [SPARK-54114][CONNECT] Support getColumns for SparkConnectDatabaseMetaData [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/14 08:14:47 UTC, 1 replies.
- Re: [PR] [SPARK-20236][SQL] dynamic partition overwrite [spark] - posted by "toujours33 (via GitHub)" <gi...@apache.org> on 2025/11/14 08:44:58 UTC, 0 replies.
- Re: [PR] [SPARK-54349] Refactor code a bit to simplify faulthandler integration extension [spark] - posted by "antban (via GitHub)" <gi...@apache.org> on 2025/11/14 08:54:59 UTC, 16 replies.
- Re: [PR] [SPARK-54348][INFRA] Recover Python unit tests CI by installing `zstandard==0.25.0` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/14 10:23:57 UTC, 9 replies.
- [PR] [SPARK-54351][BUILD] Upgrade Dropwizard metrics to 4.2.37 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/14 10:42:34 UTC, 4 replies.
- [PR] [SPARK-54350][STS] SparkGetColumnsOperation ORDINAL_POSITION should be 1-based [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/14 11:50:32 UTC, 0 replies.
- [PR] [SPARK-54352] [SQL] Introduce `SQLConf.canonicalize` to centralize normalization of strings [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/11/14 13:29:30 UTC, 3 replies.
- [PR] [SPARK-54353][CORE][SQL] Make ArrayBasedMapBuilder thread-safe [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/11/14 14:10:47 UTC, 3 replies.
- [PR] [SPARK-54354][SQL] Spark hangs when there's not enough JVM heap memory for broadcast hashed relation [spark] - posted by "zhztheplayer (via GitHub)" <gi...@apache.org> on 2025/11/14 14:16:44 UTC, 0 replies.
- [PR] Bump js-yaml and eslint in /dev [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/11/14 14:36:08 UTC, 3 replies.
- Re: [PR] [SPARK-54353][SQL] Make CollectMetricsExec.collectedMetrics thread-safe [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/11/14 15:48:45 UTC, 2 replies.
- [PR] Jessie.luo date/testing check [spark] - posted by "cookiedough77 (via GitHub)" <gi...@apache.org> on 2025/11/14 16:07:15 UTC, 0 replies.
- [PR] [SPARK-54355][CONNECT] Make `spark.connect.session.planCompression.defaultAlgorithm` to support `NONE` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/14 16:45:49 UTC, 11 replies.
- [PR] [SPARK-54356][SDP] Fix EndToEndAPISuite caused by missing storage root schema [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/11/14 16:55:10 UTC, 2 replies.
- [PR] [SPARK-54358][SDP] Checkpoint dirs collide when streaming tables in different schemas have same name [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/11/14 17:03:54 UTC, 7 replies.
- [PR] [SPARK-54172][SQL][FOLLOW-UP] Review comments [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/11/14 18:05:50 UTC, 1 replies.
- Re: [PR] [SPARK-53924] Reload DSv2 tables in views created using plans on each view access [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/11/14 18:16:13 UTC, 17 replies.
- Re: [PR] [SPARK-54354][SQL] Fix Spark hanging when there's not enough JVM heap memory for broadcast hashed relation [spark] - posted by "zhztheplayer (via GitHub)" <gi...@apache.org> on 2025/11/14 19:46:13 UTC, 19 replies.
- [PR] [SPARK-51518][SQL] Fix Spark version to intended value of 4.2.0 for spark.sql.parser.singleCharacterPipeOperator.enabled [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2025/11/14 20:02:55 UTC, 1 replies.
- Re: [PR] [SPARK-54172][SQL][FOLLOW-UP] Simplify attribute re-resolution and validate action assignment value resolution for schema evolution [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/11/14 20:06:38 UTC, 2 replies.
- [PR] [SPARK-53890] Test (and fix) read/readstream options are respected for pipelines [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2025/11/14 20:13:58 UTC, 0 replies.
- Re: [PR] [SPARK-52408][BUILD][SQL] Upgrade Hive to 4.1 [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/11/14 20:22:34 UTC, 2 replies.
- Re: [PR] [SPARK-53337][UI] XSS: Ensure the application name in historypage get escaped [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/14 20:58:04 UTC, 3 replies.
- Re: [PR] [SPARK-54350][SQL][STS] SparkGetColumnsOperation ORDINAL_POSITION should be 1-based [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/14 21:15:32 UTC, 5 replies.
- Re: [PR] [SPARK-54361][SQL][FOLLOWUP] Fix Spark version to intended value of 4.2.0 for spark.sql.parser.singleCharacterPipeOperator.enabled [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2025/11/14 21:42:59 UTC, 2 replies.
- [PR] [SPARK-54363][TESTS] Access to buffer in SparkShellSuite should be synchronized between threads [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/11/14 22:04:52 UTC, 3 replies.
- Re: [PR] [SPARK-54361][SQL] Fix Spark version to intended value of 4.2.0 for spark.sql.parser.singleCharacterPipeOperator.enabled [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/14 22:19:45 UTC, 4 replies.
- [PR] [SPARK-54250][PYTHON][INFRA] fix `pypy` packages in docker files [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2025/11/14 22:37:00 UTC, 3 replies.
- Re: [PR] [SPARK-54292][SQL] Support aggregate functions and GROUP BY in |> SELECT pipe operators [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2025/11/14 23:24:27 UTC, 1 replies.
- Re: [PR] [SPARK-53890][SDP] Test (and fix) read/readstream options are respected for pipelines [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2025/11/14 23:26:39 UTC, 1 replies.
- Re: [PR] [SPARK-53145][CORE] Corrected host decommission judgment when calculating rerun tasks caused by executor lost [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/15 00:27:46 UTC, 1 replies.
- Re: [PR] [SPARK-49133][CORE] Make member `MemoryConsumer#used` atomic to avoid user code causing deadlock [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/15 00:27:48 UTC, 6 replies.
- Re: [PR] [SPARK-52388][SQL] Handle named and positional parameters under `PlanWithUnresolvedIdentifier` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/15 00:27:50 UTC, 1 replies.
- [PR] [WIP][SPARK-54314][PySpark] Improve Server-Side debuggability in Spark Connect by capturing client application's file name and line numbers [spark] - posted by "susheel-aroskar (via GitHub)" <gi...@apache.org> on 2025/11/15 00:45:13 UTC, 1 replies.
- Re: [PR] [SPARK-54022][SQL] Make DSv2 table resolution aware of cached tables [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/11/15 00:51:56 UTC, 17 replies.
- [PR] [SPARK-54366][INFRA] Add `free_disk_space_container` step to K8s integration test GitHub Action job [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/15 03:49:31 UTC, 0 replies.
- Re: [PR] [SPARK-53337][CORE] Ensure the application name get escaped. [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/15 04:27:30 UTC, 0 replies.
- [PR] Propagate close() from SessionState to CatalogPlugins to prevent reso… [spark] - posted by "MonkeyCanCode (via GitHub)" <gi...@apache.org> on 2025/11/15 05:10:33 UTC, 0 replies.
- Re: [PR] [SPARK-54305][SQL][PYTHON] Add admission control support to Python DataSource streaming API [spark] - posted by "jiteshsoni (via GitHub)" <gi...@apache.org> on 2025/11/15 18:49:50 UTC, 2 replies.
- [PR] [SPARK-54368][INFRA] Remove `generate-llms-txt.py` from `release-build.sh` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/15 21:09:01 UTC, 9 replies.
- Re: [PR] [WIP][SPARK-54250][PYTHON][INFRA] fix `pypy` packages in docker files [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2025/11/15 22:20:06 UTC, 1 replies.
- Re: [PR] [SPARK-54366][INFRA] Add `free_disk_space` step to K8s integration test GitHub Action job [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/15 23:24:52 UTC, 3 replies.
- [PR] [SPARK-XXX][CONNECT][TESTS] Fix `PythonPipelineSuite` flakiness via `Set` instead of `Seq` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/16 00:08:07 UTC, 1 replies.
- Re: [PR] [SPARK-53019][SQL] Fix job attempt path conflicts in o.a.hadoop..FileOutputCommitter [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/16 00:31:27 UTC, 1 replies.
- Re: [PR] suppress Windows SHELL env error message - SPARK-53149 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/16 00:31:42 UTC, 1 replies.
- Re: [PR] [SPARK-54369][CONNECT][TESTS] Fix `PythonPipelineSuite` flakiness via `Set` instead of `Seq` [spark] - posted by "MonkeyCanCode (via GitHub)" <gi...@apache.org> on 2025/11/16 01:55:35 UTC, 5 replies.
- Re: [PR] [SPARK-54367][Connect]Propagate close() from SessionState to CatalogPlugins to prevent leak [spark] - posted by "MonkeyCanCode (via GitHub)" <gi...@apache.org> on 2025/11/16 01:59:04 UTC, 0 replies.
- [PR] [SPARK-54370][INFRA] Limit the Maven GitHub Action job timeout to 150 minutes [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/16 02:42:05 UTC, 3 replies.
- [PR] [SPARK-54305][PySpark][Streaming] Add admission control support for P… [spark] - posted by "jiteshsoni (via GitHub)" <gi...@apache.org> on 2025/11/16 04:35:26 UTC, 3 replies.
- [PR] [SPARK-54371][INFRA] Fix `spark-rm` Dockefile to install `pkgdown` version at the end [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/16 05:41:18 UTC, 6 replies.
- [PR] [PYTHON] Modernize the _batched method for BatchedSerializer [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/17 01:55:49 UTC, 1 replies.
- [PR] [SPARK-54373][UI] Enlarge the SVG viewBox attribute of Job DAG initialization [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/11/17 03:38:05 UTC, 3 replies.
- [PR] [SPARK-54375][CONNECT][TESTS] Add `assume` to cases in `PythonPipelineSuite` to skip tests when PyConnect dependencies is not available [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/17 03:47:26 UTC, 7 replies.
- [PR] [SPARK-54358][SDP] Code clarity followups [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/11/17 05:05:37 UTC, 0 replies.
- [PR] [SPARK-54376][SDP] Mark most pipeline configuration options as internal [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/11/17 05:17:13 UTC, 1 replies.
- [PR] [SPARK-54377][SQL] Fix COMMENT ON TABLE IS NULL to properly remove table comment [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2025/11/17 07:39:04 UTC, 8 replies.
- [PR] Test icu4j 78.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/17 09:01:02 UTC, 1 replies.
- [PR] Test Junit 6.0.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/17 09:03:46 UTC, 0 replies.
- [PR] [SPARK-54378][SQL] Remove `CreateXmlParser.scala` from `catalyst` module [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/17 09:20:19 UTC, 2 replies.
- [PR] [SPARK-54379] [SQL] Move lambda binding to separate `LambdaBinder` object [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/11/17 10:05:23 UTC, 2 replies.
- Re: [PR] [SPARK-54358][SDP][FOLLOWUP] Code clarity followups [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/17 16:03:41 UTC, 2 replies.
- Re: [PR] test [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/17 16:24:08 UTC, 1 replies.
- [PR] [SPARK-46166][Pyspark] Implementation of pandas.DataFrame.any with axis=1 [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2025/11/17 16:48:40 UTC, 1 replies.
- [PR] [SPARK-54383][SQL] Create BoundInternalRowComparableWrapper util to avoid schema cache lookups [spark] - posted by "chirag-s-db (via GitHub)" <gi...@apache.org> on 2025/11/17 17:02:42 UTC, 1 replies.
- [PR] [SPARK-53322][SQL] Select a KeyGroupedShuffleSpec only when join key positions can be fully pushed down [spark] - posted by "chirag-s-db (via GitHub)" <gi...@apache.org> on 2025/11/17 17:06:41 UTC, 16 replies.
- Re: [PR] Adds comprehensive top-level documentation to the repository [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2025/11/17 18:40:30 UTC, 1 replies.
- Re: [PR] [SPARK-54384][PYTHON] Modernize the _batched method for BatchedSerializer [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/17 18:48:45 UTC, 2 replies.
- Re: [PR] [SPARK-52218][SS] RabbitMQ stream source [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2025/11/17 18:49:35 UTC, 0 replies.
- Re: [PR] [SPARK-52336][CORE] Prepend Spark identifier to GCS user agent [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2025/11/17 18:54:48 UTC, 2 replies.
- Re: [PR] [SPARK-22876][YARN] Respect YARN AM failure validity interval [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2025/11/17 18:59:15 UTC, 0 replies.
- [PR] Refactor PythonException so it can take errorClass with sqlstate [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/17 19:20:28 UTC, 1 replies.
- [PR] [SPARK-54386][SQL][CONNECT][CLIENT]. Fix for potential deadlock in the JavaEncoderSuite, caus… [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2025/11/17 20:41:35 UTC, 2 replies.
- [PR] [SPARK-54389] Fix RocksDB State Store Invalid Stamp error when task is marked as failed during initialization [spark] - posted by "liviazhu (via GitHub)" <gi...@apache.org> on 2025/11/17 21:46:31 UTC, 0 replies.
- Re: [PR] [SPARK-54383][SQL] Add precomputed schema variant for InternalRowComparableWrapper util [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/11/17 22:14:57 UTC, 7 replies.
- Re: [PR] [SPARK-54389] [SS] Fix RocksDB State Store Invalid Stamp error when task is marked as failed during initialization [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/11/17 22:25:48 UTC, 11 replies.
- [PR] [DO_NOT_MERGE][SPARK-54390] Fix JSON Deserialize in StreamingQueryListenerBus [spark] - posted by "dylanwong250 (via GitHub)" <gi...@apache.org> on 2025/11/17 23:41:17 UTC, 0 replies.
- [PR] [SPARK-53924][FOLLOWUP][TESTS] Add tests for cached temp view detecting schema changes [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/11/17 23:54:05 UTC, 2 replies.
- [PR] [WIP] [SPARK-54388][SS] Introduce StatePartitionReader that scan raw bytes for Single ColFamily [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2025/11/18 01:05:00 UTC, 0 replies.
- Re: [PR] [SPARK-54063][SS] Trigger snapshot for next batch when upload lag [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/11/18 01:29:52 UTC, 5 replies.
- [PR] [SPARK-54163][SQL] Scan canonicalization for partitioning and ordering info [spark] - posted by "yhuang-db (via GitHub)" <gi...@apache.org> on 2025/11/18 01:31:23 UTC, 5 replies.
- Re: [PR] [WIP][SPARK-54314][PYTHON][CONNECT] Improve Server-Side debuggability in Spark Connect by capturing client application's file name and line numbers [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/11/18 01:55:38 UTC, 6 replies.
- Re: [PR] [SPARK-46166][PS] Implementation of pandas.DataFrame.any with axis=1 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/11/18 01:59:20 UTC, 8 replies.
- Re: [PR] [SPARK-54381][BUILD] Upgrade Junit to 6.0.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/18 03:20:36 UTC, 1 replies.
- [PR] [CONNECT][TESTS] Make `PythonPipelineSuite` perform a default check for `PythonTestDepsChecker.isConnectDepsAvailable` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/18 03:25:13 UTC, 0 replies.
- Re: [PR] [SPARK-54375][CONNECT][TESTS][FOLLOWUP] Make `PythonPipelineSuite` perform a default check for `PythonTestDepsChecker.isConnectDepsAvailable` [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/11/18 03:44:42 UTC, 9 replies.
- [PR] [SPARK-54393][BUILD][TESTS] Upgrade oracle free to 23.26.0 [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/11/18 04:38:05 UTC, 3 replies.
- [PR] [SPARK-54394][CORE] Move `isJavaVersionAtMost17` and `isJavaVersionAtLeast21` from `core` to `common/utils` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/11/18 04:58:41 UTC, 4 replies.
- [PR] [SPARK-54387][SQL] Fix reaching of DSv2 tables [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/11/18 05:52:00 UTC, 3 replies.
- [PR] [SPARK-54395][SHUFFLE] RemoteBlockPushResolver class repeatedly initializes ObjectMapper [spark] - posted by "CuiYanxiang (via GitHub)" <gi...@apache.org> on 2025/11/18 06:39:55 UTC, 6 replies.
- [PR] [SPARK-54396][PYTHON] Optimize Py4J calls in Dataframe.toArrow [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/18 07:03:46 UTC, 2 replies.
- [PR] [MINOR][PYTHON][DOCS] Refine the examples in window.py [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/18 07:05:47 UTC, 2 replies.
- [PR] Fix the hashable of `UserDefinedType` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/18 07:57:25 UTC, 0 replies.
- Re: [PR] [SPARK-54397][PYTHON] Make `UserDefinedType` hashable [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/18 08:41:56 UTC, 16 replies.
- Re: [PR] [SPARK-53738][SQL] Fix planned write when query output contains foldable orderings [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/18 09:04:09 UTC, 4 replies.
- Re: [PR] [SPARK-52767][SQL] Optimize maxRows and maxRowsPerPartition for join and union [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/11/18 14:34:13 UTC, 2 replies.
- [PR] [SPARK-44571][SQL][FOLLOWUP][DOCS] Update Scaladoc of `MergeSubplans` [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/11/18 14:38:02 UTC, 3 replies.
- Re: [PR] [SPARK-54387][SQL] Fix recaching of DSv2 tables [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/11/18 14:44:02 UTC, 5 replies.
- [PR] [SPARK-54398] Use 4.1.0-preview4 in `integration-test-(token|mac-spark41)` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/18 15:57:16 UTC, 3 replies.
- [PR] [SPARK-53924][SPARK-54157][SQL][FOLLOWUP] Fix error formatting for incompatible table metadata checks [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/11/18 16:32:54 UTC, 4 replies.
- [PR] [SPARK-XXX] Upgrade `grpc-swift-2` to 2.2.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/18 16:39:30 UTC, 2 replies.
- [PR] [SPARK-XXX] Upgrade `gRPC Swift NIO Transport` to 2.3.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/18 16:48:21 UTC, 2 replies.
- [PR] [SPARK-47086][SPARK-48022][BUILD][CORE][WEBUI] Upgrade Jetty to 12.1.4 [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/11/18 17:29:05 UTC, 10 replies.
- [PR] [SPARK-54399][Geo][SQL][PYTHON] Implement the st_setsrid function in Scala and PySpark [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/11/18 17:33:19 UTC, 13 replies.
- [PR] [SPARK-51771][SQL][FOLLOWUP] Rename currentVersion to version in DSv2 Table [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/11/18 17:33:50 UTC, 16 replies.
- Re: [PR] [SPARK-54401] Upgrade `grpc-swift-2` to 2.2.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/18 18:22:14 UTC, 1 replies.
- [PR] [SPARK-54400][SQL] Replace `HtmlUtils.parseQueryString` in `ThriftHttpServlet.java` with `HttpServletRequest.getQueryString` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/11/18 18:22:19 UTC, 3 replies.
- Re: [PR] [SPARK-54402] Upgrade `gRPC Swift NIO Transport` to 2.3.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/18 18:22:56 UTC, 1 replies.
- [PR] [SPARK-54410] Support Variant Logical Type Annotation on reads [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2025/11/18 20:18:16 UTC, 0 replies.
- Re: [PR] [SPARK-54410] Support Variant Logical Type Annotation on parquet reads [spark] - posted by "cashmand (via GitHub)" <gi...@apache.org> on 2025/11/18 20:48:10 UTC, 0 replies.
- Re: [PR] [SPARK-54349][PYTHON] Refactor code a bit to simplify faulthandler integration extension [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/11/18 21:52:21 UTC, 6 replies.
- Re: [PR] [SPARK-54388][SS] Introduce StatePartitionReader that scan raw bytes for Single ColFamily [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2025/11/18 22:29:50 UTC, 12 replies.
- [PR] [SPARK-54412][TEST] Cleanup (drop) view created in identifier-clause.sql golden file [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/11/18 22:53:45 UTC, 11 replies.
- [PR] [SPARK-54392][SS] Optimize JVM-Python communication for TWS initial state [spark] - posted by "nyaapa (via GitHub)" <gi...@apache.org> on 2025/11/18 23:14:20 UTC, 6 replies.
- [PR] [WIP] Introducing OffsetMap to enable Named Streaming Sources [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/11/18 23:51:39 UTC, 0 replies.
- [PR] Bump glob from 10.4.5 to 10.5.0 in /ui-test [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/11/19 01:32:57 UTC, 2 replies.
- Re: [PR] [SPARK-54410][SQL] Support Variant Logical Type Annotation on parquet reads [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/11/19 03:33:48 UTC, 23 replies.
- Re: [PR] [SPARK-54358][SDP][FOLLOWUP] Improve code clarity of SDP checkpoint path construction [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/11/19 04:14:15 UTC, 0 replies.
- Re: [PR] [SPARK-47086][SPARK-48022][BUILD][CORE][WEBUI] Upgrade Jetty to 12.1.4, Jersey to 3.1.11 and Servlet to 6.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/19 04:36:34 UTC, 13 replies.
- [PR] [SPARK-54151][Geo][PYTHON][FOLLOWUP] Update examples for ST functions in PySpark [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/11/19 06:55:53 UTC, 4 replies.
- Re: [PR] [SPARK-54030][SQL] Add user-friendly assertion message for view metadata corruption [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/11/19 06:56:06 UTC, 0 replies.
- [PR] [SPARK-54030][SQL][FOLLOWUP] Refactor test to use withBasicCatalog for consistency [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2025/11/19 07:37:34 UTC, 3 replies.
- [PR] [SPARK-54413][UI] Upgrade Bootstrap v4.4.1 to v4.6.2 [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/11/19 08:13:15 UTC, 7 replies.
- [PR] [SPARK-54414][SQL] EnsureRequirements reorderJoinPredicates should use copy avoid missing tag [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2025/11/19 09:09:04 UTC, 2 replies.
- [PR] [SPARK-54415][SQL] CREATE GLOBAL TEMPORARY VIEW / TEMPORARY VIEW supports IF NOT EXISTS clause [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/19 10:04:31 UTC, 15 replies.
- [PR] SPARK-54416 Remove references to Pod Security Policies from Kubernetes docs [spark] - posted by "Jimvin (via GitHub)" <gi...@apache.org> on 2025/11/19 10:33:59 UTC, 0 replies.
- [PR] [SPARK-54300][SPARK-54396][PYTHON][FOLLOW-UP] Pass `prefers_large_var_types` to `_collect_as_arrow` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/19 11:22:42 UTC, 2 replies.
- [PR] [WIP][SPARK-51224][BUILD] Test Maven 4 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/19 13:23:31 UTC, 0 replies.
- [PR] [SPARK-53322][SQL][Backport 4.1] Select a KeyGroupedShuffleSpec only when join key positions can be fully pushed down [spark] - posted by "chirag-s-db (via GitHub)" <gi...@apache.org> on 2025/11/19 15:41:12 UTC, 1 replies.
- [PR] [SPARK-54417] Fix error message for scalar subquery in IDENTIFIER clause [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/11/19 16:27:04 UTC, 4 replies.
- Re: [PR] [SPARK-54418][SDP] clean up typos and code reformatting [spark] - posted by "jaceklaskowski (via GitHub)" <gi...@apache.org> on 2025/11/19 17:29:27 UTC, 1 replies.
- [PR] [SPARK-54422][K8S] Increase `spark.kubernetes.allocation.batch.size` to 20 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/19 20:23:45 UTC, 2 replies.
- Re: [PR] [SPARK-53322][SQL][4.1] Select a KeyGroupedShuffleSpec only when join key positions can be fully pushed down [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/19 22:40:52 UTC, 1 replies.
- Re: [PR] [SPARK-54416][DOCS] Remove references to Pod Security Policies from Kubernetes docs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/19 22:45:06 UTC, 1 replies.
- [PR] [SPARK-54425][INFRA] Use .coveragerc for omitting sources and ignore test files for coverage [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/19 23:05:30 UTC, 3 replies.
- [PR] [SPARK-54426][INFRA] Fix `release-build.sh` to detect `REPO_ID` correctly [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/19 23:44:54 UTC, 9 replies.
- [PR] [SPARK-54427][SQL] Allow ColumnarRow to call `copy` with variant types [spark] - posted by "richardc-db (via GitHub)" <gi...@apache.org> on 2025/11/20 00:15:34 UTC, 2 replies.
- Re: [PR] [SPARK-53105][Structured Streaming] Fix tests for checkpoint v2 in RocksDBSuite [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/20 00:28:21 UTC, 1 replies.
- Re: [PR] [SPARK-52868][SQL] CBO: OOM-risky stats underestimation for some filters and sources [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/20 00:28:22 UTC, 1 replies.
- Re: [PR] [SPARK-52769][SQL] InjectRuntimeFilter should take into account join type and hints [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/20 00:28:24 UTC, 1 replies.
- [PR] [SPARK-54428] Upgrade Spark to `4.1.0-preview4` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/20 00:49:11 UTC, 3 replies.
- [PR] [SPARK-54429] Publish Apache Spark `4.1.0-preview4` to docker registry [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/20 00:57:29 UTC, 3 replies.
- [PR] [SPARK-54430] Use `4.1.0-preview4` instead of `RC1` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/20 01:01:32 UTC, 3 replies.
- [PR] [MINOR][SQL] Remove unused method [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/11/20 02:32:04 UTC, 0 replies.
- [PR] [SPARK-54431] Update `integration-test-ubuntu-spark41` to use Spark `4.1.0-preview4-java21` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/20 02:48:48 UTC, 2 replies.
- [PR] [SPARK-54432] Use `4.1.0-preview4-java21-scala` image for preview examples [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/20 02:53:20 UTC, 3 replies.
- Re: [PR] [MINOR][SQL] Remove unused method from Observation [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/11/20 03:12:27 UTC, 3 replies.
- Re: [PR] [SPARK-54358][SDP][FOLLOWUP] Add `tableIdentifierToPathString` helper method for SDP checkpoint path construction [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/20 05:35:32 UTC, 0 replies.
- Re: [PR] [SPARK-53848] Add ability to support Alpha family in Theta Aggregates [spark] - posted by "karuppayya (via GitHub)" <gi...@apache.org> on 2025/11/20 05:56:34 UTC, 3 replies.
- [PR] log4j Filters [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/20 06:33:26 UTC, 2 replies.
- Re: [PR] [SPARK-54417][SQL] Fix error message for scalar subquery in IDENTIFIER clause [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/11/20 09:30:42 UTC, 3 replies.
- [PR] [SPARK-54435][SDP] spark-pipelines init should avoid overwriting existing directory [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/11/20 15:25:24 UTC, 2 replies.
- Re: [PR] [SPARK-44639][SS][YARN] Use Java tmp dir for local RocksDB state storage on Yarn [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/20 17:59:03 UTC, 2 replies.
- Re: [PR] [SPARK-54436][SQL] Fix error formatting for incompatible table metadata checks [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/11/20 18:52:21 UTC, 3 replies.
- [PR] [SPARK-54063][SS] Fix timeout test introduced in PR-52773 [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2025/11/20 19:16:11 UTC, 0 replies.
- [PR] [SPARK-54439][SQL] KeyGroupedPartitioning and join key size mismatch [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/11/20 19:37:26 UTC, 17 replies.
- Re: [PR] [SPARK-54063][SS][FOLLOWUP] Remove `withTempDirFix` from `forceSnapshot metric populated when shouldForceSnapshotOnCommit is true` test [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/20 19:38:10 UTC, 3 replies.
- [PR] [SPARK-54424][SQL] Failures during recaching must not fail operations [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/11/20 19:57:01 UTC, 30 replies.
- Re: [PR] [SPARK-54418][SDP] Fix error messages and code formatting [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/20 21:08:27 UTC, 1 replies.
- [PR] [SPARK-54440][SDP] Give default pipeline spec file more idiomatic name [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/11/20 21:22:24 UTC, 0 replies.
- [PR] [SPARK-54441][INFRA] Enable coverage data for workers [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/20 21:43:51 UTC, 3 replies.
- [PR] [SPARK-54403][SQL][Metric View] Add YAML serde infrastructure for metric views [spark] - posted by "linhongliu-db (via GitHub)" <gi...@apache.org> on 2025/11/20 22:11:24 UTC, 12 replies.
- [PR] [SPARK-54442][SQL] Add numeric conversion functions for TIME type [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/11/20 23:55:10 UTC, 3 replies.
- Re: [PR] [SPARK-54440][SDP] Give default pipeline spec file more idiomatic name, `spark-pipeline.yml` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/21 00:13:14 UTC, 0 replies.
- Re: [PR] [SPARK-54024][BUILD] Add sbt-dependency-tree to SBT plugin [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2025/11/21 00:24:24 UTC, 2 replies.
- Re: [PR] [SPARK-53212][PYTHON] improve error handling for scalar Pandas UDFs [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/21 00:28:07 UTC, 1 replies.
- Re: [PR] [SPARK-53193][DOCS] Add advanced JVM optimization parameters to tuning guide [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/21 00:28:09 UTC, 1 replies.
- Re: [PR] [SPARK-53174][CORE] Add TMPDIR environment variable with the value of java.io.tmpdir [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/21 00:28:10 UTC, 1 replies.
- Re: [PR] [SPARK-53142][SQL] Support dynamic expression addition in SemanticComparator [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/21 00:28:12 UTC, 1 replies.
- [PR] [SPARK-54364][INFRA] Separate test_install_spark from the rest of the tests [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/21 00:28:31 UTC, 6 replies.
- Re: [PR] [SPARK-54410][SQL] Fix read support for the variant logical type annotation [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2025/11/21 01:52:32 UTC, 6 replies.
- [PR] [SPARK-54289][SQL] Allow MERGE INTO to preserve existing struct fields for UPDATE SET * when source has nested fields [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/11/21 02:47:59 UTC, 0 replies.
- [PR] [SPARK-54446][ML] FPGrowth supports local filesystem [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/21 02:48:42 UTC, 8 replies.
- Re: [PR] [SPARK-54445][SQL][TESTS] Fix configuration related to `ThresholdFilter` in `log4j2.properties` within `hive-thriftserver` module [spark] - posted by "Copilot (via GitHub)" <gi...@apache.org> on 2025/11/21 06:06:52 UTC, 4 replies.
- [PR] [MINOR][PYTHON][TEST] `test_install_spark` switch to Spark 3.5.7 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/21 07:19:10 UTC, 3 replies.
- [PR] [SPARK-54330][PYTHON][FOLLOW-UP] Further avoid unnecessary py4j calls [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/21 08:35:23 UTC, 2 replies.
- Re: [PR] [SPARK-54289][SQL] Allow MERGE INTO to preserve existing struct fields for UPDATE SET * when source struct has less nested fields than target struct [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/11/21 09:41:18 UTC, 13 replies.
- [PR] [SPARK-54448][SQL][DOCS] Fix docs and error message because CREATE TEMP VIEW does not support IF NOT EXISTS [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/21 13:50:41 UTC, 2 replies.
- [PR] [SPARK-54261][SQL][FOLLOW UP] Re-enable `spark.sql.scripting.enabled` by default in 4.1 branch [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2025/11/21 14:49:52 UTC, 6 replies.
- Re: [PR] [SPARK-54324] Add test for client-user-context-extensions [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/11/21 14:52:50 UTC, 0 replies.
- [PR] [SPARK-51765][DOCS] Docs for SQL Scripting [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2025/11/21 15:13:52 UTC, 1 replies.
- Re: [PR] [SPARK-53998][TESTS] Add addition E2E tests for RTM [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/21 16:54:41 UTC, 1 replies.
- Re: [PR] [SPARK-53753][BUILD][SQL] shade antlr4-runtime [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2025/11/21 18:32:42 UTC, 6 replies.
- [PR] [SPARK-54020][bugfix] empty response from SparkConnect server for `spark.sql(...)` inside FlowFunction [spark] - posted by "SCHJonathan (via GitHub)" <gi...@apache.org> on 2025/11/21 19:10:53 UTC, 0 replies.
- [PR] [SPARK-54450][INFRA] Allow run-tests to accept unittest style string for test names [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/21 19:18:41 UTC, 7 replies.
- Re: [PR] [SPARK-54020] empty response from SparkConnect server for `spark.sql(...)` inside FlowFunction [spark] - posted by "SCHJonathan (via GitHub)" <gi...@apache.org> on 2025/11/21 19:25:01 UTC, 2 replies.
- [PR] [SPARK-54405][SQL][Metric View] CREATE command and SELECT query resolution [spark] - posted by "linhongliu-db (via GitHub)" <gi...@apache.org> on 2025/11/21 20:26:23 UTC, 1 replies.
- [PR] tws-tester-3 [spark] - posted by "fedimser (via GitHub)" <gi...@apache.org> on 2025/11/21 20:45:54 UTC, 0 replies.
- [PR] [SPARK-54451][SQL] Add JSON serialization and deserialization support for TIME type [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/11/21 20:47:28 UTC, 5 replies.
- Re: [PR] [SPARK-54026][BUILD] Use BOM for AWS Java SDK V2 dependency management [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/11/21 20:50:20 UTC, 0 replies.
- Re: [PR] [SPARK-54006][TESTS][DSTREAM][3.5] Fix for NoClassDefFoundError in WithAggregationKinesisBackedBlockRDDSuite and KinesisTestUitls [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/11/21 20:53:38 UTC, 0 replies.
- Re: [PR] [SPARK-54452] empty response from SparkConnect server for `spark.sql(...)` inside FlowFunction [spark] - posted by "SCHJonathan (via GitHub)" <gi...@apache.org> on 2025/11/21 20:54:50 UTC, 1 replies.
- Re: [PR] [SPARK-53797][SQL] Fix `FileStreamSource.takeFilesUntilMax` to use `zipWithIndex` to avoid `indices` usage [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/21 21:48:00 UTC, 0 replies.
- [PR] [SPARK-33863] Respect session timezone in udf workers [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/21 21:59:10 UTC, 1 replies.
- Re: [PR] [SPARK-53446][CORE] Optimize BlockManager remove operations with cached block mappings [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2025/11/21 22:16:20 UTC, 2 replies.
- [PR] [SPARK-54153][PYTHON][TESTS] Skip `test_perf_profiler_data_source` if `pyarrow` is absent [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/21 22:23:45 UTC, 0 replies.
- Re: [PR] [SPARK-54153][PYTHON][TESTS][FOLLOWUP] Skip `test_perf_profiler_data_source` if `pyarrow` is absent [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/21 22:33:49 UTC, 4 replies.
- [PR] [SPARK-54425] Add two missing test directories to coverage omit [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/21 22:38:25 UTC, 0 replies.
- Re: [PR] [SPARK-54452] Fix empty response from SparkConnect server for `spark.sql(...)` inside FlowFunction [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/21 22:42:23 UTC, 3 replies.
- [PR] [SPARK-54454] Enable variant shredding and variant logical type annotation configs by default [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2025/11/21 23:16:22 UTC, 0 replies.
- [PR] [SPARK-54455][CORE][TESTS] Disable a flaky `unmanaged memory trackingwith off-heap memory enabled` test in MacOS CI [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/21 23:30:30 UTC, 0 replies.
- [PR] [SPARK-54456][Python] Import worker module after fork to avoid deadlock [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/22 00:01:37 UTC, 0 replies.
- Re: [PR] [SPARK-51765][DOCS] Document `SQL Scripting` Syntax [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/22 00:26:30 UTC, 3 replies.
- Re: [PR] [TEST-ONLY] Test PyPy 7.3.19 with Python 3.10 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/22 00:27:33 UTC, 1 replies.
- Re: [PR] [SPARK-53264][SQL][CATALYST]. Incorrect nullability when correlated scalar subquery ge… [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/22 00:27:35 UTC, 1 replies.
- Re: [PR] [SPARK-53262][SS] Support schema evolution for streaming dedupe operation [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/22 00:27:36 UTC, 1 replies.
- Re: [PR] [WIP][TESTS] Upgrade pypy to 3.11 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/22 00:27:38 UTC, 1 replies.
- Re: [PR] [SPARK-54455][CORE][TESTS] Disable a flaky `unmanaged memory tracking with off-heap memory enabled` test in MacOS CI [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/22 01:41:59 UTC, 1 replies.
- [PR] [SPARK-54458][INFRA] Use official download-artifact to fix the test_report action [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/22 03:15:33 UTC, 3 replies.
- [PR] [SPARK-54459][SQL][TESTS] Increase `StateStoreSuite.maintenance` test timeout to 2 minutes [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/22 03:34:42 UTC, 2 replies.
- [PR] [SPARK-54460][SQL][TESTS] Mark `StateStoreInstanceMetricSuite` as `ExtendedSQLTest` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/22 06:01:46 UTC, 2 replies.
- [PR] [MINOR][SQL] Remove duplicate output.reserve calls in assembleVariantBatch [spark] - posted by "Zouxxyy (via GitHub)" <gi...@apache.org> on 2025/11/22 07:43:19 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-XXX][PYTHON][INFRA] fix `pypy` packages in docker files [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2025/11/22 12:58:21 UTC, 1 replies.
- Re: [PR] [SPARK-54447][BUILD] Upgrade icu4j to 78.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/22 17:14:13 UTC, 2 replies.
- [PR] Bump js-yaml from 3.14.1 to 3.14.2 in /ui-test [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/11/22 17:15:37 UTC, 2 replies.
- [PR] [SPARK-50072][SQL] Handle ArithmeticException in interval parsing with large values [spark] - posted by "AbinayaJayaprakasam (via GitHub)" <gi...@apache.org> on 2025/11/22 17:20:08 UTC, 12 replies.
- [PR] [SPARK-54462] Add isDataFrameWriterV1 option for Delta datasource compatibility [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2025/11/22 18:04:06 UTC, 1 replies.
- [PR] [SPARK-54461][SQL] Add XML serialization and deserialization support for TIME type [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/11/22 18:31:10 UTC, 1 replies.
- Re: [PR] [SPARK-54363][REPL][TESTS] Access to buffer in SparkShellSuite should be synchronized between threads [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/22 23:57:08 UTC, 0 replies.
- Re: [PR] [SPARK-54462][SQL] Add `isDataFrameWriterV1` option for Delta datasource compatibility [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/23 00:03:00 UTC, 16 replies.
- [PR] [SPARK-54463][SQL] Add CSV serialization and deserialization support for TIME type [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/11/23 00:13:42 UTC, 1 replies.
- [PR] [SPARK-54412][SQL][TESTS] Clean up `v` properly in `identifier-clausesql` SQL golden file [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/23 00:36:06 UTC, 0 replies.
- Re: [PR] [SPARK-54412][SQL][TESTS] Clean up `v` properly in `identifier-clause.sql` SQL golden file [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/23 00:43:07 UTC, 2 replies.
- Re: [PR] [SPARK-54464][SQL] Remove duplicate `output.reserve` calls in `assembleVariantBatch` [spark] - posted by "Zouxxyy (via GitHub)" <gi...@apache.org> on 2025/11/23 01:52:52 UTC, 4 replies.
- [PR] [SPARK-54364][INFRA] Disable pyspark_install on apache master commits [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/23 02:05:32 UTC, 1 replies.
- Re: [PR] [SPARK-54364][INFRA][FOLLOWUP] Disable pyspark_install on apache master commits [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/23 02:08:04 UTC, 5 replies.
- Re: [PR] [SPARK-54412][SQL][TEST] Clean up `v` properly in `identifier-clause.sql` SQL golden file [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/23 02:20:46 UTC, 5 replies.
- Re: [PR] [SPARK-52970][CONNECT][INFRA] Upgrade PyArrow version in 3.5 client <> master server build [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/23 03:55:29 UTC, 2 replies.
- [PR] [SPARK-54465][INFRA] Remove `build_python_connect35.yml` GitHub Action job [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/23 04:01:39 UTC, 5 replies.
- [PR] a [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/23 06:49:22 UTC, 1 replies.
- [PR] [SPARK-54467][INFRA] Disable `actions/cache` on MacOS CIs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/23 07:23:06 UTC, 6 replies.
- [PR] [SPARK-54467][INFRA][FOLLOWUP] Disable `actions/cache` on `python_hosted_runner_test.yml` too [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/23 08:40:53 UTC, 4 replies.
- [PR] [SPARK-54469][DSTREAM][TESTS] Fix `StreamingContextSuite.stop slow receiver gracefully` test to clean up `SprakContext` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/23 15:16:40 UTC, 2 replies.
- [PR] [SPARK-54470][CORE][TESTS] Fix `BlockManagerDecommissionIntegrationSuite` to wait shuffle migrations [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/23 15:39:27 UTC, 5 replies.
- [PR] [SPARK-54471][INFRA] Remove `build_python_3.11_macos.yml` CI [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/23 16:18:58 UTC, 3 replies.
- [PR] [SPARK-54472][SQL] Add ORC read and write support for TIME type [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/11/23 17:54:05 UTC, 2 replies.
- [PR] [SPARK-54468][SDP] Add missing error classes [spark] - posted by "jaceklaskowski (via GitHub)" <gi...@apache.org> on 2025/11/23 20:06:22 UTC, 3 replies.
- [PR] [SPARK-54474][PYTHON] Discard the XML report on tests that are supposed to fail [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/23 21:39:28 UTC, 4 replies.
- [PR] [SPARK-54475][PYTHON] Add master-server, branch-4.0-client, Python 3.11 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/11/23 21:48:20 UTC, 7 replies.
- Re: [PR] [WIP][SPARK-54475][PYTHON] Add master-server, branch-4.0-client, Python 3.11 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/11/23 21:51:38 UTC, 24 replies.
- Re: [PR] [SPARK-54425][INFRA] Add two missing test directories to coverage omit [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/11/23 21:57:37 UTC, 1 replies.
- [PR] [SPARK-54473][SQL] Add Avro read and write support for TIME type [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/11/23 23:55:15 UTC, 1 replies.
- Re: [PR] [SPARK-53273][CONNECT][SQL] Make RegisterUserDefinedFunction in SparkConnectPlanner side effect free [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/24 00:30:50 UTC, 1 replies.
- Re: [PR] [SPARK-53148][CONNECT][SQL] Make SqlCommand in SparkConnectPlanner side effect free [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/24 00:30:52 UTC, 1 replies.
- Re: [PR] [SPARK-53254][PYTHON][TESTS] Skip hanging tests in PyPy daily workflow [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/24 00:30:52 UTC, 1 replies.
- [PR] Open source Canon: Burst-aware Memory Allocation Algorithm for Spark@K8S [spark] - posted by "YaoRazor (via GitHub)" <gi...@apache.org> on 2025/11/24 02:09:59 UTC, 4 replies.
- Re: [PR] [SPARK-53946][BUILD] Upgrade SBT to 1.11.7 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/11/24 05:44:41 UTC, 0 replies.
- Re: [PR] [SPARK-54454][SQL] Enable variant shredding and variant logical type annotation configs by default [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/11/24 06:32:04 UTC, 15 replies.
- [PR] [SPARK-54488][BUILD] Fix Connect JVM client leaks `protobuf-java-util` in shading rules [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/24 09:20:16 UTC, 1 replies.
- Re: [PR] [SPARK-33863][PYTHON] Respect session timezone in udf workers [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/11/24 09:35:15 UTC, 18 replies.
- [PR] [SPARK-54115][TESTS][FOLLOW-UP] Refine `org.apache.spark.util.UtilsSuite` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/24 10:42:24 UTC, 7 replies.
- [PR] Change volumeMounts and volumes types to array [spark-kubernetes-operator] - posted by "Sbaia (via GitHub)" <gi...@apache.org> on 2025/11/24 11:45:07 UTC, 0 replies.
- [PR] [SPARK-54489][CORE] Avoid returning corrupted Kryo objects [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2025/11/24 12:19:52 UTC, 1 replies.
- [PR] [SPARK-51765][DOCS][4.1] Document SQL Scripting Syntax [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2025/11/24 13:09:44 UTC, 8 replies.
- [PR] [SPARK-54490][SQL] Classify "withConnection" exceptions in JDBCUtils [spark] - posted by "aleksandr-chernousov-db (via GitHub)" <gi...@apache.org> on 2025/11/24 14:39:20 UTC, 2 replies.
- [PR] [SPARK-54491] Fix insert into temp view on DSv2 table failure [spark] - posted by "manuzhang (via GitHub)" <gi...@apache.org> on 2025/11/24 16:37:17 UTC, 2 replies.
- [PR] [SPARK-54492][SQL] Rename _LEGACY_ERROR_TEMP_1201 and add sqlState [spark] - posted by "aleksandr-chernousov-db (via GitHub)" <gi...@apache.org> on 2025/11/24 16:49:37 UTC, 3 replies.
- [PR] [SPARK-54492][SQL] Rename _LEGACY_ERROR_TEMP_1133 and add sqlState [spark] - posted by "aleksandr-chernousov-db (via GitHub)" <gi...@apache.org> on 2025/11/24 17:03:09 UTC, 2 replies.
- Re: [PR] [SPARK-54456][PYTHON] Import worker module after fork to avoid deadlock [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/11/24 19:47:29 UTC, 3 replies.
- [PR] [SPARK-54289][SQL][FOLLOW-UP] Make Merge Into update assignment by field default for UPDATE SET * and align configs [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/11/24 21:16:37 UTC, 4 replies.
- [PR] [SPARK-54247] Explictly close socket for util._load_from_socket [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/24 22:34:52 UTC, 0 replies.
- Re: [PR] [SPARK-54491][SQL] Fix insert into temp view on DSv2 table failure [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/11/25 00:23:48 UTC, 4 replies.
- [PR] [SPARK-54221][FOLLOW-UP] Add `pypy3.11` in `Build Pipeline Status` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/25 00:48:10 UTC, 2 replies.
- Re: [PR] [SPARK-54219][CORE] Support `spark.cleaner.referenceTracking.blocking.timeout` config [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/25 01:08:31 UTC, 0 replies.
- Re: [PR] [SPARK-54247][PYTHON] Explictly close socket for util._load_from_socket [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/25 01:14:10 UTC, 0 replies.
- Re: [PR] [SPARK-54316][CORE][PYTHON][SQL] Align Pandas-related serializers with Arrow-related serializers [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/25 02:58:46 UTC, 0 replies.
- [PR] [SPARK-54444][SQL] Relax DSv2 table checks to restore previous behavior [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/11/25 03:58:48 UTC, 20 replies.
- [PR] [SPARK-54247][PYTHON][FOLLOWUP] Ensure socket is not leaked and add regression tests [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/25 04:27:17 UTC, 2 replies.
- [PR] [SPARK-54477][CONNECT][PYTHON][TESTS] Mark tests to reeanble for 4.0 client <> master server job [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/11/25 04:50:54 UTC, 4 replies.
- [PR] [SPARK-54497][PYTHON] Apply `functools.lru_cache` in converter caching [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/25 04:56:21 UTC, 3 replies.
- [PR] [SPARK-54477][CONNECT][PYTHON][TESTS][4.0] Mark tests to reeanble for 4.0 client <> master server job [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/11/25 05:01:26 UTC, 3 replies.
- [PR] [SPARK-54496][SQL] Fix Merge Into Schema Evolution for Dataframe API [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/11/25 05:17:50 UTC, 13 replies.
- [PR] [SPARK-54130][SQL][FOLLOWUP] Refactor tests to use withEmptyCatalog for consistency [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2025/11/25 07:01:50 UTC, 4 replies.
- Re: [PR] [SPARK-54499][SQL] Re-enable `spark.sql.scripting.enabled` by default in 4.1 branch [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2025/11/25 07:34:44 UTC, 0 replies.
- [PR] [SPARK-54482][PYTHON][CONNECT][TESTS] Reeanble `test_apply_in_pandas_returning_column_names_*` for Spark Connect 4.0 client <> master server [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/25 07:35:07 UTC, 2 replies.
- [PR] Set pythonUDF.arrow.concurrency.level [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/11/25 08:19:54 UTC, 0 replies.
- Re: [PR] [PYTHON][TESTS] Restore `pythonUDF.arrow.concurrency.level` in ArrowPythonUDFLegacyTests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/25 08:35:18 UTC, 0 replies.
- [PR] [SPARK-54475][INFRA][FOLLOW-UP] Make master-server <> branch-4.0-client a scheduled workflow [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/25 09:08:14 UTC, 1 replies.
- [PR] [SPARK-54501][SQL] Improve error handling for Hive metastore partition filter failures [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2025/11/25 11:58:45 UTC, 5 replies.
- [PR] [SPARK-54503] Include pyspark.pipelines in API reference [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/11/25 17:46:19 UTC, 0 replies.
- Re: [PR] [SPARK-53873][SQL] ExplodeBase.eval IterableOnce directly on input [spark] - posted by "asautins (via GitHub)" <gi...@apache.org> on 2025/11/25 17:49:41 UTC, 2 replies.
- [PR] [SPARK-54504][SQL] Fix version refresh for DSv2 tables with subqueries [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/11/25 17:55:45 UTC, 2 replies.
- [PR] [SPARK-54462][SQL] Add RequiresDataFrameWriterV1SaveAsTableOverwriteWriteOption TableProvider mixin [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2025/11/25 18:36:27 UTC, 3 replies.
- [PR] [SPARK-54493][PYTHON] Fix assertSchemaEqual for MapType [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/25 18:43:19 UTC, 2 replies.
- [PR] [SPARK-54506][CORE] Add $init$ method to LogKey for backward compatibility [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/11/25 19:03:58 UTC, 7 replies.
- [PR] [WIP][SPARK-54505][UI][SHUFFLE] Correct the arg order of createMetrics call in makeNegative [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2025/11/25 19:08:01 UTC, 0 replies.
- [PR] [SPARK-54508] spark-pipelines fails when spec file is in different di… [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/11/25 19:12:34 UTC, 0 replies.
- [PR] [DO NOT MERGE] Cobrix issue demonstration [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2025/11/25 19:35:40 UTC, 1 replies.
- [PR] [SPARK-44988][SQL] Support reading Parquet TIMESTAMP(NANOS,false) [spark] - posted by "AbinayaJayaprakasam (via GitHub)" <gi...@apache.org> on 2025/11/25 20:33:51 UTC, 2 replies.
- Re: [PR] [SPARK-54500][PYTHON][TESTS] Restore `pythonUDF.arrow.concurrency.level` in ArrowPythonUDFLegacyTests [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/25 21:09:46 UTC, 0 replies.
- Re: [PR] [SPARK-54462][SQL] Add `RequiresDataFrameWriterV1SaveAsTableOverwriteWriteOption` TableProvider mixin [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/25 21:16:49 UTC, 6 replies.
- Re: [PR] [SPARK-54508][PYTHON] Fix `spark-pipelines` to resolve `spec` file path more robustly [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/25 21:40:32 UTC, 0 replies.
- Re: [PR] [SPARK-54503][PYTHON][DOCS] Include `pyspark.pipelines` in API reference [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/25 21:50:56 UTC, 1 replies.
- Re: [PR] [SPARK-54499][SQL][4.1] Re-enable `spark.sql.scripting.enabled` by default for Spark 4.1.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/25 21:55:56 UTC, 0 replies.
- [PR] [SPARK-54485][SPARK-54494][TESTS] Enable tests in test_parity_udf_profiler and test_parity_memory_profiler [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/11/25 22:51:46 UTC, 0 replies.
- Re: [PR] [SPARK-54485][SPARK-54494][TESTS] Re-enable tests in test_parity_udf_profiler and test_parity_memory_profiler [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/11/25 23:02:01 UTC, 5 replies.
- [PR] [SPARK-54517][PYTHON][TESTS] Forward-port test util decorators [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/11/25 23:41:11 UTC, 0 replies.
- Re: [PR] [SPARK-54485][SPARK-54494][PYTHON][TESTS] Re-enable tests in test_parity_udf_profiler and test_parity_memory_profiler [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/11/25 23:41:34 UTC, 0 replies.
- [PR] [SPARK-54454][PART-1] Fix default resolution during variant pushdown and prepare test suites for default enablement of shredding and variant logical type annotation [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2025/11/26 00:19:51 UTC, 1 replies.
- Re: [PR] [SPARK-54316][CORE][PYTHON][SQL] Consolidate `GroupPandasIterUDFSerializer` with `GroupPandasUDFSerializer` [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/11/26 00:56:26 UTC, 1 replies.
- [PR] [SPARK-54519][DOCS] Reformat tutorial comments so it's easier to read on the website [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/26 01:16:31 UTC, 2 replies.
- [PR] [INFRA] Ignore Missing Packages in CI free_disk_space Step [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/11/26 02:08:21 UTC, 0 replies.
- Re: [PR] [SPARK-54520][INFRA] Ignore Missing Packages in CI free_disk_space Step [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/11/26 02:14:19 UTC, 2 replies.
- [PR] [SPARK-54521][SQL] Add to and from WKB for Geometry type [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/11/26 02:27:14 UTC, 3 replies.
- Re: [PR] [SPARK-54522][SPARK-54523] Fix default resolution during variant pushdown and prepare test suites for default enablement of shredding and variant logical type annotation [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2025/11/26 03:24:04 UTC, 0 replies.
- [PR] [SPARK-54486][PYTHON][TESTS][4.0] Backport the pyarrow version check of `test_to_feather` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/26 03:24:28 UTC, 3 replies.
- Re: [PR] [WIP][SPARK-54316][CORE][PYTHON][SQL] Consolidate `GroupPandasIterUDFSerializer` with `GroupPandasUDFSerializer` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/26 03:49:49 UTC, 2 replies.
- Re: [PR] [SPARK-54523] Fix default resolution during variant pushdown and prepare test suites for default enablement of shredding and variant logical type annotation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/11/26 04:48:10 UTC, 1 replies.
- Re: [PR] [SPARK-54517][PYTHON][TESTS] Added utility decorators for Spark Connect parity tests [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/26 06:19:45 UTC, 4 replies.
- Re: [PR] [SPARK-54523][SQL] Fix default resolution during variant pushdown [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/11/26 06:50:53 UTC, 1 replies.
- [PR] [SPARK-54525][SQL] Disable nested struct coercion in MERGE INTO [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/11/26 07:05:22 UTC, 6 replies.
- [PR] [SPARK-53484][BUILD] Clean up Connect JDBC driver dependencies [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/26 07:24:40 UTC, 0 replies.
- Re: [PR] [SPARK-54524][BUILD] Fix Connect JDBC driver dependencies [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/26 09:53:00 UTC, 2 replies.
- [PR] [SPARK-54527][CORE] Remove `getRecoveryPath` method from `YarnShuffleService.java` [spark] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2025/11/26 12:17:10 UTC, 4 replies.
- [PR] [SPARK-54446][ML] FPGrowth supports local filesystem with Arrow file format [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/26 12:27:29 UTC, 15 replies.
- Re: [PR] [SPARK-53733][SQL] Delay `resolveColsLastResort` until all previous `UnresolvedAlias`es are resolved [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/11/26 12:41:00 UTC, 0 replies.
- [PR] [SPARK-XXX][CONNECT] Close URLClassLoader eagerly to avoid OOM [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/11/26 13:13:18 UTC, 0 replies.
- [PR] [SPARK-54529][BUILD] Upgrade `commons-codec` to 1.20.0 [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/11/26 13:19:07 UTC, 1 replies.
- Re: [PR] [SPARK-54528][CONNECT] Close URLClassLoader eagerly to avoid OOM [spark] - posted by "vicennial (via GitHub)" <gi...@apache.org> on 2025/11/26 14:20:24 UTC, 1 replies.
- [PR] [SPARK-54481][WIP][TEST][PYTHON][CONNECT]skip skipping [spark] - posted by "xianzhe-databricks (via GitHub)" <gi...@apache.org> on 2025/11/26 14:42:24 UTC, 0 replies.
- Re: [PR] [SPARK-54462][SQL] Add `SupportsV1OverwriteWithSaveAsTable ` Table mixin [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2025/11/26 16:42:45 UTC, 2 replies.
- [PR] [SPARK-53934][SQL][FOLLOW] Close Spark connect client connection and mark as closed [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/11/26 17:25:04 UTC, 0 replies.
- [PR] [SPARK-54507][SQL] Add time_bucket function for TIME type bucketing [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/11/26 17:58:26 UTC, 2 replies.
- Re: [PR] [SPARK-53934][SQL][FOLLOWUP] Close Spark connect client connection and mark as closed [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/11/26 18:54:19 UTC, 17 replies.
- [PR] [SPARK-54517][PYTHON][TESTS][FOLLOWUP] Fix a typehint using ellipsis [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/11/26 19:07:13 UTC, 0 replies.
- [PR] [SPARK-54531] Introduce ArrowStreamAggPandasUDFSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/11/26 19:42:41 UTC, 0 replies.
- Re: [PR] [SPARK-54517][PYTHON][TESTS][FOLLOWUP] Fix typehints using ellipsis [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/26 19:53:15 UTC, 1 replies.
- [PR] Spark 53597/docs/add astable examples [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/11/26 20:49:16 UTC, 0 replies.
- Re: [PR] [SPARK-54485][SPARK-54494][PYTHON][TESTS][4.0] Re-enable tests in test_parity_udf_profiler and test_parity_memory_profiler [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/11/26 22:53:31 UTC, 1 replies.
- [PR] [SPARK-54532][PYTHON] Add support for sqlstate for PySparkException [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/26 23:18:57 UTC, 10 replies.
- Re: [PR] [SPARK-53597][PYTHON][SQL][DOCS] Add `asTable()` and `TableArg` examples [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/26 23:28:27 UTC, 2 replies.
- Re: [PR] [SPARK-54462][SQL] Add `SupportsV1OverwriteWithSaveAsTable` Table mixin [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/26 23:38:54 UTC, 1 replies.
- [PR] [SPARK-54522] Variant test suite fixes for shredding configs [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2025/11/27 00:04:34 UTC, 0 replies.
- Re: [PR] [TEST-ONLY] A branch-3.5 PR to check the CI [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/27 00:36:58 UTC, 1 replies.
- Re: [PR] [SPARK-54522][SQL][TEST] Variant test suite fixes for shredding configs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/27 01:18:25 UTC, 3 replies.
- [PR] [WIP][SPARK-54533][UI] Set metric executorSource.METRIC_RESULT_SIZE with proper value [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2025/11/27 02:03:51 UTC, 0 replies.
- Re: [PR] [SPARK-54531][PYTHON] Introduce ArrowStreamAggPandasUDFSerializer [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/27 02:43:27 UTC, 4 replies.
- Re: [PR] [SPARK-54446][ML][CONNECT] FPGrowth supports local filesystem with Arrow file format [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/11/27 02:48:20 UTC, 11 replies.
- [PR] [SPARK-54534][SQL] Migrate Hive-related legacy error codes to proper error conditions [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2025/11/27 05:37:10 UTC, 1 replies.
- Re: [PR] [SPARK-53482][SQL] MERGE INTO support for when source has less nested field than target [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/11/27 06:12:22 UTC, 1 replies.
- Re: [PR] [SPARK-54505][UI][SHUFFLE] Correct the arguments order of createMetrics call in makeNegative [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2025/11/27 06:18:35 UTC, 4 replies.
- Re: [PR] [SPARK-54525][SQL] Disable nested struct coercion in MERGE INTO under a config [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/11/27 06:23:48 UTC, 3 replies.
- [PR] [SPARK-54536[CORE] Shuffle FetchWaitTime missing first call fetchUpToMaxBytes() open block rpc response time [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2025/11/27 08:01:20 UTC, 3 replies.
- [PR] [SPARK-54537][CONNECT] Fix SparkConnectDatabaseMetaData getSchemas/getTables on catalogs missing namespace capbalitity [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/27 09:01:59 UTC, 6 replies.
- [PR] [SPARK-54539][SQL] TaskMetrics add spillTime metrics [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2025/11/27 10:17:50 UTC, 0 replies.
- [PR] [SPARK-54540][CONNECT] Couples of minor fix for Connect JDBC driver [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/11/27 10:41:39 UTC, 2 replies.
- [PR] [SPARK-53614][PYTHON][TESTS][FOLLOW-UP] Fix the maxBytes config in tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/11/27 13:46:54 UTC, 1 replies.
- [PR] [SPARK-54481][SPARK-54495][SPARK-54483][WIP][TEST][PYTHON][CONNECT]Fix failing tests [spark] - posted by "xianzhe-databricks (via GitHub)" <gi...@apache.org> on 2025/11/27 14:38:46 UTC, 0 replies.
- Re: [PR] [SPARK-54481][SPARK-54495][SPARK-54483][WIP][TEST][PYTHON][CONNECT]skip skipping [spark] - posted by "xianzhe-databricks (via GitHub)" <gi...@apache.org> on 2025/11/27 14:41:14 UTC, 2 replies.
- Re: [PR] [SPARK-54481][SPARK-54495][SPARK-54483][TEST][PYTHON][CONNECT]Fix failing tests [spark] - posted by "xianzhe-databricks (via GitHub)" <gi...@apache.org> on 2025/11/27 14:46:01 UTC, 2 replies.
- Re: [PR] [SPARK-54462][SQL] Add `SupportsV1OverwriteWithSaveAsTable` mixin for `TableProvider` [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2025/11/27 15:53:26 UTC, 4 replies.
- [PR] [SPARK-54541][SQL] Rename _LEGACY_ERROR_TEMP_1007 and add sqlState [spark] - posted by "AbinayaJayaprakasam (via GitHub)" <gi...@apache.org> on 2025/11/27 18:28:40 UTC, 2 replies.
- [PR] [SPARK-54206][CONNECT][FOLLOWUP] Use VARBINARY type and reasonable max length for BinaryType [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/11/27 20:11:22 UTC, 5 replies.
- [PR] [SPARK-54544][PYTHON] Enable flake8 F811 check [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/27 22:15:00 UTC, 6 replies.
- Re: [PR] [SPARK-53283][CONNECT] Make CheckpointCommand/RemoveCachedRemoteRelationCommand in SparkConnectPlanner side effect free [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/28 00:27:43 UTC, 1 replies.
- [PR] [SPARK-54545][INFRA] Allow test case pattern for run-tests [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/11/28 00:30:14 UTC, 1 replies.
- [PR] [WIP][DO-NOT-MERGE] Debugging SS Spark Connect compat test failures in master <> 4.0 [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/11/28 00:49:27 UTC, 1 replies.
- [PR] [SPARK-45720][BUILD][DSTREAM][KINESIS] Upgrade KCL to 2.7.1 and remove AWS SDK for Java 1.x dependency [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/11/28 01:39:15 UTC, 5 replies.
- Re: [PR] [SPARK-49644][SQL] Support drop multi-level partition V2 table with partial partition spec [spark] - posted by "Zouxxyy (via GitHub)" <gi...@apache.org> on 2025/11/28 02:30:43 UTC, 1 replies.
- Re: [PR] [SPARK-54446][SQL][ML][CONNECT] FPGrowth supports local filesystem with Arrow file format [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/11/28 04:58:05 UTC, 0 replies.
- [PR] [SPARK-54548][CONNECT] Add zstandard into python library in Spark Connect post-merge builds [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/11/28 06:19:13 UTC, 1 replies.
- [PR] [SPARK-54547][CORE] Use 'host' instead of 'hostPort' in TaskScheduler executor loss logs [spark] - posted by "Xtpacz (via GitHub)" <gi...@apache.org> on 2025/11/28 06:51:11 UTC, 0 replies.
- Re: [PR] [4.0][SPARK-54481][SPARK-54495][SPARK-54483][TEST][PYTHON][CONNECT]Fix failing tests [spark] - posted by "xianzhe-databricks (via GitHub)" <gi...@apache.org> on 2025/11/28 10:57:12 UTC, 2 replies.
- Re: [PR] [SPARK-54526][SQL] Rename _LEGACY_ERROR_TEMP_1133 and add sqlState [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/11/28 17:00:54 UTC, 1 replies.
- Re: [PR] [SPARK-54548][INFRA] Install `zstandard` python library in Spark Connect post-merge builds [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/28 22:06:32 UTC, 0 replies.
- Re: [PR] [SPARK-54547][CORE] Rename `hostPort` variable to `host` in `TaskSchedulerImpl.(executorLost|logExecutorLoss)` methods [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/28 22:14:37 UTC, 2 replies.
- [PR] [SPARK-54550][CONNECT] Handle ConnectException gracefully in SparkConnectStatement.close() [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/11/28 23:27:21 UTC, 2 replies.
- [PR] [SPARK-54551][CONNECT] Fix random hangs in SparkConnectJdbcDataTypeSuite [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/11/28 23:43:11 UTC, 0 replies.
- [PR] [SPARK-54552][CONNECT] Fix getString() method for BINARY data type in SparkConnectResultSet [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/11/29 00:20:43 UTC, 1 replies.
- Re: [PR] [SPARK-53321] Make RegisterUserDefinedDataSource in SparkConnectPlanner side effect free [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/29 00:27:53 UTC, 1 replies.
- Re: [PR] [SPARK-53320] Make RegisterUserDefinedTableFunction in SparkConnectPlanner side effect free [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/11/29 00:27:54 UTC, 1 replies.
- Re: [PR] [SPARK-54533][UI] Set metric ExecutorSource.METRIC_RESULT_SIZE with proper value [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2025/11/29 00:32:43 UTC, 0 replies.
- Re: [PR] [SPARK-54551][CONNECT][TESTS] Fix random hangs in SparkConnectJdbcDataTypeSuite [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/29 00:51:52 UTC, 4 replies.
- Re: [PR] [SPARK-54550][CONNECT] Handle `ConnectException` gracefully in `SparkConnectStatement.close()` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/29 02:56:50 UTC, 0 replies.
- Re: [PR] [SPARK-54552][CONNECT] Fix `SparkConnectResultSet.getString` to handle BINARY data type with `UTF_8` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/11/29 02:57:48 UTC, 1 replies.
- [PR] Spark 54554 dpp command result [spark] - posted by "dwsmith1983 (via GitHub)" <gi...@apache.org> on 2025/11/29 06:26:20 UTC, 0 replies.
- Re: [PR] [SPARK-52923][CORE] Allow ShuffleManager to control push merge during shuffle registration [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/11/30 03:14:56 UTC, 1 replies.
- [PR] [SPARK-54555][PYTHON] Enable Arrow-optimized Python UDFs by default [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/11/30 21:24:12 UTC, 4 replies.
- Re: [PR] [SPARK-54555][PYTHON] Enable Arrow-optimized Python UDFs and Arrow-based PySpark IPC by default [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/11/30 22:18:37 UTC, 0 replies.
- [PR] [SPARK-44976] Utils.getCurrentUserName should return the full principal name [spark] - posted by "eubnara (via GitHub)" <gi...@apache.org> on 2025/11/30 23:16:25 UTC, 0 replies.
- Re: [PR] [SPARK-44976][CORE] Preserve full principal user name on executor side [spark] - posted by "eubnara (via GitHub)" <gi...@apache.org> on 2025/11/30 23:16:42 UTC, 0 replies.