reviews@spark.apache.org, 2025-09

You are viewing a plain text version of this content. The canonical link for it is here.

- Re: [PR] [SPARK-52032][SQL] Fix orc filter pushdown with null-safe equality operator [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/01 00:33:59 UTC, 0 replies.
- Re: [PR] [SPARK-51847][PYTHON] Extend PySpark testing framework util functions with basic data tests [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/01 00:34:00 UTC, 0 replies.
- Re: [PR] [SPARK-48234][SQL] Fix previous reader checks in Vectorized DELTA_BYTE_ARRAY decoder [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/01 00:34:00 UTC, 0 replies.
- [PR] [SPARK-53433][TESTS][FOLLOw-UP] Make the test compatible with PyArrow 0.15 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/09/01 01:21:31 UTC, 0 replies.
- Re: [PR] [SPARK-53444] Rework execute immediate [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/01 02:01:07 UTC, 106 replies.
- Re: [PR] [SPARK-53422][SQL][TEST] Make SPARK-30269 test case robust [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/09/01 02:25:53 UTC, 1 replies.
- Re: [PR] [SPARK-53437][SQL] InterpretedUnsafeProjection shall setNull4Bytes for YearMonthIntervalType field [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/09/01 02:27:19 UTC, 4 replies.
- Re: [PR] [SPARK-48547][DEPLOY] Add opt-in flag to have SparkSubmit automatically call System.exit after user code main method exits [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/09/01 02:32:22 UTC, 1 replies.
- [PR] Add if to avoid unnecessary calls [spark] - posted by "flaming-archer (via GitHub)" <gi...@apache.org> on 2025/09/01 02:34:03 UTC, 0 replies.
- Re: [PR] [SPARK-53435][SQL] Fix race condition in CachedRDDBuilder [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/01 02:47:41 UTC, 3 replies.
- Re: [PR] [SPARK-53401][SQL] Enable Direct Passthrough Partitioning in the DataFrame API [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/01 02:52:26 UTC, 42 replies.
- Re: [PR] [SPARK-53421][SPARK-53377][SDP] Propagate Logical Plan ID in SDP Analysis [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/01 03:15:31 UTC, 1 replies.
- Re: [PR] [SPARK-53413] Shuffle cleanup for commands [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/01 03:19:29 UTC, 2 replies.
- Re: [PR] [SPARK-53399][SQL] Restore CollapseProject to merge unrelated expressions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/01 03:31:17 UTC, 17 replies.
- Re: [PR] [SPARK-53329][CONNECT] Improve exception handling when adding artifacts [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/01 03:32:06 UTC, 1 replies.
- Re: [PR] [SPARK-53108][SQL] Implement the time_diff function in Scala [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/01 03:34:45 UTC, 1 replies.
- Re: [PR] [SPARK-53420][BUILD] Upgrade Parquet to 1.16.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/01 04:36:15 UTC, 9 replies.
- Re: [PR] [SPARK-53156][CORE] Track Driver Memory Metrics when the Application ends [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/09/01 04:56:53 UTC, 2 replies.
- Re: [PR] [SPARK-53157][CORE] Decouple driver and executor polling intervals [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/09/01 05:00:12 UTC, 3 replies.
- Re: [PR] Increase report interval of spaming logs to 10 seconds [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/09/01 05:07:30 UTC, 0 replies.
- Re: [PR] [SPARK-53443][PYTHON] Update python to `SPDX-license` [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2025/09/01 07:42:59 UTC, 1 replies.
- Re: [PR] [SPARK-52449][CONNECT][PYTHON][ML] Make datatypes for Expression.Literal.Map/Array optional [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/09/01 09:53:55 UTC, 8 replies.
- Re: [PR] [SPARK-53445][SQL]Add if to avoid unnecessary calls [spark] - posted by "TharwatMella (via GitHub)" <gi...@apache.org> on 2025/09/01 10:37:57 UTC, 1 replies.
- Re: [PR] [SPARK-49933][SQL] Push WHEN NOT MATCHED BY SOURCE predicates to target [spark] - posted by "tokoko (via GitHub)" <gi...@apache.org> on 2025/09/01 11:42:57 UTC, 0 replies.
- [PR] [SPARK-53438] Fix Product type handling in convertToCatalyst [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/09/01 13:16:24 UTC, 1 replies.
- [PR] fix [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/09/01 14:45:26 UTC, 1 replies.
- Re: [PR] [SPARK-53405] Add metrics recording for latency of Spark app state transition [spark-kubernetes-operator] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/09/01 16:23:42 UTC, 5 replies.
- [PR] [SPARK-49386][CORE][SQL][FOLLOWUP] More accurate memory tracking for memory based spill threshold [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/01 16:43:49 UTC, 12 replies.
- [PR] [WIP][SPARK-XXXX] Rocks db state store orphan removal protection [spark] - posted by "PedroMDuarte (via GitHub)" <gi...@apache.org> on 2025/09/01 21:01:44 UTC, 3 replies.
- Re: [PR] [SPARK-51699][BUILD] Upgrade to Apache parent pom 34 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/01 22:14:19 UTC, 8 replies.
- [PR] Bump github.com/stretchr/testify from 1.10.0 to 1.11.1 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/09/01 23:48:21 UTC, 0 replies.
- Re: [PR] Bump github.com/stretchr/testify from 1.10.0 to 1.11.0 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/09/01 23:48:21 UTC, 1 replies.
- Re: [PR] [SPARK-53433][TESTS][FOLLOW-UP] Make the test compatible with PyArrow 15.0.0 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/09/02 00:30:26 UTC, 1 replies.
- Re: [PR] [SPARK-53333][SS] Enable StateDataSource with state checkpoint v2 (only readChangeFeed) [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/09/02 01:04:15 UTC, 6 replies.
- [PR] [SPARK-53449][SQL] Simply options for builtin Datasource Scan related classes [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/09/02 03:28:48 UTC, 4 replies.
- [PR] [WIP][SPARK-53450] Nulls are filled after converting hive table scan to logical relation [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/09/02 04:21:43 UTC, 0 replies.
- [PR] [SPARK-53433][TESTS][FOLLOW-UP] Add a test for aggregation [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/02 04:40:41 UTC, 2 replies.
- Re: [PR] [SPARK-52346][SDP] Propagate partition columns from destination for BatchTableWrite [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/09/02 04:50:44 UTC, 7 replies.
- Re: [PR] [SPARK-52509][K8S] Cleanup shuffles from fallback storage [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2025/09/02 05:16:25 UTC, 10 replies.
- Re: [PR] [SPARK-53207][SDP] Send Pipeline Event to Client Asynchronously [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/09/02 06:02:21 UTC, 3 replies.
- Re: [PR] [SPARK-52346][SDP] Fix counter initialization and increment logic for flow retries [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/09/02 06:10:19 UTC, 2 replies.
- [PR] [SPARK-53451][PYTHON][TESTS] Fix scheduled job for python 3.13 no GIL [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/02 06:22:50 UTC, 3 replies.
- Re: [PR] [SPARK-53438][CONNECT][SQL] Use CatalystConverter in LiteralExpressionProtoConverter [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/02 06:54:43 UTC, 23 replies.
- Re: [PR] [SPARK-51756][CORE] Computes RowBasedChecksum in ShuffleWriters [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2025/09/02 07:29:48 UTC, 68 replies.
- [PR] [SPARK-53452][PYTHON] `from_arrow_type` should respect `valueContainsNull` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/02 07:52:37 UTC, 1 replies.
- [PR] [SPARK-53453][PYTHON][ML] Unblock 'torch<2.6.0' [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/02 08:14:33 UTC, 7 replies.
- Re: [PR] [SPARK-53450] Nulls are filled unexpectedly after converting hive table scan to logical relation [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/09/02 08:23:56 UTC, 4 replies.
- Re: [PR] [SPARK-53434][SQL] ColumnarRow's get should also check isNullAt [spark] - posted by "WangGuangxin (via GitHub)" <gi...@apache.org> on 2025/09/02 09:17:22 UTC, 5 replies.
- Re: [PR] [SPARK-53430] Prevent unintended JSON serialization with @JsonIgnore [spark-kubernetes-operator] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/09/02 09:22:00 UTC, 1 replies.
- Re: [PR] [SPARK-51820][FOLLOWUP][CONNECT] Replace literal in `SortOrder` only under `Sort` operator [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/09/02 09:47:17 UTC, 5 replies.
- Re: [PR] [SPARK-53127][SQL] Enable LIMIT ALL to override recursion row limit [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/02 09:49:57 UTC, 48 replies.
- Re: [PR] [SPARK-53342][SQL][3.5] Fix Arrow converter to handle multiple record batches in single IPC stream [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2025/09/02 11:40:45 UTC, 4 replies.
- [PR] fix always true/false literals for jdbc connectors [spark] - posted by "PetarVasiljevic-DB (via GitHub)" <gi...@apache.org> on 2025/09/02 13:35:05 UTC, 0 replies.
- Re: [PR] [SPARK-53454][SQL] Fix AlwaysTrue/AlwaysFalse predicate translation in JDBC connectors [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/02 13:53:21 UTC, 12 replies.
- Re: [PR] [SPARK-52807][SDP] Proto changes to support analysis inside Declarative Pipelines query functions [spark] - posted by "SCHJonathan (via GitHub)" <gi...@apache.org> on 2025/09/02 14:58:52 UTC, 20 replies.
- Re: [PR] [SPARK-53441][PS] Bools `|`/`&`/`^` None should fail under ANSI [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/09/02 17:59:14 UTC, 4 replies.
- Re: [PR] [SPARK-53435][SQL][3.5] Fix race condition in CachedRDDBuilder [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/02 19:27:13 UTC, 1 replies.
- [PR] [WIP[SPARK-53455][CONNECT] Add `CloneSession` RPC [spark] - posted by "vicennial (via GitHub)" <gi...@apache.org> on 2025/09/02 19:52:34 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-53455][CONNECT] Add `CloneSession` RPC [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/09/02 20:54:22 UTC, 17 replies.
- [PR] [SPARK-53457] Expose fabric8 dependencies as api for downstream users [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/09/02 21:36:24 UTC, 8 replies.
- Re: [PR] [SPARK-53029][PYTHON] Support return type coercion for Arrow Python UDTFs [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2025/09/02 21:36:31 UTC, 21 replies.
- [PR] [SPARK-53458][INFRA] Add daily dry-run release test GitHub Action jobs for Spark 4.0/3.5 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/02 22:04:59 UTC, 6 replies.
- [PR] [SPARK-53332][SS] Enable StateDataSource with state checkpoint v2 (only snapshotStartBatchId option) [spark] - posted by "dylanwong250 (via GitHub)" <gi...@apache.org> on 2025/09/02 22:19:16 UTC, 11 replies.
- [PR] [SPARK-53460][BUILD] Upgrade `analyticsaccelerator-s3` to 1.3.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/02 22:58:15 UTC, 3 replies.
- [PR] [SPARK-53461][PYTHON][DOCS] Clarify pie plot parameter `subplots` [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/09/02 23:18:31 UTC, 3 replies.
- [PR] [SPARK-53462][INFRA] Upgrade `actions/checkout` to v5 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/02 23:26:42 UTC, 0 replies.
- Re: [PR] [SPARK-53442]Make PrometheusServlet compatible with OpenMetrics [spark] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/09/02 23:28:23 UTC, 11 replies.
- [PR] [SPARK-53463] Upgrade `actions/checkout` to v5 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/02 23:33:04 UTC, 2 replies.
- Re: [PR] [SPARK-53462] Upgrade `actions/checkout` to v5 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/02 23:58:23 UTC, 1 replies.
- [PR] [SPARK-53464][K8S][INFRA] Update `setup-minikube` to v0.0.20 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/03 00:12:29 UTC, 2 replies.
- [PR] [MINOR][BUILD] Remove `preview` postfix in documentation.md when releasing [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/09/03 00:42:37 UTC, 5 replies.
- [PR] [MINOR][BUILD] Remove todos for testing in the real releases [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/09/03 00:46:31 UTC, 2 replies.
- [PR] [MINOR][BUILD] Fix download of preview releases in the news [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/09/03 00:50:44 UTC, 2 replies.
- [PR] [SPARK-53465] Use `4.1.0-preview1` instead of `RC1` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/03 02:27:40 UTC, 3 replies.
- [PR] [SPARK-53466] Use Spark `4.0.1` instead of `4.0.0` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/03 02:34:03 UTC, 2 replies.
- [PR] [SPARK-53467] Improve `merge_spark_pr.py` to accept PR numbers as a CLI argument [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/03 02:41:13 UTC, 3 replies.
- [PR] [SPARK-53468] Update `setup-minikube` to v0.0.20 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/03 02:46:05 UTC, 2 replies.
- Re: [PR] [SPARK-53449][SQL] Simplify options for builtin Datasource Scan related classes [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/09/03 02:58:26 UTC, 0 replies.
- [PR] [SPARK-53446][CORE] Optimize BlockManager remove operations with cach… [spark] - posted by "JacobZheng0927 (via GitHub)" <gi...@apache.org> on 2025/09/03 04:01:55 UTC, 0 replies.
- [PR] commit [spark] - posted by "richardc-db (via GitHub)" <gi...@apache.org> on 2025/09/03 04:45:17 UTC, 1 replies.
- [PR] [PYTHON] Make Hybrid queue class [spark] - posted by "richardc-db (via GitHub)" <gi...@apache.org> on 2025/09/03 05:15:22 UTC, 0 replies.
- Re: [PR] [SPARK-52659][SQL]Misleading modulo error message in ansi mode [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/09/03 05:40:28 UTC, 4 replies.
- [PR] [SPARK-53469] Ability to cleanup shuffle in Thrift server [spark] - posted by "karuppayya (via GitHub)" <gi...@apache.org> on 2025/09/03 05:40:51 UTC, 2 replies.
- [PR] [PYTHON] Refactor arrow python runner code [spark] - posted by "richardc-db (via GitHub)" <gi...@apache.org> on 2025/09/03 06:16:15 UTC, 0 replies.
- [PR] [SPARK-51739][PYTHON] Disable spark.sql.execution.arrow.pyspark.validateSchema.enabled by default [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/09/03 06:35:45 UTC, 0 replies.
- Re: [PR] [SPARK-53339][CONNECT] Fix an issue which occurs when an operation in pending state is interrupted [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/09/03 06:55:13 UTC, 1 replies.
- [PR] [SPARK-53470][SQL] ExtractValue expressions should always do type checking [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/03 07:23:42 UTC, 10 replies.
- Re: [PR] [SPARK-43368] Use `libnss_wrapper` to fake passwd entry [spark-docker] - posted by "Reamer (via GitHub)" <gi...@apache.org> on 2025/09/03 07:39:04 UTC, 1 replies.
- [PR] [SPARK-53471] Correct entrypoint.sh for Openshift [spark-docker] - posted by "Reamer (via GitHub)" <gi...@apache.org> on 2025/09/03 07:56:17 UTC, 1 replies.
- Re: [PR] [SPARK-53325] Support Prometheus 2.0 text-based-format and best practices for metrics naming [spark-kubernetes-operator] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/09/03 08:23:11 UTC, 1 replies.
- [PR] [SPARK-53472][DOCS] Fix jekyll-redirect-from template and generated html files [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/09/03 08:50:26 UTC, 5 replies.
- [PR] RabbitMQ stream source [spark] - posted by "keksmd (via GitHub)" <gi...@apache.org> on 2025/09/03 08:53:20 UTC, 2 replies.
- [PR] Good evening [spark] - posted by "Bodke5910 (via GitHub)" <gi...@apache.org> on 2025/09/03 11:20:55 UTC, 1 replies.
- Re: [PR] [SPARK-51739][PYTHON][FOLLOW-UP] Disable spark.sql.execution.arrow.pyspark.validateSchema.enabled by default [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/09/03 12:03:35 UTC, 1 replies.
- [PR] [MINOR][DOCS] Update comments for ResolveCoalesceHints [spark] - posted by "tomscut (via GitHub)" <gi...@apache.org> on 2025/09/03 12:18:35 UTC, 2 replies.
- [PR] [SQL] Remove overrideIfExists check in SqlScriptingLocalVariableManager [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2025/09/03 16:01:57 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-53438][CONNECT][SQL] Use CatalystConverter in LiteralExpressionProtoConverter [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/09/03 16:11:44 UTC, 1 replies.
- [PR] [SPARK-53473] Publish Apache Spark 4.1.0-preview1 to docker registry [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/03 16:52:37 UTC, 0 replies.
- [PR] [SPARK-53475] Use `setup-minikube` in `spark-docker` repository [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/03 17:29:33 UTC, 2 replies.
- [PR] [SPARK-53474][SQL] Add DATA_SOURCE_V2_EXPR_FOLDING [spark] - posted by "yhuang-db (via GitHub)" <gi...@apache.org> on 2025/09/03 17:29:58 UTC, 0 replies.
- Re: [PR] [SPARK-53473] Publish Apache Spark `4.1.0-preview1` to docker registry [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/03 17:38:02 UTC, 2 replies.
- Re: [PR] [SPARK-52780] Add ToLocalIterator and Arrow Record Streaming [spark-connect-go] - posted by "caldempsey (via GitHub)" <gi...@apache.org> on 2025/09/03 18:09:21 UTC, 4 replies.
- Re: [PR] [SPARK-53474][SQL] Add conf DATA_SOURCE_V2_EXPR_FOLDING [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/09/03 18:16:22 UTC, 4 replies.
- [PR] [SPARK-53459][CORE] use ReadOnlySparkConf in more places [spark] - posted by "timarmstrong (via GitHub)" <gi...@apache.org> on 2025/09/03 18:57:53 UTC, 1 replies.
- [PR] [SPARK-53477] Add `integration-test-ubuntu-spark41` GitHub Action job [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/03 19:37:10 UTC, 3 replies.
- Re: [PR] [SPARK-53378][PYTHON] Enable @udtf decorator to support returnType as first positional argument [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/09/03 20:22:08 UTC, 0 replies.
- Re: [PR] [SPARK-52780] Add StreamRows and Arrow Record Streaming [spark-connect-go] - posted by "caldempsey (via GitHub)" <gi...@apache.org> on 2025/09/03 20:35:01 UTC, 4 replies.
- [PR] [SPARK-53479][PS] Align `==` behavior with pandas when comparing against scalar under ANSI [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/09/03 21:29:43 UTC, 3 replies.
- Re: [PR] [SPARK-52218][SS] RabbitMQ stream source [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/09/03 23:14:36 UTC, 2 replies.
- Re: [PR] [SPARK-53481][PYTHON] Make Hybrid queue class [spark] - posted by "richardc-db (via GitHub)" <gi...@apache.org> on 2025/09/03 23:27:47 UTC, 5 replies.
- Re: [PR] [SPARK-53480][PYTHON] Refactor arrow python runner code [spark] - posted by "richardc-db (via GitHub)" <gi...@apache.org> on 2025/09/03 23:27:57 UTC, 5 replies.
- Re: [PR] [SPARK-53355][PYTHON][SQL] test python udf type behavior [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/04 00:10:48 UTC, 2 replies.
- Re: [PR] [SPARK-52306][SQL] Add support of ALTER TABLE ... UNSET SERDEPROPERTIES [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/04 00:25:43 UTC, 1 replies.
- Re: [PR] [SPARK-51534][Core] Improve parquet read performance by reducing unnecessary operations when converting parquet to row [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/04 00:25:45 UTC, 3 replies.
- Re: [PR] [SPARK-50785][SQL][FOLLOWUP] Remove overrideIfExists check in SqlScriptingLocalVariableManager [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/04 00:34:08 UTC, 1 replies.
- [PR] [SPARK-53482][SQL] MERGE INTO support nested case where source has less fields than target [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/09/04 01:10:30 UTC, 8 replies.
- Re: [PR] [SPARK-53459][CORE] Use ReadOnlySparkConf in more places [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/04 02:08:34 UTC, 1 replies.
- [PR] [MINOR][SQL][CORE][ML] Remove dangling right curly braces in log [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/09/04 03:02:48 UTC, 0 replies.
- [PR] [SPARK-53483] Support disable code-gen for sort merge join other than FULL OUTER and Existence [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2025/09/04 03:21:15 UTC, 0 replies.
- [PR] [SPARK-52348][SDP] Trait for PipelinesHandler [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/09/04 04:23:03 UTC, 0 replies.
- [PR] [SPARK-53485][DOCS][SECURITY] Add Proxy User Instructions [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/09/04 06:11:20 UTC, 3 replies.
- Re: [PR] [DRAFT] JDBC Driver for Spark Connect Server [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/09/04 06:37:44 UTC, 7 replies.
- [PR] made changes to readme file talked about feature1 [spark] - posted by "banaluhemanth-hub (via GitHub)" <gi...@apache.org> on 2025/09/04 07:00:56 UTC, 1 replies.
- [PR] [SPARK-53486][ML][PYTHON] Avoid setting `weights_only=False` in torch model load [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/04 07:15:16 UTC, 10 replies.
- [PR] [WIP][CONNECT] Reject on second ExecutePlan with an operation id that has already completed [spark] - posted by "nija-at (via GitHub)" <gi...@apache.org> on 2025/09/04 09:29:45 UTC, 0 replies.
- [PR] [SQL] Update CollationTypeCoercion to be compatible with single-pass Analyzer logic [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/09/04 11:27:37 UTC, 0 replies.
- [PR] [SPARK-53489] Remove using `v2ColumnsToStructType` in `ApplyDefaultCollationToStringType` [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2025/09/04 11:32:26 UTC, 2 replies.
- [PR] [SPARK-53487] [] Improve comments in `NormalizePlan.scala` [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/09/04 12:57:21 UTC, 0 replies.
- Re: [PR] [SPARK-53351][CORE] Use consistent string type blockId for block data access in external block handler [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/09/04 13:07:12 UTC, 0 replies.
- Re: [PR] [SPARK-53309][SQL] Allow to propagate extra conf to executor [spark] - posted by "zhouyuan (via GitHub)" <gi...@apache.org> on 2025/09/04 14:03:58 UTC, 1 replies.
- [PR] [SPARK-53490] Fix Protobuf conversion in observed metrics [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/09/04 14:11:00 UTC, 0 replies.
- Re: [PR] [SPARK-47280][SQL] Remove timezone limitation for ORACLE TIMESTAMP WITH TIMEZONE [spark] - posted by "melin (via GitHub)" <gi...@apache.org> on 2025/09/04 14:48:14 UTC, 0 replies.
- [PR] [SPARK-53491][SS] Fix exponential formatting of inputRowsPerSecond an… [spark] - posted by "jayantdb (via GitHub)" <gi...@apache.org> on 2025/09/04 15:43:55 UTC, 0 replies.
- Re: [PR] [SPARK-53491][SS] Fix exponential formatting of inputRowsPerSecond and processedRowsPerSecond in progress metrics JSON [spark] - posted by "jayantdb (via GitHub)" <gi...@apache.org> on 2025/09/04 16:03:50 UTC, 17 replies.
- [PR] [SPARK-53399][SQL] Collapse Python UDFs [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/09/04 16:06:38 UTC, 15 replies.
- Re: [PR] [SPARK-53487] [SQL] Improve comments in `NormalizePlan.scala` [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2025/09/04 16:20:20 UTC, 1 replies.
- Re: [PR] [SPARK-53490][CONNECT][SQL] Fix Protobuf conversion in observed metrics [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/09/04 16:29:42 UTC, 3 replies.
- [PR] [SPARK-xxxx][BUILD] Upgrade Netty to 4.1.126.Final [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2025/09/04 16:59:05 UTC, 2 replies.
- [PR] [SPARK-53493] Add `pi-preview.yaml` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/04 17:06:25 UTC, 2 replies.
- [PR] [SPARK-52431][SDP][FOLLOWUP] Remove unused scalatest Matchers from SparkPipelinesSuite [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/04 17:52:07 UTC, 1 replies.
- Re: [PR] [SPARK-53494][BUILD] Upgrade `Netty` to 4.1.126.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/04 20:09:48 UTC, 0 replies.
- Re: [PR] [SPARK-52431][SDP][TESTS][FOLLOWUP] Remove unused scalatest Matchers from SparkPipelinesSuite [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/04 20:12:06 UTC, 1 replies.
- [PR] [SPARK-53495] Remove unused 'persistentVolume' access from operator rbac [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/09/04 20:17:18 UTC, 3 replies.
- Re: [PR] [SPARK-53496][SQL][CORE][ML][SS][K8S][YARN] Remove dangling right curly braces in log [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/04 20:27:29 UTC, 2 replies.
- [PR] Disallow `/` between Decimal and float [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/09/04 21:38:53 UTC, 0 replies.
- [PR] [SPARK-53402] Support Direct Passthrough Partitioning Dataset API in Spark Connect [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2025/09/04 22:55:20 UTC, 0 replies.
- Re: [PR] [SPARK-53402][CONNECT] Support Direct Passthrough Partitioning Dataset API in Spark Connect [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2025/09/04 23:48:42 UTC, 2 replies.
- Re: [PR] [SPARK-52407][SQL] Add support for Theta Sketch [spark] - posted by "cboumalh (via GitHub)" <gi...@apache.org> on 2025/09/04 23:58:21 UTC, 60 replies.
- Re: [PR] [SPARK-52326][SQL] Add partitions related ExternalCatalogEvent and post them in corresponding operations [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/05 00:26:47 UTC, 1 replies.
- Re: [PR] [SPARK-50903][CONNECT] Cache logical plans after analysis [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/05 00:26:50 UTC, 1 replies.
- Re: [PR] [SPARK-53497][PS] Disallow `/`|`//`|`*` between Decimal and float under ANSI [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/09/05 00:34:51 UTC, 2 replies.
- [PR] [SPARK-53499][PYTHON] from_arrow_type should respect containsNull in ArrayType [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/05 01:18:44 UTC, 2 replies.
- Re: [PR] [SPARK-52011][SQL] Reduce HDFS NameNode RPC on vectorized Parquet reader [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/09/05 02:13:50 UTC, 31 replies.
- [PR] [SPARK-53453][PYTHON][ML][FOLLOW-UP] Update `dev/requirements` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/05 03:56:34 UTC, 2 replies.
- Re: [PR] [SPARK-53361][SS] Optimizing JVM–Python Communication in TWS by Grouping Multiple Keys into One Arrow Batch [spark] - posted by "zeruibao (via GitHub)" <gi...@apache.org> on 2025/09/05 05:28:18 UTC, 10 replies.
- [PR] [SPARK-53500][PYTHON][TESTS] Make `test_unpivot` deterministic [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/05 05:47:03 UTC, 2 replies.
- [PR] feat: add indiamart_clone Flutter+Firebase starter app (dual login) [spark] - posted by "pallasandeep-wq (via GitHub)" <gi...@apache.org> on 2025/09/05 08:03:41 UTC, 0 replies.
- Re: [PR] [SPARK-53488][SQL] Update CollationTypeCoercion to be compatible with single-pass Analyzer logic [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/05 08:54:25 UTC, 5 replies.
- [PR] [SPARK-53355][PYTHON] fix numpy 1.x repr in type tests [spark] - posted by "benrobby (via GitHub)" <gi...@apache.org> on 2025/09/05 08:59:25 UTC, 9 replies.
- [PR] [SPARK-50888][CONNECT][TESTS] Remove flaky assertion from `SparkConnectServiceSuite` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/09/05 11:16:24 UTC, 3 replies.
- [PR] [MINOR][CORE][TESTS] Fix typo in MasterDecommissionSuite class name [spark] - posted by "ignitz (via GitHub)" <gi...@apache.org> on 2025/09/05 12:02:07 UTC, 2 replies.
- [PR] [WIP] Add Options for DataFrameWriter [spark-connect-go] - posted by "pequalsnp (via GitHub)" <gi...@apache.org> on 2025/09/05 12:45:51 UTC, 0 replies.
- [PR] [SPARK-53501][PYTHON][CORE] refactor python worker factory API [spark] - posted by "benrobby (via GitHub)" <gi...@apache.org> on 2025/09/05 13:04:29 UTC, 0 replies.
- [PR] [SPARK-53502] Improve the naming of methods in LiteralValueProtoConverter [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/09/05 13:35:03 UTC, 1 replies.
- Re: [PR] [SPARK-52813][CONNECT] Allow DAGs in Spark Connect [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/09/05 15:39:56 UTC, 1 replies.
- Re: [PR] [SPARK-50614][SQL] Add Variant shredding support for Parquet [spark] - posted by "eldenmoon (via GitHub)" <gi...@apache.org> on 2025/09/05 15:52:38 UTC, 1 replies.
- Re: [PR] [SPARK-53492][CONNECT] Reject second ExecutePlan with an operation id that has already completed [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/09/05 16:10:12 UTC, 13 replies.
- [PR] [WIP] allow the absense of exists default [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/05 19:29:01 UTC, 0 replies.
- [PR] [SPARK-53505][CONNECT] Try the eager analysis first for withColumns and withColumnsRenamed in Spark Connect [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/09/05 20:54:28 UTC, 4 replies.
- [PR] [SDP][SPARK-53498] Correctly Reference cli.py [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2025/09/05 20:54:31 UTC, 0 replies.
- Re: [PR] [SDP][SPARK-53498] Correctly Reference `pyspark/pipelines/cli.py` from `spark-pipelines` Binary [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2025/09/05 21:19:32 UTC, 2 replies.
- Re: [PR] [SPARK-53182][PYTHON][DOCS] Fix broken and missing links in PySpark DataFrames user guide [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2025/09/05 21:22:24 UTC, 5 replies.
- [PR] [SPARK-53506][PS] Disallow `%` between Decimal and float under ANSI [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/09/05 21:22:40 UTC, 3 replies.
- [PR] [WIP] [SPARK-53507]Add breaking change info to errors [spark] - posted by "imarkowitz (via GitHub)" <gi...@apache.org> on 2025/09/05 23:43:42 UTC, 0 replies.
- Re: [PR] [SPARK-52745][SQL][FOLLOWUP] Allow the absense of exists default [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/06 15:12:10 UTC, 3 replies.
- [PR] [SPARK-53508] Upgrade Spark to 4.0.1 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/06 15:22:37 UTC, 2 replies.
- [PR] [SPARK-53509] Publish Apache Spark 4.0.1 to docker registry [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/06 15:40:23 UTC, 4 replies.
- [PR] [SPARK-53510] Update `SparkClusterResourceSpec` to use `apache/spark:4.0.1` as the default value of container image [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/06 22:32:15 UTC, 3 replies.
- Re: [PR] [SPARK-53094][SQL] Fix cube-related data quality problem [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/06 23:45:38 UTC, 1 replies.
- Re: [PR] [SPARK-52308][CORE] Fix the bug that the actual configs of the driver are overwritten [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/07 00:29:07 UTC, 1 replies.
- Re: [PR] [SPARK-53498][SDP] Correctly Reference `pyspark/pipelines/cli.py` from `spark-pipelines` Binary [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/09/07 11:05:00 UTC, 11 replies.
- [PR] [SPARK-53511] Make `examples` directory up-to-date with Spark 4.0.1 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/07 21:20:26 UTC, 2 replies.
- [PR] [SPARK-53513] Update `YuniKorn` docs with `1.7.0` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/07 22:33:31 UTC, 2 replies.
- [PR] [SPARK-53512] [SQL] Better unification of DSv2 PushDownUtils [spark] - posted by "yhuang-db (via GitHub)" <gi...@apache.org> on 2025/09/07 22:43:48 UTC, 5 replies.
- Re: [PR] [SPARK-53230][SQL] Assign a name to error class _LEGACY_ERROR_TEMP_1011 [spark] - posted by "ctring (via GitHub)" <gi...@apache.org> on 2025/09/07 23:38:19 UTC, 2 replies.
- [PR] [SPARK-53514][DOCS] Update `Gemfile` to allow Ruby 3.2+ explicitly [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/08 00:08:40 UTC, 0 replies.
- Re: [PR] Supports file pruning when underlying Delta Parquet files are explici… [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/08 00:28:20 UTC, 1 replies.
- Re: [PR] [SPARK-52088][CORE] Refactor the `ClosureCleaner#clean` and avoid using the `-Djdk.reflect.useDirectMethodHandle=false` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/08 00:28:21 UTC, 3 replies.
- Re: [PR] [SPARK-53502][CONNECT][SQL] Improve the naming of methods in LiteralValueProtoConverter [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/08 02:33:50 UTC, 1 replies.
- Re: [PR] [SPARK-53514][DOCS] Update `Gemfile` to allow Ruby 3.0+ explicitly [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/08 02:38:19 UTC, 4 replies.
- [PR] [SPARK-53515][SQL] Remove unused `private lazy val` from `SchemaOfCsv/Xml` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/09/08 03:50:54 UTC, 4 replies.
- Re: [PR] [SPARK-44065][SQL] Optimize BroadcastHashJoin skew in OptimizeSkewedJoin [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/09/08 05:03:30 UTC, 2 replies.
- [PR] [Spark 53448] Conversion of a pyspark DataFrame with a Variant column to pandas fails with an error [spark] - posted by "VindhyaG (via GitHub)" <gi...@apache.org> on 2025/09/08 05:03:58 UTC, 0 replies.
- [PR] [SPARK-53516][SDP] Fix `spark.api.mode` arg process in SparkPipelines [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/09/08 05:39:39 UTC, 13 replies.
- [PR] [SPARK-53517][PYTHON][TESTS] Add more test for pyarrow datatype conversion [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/08 05:45:11 UTC, 2 replies.
- [PR] [SPARK-53518][SQL] No truncation for catalogString of User Defined Type [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/09/08 06:55:07 UTC, 4 replies.
- [PR] [SPARK-48163][CONNECT][TESTS] Fix flaky tests in `SparkConnectServiceSuite` which are caused by `executorHolder` undefined [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/09/08 07:31:31 UTC, 3 replies.
- Re: [PR] [SPARK-53355][PYTHON][SQL] fix numpy 1.x repr in type tests [spark] - posted by "benrobby (via GitHub)" <gi...@apache.org> on 2025/09/08 08:02:15 UTC, 4 replies.
- Re: [PR] [SPARK-53489][SQL] Remove using `v2ColumnsToStructType` in `ApplyDefaultCollationToStringType` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/08 08:41:06 UTC, 1 replies.
- [PR] [SPARK-50888][CONNECT][TESTS][4.0] Remove flaky assertion from `SparkConnectServiceSuite` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/09/08 09:03:59 UTC, 3 replies.
- Re: [PR] [WIP][SPARK-53504][SQL] Type framework [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/09/08 09:09:19 UTC, 3 replies.
- Re: [PR] [SPARK-53402][CONNECT] Support Direct Passthrough Partitioning Dataset API in Spark Connect in Scala [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/09/08 09:16:02 UTC, 2 replies.
- [PR] [SPARK-53522][SDP][TEST] Simplify PipelineTest [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/08 10:06:58 UTC, 7 replies.
- [PR] [SPARK-53505][CONNECT][FOLLOWUP][4.0] Import SparkException to make build success [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/09/08 10:11:22 UTC, 0 replies.
- [PR] [SPARK-53521] Refactor Star expression [spark] - posted by "mikhailnik-db (via GitHub)" <gi...@apache.org> on 2025/09/08 10:28:17 UTC, 2 replies.
- [PR] [SPARK-53523][SQL] `NamedParameter` respects `spark.sql.caseSensitive` [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/09/08 12:42:17 UTC, 1 replies.
- [PR] Bump github.com/apache/arrow-go/v18 from 18.4.0 to 18.4.1 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/09/08 13:10:10 UTC, 0 replies.
- [PR] Bump golang.org/x/oauth2 from 0.30.0 to 0.31.0 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/09/08 13:13:39 UTC, 0 replies.
- [PR] [SPARK-53524] Fix temporal value conversion in LiteralValueProtoConverter [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/09/08 13:17:24 UTC, 1 replies.
- [PR] [SPARK-53525] Spark Connect ArrowBatch Result Chunking [spark] - posted by "xi-db (via GitHub)" <gi...@apache.org> on 2025/09/08 13:27:27 UTC, 0 replies.
- Re: [PR] [MINOR] Fix redundant brace in log [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/09/08 13:33:08 UTC, 0 replies.
- Re: [PR] [SPARK-53505][CONNECT][FOLLOWUP][4.0] Import SparkException in `SparkConnectPlanner.scala` to make build success [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/09/08 14:06:40 UTC, 3 replies.
- Re: [PR] [SPARK-53525][CONNECT] Spark Connect ArrowBatch Result Chunking [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/09/08 15:12:09 UTC, 21 replies.
- [PR] [SPARK-53526][SQL] Enable SQL scripting by default [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2025/09/08 17:42:17 UTC, 2 replies.
- [PR] Tiny doc wording clarity [spark] - posted by "hutch3232 (via GitHub)" <gi...@apache.org> on 2025/09/08 17:53:49 UTC, 0 replies.
- [PR] [SPARK-51119][SQL][FOLLOW-UP] Fix yet another missing fallback case for parsing corrupt exists_default value [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/09/08 18:11:49 UTC, 1 replies.
- [PR] Catch InterruptedIOException and ClosedByInterruptException in TransformWithStateInPySparkStateServer to avoid worker crash [spark] - posted by "jiateoh (via GitHub)" <gi...@apache.org> on 2025/09/08 22:27:49 UTC, 0 replies.
- Re: [PR] [SPARK-53527][SQL] Improve fallback of analyzeExistenceDefaultValue [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/09/08 23:07:50 UTC, 2 replies.
- [PR] [EXPERIMENT][DO NOT MERGE] Automated pyspark sdp build workflow [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2025/09/09 01:12:33 UTC, 0 replies.
- Re: [PR] [SPARK-53469][SQL] Ability to cleanup shuffle in Thrift server [spark] - posted by "karuppayya (via GitHub)" <gi...@apache.org> on 2025/09/09 01:13:12 UTC, 28 replies.
- Re: [PR] [SPARK-53523][SQL] Named parameters respect `spark.sql.caseSensitive` [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/09/09 01:48:13 UTC, 8 replies.
- [PR] [SPARK-53518][SQL][4.0] No truncation for catalogString of User Defin… [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/09/09 02:39:06 UTC, 0 replies.
- [PR] [SPARK-53518][SQL][3.5] No truncation for catalogString of User Defined Type [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/09/09 02:42:02 UTC, 2 replies.
- [PR] [SS] Clean up the useless code related to `TransformWithStateInPySparkStateServer` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/09/09 02:59:16 UTC, 4 replies.
- [PR] [SPARK-53529][CONNECT] Fix spark connect client doesn't support ipv6 address [spark] - posted by "WangGuangxin (via GitHub)" <gi...@apache.org> on 2025/09/09 03:06:51 UTC, 2 replies.
- Re: [PR] [SPARK-53448][PYTHON] Conversion of a pyspark DataFrame with a Variant column to pandas fails with an error [spark] - posted by "VindhyaG (via GitHub)" <gi...@apache.org> on 2025/09/09 03:38:46 UTC, 0 replies.
- Re: [PR] [SPARK-53518][SQL][4.0] No truncation for catalogString of User Defined Type [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/09 04:35:10 UTC, 1 replies.
- [PR] [SPARK-48163][CONNECT][TESTS][4.0] Fix flaky tests in `SparkConnectServiceSuite` which are caused by `executorHolder` undefined [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/09/09 05:53:59 UTC, 1 replies.
- [PR] [SPARK-53531][CORE] Better error message for HadoopRDD.getInputFormat [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/09/09 06:38:25 UTC, 4 replies.
- [PR] [SPARK-53532][BUILD][3.5] Upgrade Jetty to 9.4.58.v20250814 [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2025/09/09 07:15:30 UTC, 3 replies.
- [PR] [SPARK-53533][BUILD] Upgrade Jetty to 11.0.26 [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2025/09/09 07:23:50 UTC, 8 replies.
- Re: [PR] [SPARK-23817][SQL] Create file source V2 framework and migrate ORC read path [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/09/09 08:35:33 UTC, 2 replies.
- [PR] [SPARK-53534][PYTHON][TESTS] Add tests for arrow udf with numpy output [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/09 08:45:47 UTC, 1 replies.
- Re: [PR] [SPARK-53530][SS] Clean up the useless code related to `TransformWithStateInPySparkStateServer` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/09/09 09:01:33 UTC, 2 replies.
- Re: [PR] [SPARK-51348][BUILD][SQL] Upgrade Hive to 4.1 [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/09/09 10:33:25 UTC, 0 replies.
- [PR] [SPARK-51489][SQL]Represent SQL scripts in Spark UI [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2025/09/09 13:30:53 UTC, 0 replies.
- [PR] [SPARK-48338][Core] Adding a Golden File Test With Randomly Generated SQL Scripts [spark] - posted by "TeodorDjelic (via GitHub)" <gi...@apache.org> on 2025/09/09 13:33:31 UTC, 1 replies.
- Re: [PR] [SPARK-53524][CONNECT][SQL] Fix temporal value conversion in LiteralValueProtoConverter [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/09 13:58:28 UTC, 15 replies.
- Re: [PR] SPARK-12105 - SPARK-SQL add convenient show functions [spark] - posted by "loicdescotte (via GitHub)" <gi...@apache.org> on 2025/09/09 15:06:16 UTC, 0 replies.
- [PR] Feature/spark 47230 column prunning under explode [spark] - posted by "IgorBerman (via GitHub)" <gi...@apache.org> on 2025/09/09 15:38:44 UTC, 0 replies.
- Re: [PR] [SPARK-53356][PYTHON][DOCS] Small improvements to python data source docs [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/09/09 16:52:44 UTC, 3 replies.
- [PR] [SPARK-53029][FOLLOWUP] Update PyArrow StructType usage to avoid .names attribute for compatibility with PyArrow [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/09/09 18:31:17 UTC, 3 replies.
- [PR] [SPARK-53539][INFRA] Add `libwebp-dev` to recover `spark-rm/Dockerfile` building [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/09 20:28:10 UTC, 5 replies.
- [PR] [SPARK-53540][INFRA] Remove `pypy3` from `spark-rm` image [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/09 20:58:34 UTC, 4 replies.
- [PR] [SPARK-53538][SQL] `ExpandExec` should initialize the unsafe projections [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2025/09/09 21:18:37 UTC, 2 replies.
- [PR] [SPARK-53541][K8S][INFRA] Update K8s IT CI to use K8s 1.34 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/09 22:29:27 UTC, 4 replies.
- [PR] [SPARK-53542] Update CI to test K8s 1.34 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/09 22:43:29 UTC, 3 replies.
- Re: [PR] [SPARK-53335][K8S] Optionally capture diagnostics for jobs on Kubernetes [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/09/10 00:40:01 UTC, 0 replies.
- Re: [PR] [SPARK-33737][K8S] Support getting pod state using Informers + Listers [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/09/10 00:41:05 UTC, 2 replies.
- Re: [PR] [SPARK-53446][CORE] Optimize BlockManager remove operations with cached block mappings [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/10 03:09:50 UTC, 3 replies.
- [PR] [SPARK-52238][SDP] Rename Pipeline Spec Field "definitions" to 'libraries' [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/09/10 04:31:29 UTC, 4 replies.
- Re: [PR] [SPARK-53399][SQL] Merge Python UDFs [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/09/10 04:46:48 UTC, 13 replies.
- Re: [PR] [WIP][SPARK-52348][SDP] Trait for PipelinesHandler [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/09/10 05:37:52 UTC, 0 replies.
- [PR] [SPARK-53429] Support Direct Passthrough Partitioning in the PySpark Dataframe API [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2025/09/10 06:39:35 UTC, 0 replies.
- Re: [PR] [SPARK-45134][SHUFFLE] Avoid repeated fallback when failed to fetch remote push-merged block meta [spark] - posted by "zzzzming95 (via GitHub)" <gi...@apache.org> on 2025/09/10 08:24:17 UTC, 0 replies.
- [PR] [SPARK-53543][SQL][TEST-ONLY] Add more test coverage for `Window` on top of `Aggregate` [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/09/10 08:40:25 UTC, 4 replies.
- [PR] [SPARK-53340][CONNECT] Make StreamingQueryCommand in SparkConnectPlanner side effect free [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/09/10 14:58:30 UTC, 2 replies.
- [PR] Adding Support for Parsing CONTINUE HANDLER [spark] - posted by "TeodorDjelic (via GitHub)" <gi...@apache.org> on 2025/09/10 15:41:04 UTC, 4 replies.
- Re: [PR] [SPARK-52336][CORE] Prepend Spark identifier to GCS user agent [spark] - posted by "shrutisinghania (via GitHub)" <gi...@apache.org> on 2025/09/10 19:25:27 UTC, 1 replies.
- Re: [PR] [SPARK-52921][SQL] Specify outputPartitioning for UnionExec for same output partitoning as children operators [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2025/09/10 21:45:51 UTC, 2 replies.
- [PR] [SPARK-53545] Enforce style check at project level for operator [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/09/10 22:55:20 UTC, 3 replies.
- [PR] [SPARK-53546][SQL][TESTS] Fix InMemoryDataSource to return default value or null for new fields [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/09/10 23:53:24 UTC, 13 replies.
- Re: [PR] [SPARK-44223][CORE] Remove LevelDB support [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/11 00:26:30 UTC, 1 replies.
- [PR] [MINOR][PYTHON][TESTS] Skip some tests if numpy not installed [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/11 00:51:36 UTC, 2 replies.
- [PR] [SPARK-53434][SQL][4.0] ColumnarRow's get should also check isNullAt [spark] - posted by "WangGuangxin (via GitHub)" <gi...@apache.org> on 2025/09/11 01:52:12 UTC, 2 replies.
- Re: [PR] [SPARK-53111][SQL][PYTHON][CONNECT] Implement the time_diff function in PySpark [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/11 02:36:34 UTC, 0 replies.
- Re: [PR] [SPARK-52890][SPARK-52891][PYTHON] Implement the to_time and try_to_time functions in PySpark [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/11 03:14:01 UTC, 0 replies.
- [PR] [SPARK-53549] Always close the arrow allocator when list state request process is completed [spark] - posted by "huanliwang-db (via GitHub)" <gi...@apache.org> on 2025/09/11 04:57:31 UTC, 0 replies.
- [PR] [WIP] Limit Arrow batch sizes in `applyInArrow` and `applyInPandas` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/11 05:04:50 UTC, 0 replies.
- [PR] WIP [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2025/09/11 06:12:13 UTC, 0 replies.
- Re: [PR] [SPARK-53429][PYTHON] Support Direct Passthrough Partitioning in the PySpark Dataframe API [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2025/09/11 06:47:08 UTC, 10 replies.
- [PR] [SPARK-53550][SQL] Union output partitioning should compare canonicalized attributes [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/09/11 07:21:17 UTC, 13 replies.
- [PR] [SPARK-52426][SQL][FOLLOWPUP] Fix spark-sql repl w/ RedirectConsolePlugin [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/09/11 07:37:43 UTC, 5 replies.
- [PR] [SPARK-53551][SQL] Improve OffsetAndLimit by avoiding duplicate evaluation [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/09/11 07:50:16 UTC, 1 replies.
- Re: [PR] [SPARK-52601][SQL] Support primitive types in TransformingEncoder [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2025/09/11 08:36:21 UTC, 4 replies.
- [PR] [SPARK-53552][SQL] Optimize substr SQL function [spark] - posted by "wankunde (via GitHub)" <gi...@apache.org> on 2025/09/11 09:45:30 UTC, 6 replies.
- Re: [PR] [SPARK-53537][Core] Adding Support for Parsing CONTINUE HANDLER [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/11 11:26:40 UTC, 14 replies.
- Re: [PR] [SPARK-53536][Core] Adding a Golden File Test With Randomly Generated SQL Scripts [spark] - posted by "TeodorDjelic (via GitHub)" <gi...@apache.org> on 2025/09/11 12:46:38 UTC, 6 replies.
- [PR] [DOCS] Fix comma placement in array_append doc [spark] - posted by "rodrigoccurvo (via GitHub)" <gi...@apache.org> on 2025/09/11 13:26:22 UTC, 0 replies.
- [PR] [SPARK-53554] Fix `sum_distinct` [spark-connect-rust] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/09/11 14:24:23 UTC, 5 replies.
- Re: [PR] [SPARK-53444][SQL] Rework execute immediate [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/11 14:31:03 UTC, 9 replies.
- [PR] [SPARK-53553] Fix handling of null values in LiteralValueProtoConverter [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/09/11 15:24:32 UTC, 1 replies.
- [PR] Fix: SparkML-connect can't load SparkML (legacy mode) saved model [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/09/11 16:18:38 UTC, 1 replies.
- [PR] [SPARK-53556] Avoid setting redundant struct data types in LiteralValueProtoConverter [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/09/11 17:01:59 UTC, 1 replies.
- [PR] [SPARK-53550][SQL][FOLLOWUP] Union output partitioning should compare canonicalized attributes [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/09/11 17:30:04 UTC, 10 replies.
- [PR] [SPARK-53557][INFRA] Reduce automated vote email deadline from 4 days to 73 hours [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/11 17:49:37 UTC, 6 replies.
- [PR] [SPARK-53558][SQL] Show fully qualified table name including the catalog name in the exception message when the table is not found [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2025/09/11 18:14:52 UTC, 15 replies.
- [PR] [SPARK-53559][SQL][CATALYST] Fix HLL sketch updates to use raw collation key bytes [spark] - posted by "cboumalh (via GitHub)" <gi...@apache.org> on 2025/09/11 19:37:25 UTC, 25 replies.
- Re: [PR] [SPARK-49547][SQL][PYTHON] Add iterator of `RecordBatch` API to `applyInArrow` [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2025/09/11 20:21:00 UTC, 21 replies.
- [PR] [SPARK-53387][PYTHON] Add support for Arrow UDTFs with PARTITION BY [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/09/11 20:38:45 UTC, 31 replies.
- [PR] [SPARK-53561] Catch Interruption Exception in TransformWithStateInPySparkStateServer during outputStream.flush at the thread close time to avoid the worker crash [spark] - posted by "huanliwang-db (via GitHub)" <gi...@apache.org> on 2025/09/11 20:55:08 UTC, 0 replies.
- [PR] [SPARK-53538][SQL][4.0] `ExpandExec` should initialize the unsafe projections [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2025/09/11 21:02:38 UTC, 2 replies.
- Re: [PR] [SPARK-53549][SS] Always close the arrow allocator when list state request process is completed [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/09/11 21:52:14 UTC, 1 replies.
- Re: [PR] [SPARK-53561][SS] Catch Interruption Exception in TransformWithStateInPySparkStateServer during outputStream.flush to avoid the worker crash [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/09/11 21:54:10 UTC, 4 replies.
- [PR] [SPARK-53323] Support df.asTable() for Arrow UDTF in Spark Connect [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2025/09/12 00:23:50 UTC, 2 replies.
- Re: [PR] [SPARK-53562][PYTHON] Limit Arrow batch sizes in `applyInArrow` and `applyInPandas` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/12 00:43:21 UTC, 37 replies.
- Re: [PR] [SPARK-53560][SS][SQL] Crash looping when retrying uncommitted batch in Kafka source and AvailableNow trigger [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/09/12 00:55:37 UTC, 7 replies.
- Re: [PR] [SPARK-53372][SDP] SDP End to End Testing Suite [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/09/12 01:32:27 UTC, 20 replies.
- [PR] [SPARK-53544][PYTHON] Support complex types on observations [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/09/12 01:50:47 UTC, 15 replies.
- Re: [PR] [SPARK-52426][SQL][FOLLOWUP] Fix spark-sql repl w/ RedirectConsolePlugin [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/09/12 02:24:26 UTC, 4 replies.
- Re: [PR] [SPARK-53551][SQL] Improve `OffsetAndLimit` by avoiding duplicate evaluation [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/12 02:29:40 UTC, 3 replies.
- Re: [PR] [SPARK-53413][SQL] Shuffle cleanup for commands [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/12 03:03:19 UTC, 0 replies.
- Re: [PR] [SPARK-53507]Add breaking change info to errors [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/12 04:47:27 UTC, 8 replies.
- [PR] [SPARK-53563][PS] Optimize: sql_processor by avoiding inefficient string concatenation [spark] - posted by "petern48 (via GitHub)" <gi...@apache.org> on 2025/09/12 05:48:07 UTC, 3 replies.
- [PR] [WIP][PYTHON] Make `@udf` support vectorized UDF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/12 08:08:03 UTC, 0 replies.
- Re: [PR] [SPARK-53553][CONNECT] Fix handling of null values in LiteralValueProtoConverter [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/12 09:52:58 UTC, 5 replies.
- Re: [PR] [SPARK-53556][CONNECT] Avoid setting redundant struct data types in LiteralValueProtoConverter [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/12 09:58:35 UTC, 6 replies.
- [PR] [SPARK-53524][CONNECT][SQL][4.0] Fix temporal value conversion in LiteralValueProtoConverter [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/09/12 13:11:09 UTC, 6 replies.
- [PR] [SPARK-53568][CONNECT][PYTHON] Fix several small bugs in Spark Connect Python client error handling logic [spark] - posted by "khakhlyuk (via GitHub)" <gi...@apache.org> on 2025/09/12 13:51:37 UTC, 2 replies.
- Re: [PR] [SPARK-53529][PYTHON][CONNECT] Fix `pyspark` connect client to support IPv6 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/12 15:15:57 UTC, 1 replies.
- Re: [PR] [SPARK-53324][K8S] Introduce pending pod limit per ResourceProfile [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/09/12 15:41:57 UTC, 1 replies.
- [PR] Jessie.luo data/spark add response [spark] - posted by "cookiedough77 (via GitHub)" <gi...@apache.org> on 2025/09/12 20:25:44 UTC, 0 replies.
- [PR] [SPARK-51162] Add make_timestamp_ntz overload with date/time parameters [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/09/12 21:05:17 UTC, 0 replies.
- [PR] [SPARK-] Fix AnalysisContext being wiped during nested plan resolution [spark] - posted by "andyl-db (via GitHub)" <gi...@apache.org> on 2025/09/12 21:15:10 UTC, 0 replies.
- [PR] [SPARK-53361][SS][1/2] Optimizing JVM–Python Communication in TWS by Grouping Multiple Keys into One Arrow Batch [spark] - posted by "zeruibao (via GitHub)" <gi...@apache.org> on 2025/09/12 22:11:53 UTC, 5 replies.
- Re: [PR] [SPARK-53425][PYTHON][TESTS] Add more table argument tests for Arrow Python UDTFs [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/09/12 22:55:56 UTC, 5 replies.
- Re: [PR] [SPARK-51162] [Python] Add make_timestamp_ntz overload with date/time parameters [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/09/12 23:07:42 UTC, 2 replies.
- [PR] [SPARK-53569] Use `Iceberg` 1.10 for Iceberg integration test [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/12 23:10:00 UTC, 0 replies.
- [PR] [SPARK-53570] Update `integration-test-token` to use Spark `4.1.0-preview` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/12 23:18:03 UTC, 0 replies.
- [PR] [SPARK-53571] Add `integration-test-mac-spark4-iceberg` GitHub Action job [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/12 23:35:14 UTC, 2 replies.
- Re: [PR] [SPARK-53323][CONNECT] Support df.asTable() for Arrow UDTF in Spark Connect [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/09/12 23:43:40 UTC, 1 replies.
- Re: [PR] [SPARK-53569] Use `Iceberg` 1.10 for `Spark 3`-based Iceberg integration test [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/12 23:46:19 UTC, 1 replies.
- Re: [PR] [SPARK-53570] Update `integration-test-token` to use Spark `4.1.0-preview1` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/12 23:47:57 UTC, 1 replies.
- Re: [PR] Added s3 offloading technique for RDD [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/13 00:24:16 UTC, 1 replies.
- [PR] [SPARK-43579][PS] optim: Cache the converter between Arrow and pandas for reuse [spark] - posted by "petern48 (via GitHub)" <gi...@apache.org> on 2025/09/13 01:37:59 UTC, 0 replies.
- Re: [PR] [SPARK-43579][PYTHON] optim: Cache the converter between Arrow and pandas for reuse [spark] - posted by "petern48 (via GitHub)" <gi...@apache.org> on 2025/09/13 03:36:35 UTC, 2 replies.
- [PR] [SPARK-53572][SQL] Avoid throwing from ExtractValue.isExtractable [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/09/13 17:28:20 UTC, 4 replies.
- Re: [PR] [SPARK-53547] [Python] Add make_timestamp_ntz overload with date/time parameters [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/09/13 17:37:13 UTC, 1 replies.
- [PR] [WIP][SQL] Use Pre-processor for generalized parameter marker handling [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2025/09/13 20:42:52 UTC, 0 replies.
- Re: [PR] pyspark: Improve SparkConf typing [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/14 00:28:47 UTC, 1 replies.
- Re: [PR] [MINOR] Improve documentation of concat functions in pyspark [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/15 00:28:45 UTC, 1 replies.
- Re: [PR] [SPARK-52186][SQL] Rewrite EXISTS to add Scalar Project [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/15 00:28:46 UTC, 1 replies.
- Re: [PR] [Spark-50873][SQL] Prune column for ExistsSubquery in DSV2 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/15 00:28:47 UTC, 1 replies.
- Re: [PR] [SPARK-53289][SQL] Invoke cancelJobsWithTag before start passing the SparkListenerSQLExecutionEnd event to prevent execution of canceled tasks. [spark] - posted by "JkSelf (via GitHub)" <gi...@apache.org> on 2025/09/15 05:46:04 UTC, 1 replies.
- [PR] [WIP][SPARK-53564][CORE] Avoid DAGScheduler exits due to blockManager RPC timeout in DAGSchedulerEventProcessLoop [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2025/09/15 07:46:58 UTC, 0 replies.
- [PR] [WIP][SPARK-53575][CORE] Retry entire consumer stages when checksum mismatch detected for a retried shuffle map task [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2025/09/15 08:07:14 UTC, 0 replies.
- [PR] [SPARK-46957][FOLLOW-UP][CORE] Fix potential thread-safety issue for mapTaskIds.add() [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2025/09/15 08:08:57 UTC, 0 replies.
- [PR] [SPARK-53577][DOCS] Fix Scaladoc source links for java sources [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/09/15 08:33:47 UTC, 3 replies.
- Re: [PR] [SPARK-53113][SQL] Support the time type by try_make_timestamp() [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/09/15 09:02:14 UTC, 7 replies.
- [PR] [SPARK-53539][INFRA][4.0] Add `libwebp-dev` to recover `spark-rm/Dockerfile` building [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/09/15 09:14:27 UTC, 4 replies.
- [PR] [SPARK-53539][INFRA][3.5] Add `libwebp-dev` to recover `spark-rm/Dockerfile` building [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/09/15 09:14:30 UTC, 4 replies.
- Re: [PR] [SPARK-53574] Fix AnalysisContext being wiped during nested plan resolution [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/15 09:41:10 UTC, 1 replies.
- Re: [PR] [MINOR][CONNECT] Fix typos in ExecuteGrpcResponseSender.scala [spark] - posted by "luisteod (via GitHub)" <gi...@apache.org> on 2025/09/15 11:43:42 UTC, 0 replies.
- Re: [PR] [SPARK-53581][FOLLOW-UP][CORE] Fix potential thread-safety issue for mapTaskIds.add() [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2025/09/15 12:56:00 UTC, 2 replies.
- [PR] [SPARK-53578][CONNECT] Simplify data type handling in LiteralValueProtoConverter [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/09/15 13:25:10 UTC, 25 replies.
- [PR] Bump google.golang.org/grpc from 1.75.0 to 1.75.1 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/09/15 13:26:58 UTC, 0 replies.
- [PR] Bump google.golang.org/protobuf from 1.36.7 to 1.36.9 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/09/15 13:28:42 UTC, 0 replies.
- Re: [PR] Bump google.golang.org/protobuf from 1.36.7 to 1.36.8 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/09/15 13:28:43 UTC, 1 replies.
- Re: [PR] [SPARK-53582][SQL] Extend `isExtractable` so it can be applied on `UnresolvedExtractValue` [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/09/15 16:04:44 UTC, 1 replies.
- [PR] change val to def [spark] - posted by "rxluo1202 (via GitHub)" <gi...@apache.org> on 2025/09/15 16:56:47 UTC, 1 replies.
- [PR] [SPARK-53584][PYTHON] Improve process_column_param validation and column parameter docstring [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/09/15 18:51:26 UTC, 1 replies.
- [PR] [SPARK-53586][K8S][BUILD] Upgrade `kubernetes-client` to 7.4.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/15 19:01:26 UTC, 2 replies.
- [PR] [SPARK-53588] Upgrade `kubernetes-client` to 7.4.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/15 19:10:36 UTC, 3 replies.
- [PR] [SPARK-53590][BUILD] Add `huaweicloud-provided` profile [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/15 20:28:55 UTC, 2 replies.
- [PR] [SPARK-53482][SQL] MERGE INTO support for when source has less nested field than target [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/09/15 21:39:42 UTC, 1 replies.
- [PR] [SPARK-53591][SDP] Simplify Pipeline Spec Pattern Glob Matching [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/09/15 22:51:55 UTC, 3 replies.
- Re: [PR] Add response field for DefineDataset and DefineFlow RPC [spark] - posted by "SCHJonathan (via GitHub)" <gi...@apache.org> on 2025/09/16 00:06:11 UTC, 11 replies.
- Re: [PR] [SPARK-37940][SQL]upgrade to new error class in QueryCompilationErrors. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/16 00:25:56 UTC, 1 replies.
- Re: [PR] [SPARK-37940][SQL]update error mechanism to fully SparkThrowable [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/16 00:25:57 UTC, 1 replies.
- Re: [PR] [SPARK-53592][PYTHON] Make `@udf` support vectorized UDF [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/09/16 01:07:22 UTC, 5 replies.
- Re: [PR] [SPARK-53581][CORE] Fix potential thread-safety issue for mapTaskIds.add() [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2025/09/16 01:36:14 UTC, 10 replies.
- Re: [PR] [SPARK-53564][CORE] Avoid DAGScheduler exits due to blockManager RPC timeout in DAGSchedulerEventProcessLoop [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2025/09/16 02:15:28 UTC, 9 replies.
- [PR] [SPARK-52601][SQL][4.0] Support primitive types in TransformingEncoder [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2025/09/16 12:20:25 UTC, 2 replies.
- Re: [PR] [SPARK-52506][CORE] Allow migrating to fallback storage only [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2025/09/16 12:47:44 UTC, 0 replies.
- Re: [PR] [SPARK-52614][SQL] Support RowEncoder inside Product Encoder [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2025/09/16 12:51:14 UTC, 0 replies.
- Re: [PR] [SPARK-53555] Fix: SparkML-connect can't load SparkML (legacy mode) saved model [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/09/16 13:01:09 UTC, 3 replies.
- [PR] [SPARK-53598][SQL] Check numParts field for Hive tables before reading data source schema [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/09/16 14:30:38 UTC, 1 replies.
- [PR] [SPARK-53599][BUILD] Upgrade `Netty` to 4.1.127.Final [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/09/16 15:43:09 UTC, 5 replies.
- Re: [PR] [SPARK-53233][SQL][SS][MLLIB][CONNECT] Make the code related to `streaming` uses the correct package name [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/16 16:46:08 UTC, 19 replies.
- [PR] [SPARK-53600][SQL] Revise `SessionHolder` last access time log message [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/16 17:45:33 UTC, 5 replies.
- [PR] [SPARK-53601][INFRA] Use Java 25 instead of 25-ea [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/16 18:07:00 UTC, 7 replies.
- Re: [PR] [SPARK-53547] [PYTHON] Add make_timestamp_ntz overload with date/time parameters [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/09/16 18:23:09 UTC, 3 replies.
- Re: [PR] [WIP] Preparser [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2025/09/16 18:44:56 UTC, 1 replies.
- Re: [PR] [MINOR][PYTHON][DOCS] Correct the examples of `toPandas` and `toArrow` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/16 19:19:16 UTC, 1 replies.
- [PR] [SPARK-53546][TESTS][FOLLOW-UP] Fix nested array schema evolution and style for InMemoryBaseTable [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/09/16 20:31:44 UTC, 7 replies.
- [PR] [SPARK-53602][PYTHON] Profile dump improvement and profiler doc fix [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/09/16 20:55:12 UTC, 4 replies.
- [PR] [SPARK-53603][BUILD] Upgrade Checkstyle to 11.0.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/16 22:48:12 UTC, 2 replies.
- Re: [PR] [DOCS][SQL] Cross-link CSV data source docs to generic options & JSON [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/09/16 23:18:41 UTC, 2 replies.
- [PR] [SPARK-52991][SQL][FOLLOW-UP] Small optimization for MERGE INTO with SCHEMA EVOLUTION and add test [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/09/17 00:27:05 UTC, 0 replies.
- Re: [PR] [SPARK-53594][PYTHON] Make arrow UDF respect user-specified eval type [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/17 02:41:21 UTC, 1 replies.
- [PR] [MINOR][DOCS] Update the `See Also` section for time functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/17 02:48:28 UTC, 2 replies.
- [PR] [SPARK-53604][INFRA] Temporarily increase PySpark job execution time to 150 minutes [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/17 03:13:42 UTC, 7 replies.
- Re: [PR] [SPARK-52991][SQL][FOLLOW-UP] Small optimization for MERGE INTO WITH SCHEMA EVOLUTION and add test [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/17 03:49:52 UTC, 3 replies.
- [PR] [SPARK-53606][DOCS] Fix MapInPandas/MapInArrow examples with barrier [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/17 04:48:05 UTC, 2 replies.
- Re: [PR] [SPARK-52991][SQL][FOLLOW-UP] Revise `MergeIntoTable` to use `lazy val` and add a new test [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/17 05:26:28 UTC, 2 replies.
- [PR] [SPARK-53607] Support Java 25 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/17 05:50:25 UTC, 5 replies.
- Re: [PR] [SPARK-53598][SQL] Check numParts field for Hive tables before reading schema [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/17 06:04:07 UTC, 3 replies.
- [PR] [SPARK-53613] Upgrade `google-java-format` to 1.28.0 to support Java 25 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/17 06:34:21 UTC, 2 replies.
- [PR] [SPARK-53617] Use `zulu` Java distribution in GitHub Action jobs [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/17 06:44:26 UTC, 2 replies.
- Re: [PR] [SPARK-52669][PySpark]Improvement PySpark choose pythonExec in cluster yarn client mode [spark] - posted by "gwdgithubnom (via GitHub)" <gi...@apache.org> on 2025/09/17 06:49:52 UTC, 0 replies.
- Re: [PR] [SPARK-53112][SQL][PYTHON][CONNECT] Support TIME in the make_timestamp_ntz and try_make_timestamp_ntz functions in PySpark [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/17 07:35:42 UTC, 25 replies.
- [PR] [SPARK-53619][PYTHON][DOCS][TESTS] Enable doctests for toArrow/toPandas/mapInArrow/mapInPandas [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/17 08:56:17 UTC, 6 replies.
- [PR] [SPARK-53620][CORE] SparkSubmit should print stacktrace when exitFn is called [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/09/17 09:17:46 UTC, 5 replies.
- [PR] [HWORKS-2203] Workflow Tested [spark] - posted by "vatj (via GitHub)" <gi...@apache.org> on 2025/09/17 10:12:44 UTC, 1 replies.
- [PR] [SPARK-47110][CONNECT][TESTS] Reenble AmmoniteTest tests in Maven builds [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/09/17 14:44:25 UTC, 0 replies.
- [PR] [WIP] Transition PySpark default to bytes instead of bytesarray [spark] - posted by "craiuconstantintiberiu (via GitHub)" <gi...@apache.org> on 2025/09/17 15:35:46 UTC, 1 replies.
- Re: [PR] [SPARK-53337][CORE] Ensure the application name get escaped. [spark] - posted by "roddhjav (via GitHub)" <gi...@apache.org> on 2025/09/17 15:57:03 UTC, 1 replies.
- [PR] [SPARK-53537][Core] Adding Support for Executing CONTINUE HANDLER [spark] - posted by "TeodorDjelic (via GitHub)" <gi...@apache.org> on 2025/09/17 17:00:24 UTC, 0 replies.
- [PR] Bump rexml from 3.3.9 to 3.4.2 in /docs [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/09/17 18:54:35 UTC, 2 replies.
- [PR] [SPARK-53622][TEST] Improve UninterruptibleThread test [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/09/17 19:51:09 UTC, 1 replies.
- Re: [PR] [SPARK-53507][CONNECT] Add breaking change info to errors [spark] - posted by "imarkowitz (via GitHub)" <gi...@apache.org> on 2025/09/17 20:51:09 UTC, 5 replies.
- [PR] [SPARK-53624] Use `bitnamisecure/kubectl:latest` for Helm Chart testing [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/17 21:16:05 UTC, 4 replies.
- [PR] [SPARK-53623][SQL] improve reading large table properties performance [spark] - posted by "yeshengm (via GitHub)" <gi...@apache.org> on 2025/09/17 21:16:13 UTC, 8 replies.
- [PR] [SPARK-53625] [SS] Propagate metadata columns through projections to address ApplyCharTypePadding incompatibility [spark] - posted by "liviazhu (via GitHub)" <gi...@apache.org> on 2025/09/17 21:27:25 UTC, 1 replies.
- [PR] [SPARK-53626][DOCS] Add invalid mixed-type operations to ANSI migration guide [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/09/17 21:36:15 UTC, 3 replies.
- [PR] [SPARK-53627] Update docs to recommend K8s 1.32+ [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/17 21:58:18 UTC, 2 replies.
- Re: [PR] [SPARK-47110][INFRA] Reenble AmmoniteTest tests in Maven builds [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/09/17 22:20:18 UTC, 5 replies.
- [PR] [SPARK-53628] Upgrade `pmd` and `spotbugs` and enable checking on Java 25 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/17 22:35:43 UTC, 0 replies.
- Re: [PR] [SPARK-53628] Upgrade `PMD/SpotBugs` and enable checking on Java 25 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/17 22:39:35 UTC, 3 replies.
- Re: [PR] [SPARK-52482][SQL][CORE] ZStandard support for file data source reader [spark] - posted by "rcalme (via GitHub)" <gi...@apache.org> on 2025/09/17 23:17:27 UTC, 0 replies.
- Re: [PR] [SPARK-53598][SQL] Check the existence of numParts before reading large table property [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/09/17 23:20:08 UTC, 5 replies.
- [PR] [SPARK-53629][SQL] Implement type widening for MERGE INTO WITH SCHEMA EVOLUTION [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/09/18 01:01:39 UTC, 12 replies.
- [PR] [SPARK-51426][PYTHON] Fix 'Setting metadata to empty dict does not work' [spark] - posted by "petern48 (via GitHub)" <gi...@apache.org> on 2025/09/18 02:32:39 UTC, 0 replies.
- [PR] [MINOR][TESTS] Restore classic-only python tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/18 02:40:16 UTC, 2 replies.
- [PR] [SPARK-53630][PYTHON][DOCS][TESTS] Reenable doctest for `Dataframe.freqItems` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/18 02:48:16 UTC, 2 replies.
- [PR] [SPARK-53523][SQL][FOLLOWUP] Udpate scaladocs and add tests in ProcedureSuite [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/09/18 05:12:33 UTC, 3 replies.
- Re: [PR] [SPARK-53323][CONNECT] Enable Spark Connect tests for df.asTable() in Arrow UDTF [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2025/09/18 05:56:54 UTC, 0 replies.
- Re: [PR] [SPARK-53625][SS] Propagate metadata columns through projections to address ApplyCharTypePadding incompatibility [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/18 06:36:09 UTC, 5 replies.
- [PR] [SPARK-53631][CORE][SHS] Optimize memory and perf on SHS bootstrap [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/09/18 07:08:39 UTC, 17 replies.
- Re: [PR] [SPARK-53323][PYTHON][CONNECT] Enable Spark Connect tests for df.asTable() in Arrow UDTF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/18 07:46:32 UTC, 1 replies.
- [PR] [SPARK-53632][PYTHON][DOCS][TESTS] Reenable doctest for `DataFrame.pandas_api` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/18 07:52:33 UTC, 2 replies.
- [PR] [SPARK-53633][SQL] Reuse InputStream in vectorized Parquet reader [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/09/18 08:31:20 UTC, 20 replies.
- [PR] [SPARK-53598][SQL][3.5] Check the existence of numParts before reading large table property [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/09/18 10:06:45 UTC, 4 replies.
- [PR] [SPARK-53636][CORE] Fix thread-safety issue in SortShuffleManager.unregisterShuffle [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2025/09/18 13:19:22 UTC, 6 replies.
- [PR] [SPARK-53233][SQL][FOLLOWUP] Add compatibility class/object for org.apache.spark.sql.execution.streaming [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/18 13:52:26 UTC, 3 replies.
- Re: [PR] [SPARK-53622][CORE][TEST] Improve `UninterruptibleThreadSuite` [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2025/09/18 14:00:04 UTC, 6 replies.
- [PR] [SPARK-39328][TESTS] Improve flaky test `SPARK-37753: Inhibit broadcast in left outer join when there are many empty partitions on outer/left side` [spark] - posted by "Last-remote11 (via GitHub)" <gi...@apache.org> on 2025/09/18 14:16:33 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-53621][CORE] Adding Support for Executing CONTINUE HANDLER [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2025/09/18 14:33:35 UTC, 3 replies.
- Re: [PR] [SPARK-51426][PYTHON][SQL] Fix 'Setting metadata to empty dict does not work' [spark] - posted by "petern48 (via GitHub)" <gi...@apache.org> on 2025/09/18 14:34:25 UTC, 0 replies.
- [PR] Converted to Maven to Gradle [spark] - posted by "ravindrab-kota (via GitHub)" <gi...@apache.org> on 2025/09/18 14:40:52 UTC, 2 replies.
- [PR] [SPARK-53637][BUILD] Demote bcprov-jdk18on to test scope [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/09/18 15:12:46 UTC, 4 replies.
- Re: [PR] [SPARK-53593][SDP] Add response field for DefineDataset and DefineFlow RPC [spark] - posted by "SCHJonathan (via GitHub)" <gi...@apache.org> on 2025/09/18 16:37:33 UTC, 37 replies.
- Re: [PR] [SPARK-39328][SQL][TESTS] Fix flaky test `SPARK-37753: Inhibit broadcast in left outer join when there are many empty partitions on outer/left side` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/18 16:40:43 UTC, 1 replies.
- [PR] [SPARK-53638] Limit the byte size of arrow batch for TWS to avoid OOM [spark] - posted by "zeruibao (via GitHub)" <gi...@apache.org> on 2025/09/18 17:55:29 UTC, 1 replies.
- [PR] [SPARK-53639] Use `spark` consistently for Helm installation name [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/18 18:26:47 UTC, 0 replies.
- Re: [PR] [SPARK-53639] Use `spark` consistently for `release-name` of Helm installation [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/18 18:35:39 UTC, 3 replies.
- [PR] [SPARK-53641][DOCS] Add PARTITION BY support in Arrow Python UDTF docs [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/09/18 21:37:02 UTC, 2 replies.
- [PR] [SPARK-53642] Improve Javadoc for interfaces, class, methods, variables [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/18 22:35:05 UTC, 0 replies.
- Re: [PR] [SPARK-53642] Improve `Javadoc` for interfaces, classes, methods, variables [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/18 23:29:18 UTC, 3 replies.
- Re: [PR] Better do idle python workers cleanup [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/19 00:26:50 UTC, 1 replies.
- Re: [PR] [SPARK-51831][SQL] Column pruning with existsJoin for Datasource V2 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/19 00:26:51 UTC, 20 replies.
- Re: [PR] [SPARK-52104][CONNECT][SCALA] Validate column name eagerly in Spark Connect Scala Client [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/19 00:26:52 UTC, 1 replies.
- [PR] [SPARK-53644] Upgrade `Gradle` to 9.1.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/19 03:02:28 UTC, 4 replies.
- [PR] [SPARK-46166][PS] Implement `skipna` parameter for ps.DataFrame `any()` [spark] - posted by "petern48 (via GitHub)" <gi...@apache.org> on 2025/09/19 05:33:34 UTC, 0 replies.
- [PR] [MINOR][TESTS] Fix the intention of 'read parquet footers in parallel' test [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/09/19 09:32:00 UTC, 0 replies.
- Re: [PR] [SPARK-53553][CONNECT][4.0] Fix handling of null values in LiteralValueProtoConverter [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/09/19 12:39:42 UTC, 2 replies.
- Re: [PR] [SPARK-53645][PS] Implement `skipna` parameter for ps.DataFrame `any()` [spark] - posted by "petern48 (via GitHub)" <gi...@apache.org> on 2025/09/19 15:07:02 UTC, 9 replies.
- [PR] [SPARK-53646] Improve `KubernetesMetricsInterceptorTest` to verify `http.request` metric [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/19 17:46:04 UTC, 4 replies.
- [PR] [SPARK-53647][SPARK-53648] Use `VertxHttpClientFactory` and `io.fabric8.kubernetes.client.http.Interceptor` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/19 19:04:31 UTC, 8 replies.
- [PR] [DOCS] Fix minor grammar/typos in sql-programming-guide.md [spark] - posted by "Username46786 (via GitHub)" <gi...@apache.org> on 2025/09/19 19:06:10 UTC, 2 replies.
- [PR] [SPARK-53649] Remove `logging-interceptor` dependency [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/19 19:45:03 UTC, 3 replies.
- [PR] [SPARK-53551][SQL] Add unit test for Metadata equality check [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/09/19 19:57:14 UTC, 0 replies.
- [PR] [SPARK-53650] Make `build.gradle` and `libs.versions.toml` up-to-date with `okhttp3` usage [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/19 20:37:52 UTC, 3 replies.
- Re: [PR] [SPARK-52997] Fixes wrong worker assignment if multiple clusters are deployed to the same namespace [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/19 21:56:03 UTC, 1 replies.
- Re: [PR] [SPARK-49110][SQL] Fix reading metadata columns for tables with CHAR columns [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/20 00:25:05 UTC, 1 replies.
- Re: [PR] Quiet "Unable to load native-hadoop library for your platform" message [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/20 00:25:07 UTC, 1 replies.
- Re: [PR] [SPARK-53504][SQL] Type framework [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/09/20 09:29:35 UTC, 0 replies.
- [PR] [SPARK-53651] Add support for persistent views in pipelines [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/09/20 17:10:31 UTC, 0 replies.
- [PR] [SPARK-53652][SQL]Codegen for MergeRowExec [spark] - posted by "karuppayya (via GitHub)" <gi...@apache.org> on 2025/09/21 01:55:38 UTC, 2 replies.
- [PR] Update rexml gem version to 3.4.2 [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2025/09/21 20:20:17 UTC, 0 replies.
- Re: [PR] [SPARK-53653][DOC] Update `rexml` gem version to 3.4.4 [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2025/09/21 20:57:54 UTC, 1 replies.
- Re: [PR] [SQL] Add unit test for Metadata equality check [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/09/21 22:57:03 UTC, 0 replies.
- Re: [PR] [SPARK-52461] [SQL] Collapse inner Cast from DecimalType to DecimalType [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/22 00:29:19 UTC, 1 replies.
- [PR] [SPARK-7008][PYTHON] Support `seed` in function `uuid` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/22 02:58:22 UTC, 0 replies.
- Re: [PR] [SPARK-53655][TESTS] Fix the intention of 'read parquet footers in parallel' test [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/09/22 03:03:18 UTC, 0 replies.
- [PR] [SPARK-53656][SQL] Refactor MemoryStream to use SparkSession instead of SQLContext [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2025/09/22 03:24:18 UTC, 11 replies.
- [PR] [SPARK-7008][PYTHON][TESTS][FOLLOW-UP] Remove unused config in the parity test [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/22 03:29:55 UTC, 0 replies.
- [PR] [SPARK-7008][PYTHON][TESTS] Enable doctests for `GroupedData.agg` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/22 03:45:57 UTC, 0 replies.
- Re: [PR] [SPARK-53575][CORE] Retry entire consumer stages when checksum mismatch detected for a retried shuffle map task [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2025/09/22 04:46:56 UTC, 19 replies.
- Re: [PR] [SPARK-53357][PYTHON] Update `pandas` to 2.3.2 [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/22 06:27:02 UTC, 3 replies.
- Re: [PR] [SPARK-53592][PYTHON][TESTS][FOLLOW-UP] Remove unused config in the parity test [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/22 07:47:12 UTC, 1 replies.
- Re: [PR] [SQL][TESTS] Add unit test for Metadata equality check [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/22 07:58:28 UTC, 0 replies.
- Re: [PR] [SPARK-53657][PYTHON][TESTS] Enable doctests for `GroupedData.agg` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/22 10:59:29 UTC, 1 replies.
- Re: [PR] [SPARK-53654][SQL][PYTHON] Support `seed` in function `uuid` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/22 13:02:52 UTC, 1 replies.
- [PR] [SPARK-53658][CONNECT] Accept literal data_type field in ExecutePlanResponse [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/09/22 13:05:17 UTC, 0 replies.
- [PR] [SPARK-53659] Infer Variant shredding schema when writing to Parquet [spark] - posted by "cashmand (via GitHub)" <gi...@apache.org> on 2025/09/22 13:48:18 UTC, 0 replies.
- Re: [PR] [SPARK-35565][SS] Add config for ignoring metadata directory of FileStreamSink [spark] - posted by "mohaidoss (via GitHub)" <gi...@apache.org> on 2025/09/22 15:35:28 UTC, 0 replies.
- Re: [PR] [SPARK-53655][SQL][TESTS] Fix the intention of 'read parquet footers in parallel' test [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/22 15:49:07 UTC, 0 replies.
- [PR] [SPARK-53661][BUILD][TESTS] Upgrade `bouncycastle` to 1.82 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/22 16:10:42 UTC, 4 replies.
- [PR] [SPARK-53663] Add `spark-history-server-preview.yaml` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/22 18:16:46 UTC, 2 replies.
- [PR] [DO-NOT-MERGE][DRAFT] Test workflow for python 3.11 and spark connect 3.5 [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2025/09/22 18:36:15 UTC, 0 replies.
- [PR] Executing continue handlers test 1 [spark] - posted by "TeodorDjelic (via GitHub)" <gi...@apache.org> on 2025/09/22 19:10:48 UTC, 2 replies.
- [PR] [SPARK-53664] Update `updateResponseMetrics` to handle valid responses only [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/22 19:25:51 UTC, 3 replies.
- [PR] Executing continue handlers test 2 [spark] - posted by "TeodorDjelic (via GitHub)" <gi...@apache.org> on 2025/09/22 19:36:26 UTC, 2 replies.
- Re: [PR] [SPARK-53665][DOCS] Fix minor grammar/typos in sql-programming-guide.md [spark] - posted by "Username46786 (via GitHub)" <gi...@apache.org> on 2025/09/22 19:59:24 UTC, 1 replies.
- [PR] Executing continue handlers test 3 [spark] - posted by "TeodorDjelic (via GitHub)" <gi...@apache.org> on 2025/09/22 20:07:39 UTC, 2 replies.
- [PR] [SPARK-53666][DOCS] Add script to generate llms.txt file for Spark main website [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/09/22 21:00:35 UTC, 2 replies.
- [PR] [SPARK-53668][BUILD] Add `--enable-native-access=ALL-UNNAMED` to `build/sbt` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/22 21:08:22 UTC, 3 replies.
- [PR] [SPARK-53669] Publish SBOM artifacts [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/22 23:22:04 UTC, 3 replies.
- [PR] [SPARK-53670] Use `Gradle Java Toolchain` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/22 23:55:19 UTC, 2 replies.
- [PR] [SPARK-53643][DOCS] Add Arrow UDF to debugging and user guide [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/09/23 00:19:23 UTC, 3 replies.
- Re: [PR] [BINDER] Upgrade pip in postBuild to fix ResolutionImpossible Fix: Binder build failure due to pip dependency resolution [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/23 00:26:35 UTC, 1 replies.
- Re: [PR] [SPARK-53660][SQL][TESTS] Add unit test for Metadata equality check [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/09/23 01:19:25 UTC, 1 replies.
- [PR] remove import [spark] - posted by "Ali-Sayed-Salehi (via GitHub)" <gi...@apache.org> on 2025/09/23 01:50:15 UTC, 1 replies.
- [PR] [SPARK-53671][PYTHON] Exclude 0-args from `@udf` eval type inference [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/23 02:11:47 UTC, 2 replies.
- Re: [PR] [SPARK-53651][SDP] Add support for persistent views in pipelines [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/23 02:58:55 UTC, 1 replies.
- [PR] [SPARK-53673][CONNECT][TESTS] Fix a flaky test failure in `SparkSessionE2ESuite - interrupt tag` caused by the usage of `ForkJoinPool` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/09/23 04:31:47 UTC, 4 replies.
- [PR] [SPARK-53674][SQL] Strip metadata from lateral reference of complex type column [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/09/23 09:04:28 UTC, 0 replies.
- [PR] [SPARK-53676][PYTHON][INFRA][TESTS] Skip UDF type check in minimum dependency envs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/23 10:54:40 UTC, 0 replies.
- [PR] [SPARK-53676][PYTHON] Extend to support column name [spark] - posted by "malthe (via GitHub)" <gi...@apache.org> on 2025/09/23 11:05:26 UTC, 0 replies.
- [PR] [SPARK-53677] Improve debuggability for JDBC data source when query contains syntax error [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2025/09/23 15:05:01 UTC, 4 replies.
- Re: [PR] [SPARK-53676][PYTHON][TESTS] Skip UDF type check with numpy 1.x [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/23 16:03:22 UTC, 0 replies.
- Re: [PR] [SPARK-52844][PYTHON] Update `protobuf` Python package to 5.29.5 [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2025/09/23 16:14:24 UTC, 5 replies.
- [PR] [SPARK-53498][SDP][TESTS][FOLLOWUP] Fix compilation errors in `SparkPipelinesSuite` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/09/23 16:52:53 UTC, 2 replies.
- [PR] [SPARK-53679] Fix typos in Spark Kubernetes Operator documentation [spark-kubernetes-operator] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/09/23 16:55:24 UTC, 3 replies.
- [PR] [SPARK-53678][SQL] Fix NPE when subclass of ColumnVector is created with null DataType [spark] - posted by "manuzhang (via GitHub)" <gi...@apache.org> on 2025/09/23 16:58:57 UTC, 3 replies.
- Re: [PR] [SPARK-53498][CORE][TESTS][FOLLOWUP] Fix compilation errors in `SparkPipelinesSuite` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/09/23 18:40:04 UTC, 0 replies.
- Re: [PR] [SPARK-53516][CORE][TESTS][FOLLOWUP] Fix compilation errors in `SparkPipelinesSuite` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/09/23 18:42:11 UTC, 3 replies.
- [PR] [SPARK-53667][SQL] Fix EXPLAIN for CALL with IDENTIFIER [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/09/23 19:54:09 UTC, 3 replies.
- [PR] [SPARK-53681][BUILD][TESTS] Upgrade `snowflake-jdbc` to 3.26.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/23 20:25:02 UTC, 4 replies.
- [PR] [SPARK-53682][INFRA] Refresh `spark-rm` Docker Image with `jammy-20250819` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/23 20:56:19 UTC, 3 replies.
- [PR] [SPARK-53683] Use `Spark 3.5.7` for Spark 3 integration tests [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/23 22:33:46 UTC, 2 replies.
- Re: [PR] [SPARK-53371] Upgrade `gRPC Swift NIO Transport` to 2.1.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/23 22:40:21 UTC, 0 replies.
- [PR] [SPARK-53685] Upgrade `gRPC Swift NIO Transport` to 2.1.1 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/23 22:42:20 UTC, 2 replies.
- [PR] [SPARK-53686][SQL] DESC column should print out default value [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2025/09/24 00:41:50 UTC, 1 replies.
- [PR] [SPARK-53687][SQL][SS] Introduce WATERMARK clause in SQL statement [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/09/24 01:47:00 UTC, 1 replies.
- Re: [PR] [SPARK-53687][SQL][SS][SDP] Introduce WATERMARK clause in SQL statement [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/09/24 01:53:09 UTC, 23 replies.
- [PR] [SPARK-53688][PYTHON][INFRA][TESTS] Restore scheduled job Python on MacOS [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/24 02:19:32 UTC, 4 replies.
- [PR] [SPARK-53689][BUILD] Respect RELEASE_VERSION environment variable if already defined [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/09/24 03:42:28 UTC, 3 replies.
- Re: [PR] [SPARK-53688][PYTHON][INFRA][TESTS] Increase the timeout and skip UDF type tests in Python-only on MacOS [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/24 04:11:24 UTC, 2 replies.
- [PR] skip slowness test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/09/24 04:25:19 UTC, 7 replies.
- Re: [PR] [SPARK-53631][CORE] Optimize memory and perf on SHS bootstrap [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/24 04:34:20 UTC, 1 replies.
- Re: [PR] [SPARK-53573][WIP][SQL] Use Pre-processor for generalized parameter marker handling [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/24 05:06:05 UTC, 22 replies.
- [PR] [SPARK-53689][BUILD][FOLLOW-UP] Respect RELEASE_VERSION environment variable if already defined [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/09/24 05:22:23 UTC, 3 replies.
- [PR] [WIP][PS][INFRA] Further reorganize tests for Pandas API [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/24 07:57:14 UTC, 0 replies.
- [PR] [SPARK-53689][BUILD][FOLLOW-UP] Check if RELEASE_VERSION is already set properly [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/09/24 08:21:50 UTC, 2 replies.
- [PR] [SPARK-53692][DOCS] Remove a unused configuration spark.appStatusStore.diskStoreDir [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/09/24 09:17:48 UTC, 3 replies.
- [PR] [SPARK-53693] Publish Apache Spark 3.5.7 to docker registry [spark-docker] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/09/24 10:17:37 UTC, 12 replies.
- [PR] [SPARK-53694][SQL][TESTS] Improve V1WriteHiveCommandSuite test coverage [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/09/24 10:29:35 UTC, 2 replies.
- [PR] [SPARK-53695][PYTHON][TESTS] Add tests for 0-arg grouped agg UDF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/24 10:55:06 UTC, 3 replies.
- Re: [PR] [SPARK-53691][PS][INFRA][TESTS] Further reorganize tests for Pandas API [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/09/24 13:04:41 UTC, 9 replies.
- Re: [PR] [SPARK-53674][SQL] Handle single-pass analyzer LCAs when assigning aliases [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/24 13:09:28 UTC, 1 replies.
- Re: [PR] [WIP] Default PySpark BinaryType to bytes. [spark] - posted by "xianzhe-databricks (via GitHub)" <gi...@apache.org> on 2025/09/24 13:21:10 UTC, 0 replies.
- [PR] first commit [spark] - posted by "xianzhe-databricks (via GitHub)" <gi...@apache.org> on 2025/09/24 13:41:06 UTC, 0 replies.
- Re: [PR] [SPARK-53677][SQL] Improve debuggability for JDBC data source when query contains syntax error [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/24 13:48:35 UTC, 1 replies.
- [PR] [SPARK-53690][SS] Fix exponential formatting of avgOffsetsBehindLatest and estimatedTotalBytesBehindLatest in Kafka sources object in progress json [spark] - posted by "jayantdb (via GitHub)" <gi...@apache.org> on 2025/09/24 15:38:31 UTC, 0 replies.
- [PR] [SPARK-53697] Use `4.1.0-preview2` for `integration-test-(mac-spark41|token)` GitHub Action jobs [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/24 16:32:43 UTC, 4 replies.
- Re: [PR] [SPARK-XXX][PYTHON] Update pyyaml to 5.4 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/24 16:42:44 UTC, 0 replies.
- Re: [PR] [SPARK-XXX][PYTHON] Update mlflow to 3.1.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/24 16:43:11 UTC, 0 replies.
- Re: [PR] [SPARK-XXX][PYTHON][TESTS] Update `black` python to 24.3.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/24 16:43:47 UTC, 0 replies.
- [PR] [SPARK-53698] Support Swift 6.2 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/24 18:09:02 UTC, 1 replies.
- [PR] [SPARK-53699] Add `MacOS 26` GitHub Action job [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/24 18:27:18 UTC, 5 replies.
- Re: [PR] [SPARK-53698] Support `Swift 6.2` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/24 18:36:42 UTC, 1 replies.
- [PR] [SPARK-53701] Use Java 25 toolchain while supporting Java 17+ [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/24 19:04:48 UTC, 5 replies.
- [PR] Bump org.apache.zookeeper:zookeeper from 3.9.3 to 3.9.4 [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/09/24 19:13:44 UTC, 2 replies.
- Re: [PR] [SPARK-49226][SQL] Clean-up UDF code generation [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2025/09/24 19:17:02 UTC, 0 replies.
- [PR] [SPARK-53700][SQL] Remove redundancy in simpleString in DataSourceV2RelationBase [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/09/24 20:06:41 UTC, 0 replies.
- [PR] [SPARK-53702] Update `tests` to use `4.0.1` and `3.5.7` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/24 21:39:16 UTC, 2 replies.
- [PR] [MINOR] Remove unnecesary string splits in test code [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/24 22:12:06 UTC, 3 replies.
- Re: [PR] [SPARK-53638][SS][PYTHON] Limit the byte size of arrow batch for TWS to avoid OOM [spark] - posted by "zeruibao (via GitHub)" <gi...@apache.org> on 2025/09/24 22:33:36 UTC, 2 replies.
- [PR] [SPARK-53703] Improve unit tests to be neutral from Spark version strings [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/24 22:34:51 UTC, 0 replies.
- Re: [PR] [SPARK-53703] Improve unit tests to be neutral from Spark versions [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/24 22:40:32 UTC, 2 replies.
- [PR] [SPARK-53704] Rename `pyspark-pi.yaml` to `pi-python.yaml` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/24 23:57:57 UTC, 2 replies.
- Re: [PR] [SPARK-51519][SQL] MERGE INTO/UPDATE/DELETE support join hint [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/25 00:26:40 UTC, 0 replies.
- [PR] [SPARK-53406] Avoid unnecessary shuffle join in direct passthrough shuffle id [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2025/09/25 00:41:48 UTC, 0 replies.
- [PR] [SPARK-46679][SQL] Fix for SparkUnsupportedOperationException Not found an encoder of the type T, when using Parameterized class [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/09/25 00:46:30 UTC, 9 replies.
- [PR] [SPARK-53706] App reconcile steps should properly handle exceptions in status update [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/09/25 02:00:51 UTC, 2 replies.
- Re: [PR] [SPARK-53690][SS] Fix exponential formatting of avgOffsetsBehindLatest in Kafka sources object in progress json [spark] - posted by "jayantdb (via GitHub)" <gi...@apache.org> on 2025/09/25 03:50:46 UTC, 5 replies.
- [PR] [SPARK-53708][BUILD] Upgrade `ZooKeeper` to 3.9.4 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/25 05:07:55 UTC, 3 replies.
- Re: [PR] [SPARK-53700][SQL] Remove redundancy in `DataSourceV2RelationBase.simpleString` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/25 05:22:47 UTC, 6 replies.
- Re: [PR] [SPARK-53694][SQL][TESTS] Improve `V1WriteHiveCommandSuite` test coverage [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/25 05:49:59 UTC, 1 replies.
- [PR] [SPARK-53709][BUILD] Upgrade Junit to 5.13.4 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/09/25 05:59:43 UTC, 3 replies.
- [PR] [SPARK-53710] Upgrade `junit` to 5.13.4 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/25 06:07:34 UTC, 2 replies.
- [PR] [SPARK-53711] Upgrade `operator-sdk` to 5.1.3 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/25 06:13:36 UTC, 4 replies.
- [PR] [SPARK-53712] Fix `spark-operator` to use `JUnit 5` instead of `JUnit 4` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/25 06:43:52 UTC, 3 replies.
- [PR] [SPARK-53713] Remove `org.jetbrains.annotations` test code dependency from `spark-operator` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/25 06:54:07 UTC, 3 replies.
- [PR] [SPARK-53714] Remove `okhttp3` dependency [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/25 07:06:19 UTC, 3 replies.
- [PR] Test buf plugin v29.5 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/09/25 07:19:17 UTC, 1 replies.
- Re: [PR] [SPARK-51353][INFRA][BUILD] Retry dyn/closer.lua for mvn before falling back to archive.a.o [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2025/09/25 07:36:58 UTC, 0 replies.
- [PR] [SPARK-53707] Improve attribute metadata handling. [spark] - posted by "ksbeyer (via GitHub)" <gi...@apache.org> on 2025/09/25 07:38:08 UTC, 4 replies.
- Re: [PR] [WIP][SPARK-53707] Improve attribute metadata handling. [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/25 07:45:24 UTC, 3 replies.
- [PR] [SPARK-53372][FOLLOWUP] Synchronize the installation of `pyyaml` into `maven_test.yml` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/09/25 07:50:44 UTC, 0 replies.
- Re: [PR] [SPARK-53372][INFRA][FOLLOWUP] Synchronize the installation of `pyyaml` into `maven_test.yml` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/09/25 07:53:29 UTC, 4 replies.
- [PR] [SPARK-53715][SQL] Refactor getWritePrivileges for MergeIntoTable [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/09/25 08:15:18 UTC, 9 replies.
- [PR] [SPARK-53695][PYTHON][TESTS][FOLLOW-UP] Additional test for type hint [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/25 08:19:21 UTC, 2 replies.
- Re: [PR] [SPARK-53406][SQL] Avoid unnecessary shuffle join in direct passthrough shuffle id [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/25 08:55:08 UTC, 12 replies.
- [PR] [DRAFT][SPARK-51519][SQL] MERGE INTO/UPDATE/DELETE support join hint [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/09/25 09:15:56 UTC, 1 replies.
- [PR] [SPARK-53716][PYTHON][DOCS] Document vectorized UDF with `@udf` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/25 10:15:26 UTC, 1 replies.
- [PR] [SPARK-53717] Improve the accuracy of MapType’s comment [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/09/25 12:24:42 UTC, 0 replies.
- Re: [PR] [SPARK-53717][SQL] Improve the accuracy of MapType’s comment [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/09/25 12:28:39 UTC, 0 replies.
- [PR] [SPARK-51831][SQL][3.5] Column pruning with existsJoin for Datasource V2 [spark] - posted by "jackylee-ch (via GitHub)" <gi...@apache.org> on 2025/09/25 12:56:39 UTC, 7 replies.
- [PR] Fix nested char padding [spark] - posted by "ashdnazg (via GitHub)" <gi...@apache.org> on 2025/09/25 14:44:56 UTC, 0 replies.
- Re: [PR] [SPARK-53717][SQL] Revise `MapType.valueContainsNull` parameter comment more correctly [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/25 16:26:36 UTC, 0 replies.
- [PR] [SPARK-51831][SQL][4.0] Column pruning with existsJoin for Datasource V2 [spark] - posted by "jackylee-ch (via GitHub)" <gi...@apache.org> on 2025/09/25 16:53:02 UTC, 5 replies.
- [PR] [SPARK-53570][SQL] Enhance type checking in _to_col function ### What changes were proposed in this commit? This update improves the type checking in the `_to_col` function by explicitly raising a `PySparkTypeError` when the input is neither a `Column` nor a `str`. ### Why are the changes needed? The changes ensure that the function handles incorrect input types more gracefully, providing clearer error messages to users. ### Does this commit introduce _any_ user-facing change? Yes, it introduces more informative error handling for invalid input types. ### How was this patch tested? Unit tests were updated to cover the new error handling scenarios. [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/09/25 18:12:07 UTC, 0 replies.
- [PR] [SPARK-53720][SQL] Simplify extracting Table from DataSourceV2Relation [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/09/25 19:38:31 UTC, 0 replies.
- [PR] [SPARK-53112][SQL][PYTHON][CONNECT][FOLLOW-UP] Change date and time to be positional arguments [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2025/09/25 19:48:18 UTC, 2 replies.
- [PR] [SPARK-53721] Fix `HelmChart` template to use Spark-version agnostic `SparkApplicationSentinel` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/25 21:11:39 UTC, 1 replies.
- Re: [PR] [SPARK-52937][SDP] Sinks [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/09/25 21:24:17 UTC, 4 replies.
- [PR] [SPARK-53722] Document `workloadResources.sparkApplicationSentinel.name` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/25 21:28:59 UTC, 2 replies.
- Re: [PR] [SPARK-53721] Fix `HelmChart` template to use Spark-version agnostic `SentinelResource` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/25 21:48:02 UTC, 1 replies.
- [PR] [SPARK-53723] Support `SparkCluster` Sentinel Resource [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/25 22:11:10 UTC, 2 replies.
- [PR] [SPARK-53700][SQL][TEST][FOLLOWUP] Regenerate `ProtoToParsedPlanTestSuite` answer files [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/25 22:49:34 UTC, 4 replies.
- [PR] [SPARK-53724] Update `Examples` and documentations to use `4.0.1` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/25 23:29:03 UTC, 3 replies.
- [PR] [SPARK-53725] Bump version to 0.6.0-SNAPSHOT in `main` branch [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/25 23:54:33 UTC, 1 replies.
- [PR] [SPARK-53727] Update GitHub Action YAML file in `branch-0.5` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/25 23:57:08 UTC, 5 replies.
- Re: [PR] [SPARK-42329][SQL]Assign name to _LEGACY_ERROR_TEMP_2256 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/26 00:26:18 UTC, 1 replies.
- Re: [PR] [SPARK-48660][SQL] Fix explain result for CreateTableAsSelect [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/26 00:26:20 UTC, 1 replies.
- Re: [PR] [SPARK-51765][DOCS] Docs for SQL Scripting [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/26 00:26:22 UTC, 1 replies.
- Re: [PR] [SPARK-53570][SQL][PYTHON][CONNECT] Enhance type checking in `_to_col` function [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/26 00:29:25 UTC, 0 replies.
- Re: [PR] [SPARK-53719][SQL][PYTHON][CONNECT] Enhance type checking in `_to_col` function [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/26 00:34:24 UTC, 1 replies.
- [PR] [SPARK-53728][SDP] Print PipelineEvent Message with Error In Test [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/09/26 02:29:32 UTC, 2 replies.
- [PR] [SPARK-53729][PYTHON][CONNECT] Fix serialization of `pyspark.sql.connect.window.WindowSpec` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/26 03:29:25 UTC, 4 replies.
- [PR] [SPARK-52407][SQL][TESTS] Regenerate thetasketch.sql_analyzer_test [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/09/26 05:38:22 UTC, 2 replies.
- [PR] Switch Spark 3.5 Java 11 docker registry images to 11-jammy [spark-docker] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/09/26 07:22:33 UTC, 1 replies.
- Re: [PR] [SPARK-52407][SQL][TESTS][FOLLOWUP] Regenerate thetasketch.sql_analyzer_test [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/09/26 09:06:32 UTC, 4 replies.
- [PR] [SPARK-53112][PYTHON][TESTS][FOLLOW-UP] Remove some tests for Non-ANSI [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/09/26 10:00:17 UTC, 5 replies.
- Re: [PR] [SPARK-53696][PYTHON]Default to `bytes` for `BinaryType` in PySpark UDF [spark] - posted by "xianzhe-databricks (via GitHub)" <gi...@apache.org> on 2025/09/26 10:46:13 UTC, 1 replies.
- [PR] [SPARK-53696][PYTHON]Default to bytes for BinaryType in PySpark UDF [spark] - posted by "xianzhe-databricks (via GitHub)" <gi...@apache.org> on 2025/09/26 10:46:29 UTC, 2 replies.
- [PR] [SQL][Minor] Clean up golden files for and add comments for LIMIT ALL in rCTEs [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/09/26 12:52:53 UTC, 1 replies.
- [PR] [SPARK-53718][SQL] Add a new Optimizer rule to flatten nested MapConcat expressions [spark] - posted by "MRKKmrkk (via GitHub)" <gi...@apache.org> on 2025/09/26 13:24:00 UTC, 0 replies.
- [PR] hide JVM stack trace [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/09/26 15:30:18 UTC, 0 replies.
- Re: [PR] [SPARK-42746][SQL] Fix optimizer failure for SortOrder in the LISTAGG function [spark] - posted by "mikhailnik-db (via GitHub)" <gi...@apache.org> on 2025/09/26 15:37:22 UTC, 2 replies.
- [PR] [SPARK-53733][SQL] Delay `resolveColsLastResort` until all previous `UnresolvedAlias`es are resolved [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/09/26 16:28:20 UTC, 9 replies.
- [PR] [SPARK-53734][SQL] Prefer table column over LCA when resolving array index [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/09/26 17:06:23 UTC, 2 replies.
- [PR] [WIP][SPARK-53737] Add Real-time Mode trigger [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2025/09/27 01:23:47 UTC, 0 replies.
- [PR] [SPARK-53738][SQL] PlannedWrite should preserve custom sort order when query output contains literal [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/09/27 01:57:31 UTC, 24 replies.
- Re: [PR] [SPARK-53015][BUILD] Upgrade log4j to 2.25.1 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/09/27 07:30:45 UTC, 0 replies.
- [PR] Revert "[SPARK-53015][BUILD] Upgrade log4j to 2.25.1" [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/09/27 07:36:13 UTC, 3 replies.
- [PR] [SPARK-53673][CONNECT][TESTS][4.0] Fix a flaky test failure in `SparkSessionE2ESuite - interrupt tag` caused by the usage of `ForkJoinPool` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/09/27 10:18:34 UTC, 2 replies.
- [PR] [SPARK-53673][CONNECT][TESTS][3.5] Fix a flaky test failure in `SparkSessionE2ESuite - interrupt tag` caused by the usage of `ForkJoinPool` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/09/27 12:32:20 UTC, 2 replies.
- [PR] [SPARK-53739] Add `pi-preview-with-eventlog.yaml` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/27 22:30:32 UTC, 2 replies.
- [PR] [SPARK-53740] Update `(pi|spark-history-server)-preview.yaml` to use `4.1.0-preview2` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/27 22:39:15 UTC, 2 replies.
- [PR] [SPARK-53741][BUILD] Upgrade ORC to 2.2.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/27 22:51:40 UTC, 0 replies.
- Re: [PR] [SPARK-53127][SQL][FOLLOWUP] Clean up golden files for and add comments for LIMIT ALL in rCTEs [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/28 01:52:57 UTC, 1 replies.
- Re: [PR] [SPARK-53209][YARN] Add ActiveProcessorCount JVM option to YARN executor and AM [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/09/28 10:17:33 UTC, 6 replies.
- [PR] [SPARK-53743][SS] Remove the usage of fetchWithArrow in ListState.put/appendList [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/09/29 03:11:19 UTC, 5 replies.
- [PR] [MINOR][INFRA] Free disk space in releasing workflow [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/09/29 03:48:30 UTC, 3 replies.
- Re: [PR] [SPARK-53656][SS] Refactor MemoryStream to use SparkSession instead of SQLContext [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2025/09/29 04:50:47 UTC, 0 replies.
- Re: [PR] [SPARK-53744][PYTHON] Update mlflow to 3.1.0 [spark] - posted by "eschcam (via GitHub)" <gi...@apache.org> on 2025/09/29 08:48:09 UTC, 0 replies.
- Re: [PR] [SPARK-53744][PYTHON][TESTS] Update `black` python to 24.3.0 [spark] - posted by "eschcam (via GitHub)" <gi...@apache.org> on 2025/09/29 08:51:11 UTC, 0 replies.
- Re: [PR] [SPARK-53746][PYTHON] Update pyyaml to 5.4 [spark] - posted by "eschcam (via GitHub)" <gi...@apache.org> on 2025/09/29 08:53:16 UTC, 0 replies.
- Re: [PR] [SPARK-53696][PYTHON]Default to bytes for BinaryType in PySpark arrow UDF [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/09/29 10:53:23 UTC, 4 replies.
- [PR] [SPARK-53747][CORE] escape spark.app.name [spark] - posted by "pjfanning (via GitHub)" <gi...@apache.org> on 2025/09/29 13:24:37 UTC, 0 replies.
- Re: [PR] [SPARK-53735] [SDP] Hide server-side JVM stack traces by default in spark-pipelines output [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/09/29 14:38:56 UTC, 0 replies.
- Re: [PR] [SPARK-53621][CORE] Adding Support for Executing CONTINUE HANDLER [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2025/09/29 15:11:39 UTC, 9 replies.
- [PR] [SPARK-53574][SQL][FOLLOWUP] still reset the default AnalysisContext [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/09/29 16:25:11 UTC, 5 replies.
- [I] Binary type not supported when creating data frame [spark-connect-go] - posted by "EmilijusS (via GitHub)" <gi...@apache.org> on 2025/09/29 16:41:46 UTC, 0 replies.
- Re: [PR] [SPARK-53659][SQL] Infer Variant shredding schema when writing to Parquet [spark] - posted by "gene-db (via GitHub)" <gi...@apache.org> on 2025/09/29 16:51:25 UTC, 0 replies.
- Re: [PR] [SPARK-53455][CONNECT] Add `CloneSession` RPC [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/09/29 18:52:43 UTC, 3 replies.
- [PR] [SPARK-53750] Use `4.1.0-preview2` instead of `RC1` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/29 19:44:32 UTC, 3 replies.
- Re: [PR] [SPARK-39800][SQL][WIP] DataSourceV2: View Support [spark] - posted by "arpitporwal2293 (via GitHub)" <gi...@apache.org> on 2025/09/29 20:23:08 UTC, 0 replies.
- [PR] [SPARK-53752] Publish Apache Spark 4.1.0-preview2 to docker registry [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/29 20:37:10 UTC, 0 replies.
- Re: [PR] [SPARK-53752] Publish Apache Spark `4.1.0-preview2` to docker registry [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/29 20:44:44 UTC, 4 replies.
- [PR] Use unquoted for response fields [spark] - posted by "cookiedough77 (via GitHub)" <gi...@apache.org> on 2025/09/29 23:37:41 UTC, 0 replies.
- Re: [PR] [SPARK-52401][SQL] Fix DataFrame.collect() cache invalidation after saveAsTable append; add regression test [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/30 00:26:59 UTC, 0 replies.
- [PR] [SPARK-53507][CORE] Use Java class for BreakingChangeInfo [spark] - posted by "imarkowitz (via GitHub)" <gi...@apache.org> on 2025/09/30 02:12:04 UTC, 2 replies.
- [PR] [BUILD] Upgrade commons-lang3 to 3.19.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/09/30 05:26:06 UTC, 1 replies.
- [PR] [SPARK-53756][SQL][TESTS] Avoid NoSuchFileException when traversing walk files iterator to fix flaky test [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2025/09/30 05:37:42 UTC, 0 replies.
- [PR] [Prototype][SPARK-53751][SDP] Explicit Checkpoint Location [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/09/30 07:24:21 UTC, 2 replies.
- Re: [PR] [SPARK-53696][PYTHON]Default to bytes for BinaryType in PySpark [spark] - posted by "xianzhe-databricks (via GitHub)" <gi...@apache.org> on 2025/09/30 08:16:33 UTC, 3 replies.
- [PR] [SPARK-53757] Upgrade Jetty to 12.0.12 [spark] - posted by "eschcam (via GitHub)" <gi...@apache.org> on 2025/09/30 09:18:58 UTC, 1 replies.
- [PR] Add option to skip Unix native rm explicitly [spark] - posted by "cw-alexcroteau (via GitHub)" <gi...@apache.org> on 2025/09/30 13:57:38 UTC, 1 replies.
- Re: [PR] [SPARK-53730] Switch Spark 3.5 Java 11 docker registry images to 11-jammy [spark-docker] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/09/30 14:10:30 UTC, 0 replies.
- [PR] [SPARK-53753][BUILD][SQL] shade antlr4-runtime [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/09/30 15:07:57 UTC, 1 replies.
- [PR] [SPARK-53760][Geo][SQL] Introduce GeometryType and GeographyType [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/09/30 15:21:16 UTC, 0 replies.
- Re: [PR] [SPARK-53573][SQL] Use Pre-processor for generalized parameter marker handling [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2025/09/30 15:25:09 UTC, 2 replies.
- [PR] [SPARK-53763] Update `integration-test-ubuntu-spark41` to use Spark `4.1.0-preview2` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/30 17:57:00 UTC, 2 replies.
- [PR] [SPARK-53764][SQL] Collapse nested get_json_object [spark] - posted by "wecharyu (via GitHub)" <gi...@apache.org> on 2025/09/30 18:30:22 UTC, 0 replies.
- [PR] [SPARK-53765] Remove Daily `integration-test-linux` GitHub Action job [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/30 18:31:55 UTC, 2 replies.
- Re: [PR] [SPARK-53507][CORE] Don't use case class for BreakingChangeInfo [spark] - posted by "imarkowitz (via GitHub)" <gi...@apache.org> on 2025/09/30 18:35:35 UTC, 1 replies.
- [PR] [SPARK-53762][SQL] Add date and time conversions simplifier rule to optimizer [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/09/30 18:37:00 UTC, 0 replies.
- [PR] [SPARK-53766][DOC] Improve execute immediate docs [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2025/09/30 18:58:16 UTC, 3 replies.
- [PR] [SPARK-53767] Upgrade `Dropwizard` metrics to 4.2.33 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/30 21:15:02 UTC, 0 replies.
- [PR] [SPARK-53768] Upgrade `lombok` to 1.18.42 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/30 21:31:02 UTC, 0 replies.
- [PR] [SPARK-53769] Enable `Annotation Processing` during Java compilation [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/30 21:45:43 UTC, 0 replies.
- [PR] [SPARK-53770] Upgrade `mockito` to 5.20.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/09/30 22:01:17 UTC, 0 replies.
- Re: [PR] [SPARK-53593][SDP] Fix: Use unquoted for response fields [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/09/30 22:09:19 UTC, 0 replies.