reviews@spark.apache.org, 2025-08

You are viewing a plain text version of this content. The canonical link for it is here.

- Re: [PR] [SPARK-53001] Integrate RocksDB Memory Usage with the Unified Memory Manager [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/08/01 00:04:15 UTC, 19 replies.
- [PR] [SPARK-53055][PS][TESTS] Remove sort_values from pyspark.pandas.tests.indexes.test_insert [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/08/01 00:09:18 UTC, 2 replies.
- [PR] [CONNECT][SPARK-53054] Fix the connect.DataFrameReader default format behavior [spark] - posted by "dillitz (via GitHub)" <gi...@apache.org> on 2025/08/01 00:11:13 UTC, 8 replies.
- Re: [PR] [SPARK-52593][PS] Avoid CAST_INVALID_INPUT of `MultiIndex.to_series`, `Series.dot` and `DataFrame.dot` in ANSI mode [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/08/01 00:36:58 UTC, 6 replies.
- [PR] [SPARK-42360][SQL] Rule to convert Left Outer Join with suitable filter to Left Anti Join [spark] - posted by "ekoifman (via GitHub)" <gi...@apache.org> on 2025/08/01 01:44:20 UTC, 3 replies.
- Re: [PR] [SPARK-53049][CORE][SQL][SS] Support `toString` in `SparkStreamUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/01 01:44:33 UTC, 1 replies.
- Re: [PR] [SPARK-53039][PYTHON][TESTS] Add unit test for complex arrow UDF used in window [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/01 01:47:07 UTC, 1 replies.
- [PR] [SPARK-53056][BUILD] Upgrade `objenesis` to 3.4 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/01 02:03:22 UTC, 2 replies.
- Re: [PR] [SPARK-51585][SQL] Oracle dialect supports pushdown datetime functions [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/08/01 02:18:58 UTC, 20 replies.
- [PR] [SPARK-53014][PYTHON][DOCS][FOLLOW-UP] Add `arrow_udf` to API reference [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/01 02:41:06 UTC, 2 replies.
- Re: [PR] [SPARK-53045][SQL] DESCRIBE EXTENDED should be resilient to corrupt metadata [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/01 02:44:18 UTC, 3 replies.
- Re: [PR] [SPARK-52729][SQL] Add MetadataOnlyTable in DS v2 API [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/01 02:50:48 UTC, 1 replies.
- [PR] [SPARK-53057][CORE] Support `sizeOf` in `SparkFileUtils` and `JavaUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/01 03:11:02 UTC, 3 replies.
- [PR] [SPARK-53058][SQL] Clean up old comments related to HashClusteredDistribution [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/08/01 03:39:09 UTC, 0 replies.
- Re: [PR] [SPARK-52819][SQL] Making KryoSerializationCodec serializable to fix java.io.NotSerializableException errors in various use cases [spark] - posted by "Kontinuation (via GitHub)" <gi...@apache.org> on 2025/08/01 04:03:40 UTC, 0 replies.
- [PR] [SPARK-53059][PYTHON] Arrow UDF no need to depend on pandas [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/01 04:55:08 UTC, 2 replies.
- [PR] Test to showcase Aggregate followed by ORDER BY doesn't preserve orders [spark] - posted by "li-boxuan (via GitHub)" <gi...@apache.org> on 2025/08/01 04:55:29 UTC, 0 replies.
- [PR] [SPARK-52928][PYTHON][INFRA][FOLLOW-UP] Remove unreachable code after upgrading pyarrow minimum version to 15.0.0 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/01 05:15:26 UTC, 0 replies.
- Re: [PR] [SPARK-53060] Test to showcase Aggregate followed by ORDER BY doesn't preserve orders [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2025/08/01 05:38:03 UTC, 2 replies.
- [PR] [SPARK-53061][CORE][SQL] Support `copyFileToDirectory` in `SparkFileUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/01 05:46:41 UTC, 4 replies.
- Re: [PR] [SPARK-53015][BUILD] Upgrade log4j to 2.25.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/01 05:49:17 UTC, 3 replies.
- Re: [PR] [SPARK-52942][YARN][BUILD] YARN External Shuffle Service jar should include `scala-library` [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/08/01 06:01:39 UTC, 6 replies.
- [PR] [SPARK-53062][CORE] Support `deleteQuietly` in `SparkFileUtils` and `JavaUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/01 06:32:05 UTC, 4 replies.
- Re: [PR] [SPARK-52974][SQL] Don't broadcast dynamicpruning InSubqueries [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/08/01 06:44:46 UTC, 8 replies.
- [PR] [SPARK-53063][CORE] Remove inner references of deprecated APIs in FileCommitProtocol [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/08/01 06:45:18 UTC, 12 replies.
- [PR] [SPARK-52503][SQL][CONNECT][TESTS][FOLLOW-UP] Add more unit tests for `df.drop` on semantic equality [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/01 07:24:06 UTC, 2 replies.
- Re: [PR] [SPARK-52980][PYTHON] Support Arrow Python UDTFs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/01 07:31:33 UTC, 4 replies.
- Re: [PR] [SPARK-53019][SQL] Fix job attempt path conflicts in o.a.hadoop..FileOutputCommitter [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/08/01 08:37:37 UTC, 7 replies.
- Re: [PR] [SPARK-52971] [PYTHON] Limit idle Python worker queue size [spark] - posted by "benrobby (via GitHub)" <gi...@apache.org> on 2025/08/01 08:54:28 UTC, 5 replies.
- Re: [PR] [SPARK-53054][CONNECT] Fix the connect.DataFrameReader default format behavior [spark] - posted by "dillitz (via GitHub)" <gi...@apache.org> on 2025/08/01 09:05:46 UTC, 2 replies.
- Re: [PR] [SPARK-52996][TESTS] Update NPM test dependencies [spark] - posted by "eschcam (via GitHub)" <gi...@apache.org> on 2025/08/01 09:27:54 UTC, 9 replies.
- [PR] [SPARK-52844][PYTHON] Update mlflow to 3.1.0 [spark] - posted by "eschcam (via GitHub)" <gi...@apache.org> on 2025/08/01 09:30:46 UTC, 0 replies.
- [PR] [SPARK-53064][CORE] Rewrite MDC LogKey in Java [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/08/01 09:32:27 UTC, 29 replies.
- Re: [PR] [SPARK-52931][Core] Restrict declare variable naming [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2025/08/01 09:57:29 UTC, 4 replies.
- [PR] WIP update `brace-expansion` to 1.1.12 [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2025/08/01 11:00:50 UTC, 2 replies.
- Re: [PR] [SPARK-52772][SQL] Inconsistent table attribute handling during updates [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/01 11:49:14 UTC, 1 replies.
- Re: [PR] [SPARK-52451][CONNECT][SQL] Make WriteOperation in SparkConnectPlanner side effect free [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/01 11:56:59 UTC, 3 replies.
- Re: [PR] [SPARK-52928][PYTHON][FOLLOW-UP] Remove unreachable code after upgrading pyarrow minimum version to 15.0.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/01 13:57:16 UTC, 0 replies.
- Re: [PR] [SPARK-52996][TESTS] Update brace-expansion to 1.1.12 [spark] - posted by "eschcam (via GitHub)" <gi...@apache.org> on 2025/08/01 15:02:36 UTC, 2 replies.
- Re: [PR] [SPARK-52998][Core] Multiple variables inside declare [spark] - posted by "TeodorDjelic (via GitHub)" <gi...@apache.org> on 2025/08/01 15:18:30 UTC, 47 replies.
- Re: [PR] [SPARK-53054][CONNECT][3.5] Fix the connect.DataFrameReader default format behavior [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/01 15:31:21 UTC, 1 replies.
- [PR] [SPARK-51555][SQL][FOLLOWUP] Fix the error message for invalid unit in the time_diff() function [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/08/01 15:59:28 UTC, 3 replies.
- [PR] [SPARK-53001][FOLLOW-UP] Integrate RocksDB Memory Usage with the Unified Memory Manager [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/08/01 16:26:53 UTC, 2 replies.
- [PR] [SPARK-53035][TESTS][FOLLOWUP] Use `String.repeat` in `tests` too [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/01 16:33:56 UTC, 4 replies.
- Re: [PR] [SPARK-52844][PYTHON][TESTS] Update black to 24.3.0 [spark] - posted by "jwong-attentive (via GitHub)" <gi...@apache.org> on 2025/08/01 17:10:12 UTC, 4 replies.
- [PR] [SPARK-53067][BUILD] Increase GCLockerRetryAllocationCount for SBT [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/08/01 17:11:00 UTC, 12 replies.
- [PR] [SPARK-53066][SQL] Improve EXPLAIN output for DSv2 Join pushdown [spark] - posted by "PetarVasiljevic-DB (via GitHub)" <gi...@apache.org> on 2025/08/01 17:28:41 UTC, 19 replies.
- [PR] [SPARK-53068][SQL][TESTS] Mark `TransformWith*Suite` as `SlowSQLTest` in `sql/core` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/01 18:10:17 UTC, 4 replies.
- [PR] [SPARK-53070][CORE] Support `is(Not)?Empty` in `SparkCollectionUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/01 19:17:10 UTC, 9 replies.
- Re: [PR] [SPARK-52968][SS] Emit additional state store metrics [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/08/01 19:35:57 UTC, 1 replies.
- Re: [PR] [SPARK-52989][SS] Add explicit close() API to State Store iterators [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/08/01 20:02:36 UTC, 28 replies.
- Re: [PR] [SPARK-53001][CORE][SQL][FOLLOW-UP] Disable `spark.memory.unmanagedMemoryPollingInterval` by default [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/08/01 20:42:28 UTC, 4 replies.
- Re: [PR] [SPARK-53058][SQL][DOCS] Clean up old comments related to HashClusteredDistribution [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/01 21:01:09 UTC, 1 replies.
- Re: [PR] [SPARK-53032] Fix parquet format of shredded timestamp values within arrays [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2025/08/01 21:34:23 UTC, 3 replies.
- [PR] [SPARK-53071][CORE][SQL][CONNECT] Support `copyFile` in `SparkFileUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/01 22:03:42 UTC, 3 replies.
- [PR] [SPARK-53072][TEST-ONLY] Only run Lock Hardening tests in RocksDBStateStoreLockHardeningSuite [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/08/01 22:15:59 UTC, 0 replies.
- [PR] [SPARK-53073][CORE][SQL][YARN][SS] Support `copyDirectory` in `SparkFileUtils` and `JavaUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/01 22:52:15 UTC, 15 replies.
- Re: [PR] [SPARK-53002] Show accurate memory usage statistics when bounded memory is enabled for RocksDB [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/08/01 23:18:32 UTC, 0 replies.
- Re: [PR] [SPARK-52915] Support TTL for Spark apps [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/08/01 23:32:32 UTC, 3 replies.
- Re: [PR] [SPARK-53072][TESTS] Only run Lock Hardening tests in RocksDBStateStoreLockHardeningSuite [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/01 23:58:05 UTC, 3 replies.
- Re: [PR] [SPARK-53002][SS] Show accurate memory usage statistics when bounded memory is enabled for RocksDB [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/08/02 00:07:12 UTC, 2 replies.
- [PR] [SPARK-53075][CORE] Use Java `Files.readAllLines/write` instead of `FileUtils.(read|write)Lines` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/02 01:40:01 UTC, 0 replies.
- Re: [PR] [SPARK-53075][CORE][TESTS] Use Java `Files.readAllLines/write` instead of `FileUtils.(read|write)Lines` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/02 04:36:19 UTC, 3 replies.
- Re: [PR] [SPARK-52975][SQL] Simplify field names in pushdown join sql [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2025/08/02 08:41:34 UTC, 5 replies.
- Re: [PR] Revert "[SPARK-52610][BUILD] Upgrade rocksdbjni to 10.2.1" [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/02 14:11:12 UTC, 2 replies.
- Re: [PR] [SPARK-47547][CORE] Add `BloomFilter` V2 and use it as default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/02 15:13:46 UTC, 1 replies.
- [PR] [SPARK-53076][CORE][TESTS] Disable `SparkBloomFilterSuite` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/02 15:23:03 UTC, 16 replies.
- [PR] [SPARK-53078][CORE] Remove `commons-(io|lang3)` test dependencies from `kvstore` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/02 15:34:53 UTC, 0 replies.
- [PR] [SPARK-53069] Fix incorrect state store metrics with virtual column families [spark] - posted by "dylanwong250 (via GitHub)" <gi...@apache.org> on 2025/08/02 20:09:59 UTC, 0 replies.
- Re: [PR] [SPARK-52407][SQL] Add support for Theta Sketch [spark] - posted by "cboumalh (via GitHub)" <gi...@apache.org> on 2025/08/02 20:25:23 UTC, 39 replies.
- [PR] [SPARK-53079][K8S][DOCS] Update `YuniKorn` docs with `1.7.0` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/02 21:17:01 UTC, 3 replies.
- [PR] [SPARK-53080][CORE][CONNECT] Support `cleanDirectory` in `SparkFileUtils` and `JavaUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/02 21:54:23 UTC, 14 replies.
- [PR] [SPARK-53081][CORE][SQL][CONNECT] Support `contentEquals` in `SparkFileUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/02 23:37:54 UTC, 9 replies.
- Re: [PR] [SPARK-53078][CORE][TESTS] Remove `commons-(io|lang3)` test dependencies from `kvstore` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/03 00:05:14 UTC, 5 replies.
- [PR] [SPARK-53082][CORE][SQL][TESTS] Use Java `Files.readString` instead of `FileUtils.readFileToString` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/03 00:15:33 UTC, 2 replies.
- Re: [PR] [MINOR][CORE] Place the comments in the appropriate location [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/03 00:34:57 UTC, 1 replies.
- [PR] [SPARK-53083][CORE][SQL][K8S][SS][TESTS] Use Java `Files.writeString` instead of `FileUtils.write` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/03 01:00:20 UTC, 3 replies.
- [PR] [SPARK-53084][CORE] Supplement Default GC Options in SparkContext Initialization [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2025/08/03 05:35:44 UTC, 0 replies.
- Re: [PR] [SPARK-53084][CORE] Supplement default GC options in SparkContext initialization [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/03 05:44:57 UTC, 15 replies.
- [PR] Fix invalid exit codes and enhance CLI validation tools [spark] - posted by "manyamittal25 (via GitHub)" <gi...@apache.org> on 2025/08/03 07:05:21 UTC, 0 replies.
- [PR] Just test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/03 08:00:05 UTC, 1 replies.
- Re: [PR] [SPARK-51947] Spark connect model cache offloading [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/03 14:35:48 UTC, 0 replies.
- [PR] [SPARK-53086][TESTS] Revise Scalastyle RegexChecker patterns [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/03 20:36:26 UTC, 4 replies.
- [PR] [SPARK-53087][BUILD] Upgrade `Jackson` to 2.19.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/03 20:52:06 UTC, 3 replies.
- [PR] [SPARK-53088][BUILD] Remove `scala-collection-compat` dependency [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/03 21:17:17 UTC, 5 replies.
- [PR] [SPARK-53089][BUILD] Upgrade `Ammonite` to 3.0.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/03 22:56:40 UTC, 4 replies.
- [PR] [SPARK-53090][CORE][SS][TESTS] Use Java `OutputStream.write` instead of `IOUtils.write` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/03 23:38:59 UTC, 3 replies.
- Re: [PR] [SPARK-51918][CORE] Executor exit wait for out/err appenders to stop + flush remaining data [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/04 00:34:16 UTC, 1 replies.
- [PR] [SPARK-53091][SQL] Ban `org.apache.commons.lang3.Strings` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/04 01:06:05 UTC, 4 replies.
- Re: [PR] [SPARK-53008][SQL] Infer SQL Data Access from SQL UDF body [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/04 02:09:16 UTC, 1 replies.
- Re: [PR] [SPARK-53063][CORE] Implement and call new APIs in FileCommitProtocol instead of deprecated [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/08/04 02:21:07 UTC, 0 replies.
- [PR] [SPARK-53077] Add an env to control the execution of the `SparkBloomFilterSuite [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/04 02:53:00 UTC, 5 replies.
- [PR] [SPARK-53092][CORE][CONNECT] Ban `org.apache.commons.lang3.SystemUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/04 04:26:02 UTC, 12 replies.
- Re: [PR] [SPARK-53063][CORE] Implement and call new APIs in FileCommitProtocol instead of the deprecated [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/04 04:46:22 UTC, 16 replies.
- [PR] [SPARK-53093][K8S][DOCS] Drop K8s v1.31 Support [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/04 05:01:36 UTC, 3 replies.
- [PR] Support HMS v4.1 [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/08/04 05:47:16 UTC, 0 replies.
- [PR] [SPARK-53094][SQL] Fix cube-related data quality problem [spark] - posted by "harris233 (via GitHub)" <gi...@apache.org> on 2025/08/04 06:25:34 UTC, 2 replies.
- [PR] [SPARK-53096][K8S] Support `spark.kubernetes.executor.terminationGracePeriodSeconds` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/04 06:36:05 UTC, 2 replies.
- Re: [PR] [SPARK-53095][SQL] Support HMS v4.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/04 07:22:06 UTC, 3 replies.
- [PR] fix [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/08/04 09:59:30 UTC, 0 replies.
- Re: [PR] [SPARK-53040][SQL] Ban self references inside topmost CTEs in Recursive CTEs [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/04 10:06:27 UTC, 4 replies.
- [PR] [SPARK-53097] Make WriteOperationV2 in SparkConnectPlanner side effect free [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/08/04 12:23:19 UTC, 0 replies.
- Re: [PR] [SPARK-53027] Operator sa should be able to create ingress [spark-kubernetes-operator] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/08/04 12:38:25 UTC, 4 replies.
- Re: [PR] [SPARK-53077][CORE][TESTS] Add an env to control the execution of the `SparkBloomFilterSuite` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/04 14:13:42 UTC, 1 replies.
- Re: [PR] [SPARK-53098][SQL] `DeduplicateRelations` shouldn't remap expressions if old `ExprId` still exists in output [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/04 16:41:22 UTC, 6 replies.
- [PR] [SPARK-53100][SQL] Use Java `String.substring` instead of `StringUtils.substring` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/04 16:44:22 UTC, 4 replies.
- [PR] [SPARK-53101][CORE][SQL][MLLIB] Support `(left|right)Pad` in `SparkStringUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/04 17:39:51 UTC, 6 replies.
- [PR] [SPARK-53102][BUILD] Upgrade `commons-cli` to 1.10.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/04 17:54:27 UTC, 4 replies.
- [PR] [SPARK-53103][SS] Throw an error if state directory is not empty on batch 0 [spark] - posted by "dylanwong250 (via GitHub)" <gi...@apache.org> on 2025/08/04 18:11:52 UTC, 24 replies.
- Re: [PR] [WIP][SPARK-52394][PS] Fix autocorr divide-by-zero error under ANSI mode [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/08/04 18:16:23 UTC, 2 replies.
- [PR] [SPARK-53074] Avoid partial clustering in SPJ to meet a child's required distribution [spark] - posted by "chirag-s-db (via GitHub)" <gi...@apache.org> on 2025/08/04 18:40:18 UTC, 1 replies.
- [PR] Support `(left|right)Pad` in `SparkStringUtils` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/04 18:55:40 UTC, 5 replies.
- Re: [PR] [SPARK-53069][SS] Fix incorrect state store metrics with virtual column families [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/08/04 20:16:08 UTC, 5 replies.
- [PR] [SPARK-53094][SQL] Fix CUBE with aggregate containing HAVING clauses [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/08/04 20:40:41 UTC, 11 replies.
- Re: [PR] [SPARK-52394][PS] Fix autocorr divide-by-zero error under ANSI mode [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/08/04 20:50:39 UTC, 9 replies.
- [PR] [SPARK-53104][PS} Introduce ansi_mode_context to avoid multiple config checks per API call [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/08/04 20:59:16 UTC, 0 replies.
- [PR] [SPARK-53106] Add schema evolution tests for TWS Scala spark connect suites [spark] - posted by "zeruibao (via GitHub)" <gi...@apache.org> on 2025/08/04 21:03:23 UTC, 6 replies.
- Re: [PR] [SPARK-52582][SQL] Improve the memory usage of XML parser [spark] - posted by "xiaonanyang-db (via GitHub)" <gi...@apache.org> on 2025/08/04 21:19:14 UTC, 41 replies.
- [PR] [SPARK-53107][SQL] Implement the time_trunc function in Scala [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/08/04 21:23:11 UTC, 3 replies.
- [PR] [SPARK-53113][SQL] Support the time type by try_make_timestamp() [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/08/04 21:23:19 UTC, 7 replies.
- [PR] [SPARK-53110][SQL][PYTHON][CONNECT] Implement the time_trunc function in PySpark [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/08/04 21:23:24 UTC, 3 replies.
- [PR] [SPARK-53108][SQL] Implement the time_diff function in Scala [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/08/04 21:23:30 UTC, 7 replies.
- [PR] [SPARK-51462][SPARK-51564][SQL][FOLLOWUP][TESTS] Add E2E SQL tests for TIME literals in 24hr and 12hr formats [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/08/04 21:23:33 UTC, 3 replies.
- [PR] [SPARK-53109][SQL] Support TIME in the make_timestamp_ntz and try_make_timestamp_ntz functions in Scala [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/08/04 21:23:37 UTC, 3 replies.
- [PR] [SPARK-53111][SQL][PYTHON][CONNECT] Implement the time_diff function in PySpark [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/08/04 21:23:40 UTC, 0 replies.
- [PR] [SQL] Run scalafmt on DateTimeUtils and DateTimeUtilsSuite [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/08/04 21:23:42 UTC, 3 replies.
- [PR] [SPARK-53112][SQL][PYTHON][CONNECT] Support TIME in the make_timestamp_ntz and try_make_timestamp_ntz functions in PySpark [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/08/04 21:23:45 UTC, 0 replies.
- [PR] [SPARK-53114][CORE][SQL] Support `join` in `JavaUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/04 21:30:16 UTC, 4 replies.
- [PR] [SPARK-53115][TESTS] Ban `org.apache.commons.lang3.StringUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/04 21:51:46 UTC, 3 replies.
- Re: [PR] [SPARK-52777][SQL] Enable shuffle cleanup mode configuration in Spark SQL [spark] - posted by "karuppayya (via GitHub)" <gi...@apache.org> on 2025/08/04 21:54:28 UTC, 34 replies.
- [PR] [SPARK-53105][Structured Streaming] Fix tests for checkpoint v2 in RocksDBSuite [spark] - posted by "bothra90 (via GitHub)" <gi...@apache.org> on 2025/08/04 22:29:02 UTC, 0 replies.
- [PR] [BUG] Fix conf setter when client is built with jar containing SQLConf but not its engine counterparts [spark] - posted by "garlandz-db (via GitHub)" <gi...@apache.org> on 2025/08/04 22:43:41 UTC, 0 replies.
- [PR] [SPARK-53117][CORE][SQL] Support `moveDirectory` in `SparkFileUtils` and `JavaUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/04 23:05:22 UTC, 3 replies.
- Re: [PR] [SPARK-53104][PS] Introduce ansi_mode_context to avoid multiple config checks per API call [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/08/05 00:24:32 UTC, 2 replies.
- [PR] [SPARK-53118][CORE][TESTS] Use `Files.write` in `GenericFileInputStreamSuite` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/05 00:38:36 UTC, 5 replies.
- [PR] [SPARK-53119][CORE] Support `touch` in `SparkFileUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/05 01:32:10 UTC, 7 replies.
- Re: [PR] [SPARK-49182][DOCS][PYTHON] Stop publish site/docs/{version}/api/python/_sources dir [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/08/05 01:50:52 UTC, 0 replies.
- [PR] [SPARK-53120][DOCS] Recover _source directory for PySpark documentation [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/08/05 01:54:09 UTC, 2 replies.
- [PR] [SPARK-53121][SQL] Use `deleteRecursively` instead of `FileUtils.forceDelete` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/05 01:56:39 UTC, 3 replies.
- Re: [PR] [SPARK-50416][CORE] A more portable terminal / pipe test needed for bin/load-spark-env.sh [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/08/05 02:50:44 UTC, 6 replies.
- [PR] [SPARK-53122][CORE] Support `moveFile` in `SparkFileUtils` and `JavaUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/05 04:50:12 UTC, 2 replies.
- Re: [PR] [SPARK-53074][SQL] Avoid partial clustering in SPJ to meet a child's required distribution [spark] - posted by "violetnspct (via GitHub)" <gi...@apache.org> on 2025/08/05 05:00:53 UTC, 12 replies.
- Re: [PR] [SPARK-53097][CONNECT] Make WriteOperationV2 in SparkConnectPlanner side effect free [spark] - posted by "violetnspct (via GitHub)" <gi...@apache.org> on 2025/08/05 05:17:46 UTC, 1 replies.
- [PR] [SPARK-53123][CORE] Support `getRootCause` in `SparkErrorUtils` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/05 06:16:34 UTC, 0 replies.
- Re: [PR] [SPARK-53123][CORE][SQL] Support `getRootCause` in `SparkErrorUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/05 06:30:47 UTC, 4 replies.
- [PR] [SPARK-53124][SQL] Prune unnecessary fields from JsonTuple [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2025/08/05 07:08:09 UTC, 7 replies.
- [PR] Refactor `SparkErrorUtils#stackTraceToString` to handle `null` input and use it to replace `ExceptionUtils#getStackTrace` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/05 08:39:21 UTC, 1 replies.
- [PR] [SPARK-53077][CORE] reduce insertion count in SparkBloomFilterSuite [spark] - posted by "ishnagy (via GitHub)" <gi...@apache.org> on 2025/08/05 08:50:48 UTC, 2 replies.
- Re: [PR] [SPARK-53116][CONNECT] Fix conf setter when client is built with jar containing SQLConf but not its engine counterparts [spark] - posted by "the-sakthi (via GitHub)" <gi...@apache.org> on 2025/08/05 09:40:24 UTC, 1 replies.
- Re: [PR] [MINOR][DOCS] Updated the docstring of DataStreamWriter.foreach() method [spark] - posted by "the-sakthi (via GitHub)" <gi...@apache.org> on 2025/08/05 09:43:04 UTC, 2 replies.
- Re: [PR] [SPARK-52976][PYTHON] Fix Python UDF not accepting collated string as input param/return type [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2025/08/05 09:53:45 UTC, 19 replies.
- [PR] [SPARK-53125][TEST] RemoteSparkSession prints whole `spark-submit` command [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/08/05 10:53:19 UTC, 3 replies.
- [PR] [SPARK-53127] Enable LIMIT ALL to override recursion row limit [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/08/05 14:16:33 UTC, 1 replies.
- Re: [PR] [SPARK-52943][PYTHON] Enable arrow_cast for all pandas UDF eval types [spark] - posted by "benrobby (via GitHub)" <gi...@apache.org> on 2025/08/05 14:17:13 UTC, 2 replies.
- Re: [PR] [SPARK-53126][SQL][CONNECT] Refactor `SparkErrorUtils#stackTraceToString` to handle `null` input and use it to replace `ExceptionUtils#getStackTrace` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/05 14:53:22 UTC, 5 replies.
- [PR] [SPARK-53128][CORE] Include unmanaged memory bytes in the usage log before execution memory OOM [spark] - posted by "zhztheplayer (via GitHub)" <gi...@apache.org> on 2025/08/05 14:55:24 UTC, 3 replies.
- Re: [PR] [SPARK-53077][CORE][TESTS][FOLLOWUP] Reduce insertion count in SparkBloomFilterSuite [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/05 14:56:44 UTC, 1 replies.
- [PR] [SPARK-49133][CORE] Make member `MemoryConsumer#used` atomic to avoid deadlock [spark] - posted by "zhztheplayer (via GitHub)" <gi...@apache.org> on 2025/08/05 15:38:19 UTC, 0 replies.
- [PR] [DO NOT REVIEW] Fix StringType toJson [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2025/08/05 16:04:54 UTC, 0 replies.
- [PR] Fix broken and missing links in PySpark DataFrames user guide [spark] - posted by "jonnycomes (via GitHub)" <gi...@apache.org> on 2025/08/05 16:13:20 UTC, 1 replies.
- [PR] [SPARK-53129][SHELL] Improve `SparkShell` to import `java.net._` by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/05 16:27:03 UTC, 4 replies.
- Re: [PR] [SPARK-53130][SQL][PYTHON] Fix `toJson` behavior of collated string types [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2025/08/05 16:34:32 UTC, 4 replies.
- [PR] [SPARK-53131][SHELL] Improve `SparkShell` to import `java.nio.file._` by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/05 16:41:43 UTC, 6 replies.
- Re: [PR] [SPARK-53030][PYTHON] Support Arrow writer for streaming Python data sources [spark] - posted by "jiateoh (via GitHub)" <gi...@apache.org> on 2025/08/05 17:46:12 UTC, 5 replies.
- Re: [PR] [SPARK-53026] Fix deserialize error for spec with DriverServiceIngressSpec field [spark-kubernetes-operator] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/08/05 18:41:12 UTC, 1 replies.
- [PR] [SPARK-53094][SQL][4.0] Fix CUBE with aggregate containing HAVING clauses [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/08/05 18:53:50 UTC, 3 replies.
- [PR] [SPARK-53094][SQL][3.5] Fix CUBE with aggregate containing HAVING clauses [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/08/05 18:54:35 UTC, 3 replies.
- [PR] [SPARK-53132][CORE][SQL][MLLIB] Support `list(File|Path)s` in `SparkFileUtils` and `JavaUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/05 21:31:56 UTC, 2 replies.
- [PR] [SPARK-43100][CORE] Push Based Shuffle metrics must be deserialized correctly [spark] - posted by "thejdeep (via GitHub)" <gi...@apache.org> on 2025/08/05 21:51:48 UTC, 4 replies.
- [PR] [SPARK-53133][SQL][TESTS] Use Java `System.getProperty` instead of `FileUtils.getTempDirectory` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/05 23:15:42 UTC, 2 replies.
- [PR] [SPARK-53134][PS] Clean up unused ANSI imports in tests [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/08/05 23:53:51 UTC, 2 replies.
- [PR] [SPARK-52981][PYTHON] Add table argument support for Arrow Python UDTFs [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/08/05 23:59:43 UTC, 7 replies.
- [PR] [SPARK-53135][CORE][SQL] Support `copyURLToFile` in `SparkFileUtils` and `JavaUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/06 00:25:46 UTC, 3 replies.
- Re: [PR] [SPARK-51920][SS][PYTHON] Fix composite/nested StructType in value state for python [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/06 00:31:50 UTC, 1 replies.
- [PR] [SPARK-52989] Add explicit close() API to State Store iterators [spark] - posted by "dylanwong250 (via GitHub)" <gi...@apache.org> on 2025/08/06 02:36:55 UTC, 0 replies.
- Re: [PR] [SPARK-49133][CORE] Make member `MemoryConsumer#used` atomic to avoid user code causing deadlock [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/08/06 03:03:57 UTC, 0 replies.
- [PR] [SPARK-53136][CORE] tryWithResource & tryInitializeResource shall close resource quietly [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/08/06 03:44:31 UTC, 6 replies.
- [PR] [SPARK-53132][CORE][TESTS][FOLLOWUP] Use Utils.listFiles in BlockManagerDecommissionIntegrationSuite [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/06 04:27:01 UTC, 0 replies.
- Re: [PR] [SPARK-53132][CORE][TESTS][FOLLOWUP] Use `Utils.listFiles` in `BlockManagerDecommissionIntegrationSuite` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/06 04:50:36 UTC, 2 replies.
- [PR] [SPARK-53137][CORE][SQL] Support `forceDeleteOnExit` in `SparkFileUtils` and `JavaUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/06 05:12:39 UTC, 6 replies.
- [PR] Time timeout [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/06 05:34:06 UTC, 11 replies.
- [PR] [SPARK-53138] Split common-utils Java code into a new module [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/08/06 06:49:51 UTC, 2 replies.
- [PR] [SPARK-53140][TESTS] Ban `org.apache.commons.io.FileUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/06 07:04:09 UTC, 6 replies.
- [PR] [SPARK-53141][CORE] Add APIs to get overhead memory size and offheap memory size from resource profile [spark] - posted by "PHILO-HE (via GitHub)" <gi...@apache.org> on 2025/08/06 07:56:56 UTC, 3 replies.
- Re: [PR] [SPARK-52989][SS][4.0] Add explicit close() API to State Store iterators [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/08/06 08:15:33 UTC, 1 replies.
- Re: [PR] [SPARK-53138][CORE][BUILD] Split common-utils Java code into a new module [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/08/06 08:22:57 UTC, 8 replies.
- [PR] [SPARK-53142] Support dynamic expression addition in SemanticComparator [spark] - posted by "nikola-jovicevic-db (via GitHub)" <gi...@apache.org> on 2025/08/06 10:09:37 UTC, 0 replies.
- Re: [PR] [SPARK-53097][CONNECT][SQL] Make WriteOperationV2 in SparkConnectPlanner side effect free [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/06 10:24:05 UTC, 1 replies.
- Re: [PR] [SPARK-52669][PySpark]Improvement PySpark choose pythonExec in cluster yarn client mode [spark] - posted by "gwdgithubnom (via GitHub)" <gi...@apache.org> on 2025/08/06 10:52:25 UTC, 0 replies.
- [PR] [SPARK-53098][SQL][TEST-ONLY][FOLLOWUP] Fix a test when returning single-pass result [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/08/06 11:37:43 UTC, 2 replies.
- [PR] Fix faulty behavior in self-join [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2025/08/06 12:20:15 UTC, 1 replies.
- [PR] [SPARK-53144][CONNECT][SQL] Make CreateViewCommand in SparkConnectPlanner side effect free [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/08/06 13:05:28 UTC, 4 replies.
- Re: [PR] [SPARK-53143] Fix self join in DataFrame API - Join is not the only expected output from analyzer [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/08/06 13:05:50 UTC, 2 replies.
- [PR] [SPARK-49472][CORE] Corrected host decommission judgment when calculating rerun tasks caused by executor lost [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2025/08/06 13:55:19 UTC, 0 replies.
- [PR] [SPARK-53146][CONNECT][SQL] Make MergeIntoTable in SparkConnectPlanner side effect free [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/08/06 14:35:33 UTC, 2 replies.
- [PR] Log generated JDBC query in JDBC connector [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2025/08/06 14:43:43 UTC, 0 replies.
- Re: [PR] [SPARK-52388][SQL] Handle named and positional parameters under `PlanWithUnresolvedIdentifier` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/06 15:08:36 UTC, 1 replies.
- [PR] [SPARK-53150][CORE] Improve `list(File|Path)s` to handle non-existent, non-directory, symlink input [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/06 16:58:34 UTC, 5 replies.
- [PR] suppress Windows SHELL env error message - SPARK-53149 [spark] - posted by "philwalk (via GitHub)" <gi...@apache.org> on 2025/08/06 16:58:59 UTC, 0 replies.
- [PR] [SPARK-52980][FOLLOWUP] Fix Python Arrow UDTF test cases [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/08/06 18:25:01 UTC, 2 replies.
- Re: [PR] [SPARK-52787][SS] Reorganize streaming execution dir around runtime and checkpoint areas [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/06 18:52:38 UTC, 3 replies.
- [PR] [SPARK-53152][CORE][K8S][YARN] Use Java `Files.readString` instead of `Files.asCharSource` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/06 18:56:08 UTC, 17 replies.
- Re: [PR] [SPARK-52964] Add `merge_connect_rust_pr.py` and `PULL_REQUEST_TEMPLATE` [spark-connect-rust] - posted by "xuanyuanking (via GitHub)" <gi...@apache.org> on 2025/08/06 19:06:18 UTC, 5 replies.
- [PR] [IN PROGRESS] Log metrics for the driver when the application ends [spark] - posted by "ForVic (via GitHub)" <gi...@apache.org> on 2025/08/06 19:07:54 UTC, 0 replies.
- Re: [PR] [SPARK-53001][TESTS] Fix test_df_unpivot to pass with Spark 4.0 [spark-connect-rust] - posted by "xuanyuanking (via GitHub)" <gi...@apache.org> on 2025/08/06 19:08:21 UTC, 4 replies.
- [PR] [SPARK-53153][CORE][TESTS] Use Java `Files.readAllLines` in `PluginContainerSuite` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/06 19:52:20 UTC, 7 replies.
- [PR] [SPARK-53155][SQL] Global lower agggregation should not be replaced with a project [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/08/06 20:35:42 UTC, 11 replies.
- [PR] [SPARK-53157][CORE] Decouple driver and executor heartbeat polling intervals [spark] - posted by "ForVic (via GitHub)" <gi...@apache.org> on 2025/08/06 21:33:14 UTC, 6 replies.
- Re: [PR] [SPARK-53156][CORE] Track Driver Memory Metrics when the Application ends [spark] - posted by "ForVic (via GitHub)" <gi...@apache.org> on 2025/08/06 21:44:10 UTC, 7 replies.
- [PR] [SPARK-53159] Declare metrics port for operator in helm chart [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/08/06 21:45:20 UTC, 6 replies.
- [PR] [SPARK-53160][CORE][SQL][MLLIB][K8S][YARN][SS] Use Java `Files.writeString` instead of `Files.asCharSink` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/06 21:45:51 UTC, 4 replies.
- [PR] [SPARK-53158][WEBUI] Redaction of properties should handle null values [spark] - posted by "thejdeep (via GitHub)" <gi...@apache.org> on 2025/08/06 22:39:33 UTC, 3 replies.
- [PR] [SPARK-53162][SQL][TESTS] Mark `DynamicPartitionPruning*Suite*` as `SlowHiveTest` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/06 22:49:19 UTC, 0 replies.
- Re: [PR] [SPARK-52828][SQL] Make hashing for collated strings collation agnostic [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/07 00:01:52 UTC, 3 replies.
- Re: [PR] [SPARK-51885][SQL]Part 1.b Add analyzer support for nested correlated subqueries [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/07 00:31:55 UTC, 1 replies.
- Re: [PR] [SPARK-19335][SPARK-38200][SQL] Add upserts for writing to JDBC [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/07 00:31:56 UTC, 1 replies.
- Re: [PR] [MINOR][INFRA] Do not upload docker build record [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/07 00:31:57 UTC, 1 replies.
- Re: [PR] [SPARK-47573][K8S] Support custom driver log url [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/07 00:31:58 UTC, 1 replies.
- Re: [PR] [SPARK-19335][SPARK-38200][SQL] Add upserts for writing to JDBC using MERGE INTO with temp table [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/07 00:32:00 UTC, 1 replies.
- Re: [PR] [SPARK-53162][SQL][TESTS] Mark `DynamicPartitionPruningHive*Suite*` as `SlowHiveTest` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/07 01:05:12 UTC, 3 replies.
- [PR] [MINOR] Remove a wrong comment of SparkTestUtils [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/07 01:16:38 UTC, 0 replies.
- [PR] [SPARK-53163][PYTHON][INFRA] Upgrade PyArrow to 21.0.0 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/07 01:40:47 UTC, 1 replies.
- Re: [PR] [MINOR][CORE] Remove a wrong comment inside `SparkTestUtils.SparkTestUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/07 02:25:11 UTC, 1 replies.
- [PR] [SPARK-53164][CORE][K8S][DSTREAM] Use Java `Files.readAllBytes` instead of `Files.toByteArray` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/07 03:04:42 UTC, 10 replies.
- [PR] [SPARK-53165][CORE] Add `SparkExitCode.CLASS_NOT_FOUND` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/07 04:25:24 UTC, 4 replies.
- [PR] [SPARK-53166][CORE] Use `SparkExitCode.EXIT_FAILURE` in `SparkPipelines` object [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/07 04:33:44 UTC, 5 replies.
- [PR] [MINOR][SQL][TESTS] Fix `appender.file.filter.threshold.level` to `warn` in `log4j2.properties` used for testing sql module [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/07 05:12:06 UTC, 2 replies.
- [PR] [SPARK-53168][SQL][TESTS] Decouple the test cases in the sql module from the configuration values in `log4j2.properties` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/07 05:22:54 UTC, 2 replies.
- [PR] [SPARK-53167][DEPLOY] Spark launcher isRemote also respects properties files [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/08/07 05:44:42 UTC, 0 replies.
- Re: [PR] [SPARK-51267][CONNECT] Match local Spark Connect server logic between Python and Scala [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/08/07 05:45:22 UTC, 0 replies.
- Re: [PR] [SPARK-53167][DEPLOY] Spark launcher isRemote also respects properties file [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/08/07 05:51:34 UTC, 5 replies.
- Re: [PR] [SPARK-53169][SQL][TESTS] Fix `appender.file.filter.threshold.level` to `warn` in `log4j2.properties` used for testing sql module [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/07 05:53:18 UTC, 9 replies.
- [PR] [SPARK-53170][CORE] Improve `SparkUserAppException` to have `cause` parameter [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/07 06:33:44 UTC, 4 replies.
- Re: [PR] [SPARK-53169][SQL] Fix comments of `appender.file.filter.threshold.level` in `log4j2.properties` used for testing sql module [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/07 07:24:29 UTC, 2 replies.
- [PR] [SPARK-52215][PYTHON][TESTS][FOLLOW-UP] Fix `test_arrow_udf_output_nested_arrays` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/07 07:44:09 UTC, 5 replies.
- [PR] [DRAFT] Custom HiveThriftServer2 [spark] - posted by "devendra-nr (via GitHub)" <gi...@apache.org> on 2025/08/07 08:39:49 UTC, 0 replies.
- [PR] [SPARK-53171][CORE] Improvement UTF8String repeat [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/08/07 10:01:03 UTC, 3 replies.
- [PR] [SPARK-53173][SQL][TESTS] Improve the regex pattern in the replaceNotIncludedMsg method [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2025/08/07 10:54:13 UTC, 1 replies.
- Re: [PR] [MINOR] Fix versioning tag [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2025/08/07 12:44:09 UTC, 1 replies.
- [PR] [SPARK-53174][CORE] Add TMPDIR environment variable with the value of java.io.tmpdir [spark] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2025/08/07 12:58:17 UTC, 1 replies.
- Re: [PR] [SPARK-53169][SQL] Remove comments related to "`Set the logger level of File Appender to`" from `log4j2.properties` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/07 14:28:16 UTC, 2 replies.
- [PR] [SPARK-53148][CONNECT][SQL] Make SqlCommand in SparkConnectPlanner side effect free [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/08/07 15:36:05 UTC, 1 replies.
- [PR] [SPARK-53177][K8S] Use Java `Base64` instead of `com.google.common.ioBaseEncoding` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/07 16:14:22 UTC, 0 replies.
- [PR] [SPARK-53176][DEPLOY] Spark launcher should respect `--load-spark-defaults` [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/08/07 16:22:39 UTC, 24 replies.
- Re: [PR] [SPARK-53177][K8S] Use Java `Base64` instead of `com.google.common.io.BaseEncoding` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/07 16:23:56 UTC, 3 replies.
- [PR] [SPARK-53178][BUILD] Upgrade `curator` to 5.9.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/07 16:29:03 UTC, 4 replies.
- Re: [PR] [SPARK-53168][CORE][TESTS] Change default value of the input parameter `level` for `SparkFunSuite#withLogAppender` from `None` to `Some(Level.INFO)` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/07 16:56:33 UTC, 2 replies.
- [PR] Fix cases where package declarations do not match the directory structure related to SDP [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/07 17:29:18 UTC, 1 replies.
- [PR] [SPARK-53179][CORE][TESTS] Use `SparkStreamUtils.toString` instead of `CharStreams.toString` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/07 17:51:37 UTC, 4 replies.
- [PR] [SPARK-53180][CORE] Use Java `InputStream.skipNBytes` instead of `ByteStreams.skipFully` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/07 18:49:30 UTC, 4 replies.
- [PR] [WIP][SPARK-53181][PS] Enable doc tests under ANSI [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/08/07 18:59:10 UTC, 0 replies.
- Re: [PR] [SPARK-53182] Fix broken and missing links in PySpark DataFrames user guide [spark] - posted by "jonnycomes (via GitHub)" <gi...@apache.org> on 2025/08/07 19:24:35 UTC, 0 replies.
- [PR] [SPARK-53183][SQL] Use Java `Files.readString` instead of `o.a.s.sql.catalyst.util.fileToString` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/07 21:33:07 UTC, 7 replies.
- Re: [PR] [SPARK-53181][PS] Enable doc tests under ANSI [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/08/07 21:39:58 UTC, 4 replies.
- [PR] [SPARK-53185][CORE][YARN][TESTS] Use `SparkStreamUtils.toString` instead of `ByteStreams.toByteArray` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/07 21:56:24 UTC, 4 replies.
- [PR] initial impl need to verify [spark] - posted by "ForVic (via GitHub)" <gi...@apache.org> on 2025/08/07 22:13:41 UTC, 0 replies.
- [PR] [SPARK-53187]Support SparkCluster event related metrics set [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/08/07 22:57:48 UTC, 3 replies.
- [PR] [SPARK-53186] Fix probe port override from helm chart [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/08/08 00:08:01 UTC, 4 replies.
- [PR] [SPARK-53184][PS] `melt` when "value" has MultiIndex column labels [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/08/08 00:30:37 UTC, 3 replies.
- Re: [PR] [SPARK-51949][CONNECT] Bump up the default value of `CONNECT_GRPC_MARSHALLER_RECURSION_LIMIT` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/08 00:31:28 UTC, 1 replies.
- Re: [PR] [DO NOT MERGE]Testing nested correlations handling [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/08 00:31:30 UTC, 1 replies.
- Re: [PR] [SPARK-51886][SQL]Part2.a Adds support for decorrelating nested correlated subqueries in Optimizer [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/08 00:31:31 UTC, 1 replies.
- Re: [PR] [SPARK-52638][SQL] Allow preserving Hive-style column order to be configurable [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/08/08 01:01:38 UTC, 2 replies.
- Re: [PR] [SPARK-52991][SQL] Implement MERGE INTO with SCHEMA EVOLUTION for V2 Data Source [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/08/08 01:04:16 UTC, 29 replies.
- [PR] [SPARK-53188][CORE][SQL] Support `readFully` in `SparkStreamUtils` and `JavaUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/08 01:14:07 UTC, 5 replies.
- [PR] add handling for exceptions from reading corrupt zstd files [spark] - posted by "mzhang (via GitHub)" <gi...@apache.org> on 2025/08/08 01:37:58 UTC, 0 replies.
- [PR] [SPARK-53189][INFRA] Use `Temurin` JDK distribution in `build_and_test.yml` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/08 02:44:21 UTC, 12 replies.
- Re: [PR] [SPARK-53173][SQL][TESTS] Improve `Owner` regex pattern in the replaceNotIncludedMsg method [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2025/08/08 03:18:38 UTC, 3 replies.
- [PR] [SPARK-53190][CORE] Use Java `InputStream.transferTo` instead of `ByteStreams.copy` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/08 04:22:38 UTC, 10 replies.
- [PR] [SPARK-53191][CORE][SQL][MLLIB][YARN] Use Java `InputStream.readAllBytes` instead of `ByteStreams.toByteArray` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/08 05:06:51 UTC, 3 replies.
- [PR] [SPARK-53193][DOCS] Add advanced JVM optimization parameters to tuning guide [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2025/08/08 05:53:33 UTC, 2 replies.
- [PR] [SPARK-53192][CONNECT] Always cache a DataSource in the Spark Connect Plan Cache [spark] - posted by "dillitz (via GitHub)" <gi...@apache.org> on 2025/08/08 06:10:57 UTC, 2 replies.
- [PR] [SPARK-53194][INFRA] Set -XX:ErrorFile to build/target directory for tests [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/08/08 06:19:29 UTC, 2 replies.
- [PR] [SPARK-53195][CORE] Use Java `InputStream.readNBytes` instead of `ByteStreams.read` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/08 06:51:30 UTC, 4 replies.
- [PR] [SPARK-53196][CORE] Use Java `OutputStream.nullOutputStream` instead of `ByteStreams.nullOutputStream` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/08 07:13:32 UTC, 2 replies.
- [PR] [SPARK-53197][CORE][SQL] Use `java.util.Objects#requireNonNull` instead of `com.google.common.base.Preconditions#checkNotNull` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/08 09:40:43 UTC, 8 replies.
- [PR] [SPARK-53199][SQL][TESTS] Use Java `Files.copy` instead of `com.google.common.io.Files.copy` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/08 14:01:25 UTC, 4 replies.
- [PR] [SPARK-53200][CORE] Use Java `Files.newInputStream` instead of `FilesasByteSource().openStream()` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/08 14:19:51 UTC, 2 replies.
- [PR] [SPARK-53198][CORE] Support terminating driver JVM after SparkContext is stopped [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/08/08 14:20:22 UTC, 10 replies.
- Re: [PR] [SPARK-52544][SQL] Allow configuring Json datasource string length limit through SQLConf [spark] - posted by "cdagraca (via GitHub)" <gi...@apache.org> on 2025/08/08 14:21:22 UTC, 0 replies.
- Re: [PR] [SPARK-53200][CORE] Use Java `Files.newInputStream` instead of `Files.asByteSource().openStream()` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/08 14:30:29 UTC, 3 replies.
- [PR] [SPARK-53201][CORE] Use `SparkFileUtils.contentEquals` instead of `Files.equal` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/08 14:49:34 UTC, 5 replies.
- [PR] [SPARK-53202][SQL][TESTS] Use `SparkFileUtils.touch` instead of `Files.touch` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/08 15:18:05 UTC, 5 replies.
- [PR] [SPARK-53205][CORE][SQL] Support `createParentDirs` in `SparkFileUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/08 17:04:35 UTC, 7 replies.
- [PR] [SPARK-53206][CORE] Use `SparkFileUtils.move` instead of `com.google.common.io.Files.move` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/08 17:31:51 UTC, 5 replies.
- [PR] [SPARK-53208][SQL] Use `Hex.unhex` instead of `o.a.commons.codec.binary.Hex.decodeHex` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/08 18:50:48 UTC, 0 replies.
- Re: [PR] [SPARK-53208][SQL][TESTS] Use `Hex.unhex` instead of `o.a.commons.codec.binary.Hex.decodeHex` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/08 18:55:46 UTC, 4 replies.
- [PR] [SPARK-53210][CORE][SQL][DSTREAM][YARN] Use Java `Files.write` instead of `com.google.common.io.Files.write` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/08 20:06:27 UTC, 2 replies.
- [PR] [SPARK-53211][TESTS] Ban `com.google.common.io.Files` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/08 20:42:12 UTC, 4 replies.
- [PR] [SPARK-53212] improve error handling for scalar Pandas UDFs [spark] - posted by "wrschneider (via GitHub)" <gi...@apache.org> on 2025/08/08 21:14:14 UTC, 1 replies.
- [PR] [SPARK-53213][CORE][SQL][K8S] Use Java `Base64` instead of `Base64.(en|decodeBase64)*` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/08 21:34:39 UTC, 0 replies.
- [PR] [SPARK-53214][CORE][SQL][K8S] Use Java `HexFormat` instead of `Hex.encodeHexString` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/08 22:25:01 UTC, 6 replies.
- Re: [PR] [SPARK-52482][SQL][CORE] Improve exception handling for reading certain corrupt zstd files [spark] - posted by "sandip-db (via GitHub)" <gi...@apache.org> on 2025/08/08 23:03:33 UTC, 11 replies.
- [PR] [SPARK-53215][CORE][TESTS] Use `JavaUtils.listFiles` in `CleanupNonShuffleServiceServedFilesSuite` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/08 23:40:37 UTC, 5 replies.
- Re: [PR] [SPARK-53213][CORE][SQL][K8S] Use Java `Base64` instead of `Base64.(decodeBase64|encodeBase64String)` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/08 23:46:59 UTC, 4 replies.
- Re: [PR] [SPARK-53210][CORE][SQL][DSTREAM][YARN] Use Java `Files.write(String)?` instead of `com.google.common.io.Files.write` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/09 01:35:00 UTC, 4 replies.
- [PR] [SPARK-53216][CORE] Move `is*(Blank|Empty)` from `object SparkStringUtils` to `trait SparkStringUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/09 01:56:28 UTC, 6 replies.
- [PR] [SPARK-53217][CORE][DSTREAM] Use Java `Set.of` instead of `Sets.newHashSet` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/09 03:16:46 UTC, 4 replies.
- [PR] [SPARK-53218][BUILD] Upgrade `bouncycastle` to 1.81 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/09 03:30:44 UTC, 4 replies.
- [PR] [SPARK-53219][BUILD] Upgrade `Dropwizard` metrics to 4.2.33 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/09 06:12:45 UTC, 4 replies.
- [PR] [SPARK-53220][BUILD] Upgrade `dev.ludovic.netlib` to 3.0.4 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/09 06:21:59 UTC, 3 replies.
- [PR] [SPARK-53221][BUILD] Upgrade `commons-codec` to 1.19.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/09 06:32:46 UTC, 5 replies.
- [PR] [SPARK-53222][BUILD] Upgrade `commons-compress` to 1.28.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/09 06:43:57 UTC, 3 replies.
- [PR] [SPARK-53209][YARN] Add ActiveProcessorCount JVM option to YARN executor and driver [spark] - posted by "jzhuge (via GitHub)" <gi...@apache.org> on 2025/08/09 06:50:11 UTC, 7 replies.
- [PR] [SPARK-53223][BUILD] Upgrade `jersey` to 3.0.18 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/09 07:00:15 UTC, 3 replies.
- [PR] [SPARK-53224][BUILD] Upgrade `joda-time` to 2.14.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/09 07:11:20 UTC, 7 replies.
- [PR] [SPARK-53225][BUILD] Upgrade `datasketches-java` to 7.0.1 and `datasketches-memory` to 4.1.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/09 07:22:24 UTC, 2 replies.
- [PR] [SPARK-53227][SQL][TESTS] Use `HashMap.equals` instead of `Maps.difference.areEqual` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/09 22:29:11 UTC, 0 replies.
- [PR] [SPARK-53228][CORE][SQL] Use Java `Map` constructors instead of `Maps.new*HashMap` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/09 22:37:45 UTC, 0 replies.
- [PR] [SPARK-53229][CORE][SQL][EXAMPLES][TESTS] Use Java `Map.of` instead of `ImmutableMap.of` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/09 23:19:19 UTC, 6 replies.
- Re: [PR] [SPARK-53227][SQL][TESTS] Use Java `HashMap.equals` instead of `Maps.difference.areEqual` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/10 03:01:01 UTC, 3 replies.
- [PR] [SPARK-53230] Assign a name for _LEGACY_ERROR_TEMP_1011 [spark] - posted by "ctring (via GitHub)" <gi...@apache.org> on 2025/08/10 05:39:43 UTC, 0 replies.
- [PR] [WIP][SPARK-53207][SDP] Send Pipeline Event to Client Asynchronously [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/08/10 05:48:07 UTC, 0 replies.
- Re: [PR] [SPARK-53228][CORE][SQL] Use Java `Map` constructors instead of `Maps.new*HashMap()` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/10 06:52:17 UTC, 4 replies.
- [PR] [SPARK-53231][TESTS] Ban `com.google.common.collect.Sets` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/10 07:15:44 UTC, 3 replies.
- [PR] [SPARK-53232][SQL][TESTS] Use Java `Map.copyOf` instead of `ImmutableMap.copyOf` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/10 07:30:10 UTC, 3 replies.
- [PR] [SPARK-53233][SS] Make the code related to `streaming` uses the correct package name [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/10 07:59:33 UTC, 4 replies.
- Re: [PR] [SPARK-53233][SQL][SS][MLLIB][CONNECT] Make the code related to `streaming` uses the correct package name [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/10 14:04:48 UTC, 18 replies.
- [PR] [SPARK-53234][CORE][SQL][MLLIB][YARN] [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/10 15:01:38 UTC, 2 replies.
- Re: [PR] [SPARK-53234][CORE][SQL][MLLIB][YARN] Use `java.util.Objects` instead of `com.google.common.base.Objects` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/10 15:30:27 UTC, 3 replies.
- [PR] [SPARK-53235][CORE][TESTS] Use Java `Set.of` instead of `ImmutableSet.of` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/10 15:34:22 UTC, 9 replies.
- [PR] [SPARK-53236][CORE][EXAMPLE] Use Java `ArrayList` constructors instea… [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/10 17:52:59 UTC, 0 replies.
- [PR] [SPARK-53237][SQL] Use Java `Base64` instead of `org.apache.commons.codec.binary.Base64` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/10 19:49:33 UTC, 0 replies.
- [PR] [SPARK-53238][CORE][TESTS] Improve `SorterBenchmark` to include `Arrays.parallelSort` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/10 21:45:35 UTC, 4 replies.
- Re: [PR] [SPARK-53237][SQL] Use Java `Base64` instead of `org.apache.commons.codec.binary.Base64` instance [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/10 23:01:22 UTC, 2 replies.
- [PR] [SPARK-53239][SQL] Improve `MapSort` and `SortArray` performance via `parallelSort` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/10 23:22:21 UTC, 5 replies.
- Re: [PR] [SPARK-51966][PYTHON] Replace select.select() with select.poll() when running on POSIX os [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/11 00:32:38 UTC, 1 replies.
- [PR] [WIP][TESTS] Fix pypy daily job [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/11 02:43:46 UTC, 3 replies.
- Re: [PR] [SPARK-53236][CORE][EXAMPLE] Use Java `ArrayList` constructors instead of `Lists.newArrayList` in Java code [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/11 03:14:11 UTC, 2 replies.
- [PR] [SPARK-53240][SQL] Ban `com.google.common.collect.(ArrayList)?Multimap` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/11 04:20:58 UTC, 8 replies.
- [PR] [SPARK-53241][CORE] Support `createArray` in `SparkCollectionUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/11 05:23:33 UTC, 7 replies.
- [PR] Move `stackTraceToString` to `JavaUtils` and use it to replace `Throwables.getStackTraceAsString` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/11 06:18:41 UTC, 0 replies.
- Re: [PR] [SPARK-53242][CORE][DSTREAM] Move `stackTraceToString` to `JavaUtils` and use it to replace `Throwables.getStackTraceAsString` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/11 06:23:38 UTC, 2 replies.
- Re: [PR] [SPARK-52769][SQL] InjectRuntimeFilter should take into account join type and hints [spark] - posted by "akupchinskiy (via GitHub)" <gi...@apache.org> on 2025/08/11 09:17:07 UTC, 0 replies.
- Re: [PR] [SPARK-52868][SQL] CBO: OOM-risky stats underestimation for some filters and sources [spark] - posted by "akupchinskiy (via GitHub)" <gi...@apache.org> on 2025/08/11 09:20:52 UTC, 0 replies.
- [PR] [SPARK-53243][PYTHON][SQL] List the supported eval types in arrow nodes [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/11 10:47:31 UTC, 3 replies.
- Re: [PR] [SPARK-52780] Add ToLocalIterator and Arrow Record Streaming [spark-connect-go] - posted by "caldempsey (via GitHub)" <gi...@apache.org> on 2025/08/11 11:47:18 UTC, 0 replies.
- [PR] [MINOR][PYTHON] Remove two obsolete TODO items [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/11 11:57:16 UTC, 1 replies.
- [PR] [SPARK-53244] Don't store dual-run enabled and tentative mode enabled confs during view creation [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/08/11 13:05:34 UTC, 0 replies.
- Re: [PR] [SPARK-53147][SQL] Log generated JDBC query in JDBC connector [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/11 13:44:33 UTC, 1 replies.
- Re: [PR] [SPARK-53244] [SQL] Don't store dual-run enabled and tentative mode enabled confs during view creation [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/08/11 14:50:32 UTC, 2 replies.
- [PR] bump josdk to 5.1.2 [spark-kubernetes-operator] - posted by "csviri (via GitHub)" <gi...@apache.org> on 2025/08/11 15:55:04 UTC, 0 replies.
- [PR] [SPARK-53246][TEST] remove class files for ReplSuite [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/11 16:17:10 UTC, 8 replies.
- Re: [PR] [SPARK-52621][SQL] Cast TIME to/from VARIANT [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/08/11 16:21:16 UTC, 2 replies.
- Re: [PR] [SPARK-52008] Throwing an error if State Stores do not commit at the end of a batch when ForeachBatch is used [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/11 16:55:05 UTC, 6 replies.
- [PR] [SPARK-52008][FOLLOWUP] Fixing StateStoreCoordinator `warn` compilation messages from batch commit tracking [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/08/11 17:25:33 UTC, 4 replies.
- [PR] [SPARK-53247][CORE][SQL][MLLIB] Use `createArray` for large test array creations [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/11 18:46:14 UTC, 0 replies.
- [PR] Bump github.com/apache/arrow-go/v18 from 18.3.0 to 18.4.0 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/08/11 19:25:45 UTC, 2 replies.
- Re: [PR] Bump github.com/apache/arrow-go/v18 from 18.3.0 to 18.3.1 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/08/11 19:25:47 UTC, 1 replies.
- Re: [PR] [SPARK-53247][CORE][SQL][MLLIB][TESTS] Use `createArray` for large test array creations [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/11 19:28:21 UTC, 5 replies.
- [PR] Bump google.golang.org/protobuf from 1.36.6 to 1.36.7 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/08/11 19:28:50 UTC, 1 replies.
- [PR] Bump google.golang.org/grpc from 1.72.2 to 1.74.2 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/08/11 19:38:21 UTC, 3 replies.
- Re: [PR] Bump google.golang.org/grpc from 1.72.2 to 1.73.0 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/08/11 19:38:23 UTC, 1 replies.
- Re: [PR] [SPARK-53209][YARN] Add ActiveProcessorCount JVM option to Spark driver and executor in YARN mode [spark] - posted by "jzhuge (via GitHub)" <gi...@apache.org> on 2025/08/11 19:38:26 UTC, 1 replies.
- [PR] [SPARK-53248][CORE] Support `checkedCast` in `JavaUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/11 20:50:42 UTC, 6 replies.
- [PR] [SPARK-53249][INFRA] Run `build_maven_java21_arm.yml` every two days [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/11 22:25:11 UTC, 6 replies.
- Re: [PR] [SPARK-51920][SS][PYTHON] Fix composite/nested type in value state for python TWS [spark] - posted by "zeruibao (via GitHub)" <gi...@apache.org> on 2025/08/11 22:45:54 UTC, 12 replies.
- Re: [PR] [SPARK-52988][SQL] Fix race conditions at CREATE TABLE and FUNCTION when IF NOT EXISTS is used [spark] - posted by "attilapiros (via GitHub)" <gi...@apache.org> on 2025/08/11 23:08:53 UTC, 7 replies.
- [PR] [SQL] Refactor SPJ pushdown logic out of BatchScanExec [spark] - posted by "chirag-s-db (via GitHub)" <gi...@apache.org> on 2025/08/11 23:30:37 UTC, 8 replies.
- [PR] [SPARK-53250][BUILD] Remove unused `Guava` dependency from `unsafe` module [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/11 23:59:39 UTC, 3 replies.
- [PR] [SPARK-53252][TESTS] Use `IntStream` instead of `ParSeq` in `CollationFactorySuite` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/12 00:23:55 UTC, 0 replies.
- [PR] [wip] Split job [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/08/12 00:47:15 UTC, 8 replies.
- [PR] [WIP][PYTHON][TESTS] Skip hanging tests in PyPy daily workflow [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/12 00:52:01 UTC, 0 replies.
- Re: [PR] [WIP][TESTS] Upgrade pypy to 3.11 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/12 01:20:19 UTC, 3 replies.
- [PR] [SPARK-53253][PYTHON] Fix register UDF of type `SQL_SCALAR_ARROW_ITER_UDF` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/12 02:01:02 UTC, 2 replies.
- Re: [PR] [SPARK-53252][TESTS] Use Java `IntStream` instead of `ParSeq` in `CollationFactorySuite` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/12 02:10:38 UTC, 1 replies.
- Re: [PR] [SPARK-53254][PYTHON][TESTS] Skip hanging tests in PyPy daily workflow [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/12 02:35:37 UTC, 2 replies.
- Re: [PR] [SPARK-53016][INFRA] Replace actions-rs/toolchain with dtolnay/rust-toolchain [spark-connect-rust] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/08/12 02:51:43 UTC, 1 replies.
- Re: [PR] [SPARK-53011][TESTS] Fix test_df_unpivot to pass with Spark 4.0 [spark-connect-rust] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/08/12 02:56:01 UTC, 0 replies.
- [PR] [SPARK-53255][SQL] Ban `org.apache.parquet.Preconditions` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/12 04:05:23 UTC, 3 replies.
- [PR] [SPARK-53256][CORE] Promote `check(Argument|NotNull|State)` to `JavaUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/12 04:10:26 UTC, 9 replies.
- [PR] [SPARK-53257][PYTHON][TESTS] Deduplicate have_graphviz and graphviz_requirement_message [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/12 05:41:40 UTC, 3 replies.
- [PR] [SPARK-53258][CORE][SQL] Use `JavaUtils`'s `check(Argument|NotNull|State)` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/12 06:50:32 UTC, 0 replies.
- Re: [PR] [SPARK-53256][CORE] Promote `check(Argument|State)` to `JavaUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/12 06:56:30 UTC, 6 replies.
- Re: [PR] [SPARK-53258][CORE][SQL] Use `JavaUtils`'s `check(Argument|State)` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/12 07:07:33 UTC, 2 replies.
- [PR] [SPARK-53259][PYTHON] Correct the message for INVALID_UDF_EVAL_TYPE [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/12 08:06:42 UTC, 1 replies.
- Re: [PR] [SPARK-52844][PYTHON] Update protobuf to 5.29.5 [spark] - posted by "eschcam (via GitHub)" <gi...@apache.org> on 2025/08/12 08:39:27 UTC, 0 replies.
- [PR] [SPARK-52844][PYTHON] Update numpy to 1.22 [spark] - posted by "eschcam (via GitHub)" <gi...@apache.org> on 2025/08/12 11:12:36 UTC, 2 replies.
- [PR] Reducing number of JDBC overhead connections creation [spark] - posted by "vanja-vujovic-db (via GitHub)" <gi...@apache.org> on 2025/08/12 14:20:14 UTC, 1 replies.
- [PR] [SPARK-53261][CORE][SQL] Use Java `String.join|StringJoiner` instead of Guava `Joiner` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/12 15:21:01 UTC, 3 replies.
- Re: [PR] [SPARK-53207][SDP] Send Pipeline Event to Client Asynchronously [spark] - posted by "jonmio (via GitHub)" <gi...@apache.org> on 2025/08/12 15:51:20 UTC, 12 replies.
- [PR] [SPARK-52844][PYTHON] Update pyyaml to 5.4 [spark] - posted by "eschcam (via GitHub)" <gi...@apache.org> on 2025/08/12 15:55:52 UTC, 0 replies.
- [PR] [WIP] Debugging TWS/RocksDB on GithubActions [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/08/12 17:56:33 UTC, 1 replies.
- [PR] [SPARK-53050][PS] MultiIndex.to_series() should return tuples for each entry [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/08/12 21:37:04 UTC, 0 replies.
- [PR] [SPARK-53262] Support schema evolution for streaming dedupe operation [spark] - posted by "zeruibao (via GitHub)" <gi...@apache.org> on 2025/08/12 22:22:55 UTC, 0 replies.
- Re: [PR] [SPARK-53127][SQL] Enable LIMIT ALL to override recursion row limit [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/08/12 23:39:30 UTC, 4 replies.
- Re: [PR] [SPARK-53182][PYTHON] Fix broken and missing links in PySpark DataFrames user guide [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/08/12 23:43:19 UTC, 0 replies.
- [PR] [SPARK-53263][PYTHON] Support TimeType in df.toArrow [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/12 23:51:27 UTC, 4 replies.
- [PR] [SPARK-53012][PYHTON] Support Arrow Python UDTF in Spark Connect [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/08/12 23:53:36 UTC, 6 replies.
- Re: [PR] [SPARK-52240] Corrected row index usage when exploding packed arrays in vectorized reader [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/13 00:06:16 UTC, 1 replies.
- Re: [PR] [SPARK-53209][YARN] Add ActiveProcessorCount JVM option to YARN executor and AM [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/08/13 00:15:34 UTC, 2 replies.
- Re: [PR] [SPARK-51740][SQL] Allow get_json_object to consider leading spaces in paths [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/13 00:29:40 UTC, 1 replies.
- [PR] [SPARK-52482][SQL][CORE] Improve exception handling for reading certain corrupt zstd [spark] - posted by "mzhang (via GitHub)" <gi...@apache.org> on 2025/08/13 00:56:03 UTC, 3 replies.
- Re: [PR] [SPARK-52482][DOC][FOLLOWUP] Mention behavior changes in migration guide [spark] - posted by "mzhang (via GitHub)" <gi...@apache.org> on 2025/08/13 01:15:05 UTC, 0 replies.
- [PR] temp: [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2025/08/13 01:43:32 UTC, 0 replies.
- [PR] [MINOR][PYTHON] Use different temp table name in foreachBatch tests [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/08/13 01:58:04 UTC, 0 replies.
- [PR] [SPARK-53264][SQL][CATALYST]. Incorrect nullability when correlated scalar subquery ge… [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2025/08/13 02:11:40 UTC, 0 replies.
- Re: [PR] [SPARK-52482][DOCS][FOLLOW-UP] Mention behavior changes in migration guide [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/08/13 03:07:38 UTC, 9 replies.
- Re: [PR] [SPARK-51609][SQL] Optimize Recursive CTE execution for simple queries [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/13 04:01:18 UTC, 1 replies.
- [PR] [SPARK-53265][PYTHON][DOCS] Add Arrow Python UDF Type Coercion Tables in Arrow Python UDF Docs [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/08/13 04:11:54 UTC, 10 replies.
- Re: [PR] [MINOR][PYTHON][TESTS] Use different temp table name in foreachBatch tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/13 04:24:39 UTC, 2 replies.
- [PR] [SPARK-53266][TESTS] Regenerate benchmark results [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/13 04:48:48 UTC, 11 replies.
- [PR] [MINOR][PYTHON][DOCS] Update an UDF example with specified eval type [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/13 05:40:34 UTC, 4 replies.
- [PR] [SPARK-53267][DOCS] Update the javadoc for Arrow UDF physical plans [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/13 05:45:33 UTC, 2 replies.
- [PR] Revert "[SPARK-53265][PYTHON][DOCS] Add Arrow Python UDF Type Coercion Tables in Arrow Python UDF Docs" [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/13 07:25:01 UTC, 2 replies.
- [PR] [SPARK-52969][SQL] Support DSv2 OrcScan dpp [spark] - posted by "flaming-archer (via GitHub)" <gi...@apache.org> on 2025/08/13 07:55:28 UTC, 0 replies.
- [PR] [SPARK-53268][BUILD][TESTS] Update Oracle free version from 23.7 to 23.9 [spark] - posted by "LucaCanali (via GitHub)" <gi...@apache.org> on 2025/08/13 09:01:33 UTC, 6 replies.
- [PR] [SPARK-53269][PYTHON][TESTS] Centralize connect dependency checks [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/13 10:47:49 UTC, 8 replies.
- [PR] [SPARK-53270][Tests] Disable oracle datetime pushdown tests in non-ANSI mode [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2025/08/13 13:17:53 UTC, 0 replies.
- [PR] [SPARK-53271][PYTHON][INFRA] Show Python Versions in PySpark Jobs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/13 13:20:23 UTC, 2 replies.
- [PR] [TEST-ONLY] Test PyPy 7.3.19 with Python 3.10 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/13 13:35:20 UTC, 0 replies.
- Re: [PR] [SPARK-53270][SQL][Tests] Disable oracle datetime pushdown tests in non-ANSI mode [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/13 15:02:03 UTC, 15 replies.
- Re: [PR] [SPARK-53272][SQL] Refactor SPJ pushdown logic out of BatchScanExec [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/13 16:01:44 UTC, 3 replies.
- [PR] Sandip cherrypick 4 [spark] - posted by "mzhang (via GitHub)" <gi...@apache.org> on 2025/08/13 16:57:40 UTC, 0 replies.
- Re: [PR] [SPARK-49872][CORE] allow unlimited json size again [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/13 17:08:18 UTC, 2 replies.
- Re: [PR] [SPARK-52482][SQL][CORE] cherrypick #51182 and #51916 onto branch-4.0 [spark] - posted by "mzhang (via GitHub)" <gi...@apache.org> on 2025/08/13 17:10:43 UTC, 1 replies.
- [PR] [SPARK-52772] Simplify DataTypeUtils.canWrite and TableOutputResolver [spark] - posted by "ksbeyer (via GitHub)" <gi...@apache.org> on 2025/08/13 17:32:50 UTC, 4 replies.
- [I] Publish `spark-connect-rs` to crates.io as `spark-connect` [spark-connect-rust] - posted by "CTTY (via GitHub)" <gi...@apache.org> on 2025/08/13 17:53:41 UTC, 3 replies.
- Re: [PR] [SPARK-52969][SQL] Support DSv2 OrcScan Dynamic Partition Prune [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/13 18:31:37 UTC, 9 replies.
- [PR] [SPARK-53274][SQL] Support left and right join pushdown in JDBCScanBuilder [spark] - posted by "PetarVasiljevic-DB (via GitHub)" <gi...@apache.org> on 2025/08/13 18:58:16 UTC, 3 replies.
- Re: [PR] [SPARK-53106][SS] Add schema evolution tests for TWS Scala spark connect suites [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/08/13 20:21:59 UTC, 0 replies.
- [PR] [SPARK-53276] Checking if we own the stamp before closing RocksDB [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/08/13 20:57:10 UTC, 0 replies.
- [PR] [SPARK-53277][INFRA] Improve `merge_spark_pr.py` to stop early in case of the closed PRs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/13 21:10:04 UTC, 6 replies.
- [PR] [SPARK-53278][INFRA] Improve `merge_spark_pr.py` to accept PR numbers as a CLI argument [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/13 21:21:05 UTC, 4 replies.
- Re: [PR] [SPARK-53276][SS] Checking if we own the stamp before closing RocksDB [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/08/13 21:31:00 UTC, 16 replies.
- [PR] [SPARK-53279][INFRA] Improve `determine_modules_for_files` to ignore `Scalastyle/Checkstyle` rule files [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/13 21:57:23 UTC, 5 replies.
- Re: [PR] [SPARK-49984][CORE] Fix duplicate JVM options [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/13 22:14:05 UTC, 1 replies.
- Re: [PR] [SPARK-49399] Add `pi-scala.yaml` and `pyspark-pi.yaml` [spark-kubernetes-operator] - posted by "lchen4snap (via GitHub)" <gi...@apache.org> on 2025/08/13 22:37:41 UTC, 0 replies.
- [PR] [SPARK-53280][CORE] Use Java `instanceof` instead of `Throwables.throwIf*` methods [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/13 23:27:04 UTC, 6 replies.
- Re: [PR] [SPARK-49984][CORE] Fix `supplementJava(Module|IPv6)Options` to update `extraJavaOptions` only [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2025/08/14 00:06:32 UTC, 3 replies.
- Re: [PR] [SPARK-53050][PS] Enable MultiIndex.to_series() to return Rows for each entry [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/08/14 00:13:40 UTC, 1 replies.
- Re: [PR] [SPARK-51016][SQL] Non-deterministic SQL expressions should set indeterminate map stage output level [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/14 00:29:17 UTC, 1 replies.
- Re: [PR] [SPARK-53050][PS] Enable MultiIndex.to_series() to return struct for each entry [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/08/14 00:54:59 UTC, 3 replies.
- [PR] [MINOR][DOCS] Fix an Arrow UDF example [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/14 01:31:58 UTC, 2 replies.
- [PR] [SPARK-53282][PYTHON][TESTS] Add test for arrow udf type hints [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/14 02:33:45 UTC, 3 replies.
- Re: [PR] [SPARK-52741][SQL] RemoveFiles ShuffleCleanup mode doesnt work with non-adaptive execution [spark] - posted by "karuppayya (via GitHub)" <gi...@apache.org> on 2025/08/14 04:34:22 UTC, 2 replies.
- Re: [PR] [SPARK-53230][SQL] Assign a name to error class _LEGACY_ERROR_TEMP_1011 [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/08/14 12:40:41 UTC, 0 replies.
- [PR] [SPARK-53273][CONNECT] Make RegisterUserDefinedFunction in SparkConnectPlanner side effect free [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/08/14 13:19:14 UTC, 1 replies.
- [PR] [SPARK-52336] Prepend Spark identifier to GCS user agent [spark] - posted by "shrutisinghania (via GitHub)" <gi...@apache.org> on 2025/08/14 13:20:35 UTC, 0 replies.
- [PR] Improve maps and structs [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2025/08/14 14:29:00 UTC, 0 replies.
- [PR] [FEAT]Create Script to Automate Release [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2025/08/14 15:35:12 UTC, 1 replies.
- [PR] [SPARK-53275][SQL] Handle stateful expressions when ordering in interpreted mode [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2025/08/14 16:11:23 UTC, 2 replies.
- [PR] [SPARK-53251][PYTHON] Enable DataFrame API testing with asTable() for Arrow Python UDTFs [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/08/14 19:41:13 UTC, 1 replies.
- Re: [PR] [SPARK-52677] Simplify DataTypeUtils.canWrite and TableOutputResolver [spark] - posted by "ksbeyer (via GitHub)" <gi...@apache.org> on 2025/08/14 20:15:19 UTC, 2 replies.
- [PR] [SPARK-53284][PS] Adjust imports of Spark config in tests [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/08/14 20:49:27 UTC, 2 replies.
- [PR] Test [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/14 21:07:58 UTC, 1 replies.
- [PR] [SPARK-53269][PYTHON][FOLLOWUP] Fix GRPC and GRPCStatus check [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/14 22:06:40 UTC, 6 replies.
- [PR] [SPARK-53285][INFRA] Run `Java 17/25` Maven install tests if necessary [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/14 22:27:13 UTC, 3 replies.
- Re: [PR] [SPARK-51880][FOLLOW-UP] Fix LDAModel.toLocal [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/15 00:30:10 UTC, 1 replies.
- [PR] [WIP][SPARK-53287] Add ANSI Migration Guide [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/08/15 00:38:43 UTC, 0 replies.
- [PR] [SPARK-53288][SS] Fix assertion error with streaming global limit [spark] - posted by "dylanwong250 (via GitHub)" <gi...@apache.org> on 2025/08/15 04:59:45 UTC, 3 replies.
- [PR] Revert "[SPARK-49872][CORE] allow unlimited json size again" [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/15 05:23:51 UTC, 3 replies.
- [PR] [SPARK-53290][SQL][CONNECT] Metadata backward-compatibility [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/08/15 07:20:59 UTC, 0 replies.
- [PR] [SPARK-52307][PYTHON][FOLLOW-UP] Fix type hint for Scalar Arrow Iterator UDF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/15 07:43:55 UTC, 2 replies.
- [PR] [SPARK-53289] Invoke cancelJobGroup before start passing the ExecutionEnd event to prevent execution of canceled tasks. [spark] - posted by "JkSelf (via GitHub)" <gi...@apache.org> on 2025/08/15 07:59:31 UTC, 1 replies.
- [PR] [TEST-ONLY] A branch-3.5 PR to check the CI [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/15 08:59:23 UTC, 0 replies.
- [PR] [WIP][INFRA] Rebalance the test modules of pandas API on connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/15 09:21:49 UTC, 0 replies.
- Re: [PR] Test timeout [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/15 09:52:36 UTC, 0 replies.
- [PR] Remove RetriesExceeded error [spark] - posted by "khakhlyuk (via GitHub)" <gi...@apache.org> on 2025/08/15 13:13:16 UTC, 0 replies.
- [PR] [FEAT][INFRA]Improve Merge PR Script [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2025/08/15 13:14:20 UTC, 2 replies.
- Re: [PR] [FEAT]Improve maps and structs [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2025/08/15 13:38:20 UTC, 0 replies.
- Re: [PR] feat: init devenv [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2025/08/15 13:44:25 UTC, 1 replies.
- [PR] [SPARK-53291][SQL] Fix nullability for value column [spark] - posted by "cashmand (via GitHub)" <gi...@apache.org> on 2025/08/15 15:12:42 UTC, 4 replies.
- Re: [PR] [SPARK-53290][SQL][CONNECT] Fix Metadata backward-compatibility breaking [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/15 15:55:49 UTC, 2 replies.
- [PR] [SPARK-53283][CONNECT] Make CheckpointCommand in SparkConnectPlanner side effect free [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/08/15 17:05:34 UTC, 0 replies.
- Re: [PR] [SPARK-52336][CORE] Prepend Spark identifier to GCS user agent [spark] - posted by "shrutisinghania (via GitHub)" <gi...@apache.org> on 2025/08/15 17:18:56 UTC, 24 replies.
- Re: [PR] [SPARK-53287][PS] Add ANSI Migration Guide [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/08/15 18:26:50 UTC, 12 replies.
- [PR] [WIP] Turn on ANSI by default for Pandas API on Spark [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/08/15 18:32:42 UTC, 0 replies.
- [PR] [SPARK-53293] modify exprIdToOrdinal implementation for speedup on queries with wide tables [spark] - posted by "arnavgupta03 (via GitHub)" <gi...@apache.org> on 2025/08/15 18:35:11 UTC, 0 replies.
- [PR] [SPARK-53294][SS] Enable StateDataSource with state checkpoint v2 (only batchId option) [spark] - posted by "dylanwong250 (via GitHub)" <gi...@apache.org> on 2025/08/15 19:44:06 UTC, 14 replies.
- Re: [PR] [SPARK-53295][PS] Turn on ANSI by default for Pandas API on Spark [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/08/15 20:57:26 UTC, 2 replies.
- Re: [PR] [SPARK-33737][K8S] Support getting pod state using Informers + Listers [spark] - posted by "ForVic (via GitHub)" <gi...@apache.org> on 2025/08/15 22:13:46 UTC, 20 replies.
- [PR] [SPARK-52982][PYTHON] Disallow lateral join with Arrow Python UDTFs [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/08/15 23:39:05 UTC, 8 replies.
- Re: [PR] [SPARK-52031][SQL]Part 3. Subquery generator for testing queries with nested correlations [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/16 00:27:52 UTC, 1 replies.
- Re: [PR] [SPARK-52029][SQL] Support external field-id to column-name mapping for Parquet [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/16 00:27:54 UTC, 1 replies.
- Re: [PR] [SPARK-51972][SS] State Store file integrity verification using checksum [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/16 00:27:56 UTC, 1 replies.
- Re: [PR] [SPARK-51710][PYTHON] Passing an empty array to PySpark Dataframe.dropDuplicates should behave the same as passing no arguments [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/16 00:27:57 UTC, 1 replies.
- Re: [PR] [SPARK-52799][TESTS] Fix ThriftServerQueryTestSuite result comparison [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/16 03:14:28 UTC, 2 replies.
- [PR] [SPARK-49872][CORE] Remove jackson JSON string length limitation. [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/16 03:45:48 UTC, 2 replies.
- [PR] [SPARK-53296] ESS exit main thread in case boss thread exits [spark] - posted by "AmandeepSingh285 (via GitHub)" <gi...@apache.org> on 2025/08/16 14:20:13 UTC, 0 replies.
- [PR] [SPARK-53297] - Fix StreamingTable Declarative Pipelines API docstring [spark] - posted by "calilisantos (via GitHub)" <gi...@apache.org> on 2025/08/16 16:10:17 UTC, 0 replies.
- Re: [PR] [SPARK-51671][SQL] Add column pruning ro Recursive CTEs [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/17 00:32:12 UTC, 1 replies.
- Re: [PR] [SPARK-51842][SQL] Remove unnecessary judgement from fillDefaultValue [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/17 00:32:13 UTC, 1 replies.
- [PR] [SPARK-53298][SQL] make an isolation to control Shuffle partitionSizeInBytes converted from `REBALANCE` hint [spark] - posted by "xuyu-co (via GitHub)" <gi...@apache.org> on 2025/08/17 16:45:54 UTC, 0 replies.
- Re: [PR] [SPARK-53297][SDP] Fix StreamingTable Declarative Pipelines API docstring [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/08/18 00:15:04 UTC, 1 replies.
- Re: [PR] [SPARK][CONNECT][CLIENT][PYTHON][SCALA] Remove RetriesExceeded error from Spark Connect Python and Scala clients [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/08/18 00:17:50 UTC, 0 replies.
- Re: [PR] [SPARK-53289][SQL] Invoke cancelJobGroup before start passing the ExecutionEnd event to prevent execution of canceled tasks. [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/08/18 00:19:22 UTC, 6 replies.
- Re: [PR] [SPARK-52041][CORE] Add better support for integrating with external cluster manager [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/18 00:31:58 UTC, 1 replies.
- Re: [PR] [SPARK-53299][INFRA] Rebalance the test modules of pandas API on connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/18 00:50:55 UTC, 1 replies.
- [PR] [SPARK-53300][PYTHON][TESTS] Fix field names in test_unpivot [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/18 01:31:47 UTC, 2 replies.
- [PR] [SPARK-53301][PYTHON] Differentiate type hints of Pandas UDF and Arrow UDF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/18 02:27:13 UTC, 2 replies.
- [PR] [SPARK-53302][PYTHON][TESTS] Make doctest of df.unpivot deterministic [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/18 03:22:20 UTC, 2 replies.
- [PR] [SPARK-53303][SS][CONNECT] Use the empty state encoder when the initial state is not provided in TWS [spark] - posted by "huanliwang-db (via GitHub)" <gi...@apache.org> on 2025/08/18 03:42:33 UTC, 3 replies.
- [PR] [SPARK-53304][BUILD] Upgrade commons-text to 1.14.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/18 04:32:25 UTC, 2 replies.
- [PR] [SPARK-53305][PYTHON] Support TimeType in createDataFrame [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/18 05:06:12 UTC, 3 replies.
- Re: [PR] [SPARK-53293][SQL] Modify exprIdToOrdinal implementation for speedup on queries with wide tables [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/18 05:10:29 UTC, 19 replies.
- Re: [PR] [SPARK-33538][SQL] Directly push IN/NOT predicates to the Hive Metastore [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/18 06:26:22 UTC, 1 replies.
- Re: [PR] Fix wrong package statements [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/18 07:32:52 UTC, 0 replies.
- [PR] [SPARK-53306][SQL][YARN][TESTS] Fix wrong package statements [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/18 07:33:01 UTC, 0 replies.
- Re: [PR] [SPARK-53307][CONNECT][CLIENT][PYTHON][SCALA] Remove RetriesExceeded error from Spark Connect Python and Scala clients [spark] - posted by "khakhlyuk (via GitHub)" <gi...@apache.org> on 2025/08/18 09:32:54 UTC, 2 replies.
- [PR] initial commit [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/08/18 10:23:05 UTC, 0 replies.
- Re: [PR] [SPARK-52709][SQL] Fix parsing of STRUCT<> [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/18 11:37:52 UTC, 0 replies.
- [PR] [SPARK-53311] make pulloutnondeterministic use canonicalized expressions [spark] - posted by "benrobby (via GitHub)" <gi...@apache.org> on 2025/08/18 12:30:08 UTC, 0 replies.
- Re: [PR] [SPARK-53311][SQL][PYTHON][CORE] make PullOutNonDeterministic use canonicalized expressions [spark] - posted by "benrobby (via GitHub)" <gi...@apache.org> on 2025/08/18 12:33:31 UTC, 4 replies.
- Re: [PR] [SPARK-53306][SQL][CONNECT][YARN][TESTS] Fix wrong package statements [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/18 13:22:59 UTC, 1 replies.
- [PR] Support the time type by make_timestamp_ltz() [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/08/18 13:34:29 UTC, 0 replies.
- [PR] Support the time type by try_make_timestamp_ltz() [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/08/18 13:41:40 UTC, 0 replies.
- [PR] [SPARK-53292] Make CreateResourceProfileCommand in SparkConnectPlanner side effect free [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/08/18 14:08:42 UTC, 0 replies.
- Re: [PR] [SPARK-53283][CONNECT] Make CheckpointCommand/RemoveCachedRemoteRelationCommand in SparkConnectPlanner side effect free [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/08/18 14:11:25 UTC, 0 replies.
- [PR] [FEAT] Converting a Row to a JSON string [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2025/08/18 14:57:50 UTC, 2 replies.
- Re: [PR] Add dataframe PrintSchema and schema.TreeString [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2025/08/18 15:00:59 UTC, 1 replies.
- Re: [I] Context cancel doesn't work [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2025/08/18 15:25:33 UTC, 0 replies.
- Re: [I] Error "INTERNAL: Encountered end-of-stream mid-frame" during DataFrame.Save() operations [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2025/08/18 15:27:45 UTC, 0 replies.
- [PR] [SPARK-51874][SQL][FOLLOWUP] revert ParquetOptions rebase methods to return string type [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/18 15:58:11 UTC, 1 replies.
- [PR] [SPARK-51920][SS][PYTHON][CHERRY-PICK] Fix composite/nested type in value state for python TWS [spark] - posted by "zeruibao (via GitHub)" <gi...@apache.org> on 2025/08/18 16:43:49 UTC, 0 replies.
- [PR] [SPARK-52873][SQL] Don't ignore duplicate keys in SHJ when there is a bound condition [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2025/08/18 19:09:31 UTC, 0 replies.
- [PR] [WIP][K8S] Optionally capture diagnostics for jobs on Kubernetes [spark] - posted by "ForVic (via GitHub)" <gi...@apache.org> on 2025/08/18 21:57:45 UTC, 0 replies.
- Re: [PR] [SPARK-53324][K8S] Introduce pending pod limit per ResourceProfile [spark] - posted by "ForVic (via GitHub)" <gi...@apache.org> on 2025/08/18 22:09:47 UTC, 0 replies.
- Re: [PR] [SPARK-49872][CORE] Remove jackson JSON string length limitation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/19 00:04:21 UTC, 1 replies.
- Re: [PR] [SPARK-53311][SQL][PYTHON][CORE] Make PullOutNonDeterministic use canonicalized expressions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/19 00:13:51 UTC, 1 replies.
- [PR] [SPARK-53325] Support Prometheus 2.0 text-based-format and best practices for metrics naming [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/08/19 00:27:23 UTC, 19 replies.
- Re: [PR] [SPARK-53289][SQL] Invoke cancelJobsWithTag before start passing the SparkListenerSQLExecutionEnd event to prevent execution of canceled tasks. [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/19 03:01:12 UTC, 7 replies.
- [PR] [SPARK-53326][BUILD] Upgrade ORC Format to 1.1.1 [spark] - posted by "williamhyun (via GitHub)" <gi...@apache.org> on 2025/08/19 05:03:11 UTC, 2 replies.
- Re: [PR] [SPARK-52873][SQL] SHJ shouldn't ignore duplicate keys when there is a bound condition [spark] - posted by "YuzhouSun (via GitHub)" <gi...@apache.org> on 2025/08/19 07:05:50 UTC, 5 replies.
- [PR] [SPARK-52837][SQL][PYTHON][FOLLOW-UP] Specify the BitWidth of Arrow TimeType [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/19 08:18:33 UTC, 2 replies.
- Re: [PR] [SPARK-51874][SQL][FOLLOW-UP] Revert ParquetOptions rebase methods to return string type [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/19 09:56:16 UTC, 1 replies.
- [PR] [SPARK-53309][SQL] Allow to propagate extra conf to executor [spark] - posted by "zhouyuan (via GitHub)" <gi...@apache.org> on 2025/08/19 10:27:33 UTC, 2 replies.
- [PR] [SPARK-53328] [ML] [CONNECT] Improve debuggability for SparkML-connect [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/08/19 15:40:46 UTC, 1 replies.
- [PR] [SPARK-53329] Improve exception handling when adding artifacts [spark] - posted by "HendrikHuebner (via GitHub)" <gi...@apache.org> on 2025/08/19 16:27:05 UTC, 10 replies.
- [PR] [SPARK-51874][SQL][FOLLOW-UP] Revert API changes of rebase methods in DataSourceUtils and AvroOptions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/19 16:46:21 UTC, 3 replies.
- [PR] Re-enable SPARK_ANSI_SQL_MODE during doc generation [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/08/19 21:21:28 UTC, 0 replies.
- [PR] [WIP][SPARK-52090] retry fetch on ExecutorDeadException if block is found on another executor [spark] - posted by "SamWheating (via GitHub)" <gi...@apache.org> on 2025/08/19 21:22:38 UTC, 2 replies.
- [PR] [SPARK-53330] Fix Arrow UDF support for DayTimeIntervalType with bounds != start-end [spark] - posted by "benrobby (via GitHub)" <gi...@apache.org> on 2025/08/19 21:31:03 UTC, 0 replies.
- Re: [PR] [SPARK-53330] Fix Arrow UDF with DayTimeIntervalType (bounds != start/end) [spark] - posted by "benrobby (via GitHub)" <gi...@apache.org> on 2025/08/19 21:32:59 UTC, 0 replies.
- Re: [PR] [SPARK-51920][SS][PYTHON][4.0] Fix composite/nested type in value state for python TWS [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/08/19 23:50:37 UTC, 2 replies.
- Re: [PR] [SPARK-53328][ML][CONNECT] Improve debuggability for SparkML-connect [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/08/20 00:10:04 UTC, 2 replies.
- Re: [PR] [SPARK-53331][PS] Re-enable SPARK_ANSI_SQL_MODE during doc generation [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/08/20 00:48:54 UTC, 1 replies.
- [PR] [SPARK-53334][CONNECT] `LiteralValueProtoConverter` should keep the order of input map [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/20 02:04:36 UTC, 4 replies.
- Re: [PR] [SPARK-53308] [SQL] Don't remove aliases in RemoveRedundantAliases that would cause duplicates [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/20 03:13:35 UTC, 1 replies.
- [PR] [MINOR][PYTHON][DOCS] Add TimeType to API reference [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/20 11:20:52 UTC, 2 replies.
- Re: [PR] [SPARK-53260][SQL] Reducing number of JDBC overhead connections creation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/20 13:54:03 UTC, 1 replies.
- Re: [I] BEWARE, DATA LOSS: CreateDataFrameFromArrow reads every batch from Parquet but only the first batch from ND‑JSON unless JSON is loaded with WithChunk(-1) [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2025/08/20 13:59:28 UTC, 2 replies.
- [PR] [SPARK-53336] [ML] [CONNECT] Reset `MLCache.totalMLCacheSizeBytes` when `MLCache.clear()` is called [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/08/20 14:51:17 UTC, 2 replies.
- [PR] [SPARK-53320] Make RegisterUserDefinedTableFunction in SparkConnectPlanner side effect free [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/08/20 15:13:59 UTC, 0 replies.
- [PR] [WIP[SPARK-53321] Make RegisterUserDefinedDataSource in SparkConnectPlanner side effect free [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/08/20 15:34:47 UTC, 0 replies.
- [PR] [SPARK-53339][CONNECT] Fix a race condition issue which occurs when an operation in pending state is interrupted [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/08/20 15:35:52 UTC, 0 replies.
- [PR] [SPARK-53337][CORE] Ensure the application name get escaped. [spark] - posted by "roddhjav (via GitHub)" <gi...@apache.org> on 2025/08/20 15:58:52 UTC, 19 replies.
- [PR] Preparser [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2025/08/20 16:20:55 UTC, 0 replies.
- Re: [PR] [SPARK-53103][SS] Throw an error if state directory is not empty when query starts [spark] - posted by "dylanwong250 (via GitHub)" <gi...@apache.org> on 2025/08/20 18:26:59 UTC, 4 replies.
- [PR] Expand golden test coverage on multivariable DECLARE [spark] - posted by "TeodorDjelic (via GitHub)" <gi...@apache.org> on 2025/08/20 20:56:32 UTC, 0 replies.
- [PR] [SPARK-53344][DOCS] Add user guide for Arrow Python UDTFs [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/08/21 00:10:51 UTC, 3 replies.
- [PR] [SPARK-53345] Use withTempDir for consistent directory across restarts in test [spark] - posted by "dylanwong250 (via GitHub)" <gi...@apache.org> on 2025/08/21 00:30:46 UTC, 0 replies.
- Re: [PR] [WIP] Preparser [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/21 02:52:21 UTC, 4 replies.
- Re: [PR] [SPARK-52448][CONNECT] Add simplified Struct Expression.Literal [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/21 04:40:10 UTC, 2 replies.
- Re: [PR] [SPARK-52930][CONNECT] Use DataType.Array/Map for Array/Map Literals [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/21 04:45:16 UTC, 5 replies.
- [PR] [SPARK-53346][CONNECT] Avoid creating temporary collections in toCatalystArray/toCatalystMap [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/21 05:22:33 UTC, 2 replies.
- [PR] [SPARK-53342][SQL] Fix Arrow converter to handle multiple record batches in single IPC stream [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2025/08/21 06:32:02 UTC, 13 replies.
- Re: [PR] [SPARK-53341][Core] Expand golden test coverage on multivariable DECLARE [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2025/08/21 08:15:31 UTC, 5 replies.
- [PR] [SPARK-48547][DEPLOY] Add opt-in flag to have SparkSubmit automatically call System.exit after user code main method exits [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/08/21 09:43:44 UTC, 12 replies.
- [PR] [SPARK-53348] [SQL] Always persist ANSI value when creating a view or assume it when querying if not stored [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/08/21 15:42:06 UTC, 23 replies.
- Re: [PR] [SPARK-51348][BUILD][SQL] Upgrade Hive to 4.1 [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/08/21 20:25:56 UTC, 8 replies.
- Re: [PR] [SPARK-52873][SQL] Further restrict when SHJ semi/anti join can ignore duplicate keys on the build side [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/08/21 20:34:34 UTC, 13 replies.
- [PR] [SPARK-53349][SQL] Optimized XML parser can't handle corrupted files correctly [spark] - posted by "xiaonanyang-db (via GitHub)" <gi...@apache.org> on 2025/08/22 01:50:39 UTC, 9 replies.
- [PR] [SDP] Fix counter initialization and increment logic for flow retries [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/08/22 05:50:26 UTC, 0 replies.
- Re: [PR] [SPARK-52346][SDP] Fix counter initialization and increment logic for flow retries [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/08/22 06:05:48 UTC, 5 replies.
- Re: [PR] [SPARK-53345][SS][TESTS] Use withTempDir for consistent directory across restarts in streaming test [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/08/22 06:53:10 UTC, 1 replies.
- [PR] [SPARK-53351][CORE] Use consistent blockId for block data access in external block handler [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2025/08/22 08:48:35 UTC, 0 replies.
- [PR] [SPARK-53352][PYTHON] Refine the error message for unsupported return type [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/22 09:00:38 UTC, 2 replies.
- [PR] [SPARK-53353][PYTHON] Fail Scalar Iterator Arrow UDF with 0-arg [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/22 09:28:18 UTC, 2 replies.
- [PR] [SPARK-53354] Simplify LiteralValueProtoConverter.toCatalystStruct [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/08/22 13:49:57 UTC, 1 replies.
- [PR] pandas 2.3.2 [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2025/08/22 16:39:51 UTC, 0 replies.
- [PR] improve python data source docs [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/08/22 17:02:58 UTC, 0 replies.
- [PR] [SDP][SQL] Move optionsClause to before tableAlias [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/08/22 17:20:55 UTC, 1 replies.
- [PR] update error message [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/08/22 20:46:34 UTC, 0 replies.
- Re: [PR] [SPARK-53044] Change Declarative Pipelines import alias convention from "sdp" to "dp" [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/08/22 21:21:38 UTC, 0 replies.
- [PR] [SPARK-53359][PYTHON] Fix Arrow UDTF to handle the results as iterator [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/08/22 22:02:25 UTC, 3 replies.
- [PR] [SPARK-53355][PYTHON] document python udf type behavior [spark] - posted by "benrobby (via GitHub)" <gi...@apache.org> on 2025/08/22 22:07:39 UTC, 0 replies.
- Re: [PR] [SPARK-53358] Improve arrow Python UDTF output type mismatch error message [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/08/22 22:34:39 UTC, 1 replies.
- Re: [PR] Update supported_api_gen.py: remove an invalid escape sequence "\_" using a raw string [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/23 00:26:43 UTC, 5 replies.
- Re: [PR] [WIP][SPARK-51180][BUILD] Upgrade Arrow to 19.0.0 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/23 00:26:45 UTC, 1 replies.
- Re: [PR] [SPARK-53355][PYTHON][SQL] document python udf type behavior [spark] - posted by "benrobby (via GitHub)" <gi...@apache.org> on 2025/08/23 00:48:23 UTC, 1 replies.
- [PR] [SPARK-53360][SQL] Once strategy with ConstantFolding's idempotence should not be broken [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/08/23 05:44:33 UTC, 5 replies.
- Re: [PR] [SPARK-53354][CONNECT] Simplify LiteralValueProtoConverter.toCatalystStruct [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/24 02:04:57 UTC, 1 replies.
- [PR] [SPARK-53347][PROTOBUF] Fix proto deserialization to allow false and null values [spark] - posted by "gurpal75 (via GitHub)" <gi...@apache.org> on 2025/08/24 17:55:02 UTC, 0 replies.
- Re: [PR] [SPARK-53351][CORE] Use consistent string type blockId for block data access in external block handler [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/08/24 19:49:52 UTC, 7 replies.
- Re: [PR] [SPARK-52923][CORE] Allow ShuffleManager to control push merge during shuffle registration [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/08/24 20:25:22 UTC, 1 replies.
- [PR] [SPARK-53360][SS] Optimizing JVM–Python Communication in TWS by Grouping Multiple Keys into One Arrow Batch [spark] - posted by "zeruibao (via GitHub)" <gi...@apache.org> on 2025/08/24 22:26:22 UTC, 0 replies.
- Re: [PR] [SPARK-53355][PYTHON][SQL] Document python udf type behavior [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/08/24 23:33:30 UTC, 5 replies.
- Re: [PR] [SPARK-53356] Small improvements to python data source docs [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/08/24 23:38:35 UTC, 0 replies.
- Re: [PR] [SPARK-52124] Actively Releasing Disk Space After Application Completio… [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/25 00:29:11 UTC, 1 replies.
- Re: [PR] [SPARK-49386][CORE][SQL] Add memory based thresholds for shuffle spill [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/25 03:43:35 UTC, 0 replies.
- [PR] [DRAFT] JDBC Driver for Spark Connect Server [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/08/25 04:05:47 UTC, 11 replies.
- [PR] [SPARK-53362] [ML] [CONNECT] Fix IDFModel local loader bug [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/08/25 05:25:19 UTC, 2 replies.
- [PR] [SPARK-53363] Add uuid builtin function [spark-connect-rust] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/08/25 07:27:04 UTC, 0 replies.
- Re: [PR] [SPARK-53357][PYTHON] Update `pandas` to 2.3.2 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/25 07:31:48 UTC, 2 replies.
- [PR] refactor: Remove python 2 code [spark] - posted by "jakekasan (via GitHub)" <gi...@apache.org> on 2025/08/25 07:51:45 UTC, 0 replies.
- [PR] [SPARK-53365] [SQL] Unify the code for persisting of confs in views and UDFs [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/08/25 10:02:21 UTC, 0 replies.
- [PR] temp [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2025/08/25 13:01:40 UTC, 0 replies.
- [PR] [MINOR][SQL] Fix rCTE bug with malformed recursion [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/08/25 13:05:59 UTC, 0 replies.
- [PR] [SPARK-53366][CONNECT] Apply formatting rules to sql/connect/shims [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/25 13:11:53 UTC, 2 replies.
- Re: [PR] [SPARK-53355][PYTHON][SQL][INFRA] test python udf type behavior [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/08/25 13:58:55 UTC, 5 replies.
- [PR] [SPARK-53367][PYTHON] add int to decimal coercion for Arrow UDFs [spark] - posted by "benrobby (via GitHub)" <gi...@apache.org> on 2025/08/25 15:12:00 UTC, 1 replies.
- [PR] [SPARK-53369][PYTHON] Fix error message for UDFs with `CHAR/VARCHAR` return type [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2025/08/25 15:30:10 UTC, 6 replies.
- Re: [PR] [SPARK-53339][CONNECT] Fix an issue which occurs when an operation in pending state is interrupted [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/08/25 16:14:51 UTC, 13 replies.
- Re: [PR] [SPARK-53158][WEBUI] Missing metricsProperties in KV Store should be handled correctly [spark] - posted by "thejdeep (via GitHub)" <gi...@apache.org> on 2025/08/25 16:43:22 UTC, 1 replies.
- [PR] [SPARK-53370] Upgrade `grpc-swift-protobuf` to 2.1.1 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/25 17:38:47 UTC, 0 replies.
- [PR] [SPARK-52346][SDP] Propagate partition columns from destination for BatchTableWrite [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/08/25 17:56:38 UTC, 5 replies.
- [PR] [SPARK-53371] Upgrade `gRPC Swift NIO Transport` to 2.1.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/25 18:09:48 UTC, 5 replies.
- [PR] [SPARK-53373] Use `nightly-6.2-amazonlinux2` for Swift 6.2 CI [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/25 18:21:40 UTC, 3 replies.
- [PR] [WIP][SPARK-53372][SDP] End to End Testing Suite [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/08/25 18:31:19 UTC, 0 replies.
- [PR] [SPARK-53374] Use `release` build in Apache Spark `4.1.0-preview1` testing [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/25 18:50:11 UTC, 4 replies.
- Re: [PR] [SPARK-53365] [SQL] Unify code for persisting of configs in views and UDFs [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/08/25 19:22:46 UTC, 2 replies.
- [PR] [SPARK-53375] Remove downloaded tgz files [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/25 19:29:39 UTC, 4 replies.
- Re: [PR] [SPARK-52110][SDP][SQL] Move optionsClause to before tableAlias [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/08/25 19:36:06 UTC, 0 replies.
- Re: [PR] [SPARK-52110][SDP][SQL][FOLLOWUP] Move optionsClause to before tableAlias [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/08/25 19:39:26 UTC, 0 replies.
- [PR] [SPARK-53376] Run Swift `build` first before running `test` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/25 19:56:04 UTC, 4 replies.
- [PR] [SPARK-53377][SDP] Tests for groupby and rollup [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/08/25 20:03:06 UTC, 2 replies.
- [PR] df [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/25 20:38:17 UTC, 1 replies.
- [PR] Use SwiftyLab/setup-swift [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/25 22:31:55 UTC, 2 replies.
- [PR] [SPARK-53378][PYTHON] Enable @udtf decorator to support returnType as first positional argument [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2025/08/25 22:53:09 UTC, 5 replies.
- Re: [PR] [SPARK-52933][K8S] Verify if the executor cpu request exceeds limit [spark] - posted by "zemin-piao (via GitHub)" <gi...@apache.org> on 2025/08/25 23:33:31 UTC, 0 replies.
- Re: [PR] [SPARK-53329][CONNECT] Improve exception handling when adding artifacts [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/08/25 23:44:47 UTC, 3 replies.
- [PR] Bump google.golang.org/grpc from 1.74.2 to 1.75.0 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/08/26 02:45:08 UTC, 2 replies.
- [PR] Bump github.com/stretchr/testify from 1.10.0 to 1.11.0 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/08/26 03:16:11 UTC, 0 replies.
- [PR] Bump google.golang.org/protobuf from 1.36.7 to 1.36.8 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/08/26 03:16:18 UTC, 0 replies.
- [PR] Build Test Code [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/26 04:11:57 UTC, 2 replies.
- [PR] Use MacOS 14 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/26 04:42:25 UTC, 1 replies.
- [PR] Use XCode 16.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/26 04:57:37 UTC, 1 replies.
- [PR] [SPARK-53379] Add `integration-test-ubuntu` GitHub Action job [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/26 05:21:22 UTC, 7 replies.
- Re: [PR] [SPARK-53318][SQL] Support the time type by make_timestamp_ltz() [spark] - posted by "jwong-attentive (via GitHub)" <gi...@apache.org> on 2025/08/26 06:14:51 UTC, 12 replies.
- [PR] Test [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/26 06:19:39 UTC, 1 replies.
- [PR] [SPARK-53380] Add `SPARK_LOCAL_IP` env variable for integration tests on MacOS [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/26 06:30:53 UTC, 1 replies.
- Re: [PR] [SPARK-53380] Add `SPARK_LOCAL_IP` env variable to MacOS-based integration test jobs [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/26 06:51:35 UTC, 4 replies.
- [PR] [SPARK-53381][CONNECT] Avoid creating temporary collections in toCatalystStruct [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/26 07:30:35 UTC, 3 replies.
- Re: [PR] [DRAFT][DO-NOT-REVIEW][SPARK-51XXX][SQL] Enable implicit cast from STRING to TIME type [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/08/26 07:40:33 UTC, 0 replies.
- [PR] [SPARK-53383][PYTHON][TESTS] Add tests to check the timezone handling in Arrow UDF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/26 11:34:24 UTC, 2 replies.
- [PR] [SPARK-53384][SQL] Refactor variable resolution out to use it in the single-pass Analyzer [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/08/26 11:38:30 UTC, 0 replies.
- [PR] [SPARK-53385][SQL] Refactor Identifier evaluation out [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/08/26 11:54:48 UTC, 2 replies.
- Re: [PR] [SPARK-53382][SQL] Fix rCTE bug with malformed recursion [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/26 12:30:33 UTC, 1 replies.
- Re: [PR] [SPARK-53384][SQL] Refactor variable resolution out [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/26 12:32:59 UTC, 5 replies.
- [PR] [SPARK-53386][SQL] Support query parameter ending with semicolon in JDBC connectors [spark] - posted by "alekjarmov (via GitHub)" <gi...@apache.org> on 2025/08/26 13:57:40 UTC, 41 replies.
- Re: [PR] [SPARK-51756][CORE] Computes RowBasedChecksum in ShuffleWriters [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2025/08/26 14:17:27 UTC, 8 replies.
- Re: [PR] [SPARK-53370] Upgrade `gRPC Swift Protobuf` to 2.1.1 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/26 15:43:39 UTC, 1 replies.
- [PR] [SPARK-52913] Upgrade `grpc-swift-2` to 2.1.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/26 15:56:43 UTC, 4 replies.
- [PR] [SPARK-52873][SQL][FOLLOWUP] Fix test for non-ansi mode [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2025/08/26 19:32:19 UTC, 1 replies.
- Re: [PR] [SPARK-52873][SQL][TESTS][FOLLOWUP] Fix test for non-ansi mode [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/26 20:03:42 UTC, 4 replies.
- [PR] [MINOR] Hide traceback for helper functions in testing utils [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/08/26 20:57:02 UTC, 2 replies.
- Re: [PR] [SPARK-53381][CONNECT] Avoid creating temporary collections in `toCatalystStruct` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/26 20:58:39 UTC, 0 replies.
- Re: [PR] [SPARK-53342][SQL][4.0] Fix Arrow converter to handle multiple record batches in single IPC stream [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/26 21:40:05 UTC, 5 replies.
- [PR] [SPARK-53390][PS] Test astype with more int dtypes [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/08/26 21:50:30 UTC, 0 replies.
- Re: [PR] [SPARK-53390][PS] Raise error when bools with None `astype` to ints under ANSI [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/08/26 22:49:07 UTC, 2 replies.
- Re: [PR] [SPARK-53330][SQL][PYTHON] Fix Arrow UDF with DayTimeIntervalType (bounds != start/end) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/08/26 22:57:43 UTC, 1 replies.
- [PR] [WIP] Sequential [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/08/26 23:27:31 UTC, 1 replies.
- [PR] [SPARK-52873][SQL][3.5] Further restrict when SHJ semi/anti join can ignore duplicate keys on the build side [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2025/08/26 23:53:52 UTC, 2 replies.
- Re: [PR] [SPARK-53367][PYTHON][SQL] add int to decimal coercion for Arrow UDFs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/27 00:28:34 UTC, 1 replies.
- [PR] [SPARK-53391][CORE] Remove unused PrimitiveKeyOpenHashMap [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/08/27 03:06:20 UTC, 5 replies.
- Re: [PR] [SPARK-53388][SQL][TESTS] Split `collations.sql` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/27 03:38:17 UTC, 1 replies.
- [PR] [SPARK-53392][ML][CONNECT] Move SpecializedArray handling to connect-common [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/27 04:00:16 UTC, 4 replies.
- [PR] [SPARK-53393][PYTHON] Disable memory profiler for Arrow Scalar Iterator UDFs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/27 04:12:19 UTC, 3 replies.
- [PR] [SPARK-53394][CORE] UninterruptibleLock.isInterruptible should avoid duplicated interrupt [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2025/08/27 04:50:47 UTC, 21 replies.
- Re: [PR] [SPARK-53319][SQL] Support the time type by try_make_timestamp_ltz() [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/08/27 06:30:17 UTC, 6 replies.
- [PR] [SPARK-53029][PYTHON] Support return type coercion for Arrow Python UDTFs [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2025/08/27 06:55:22 UTC, 19 replies.
- [PR] [SPARK-53395][PYTHON][CONNECT][TESTS] Add tests for combinations of different scalar UDFs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/27 07:14:38 UTC, 2 replies.
- Re: [PR] [DO NOT REVIEW] temp [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2025/08/27 07:17:43 UTC, 0 replies.
- [PR] [SPARK-53396][SQL] Improve error message when input of `GetStructField` is not `StructType` [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/08/27 08:14:31 UTC, 2 replies.
- Re: [PR] [SPARK-53143][SQL] Fix self join in DataFrame API - Join is not the only expected output from analyzer [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2025/08/27 10:01:08 UTC, 7 replies.
- Re: [PR] [SPARK-52858][INFRA] Retry SBT compilation when OOM [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/27 10:08:55 UTC, 2 replies.
- Re: [PR] [SPARK-53397][PYTHON][TESTS] Fix UDTF with collations test indentation [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/27 12:20:51 UTC, 8 replies.
- [PR] [MINOR][CONNECT] Fix typos in ExecuteGrpcResponseSender.scala [spark] - posted by "luisteod (via GitHub)" <gi...@apache.org> on 2025/08/27 14:09:48 UTC, 6 replies.
- [PR] [SPARK-53398] Ensure that RocksDBMemoryManager metrics reporting doesn't throw a NullPointerException [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/08/27 17:05:46 UTC, 0 replies.
- [PR] [SPARK-53348] [SQL] [FOLLOWUP] Don't run `AlwaysPersistedConfigsSuite` in case ANSI was set using the system var [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/08/27 17:11:41 UTC, 6 replies.
- Re: [PR] [SPARK-53157][CORE] Decouple driver and executor polling intervals [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/27 18:10:28 UTC, 3 replies.
- Re: [PR] [MINOR] Hide traceback in `assertSchemaEqual/assertDataFrameEqual/assert_rows_equal` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/27 18:44:40 UTC, 0 replies.
- [PR] [SPARK-51585][SQL][FOLLOWUP] Turn on ANSI mode in DockerJDBCIntegrationV2Suite [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/27 18:56:06 UTC, 5 replies.
- [PR] [SPARK-53348] [SQL] [4.0] Always persist ANSI value when creating a view or assume it when querying if not stored [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/08/27 19:05:23 UTC, 2 replies.
- [PR] [SPARK-53333][SS] Enable StateDataSource with state checkpoint v2 (only readChangeFeed) [spark] - posted by "dylanwong250 (via GitHub)" <gi...@apache.org> on 2025/08/27 19:20:13 UTC, 16 replies.
- Re: [PR] [SPARK-53398][SS] Ensure that RocksDBMemoryManager metrics reporting doesn't throw a NullPointerException [spark] - posted by "violetnspct (via GitHub)" <gi...@apache.org> on 2025/08/27 19:30:29 UTC, 1 replies.
- [PR] [WIP][SPARK-53399][SQL] Improve CollapseProject [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/08/27 20:05:47 UTC, 0 replies.
- [PR] [WIP] Naming Sources, no new version [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/08/27 20:52:15 UTC, 1 replies.
- Re: [PR] [SPARK-50493][SPARK-37687][BUILD] Migrate kubernetes-client from `6.x` to `7.x` [spark] - posted by "attilapiros (via GitHub)" <gi...@apache.org> on 2025/08/27 20:52:51 UTC, 1 replies.
- [PR] [WIP] Enable add/sub float tests under ANSI [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/08/27 20:55:28 UTC, 0 replies.
- [PR] [WIP] Sequential Union PoC [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/08/27 22:24:53 UTC, 0 replies.
- Re: [PR] [SPARK-51168][BUILD] Test Hadoop 3.4.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/27 22:30:38 UTC, 2 replies.
- [PR] [SPARK-53405] Add metrics recording for latency of Spark app state transition [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/08/27 23:27:11 UTC, 2 replies.
- [PR] [DRAFT][ SPARK-53401] Enable Direct Passthrough Partitioning in the DataFrame API [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2025/08/28 00:31:08 UTC, 0 replies.
- [PR] Jonathan chang data/proto changes [spark] - posted by "SCHJonathan (via GitHub)" <gi...@apache.org> on 2025/08/28 01:00:06 UTC, 0 replies.
- Re: [PR] [SPARK-53404] Make `Build` step to verify test compilation too [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/28 02:32:52 UTC, 2 replies.
- Re: [PR] [SPARK-53245] Update Java Operator SDK version to 5.1.2 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/28 02:44:48 UTC, 0 replies.
- [PR] [SPARK-53407] Use `baseDirectory` instead of `baseDir` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/28 03:03:52 UTC, 4 replies.
- Re: [PR] [DRAFT][SPARK-53401] Enable Direct Passthrough Partitioning in the DataFrame API [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/28 03:06:26 UTC, 0 replies.
- [PR] [SPARK-53408][SQL] Clean up unused functions from `QueryCompilationErrors` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/28 03:24:00 UTC, 0 replies.
- Re: [PR] [SPARK-53342][SQL][3.5] Fix Arrow converter to handle multiple record batches in single IPC stream [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/28 03:44:24 UTC, 1 replies.
- Re: [PR] [SPARK-52969][SQL] Support DSv2 OrcScan Dynamic Partition Pruning [spark] - posted by "flaming-archer (via GitHub)" <gi...@apache.org> on 2025/08/28 03:53:31 UTC, 1 replies.
- [PR] [SPARK-53409] Upgrade `Gradle` to 9.0.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/28 04:57:22 UTC, 3 replies.
- Re: [PR] [SPARK-53408][SQL] Remove unused functions from `QueryCompilationErrors` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/28 05:04:39 UTC, 2 replies.
- [PR] [SPARK-53410] Improve `merge_spark_pr.py` to accept PR numbers as a CLI argument [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/28 05:05:53 UTC, 4 replies.
- [PR] [SPARK-53411] Upgrade the minimum K8s version to v1.32 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/28 05:13:43 UTC, 2 replies.
- [PR] [SPARK-53412][K8S][INFRA][DOCS] Upgrade Volcano to 1.12.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/28 05:35:28 UTC, 2 replies.
- [PR] [SPARK-53413] Shuffle cleanup for commands [spark] - posted by "karuppayya (via GitHub)" <gi...@apache.org> on 2025/08/28 06:07:12 UTC, 7 replies.
- [PR] [SPARK-53414][PYTHON][TESTS] Add tests for Arrow UDF with profiler [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/28 06:07:47 UTC, 2 replies.
- [PR] [SPARK-53391][CORE][FOLLOWUP] Add comments for PrimitiveKeyOpenHashMap removal in Mima [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/08/28 06:27:29 UTC, 2 replies.
- [PR] [SPARK-53415][SQL] Simply options for builtin FileFormats [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/08/28 06:58:20 UTC, 4 replies.
- [PR] [SPARK-53416][SQL][TESTS] Use `createOrReplaceTempView` instead of `registerTempTable` in `StreamingQueryOptimizationCorrectnessSuite` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/28 08:01:23 UTC, 0 replies.
- [PR] [SPARK-53417][PYTHON][TESTS] Add test for Arrow UDF with TimeType [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/28 09:22:22 UTC, 2 replies.
- [PR] [SPARK-53418][SQL] Handle TimeType in ColumnAccessor [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/08/28 09:47:41 UTC, 0 replies.
- Re: [PR] [SPARK-53355][PYTHON][SQL] test python udf type behavior [spark] - posted by "benrobby (via GitHub)" <gi...@apache.org> on 2025/08/28 12:04:34 UTC, 3 replies.
- Re: [PR] [SPARK-53416][SS][TESTS] Use `createOrReplaceTempView` instead of `registerTempTable` in `StreamingQueryOptimizationCorrectnessSuite` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/08/28 13:15:43 UTC, 1 replies.
- Re: [PR] [SPARK-53399][SQL] Restore CollapseProject to merge unrelated expressions [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/08/28 14:43:44 UTC, 4 replies.
- [PR] [SPARK-53419][SQL] Move common SqlScriptingContextManager initialization code from SqlScriptingInterpreterSuite [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/08/28 14:50:16 UTC, 5 replies.
- [PR] [SPARK-53420][BUILD] Upgrade Parquet to 1.16.0 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/08/28 16:08:12 UTC, 6 replies.
- Re: [PR] [SPARK-51168][BUILD] Upgrade to Hadoop 3.4.2 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/08/28 17:14:10 UTC, 15 replies.
- Re: [PR] [MINOR][PYTHON][TESTS] Hide traceback in `assertSchemaEqual/assertDataFrameEqual/assert_rows_equal` [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/08/28 18:04:07 UTC, 0 replies.
- Re: [PR] [SPARK-53403][PS] Improve add/sub tests under ANSI [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/08/28 18:07:01 UTC, 2 replies.
- Re: [PR] [SPARK-53401] Enable Direct Passthrough Partitioning in the DataFrame API [spark] - posted by "itskals (via GitHub)" <gi...@apache.org> on 2025/08/28 18:24:12 UTC, 9 replies.
- [PR] [WIP] Test divisor 0 in truediv/floordiv/mod tests under ANSI [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/08/28 18:29:38 UTC, 0 replies.
- [PR] Naming sources again [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/08/28 18:41:57 UTC, 0 replies.
- [PR] [SPARK-53422][SQL][TEST] Make SPARK-30269 test robust [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/08/28 19:00:23 UTC, 0 replies.
- [PR] [SPARK-53423] [SQL] Move all the single-pass resolver related tags to `ResolverTag` [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/08/28 19:04:29 UTC, 2 replies.
- Re: [PR] [SPARK-53422][SQL][TEST] Make SPARK-30269 test case robust [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/28 19:15:03 UTC, 5 replies.
- Re: [PR] [SPARK-53421][SPARK-53377][SDP] Propagate Logical Plan ID in SDP Analysis [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/08/28 21:28:57 UTC, 11 replies.
- [PR] [SPARK-53425][PYTHON][TESTS] Add more able argument tests for Arrow Python UDTFs [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/08/28 21:45:11 UTC, 0 replies.
- Re: [PR] [SPARK-53425][PYTHON][TESTS] Add more table argument tests for Arrow Python UDTFs [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/08/28 22:00:59 UTC, 2 replies.
- [PR] [SPARK-53430]Prevent unintended JSON serialization with @JsonIgnore [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/08/28 23:52:07 UTC, 0 replies.
- Re: [PR] [SPARK-52185][CORE] Automate the thread dump collection for Spark applications [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/29 00:27:17 UTC, 1 replies.
- [PR] [SPARK-53431][PYTHON] Fix Python UDTF with named table arguments in DataFrame API [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/08/29 00:35:44 UTC, 3 replies.
- [PR] [SPARK-53433][PYTHON][TESTS] Add test for Arrow UDF with VariantType [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/29 02:13:03 UTC, 2 replies.
- [PR] [WIP] Rework execute immediate [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2025/08/29 04:18:19 UTC, 1 replies.
- [PR] [SPARK-53435][SQL] Fix race condition in CachedRDDBuilder [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2025/08/29 05:03:47 UTC, 4 replies.
- [PR] [SPARK-53434][SQL] ColumnarRow's get should also check isNullAt [spark] - posted by "WangGuangxin (via GitHub)" <gi...@apache.org> on 2025/08/29 05:44:49 UTC, 0 replies.
- [PR] [MINOR] Fix redundant brace in log [spark] - posted by "WangGuangxin (via GitHub)" <gi...@apache.org> on 2025/08/29 06:07:29 UTC, 2 replies.
- [PR] [PYTHON] Remove unused type ignores [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/08/29 08:46:50 UTC, 0 replies.
- Re: [PR] [SPARK-53419][SQL][TEST] Move common SqlScriptingContextManager initialization code from SqlScriptingInterpreterSuite [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/08/29 09:16:53 UTC, 1 replies.
- [PR] [SPARK-53437][SQL] InterpretedUnsafeProjection shall setNull4Bytes for YearMonthIntervalType field [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/08/29 10:14:58 UTC, 0 replies.
- [PR] [SPARK-53417][PYTHON][TESTS][FOLLOW-UP] Add more tests for aggregation and window [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/08/29 11:03:02 UTC, 2 replies.
- [PR] [SPARK-53439][SQL] Support DSv2 OrcScan Dynamic Partition Pruning [spark] - posted by "flaming-archer (via GitHub)" <gi...@apache.org> on 2025/08/29 16:36:30 UTC, 0 replies.
- Re: [PR] [SPARK-53427][PS][TESTS] Test divisor 0 in truediv/floordiv/mod tests under ANSI [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/08/29 20:53:58 UTC, 2 replies.
- [PR] Netty 4.1.124.Final [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2025/08/29 21:14:22 UTC, 1 replies.
- [PR] [SPARK-53441][PS] Bools `|`/`&`/`^` None should fail under ANSI [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/08/29 21:45:35 UTC, 0 replies.
- [PR] [SPARK-53442]Make PrometheusServlet compatible with OpenMetrics [spark] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/08/29 23:29:48 UTC, 0 replies.
- Re: [PR] [SPARK-51250][K8S] Add Support for K8s PriorityClass Configuration fo… [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/30 00:25:46 UTC, 1 replies.
- Re: [PR] [SPARK-53436][BUILD] Upgrade `Netty` to 4.1.124.Final [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2025/08/30 12:02:13 UTC, 1 replies.
- Re: [PR] [SPARK-53424][PYTHON][TESTS] Hide traceback in `assertSchemaEqual/assertDataFrameEqual/assert_rows_equal` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/08/30 20:14:27 UTC, 1 replies.
- Re: [PR] Increase report interval of spaming logs to 10 seconds [spark] - posted by "Avihais12344 (via GitHub)" <gi...@apache.org> on 2025/08/30 20:34:33 UTC, 3 replies.
- Re: [PR] [SPARK-52032][SQL] Fix orc filter pushdown with null-safe equality operator [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/31 00:30:04 UTC, 0 replies.
- Re: [PR] [SPARK-51847][PYTHON] Extend PySpark testing framework util functions with basic data tests [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/31 00:30:06 UTC, 0 replies.
- Re: [PR] [SPARK-48234][SQL] Fix previous reader checks in Vectorized DELTA_BYTE_ARRAY decoder [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/31 00:30:08 UTC, 0 replies.
- Re: [PR] [SPARK-53439][SQL] Support DSv2 ParquetScan Dynamic Partition Pruning [spark] - posted by "flaming-archer (via GitHub)" <gi...@apache.org> on 2025/08/31 13:08:22 UTC, 1 replies.
- [PR] update-python-to-SPDX-license [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2025/08/31 16:00:55 UTC, 0 replies.
- [PR] [SPARK-49933][SQL] Push WHEN NOT MATCHED BY SOURCE predicates to target [spark] - posted by "tokoko (via GitHub)" <gi...@apache.org> on 2025/08/31 17:49:51 UTC, 0 replies.
- Re: [PR] [SPARK-53443][PYTHON] Update python to `SPDX-license` [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2025/08/31 21:48:02 UTC, 0 replies.