reviews@spark.apache.org, 2025-07

You are viewing a plain text version of this content. The canonical link for it is here.

- [PR] [SPARK-52626][SQL] Allow grouping by the time type [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2025/07/01 00:06:35 UTC, 3 replies.
- Re: [PR] [SPARK-52582][SQL] Improve the memory usage of XML parser [spark] - posted by "xiaonanyang-db (via GitHub)" <gi...@apache.org> on 2025/07/01 00:34:16 UTC, 39 replies.
- [PR] [SPARK-52622][PS] Avoid CAST_INVALID_INPUT of `DataFrame.melt` in ANSI mode [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/07/01 00:35:47 UTC, 3 replies.
- Re: [PR] [SPARK-52503][SQL][CONNECT] Fix `drop` when the input column is not existent [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/01 00:38:43 UTC, 6 replies.
- [PR] a [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/01 01:54:11 UTC, 0 replies.
- Re: [PR] [SPARK-52627] Improve `SQLTests` to handle `userName` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/01 04:06:41 UTC, 1 replies.
- Re: [PR] [SPARK-52612][INFRA] No longer explicitly add the `spark-avro-*.jar` to the classpath of the benchmark. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/01 04:10:45 UTC, 0 replies.
- [PR] [SPARK-52629] Remove `ArrowReaderHelper.isNestedType` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/01 04:15:35 UTC, 3 replies.
- Re: [PR] [SPARK-52612][INFRA] package issue [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/01 04:21:56 UTC, 6 replies.
- Re: [PR] [SPARK-52545][SQL] Double-quote should prioritize over implicit string concatenation [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2025/07/01 05:22:38 UTC, 5 replies.
- Re: [PR] [SPARK-52570][PS] Enable divide-by-zero for numeric rmod with ANSI enabled [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/07/01 05:51:07 UTC, 4 replies.
- [PR] [SPARK-52630][SS] Reorganize streaming operator and state mgmt code and dirs [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/07/01 05:51:29 UTC, 2 replies.
- Re: [PR] [SPARK-52515][SQL] Add approx_top_k function [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/07/01 05:57:27 UTC, 1 replies.
- [PR] [SPARK-52515][SQL][TESTS][FOLLOW-UP] Explicitly enable ANSI for overflow error case [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/07/01 05:58:39 UTC, 2 replies.
- Re: [PR] [SPARK-52551][SQL] Add a new v2 Predicate BOOLEAN_EXPRESSION [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/07/01 06:01:31 UTC, 4 replies.
- [PR] [SPARK-52631] Update `Spark Connect`-generated Swift source code [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/01 06:02:26 UTC, 3 replies.
- [PR] [SPARK-52551][SQL][TESTS][FOLLOW-UP] Explicitly enable ANSI for the test case in V2 cast pushdown [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/07/01 06:05:30 UTC, 1 replies.
- [PR] [SPARK-52551][SQL][FOLLOWUP] enable ANSI mode in PushablePredicateSuite [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/07/01 06:05:31 UTC, 2 replies.
- Re: [PR] [SPARK-52539][CONNECT] Introduce session hooks [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/07/01 06:18:23 UTC, 2 replies.
- [PR] [SPARK-52539][CONNECT][FOLLOW-UP] Avoid using TypeAlias that is available from Python 3.10 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/07/01 06:18:28 UTC, 4 replies.
- Re: [PR] [SPARK-51035][BUILD] Upgrade Janino to 3.1.12 [spark] - posted by "YanivKunda (via GitHub)" <gi...@apache.org> on 2025/07/01 07:42:29 UTC, 0 replies.
- [PR] [SPARK-52632][SQL] Pretty display V2 write plan nodes [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/07/01 08:41:02 UTC, 7 replies.
- [PR] [WIP][SQL] Update the ANSI compliance page regarding the TIME type [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/01 09:26:01 UTC, 0 replies.
- [PR] fix [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/07/01 11:29:24 UTC, 3 replies.
- Re: [PR] [SPARK-52444][SQL][CONNECT] Add support for Variant/Char/Varchar Literal [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2025/07/01 11:35:18 UTC, 7 replies.
- [PR] [WIP] Fix inconsistencies and refactor primitive types in parser [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2025/07/01 11:41:00 UTC, 7 replies.
- Re: [PR] [SPARK-52633][SQL] Deduplicate single `Union` child output before `DeduplicateRelations` [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/07/01 11:47:36 UTC, 4 replies.
- Re: [PR] [SPARK-52187][SQL] Introduce Join pushdown for DSv2 [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/07/01 13:02:32 UTC, 104 replies.
- Re: [PR] [SPARK-52023][SQL] Fix data corruption/segfault returning Option[Product] from udaf [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/07/01 13:36:06 UTC, 6 replies.
- Re: [PR] [SPARK-52545][SQL] Standardize double-quote escaping to follow SQL specification [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/07/01 13:48:48 UTC, 4 replies.
- [PR] Test ORC 1.9.7 RC0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/01 14:55:16 UTC, 0 replies.
- [PR] [WIP][SQL][TESTS] Disable stable column aliases in tests that it is assumed [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/01 16:17:50 UTC, 0 replies.
- [PR] [SPARK-52636][K8S] Support `java_image_name` ARG in K8s `Dockerfile` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/01 17:11:35 UTC, 5 replies.
- Re: [PR] [SPARK-52575][SQL] Introduce contextIndependentFoldable attribute for Expressions [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/07/01 17:25:30 UTC, 22 replies.
- [PR] [SPARK-52637] Fix version ID mismatch issue for RocksDB compaction leading to incorrect file mapping [spark] - posted by "liviazhu (via GitHub)" <gi...@apache.org> on 2025/07/01 18:38:04 UTC, 0 replies.
- Re: [PR] [WIP] StateStore state machine [spark] - posted by "liviazhu (via GitHub)" <gi...@apache.org> on 2025/07/01 18:40:01 UTC, 0 replies.
- [PR] [SPARK-52638][SQL] Allow preserving Hive-style column order to be configurable [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/07/01 19:47:45 UTC, 17 replies.
- Re: [PR] [SDP] [SPARK-52576] Drop/recreate on full refresh and MV update [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/07/01 19:48:19 UTC, 9 replies.
- [PR] [SPARK-52639][K8S][INFRA][DOCS] Upgrade Volcano to 1.12.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/01 19:50:17 UTC, 0 replies.
- [PR] [SPARK-52640][SDP] Propagate Python Source Code Location [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2025/07/01 20:24:37 UTC, 6 replies.
- [PR] [SPARK-52642][PYTHON] Make PythonWorkerFactory.create foolproof [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/07/01 22:23:07 UTC, 2 replies.
- [PR] [SPARK-52643][BUILD] Upgrade `extra-enforcer-rules` to support Java 25 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/01 23:00:16 UTC, 6 replies.
- Re: [PR] [SPARK-52639][K8S][INFRA][DOCS] Upgrade Volcano to 1.12.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/01 23:11:33 UTC, 5 replies.
- Re: [PR] [SPARK-52642][PYTHON] User daemonWorkers.get(worker) to avoid unexpected out-of-sync between idleWorkers and daemonWorkers [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/07/01 23:15:57 UTC, 0 replies.
- Re: [PR] [SPARK-52642][PYTHON] Use daemonWorkers.get(worker) to avoid unexpected out-of-sync between idleWorkers and daemonWorkers [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/07/01 23:17:08 UTC, 3 replies.
- Re: [PR] [SPARK-52551][SQL][FOLLOW-UP] Enable ANSI mode in PushablePredicateSuite [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/07/01 23:29:33 UTC, 1 replies.
- Re: [PR] [SPARK-52634][SQL][DOCS] Update the ANSI compliance page regarding the TIME type [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/07/01 23:35:14 UTC, 10 replies.
- [PR] [SPARK-52645] Enable `ExitOnOutOfMemoryError` JVM option by default [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/02 00:49:19 UTC, 6 replies.
- [PR] [SPARK-52647] Fix `jvmArgs` to support multiple arguments [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/02 01:20:11 UTC, 4 replies.
- [PR] [SPARK-52648] Add support for maximal retain duration for Spark application resources [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/07/02 01:42:46 UTC, 22 replies.
- Re: [PR] [SPARK-52612][INFRA] Add an env `NO_PROVIDED_SPARK_JARS` to control collection behavior of `sbt/package` for `spark-avro.jar` and `spark-protobuf.jar` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/02 02:53:27 UTC, 3 replies.
- Re: [PR] [SPARK-51268][SQL] Make `TreeNode` lock-free [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/07/02 04:45:18 UTC, 3 replies.
- Re: [PR] [SPARK-52482][SQL][CORE] ZStandard support for file data source reader [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/07/02 05:48:22 UTC, 2 replies.
- [PR] [SPARK-52023][SQL][3.5] Fix data corruption/segfault returning Option[Product] from udaf [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2025/07/02 06:57:01 UTC, 2 replies.
- Re: [PR] [WIP][SQL][TESTS] Disable stable column aliases in tests if assumed [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/07/02 07:54:47 UTC, 9 replies.
- [PR] [SPARK-52503][SQL][CONNECT][4.0] Fix drop when the input column is not existent [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/02 08:14:42 UTC, 2 replies.
- Re: [PR] [SPARK-47547] BloomFilter fpp degradation [spark] - posted by "ishnagy (via GitHub)" <gi...@apache.org> on 2025/07/02 08:32:09 UTC, 69 replies.
- Re: [PR] [SPARK-52535][SQL] Improve code readability of rule ApplyColumnarRulesAndInsertTransitions [spark] - posted by "zhztheplayer (via GitHub)" <gi...@apache.org> on 2025/07/02 10:06:19 UTC, 3 replies.
- [PR] [SPARK-52651][SQL] Handle User Defined Type in Nested ColumnVector [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/02 11:14:07 UTC, 5 replies.
- Re: [PR] [WIP][SPARK-51224][BUILD] Test Maven 4 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/07/02 11:40:14 UTC, 0 replies.
- [PR] [SPARK-52652][BUILD] Replace os-maven-plugin with nisse [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/07/02 12:49:34 UTC, 0 replies.
- [PR] [SPARK-52653] Fix `operatorDeployment.operatorContainer` to `operatorDeployment.operatorPod.operatorContainer` in `operations.md` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/02 14:39:08 UTC, 0 replies.
- Re: [PR] [SPARK-52653] Fix `*.operatorContainer` to `*.operatorPod.operatorContainer` in `operations.md` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/02 14:49:01 UTC, 3 replies.
- [PR] [SPARK-52654] Use `ParallelGC` by default [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/02 14:55:13 UTC, 4 replies.
- Re: [PR] [SPARK-52652][BUILD] Replace `os-maven-plugin` with `nisse` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/02 15:54:05 UTC, 3 replies.
- [PR] [WIP][SQL] Fix truncation of TIME values to the given precision [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/02 16:30:10 UTC, 0 replies.
- [PR] [SPARK-52409][SDP] Only use PipelineRunEventBuffer in tests [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/07/02 16:54:35 UTC, 3 replies.
- [PR] Fix the bug when user has set the spark.app.id value [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2025/07/02 18:02:20 UTC, 0 replies.
- [PR] [SPARK-52658] Add `Swift 6.2` build test CI [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/02 18:43:15 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-52656][SQL] Fix truncation of TIME values to the given precision [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/02 20:26:26 UTC, 0 replies.
- Re: [PR] [SPARK-52657] Fix the bug when user has set the spark.app.id value [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/02 21:00:17 UTC, 3 replies.
- Re: [PR] [SPARK-52656][SQL] Fix current_time() [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/02 21:37:10 UTC, 9 replies.
- [PR] [SPARK-52661] Suppress pending pod log messages [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/02 23:00:57 UTC, 3 replies.
- [PR] [SPARK-52662] Add `SparkApp` benchmark [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/03 00:02:03 UTC, 4 replies.
- Re: [PR] [SPARK-46860][CORE]Enable basic authentication when downloading jars and other files from secured repos [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/03 00:29:29 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-51439] Support SQL UDF with DEFAULT argument [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/03 00:29:30 UTC, 1 replies.
- Re: [PR] docs: update commet for `nullIntolerant` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/03 00:29:31 UTC, 1 replies.
- Re: [PR] [SPARK-51583] [SQL] Improve error message when to_timestamp function has arguments of wrong type [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/03 00:29:32 UTC, 1 replies.
- [PR] [SPARK-52663][SDP] Introduce name field to pipeline spec [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/07/03 00:36:42 UTC, 5 replies.
- [PR] [SPARK-52660][SQL] Add time type to `CodeGenerator#javaClass` [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2025/07/03 00:41:59 UTC, 4 replies.
- Re: [PR] [SPARK-22876][YARN] Respect YARN AM failure validity interval [spark] - posted by "xujiongda (via GitHub)" <gi...@apache.org> on 2025/07/03 01:13:19 UTC, 1 replies.
- Re: [PR] [SPARK-52657] Allow `spark.app.id` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/03 01:42:04 UTC, 1 replies.
- [PR] [SPARK-52664] Add `branch-0.4` to `publish_snapshot_*.yml` GitHub Action jobs [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/03 02:44:31 UTC, 2 replies.
- [PR] [SPARK-52665][BUILD] Fix make-distribution.sh [: missing `]' [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2025/07/03 03:24:27 UTC, 4 replies.
- [PR] [SPARK-52666][SQL] Map User Defined Type to correct MutableValue in SpecificInternalRow [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/03 04:01:42 UTC, 4 replies.
- Re: [PR] [SPARK-49386][SPARK-27734][CORE][SQL] Add memory based thresholds for shuffle spill [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/07/03 04:47:01 UTC, 1 replies.
- [PR] [SPARK-52667] Improve `SparkAppReconciler` to show app names during cleaning up [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/03 06:08:13 UTC, 0 replies.
- [PR] [SPARK-52668] Set `(Initial|Max)RAMPercentage` to 80% by default [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/03 06:41:24 UTC, 2 replies.
- Re: [PR] [SPARK-52649][SQL] Trim aliases before matching Sort/Having/Filter expressions in `buildAggExprList` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/07/03 07:27:54 UTC, 1 replies.
- [PR] [SPARK-52669][ PySpark]Resolve the issue where PySpark fails to run due to different Python minor versions. Run Python directly. [spark] - posted by "gwdgithubnom (via GitHub)" <gi...@apache.org> on 2025/07/03 07:29:23 UTC, 0 replies.
- Re: [PR] [SPARK-52613][CORE][SQL] Restore printing full stacktrace when HBase/Hive DelegationTokenProvider hit exception [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/03 07:30:48 UTC, 1 replies.
- [PR] [SPARK-52670][SQL] Make HiveResult work with UserDefinedType#stringifyValue [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/03 07:39:33 UTC, 4 replies.
- Re: [PR] [SPARK-52561][PYTHON][INFRA] Upgrade the minimum version of Python to 3.10 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/03 08:43:24 UTC, 3 replies.
- Re: [PR] [SPARK-49872][CORE] allow unlimited json size again [spark] - posted by "amonteagudomoreno (via GitHub)" <gi...@apache.org> on 2025/07/03 09:24:47 UTC, 1 replies.
- [PR] [SPARK-52672][SQL] Don't replace Sort/Having expressions with aliases if expression exists in Aggregate [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/07/03 09:28:25 UTC, 12 replies.
- Re: [PR] [SPARK-41551][SQL] Dynamic/absolute path support in PathOutputCommitters [spark] - posted by "wgqcd88 (via GitHub)" <gi...@apache.org> on 2025/07/03 09:34:44 UTC, 0 replies.
- [PR] [SPARK-52671][SQL] RowEncoder shall not lookup a resolved UDT [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/03 10:04:22 UTC, 5 replies.
- [PR] [WIP][SQL] Casting TIME(n) to TIME(m) [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/03 10:37:48 UTC, 0 replies.
- [PR] Clean up the usage of deprecated APIs related to RandomStringUtils [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/03 10:41:36 UTC, 0 replies.
- [PR] [SPARK-52673][CONNECT][CLIENT] Add grpc RetryInfo handling to Spark Connect retry policies [spark] - posted by "khakhlyuk (via GitHub)" <gi...@apache.org> on 2025/07/03 10:56:58 UTC, 4 replies.
- [PR] [SPARK-52675][ML][CONNECT] Interrupt hanging ML handlers in tests [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/07/03 13:44:43 UTC, 2 replies.
- [PR] [WIP][SQL] Support TIME by the Thrift server [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/03 13:51:54 UTC, 0 replies.
- Re: [PR] [SPARK-52598][DOCS] Reorganize Spark Connect programming guide [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2025/07/03 14:14:33 UTC, 1 replies.
- [PR] [MINOR][PYTHON] Add `scipy-stubs` to dev/requirements.txt [spark] - posted by "jorenham (via GitHub)" <gi...@apache.org> on 2025/07/03 14:15:48 UTC, 7 replies.
- [PR] [SPARK-52676] Use Java 21 for `SparkApp` benchmark [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/03 15:41:10 UTC, 2 replies.
- Re: [PR] [SPARK-51516][SQL] Support TIME by the Thrift server [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/03 15:49:55 UTC, 1 replies.
- [PR] Migration test case `RocksDBBenchmark` to microbenchmark [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/03 15:51:28 UTC, 0 replies.
- [PR] [TEST][CONNECT][PYTHON] Fix flaky test_client.py test [spark] - posted by "khakhlyuk (via GitHub)" <gi...@apache.org> on 2025/07/03 15:55:03 UTC, 0 replies.
- [PR] [CONNECT][PYTHON] Fix a race condition in ExecutePlanResponseReattachableIterator.shutdown [spark] - posted by "khakhlyuk (via GitHub)" <gi...@apache.org> on 2025/07/03 16:24:18 UTC, 0 replies.
- Re: [PR] [SPARK-52560][BUILD] Bump ap-loader 4.0(v10) to support for async-profiler 4.0 [spark] - posted by "parthchandra (via GitHub)" <gi...@apache.org> on 2025/07/03 20:42:50 UTC, 5 replies.
- [PR] [SPARK-52678] Update `ArrowReader.swift` with GH-54 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/03 22:43:55 UTC, 5 replies.
- Re: [PR] [MINOR][TEST][CONNECT][PYTHON] Fix flaky test_client.py test [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/07/03 23:15:39 UTC, 1 replies.
- Re: [PR] [MINOR][CONNECT][PYTHON] Fix a race condition in ExecutePlanResponseReattachableIterator.shutdown [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/07/03 23:16:04 UTC, 1 replies.
- Re: [PR] [SPARK-52578][SQL] Add metrics for rows to track case and action in MergeRowsExec [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/07/03 23:29:34 UTC, 5 replies.
- [PR] [SPARK-52679] Bundle default log4j2 properties file in Helm chart [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/07/04 00:20:04 UTC, 1 replies.
- Re: [PR] [MINOR][DOCS]: corrected spellings and typos [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/04 00:29:04 UTC, 1 replies.
- [PR] [WIP][SPARK-52646][PS] Avoid CAST_INVALID_INPUT of `__eq__` in ANSI mode [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/07/04 00:34:05 UTC, 0 replies.
- [PR] [SPARK-52680][INFRA] Remove Python 3.9 GitHub Action CI [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/04 01:12:01 UTC, 7 replies.
- [PR] [SPARK-52681][SQL] V2SessionCatalog alter table add column warns on HiveCatalog [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/07/04 01:59:40 UTC, 2 replies.
- Re: [PR] [SPARK-52674][SQL] Clean up the usage of deprecated APIs related to `RandomStringUtils` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/04 02:29:49 UTC, 1 replies.
- Re: [PR] [SPARK-52548][CORE][TESTS] Add a test case for when shuffle manager is overridden by a SparkPlugin [spark] - posted by "zhztheplayer (via GitHub)" <gi...@apache.org> on 2025/07/04 02:49:31 UTC, 1 replies.
- Re: [PR] [SPARK-52682][CORE][TESTS] Migration test case `RocksDBBenchmark` to microbenchmark [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/04 02:49:41 UTC, 4 replies.
- Re: [PR] [SPARK-52618][SQL] Casting TIME(n) to TIME(m) [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/04 03:54:34 UTC, 1 replies.
- Re: [PR] [DRAFT][PYTHON] Improve Python UDF Arrow Serializer Performance [spark] - posted by "ConeyLiu (via GitHub)" <gi...@apache.org> on 2025/07/04 03:56:47 UTC, 9 replies.
- [PR] [SPARK-52683][SQL] Support ExternalCatalog alterTableSchema [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/07/04 05:28:05 UTC, 15 replies.
- [PR] [SPARK-52684][SQL] Make CACHE TABLE Commands atomic while encountering execution errors [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/04 06:57:24 UTC, 5 replies.
- Re: [PR] [SPARK-49547][SQL][PYTHON] Add iterator of `RecordBatch` API to `applyInArrow` [spark] - posted by "ConeyLiu (via GitHub)" <gi...@apache.org> on 2025/07/04 07:47:27 UTC, 0 replies.
- [PR] [SPARK-52685][SQL][TESTS] Add a clue for flaky test: 'SPARK-47148: AQE should avoid to submit shuffle job on cancellation' [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/04 10:11:56 UTC, 3 replies.
- [PR] ] [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/07/04 12:45:17 UTC, 0 replies.
- Re: [PR] [SPARK-52686][SQL] `Union` should be resolved only if there are no duplicates [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/07/04 12:54:15 UTC, 30 replies.
- Re: [PR] [SPARK-48359][SQL] Built-in functions for Zstd compression and decompression [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/07/04 13:59:51 UTC, 6 replies.
- Re: [PR] [SPARK-51168][BUILD] Test Hadoop 3.4.2 [spark] - posted by "max-allan-cgr (via GitHub)" <gi...@apache.org> on 2025/07/04 15:41:12 UTC, 0 replies.
- [PR] [SPARK-52689][SQL] Send DML Metrics to V2Write [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/07/04 19:02:31 UTC, 27 replies.
- Re: [PR] [SPARK-49386][CORE][SQL] Add memory based thresholds for shuffle spill [spark] - posted by "attilapiros (via GitHub)" <gi...@apache.org> on 2025/07/04 21:20:46 UTC, 2 replies.
- Re: [PR] [SPARK-52635][BUILD][3.5] Upgrade ORC to 1.9.7 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/04 22:22:20 UTC, 2 replies.
- [PR] [SPARK-52659][SQL]Misleading modulo error message in ansi mode [spark] - posted by "pasar6987 (via GitHub)" <gi...@apache.org> on 2025/07/05 05:13:02 UTC, 2 replies.
- [PR] [SPARK-52545][SQL][DOCS] Update string literal docs for quote escaping rules [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2025/07/05 09:12:03 UTC, 0 replies.
- [PR] [WIP][SQL][FOLLOWUP] Rename `timeToMicros` to `makeTime` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/05 10:14:18 UTC, 0 replies.
- [PR] [SPARK-52617][SQL]Cast TIME to/from TIMESTAMP_NTZ [spark] - posted by "SubhamSinghal (via GitHub)" <gi...@apache.org> on 2025/07/05 11:13:39 UTC, 20 replies.
- Re: [PR] [WIP][SPARK-52617][SQL]Cast TIME to/from TIMESTAMP_NTZ [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/05 15:29:47 UTC, 0 replies.
- Re: [PR] [SPARK-52460][SQL][FOLLOWUP] Rename `timeToMicros` to `makeTime` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/05 18:52:04 UTC, 1 replies.
- [PR] [SPARK-52691][BUILD] Upgrade ORC to 2.1.3 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/05 20:37:45 UTC, 5 replies.
- Re: [PR] [SPARK-51270] Support nanosecond precision timestamp in Variant [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/06 00:32:38 UTC, 1 replies.
- Re: [PR] [SPARK-51318][TESTS] Remove `jar` files from Apache Spark repository and disable affected tests [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/06 00:32:39 UTC, 1 replies.
- Re: [PR] [SPARK-51338][INFRA] Add automated CI build for `connect-examples` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/06 00:32:41 UTC, 1 replies.
- Re: [PR] [SPARK-51264][SQL][JDBC] JDBC write keeps driver connection open unnecessarily [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/06 00:32:42 UTC, 1 replies.
- Re: [PR] [SPARK-51359][CORE][SQL] Set INT64 as the default timestamp type for Parquet files [spark] - posted by "alamb (via GitHub)" <gi...@apache.org> on 2025/07/06 10:20:45 UTC, 1 replies.
- [PR] [WIP][SPARK-52693][SQL] Support +/- ANSI day-time intervals to/from TIME [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/06 10:31:37 UTC, 0 replies.
- [PR] [SPARK-52688][SQL][DOCS] Fixing broken links to python reference in the getting started guide [spark] - posted by "carlotran4 (via GitHub)" <gi...@apache.org> on 2025/07/06 17:50:01 UTC, 2 replies.
- Re: [PR] [SPARK-52495][SQL] Allow including partition columns in the single variant column [spark] - posted by "sandip-db (via GitHub)" <gi...@apache.org> on 2025/07/06 19:24:35 UTC, 7 replies.
- [PR] [SPARK-52692][SQL] Support caching the TIME type [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2025/07/07 01:25:55 UTC, 3 replies.
- Re: [PR] [SPARK-52082][PYTHON][DOCS] Improve ExtractPythonUDF docs [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/07/07 05:07:25 UTC, 1 replies.
- Re: [PR] [SPARK-52693][SQL] Support +/- ANSI day-time intervals to/from TIME [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/07 08:07:59 UTC, 14 replies.
- Re: [PR] [SPARK-52544][SQL] Allow configuring Json datasource string length limit through SQLConf [spark] - posted by "DapengShi (via GitHub)" <gi...@apache.org> on 2025/07/07 09:18:24 UTC, 1 replies.
- [PR] [SPARK-51557][SQL] Tests - Add tests for TIME data type in Java API [spark] - posted by "fartzy (via GitHub)" <gi...@apache.org> on 2025/07/07 09:21:05 UTC, 1 replies.
- [PR] [SPARK-52695][SQL] User Defined Type write support for xml file format [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/07 09:35:01 UTC, 3 replies.
- [PR] [SPARK-52696][SQL] Strip `__is_duplicate` metadata after analysis [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/07/07 09:55:39 UTC, 6 replies.
- Re: [PR] [SPARK-51557][SQL][TESTS] - Add tests for TIME data type in Java API [spark] - posted by "fartzy (via GitHub)" <gi...@apache.org> on 2025/07/07 14:22:16 UTC, 1 replies.
- Re: [PR] [SPARK-51557][SQL][TESTS] Add tests for TIME data type in Java API [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/07 17:04:16 UTC, 5 replies.
- [PR] [SPARK-52697][BUILD] Make Maven plugins up-to-date [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/07 17:40:41 UTC, 2 replies.
- [PR] Pull out nondeterminstic [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/07/07 18:17:15 UTC, 0 replies.
- Re: [PR] [SPARK-52679] Revise `appender.console.layout.pattern` to include MDC keys and thread name [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/07 20:16:11 UTC, 2 replies.
- [PR] [SPARK-52698][PYTHON] Improve type hints for datasource module [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/07/07 21:15:39 UTC, 6 replies.
- [PR] approx_top_k_combine [spark] - posted by "yhuang-db (via GitHub)" <gi...@apache.org> on 2025/07/07 22:47:31 UTC, 12 replies.
- [PR] [SPARK-52701][PS] Fix float32 type widening in `mod` with bool under ANSI [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/07/07 22:51:03 UTC, 3 replies.
- Re: [PR] [SPARK-52563][PS] Fix var naming bug in _assert_pandas_almost_equal [spark] - posted by "petern48 (via GitHub)" <gi...@apache.org> on 2025/07/08 00:17:35 UTC, 5 replies.
- [PR] [SPARK-52699][SQL] Support aggregating TIME type in interpreted mode [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2025/07/08 00:17:56 UTC, 3 replies.
- [PR] [SPARK-52702] Support using latest generated CRD yaml in Helm charts [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/07/08 00:27:10 UTC, 7 replies.
- Re: [PR] [WIP][SPARK-24815] [CORE] Trigger Interval based DRA for Structured Streaming [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/08 00:29:18 UTC, 1 replies.
- [PR] [IN PROGRESS] Support getting pod state using Informers/Listers [spark] - posted by "ForVic (via GitHub)" <gi...@apache.org> on 2025/07/08 00:54:07 UTC, 0 replies.
- [PR] [SPARK-52703][INFRA][PS] Upgrade minimum python version of pandas api to 3.10 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/08 03:36:17 UTC, 2 replies.
- [PR] [SPARK-52704][SQL] Simplify interoperations between SQLConf and file-format options in TextBasedFileFormats [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/08 03:45:32 UTC, 10 replies.
- Re: [PR] [SPARK-52706][SQL] Fix inconsistencies and refactor primitive types in parser [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/07/08 06:16:07 UTC, 7 replies.
- Re: [PR] [SPARK-52669][PySpark]Improvement PySpark choose pythonExec in cluster yarn client mode [spark] - posted by "gwdgithubnom (via GitHub)" <gi...@apache.org> on 2025/07/08 07:32:42 UTC, 0 replies.
- [PR] [SPARK-52707][BUILD] Remove preview postfix when looking up the JIRA versions [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/07/08 09:05:48 UTC, 3 replies.
- Re: [PR] [SPARK-52705][SQL] Refactor deterministic check for grouping expressions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/07/08 10:32:11 UTC, 8 replies.
- [PR] [WIP] Delay column name validation [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/08 10:34:35 UTC, 0 replies.
- [PR] [SPARK-52710][SQL] `DESCRIBE SCHEMA` should print collation [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2025/07/08 16:52:48 UTC, 3 replies.
- Re: [PR] [SPARK-51919][PYTHON] Allow overwriting statically registered Python Data Source [spark] - posted by "the-sakthi (via GitHub)" <gi...@apache.org> on 2025/07/08 17:32:59 UTC, 3 replies.
- [PR] [SPARK-52711][PS][TESTS] Enable test_extension_float_dtypes with ANSI [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/07/08 18:57:59 UTC, 1 replies.
- [PR] [WIP][SQL] Pretty SQL string of TIME - DAY-TIME INTERVAL [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/08 19:19:10 UTC, 0 replies.
- [PR] [SPARK-52714][SDP][SQL] Remove unused comment arg in append_flow decorator [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/07/08 20:33:36 UTC, 2 replies.
- Re: [PR] [SPARK-52715][SQL] Pretty SQL string of TIME - DAY-TIME INTERVAL [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/07/08 20:59:22 UTC, 2 replies.
- Re: [PR] [SPARK-52542] Use `/nonexistent` instead of nonexistent `/home/spark` [spark-docker] - posted by "DenWav (via GitHub)" <gi...@apache.org> on 2025/07/08 21:11:46 UTC, 3 replies.
- Re: [PR] [SPARK-52714][SDP] Remove unused comment arg in append_flow decorator [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2025/07/08 22:06:44 UTC, 2 replies.
- Re: [PR] [SPARK-52588][SQL] Approx_top_k: accumulate and estimate [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/07/08 22:35:44 UTC, 18 replies.
- [PR] [SPARK-52717][INFRA] Escape special characters when redacting the log files in release build [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/07/08 23:05:06 UTC, 2 replies.
- [PR] [WIP][SPARK-52716] Remove comment from Flow trait and references [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/07/09 00:09:32 UTC, 0 replies.
- [PR] [SPARK-52718][PS] Fix float32 type widening in `rmod` under ANSI [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/07/09 00:40:07 UTC, 0 replies.
- [PR] [WIP] Fix float32 type widening in `add`/`radd` under ANSI [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/07/09 00:53:08 UTC, 0 replies.
- Re: [PR] [MINOR][DOCS] Updated the docstring of DataStreamWriter.foreach() method [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/07/09 00:56:02 UTC, 1 replies.
- [PR] [WIP][CONNECT] Server side column name validation [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/09 02:40:40 UTC, 0 replies.
- [PR] Parmsubstitution [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2025/07/09 02:43:18 UTC, 0 replies.
- [PR] [SPARK-52704][SQL][FOLLOWUP] Move session state utilities from trait FileFormat to SessionStateHelper [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/09 03:40:01 UTC, 4 replies.
- [PR] Create test [spark] - posted by "codersky (via GitHub)" <gi...@apache.org> on 2025/07/09 05:55:29 UTC, 1 replies.
- [PR] [MINOR][PYTHON][ML][TESTS] Skip two flaky tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/09 06:08:15 UTC, 2 replies.
- [PR] [SPARK-52721][PYTHON] Fix message parameter for CANNOT_PARSE_DATATYPE [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/09 07:37:04 UTC, 3 replies.
- [PR] [SPARK-52722] Deprecate JdbcRDD class [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2025/07/09 08:20:30 UTC, 3 replies.
- [PR] [SPARK-52561][PYTHON][DOC][FOLLOW-UP] Further upgrade the minimum python version [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/09 09:20:49 UTC, 3 replies.
- [PR] [SPARK-52724][SQL] Enhance broadcast join OOM error handling with SHUFFLE_MERGE hint support [spark] - posted by "Emma-82 (via GitHub)" <gi...@apache.org> on 2025/07/09 09:47:31 UTC, 5 replies.
- [PR] [SPARK-52728][BUILD] Remove the usage of non-existent profiles [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/09 12:23:38 UTC, 4 replies.
- [PR] [SPARK-52729][SQL] Add GENERAL_TABLE v2 table capacity [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/07/09 13:05:21 UTC, 23 replies.
- Re: [PR] [SPARK-46941][SQL] Can't insert window group limit node for top-k computation if contains SizeBasedWindowFunction [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2025/07/09 13:12:22 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-35677][Core][SQL] Support dynamic range of executor numbers for dynamic allocation [spark] - posted by "liming30 (via GitHub)" <gi...@apache.org> on 2025/07/09 13:14:03 UTC, 0 replies.
- [PR] [WIP][SQL][DOCS] Update the page about TIME literals [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/09 13:15:27 UTC, 0 replies.
- Re: [PR] [SDP] [SPARK-52577] Add tests for Declarative Pipelines DatasetManager with Hive catalog [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/07/09 13:19:55 UTC, 0 replies.
- [PR] [SPARK-52730] Store underlying driver and database version in JDBCRDD [spark] - posted by "alekjarmov (via GitHub)" <gi...@apache.org> on 2025/07/09 13:45:34 UTC, 0 replies.
- [PR] [SPARK-46941][SQL][3.5] Can't insert window group limit node for top-k computation if contains SizeBasedWindowFunction [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2025/07/09 13:53:51 UTC, 6 replies.
- [PR] [SPARK-52731][SS][PYTHON][TESTS] Fix flaky test_listener_events in 'pyspark.sql.tests.streaming.test_streaming_listener' [spark] - posted by "sririshindra (via GitHub)" <gi...@apache.org> on 2025/07/09 13:55:52 UTC, 10 replies.
- Re: [PR] [SPARK-52723][SQL][CONNECT] Server side column name validation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/07/09 13:58:50 UTC, 4 replies.
- [PR] [SPARK-52725][CORE] Delay resource profile manager initialization until plugin is loaded [spark] - posted by "DenineLu (via GitHub)" <gi...@apache.org> on 2025/07/09 14:05:21 UTC, 3 replies.
- Re: [PR] [SPARK-52716][SDP][SQL] Remove comment from Flow trait and references [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/07/09 15:56:59 UTC, 4 replies.
- [PR] Add eventually in flaky test SPARK-44776: LocalTableScanExec [spark] - posted by "alekjarmov (via GitHub)" <gi...@apache.org> on 2025/07/09 16:59:38 UTC, 0 replies.
- Re: [PR] [SPARK-52733][SQL][DOCS] Update the page about TIME literals [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/09 18:12:29 UTC, 2 replies.
- [PR] [SPARK-52736][PS] Fix typos 'moveing' in pyspark/pandas/generic.py [spark] - posted by "petern48 (via GitHub)" <gi...@apache.org> on 2025/07/09 18:50:03 UTC, 2 replies.
- [PR] [SPARK-52735][SQL] Fix missing error conditions for SQL UDFs [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/07/09 19:01:49 UTC, 6 replies.
- Re: [PR] [SPARK-52718][PS] Fix float32 type widening in `rmod`/`mod` under ANSI [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/07/09 20:29:34 UTC, 2 replies.
- [PR] [SPARK-52737][CORE] Pushdown predicate and number of apps to FsHistoryProvider when listing applications [spark] - posted by "shardulm94 (via GitHub)" <gi...@apache.org> on 2025/07/09 21:17:36 UTC, 18 replies.
- [PR] [SPARK-52739][PYTHON][TEST] Apply a patch to unittest.main to report errors in setUpClass properly [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/07/09 22:13:50 UTC, 2 replies.
- [PR] [SPARK-52738][SQL] Support aggregating the TIME type with a UDAF when the underlying buffer is an `UnsafeRow` [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2025/07/09 22:25:47 UTC, 5 replies.
- [PR] [SPARK-52740] Fix NPE in HDFSBackedStateStoreProvider accessing StateStoreConf.sqlConf when checkpoint format version is >=2 [spark] - posted by "liviazhu (via GitHub)" <gi...@apache.org> on 2025/07/09 22:34:12 UTC, 0 replies.
- [PR] [SPARK-52741][SQL] RemoveFiles ShuffleCleanup mode doesnt work with non-adaptive execution [spark] - posted by "karuppayya (via GitHub)" <gi...@apache.org> on 2025/07/09 22:58:10 UTC, 12 replies.
- Re: [PR] [SPARK-44776][TESTS] Add eventually in flaky test LocalTableScanExec [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/07/09 23:36:22 UTC, 2 replies.
- Re: [PR] [SPARK-51647][INFRA] Add a job to guard REPLs: spark-sql and spark-shell [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/10 00:29:39 UTC, 1 replies.
- Re: [PR] [SPARK-51637][PYTHON] Implement createColumnarReader for Python Data Source [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/10 00:29:40 UTC, 1 replies.
- Re: [PR] [SPARK-52730][SQL] Store underlying driver and database version in JDBCRDD [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/07/10 00:55:34 UTC, 6 replies.
- Re: [PR] [SPARK-52740] [SS] Fix NPE in HDFSBackedStateStoreProvider accessing StateStoreConf.sqlConf when checkpoint format version is >=2 [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/07/10 00:58:44 UTC, 8 replies.
- [PR] [SPARK-52742] Support `createDataflowGraph` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/10 01:11:38 UTC, 9 replies.
- [PR] [SPARK-52727][SQL] Refactor Window resolution in order to reuse it in single-pass analyzer [spark] - posted by "nikola-jovicevic-db (via GitHub)" <gi...@apache.org> on 2025/07/10 02:33:41 UTC, 4 replies.
- [PR] [SPARK-52743] Support `startRun` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/10 03:18:48 UTC, 3 replies.
- [PR] [SPARK-52744] Add `MacOS` integration test with Apache Spark `4.1.0-preview1` RC1 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/10 03:28:59 UTC, 10 replies.
- [PR] [SPARK-52745][SQL] Make Table.schema() be able to be deprecated [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/10 03:57:52 UTC, 2 replies.
- [PR] [SPARK-52694][SQL] Add a DeveloperApi - org.apache.spark.sql.Encoders#udt [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/10 06:54:04 UTC, 4 replies.
- [PR] [SPARK-52748] Support `defineDataset` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/10 07:05:27 UTC, 5 replies.
- [PR] [SPARK-52749][BUILD] Replace preview1 to dev1 in its PyPI package name in the vote email [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/07/10 07:10:02 UTC, 3 replies.
- Re: [PR] [SPARK-52223][CONNECT] Add SDP Spark Connect Protos [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/10 07:59:43 UTC, 4 replies.
- Re: [PR] [SPARK-52745][SQL] Ensure one of the `schema` and `columns` in the Table interface is implemented and `columns` is preferable [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/10 08:11:28 UTC, 6 replies.
- Re: [PR] [SPARK-52750][TESTS] Add eventually in flaky test LocalTableScanExec [spark] - posted by "alekjarmov (via GitHub)" <gi...@apache.org> on 2025/07/10 08:24:40 UTC, 3 replies.
- [PR] fix: do not retry status patch if succeeded before [spark-kubernetes-operator] - posted by "csviri (via GitHub)" <gi...@apache.org> on 2025/07/10 08:59:05 UTC, 0 replies.
- Re: [PR] [SPARK-52565] [SQL] Enforce ordinal resolution before other sort order expressions [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/07/10 10:42:19 UTC, 7 replies.
- [PR] [SPARK-52752][CORE] Check if tasks on executor are finished when killing executor [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2025/07/10 10:44:40 UTC, 13 replies.
- [PR] [SPARK-52753] Make parseDataType binary compatible with previous versions [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2025/07/10 11:50:25 UTC, 2 replies.
- [PR] Remove informer config reconciler [spark-kubernetes-operator] - posted by "csviri (via GitHub)" <gi...@apache.org> on 2025/07/10 13:15:01 UTC, 0 replies.
- [PR] [SPARK-52756] Support `defineFlow` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/10 13:28:24 UTC, 4 replies.
- Re: [PR] [SPARK-52755] Remove `ConfigMap` informer from config reconciler [spark-kubernetes-operator] - posted by "csviri (via GitHub)" <gi...@apache.org> on 2025/07/10 14:20:28 UTC, 16 replies.
- Re: [PR] [SPARK-52694][SQL] Add `o.a.s.sql.Encoders#udt`API [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/10 14:49:34 UTC, 5 replies.
- Re: [PR] Enable -Xsource:3 compiler flag [spark] - posted by "joan38 (via GitHub)" <gi...@apache.org> on 2025/07/10 15:37:30 UTC, 9 replies.
- [PR] [SPARK-52726][SQL] Normalize project list under Window [spark] - posted by "nikola-jovicevic-db (via GitHub)" <gi...@apache.org> on 2025/07/10 15:58:42 UTC, 7 replies.
- [PR] [SPARK-52735][FOLLOWUP] Drop created UDF UDFs in SQL query tests [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/07/10 16:32:23 UTC, 3 replies.
- [PR] [WIP][SQL] Support TIME subtract [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/10 17:00:53 UTC, 0 replies.
- [PR] [SPARK-52757][CONNECT] Rename "plan" field in DefineFlow to "relation" [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/07/10 17:14:02 UTC, 2 replies.
- [PR] [SPARK-52757][CONNECT] Rename DefineFlow.plan to relation [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/07/10 17:21:59 UTC, 2 replies.
- [PR] [SPARK-52758] Support `defineSqlGraphElements` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/10 17:40:25 UTC, 3 replies.
- Re: [PR] [SPARK-42746][SQL][FIXUP] Fix optimizer failure for SortOrder in the LISTAGG function [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/10 17:44:01 UTC, 5 replies.
- Re: [PR] [SPARK-52419][PYTHON][TESTS] Make Python Connect tests work with NumPy 2.3.0 [spark] - posted by "kaifahmad (via GitHub)" <gi...@apache.org> on 2025/07/10 17:45:52 UTC, 2 replies.
- Re: [PR] [SPARK-52751][PYTHON][CONNECT] Don't eagerly validate column name in `dataframe['col_name']` [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/07/10 17:54:49 UTC, 3 replies.
- Re: [PR] [SPARK-52720][PS] Fix float32 type widening in `add`/`radd` under ANSI [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/07/10 17:59:31 UTC, 2 replies.
- [PR] [SPARK-52760][PS] Fix float32 type widening in `sub`/`rsub` under ANSI [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/07/10 18:29:46 UTC, 3 replies.
- [PR] [SPARK-52759] Throw exception if pipeline has no tables or persisted views [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/07/10 18:31:32 UTC, 0 replies.
- [PR] [SQL] Clarify schema mismatch types in insertInto error [spark] - posted by "a1noh (via GitHub)" <gi...@apache.org> on 2025/07/10 19:03:30 UTC, 0 replies.
- Re: [PR] [SPARK-52759][SDP][SQL] Throw exception if pipeline has no tables or persisted views [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/07/10 20:08:41 UTC, 10 replies.
- [PR] [SPARK-52711][PS] Fix float32 type widening in `mul`/`rmul` under ANSI [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/07/10 20:43:15 UTC, 4 replies.
- Re: [PR] [SPARK-52763][SQL] Support TIME subtract [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/10 20:53:42 UTC, 10 replies.
- Re: [PR] [SPARK-51653][CONNECT][TESTS] Migrate the tests related to `RemoteSparkSession` from the `connect-client-jvm` module to `connect-client-integration-tests` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/11 00:29:52 UTC, 1 replies.
- [PR] [MINOR][PYTHON][ML][TESTS] Further skip flaky `test_parity_regression` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/11 01:30:47 UTC, 2 replies.
- Re: [PR] [SPARK-47404][SQL] Add configurable size limits for ANTLR DFA cache [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/07/11 01:54:31 UTC, 6 replies.
- [PR] Use `StandardCharsets.UTF_8` instead of `Charsets.UTF_8` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/11 03:29:39 UTC, 0 replies.
- Re: [PR] [SPARK-52334][CORE][K8S] update all files, jars, and pyFiles to reference the working directory after they are downloaded [spark] - posted by "TongWei1105 (via GitHub)" <gi...@apache.org> on 2025/07/11 04:02:22 UTC, 0 replies.
- [PR] [SPARK-52766][INFRA] Allow manual dispatches of dry runs in the forked repository [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/07/11 04:39:31 UTC, 2 replies.
- [PR] [SPARK-52767][SQL] Optimize the performance of maxRows in join [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2025/07/11 05:45:54 UTC, 5 replies.
- Re: [PR] [SPARK-52754] Fix repeated status update retries if no error [spark-kubernetes-operator] - posted by "csviri (via GitHub)" <gi...@apache.org> on 2025/07/11 06:25:38 UTC, 2 replies.
- [PR] [SPARK-52768][PS] Fix typo "moveing" in pandas/series.py [spark] - posted by "petern48 (via GitHub)" <gi...@apache.org> on 2025/07/11 07:05:53 UTC, 2 replies.
- Re: [PR] [SPARK-52765][K8S] Use `StandardCharsets.UTF_8` instead of `Charsets.UTF_8` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/11 08:59:30 UTC, 1 replies.
- Re: [PR] [SPARK-52753][SQL] Make parseDataType binary compatible with previous versions [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/11 09:22:52 UTC, 1 replies.
- [PR] [SPARK-52769] InjectRuntimeFilter should take into account join type and hints [spark] - posted by "akupchinskiy (via GitHub)" <gi...@apache.org> on 2025/07/11 11:54:30 UTC, 0 replies.
- [PR] [WIP][SQL] Return NULL from +/- on datetime with NULL [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/11 13:57:08 UTC, 0 replies.
- Re: [PR] [SPARK-52592][PS] Prevent error when creating ps.Series from ps.Series [spark] - posted by "petern48 (via GitHub)" <gi...@apache.org> on 2025/07/11 15:11:46 UTC, 1 replies.
- [PR] Initial commit [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/11 15:40:27 UTC, 0 replies.
- [PR] [SPARK-52771][PS] Fix float32 type widening in `truediv`/`floordiv` under ANSI [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/07/11 18:21:30 UTC, 0 replies.
- Re: [PR] [SPARK-52577][SDP] Add tests for Declarative Pipelines DatasetManager with Hive catalog [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/07/11 18:35:47 UTC, 5 replies.
- [PR] [SPARK-52773] Upgrade `Gradle` to 8.14.3 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/11 19:05:49 UTC, 3 replies.
- [PR] [SPARK-52702] Add test for comparing generated CRD yaml with the version in Helm charts [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/07/11 20:21:03 UTC, 0 replies.
- Re: [PR] [SPARK-52702] Verify generated CRD yaml with Helm chart `crds` content [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/11 20:25:48 UTC, 2 replies.
- [PR] [SPARK-52774] Fix resource retain policy typo in docs [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/07/11 21:00:02 UTC, 0 replies.
- [PR] [SPARK-52775] Add `time` SQL test and answer file [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/11 21:02:34 UTC, 4 replies.
- Re: [PR] [SPARK-52774] Fix `resourceRetentionPolicy` typo to `resourceRetainPolicy` in docs [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/11 21:12:53 UTC, 3 replies.
- [PR] [SPARK-52776][CORE] Do not split the comm field in ProcfsMetricsGetter [spark] - posted by "max2718281 (via GitHub)" <gi...@apache.org> on 2025/07/11 23:38:53 UTC, 3 replies.
- Re: [PR] [SPARK-51562][SQL] Add the time() function [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/12 00:29:42 UTC, 5 replies.
- [PR] [SPARK-52777] Enable shuffle cleanup mode configuration in Spark SQL [spark] - posted by "karuppayya (via GitHub)" <gi...@apache.org> on 2025/07/12 00:39:04 UTC, 0 replies.
- [PR] Bump org.apache.commons:commons-lang3 from 3.17.0 to 3.18.0 [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/07/12 01:32:43 UTC, 2 replies.
- [PR] [SPARK-52778] Upgrade `commons-lang3` to 3.18.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/12 02:36:58 UTC, 0 replies.
- [PR] [SPARK-52619][SQL] Cast TimeType to IntegralType [spark] - posted by "fartzy (via GitHub)" <gi...@apache.org> on 2025/07/12 06:17:25 UTC, 20 replies.
- Re: [PR] [SPARK-52722][CORE] Deprecate JdbcRDD class [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/12 08:26:43 UTC, 1 replies.
- Re: [PR] [SPARK-52778][BUILD] Upgrade `commons-lang3` to 3.18.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/12 08:29:56 UTC, 3 replies.
- [PR] [SPARK-51162][SQL][CONNECT] Support TimeType literal in Connect [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2025/07/12 09:46:07 UTC, 1 replies.
- [PR] [SPARK-52780] Implement ToLocalRowIterator (ToLocalIterator equivalent) [spark-connect-go] - posted by "caldempsey (via GitHub)" <gi...@apache.org> on 2025/07/12 16:44:24 UTC, 3 replies.
- [PR] [SPARK-52780] Add ToLocalIterator and Arrow Record Streaming [spark-connect-go] - posted by "caldempsey (via GitHub)" <gi...@apache.org> on 2025/07/13 00:13:21 UTC, 26 replies.
- Re: [PR] [SPARK-51694][SQL] Fix load v2 function with non-buildin V2 session catalog [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/13 00:33:39 UTC, 1 replies.
- [PR] [SPARK-52781][PS] Fix dtyeps typo in internal.py [spark] - posted by "petern48 (via GitHub)" <gi...@apache.org> on 2025/07/13 00:58:35 UTC, 2 replies.
- [PR] [SPARK-52770][CONNECT] Support `TIME` type in connect proto [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/07/13 10:46:07 UTC, 15 replies.
- [PR] [SPARK-52457][SQL]ParseToDate/ParseToTimestamp can return incorrect value for TimestampNTZ [spark] - posted by "pasar6987 (via GitHub)" <gi...@apache.org> on 2025/07/13 10:57:46 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-52780] Add ToLocalIterator and Arrow Record Streaming [spark-connect-go] - posted by "caldempsey (via GitHub)" <gi...@apache.org> on 2025/07/13 11:39:17 UTC, 4 replies.
- Re: [PR] [SPARK-52782][SQL] Return NULL from +/- on datetime with NULL [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/13 11:43:41 UTC, 2 replies.
- Re: [PR] [SPARK-52620][SQL] Support casting of TIME to DECIMAL [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/13 13:27:42 UTC, 5 replies.
- Re: [PR] [SPARK-52779][SQL][CONNECT] Support TimeType literal in Connect [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/13 13:29:08 UTC, 6 replies.
- Re: [PR] [WIP][SPARK-52620][SQL] Support casting of TIME to DECIMAL [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/13 16:05:02 UTC, 5 replies.
- [PR] [SPARK-52772] Inconsistent table attribute handling during updates [spark] - posted by "ksbeyer (via GitHub)" <gi...@apache.org> on 2025/07/13 16:24:39 UTC, 1 replies.
- [PR] [WIP][SQL] Incapsulate type operations [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/13 18:02:33 UTC, 10 replies.
- [PR] [SPARK-52784][SQL] Add TimeZoneAware casting in WindowFrameTypeCoercion.createBoundaryCast [spark] - posted by "nikola-jovicevic-db (via GitHub)" <gi...@apache.org> on 2025/07/13 23:41:19 UTC, 2 replies.
- Re: [PR] [SPARK-51696][SQL] Fix the VariantGet .sql method to also output the target data type [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/14 00:32:15 UTC, 1 replies.
- Re: [PR] [SPARK-52772][SQL] Inconsistent table attribute handling during updates [spark] - posted by "ksbeyer (via GitHub)" <gi...@apache.org> on 2025/07/14 02:34:52 UTC, 27 replies.
- [PR] [SPARK-52786][Make pyspark-client package to upload with preview naming [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/07/14 03:40:35 UTC, 0 replies.
- Re: [PR] [SPARK-52786][BUILD] Make pyspark-client package to upload with preview naming [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/07/14 03:59:02 UTC, 1 replies.
- [PR] [SPARK-52788][SQL] Fix error of converting binary value in BinaryType to XML [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/14 04:49:56 UTC, 7 replies.
- [PR] [SPARK-52789][BUILD] Upgrade PostgreSQL to 42.7.7 [spark] - posted by "eschcam (via GitHub)" <gi...@apache.org> on 2025/07/14 09:56:26 UTC, 4 replies.
- Re: [PR] [SPARK-39142][SPARK-42235][PYTHON] Add overloads in pandas function stub file [spark] - posted by "AkiraVoid (via GitHub)" <gi...@apache.org> on 2025/07/14 11:15:48 UTC, 0 replies.
- [PR] [SPARK-52449][CONNECT] Make datatypes for Expression.Literal.Map/Expression.Literal.Array optional [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/07/14 13:08:53 UTC, 0 replies.
- [PR] [SPARK-52790] Introduce new grid testing method in SparkFunSuite [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2025/07/14 13:13:46 UTC, 0 replies.
- [PR] [SPARK-52791][PS] Fix inferring a UDT errors when first element is null [spark] - posted by "petern48 (via GitHub)" <gi...@apache.org> on 2025/07/14 14:17:13 UTC, 0 replies.
- Re: [PR] [SPARK-52790][CORE] Introduce new grid testing method in SparkFunSuite [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2025/07/14 14:23:51 UTC, 0 replies.
- Re: [PR] [SPARK-42288] Expose file path if reading failed [spark] - posted by "wugx (via GitHub)" <gi...@apache.org> on 2025/07/14 16:02:48 UTC, 1 replies.
- Re: [PR] [SPARK-52592][PS] Support creating a ps.Series from a ps.Series [spark] - posted by "petern48 (via GitHub)" <gi...@apache.org> on 2025/07/14 16:04:35 UTC, 8 replies.
- [PR] [SPARK-52792][CORE] Remove `commons-lang3` dependency from `network-common` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/14 16:27:50 UTC, 31 replies.
- [PR] [SPARK-52787][SS] Reorganize streaming execution dir around runtime and checkpoint areas [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/07/14 16:32:19 UTC, 3 replies.
- [PR] [SPARK-52793][CORE] Support `isUnix` at `o.a.s.util.Utils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/14 17:08:02 UTC, 5 replies.
- [PR] [SPARK-52794][PYTHON] 2x Performance Improvement of Arrow-Optimized Python UDTF [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/07/14 18:22:51 UTC, 1 replies.
- [PR] [SPARK-52709][SQL] Fix parsing of null STRUCT<> [spark] - posted by "ManosGEM (via GitHub)" <gi...@apache.org> on 2025/07/14 19:10:12 UTC, 8 replies.
- Re: [PR] [SPARK-52794][PYTHON] Performance improvement of arrow-optimized python UDTF with LocalDataToArrowConversion check [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/07/14 21:41:25 UTC, 3 replies.
- [PR] [SPARK-52776][CORE][3.5] Do not split the comm field in ProcfsMetricsGetter [spark] - posted by "max2718281 (via GitHub)" <gi...@apache.org> on 2025/07/14 22:03:42 UTC, 2 replies.
- [PR] [SPARK-52796][PYTHON] Optimize LocalDataToArrowConversion.convert to improve its performance [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/07/14 23:06:11 UTC, 2 replies.
- [PR] [SPARK-52797] Use `Utils.isWindows` instead of re-evaluating in `PythonWorkerFactory` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/14 23:15:53 UTC, 3 replies.
- [PR] [WIP] [SPARK-52795] [SS] Include runId in state store logs [spark] - posted by "dylanwong250 (via GitHub)" <gi...@apache.org> on 2025/07/14 23:48:12 UTC, 0 replies.
- [PR] Fix example 4 in DataFrame.na.replace() [spark] - posted by "mbrukman (via GitHub)" <gi...@apache.org> on 2025/07/14 23:51:15 UTC, 0 replies.
- [PR] [SPARK-52578][SQL][FOLLOW-UP] Small capitalization fixes for merge merge metrics [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/07/15 00:03:23 UTC, 3 replies.
- Re: [PR] [MINOR][DOC] grammatical corrections, spellings and typos [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/15 00:30:58 UTC, 1 replies.
- [PR] [MINOR][PYTHON][TESTS] Make a group of tests more deterministic [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/15 03:10:50 UTC, 0 replies.
- [PR] [MINOR][TESTS] Fix ThriftServerQueryTestSuite result comparison [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/15 03:13:47 UTC, 0 replies.
- [PR] dry run [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/07/15 04:29:10 UTC, 0 replies.
- Re: [PR] [MINOR][PYTHON][TESTS] Make a group of tests more deterministic in `test_connect_function.py` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/15 05:08:59 UTC, 1 replies.
- [PR] [SPARK-52686][FOLLOWUP][SQL][MINOR][TESTS] Fix a failing test [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/07/15 06:49:33 UTC, 6 replies.
- Re: [PR] [SPARK-52709][SQL] Fix parsing of STRUCT<> [spark] - posted by "ManosGEM (via GitHub)" <gi...@apache.org> on 2025/07/15 07:33:22 UTC, 15 replies.
- [PR] Test maven 3.9.11 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/15 07:43:42 UTC, 2 replies.
- [PR] Test zstd-jni 1.5.7-4 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/15 07:53:21 UTC, 2 replies.
- Re: [PR] [SPARK-52799][TESTS] Fix ThriftServerQueryTestSuite result comparison [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/15 08:14:37 UTC, 5 replies.
- Re: [PR] [SPARK-52617][SQL] Cast TIME to/from TIMESTAMP_NTZ [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/15 09:44:12 UTC, 9 replies.
- [PR] [SQL][SPARK-52801] Make name-precedence-in-order-by-and-having-with-conflicting-attributes suite deterministic [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/07/15 11:58:31 UTC, 2 replies.
- [PR] [SPARK-52800]Remove several deprecated commons-lang3 methods [spark] - posted by "morvenhuang (via GitHub)" <gi...@apache.org> on 2025/07/15 12:53:34 UTC, 0 replies.
- [PR] [SPARK-52783][SQL] Refactor windowFunction validation logic from checkAnalysis for reuse in single-pass analyzer [spark] - posted by "nikola-jovicevic-db (via GitHub)" <gi...@apache.org> on 2025/07/15 14:12:19 UTC, 2 replies.
- Re: [PR] [SPARK-52686][FOLLOWUP][SQL][TESTS] Fix a failing test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/15 15:17:10 UTC, 0 replies.
- Re: [PR] [SPARK-52455][SQL][TESTS] Test expression-based defaults in UPDATE and MERGE [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/07/15 15:25:38 UTC, 0 replies.
- [PR] [SPARK-52803][BUILD] Update aws-java-sdk-s3 to 1.12.261 [spark] - posted by "eschcam (via GitHub)" <gi...@apache.org> on 2025/07/15 15:53:11 UTC, 1 replies.
- [PR] Revert "[SPARK-52576][SDP] Drop/recreate on full refresh and MV update" [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/07/15 15:53:11 UTC, 4 replies.
- Re: [PR] [SPARK-52789][BUILD][TESTS] Upgrade PostgreSQL to 42.7.7 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/15 16:03:21 UTC, 1 replies.
- Re: [PR] [SPARK-52803][BUILD] Update aws-java-sdk-s3 to 1.12.720 [spark] - posted by "eschcam (via GitHub)" <gi...@apache.org> on 2025/07/15 16:44:03 UTC, 3 replies.
- Re: [PR] [SPARK-52437][BUILD] Ensure `Annotation Processing` in Java compilation for Java 23+ [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/15 16:59:42 UTC, 11 replies.
- Re: [PR] [SPARK-52795] [SS] Include runId in state store logs [spark] - posted by "liviazhu (via GitHub)" <gi...@apache.org> on 2025/07/15 17:09:05 UTC, 22 replies.
- [PR] SPARK-XXX: Add Java 17 clean build test [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/15 17:09:42 UTC, 0 replies.
- [PR] [SPARK-52804] Revert faulty annotation processing policy [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/15 17:31:48 UTC, 9 replies.
- [PR] temp [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2025/07/15 17:40:14 UTC, 0 replies.
- Re: [PR] [SPARK-52805][INFRA] Add `Java 17` build and install test pipeline [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/15 17:44:07 UTC, 4 replies.
- Re: [PR] [SPARK-51728][SQL] Add SELECT EXCEPT Support [spark] - posted by "changrybirds (via GitHub)" <gi...@apache.org> on 2025/07/15 19:38:31 UTC, 0 replies.
- [PR] [SPARK-52807][SDP] Proto changes to support analysis inside Declarative Pipelines query functions [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/07/15 20:05:54 UTC, 3 replies.
- [PR] [SPARK-XXXXX][SQL] Add only one task completion listener for metric update callback [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/07/15 20:11:51 UTC, 0 replies.
- Re: [PR] [DO-NOT-MERGE][SPARK-52804] Revert faulty annotation processing policy [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/15 20:14:38 UTC, 0 replies.
- [PR] [SPARK-52808][CORE] `spark.history.retainedApplications` should be positive [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/15 20:31:19 UTC, 4 replies.
- Re: [PR] [SPARK-52809][SQL] Don't hold reader and iterator references for all partitions in task completion listeners for metric update [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/15 20:44:33 UTC, 5 replies.
- Re: [PR] [SPARK-52008] [SS] Add StateStore TaskCompletionListener to abort store and throw error [spark] - posted by "liviazhu (via GitHub)" <gi...@apache.org> on 2025/07/15 22:41:09 UTC, 0 replies.
- [PR] [SPARK-52798] [SQL] Add function approx_top_k_combine [spark] - posted by "yhuang-db (via GitHub)" <gi...@apache.org> on 2025/07/15 23:17:27 UTC, 1 replies.
- [PR] [MINOR][SQL] Add unit test for V2 write schema evolution [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/07/16 00:55:56 UTC, 0 replies.
- [PR] [WIP][SPARK- 52810][SDP][SQL] Spark Pipelines CLI Selection Options [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/07/16 01:27:07 UTC, 0 replies.
- [PR] [SPARK-52811][PYTHON] Optimize ArrowTableToRowsConversion.convert to improve its performance [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/07/16 01:59:43 UTC, 2 replies.
- Re: [PR] [MINOR][DOCS] Fix example 4 in DataFrame.na.replace() [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/16 02:20:22 UTC, 1 replies.
- [PR] [SPARK-52815][CORE] Improve `SparkClassUtils` to support `getAllInterfaces` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/16 04:18:58 UTC, 6 replies.
- [PR] [SPARK-52817][SQL] Fix Like Expression performance [spark] - posted by "zhixingheyi-tian (via GitHub)" <gi...@apache.org> on 2025/07/16 06:26:33 UTC, 7 replies.
- [PR] [MINOR][PYTHON][TESTS] De-flake unit tests of `collect_set` and `collect_list` in `test_connect_function` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/16 07:40:51 UTC, 2 replies.
- Re: [PR] [SPARK-52214][PYTHON] Arrow UDF for aggregation [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/16 08:40:16 UTC, 3 replies.
- Re: [PR] [SPARK-52814][BUILD] Upgrade zstd-jni to 1.5.7-4 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/16 09:27:45 UTC, 1 replies.
- [PR] [SPARK-52820][SQL] Capture full plans in golden files [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/07/16 10:55:07 UTC, 8 replies.
- [PR] single pass [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/07/16 11:27:15 UTC, 0 replies.
- [PR] Check the Java version used for building the project [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/16 12:55:08 UTC, 6 replies.
- Re: [PR] [SPARK-52803][BUILD] Update `aws-java-sdk-sts` to 1.12.720 in `kinesis-asl` module [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/16 14:02:33 UTC, 10 replies.
- [PR] wip [SPARK-52779][CONNECT][PYTHON] Support TimeType literal in Connect [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2025/07/16 15:15:33 UTC, 0 replies.
- Re: [PR] [SPARK-52449][CONNECT][PYTHON][SQL] Make datatypes for Expression.Literal.Map/Array optional [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/07/16 15:29:28 UTC, 6 replies.
- [PR] [SPARK-52813][CONNECT] [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/07/16 15:50:43 UTC, 7 replies.
- [PR] [WIP][SQL] Simplify casting of TIME to INT [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/16 15:59:28 UTC, 0 replies.
- Re: [PR] [SPARK-52804][BUILD] Add a check for the Java version used to build Spark [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/16 16:36:10 UTC, 5 replies.
- Re: [PR] [DRAFT] Parameter markers in DDL. [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/07/16 16:48:03 UTC, 1 replies.
- [PR] [SPARK-52824][SS] CheckpointFileManager error classification [spark] - posted by "liviazhu (via GitHub)" <gi...@apache.org> on 2025/07/16 17:56:14 UTC, 9 replies.
- Re: [PR] [SPARK- 52810][SDP][SQL] Spark Pipelines CLI Selection Options [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/07/16 18:02:11 UTC, 20 replies.
- [PR] [SPARK-52823][SQL] Support DSv2 Join pushdown for Oracle connector [spark] - posted by "PetarVasiljevic-DB (via GitHub)" <gi...@apache.org> on 2025/07/16 19:31:09 UTC, 57 replies.
- [PR] [SS][SPARK-52637] Fix version ID mismatch issue for RocksDB compaction leading to incorrect file mapping [spark] - posted by "liviazhu (via GitHub)" <gi...@apache.org> on 2025/07/16 19:36:03 UTC, 5 replies.
- Re: [PR] [SPARK-52619][SQL][FOLLOWUP] Simplify casting of TIME to INT [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/16 20:10:02 UTC, 3 replies.
- [PR] [SPARK-52827] Add `pi-with-template.yaml` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/16 20:36:28 UTC, 4 replies.
- Re: [PR] [SPARK-52511][SDP] dry run [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/07/16 20:42:56 UTC, 0 replies.
- [PR] [SPARK-52828][SQL] Make hashing for collated strings collation agnostic [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/16 21:10:07 UTC, 15 replies.
- [PR] [SPARK-52830][K8S] Support `spark.kubernetes.(driver|executor).pod.excludedFeatureSteps` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/16 22:18:23 UTC, 7 replies.
- [PR] [SPARK-52829][PYTHON] Fix LocalDataToArrowConversion.convert to handle empty rows properly [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/07/16 22:22:30 UTC, 2 replies.
- [PR] [SPARK-52792][CORE][FOLLOWUP] Remove redundant condition check [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/16 22:33:01 UTC, 5 replies.
- [PR] [SPARK-52641][SQL] Primary key columns should not be nullable [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/07/16 22:50:38 UTC, 14 replies.
- [PR] [SPARK-52831] Revise the default logging layout to include only name & namespace MDC Keys [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/07/16 23:31:09 UTC, 3 replies.
- [PR] [SPARK-52833] Fix VariantBuilder.appendFloat [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2025/07/16 23:49:28 UTC, 1 replies.
- [PR] [SPARK-52834] Improve `ProbeService` to show the port number [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/17 00:01:54 UTC, 2 replies.
- Re: [PR] [SPARK-51741][SQL][TESTS] Remove --ONLY_IF spark for subquery tests: PR#1 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/17 00:30:44 UTC, 1 replies.
- Re: [PR] [SPARK-52777][SQL] Enable shuffle cleanup mode configuration in Spark SQL [spark] - posted by "karuppayya (via GitHub)" <gi...@apache.org> on 2025/07/17 01:29:59 UTC, 17 replies.
- Re: [PR] [SPARK-52511][SDP] Support dry-run mode in spark-pipelines command [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/07/17 03:06:43 UTC, 6 replies.
- Re: [PR] [SPARK-46207][SQL] Support MergeInto in DataFrameWriterV2 [spark] - posted by "sangram11 (via GitHub)" <gi...@apache.org> on 2025/07/17 03:14:46 UTC, 0 replies.
- [PR] [SPARK-52835] Fix the default value of `operatorContainer` memory to `2Gi` from `4Gi` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/17 04:16:00 UTC, 3 replies.
- [PR] [SPARK-52836] Fix `sparkapp.sh` to let Spark driver determine pod memory [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/17 04:32:39 UTC, 3 replies.
- [PR] [MINOR][CORE] Fix a missing space in log [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2025/07/17 05:08:25 UTC, 2 replies.
- Re: [PR] [SPARK-52779][CONNECT][PYTHON] Support TimeType literal in Connect [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2025/07/17 05:13:21 UTC, 0 replies.
- Re: [PR] [SPARK-42746][SQL] Fix optimizer failure for SortOrder in the LISTAGG function [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/07/17 05:30:48 UTC, 2 replies.
- Re: [PR] [SPARK-52837][CONNECT][PYTHON] Support TimeType literal in Connect [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2025/07/17 07:04:25 UTC, 5 replies.
- [PR] [SPARK-XXXXX][SQL] Don't hold previous iterator reference after advancing to next file in ParquetPartitionReaderFactory [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/07/17 07:39:53 UTC, 0 replies.
- [PR] Add client env proto to spark connect client requests [spark] - posted by "garlandz-db (via GitHub)" <gi...@apache.org> on 2025/07/17 09:15:05 UTC, 0 replies.
- [PR] [SPARK-52839][PYTHON][CONNECT][TESTS] Enable Arrow aggregation tests in connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/17 09:29:28 UTC, 2 replies.
- [PR] [SPARK-52840][PYTHON][DOCS] Increase Pandas minimum version to 2.2.0 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/17 09:43:02 UTC, 3 replies.
- [PR] [WIP][SPARK-51169] Set up a daily job for Python 3.14 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/17 09:44:48 UTC, 1 replies.
- [PR] [SPARK-52832][CORE] Fix oracle dialect identifier quoting [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2025/07/17 10:41:56 UTC, 0 replies.
- [PR] [SPARK-52841][SQL] Fix PlanStabilitySuite id normalization [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/07/17 10:58:15 UTC, 1 replies.
- [PR] [SPARK-52764][PYTHON][ML][CONNECT][TESTS] Retry flaky tests in `test_parity_classification` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/17 12:29:01 UTC, 0 replies.
- [PR] Add withTiming utility to SQLMetrics [spark] - posted by "alekjarmov (via GitHub)" <gi...@apache.org> on 2025/07/17 12:51:11 UTC, 0 replies.
- [PR] [SPARK-52843][PYTHON][TESTS] Support retry timeout tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/17 13:04:11 UTC, 4 replies.
- Re: [PR] [SPARK-52449][CONNECT][PYTHON][ML] Make datatypes for Expression.Literal.Map/Array optional [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/07/17 13:40:06 UTC, 10 replies.
- Re: [PR] [SPARK-52841][SQL][TESTS] Fix PlanStabilitySuite id normalization [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/17 14:20:57 UTC, 12 replies.
- Re: [PR] [SPARK-52845][BUILD] Upgrade maven to 3.9.11 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/17 14:22:24 UTC, 1 replies.
- Re: [PR] [SPARK-52832][SQL] Fix oracle dialect identifier quoting [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/07/17 14:27:28 UTC, 2 replies.
- Re: [PR] [SPARK-52516][SQL] Don't hold previous iterator reference after advancing to next file in ParquetPartitionReaderFactory [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/17 14:56:31 UTC, 9 replies.
- [PR] [SPARK-52821] add int->DecimalType pyspark udf return type coercion [spark] - posted by "benrobby (via GitHub)" <gi...@apache.org> on 2025/07/17 15:01:35 UTC, 0 replies.
- [PR] [WIP][SQL] Avoid cast to Double in casting of TIME/TIMESTAMP to DECIMAL [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/17 16:28:12 UTC, 0 replies.
- [PR] [SPARK-52847] Add `ConstraintTests` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/17 16:30:59 UTC, 10 replies.
- Re: [PR] [SPARK-52842][SQL] New functionality and bugfixes for single-pass analyzer [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/07/17 17:04:47 UTC, 2 replies.
- Re: [PR] [SPARK-52171] [SS] StateDataSource join implementation for state v3 [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/07/17 17:50:57 UTC, 0 replies.
- [PR] [SPARK-52849][CORE] Add `stringifyException` to `o.a.s.util.Utils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/17 18:35:15 UTC, 3 replies.
- Re: [PR] [SPARK-52848][SQL] Avoid cast to `Double` in casting TIME/TIMESTAMP to DECIMAL [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/17 18:43:19 UTC, 12 replies.
- Re: [PR] [WIP][SPARK-52821][PYTHON] add int->DecimalType pyspark udf return type coercion [spark] - posted by "benrobby (via GitHub)" <gi...@apache.org> on 2025/07/17 19:16:02 UTC, 1 replies.
- [PR] [SPARK-52142][SQL] Display table constraints in SHOW CREATE TABLE COMMAND [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/07/17 20:10:15 UTC, 6 replies.
- Re: [PR] [SPARK-52833][SQL] Fix `VariantBuilder.appendFloat` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/17 22:01:24 UTC, 1 replies.
- [PR] [SPARK-52850][PYTHON] Skip calling conversions if identity function [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/07/17 22:30:19 UTC, 2 replies.
- Re: [PR] [MINOR][SQL][Test] Support V2 write schema evolution in InMemoryTable [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/07/17 23:31:41 UTC, 3 replies.
- Re: [PR] [SPARK-52832][SQL] Fix JDBC dialect identifier quoting [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2025/07/17 23:50:14 UTC, 5 replies.
- [PR] [WIP][SPARK-51415] Support the time type by make_timestamp() [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/18 00:06:19 UTC, 0 replies.
- [PR] [WIP] Spark 52432 session graph registry [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/07/18 00:06:23 UTC, 0 replies.
- [PR] [SPARK-52859] Add `SparkSystemUtils` trait [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/18 00:40:04 UTC, 13 replies.
- Re: [PR] [SPARK-52858][INFRA] Retry SBT compilation when OOM [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/18 01:19:09 UTC, 7 replies.
- [PR] [SPARK-52861][PYTHON] Skip Row object creation in Arrow-optimized UDTF execution [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/07/18 02:05:55 UTC, 4 replies.
- [PR] [WIP][SPARK-51554][SQL] Add the time_trunc() function [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/18 03:04:23 UTC, 0 replies.
- [PR] [SPARK-52862][PYTHON][CONNECT] Fix the nullability check of `Decimal('NaN')` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/18 03:43:42 UTC, 5 replies.
- [PR] [SPARK-51564] TIME literals in the 12hr clock format [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/18 03:46:53 UTC, 0 replies.
- [PR] [SPARK-52863][PYTHON] Clean up code paths for old pandas versions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/18 03:47:56 UTC, 3 replies.
- Re: [PR] [SPARK-51564] TIME parsing in the 12hr clock format [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/18 04:07:11 UTC, 8 replies.
- [PR] Keep coverage data when running pip tests [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2025/07/18 04:42:49 UTC, 0 replies.
- [PR] [WIP][SPARK-52621][SQL] Cast TIME to/from VARIANT [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/18 04:46:10 UTC, 0 replies.
- Re: [PR] [SPARK-52864] [CORE] [Tests] Let LocalSparkContext clear active context in beforeAll [spark] - posted by "price-qian (via GitHub)" <gi...@apache.org> on 2025/07/18 05:15:32 UTC, 0 replies.
- [PR] [SPARK-52865][SQL]Remove usage of deprecated FileCommitProtocol.newTaskTempFile method [spark] - posted by "morvenhuang (via GitHub)" <gi...@apache.org> on 2025/07/18 06:06:50 UTC, 0 replies.
- [PR] [WIP][SQL] Add support for `try_to_date` [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2025/07/18 06:50:50 UTC, 0 replies.
- Re: [PR] [SPARK-52866][SQL] Add support for `try_to_date` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/18 08:06:05 UTC, 6 replies.
- [PR] [SPARK-52867] Remove redundant GetTimestamp [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2025/07/18 08:34:04 UTC, 0 replies.
- Re: [PR] [SPARK-51554][SQL] Add the time_trunc() function [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/18 08:36:26 UTC, 46 replies.
- [PR] [SPARK-52868][SQL] CBO: OOM-risky stats underestimation for some filters and sources [spark] - posted by "akupchinskiy (via GitHub)" <gi...@apache.org> on 2025/07/18 11:51:43 UTC, 1 replies.
- [PR] [SPARK-52869][SQL] Add FrameLessOffsetWindowFunction validation to validateResolvedWindowExpression for reuse in single-pass analyzer [spark] - posted by "nikola-jovicevic-db (via GitHub)" <gi...@apache.org> on 2025/07/18 12:36:58 UTC, 3 replies.
- [PR] [SPARK-52870] Properly quote variable names in FOR statement [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2025/07/18 12:43:19 UTC, 10 replies.
- [PR] [SPARK-52448][CONNECT] Add simplified Struct Expression.Literal [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/07/18 14:26:16 UTC, 13 replies.
- Re: [PR] [SPARK-51562][SQL] Add `time` function [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/18 14:41:18 UTC, 2 replies.
- Re: [PR] [SPARK-49968][SQL] The split function produces incorrect results with an empty regex and a limit [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2025/07/18 15:27:02 UTC, 10 replies.
- [PR] [SPARK-52871][CORE] Merge `o.a.s.sql.catalyst.util.SparkStringUtils` to `o.a.s.util.SparkStringUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/18 16:00:19 UTC, 0 replies.
- Re: [PR] [SPARK-52432][SDP][SQL] Scope DataflowGraphRegistry to Session [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/07/18 16:34:48 UTC, 3 replies.
- Re: [PR] [SPARK-52871][SQL] Merge `o.a.s.sql.catalyst.util.SparkStringUtils` to `o.a.s.util.SparkStringUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/18 16:40:45 UTC, 6 replies.
- Re: [PR] [SPARK-52846][SQL] Add a metric in JDBCRDD for how long it takes to fetch the resultset [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/07/18 16:46:38 UTC, 8 replies.
- [PR] [SPARK-52714] Remove public APIs for append once flows [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/07/18 18:07:18 UTC, 0 replies.
- [PR] [SPARK-52872][SQL][TESTS] Improve test coverage for `HigherOrderFunctions` [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/07/18 18:08:41 UTC, 3 replies.
- [PR] [SPARK-51596][SS] Fix concurrent StateStoreProvider maintenance and closing [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/07/18 18:25:21 UTC, 2 replies.
- Re: [PR] [SPARK-52851] Remove public APIs for append once flows [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/07/18 18:29:40 UTC, 0 replies.
- [PR] [SPARK-51955] Adding release() to ReadStateStore interface and reusing ReadStore for Streaming Aggregations [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/07/18 18:47:57 UTC, 2 replies.
- [PR] [SPARK-52874][CORE] Add `o.a.s.util.Pair` Java Record [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/18 19:30:26 UTC, 0 replies.
- Re: [PR] [SPARK-52874][CORE] Support `o.a.s.util.Pair` Java Record [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/18 21:39:31 UTC, 6 replies.
- [PR] [SPARK-52875][SQL] Simplify V2 expression translation if the input is context-independent-foldable [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/07/18 21:59:15 UTC, 5 replies.
- Re: [PR] [SPARK-52439][SQL] Support creating check constraint with NULL [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/07/18 21:59:44 UTC, 0 replies.
- [PR] [SPARK-52876][CORE] Fix a typo `buffer` to `body` in `ChunkFetchSuccess.toString` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/18 22:50:13 UTC, 4 replies.
- Re: [PR] [SPARK-52817][SQL] Fix `Like` Expression performance [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2025/07/19 00:07:22 UTC, 1 replies.
- Re: [PR] [SPARK-51713][PYTHON] Add column pruning API to Python Data Sources [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/19 00:29:56 UTC, 1 replies.
- [I] انستقرام [spark-connect-go] - posted by "ahmedayoub200439-cmd (via GitHub)" <gi...@apache.org> on 2025/07/19 05:54:54 UTC, 1 replies.
- Re: [PR] [SPARK-52621][SQL] Cast TIME to/from VARIANT [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/19 08:21:31 UTC, 5 replies.
- [PR] added the file in readme [spark] - posted by "umeshlingayat326 (via GitHub)" <gi...@apache.org> on 2025/07/19 13:04:39 UTC, 1 replies.
- [PR] [SPARK-52880][CORE] Improve `toString` by JEP-280 instead of `ToStringBuilder` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/19 13:53:18 UTC, 0 replies.
- Re: [PR] [SPARK-52880][CORE] Improve `toString` by `JEP-280` instead of `ToStringBuilder` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/19 15:19:05 UTC, 19 replies.
- [PR] [WIP][SPARK-52881] Implement the make_time function in Scala [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/19 21:51:29 UTC, 0 replies.
- [PR] [WIP][SPARK-52882] Implement the current_time function in Scala [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/19 21:53:06 UTC, 0 replies.
- [PR] [WIP][SPARK-52883][SPARK-52884] Implement the to_time and try_to_time functions in Scala [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/19 21:54:56 UTC, 0 replies.
- [PR] [WIP][SPARK-52885][SPARK-52886][SPARK-52887] Implement the hour, minute, and second functions in Scala [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/19 21:57:32 UTC, 0 replies.
- Re: [PR] [SPARK-51692][SQL]Fix bug while replace cte ref which contains dynamicpruning [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/20 00:34:15 UTC, 1 replies.
- Re: [PR] [SPARK-51644][BUILD][CONNECT] fix for spark shells [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/20 00:34:17 UTC, 1 replies.
- Re: [PR] [SPARK-52885][SPARK-52886][SPARK-52887][SQL] Implement the hour, minute, and second functions in Scala for the TIME type [spark] - posted by "ShreyeshArangath (via GitHub)" <gi...@apache.org> on 2025/07/20 06:21:13 UTC, 13 replies.
- [PR] [SPARK-52141][SQL] Display constraints in DESC commands [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2025/07/20 08:06:05 UTC, 13 replies.
- [PR] [MINOR] Remove unnecessary df.show() in tests [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2025/07/20 08:17:17 UTC, 2 replies.
- Re: [PR] [SPARK-52883][SPARK-52884][SQL] Implement the to_time and try_to_time functions in Scala [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/20 08:25:29 UTC, 18 replies.
- Re: [PR] [SPARK-52882][SQL] Implement the current_time function in Scala [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/20 10:10:39 UTC, 7 replies.
- Re: [PR] [SPARK-52881][SQL] Implement the make_time function in Scala [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/20 10:10:49 UTC, 3 replies.
- Re: [PR] [SPARK-52821][PYTHON] add int->DecimalType pyspark udf return type coercion [spark] - posted by "benrobby (via GitHub)" <gi...@apache.org> on 2025/07/20 11:50:39 UTC, 2 replies.
- [PR] [SPARK-XXXX][PYTHON] Update `pandas` to 2.3.1 [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2025/07/20 12:12:38 UTC, 0 replies.
- Re: [PR] [SPARK-52897[PYTHON] Update `pandas` to 2.3.1 [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2025/07/20 13:17:24 UTC, 4 replies.
- [PR] [WIP][SPARK-52898][SQL] Support TIME addition [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/20 13:41:35 UTC, 0 replies.
- [PR] [SPARK-52899][SQL] Fix QueryExecutionErrorsSuite test to register H2Dialect back [spark] - posted by "PetarVasiljevic-DB (via GitHub)" <gi...@apache.org> on 2025/07/20 14:17:43 UTC, 4 replies.
- [PR] [WIP][SPARK-52888][PYTHON] Implement the make_time function in PySpark [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/20 15:10:38 UTC, 0 replies.
- Re: [PR] [SPARK-52800][SQL][K8S] Remove several deprecated commons-lang3 methods [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/20 15:30:38 UTC, 2 replies.
- Re: [PR] [SPARK-52898][SQL] Support TIME addition [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/20 15:56:04 UTC, 4 replies.
- [PR] [DRAFT][DO-NOT-REVIEW][SPARK-51XXX][SQL] Enable implicit cast from STRING to TIME type [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/20 22:48:22 UTC, 1 replies.
- [PR] [DRAFT][SPARK-52888][PYTHON] Implement the current_time function in PySpark [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/20 23:03:30 UTC, 0 replies.
- [PR] [DRAFT][SPARK-52888][PYTHON] Implement the to_time and try_to_time functions in PySpark [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/20 23:05:59 UTC, 0 replies.
- [PR] [DRAFT][SPARK-52892][PYTHON] Implement the hour, minute, and second functions in PySpark [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/20 23:08:40 UTC, 0 replies.
- [PR] [SPARK-52900][CORE] Use `SparkStringUtils.stringToSeq` in `FsHistoryProvider` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/21 00:48:13 UTC, 4 replies.
- [PR] [SPARK-52901][SQL][K8S] Fix deprecated nested class shadowing warnings [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/21 01:55:46 UTC, 3 replies.
- [PR] Update README.md [spark] - posted by "738225606 (via GitHub)" <gi...@apache.org> on 2025/07/21 02:28:06 UTC, 1 replies.
- Re: [PR] [SPARK-52895][SQL] Don't add duplicate elements in `resolveExprsWithAggregate` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/07/21 02:41:46 UTC, 3 replies.
- Re: [PR] [SPARK-52486][SQL] Fix Spark Driver Planning OOM issue due to unworthwhile dpp expression before Execution when enabling AQE [spark] - posted by "zhixingheyi-tian (via GitHub)" <gi...@apache.org> on 2025/07/21 03:20:51 UTC, 0 replies.
- Re: [PR] [SPARK-52767][SQL] Optimize the performance of maxRows for join and union [spark] - posted by "JacobZheng0927 (via GitHub)" <gi...@apache.org> on 2025/07/21 04:03:45 UTC, 3 replies.
- Re: [PR] [SPARK-52877][PYTHON] Improve Python UDF Arrow Serializer Performance [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/21 04:50:35 UTC, 7 replies.
- [PR] [SPARK-52853][SDP] Prevent imperative conf set in declarative pipelines [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/07/21 05:55:07 UTC, 2 replies.
- Re: [PR] [SPARK-52407][SQL] Add support for Theta Sketch [spark] - posted by "cboumalh (via GitHub)" <gi...@apache.org> on 2025/07/21 05:57:01 UTC, 12 replies.
- [PR] [SPARK-52903][SQL] Trim non-top-level aliases before LCA resolution [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/07/21 07:53:41 UTC, 9 replies.
- [PR] [SPARK-52902][K8S] K8s image configs support `{{SPARK_VERSION}}` placeholder [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/07/21 08:01:58 UTC, 1 replies.
- [PR] [SPARK-52905][PYTHON] Arrow UDF for window [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/21 08:36:20 UTC, 7 replies.
- [PR] Support join for postgres [spark] - posted by "PetarVasiljevic-DB (via GitHub)" <gi...@apache.org> on 2025/07/21 09:08:14 UTC, 0 replies.
- [PR] [SPARK-52908][Core] Prevent for iterator variable name clashing with names of labels in the path to the root of AST [spark] - posted by "TeodorDjelic (via GitHub)" <gi...@apache.org> on 2025/07/21 10:29:57 UTC, 16 replies.
- Re: [PR] [SPARK-52896][SQL] Match attribute `ExprId` in `OuterReference` with `ExprId` of exposed outer attribute [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/07/21 10:35:52 UTC, 4 replies.
- Re: [PR] [SPARK-52870][SQL] Properly quote variable names in `FOR` statement [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/07/21 10:48:34 UTC, 1 replies.
- Re: [PR] [SPARK-52424][TESTS] Add unit test to verify in Spark Connect, Column object defined outside of a function can be referenced properly. [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/07/21 10:59:14 UTC, 1 replies.
- Re: [PR] [SPARK-51400] Replace ArrayContains nodes to InSet [spark] - posted by "adrians (via GitHub)" <gi...@apache.org> on 2025/07/21 11:36:37 UTC, 5 replies.
- [PR] [WIP][SPARK-52904][PYTHON] enable convertToArrowArraySafely by default [spark] - posted by "benrobby (via GitHub)" <gi...@apache.org> on 2025/07/21 12:08:39 UTC, 0 replies.
- Re: [PR] [SPARK-48230][BUILD] Remove unused `jodd-core` [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/07/21 13:16:58 UTC, 6 replies.
- [PR] [SPARK-52909][SQL] Enable ANSI mode in JDBCV2JoinPushdownSuite [spark] - posted by "PetarVasiljevic-DB (via GitHub)" <gi...@apache.org> on 2025/07/21 14:22:38 UTC, 2 replies.
- [PR] [SPARK-52804][BUILD][FOLLOWUP] Revert Java minimum version check for Maven [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/21 14:54:00 UTC, 10 replies.
- [PR] [SPARK-52910] Remove the explicit specification of `-Djava.version` in the `maven_test.yml` file [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/21 15:29:51 UTC, 1 replies.
- [PR] [SPARK-52910] Remove the explicit specification of `-Djava.version` in the `maven_test.yml` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/21 15:31:28 UTC, 0 replies.
- Re: [PR] [SPARK-52910][INFRA] Remove the explicit specification of `-Djava.version` from `maven_test.yml` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/21 15:49:51 UTC, 7 replies.
- Re: [PR] [SPARK-52902][K8S] Support `SPARK_VERSION` placeholder in container image names [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/21 15:54:05 UTC, 1 replies.
- Re: [PR] [SPARK-51415][SQL] Support the time type by make_timestamp() [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/07/21 16:03:47 UTC, 27 replies.
- [PR] Test default as 17.0.16 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/21 17:05:36 UTC, 1 replies.
- Re: [PR] [SPARK-52851][SDP] Remove public APIs for append once flows [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/07/21 17:27:52 UTC, 2 replies.
- [PR] [SPARK-52911][SQL] Remove `StringUtils.(split|chop)` usage [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/21 17:47:22 UTC, 11 replies.
- Re: [PR] [SPARK-52771][PS] Fix float32 type widening in `truediv`/`floordiv` [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/07/21 18:06:27 UTC, 2 replies.
- [PR] [SPARK-52912][CORE] Improve `SparkStringUtils` to support `is(Not)?(Blank|Empty)` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/21 19:11:34 UTC, 4 replies.
- Re: [PR] [SPARK-52910][BUILD][INFRA] Standardize Java version configuration by replacing `java.version` with `maven.compiler.release` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/21 20:38:45 UTC, 9 replies.
- [PR] [SPARK-52913] Upgrade `grpc-swift-2` to 2.1.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/21 20:52:27 UTC, 1 replies.
- Re: [PR] [SPARK-52853][SDP] Prevent imperative PySpark methods in declarative pipelines [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/07/21 21:51:35 UTC, 7 replies.
- [PR] [SPARK-52914][CORE] Support `On-Demand Log Loading` in `History Server` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/21 22:14:12 UTC, 15 replies.
- [PR] Bump form-data from 4.0.0 to 4.0.4 in /ui-test [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/07/21 23:05:12 UTC, 2 replies.
- [PR] [SPARK-52829][PYTHON][FOLLOWUP] Remove unnecessary special handling [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/07/21 23:44:46 UTC, 2 replies.
- [PR] [SPARK-52852][SDP] Remove unused spark_conf in create_streaming_table [spark] - posted by "JiaqiWang18 (via GitHub)" <gi...@apache.org> on 2025/07/22 00:19:04 UTC, 3 replies.
- [PR] [SPARK-51505][SQL] Always show empty partition number metrics in AQEShuffleReadExec [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2025/07/22 01:03:34 UTC, 6 replies.
- [PR] [SPARK-50614][FOLLOW-UP] Fix bug where shredded timestamp values did not conform to the Parquet Variant Shredding spec [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2025/07/22 01:18:00 UTC, 6 replies.
- [PR] [SPARK-52915] Support TTL for Spark apps [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/07/22 01:37:31 UTC, 7 replies.
- Re: [PR] [SPARK-52791][PS] Fix error when inferring a UDT with a null first element [spark] - posted by "petern48 (via GitHub)" <gi...@apache.org> on 2025/07/22 04:48:49 UTC, 6 replies.
- Re: [PR] [SPARK-52788][SQL][4.0] Fix error of converting binary value in BinaryType to XML [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/22 05:07:26 UTC, 1 replies.
- [PR] [SPARK-52424][TESTS] Drop table created in PySpark test_streaming_foreach_batch_external_column. [spark] - posted by "haoyangeng-db (via GitHub)" <gi...@apache.org> on 2025/07/22 05:44:36 UTC, 4 replies.
- Re: [PR] [SPARK-52837][CONNECT][PYTHON] Support TimeType literal in pyspark [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2025/07/22 06:46:35 UTC, 5 replies.
- [PR] [SPARK-5230][TEST] Fix invalid AnalysisConfOverrideSuite [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/07/22 07:07:04 UTC, 2 replies.
- Re: [PR] [SPARK-5230][SQL][TEST] Fix invalid AnalysisConfOverrideSuite [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/07/22 07:13:50 UTC, 2 replies.
- [PR] [SPARK-52916][BUILD] Exclude slf4j-simple from SBT [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/07/22 07:23:55 UTC, 4 replies.
- [PR] [SPARK-52917][SQL] Read support to enable round-trip for binary in xml format [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/22 07:40:23 UTC, 3 replies.
- [PR] [SPARK-52819] Making KryoSerializationCodec serializable to fix java.io.NotSerializableException errors in various use cases [spark] - posted by "Kontinuation (via GitHub)" <gi...@apache.org> on 2025/07/22 07:49:55 UTC, 0 replies.
- Re: [PR] [SPARK-52819][SQL] Making KryoSerializationCodec serializable to fix java.io.NotSerializableException errors in various use cases [spark] - posted by "Kontinuation (via GitHub)" <gi...@apache.org> on 2025/07/22 08:23:06 UTC, 0 replies.
- [PR] Batch JDBC database statements in JDBC suites [spark] - posted by "alekjarmov (via GitHub)" <gi...@apache.org> on 2025/07/22 09:18:35 UTC, 0 replies.
- Re: [PR] [SQL][SPARK-52918] Batch JDBC database statements in JDBC suites [spark] - posted by "alekjarmov (via GitHub)" <gi...@apache.org> on 2025/07/22 09:27:01 UTC, 1 replies.
- Re: [PR] [SPARK-52860][SQL][Test] Support V2 write schema evolution in InMemoryTable [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/07/22 11:35:04 UTC, 2 replies.
- [PR] [SPARK-52866][SQL][4.0] Fix error message for `to_date` [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2025/07/22 11:51:04 UTC, 5 replies.
- Re: [PR] [SPARK-52906 ][SQL] Support DSv2 Join pushdown for Postgres connector [spark] - posted by "PetarVasiljevic-DB (via GitHub)" <gi...@apache.org> on 2025/07/22 12:11:49 UTC, 5 replies.
- Re: [PR] [SQL][TESTS][SPARK-52918] Batch JDBC database statements in JDBC suites [spark] - posted by "PetarVasiljevic-DB (via GitHub)" <gi...@apache.org> on 2025/07/22 12:30:53 UTC, 15 replies.
- [PR] [MINOR][SQL] Return correct error message for anchor self references in rCTEs [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/07/22 13:45:14 UTC, 3 replies.
- [PR] [SPARK-52832] Fix comment in MySQLDialect::quoteIdentifier [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2025/07/22 13:54:52 UTC, 0 replies.
- Re: [PR] [SPARK-52327][Core] Glob based provider for history server [spark] - posted by "GauravWaghmare (via GitHub)" <gi...@apache.org> on 2025/07/22 15:19:34 UTC, 0 replies.
- [I] CreateDataFrameFromArrow Only Reads First Row from Multi-Row Arrow Tables [spark-connect-go] - posted by "caldempsey (via GitHub)" <gi...@apache.org> on 2025/07/22 15:50:35 UTC, 2 replies.
- Re: [PR] [SPARK-51554][SQL] Add the time_trunc() function for TIME datatype [spark] - posted by "the-sakthi (via GitHub)" <gi...@apache.org> on 2025/07/22 18:02:50 UTC, 0 replies.
- Re: [PR] [SPARK-52646][PS] Avoid CAST_INVALID_INPUT of `__eq__` in ANSI mode [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/07/22 18:18:35 UTC, 11 replies.
- Re: [PR] [SPARK-52832][SQL][FOLLOWUP] Fix comment in `MySQLDialect::quoteIdentifier` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/22 19:40:30 UTC, 2 replies.
- Re: [PR] [SPARK-52914][CORE] Support `On-Demand Log Loading` for rolling logs in `History Server` [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/07/22 20:04:32 UTC, 64 replies.
- [PR] [SPARK-51920][SS][PYTHON] Fix composite/nested type in value state for python [spark] - posted by "zeruibao (via GitHub)" <gi...@apache.org> on 2025/07/22 21:11:54 UTC, 0 replies.
- [PR] [SPARK-52919] Fix DSv2 Join pushdown to use previously aliased column [spark] - posted by "PetarVasiljevic-DB (via GitHub)" <gi...@apache.org> on 2025/07/22 21:23:14 UTC, 0 replies.
- [PR] [SPARK-XXXXX][SQL] Specify outputPartitioning for UnionExec for partitioner aware case [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/07/22 21:34:44 UTC, 9 replies.
- [PR] [SPARK-52920][DOCS] Improve memory profiler doc to clarify generator UDFs are unsupported [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/07/22 22:03:36 UTC, 2 replies.
- [PR] [SPARK-52147][SQL][TESTS] Block temporary object references in persistent SQL UDFs [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/07/22 22:44:56 UTC, 3 replies.
- [PR] [SPARK-52146][SQL] Detect cyclic function references in SQL UDFs [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/07/23 00:27:25 UTC, 11 replies.
- Re: [PR] [Core]Convert shuffleWriteTime from Nanoseconds to Milliseconds for Consistency with Other Metrics [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/23 00:30:59 UTC, 1 replies.
- [PR] [WIP] Avoid CAST_INVALID_INPUT of "astype" in ANSI mode [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/07/23 00:58:18 UTC, 0 replies.
- Re: [PR] [SPARK-52300][SQL][TEST] Fix invalid AnalysisConfOverrideSuite [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/07/23 03:04:03 UTC, 2 replies.
- Re: [PR] [SPARK-47547][CORE] BloomFilter fpp degradation [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/23 04:22:00 UTC, 0 replies.
- Re: [PR] [SPARK-47547][CORE] Add `BloomFilter` V2 and use it as default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/23 04:25:13 UTC, 7 replies.
- Re: [PR] [SPARK-52921][SQL] Specify outputPartitioning for UnionExec for partitioner aware case [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/07/23 06:41:58 UTC, 23 replies.
- [PR] [SPARK-52686][SQL][FOLLOWUP] Don't push `Project` through `Union` if there are duplicates in the project list [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/07/23 06:45:02 UTC, 2 replies.
- [PR] [SPARK-52923] Allow ShuffleManager to control push merge during shuffle registration [spark] - posted by "gaoyajun02 (via GitHub)" <gi...@apache.org> on 2025/07/23 06:45:08 UTC, 0 replies.
- Re: [PR] [SPARK-52923][CORE] Allow ShuffleManager to control push merge during shuffle registration [spark] - posted by "gaoyajun02 (via GitHub)" <gi...@apache.org> on 2025/07/23 07:07:03 UTC, 0 replies.
- Re: [PR] [SPARK-52925][SQL] Return correct error message for anchor self references in rCTEs [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/07/23 07:30:25 UTC, 2 replies.
- [PR] [SPARK-52924][CORE] Support ZSTD_strategy for compression [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/23 07:47:13 UTC, 4 replies.
- [PR] [SPARK-52680][DOCS][FOLLOW-UP] Update migration guide about Python 3.9 dropped [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/23 08:56:05 UTC, 2 replies.
- Re: [PR] [SPARK-52919][SQL] Fix DSv2 Join pushdown to use previously aliased column [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/07/23 09:12:46 UTC, 1 replies.
- [PR] [SPARK-52927][PYTHON][INFRA] Upgrade pyarrow to 15.0 in image `python-minimum` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/23 09:39:57 UTC, 1 replies.
- [PR] [SPARK-52926] Added SQLMetric for remote schema fetching time duration. [spark] - posted by "vanja-vujovic-db (via GitHub)" <gi...@apache.org> on 2025/07/23 11:37:49 UTC, 3 replies.
- Re: [PR] [SPARK-52904][PYTHON] Enable convertToArrowArraySafely by default [spark] - posted by "benrobby (via GitHub)" <gi...@apache.org> on 2025/07/23 12:19:22 UTC, 7 replies.
- [PR] [SPARK-52903][SQL][FOLLOWUP] Fix query failure with LCAs on structs [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/07/23 14:01:51 UTC, 2 replies.
- [PR] [WIP] Enable arrow_cast for all pandas UDF eval types [spark] - posted by "benrobby (via GitHub)" <gi...@apache.org> on 2025/07/23 14:03:30 UTC, 0 replies.
- [PR] [SPARK-52844][PYTHON][TESTS] Update Python test dependencies [spark] - posted by "eschcam (via GitHub)" <gi...@apache.org> on 2025/07/23 14:13:34 UTC, 8 replies.
- [PR] [SPARK-52929][SQL] Support MySQL and SQLServer connector for DSv2 Join pushdown [spark] - posted by "PetarVasiljevic-DB (via GitHub)" <gi...@apache.org> on 2025/07/23 14:35:09 UTC, 2 replies.
- Re: [PR] [SPARK-52561][DOCS][FOLLOW-UP] Update migration guide about Python 3.9 dropped [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/23 14:54:26 UTC, 0 replies.
- [PR] [SPARK-50889][CONNECT][TESTS] Fix Flaky Test: `SparkSessionE2ESuite.interrupt operation` (Hang) [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/07/23 15:23:23 UTC, 11 replies.
- Re: [PR] [SPARK-52837][CONNECT][PYTHON] Support TimeType in pyspark [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2025/07/23 15:28:35 UTC, 2 replies.
- [PR] [SPARK-52931][Core] Restrict declare variable naming [spark] - posted by "TeodorDjelic (via GitHub)" <gi...@apache.org> on 2025/07/23 16:44:11 UTC, 11 replies.
- Re: [PR] [SPARK-51756][CORE] Computes RowBasedChecksum in ShuffleWriters [spark] - posted by "attilapiros (via GitHub)" <gi...@apache.org> on 2025/07/23 20:12:11 UTC, 1 replies.
- Re: [PR] [SPARK-52897][PYTHON] Update `pandas` to 2.3.1 [spark] - posted by "the-sakthi (via GitHub)" <gi...@apache.org> on 2025/07/23 20:51:56 UTC, 2 replies.
- Re: [I] CreateDataFrameFromArrow Only Reads First Record from Multi-Record Arrow Tables (3 rows 3 records -> 1 row in df.Show()) [spark-connect-go] - posted by "caldempsey (via GitHub)" <gi...@apache.org> on 2025/07/23 21:00:05 UTC, 0 replies.
- [I] CreateDataFrameFromArrow reads every batch from Parquet but only the first batch from ND‑JSON unless JSON is loaded with WithChunk(-1) [spark-connect-go] - posted by "caldempsey (via GitHub)" <gi...@apache.org> on 2025/07/23 21:03:52 UTC, 0 replies.
- Re: [PR] WIP [SPARK-52146][SQL] Detect cyclic function references in SQL UDFs [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/07/23 21:36:52 UTC, 0 replies.
- [PR] [SPARK-52934][PYTHON] Allow yielding scalar values with Arrow-optimized Python UDTF [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/07/24 00:31:33 UTC, 2 replies.
- [PR] [SPARK-50614][FOLLOW-UP] Add assert(false) to test in catch block [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2025/07/24 02:10:15 UTC, 5 replies.
- [PR] [SPARK-52935][PYTHON][CONNECT][TESTS] Enable Arrow window tests in connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/24 02:27:09 UTC, 2 replies.
- Re: [PR] [SPARK-52926][SQL] Added SQLMetric for remote schema fetching time duration. [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/07/24 02:28:48 UTC, 40 replies.
- [PR] [SPARK-52936][INFRA][TESTS] Benchmark result update automation [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/24 03:01:11 UTC, 9 replies.
- [PR] Sinks [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/07/24 03:48:45 UTC, 0 replies.
- [PR] [SPARK-7008][INFRA][PS] Upgrade pyarrow to 15.0 in image python-ps-minimum [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/24 04:02:37 UTC, 2 replies.
- [PR] [SPARK-52928][PYTHON][INFRA] Upgrade the minimum version of pyarrow to 15.0.0 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/24 05:23:47 UTC, 4 replies.
- [PR] [SPARK-52939][TESTS] Add unit tests for ArrowWriter with User Defined Type [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/24 05:40:50 UTC, 2 replies.
- [PR] [SPARK-52905][PYTHON][FOLLOW-UP] ArrowWindowPythonExec code clean up [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/24 06:32:01 UTC, 5 replies.
- [PR] [SPARK-52940][PYTHON][TESTS] Add arrow udf unit tests for complex return types [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/24 07:33:41 UTC, 0 replies.
- [PR] [SPARK-5294][YARN][BUILD] YARN External Shuffle Service jar should include `scala-library` [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/07/24 11:00:17 UTC, 4 replies.
- [PR] [SPARK-52875][SQL][TESTS][FOLLOWUP] Make `Partial constant folding of math functions` use `spark.sql.ansi.enabled=true` for testing by default [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/24 11:49:02 UTC, 1 replies.
- [PR] [SPARK-52875][SQL][TESTS][FOLLOWUP] Test `Partial constant folding of math functions` only when `ansiEnabled` is `true` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/24 12:16:01 UTC, 2 replies.
- Re: [PR] [SPARK-52942][YARN][BUILD] YARN External Shuffle Service jar should include `scala-library` [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/07/24 15:14:09 UTC, 13 replies.
- [PR] [SPARK-52930] Use DataType.Array/Map for Array/Map Literals [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/07/24 15:32:12 UTC, 0 replies.
- [PR] Fix invalid assertions in test cases [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/24 16:40:35 UTC, 0 replies.
- Re: [PR] [SPARK-52940][PYTHON][TESTS] Add arrow aggregation unit tests for complex return types [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/07/24 18:08:59 UTC, 2 replies.
- Re: [PR] [SPARK-52930][CONNECT] Use DataType.Array/Map for Array/Map Literals [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/07/24 19:14:35 UTC, 0 replies.
- Re: [I] BEWARE, DATA LOSS: CreateDataFrameFromArrow reads every batch from Parquet but only the first batch from ND‑JSON unless JSON is loaded with WithChunk(-1) [spark-connect-go] - posted by "zeroshade (via GitHub)" <gi...@apache.org> on 2025/07/24 20:05:35 UTC, 1 replies.
- [PR] [SPARK-52946][PYTHON] Fix Arrow-optimized Python UDTF to support large var types [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/07/24 21:11:31 UTC, 2 replies.
- Re: [PR] [SPARK-52922][PS] Avoid CAST_INVALID_INPUT of "astype" in ANSI mode [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/07/24 21:49:52 UTC, 5 replies.
- [PR] [WIP] Enable test_np_spark_compat_frame under ANSI [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/07/24 22:18:19 UTC, 0 replies.
- [PR] [SPARK-52947][SDP] Fix image path in declarative pipelines programming guide [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/07/24 22:39:52 UTC, 2 replies.
- Re: [PR] [SPARK-52580][PS] Avoid CAST_INVALID_INPUT of `replace` in ANSI mode [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/07/24 22:49:08 UTC, 7 replies.
- [PR] V3.5.6 lyft [spark] - posted by "anuvedverma (via GitHub)" <gi...@apache.org> on 2025/07/24 23:02:21 UTC, 1 replies.
- [PR] [SPARK-52949][PYTHON] Avoid roundtrip between RecordBatch and Table in Arrow-optimized Python UDTF [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/07/24 23:48:37 UTC, 2 replies.
- Re: [PR] [SPARK-51796] [SQL] Disallow Sort order expressions under non-Sort operators [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/25 00:31:01 UTC, 1 replies.
- Re: [PR] [SPARK-51568][SQL] Introduce isSupportedExtract to prevent happening unexpected behavior [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/25 00:31:04 UTC, 1 replies.
- Re: [PR] [SPARK-52948][PS] Enable test_np_spark_compat_frame under ANSI [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/07/25 00:32:54 UTC, 2 replies.
- Re: [PR] [SPARK-52593][PS] Avoid CAST_INVALID_INPUT of `Series.dot` and `DataFrame.dot` in ANSI mode [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/07/25 00:35:46 UTC, 1 replies.
- [PR] [SPARK-52950][SQL][TESTS] Enable ANSI mode in DataSourceV2StrategySuite [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/07/25 01:39:20 UTC, 4 replies.
- [PR] [SPARK-52877][PYTHON][FOLLOW-UP] Use columns instead of itercolumns in RecordBatch [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/07/25 01:50:52 UTC, 3 replies.
- [PR] [SPARK-52840][PYTHON][DOCS][FOLLOW-UP] Increase Pandas minimum version to 2.2.0 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/25 02:40:12 UTC, 2 replies.
- [PR] [SPARK-52952][PYTHON] Add PySpark UDF Type Coercion Dev Script [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/07/25 05:00:41 UTC, 9 replies.
- [PR] [SPARK-52953][SQL] Incorrect parameter order in some ExpressionEvalHelper.checkResult() method invocations [spark] - posted by "morvenhuang (via GitHub)" <gi...@apache.org> on 2025/07/25 07:43:16 UTC, 0 replies.
- [PR] [SPARK-52954][PYTHON] Arrow UDF support return type coercion [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/25 07:43:36 UTC, 2 replies.
- [PR] Initial commit. [spark] - posted by "nikola-jovicevic-db (via GitHub)" <gi...@apache.org> on 2025/07/25 10:35:28 UTC, 0 replies.
- [PR] [SPARK-52956] Preserve alias metadata when collapsing projects [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/07/25 11:04:23 UTC, 0 replies.
- Re: [PR] Increase report interval of spaming logs to 10 seconds [spark] - posted by "Avihais12344 (via GitHub)" <gi...@apache.org> on 2025/07/25 11:23:09 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-52943][PYTHON] Enable arrow_cast for all pandas UDF eval types [spark] - posted by "benrobby (via GitHub)" <gi...@apache.org> on 2025/07/25 13:17:24 UTC, 0 replies.
- Re: [PR] [SPARK-52944][CORE][SQL][YARN] Fix invalid assertions in tests [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/25 13:51:34 UTC, 4 replies.
- Re: [PR] [SPARK-52875][SQL][TESTS][FOLLOWUP] Override the `sparkConf` for `DataSourceV2StrategySuite` to ensure that `ANSI_ENABLED` is set to true. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/25 14:10:25 UTC, 1 replies.
- Re: [PR] [SPARK-52955] Change return types of WindowResolution.resolveOrder and WindowResolution.resolveFrame to WindowExpression [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/07/25 14:12:57 UTC, 1 replies.
- Re: [PR] [SPARK-41166][SQL][TESTS] Check errorSubClass of DataTypeMismatch in *ExpressionSuites [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/25 15:55:57 UTC, 0 replies.
- Re: [PR] [SPARK-52943][PYTHON] Enable arrow_cast for all pandas UDF eval types [spark] - posted by "benrobby (via GitHub)" <gi...@apache.org> on 2025/07/25 16:16:51 UTC, 1 replies.
- [PR] [SPARK-52945][SQL][TESTS] Fix the assertions in `checkInvalidCastFromNumericType` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/25 16:27:06 UTC, 2 replies.
- [PR] [WIP] Exclude pandas numpy operand in __eq__ [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/07/25 20:02:08 UTC, 0 replies.
- Re: [PR] [SPARK-50748][SPARK-50889][CONNECT] Fix a race condition issue which happens when operations are interrupted [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/07/25 20:14:22 UTC, 1 replies.
- [PR] [SPARK-50748][SPARK-50889][CONNECT][4.0] Fix a race condition issue which happens when operations are interrupted [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/07/25 20:21:44 UTC, 4 replies.
- Re: [PR] [SPARK-52956][SQL] Preserve alias metadata when collapsing projects [spark] - posted by "violetnspct (via GitHub)" <gi...@apache.org> on 2025/07/25 21:35:12 UTC, 8 replies.
- [PR] [SPARK-52961][PYTHON] Fix Arrow-optimized Python UDTF with 0-arg eval on lateral join [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/07/25 23:41:27 UTC, 2 replies.
- Re: [PR] [SPARK-51149][CORE] Log classpath in SparkSubmit on ClassNotFoundException [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/26 00:29:44 UTC, 1 replies.
- Re: [PR] [SPARK-50639][SQL] Improve warning logging in CacheManager [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/26 00:29:45 UTC, 1 replies.
- [PR] [SPARK-XXXXX][SQL] BroadcastExchangeExec should not reset metrics [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/07/26 00:45:07 UTC, 0 replies.
- [PR] [SPARK-52960][SQL] Show subtree string in LogicalQueryStage toString [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2025/07/26 02:50:00 UTC, 5 replies.
- Re: [PR] [SPARK-52941] Make GitHub Actions work for spark-connect-rust [spark-connect-rust] - posted by "xuanyuanking (via GitHub)" <gi...@apache.org> on 2025/07/26 09:45:35 UTC, 0 replies.
- Re: [PR] [SPARK-52945][SQL][TESTS] Split `CastSuiteBase#checkInvalidCastFromNumericType` into three methods and guarantee assertions are valid [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/26 14:05:17 UTC, 3 replies.
- [PR] [SPARK-52944][CORE][TESTS] Avoid hard-coding the checksum algorithm name [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/26 14:18:58 UTC, 1 replies.
- [PR] [SPARK-52964] Add `merge_connect_rust_pr.py` and `PULL_REQUEST_TEMPLATE` [spark-connect-rust] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/07/26 15:31:57 UTC, 0 replies.
- Re: [PR] [SPARK-52962][SQL] BroadcastExchangeExec should not reset metrics [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/07/26 16:11:51 UTC, 1 replies.
- Re: [PR] [SPARK-52921][SQL] Specify outputPartitioning for UnionExec for same output partitoning as children operators [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/07/26 20:55:13 UTC, 9 replies.
- [PR] [SPARK-52967][BUILD] Upgrade ORC to 2.2.0 [spark] - posted by "williamhyun (via GitHub)" <gi...@apache.org> on 2025/07/26 22:56:47 UTC, 4 replies.
- Re: [PR] [SPARK-51830] Exception handling for partition datatype conversion call [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/27 00:34:16 UTC, 1 replies.
- Re: [PR] [SPARK-52944][CORE][TESTS][FOLLOWUP] Avoid hard-coding the checksum algorithm name [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/27 04:56:35 UTC, 2 replies.
- [PR] [SPARK-52944][CORE][SQL][YARN][3.5] Fix invalid assertions in tests [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/27 05:27:06 UTC, 4 replies.
- Re: [PR] [WIP][SPARK-52888][PYTHON] Implement the current_time function in PySpark [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/27 18:26:42 UTC, 0 replies.
- Re: [PR] [DRAFT][SPARK-52888][SPARK-52889][PYTHON] Implement the to_time and try_to_time functions in PySpark [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/27 18:58:12 UTC, 0 replies.
- Re: [PR] [DRAFT][SPARK-52892][SPARK-52893][SPARK-52894][PYTHON] Implement the hour, minute, and second functions in PySpark [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/27 18:58:57 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-52892][SPARK-52893][SPARK-52894][PYTHON] Implement the hour, minute, and second functions in PySpark [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/27 21:04:42 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-52890][SPARK-52891][PYTHON] Implement the to_time and try_to_time functions in PySpark [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/27 21:05:14 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-52889][PYTHON] Implement the current_time function in PySpark [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/27 21:05:34 UTC, 0 replies.
- Re: [PR] [SPARK-52888][PYTHON] Implement the make_time function in PySpark [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/27 21:11:26 UTC, 5 replies.
- Re: [PR] [SPARK-52889][PYTHON] Implement the current_time function in PySpark [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/27 21:38:41 UTC, 9 replies.
- [PR] [SPARK-52933][K8S] Verify if the executor cpu request exceeds limit [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/27 21:46:58 UTC, 6 replies.
- Re: [PR] [SPARK-52890][SPARK-52891][PYTHON] Implement the to_time and try_to_time functions in PySpark [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/27 22:08:39 UTC, 4 replies.
- Re: [PR] [SPARK-52892][SPARK-52893][SPARK-52894][PYTHON] Support TIME in the hour, minute, and second functions in PySpark [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/27 22:18:41 UTC, 4 replies.
- Re: [PR] [SPARK-51585][SQL] Oracle dialect supports pushdown datetime functions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/07/28 00:33:22 UTC, 1 replies.
- Re: [PR] [SPARK-52944][CORE][SQL][YARN][TESTS][3.5] Fix invalid assertions in tests [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/28 00:57:13 UTC, 4 replies.
- [PR] [SPARK-52968][SS] Emit additional state store metrics [spark] - posted by "dylanwong250 (via GitHub)" <gi...@apache.org> on 2025/07/28 02:16:10 UTC, 17 replies.
- [PR] [SPARK-52853][TESTS][FOLLOW-UP] Import SDP module when connect dependencies are available [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/07/28 03:27:24 UTC, 2 replies.
- [PR] [SPARK-52970][CONNECT][INFRA] Upgrade PyArrow version in 3.5 client <> master server build [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/07/28 03:42:20 UTC, 2 replies.
- [PR] [SPARK-52972][PYTHON][INFRA] Remove the testing image for python 3.9 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/28 07:26:40 UTC, 5 replies.
- [PR] [SPARK-52597][TESTS][FOLLOWUP] Fix the execution failure of StateStoreBasicOperationsBenchmark [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/28 07:48:21 UTC, 1 replies.
- [PR] [SPARK-52971] [PYTHON] Limit idle Python worker queue size [spark] - posted by "craiuconstantintiberiu (via GitHub)" <gi...@apache.org> on 2025/07/28 08:03:17 UTC, 5 replies.
- Re: [PR] [SPARK-52973][TESTS] Fix the execution failure of StateStoreBasicOperationsBenchmark [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/28 09:47:14 UTC, 2 replies.
- [PR] [SPARK-52974][SQL] Don't broadcast dynamicpruning InSubqueries [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/07/28 11:41:12 UTC, 1 replies.
- [PR] [SPARK-52975][SQL] Simplify field names in pushdown join sql [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2025/07/28 12:17:01 UTC, 25 replies.
- [PR] [SPARK-52844][PYTHON][TESTS] Update black to 24.3.0 [spark] - posted by "eschcam (via GitHub)" <gi...@apache.org> on 2025/07/28 12:51:17 UTC, 12 replies.
- [PR] [SPARK-52976][Python] Fix Python UDF not accepting collated string as input param [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2025/07/28 14:07:05 UTC, 4 replies.
- [PR] [SPARK-52977][TESTS] Fix npm vulnerabilities by `npm audit fix` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/28 14:53:45 UTC, 2 replies.
- [PR] Wip 52978 [spark] - posted by "zhztheplayer (via GitHub)" <gi...@apache.org> on 2025/07/28 16:03:52 UTC, 0 replies.
- Re: [PR] [SPARK-52020][TEST] Build hive-test-udfs.jar from source [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/07/28 17:19:29 UTC, 0 replies.
- Re: [PR] [SPARK-51745] Enforce State Machine for RocksDBStateStore [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/07/28 19:13:56 UTC, 1 replies.
- Re: [PR] [SPARK-36794][SQL] Ignore duplicated join keys when building relation for SEMI/ANTI shuffled hash join [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2025/07/28 19:22:41 UTC, 0 replies.
- [PR] [SPARK-52980][PYTHON] Support Arrow Python UDTFs [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/07/28 21:13:50 UTC, 8 replies.
- [PR] [SPARK-52983][BUILD] Upgrade Netty to 4.1.123.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/28 21:17:18 UTC, 3 replies.
- [PR] [SPARK-52959][PYTHON] Support UDT in Arrow optimized Python UDTF [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/07/28 21:17:29 UTC, 0 replies.
- [PR] [SPARK-52987][SQL][K8S] Use Java `String.replace` instead of `Strings.CS.replace` of `commons-lang3` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/28 22:01:28 UTC, 0 replies.
- Re: [PR] [SPARK-52985][PS] Raise TypeError for pandas numpy operand in comparison operators [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/07/28 22:13:29 UTC, 2 replies.
- [PR] [SPARK-52988][SQL] Fix race conditions in SessionCatalog's metastore function handling [spark] - posted by "attilapiros (via GitHub)" <gi...@apache.org> on 2025/07/29 00:06:33 UTC, 6 replies.
- [PR] [SPARK-52990][CORE] Support `StringSubstitutor` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/29 00:50:31 UTC, 6 replies.
- Re: [PR] [SPARK-52987][SQL][K8S] Use Java `String.(equals|replace)` method instead of `commons-lang3` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/29 00:51:52 UTC, 1 replies.
- [PR] [SPARK-52991][SQL] Implement MERGE INTO with SCHEMA EVOLUTION for V2 Data Source [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/07/29 02:03:23 UTC, 10 replies.
- [PR] [SPARK-52992][PYTHON][DOCS] Restore API reference of `pandas_udf` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/29 03:11:58 UTC, 2 replies.
- [PR] [SPARK-52993][BUILD] Bump Snappy 1.1.10.8 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/07/29 03:44:49 UTC, 2 replies.
- [PR] Add explicit closeIfNeeded API to State Store iterators [spark] - posted by "dylanwong250 (via GitHub)" <gi...@apache.org> on 2025/07/29 04:17:30 UTC, 0 replies.
- [PR] Clean up the usage of deprecated APIs in the `kubernetes-integration-tests` module [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/29 06:43:52 UTC, 0 replies.
- Re: [PR] [SPARK-51267][CONNECT] Match local Spark Connect server logic between Python and Scala [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/07/29 09:07:07 UTC, 1 replies.
- Re: [PR] [SPARK-52978][SQL] Make FileFormatWriter customizable via SQL configuration [spark] - posted by "zhztheplayer (via GitHub)" <gi...@apache.org> on 2025/07/29 09:28:55 UTC, 3 replies.
- [PR] [SPARK-52996][TESTS] Update NPM test dependencies [spark] - posted by "eschcam (via GitHub)" <gi...@apache.org> on 2025/07/29 11:01:56 UTC, 9 replies.
- [PR] [SPARK-52995][YARN] Use Buffered I/O for creating spark jar archive [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/29 11:09:25 UTC, 2 replies.
- Re: [PR] [SPARK-51069][SQL] Add big-endian support to UnsafeRowUtils.validateStructuralIntegrityWithReasonImpl [spark] - posted by "jonathan-albrecht-ibm (via GitHub)" <gi...@apache.org> on 2025/07/29 11:41:49 UTC, 0 replies.
- Re: [PR] [SPARK-47496][SQL] Java SPI Support for dynamic JDBC dialect registering [spark] - posted by "elijah-pl (via GitHub)" <gi...@apache.org> on 2025/07/29 12:05:43 UTC, 1 replies.
- Re: [PR] [SPARK-52226] [SQL] Fix unusual equality checks in three operators [spark] - posted by "zhztheplayer (via GitHub)" <gi...@apache.org> on 2025/07/29 12:13:51 UTC, 0 replies.
- [PR] Fixes wrong worker assignment if multiple clusters are deployed to the namespace [spark-kubernetes-operator] - posted by "schmaxXximilian (via GitHub)" <gi...@apache.org> on 2025/07/29 13:07:47 UTC, 0 replies.
- [PR] [SPARK-52998][Core] Multiple variables inside declare [spark] - posted by "TeodorDjelic (via GitHub)" <gi...@apache.org> on 2025/07/29 13:47:44 UTC, 10 replies.
- Re: [PR] [SPARK-52867][SQL] Remove redundant GetTimestamp [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/29 15:09:11 UTC, 0 replies.
- Re: [PR] [SPARK-52959][PYTHON] Support UDT in Arrow-optimized Python UDTF [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/29 15:10:57 UTC, 1 replies.
- Re: [PR] [SPARK-51745][SQL][SS] Enforce State Machine for RocksDBStateStore [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/07/29 16:13:43 UTC, 3 replies.
- [PR] Throwing an error if State Stores do not commit at the end of a batch… [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/07/29 17:21:33 UTC, 0 replies.
- Re: [PR] [SPARK-52999][K8S][TESTS] Clean up the deprecated APIs usage in `kubernetes-integration-tests` module [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/29 17:42:41 UTC, 5 replies.
- [PR] [SPARK-53000][SQL] Rename `StringUtils.scala` to `StringConcat.scala` in `sql/api` module [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/29 18:16:52 UTC, 4 replies.
- [PR] [SPARK-53001] Integrate RocksDB Memory Usage with the Unified Memory Manager [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/07/29 18:28:06 UTC, 9 replies.
- [PR] [SPARK-53002] Show accurate memory usage statistics when bounded memory is enabled for RocksDB [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/07/29 18:42:06 UTC, 2 replies.
- [PR] [SPARK-53003][CORE] Support `strip` in `SparkStringUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/29 19:16:40 UTC, 8 replies.
- [PR] [SPARK-53004][CORE] Support `abbreviate` in `SparkStringUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/29 20:07:07 UTC, 2 replies.
- [PR] [SPARK-53006][BUILD][TESTS] Upgrade `bytebuddy` to 1.17.6 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/29 20:35:15 UTC, 2 replies.
- [PR] [SPARK-53010][MLLIB][YARN] Ban `com.google.common.base.Strings` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/29 22:29:37 UTC, 2 replies.
- [PR] [SPARK-53008][SQL] Infer SQL Data Access from SQL UDF body [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/07/29 22:45:30 UTC, 3 replies.
- [PR] [SPARK-53001][TESTS] Fix test_df_unpivot to pass with Spark 4.0 [spark-connect-rust] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/07/29 22:58:26 UTC, 0 replies.
- [PR] [SPARK-51555][SQL] Add the timediff() function [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2025/07/29 23:06:29 UTC, 0 replies.
- [PR] [SPARK-53003][CORE][FOLLOWUP] Handle null input values [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/30 01:01:01 UTC, 5 replies.
- [PR] [SPARK-53013][PYTHON] Fix Arrow-optimized Python UDTF returning no rows on lateral join [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/07/30 02:30:09 UTC, 2 replies.
- [PR] [SPARK-53014][PYTHON][DOCS] Make Arrow UDF public [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/30 03:51:19 UTC, 2 replies.
- [PR] [SPARK-53015][BUILD] Upgrade log4j to 2.25.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/30 05:52:13 UTC, 9 replies.
- [PR] [SPARK-53016][INFRA] Replace actions-rs/toolchain with dtolnay/rust-toolchain [spark-connect-rust] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/07/30 05:59:39 UTC, 0 replies.
- [PR] [SPARK-53017][SQL][FOLLOWUP] Add logs in DSv2 Join pushdown rule [spark] - posted by "PetarVasiljevic-DB (via GitHub)" <gi...@apache.org> on 2025/07/30 06:58:26 UTC, 5 replies.
- Re: [PR] [SPARK-53017][SQL][FOLLOWUP] Add log4j logs in DSv2 Join pushdown rule [spark] - posted by "PetarVasiljevic-DB (via GitHub)" <gi...@apache.org> on 2025/07/30 07:03:12 UTC, 9 replies.
- Re: [PR] [SPARK-52997] Fixes wrong worker assignment if multiple clusters are deployed to the same namespace [spark-kubernetes-operator] - posted by "schmaxXximilian (via GitHub)" <gi...@apache.org> on 2025/07/30 07:25:23 UTC, 4 replies.
- [PR] [SPARK-52954][PYTHON][TESTS][FOLLOW-UP] Explicitly set the configs needed in the tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/30 07:44:55 UTC, 1 replies.
- [PR] [SPARK-52954][PYTHON][TESTS][FOLLOW-UP] Alway set safe_check=True in Arrow UDFs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/30 07:59:40 UTC, 2 replies.
- [PR] [SPARK-53018][PYTHON] ArrowStreamArrowUDFSerializer should respect argument arrow_cast [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/30 08:07:01 UTC, 2 replies.
- [PR] [SPARK-53019][SQL] Fix job attempt path conflicts in o.a.hadoop..FileOutputCommitter [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/07/30 08:52:29 UTC, 1 replies.
- Re: [PR] [SPARK-51555][SQL] Add the time_diff() function [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/07/30 13:14:45 UTC, 3 replies.
- [PR] [SPARK-53020][DEPLOY] JPMS args should also apply to non-SparkSubmit process [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/07/30 14:08:45 UTC, 4 replies.
- [PR] [SPARK-53021][BUILD] Switch `common/utils` module to have `commons-io… [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/30 15:01:21 UTC, 0 replies.
- [PR] [SPARK-52451][CONNECT] Make WriteOperation in SparkConnectPlanner side effect free [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/07/30 15:24:12 UTC, 0 replies.
- Re: [PR] [SPARK-52451][CONNECT][SQL] Make WriteOperation in SparkConnectPlanner side effect free [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/07/30 16:36:12 UTC, 6 replies.
- Re: [PR] [SPARK-53021][BUILD] Switch `common/utils` module to have `commons-io` test dependency [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/30 17:18:58 UTC, 7 replies.
- [PR] [SPARK-53022][TESTS] Add MemoryConsumerBenchmark [spark] - posted by "zhztheplayer (via GitHub)" <gi...@apache.org> on 2025/07/30 18:13:24 UTC, 1 replies.
- Re: [PR] [SPARK-52008] Throwing an error if State Stores do not commit at the end of a batch when ForeachBatch is used [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/07/30 18:31:37 UTC, 0 replies.
- [PR] [SPARK-53023][SQL] Remove `commons-io` dependency from `sql/api` module [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/30 18:46:20 UTC, 5 replies.
- [PR] [SPARK-53024][BUILD] Upgrade `commons-io` to 2.20.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/30 18:50:53 UTC, 4 replies.
- [PR] [SPARK-53025][CORE][SQL][TESTS] Use Java `Files.writeString` instead of `FileUtils.writeStringToFile` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/30 20:26:14 UTC, 3 replies.
- [PR] [SPARK-53026] Fix deserialize error for spec with DriverServiceIngressSpec field [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2025/07/30 20:47:17 UTC, 0 replies.
- [PR] [SPARK-53027] Operator sa should be able to create ingress [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2025/07/30 22:17:22 UTC, 0 replies.
- [PR] [SPARK-53028][SQL][K8S][EXAMPLE] Use `StandardCharsets.UTF_8` instead of `Charset.defaultCharset` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/30 23:28:09 UTC, 4 replies.
- [PR] [SPARK-53031][CORE] Support `getFile` in `SparkFileUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/31 00:56:08 UTC, 2 replies.
- [PR] [SPARK-53032] Fix parquet format of shredded timestamp values within arrays [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2025/07/31 01:24:52 UTC, 4 replies.
- [PR] [SPARK-52940][PYTHON][TESTS][FOLLOW-UP] Correct the return type in test UDFs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/31 02:32:08 UTC, 2 replies.
- [PR] [SPARK-53020][DEPLOY][4.0] JPMS args should also apply to non-SparkSubmit process [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/07/31 02:50:50 UTC, 2 replies.
- [PR] [MINOR][PYTHON][DOCS] Fix a pandas UDF example [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/31 03:02:55 UTC, 2 replies.
- Re: [PR] [SPARK-52729][SQL] Add MetadataOnlyTable in DS v2 API [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/07/31 03:04:39 UTC, 7 replies.
- [PR] [SPARK-53034][CORE][SQL][MLLIB][YARN] Use `Utils.deleteRecursively` i… [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/31 03:41:29 UTC, 0 replies.
- Re: [PR] [SPARK-53034][CORE][SQL][MLLIB][YARN] Use `deleteRecursively` instead of `FileUtils.deleteDirectory` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/31 04:54:07 UTC, 4 replies.
- Re: [PR] [SPARK-53020][DEPLOY][3.5] JPMS args should also apply to non-SparkSubmit process [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/07/31 05:41:35 UTC, 4 replies.
- [PR] [SPARK-53035][CORE][SQL][K8S][MLLIB] Use `String.repeat` instead of Scala string multiplication [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/31 05:56:30 UTC, 4 replies.
- [PR] [SPARK-53036][PYTHON][DOCS][TESTS] Enable doctest `pyspark.sql.pandas.functions` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/31 06:30:55 UTC, 3 replies.
- [PR] [SPARK-53037][CORE][SQL][K8S] Support `closeQuietly` in `SparkErrorUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/31 06:52:50 UTC, 2 replies.
- [PR] [SPARK-53038][SQL][HIVE] Call initialize only once per GenericUDF instance [spark] - posted by "wankunde (via GitHub)" <gi...@apache.org> on 2025/07/31 07:37:11 UTC, 0 replies.
- [PR] [MINOR][CORE][TESTS] Remove a redundant @VisibleForTesting in test code [spark] - posted by "zhztheplayer (via GitHub)" <gi...@apache.org> on 2025/07/31 07:57:39 UTC, 3 replies.
- [PR] Wip clean testmm [spark] - posted by "zhztheplayer (via GitHub)" <gi...@apache.org> on 2025/07/31 08:01:17 UTC, 0 replies.
- [PR] [SPARK-53039][PYTHON][TESTS] Add unit test for complex arrow UDF used in window [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/07/31 08:03:56 UTC, 1 replies.
- [PR] [SPARK-52844][PYTHON] Update protobuf to 5.29.5 [spark] - posted by "eschcam (via GitHub)" <gi...@apache.org> on 2025/07/31 10:46:44 UTC, 0 replies.
- [PR] [SPARK-53040][SQL] Ban self references inside topmost CTEs in Recursive CTEs [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/07/31 12:42:49 UTC, 5 replies.
- [PR] [SPARK-53034][CORE][TESTS][FOLLOWUP] Use JavaUtils.deleteRecursively in Java code [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/31 14:33:28 UTC, 1 replies.
- Re: [PR] [SPARK-53034][CORE][TESTS][FOLLOWUP] Use `JavaUtils.deleteRecursively` in Java code [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/31 14:39:54 UTC, 4 replies.
- Re: [PR] [MINOR][CORE][TESTS] Rename `TestMemoryManager.(markconsequentOOM -> markConsequentOOM)` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/31 15:22:07 UTC, 0 replies.
- [PR] Revert "[SPARK-52610][BUILD] Upgrade rocksdbjni to 10.2.1" [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/07/31 15:22:38 UTC, 3 replies.
- [PR] [SPARK-53043][CORE][SQL][K8S] Use Java `transferTo` instead of `IOUtils.copy` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/31 17:56:56 UTC, 4 replies.
- [PR] [SPARK-53044] Change Declarative Pipelines import alias convention from "sdp" to "dp" [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/07/31 17:57:47 UTC, 0 replies.
- [PR] [SPARK-53045][SQL] DESCRIBE EXTENDED should be resilient to corrupt metadata [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/07/31 18:59:26 UTC, 0 replies.
- [PR] [SPARK-53046][CORE][SQL] Use Java `readAllBytes` instead of `IOUtils.toByteArray` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/31 19:33:06 UTC, 5 replies.
- [PR] [SPARK-53049][CORE][SQL][SS] Support `toString` in `SparkStreamUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/31 21:18:54 UTC, 1 replies.
- [PR] Wip naming sources [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/07/31 21:25:58 UTC, 0 replies.
- [PR] [SPARK-53030][PYTHON] Support Arrow writer for streaming Python data sources [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/07/31 21:33:10 UTC, 2 replies.
- [PR] [SPARK-53051][CORE][TESTS] Ban `org.apache.hadoop.io.IOUtils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/07/31 22:13:40 UTC, 3 replies.
- [PR] [CONNECT][SPARK-53054] Fix the connect.DataFrameReader default format behavior [spark] - posted by "dillitz (via GitHub)" <gi...@apache.org> on 2025/07/31 23:40:57 UTC, 0 replies.