reviews@spark.apache.org, 2025-05

You are viewing a plain text version of this content. The canonical link for it is here.

- Re: [PR] [SPARK-51906][SQL] Dsv2 expressions in alter table add columns [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/05/01 00:01:12 UTC, 37 replies.
- Re: [PR] [SPARK-51883][DOCS][PYTHON] Python Data Source user guide for filter pushdown [spark] - posted by "wengh (via GitHub)" <gi...@apache.org> on 2025/05/01 00:05:22 UTC, 8 replies.
- Re: [PR] [SPARK-51272][CORE] Aborting instead of re-submitting of partially completed indeterminate result stage [spark] - posted by "attilapiros (via GitHub)" <gi...@apache.org> on 2025/05/01 00:45:17 UTC, 9 replies.
- Re: [PR] [SPARK-51969] Support `createTable` and `(table|function)Exists` in `Catalog` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/01 00:56:19 UTC, 1 replies.
- [PR] [SPARK-51970] Support to create and drop temporary views in `DataFrame` and `Catalog` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/01 01:00:08 UTC, 3 replies.
- [PR] [SPARK-51971] Improve `DataFrame.collect` to return the original values [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/01 04:04:44 UTC, 5 replies.
- [PR] Test [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/01 04:23:53 UTC, 1 replies.
- Re: [PR] [SPARK-][CORE] Expand tilde `(~)` in spark.jars.ivy path configuration [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/01 04:26:24 UTC, 1 replies.
- Re: [PR] [SPARK-51182][SQL] DataFrameWriter should throw dataPathNotSpecifiedError when path is not specified [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/01 04:33:09 UTC, 9 replies.
- Re: [PR] [SPARK-51842][SQL] Remove unnecessary judgement from fillDefaultValue [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/01 04:37:01 UTC, 1 replies.
- Re: [PR] [SPARK-51867][ML][FOLLOW-UP] Use private[ml] to avoid exposing Data class [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/05/01 04:58:29 UTC, 1 replies.
- Re: [PR] [SPARK-51871] Improve `SQLTests` to check column names [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/01 06:04:19 UTC, 2 replies.
- [PR] [SPARK-51972][SS] State Store file integrity verification using checksum [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2025/05/01 06:18:14 UTC, 27 replies.
- Re: [PR] [SPARK-51291] Reclassify validation errors thrown from state store loading [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2025/05/01 07:19:18 UTC, 5 replies.
- Re: [PR] [SPARK-51016][SQL] Non-deterministic SQL expressions should set indeterminate map stage output level [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/05/01 08:44:01 UTC, 21 replies.
- Re: [PR] [SPARK-51964][SQL] Correctly resolve attributes from hidden output in ORDER BY and HAVING on top of an Aggregate in single-pass Analyzer [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/05/01 10:45:29 UTC, 8 replies.
- Re: [PR] [SPARK-51847][PYTHON] Extend PySpark testing framework util functions with basic data tests [spark] - posted by "stanlocht (via GitHub)" <gi...@apache.org> on 2025/05/01 11:55:26 UTC, 5 replies.
- [PR] [SPARK-51966][PYTHON] Replace select.select() with select.poll() when running on POSIX os [spark] - posted by "wjszlachta-man (via GitHub)" <gi...@apache.org> on 2025/05/01 12:12:37 UTC, 0 replies.
- [PR] [SPARK-51973][K8S][BUILD] Upgrade `kubernetes-client` to 7.2.0 for K8s 1.33 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/01 12:37:28 UTC, 6 replies.
- Re: [PR] [SPARK-51958][CORE][SQL][TESTS] Replace hardcoded icu version with `c.ibm.icu.util.VersionInfo.ICU_VERSION` it tests [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/01 12:53:43 UTC, 0 replies.
- [PR] [SPARK-51976] Add `array`, `map`, `timestamp`, `posexplode` test queries [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/01 16:05:01 UTC, 3 replies.
- [PR] [SPARK-51977] Improve `SparkSQLRepl` to support multiple lines [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/01 16:32:17 UTC, 2 replies.
- [PR] [SPARK-51978] Upgrade `kubernetes-client` to 7.2.0 for K8s 1.33 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/01 17:33:53 UTC, 3 replies.
- [PR] [SPARK-51979][SQL][TEST] Add more SQL Query tests for SQL TVF return columns [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/05/01 17:41:19 UTC, 0 replies.
- Re: [PR] [SPARK-51756][CORE] Computes RowBasedChecksum in ShuffleWriters [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/05/01 17:41:38 UTC, 28 replies.
- Re: [PR] [SPARK-51979][SQL][TESTS] Add more SQL Query tests for SQL TVF return columns [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/05/01 17:43:48 UTC, 2 replies.
- Re: [PR] [SPARK-51955] Adding release() to ReadStateStore interface and reusing ReadStore for Streaming Aggregations [spark] - posted by "liviazhu-db (via GitHub)" <gi...@apache.org> on 2025/05/01 18:03:36 UTC, 14 replies.
- [PR] [MINOR][PS][DOC] Update pandas API on Spark option doc [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/05/01 18:51:10 UTC, 3 replies.
- [PR] Enable `--use-pep517` in `dev/run-pip-tests` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/01 19:54:29 UTC, 0 replies.
- Re: [PR] [SPARK-51902][SQL] Enforce check constraint on table insertion [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/05/01 22:45:01 UTC, 19 replies.
- [PR] [SPARK-51983][PS] Prepare the test environment for pandas API on Spark with ANSI mode enabled [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/05/01 23:24:23 UTC, 2 replies.
- [PR] [SPARK-51981][Strcutured Streaming]Add JobTags to queryStartedEvent [spark] - posted by "gjxdxh (via GitHub)" <gi...@apache.org> on 2025/05/01 23:38:39 UTC, 6 replies.
- Re: [PR] [SPARK-44856][PYTHON] Improve Python UDTF arrow serializer performance [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/05/02 01:11:23 UTC, 2 replies.
- Re: [PR] [SPARK-51821][CORE] Call interrupt() without holding uninterruptibleLock to avoid possible deadlock [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2025/05/02 03:21:46 UTC, 20 replies.
- Re: [PR] [SPARK-51596][SS] Fix concurrent StateStoreProvider maintenance and closing [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2025/05/02 04:45:11 UTC, 1 replies.
- Re: [PR] [SPARK-51980][PYTHON][TESTS] Enable `--use-pep517` in `dev/run-pip-tests` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/02 04:49:39 UTC, 1 replies.
- Re: [PR] [SPARK-51291] [SS] Reclassify validation errors thrown from state store loading [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2025/05/02 05:26:41 UTC, 3 replies.
- Re: [PR] [SPARK-51947] Spark connect model cache offloading [spark] - posted by "xi-db (via GitHub)" <gi...@apache.org> on 2025/05/02 09:52:28 UTC, 4 replies.
- Re: [PR] [SPARK-51974][CONNECT][ML] Limit model size and per-session model cache size [spark] - posted by "xi-db (via GitHub)" <gi...@apache.org> on 2025/05/02 10:02:45 UTC, 8 replies.
- Re: [PR] [SPARK-51818][CONNECT] Move QueryExecution creation to AnalyzeHandler and don't Execute for AnalyzePlanRequests [spark] - posted by "peterpashkin (via GitHub)" <gi...@apache.org> on 2025/05/02 14:30:34 UTC, 3 replies.
- [PR] [SPARK-51985][CORE] Remove `Experimental` from `(Long|Double)AccumulatorSource` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/02 15:13:10 UTC, 5 replies.
- [PR] [SPARK-51986] Support `Parameterized SQL queries` in `sql` API [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/02 17:33:53 UTC, 6 replies.
- Re: [PR] [CORE][CONNECT] Add cogroup and cogroupSorted variants for additional KeyValueGroupedDatasets. [spark] - posted by "kyle-winkelman (via GitHub)" <gi...@apache.org> on 2025/05/02 17:40:41 UTC, 1 replies.
- Re: [PR] [SPARK-51016][SQL] Stage.isIndeterminate gives wrong result in case the shuffle partitioner uses an inDeterministic attribute or expression. [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2025/05/02 19:05:09 UTC, 1 replies.
- [PR] [SPARK-51989][PYTHON] Add missing Filter subclasses to __all__ list in datasource [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/05/02 19:17:22 UTC, 4 replies.
- [PR] [WIP] All Lock Hardening Changes so far [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/05/02 23:09:24 UTC, 1 replies.
- [PR] [WIP] All Lock Hardening Changes [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/05/02 23:17:59 UTC, 3 replies.
- Re: [PR] [SPARK-50589][SQL] Avoid extra expensive expression duplication when push filter [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/05/03 00:26:39 UTC, 1 replies.
- Re: [PR] [SPARK-51950][BUILD] Upgrade `Parquet` to 1.15.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/03 01:01:26 UTC, 3 replies.
- [PR] Test GPG manual installation [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/03 01:11:53 UTC, 1 replies.
- [PR] Remove setup-swift [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/03 01:48:10 UTC, 0 replies.
- Re: [PR] [SPARK-51990] Use `Swift` docker image instead of `setup-swift` on Linux environments [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/03 02:11:36 UTC, 2 replies.
- Re: [PR] [SPARK-49386][SPARK-27734][CORE][SQL] Add memory based thresholds for shuffle spill [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/05/03 03:18:24 UTC, 7 replies.
- Re: [PR] [SPARK-51990] Use `Swift` docker image on Linux environments [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/03 14:11:49 UTC, 1 replies.
- [PR] [SPARK-51991] Add `GettingStarted.md` and `SparkSession.md` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/03 15:53:17 UTC, 1 replies.
- Re: [PR] [SPARK-51991] Add `SparkConnect.md`, `GettingStarted.md` and `SparkSession.md` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/03 16:12:34 UTC, 3 replies.
- [PR] [SPARK-51992] Support `interrupt(Tag|Operation|All)` in `SparkSession` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/03 17:37:49 UTC, 7 replies.
- [PR] Test Apache ORC 2.1.1-SNAPSHOT [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/03 20:05:34 UTC, 1 replies.
- [PR] [SPARK-51993] Support `emptyDataFrame` and `listColumns` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/03 21:51:50 UTC, 3 replies.
- [PR] [SPARK-51994] Fix `ArrowType.Info.==` to support complex types [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/03 21:59:16 UTC, 3 replies.
- Re: [PR] [DRAFT] Resolve default string producing expressions in analyzer [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/05/04 00:30:46 UTC, 1 replies.
- Re: [PR] [SPARK-50603][SQL] Respect user-provided basePath for streaming file source reads without glob [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/05/04 00:30:47 UTC, 2 replies.
- [PR] [SPARK-51995] Support `distinct` and `dropDuplicates(WithinWatermark)?` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/04 01:55:02 UTC, 0 replies.
- Re: [PR] [SPARK-51995] Support `toDF`, `distinct` and `dropDuplicates(WithinWatermark)?` in `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/04 02:34:47 UTC, 1 replies.
- [PR] [SPARK-51996] Support `describe` and `summary` in `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/04 02:37:16 UTC, 2 replies.
- [PR] [SPARK-51997] Mark `nodoc` to hide generated and internal classes from docs [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/04 13:53:25 UTC, 2 replies.
- [PR] [SPARK-51998][BUILD] Upgrade ORC to 2.1.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/04 15:11:26 UTC, 5 replies.
- [PR] [SPARK-52001] Bump version to 0.2.0-SNAPSHOT in `main` branch [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/04 16:09:06 UTC, 6 replies.
- [PR] [SPARK-52002] Update GitHub Action YAML file in `branch-0.1` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/04 16:19:04 UTC, 2 replies.
- [PR] [SPARK-52003] Improve `publish_snapshot_dockerhub` GitHub Action job to support branches [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/04 19:09:40 UTC, 3 replies.
- [PR] [SPARK-52004] Improve `publish_snapshot_chart` GitHub Action job to support branches [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/04 21:46:00 UTC, 8 replies.
- Re: [PR] [SPARK-51740][SQL] Allow get_json_object to consider leading spaces in paths [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2025/05/04 22:52:12 UTC, 0 replies.
- [PR] [SPARK-50238][FOLLOW-UP] Fix Arrow UDF bug where Struct with metadata field was failing on the is_variant path [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2025/05/04 22:56:27 UTC, 0 replies.
- Re: [PR] [SPARK-50238][PYTHON][FOLLOW-UP] Fix Arrow UDF bug where Struct with metadata field was failing on the is_variant path [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2025/05/04 22:56:52 UTC, 2 replies.
- Re: [PR] [SPARK-51577] Make gradle build to automatically append SNAPSHOT suffix to version for non-release builds [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/04 23:22:10 UTC, 0 replies.
- Re: [PR] [SPARK-50964][SQL] Use StaticInvoke to implement `VariantGet` codegen [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/05/05 00:29:58 UTC, 1 replies.
- [PR] [SPARK-51880][FOLLOW-UP] Fix LDAModel.toLocal [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/05/05 06:05:40 UTC, 1 replies.
- [PR] Enhance Spark UI path handling by introducing a global path prefix [spark] - posted by "GauravWaghmare (via GitHub)" <gi...@apache.org> on 2025/05/05 09:45:36 UTC, 1 replies.
- Re: [PR] [SPARK-51710][PYTHON] Passing an empty array to PySpark Dataframe.dropDuplicates should behave the same as passing no arguments [spark] - posted by "joke1196 (via GitHub)" <gi...@apache.org> on 2025/05/05 13:38:50 UTC, 4 replies.
- [PR] Bump golang.org/x/oauth2 from 0.28.0 to 0.30.0 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/05/05 14:28:37 UTC, 0 replies.
- Re: [PR] Bump golang.org/x/oauth2 from 0.28.0 to 0.29.0 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/05/05 14:28:38 UTC, 1 replies.
- [PR] [WIP] Build jar from source [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/05/05 14:58:48 UTC, 7 replies.
- [PR] [SPARK-52007] [SQL] Expression IDs shouldn't be present in grouping expressions when using grouping sets [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/05/05 16:13:55 UTC, 3 replies.
- [PR] [SPARK-51987][SQL] DSv2 expressions in column defaults on write [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/05/05 20:41:55 UTC, 54 replies.
- [PR] [SQL][MINOR][FOLLOW-UP] Fix warnings in DataSource/WriterV2Suites [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/05/05 22:27:52 UTC, 2 replies.
- [PR] [SPARK-52008] [SS] [WIP] [spark] - posted by "liviazhu-db (via GitHub)" <gi...@apache.org> on 2025/05/05 22:39:53 UTC, 1 replies.
- [PR] [SPARK-52008] [SS] Add StateStore TaskCompletionListener to abort store and throw error [spark] - posted by "liviazhu-db (via GitHub)" <gi...@apache.org> on 2025/05/05 22:56:57 UTC, 2 replies.
- [PR] [WIP][SPARK-52006][SQL] Exclude CollectMetricsExec accumulator from Spark UI + event logs [spark] - posted by "tengfeihuang-db (via GitHub)" <gi...@apache.org> on 2025/05/06 00:59:31 UTC, 1 replies.
- [PR] [SPARK-52010] Do not generate API docs for private classes [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/06 01:52:14 UTC, 10 replies.
- Re: [PR] [SPARK-52010] Do not generate API docs for internal classes [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/06 01:59:36 UTC, 2 replies.
- Re: [PR] [WIP] Reduce HDFS NameNode RPC on vectorized Parquet reader [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/05/06 02:13:44 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-52011][SQL] Reduce HDFS NameNode RPC on vectorized Parquet reader [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2025/05/06 03:13:46 UTC, 1 replies.
- Re: [PR] [SPARK-51905][SQL] Disallow NOT ENFORCED CHECK constraint [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/05/06 03:32:02 UTC, 5 replies.
- [PR] [WIP][SPARK-52012][CORE][SQL] Restore IDE Index with type annotations [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/05/06 03:48:32 UTC, 0 replies.
- [PR] [SPARK-52013] [CONNECT] [ML] Fix SparkConnectClient ml_caches [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/05/06 04:26:16 UTC, 2 replies.
- [PR] [SPARK-52014][SQL] Support FoldableUnevaluable in HiveGenericUDFEvaluator [spark] - posted by "wankunde (via GitHub)" <gi...@apache.org> on 2025/05/06 08:07:29 UTC, 3 replies.
- Re: [PR] [SPARK-52012][CORE][SQL] Restore IDE Index with type annotations [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/06 08:18:27 UTC, 23 replies.
- [PR] [SPARK-52015][BUILD][TESTS] Update Oracle free version from 23.6 to 23.7 [spark] - posted by "LucaCanali (via GitHub)" <gi...@apache.org> on 2025/05/06 09:43:38 UTC, 1 replies.
- [PR] [MINOR][TESTS] Reduce the number of iterations in tuning tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/05/06 12:08:23 UTC, 2 replies.
- [PR] [SPARK-52017] Enable multiple self-references and self-references from a Subquery inside rCTEs [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/05/06 13:22:20 UTC, 5 replies.
- Re: [PR] [SPARK-51554][SQL] Add the time_trunc() function for TIME datatype [spark] - posted by "the-sakthi (via GitHub)" <gi...@apache.org> on 2025/05/06 13:39:15 UTC, 0 replies.
- [PR] [SPARK-52019] [SQL] Strip outer reference before creating a name in toPrettySQL [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/05/06 15:22:33 UTC, 7 replies.
- [PR] Separate operator and expression patterns [spark] - posted by "sigmod (via GitHub)" <gi...@apache.org> on 2025/05/06 18:35:44 UTC, 0 replies.
- Re: [PR] [SPARK-52021] Separate operator and expression patterns [spark] - posted by "sigmod (via GitHub)" <gi...@apache.org> on 2025/05/06 20:35:46 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-44662][SQL] Perf improvement in BroadcastHashJoin queries with stream side join key on non partition columns [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2025/05/06 20:46:23 UTC, 3 replies.
- Re: [PR] [SPARK-47609][SQL] Making CacheLookup more optimal to minimize cache miss [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2025/05/06 21:27:45 UTC, 1 replies.
- Re: [PR] [SPARK-45959][SQL] Improving performance when addition of 1 column at a time causes increase in the LogicalPlan tree depth [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2025/05/06 21:47:00 UTC, 0 replies.
- [PR] [SPARK-51835][SQL][TESTS] Extend InMemoryTable to support table versions [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/05/06 22:13:49 UTC, 5 replies.
- [PR] Linux test [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/06 22:21:40 UTC, 1 replies.
- Re: [PR] [SPARK-33152][SQL] Implement new optimized logic for constraint propagation rule [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2025/05/06 23:11:40 UTC, 1 replies.
- Re: [PR] [SPARK-51981][SS] Add JobTags to queryStartedEvent [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/06 23:12:15 UTC, 18 replies.
- Re: [PR] [SPARK-49881][SQL] Skipping DeduplicateRelations rule conditionally to improve analyzer perf [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2025/05/06 23:32:55 UTC, 1 replies.
- Re: [PR] [SPARK-52021][SQL] Separate operator and expression patterns [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/05/06 23:55:57 UTC, 9 replies.
- Re: [PR] [SPARK-49642][SQL] Remove the ANSI config suggestion in DATETIME_FIELD_OUT_OF_BOUNDS [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/05/07 00:27:54 UTC, 1 replies.
- [PR] [SPARK-52022][PYTHON] Add additional check in default method for SparkThrowable.getQueryContext [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/07 00:51:02 UTC, 5 replies.
- [PR] [SPARK-51849][SQL][FOLLOWUP] ApplyDefaultCollationToStringType.fetchDefaultCollation should be consistent with transform [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/07 05:54:24 UTC, 3 replies.
- Re: [PR] Update supported_api_gen.py: remove an invalid escape sequence "\_" using a raw string [spark] - posted by "wyattscarpenter (via GitHub)" <gi...@apache.org> on 2025/05/07 07:23:45 UTC, 1 replies.
- Re: [PR] [SPARK-52017][SQL] Enable multiple self-references and self-references from a Subquery inside rCTEs [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/05/07 08:26:18 UTC, 8 replies.
- Re: [PR] [Spark-50873][SQL] Prune column after RewriteSubquery rule for DSV2 [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/07 08:35:24 UTC, 2 replies.
- [PR] Add GitHub Actions workflows for building, publishing, and deploying Spark History Server [spark] - posted by "GauravWaghmare (via GitHub)" <gi...@apache.org> on 2025/05/07 12:41:45 UTC, 1 replies.
- [PR] [SPARK-51867][ML][FOLLOW-UP] Make funtions in `ReadWriteUtils` private [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/05/07 13:40:20 UTC, 2 replies.
- [PR] [SPARK-52006][SQL][CORE] Exclude CollectMetricsExec accumulator from Spark UI + event logs + metric heartbeats [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2025/05/07 15:19:18 UTC, 5 replies.
- Re: [PR] [SPARK-49872][CORE] allow unlimited json size again [spark] - posted by "arunaru-te (via GitHub)" <gi...@apache.org> on 2025/05/07 15:47:01 UTC, 6 replies.
- [PR] [SPARK-52025][BUILD] Upgrade ORC to 1.9.6 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/07 15:52:43 UTC, 0 replies.
- [PR] [SPARK-52024][SQL] Support cancel ShuffleQueryStage when propagate empty relations [spark] - posted by "summaryzb (via GitHub)" <gi...@apache.org> on 2025/05/07 17:30:44 UTC, 3 replies.
- Re: [PR] [SPARK-51765] Docs for SQL Scripting [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/07 17:37:51 UTC, 0 replies.
- Re: [PR] [SPARK-51301][BUILD] Bump zstd-jni 1.5.7-1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/07 19:03:46 UTC, 12 replies.
- Re: [PR] [SPARK-52025][BUILD][3.5] Upgrade ORC to 1.9.6 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/07 19:26:04 UTC, 3 replies.
- [PR] Add `spark-core` as compile dependency for `sql-api` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/07 19:28:38 UTC, 2 replies.
- [PR] [SPARK-52026][PS] Block pandas API on Spark on ANSI mode by default [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/05/07 19:37:46 UTC, 7 replies.
- [PR] [SPARK-52026][PS][4.0] Block pandas API on Spark on ANSI mode by default [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/05/07 19:38:06 UTC, 5 replies.
- [PR] [SPARK-52027][K8S][DOCS] Update `YuniKorn` docs with `1.6.3` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/07 21:12:04 UTC, 4 replies.
- [PR] [SPARK-52028] Update `README.md` with YuniKorn 1.6.3 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/07 21:24:02 UTC, 2 replies.
- [PR] [SPARK-52029][SQL] Support external field-id to column-name mapping for Parquet [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/05/07 22:49:54 UTC, 0 replies.
- [PR] [SPARK-52030] Make all test suites serialized [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/07 23:22:47 UTC, 2 replies.
- [PR] [SPARK-50585][PYTHON][DOCS] Render interactive PySpark plot examples [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/05/07 23:33:05 UTC, 2 replies.
- [PR] [SPARK-52031][SQL] Subquery generator for testing queries with nested correlations [spark] - posted by "AveryQi115 (via GitHub)" <gi...@apache.org> on 2025/05/08 00:03:39 UTC, 0 replies.
- Re: [PR] [SPARK-50991][SQL] Align the table schema column position beginning index [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/05/08 00:28:11 UTC, 1 replies.
- Re: [PR] [WIP]Refactor metrics [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/05/08 00:28:12 UTC, 1 replies.
- [PR] [SPARK-51884][SQL]Part 1.a Add outer scope attributes for SubqueryExpression [spark] - posted by "AveryQi115 (via GitHub)" <gi...@apache.org> on 2025/05/08 01:00:52 UTC, 19 replies.
- [PR] [SPARK-52033] Fix Generate node bug fix where the output of the child node can have multiple copies of the same Attribute [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2025/05/08 02:15:07 UTC, 1 replies.
- [PR] [SPARK-52034][SQL] Add common methods in SparkOperation trait for thriftserver operations [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/05/08 03:12:02 UTC, 5 replies.
- [PR] [SPARK-52035][ML] Decouple LinearRegressionTrainingSummary and LinearRegressionModel [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/05/08 03:51:10 UTC, 3 replies.
- [PR] [SPARK-52036][SQL] Add SQLConfHelper trait to v2.FileScan [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/05/08 06:06:05 UTC, 3 replies.
- [PR] [SPARK-52023][SQL] Fix data corruption/segfault returning Option[Product] from udaf [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2025/05/08 06:25:10 UTC, 0 replies.
- Re: [PR] [SPARK-52033][SQL] Fix Generate node bug fix where the output of the child node can have multiple copies of the same Attribute [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/08 07:09:50 UTC, 5 replies.
- [PR] [SPARK-52037][SQL] Order in LCA inner project lists should respect order in original project list [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/05/08 07:25:31 UTC, 2 replies.
- [PR] [SPARK-52038][BUILD] Upgrade icu4j to 77.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/08 07:26:27 UTC, 2 replies.
- [PR] [SPARK-52039][CORE][SQL][TESTS] Remove unnecessary `with PrivateMethodTester` from `ClosureCleanerSuite2` and `InsertSuite` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/08 07:58:14 UTC, 3 replies.
- [PR] [SPARK-52040][SQL][CONNECT] ResolveLateralColumnAliasReference should retain the plan id [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/05/08 08:40:41 UTC, 0 replies.
- Re: [PR] [SPARK-51671][SQL] Add column pruning ro Recursive CTEs [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/08 08:48:37 UTC, 3 replies.
- Re: [PR] [SPARK-50849][Connect] Add example project to demonstrate Spark Connect Server Libraries [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/08 09:15:19 UTC, 6 replies.
- [PR] [SPARK-52013] [CONNECT] [ML] Remove `SparkConnectClient.ml_caches` [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/05/08 11:24:39 UTC, 7 replies.
- [PR] Test CI. [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/05/08 13:40:11 UTC, 1 replies.
- Re: [PR] [SPARK-52041] add better support for integrating with external cluster manager [spark] - posted by "dejanzele (via GitHub)" <gi...@apache.org> on 2025/05/08 13:56:45 UTC, 0 replies.
- [PR] [WIP][SQL] Fix an error of supported typed literals [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/05/08 14:34:52 UTC, 0 replies.
- [PR] [SPARK-52043] Upgrade `DropWizard` to 4.2.30 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/08 15:13:35 UTC, 2 replies.
- [PR] [SPARK-52044] Upgrade `log4j2` to 2.24.3 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/08 15:23:06 UTC, 2 replies.
- [PR] [SPARK-52045] Upgrade `junit` to 5.12.2 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/08 15:34:05 UTC, 3 replies.
- [PR] add handling for table not found [spark] - posted by "milastdbx (via GitHub)" <gi...@apache.org> on 2025/05/08 16:02:19 UTC, 0 replies.
- Re: [PR] Properly handle table existence check for jdbc dialects [spark] - posted by "milastdbx (via GitHub)" <gi...@apache.org> on 2025/05/08 16:03:32 UTC, 0 replies.
- [PR] [SPARK-52046] [SQL] Prettify OuterReference names when using toPrettySQL [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/05/08 18:05:19 UTC, 0 replies.
- [PR] Raise PySparkValueError for unsupported plot kinds [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/05/08 18:52:03 UTC, 0 replies.
- Re: [PR] [SPARK-52040][PYTHON][SQL][CONNECT] ResolveLateralColumnAliasReference should retain the plan id [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/05/08 20:50:15 UTC, 3 replies.
- [PR] add a new type OuterScopeReference to differentiate between outerAttr… [spark] - posted by "AveryQi115 (via GitHub)" <gi...@apache.org> on 2025/05/08 21:01:44 UTC, 0 replies.
- [PR] [SPARK-52048] Add `Swift Web Server` example repository link [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/08 22:12:22 UTC, 3 replies.
- [PR] [SPARK-51903][SQL] Validate data on adding a CHECK constraint [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/05/09 00:09:25 UTC, 14 replies.
- [PR] [SPARK-52049] Fix the bug that XML attributes can't be parsed as Variant [spark] - posted by "xiaonanyang-db (via GitHub)" <gi...@apache.org> on 2025/05/09 00:17:34 UTC, 3 replies.
- Re: [PR] [WIP][SPARK-50892][SQL]Add UnionLoopExec, physical operator for recursion, to perform execution of recursive queries [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/05/09 00:28:12 UTC, 1 replies.
- Re: [PR] [SPARK-50356][CORE] Fix inconsitent skipped stage & tasks data on UI when jobs share the same stage [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/05/09 00:28:13 UTC, 1 replies.
- Re: [PR] [SPARK-47618][CORE] Use `Magic Committer` for all S3 buckets by default [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/05/09 00:28:15 UTC, 2 replies.
- [PR] [SPARK-52040][PYTHON][SQL][CONNECT][4.0] ResolveLateralColumnAliasReference should retain the plan id [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/05/09 01:07:21 UTC, 3 replies.
- [PR] [SPARK-51983][PS][FOLLOW-UP] Replace `assertEquals` with `assertEqual' for python 3.12+ [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/05/09 02:18:18 UTC, 0 replies.
- Re: [PR] [SPARK-51291][SS] Reclassify validation errors thrown from state store loading [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/05/09 02:19:41 UTC, 1 replies.
- Re: [PR] [SPARK-51983][PS][TESTS][FOLLOW-UP] Replace `assertEquals` with `assertEqual` for python 3.12+ [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/05/09 04:03:05 UTC, 1 replies.
- [PR] [SPARK-52051] [ML] [CONNECT] Enable model summary when memory control is enabled [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/05/09 05:01:14 UTC, 1 replies.
- Re: [PR] [SPARK-51786][SQL] DSv2 expressions in column defaults in CREATE/REPLACE [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/09 05:27:58 UTC, 2 replies.
- Re: [PR] [SPARK-52047][PYTHON] Raise PySparkValueError for unsupported plot kinds [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/09 05:29:32 UTC, 1 replies.
- [PR] [SPARK-52052][CORE] Add .broadcast in the companion object of SerializableConfiguration [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/05/09 06:19:45 UTC, 2 replies.
- [PR] [SPARK-52053][PYTHON][TESTS] Enable test_job_cancellation and its parity test [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/05/09 07:17:27 UTC, 4 replies.
- Re: [PR] [SPARK-52042][SQL] Fix an error of supported typed literals [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/05/09 07:37:12 UTC, 1 replies.
- [PR] [SPARK-51789][CORE][FOLLOW-UP] Set the initial Spark Connect mode properly [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/09 07:47:41 UTC, 3 replies.
- [PR] [SPARK-52055][PYTHON][CONNECT] Suppress the exception in ExecutePlanResponseReattachableIterator.__del__ [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/09 10:02:59 UTC, 2 replies.
- Re: [PR] [SPARK-52046] [SQL] Prettify OuterReference on AggregateExpression names when using toPrettySQL [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/05/09 10:11:12 UTC, 3 replies.
- [PR] [SPARK-52057] [ML] [CONNECT] Collect Tree size limit warning messages to client [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/05/09 14:32:41 UTC, 1 replies.
- Re: [PR] [SPARK-52052][CORE] Add `.broadcast` in the companion object of `SerializableConfiguration` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/09 15:47:34 UTC, 0 replies.
- [PR] [SPARK-52058] Update `README.md` and integration test with Apache Spark 4.0.0 RC5 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/09 15:58:40 UTC, 2 replies.
- [PR] [SPARK-52059] Fix `DataFrame` to use SparkSession's `transportSecurity` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/09 16:27:53 UTC, 5 replies.
- [PR] [SQL] Make `OneRowRelationExec` node [spark] - posted by "richardc-db (via GitHub)" <gi...@apache.org> on 2025/05/09 18:45:37 UTC, 0 replies.
- [PR] [SPARK-46685][DOCS] Refine PySpark profiler user guide for clarity [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/05/09 20:38:03 UTC, 6 replies.
- Re: [PR] [WIP][SPARK-50585][PYTHON][DOCS] Render interactive PySpark plot examples [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/05/09 20:45:06 UTC, 0 replies.
- [PR] [SPARK-51906][SQL][FOLLOW-UP] Enforce ANSI mode in previous tests [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/05/09 23:27:23 UTC, 3 replies.
- [PR] [SPARK-52061] Add `getOption/isModifiable` and `set` variants to `RuntimeConf` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/10 00:01:30 UTC, 2 replies.
- [PR] [SPARK-52062] Update `CFBundleVersion` to `0.2.0` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/10 00:24:09 UTC, 1 replies.
- [PR] [SPARK-52063] Support `newSession` in `SparkSession` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/10 00:53:57 UTC, 2 replies.
- [PR] [SPARK-52064] Support `first/take/toJSON` in `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/10 01:41:10 UTC, 2 replies.
- [PR] [SPARK-52065][SQL] Produce another plan tree with output columns (name, data type, nullability) in plan change logging [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/05/10 09:49:03 UTC, 13 replies.
- Re: [I] Add Support for Additional DataFrame Functionality [spark-connect-go] - posted by "roshan989 (via GitHub)" <gi...@apache.org> on 2025/05/10 10:21:03 UTC, 0 replies.
- [PR] [SPARK-52066] Support `unpivot/melt/transpose` in `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/10 14:35:38 UTC, 2 replies.
- [PR] [SPARK-52067] Add `Examples` directory [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/10 17:10:29 UTC, 3 replies.
- [PR] [SPARK-52068] Add `StreamingQuery` actor [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/10 23:23:51 UTC, 2 replies.
- Re: [PR] [SPARK-49230][Connect][SQL] Do not return UnboundRowEncoder when not needed [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/05/11 00:30:20 UTC, 1 replies.
- [PR] fixed a typo in python/pyspark/sql/column.py [spark] - posted by "francesco-camaione (via GitHub)" <gi...@apache.org> on 2025/05/11 09:32:52 UTC, 3 replies.
- [PR] fixed typo in python/pyspark/sql/column.py [spark] - posted by "francesco-camaione (via GitHub)" <gi...@apache.org> on 2025/05/11 09:54:16 UTC, 1 replies.
- [PR] [SPARK-52069] Support `DataStreamReader` and `DataStreamWriter` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/11 15:24:56 UTC, 10 replies.
- [PR] Fix Switft 6.0 Build [spark-connect-swift] - posted by "williamhyun (via GitHub)" <gi...@apache.org> on 2025/05/11 18:08:00 UTC, 0 replies.
- Re: [PR] [SPARK-52070] Fix `Swift 6.0` compilation error [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/11 18:26:26 UTC, 2 replies.
- [PR] [SPARK-52071] Add `stream` example and revise `Trigger` names [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/11 20:43:06 UTC, 2 replies.
- [PR] [SPARK-52072] Add `option()` variants to `SparkSession` and `Data(Frame|Stream)Reader` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/11 21:08:03 UTC, 0 replies.
- [PR] [SPARK-52073] Add `pi` example [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/11 21:47:21 UTC, 2 replies.
- [PR] Use release build [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/11 23:42:08 UTC, 1 replies.
- Re: [PR] [SPARK-52072] Add `option()` variants to `SparkSession.Builder` and `Data(Frame|Stream)Reader` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/12 00:03:38 UTC, 2 replies.
- Re: [PR] [MINOR][PYSPARK][SQL] fixed a typo in python/pyspark/sql/column.py [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/12 00:07:38 UTC, 1 replies.
- Re: [PR] [SPARK-50531][SQL] Update `StringType` proto to support constraints [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/05/12 00:30:04 UTC, 1 replies.
- [PR] [SPARK-52074] Add `Dockerfile`s to all examples [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/12 02:35:51 UTC, 2 replies.
- [PR] [SPARK-52075] Add `Examples.md` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/12 04:00:53 UTC, 2 replies.
- [PR] [SPARK-52076][CONNECT] Explicitly closes ExecutePlanResponseReattachableIterator after usage [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/12 04:15:57 UTC, 3 replies.
- [PR] [SPARK-52077][PYTHON][CONNECT][TEST] Skip ArrowUDTFParityTests in Spark Connect compatibility test [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/12 06:17:07 UTC, 2 replies.
- [PR] [SPARK-52078][TEST] Rewrite ZStandardBenchmark with TPC-DS data [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/05/12 07:11:45 UTC, 11 replies.
- Re: [PR] [SPARK-50137][HIVE] Avoid fallback to Hive-incompatible ways when table creation fails by thrift exception [spark] - posted by "wecharyu (via GitHub)" <gi...@apache.org> on 2025/05/12 07:26:41 UTC, 12 replies.
- [PR] [SPARK-52079] Normalize order of attributes in inner project lists [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/05/12 08:51:22 UTC, 4 replies.
- [PR] [SPARK-52080][DOCS] Display the Daily Build Pipeline Status in `README.md` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/12 09:15:26 UTC, 9 replies.
- [PR] Bump github.com/apache/arrow-go/v18 from 18.2.0 to 18.3.0 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/05/12 13:52:59 UTC, 0 replies.
- [PR] [SPARK-52083] Update `Spark Connect`-generated `Swift` source code with 4.0.0-rc5 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/12 14:27:04 UTC, 3 replies.
- Re: [PR] [SPARK-52020][TEST] Build hive-test-udfs.jar from source [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/05/12 14:40:23 UTC, 0 replies.
- [PR] [SPARK-52084] Upgrade `gRPC Swift` to 2.2.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/12 14:51:19 UTC, 3 replies.
- [PR] [SPARK-52085] Use `release` build in GitHub Action CI [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/12 15:18:56 UTC, 2 replies.
- [PR] [SPARK-52080][DOCS][FOLLOWUP] Fix a wrong link in `Daily Build Pipeline Status` table [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/12 16:10:49 UTC, 3 replies.
- [PR] [SPARK-51980][PYTHON][TESTS][3.5] Enable `--use-pep517` in `dev/run-pip-tests` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/12 16:21:30 UTC, 5 replies.
- [PR] [SPARK-52087] [SQL] Add copying of tags and origin to AliasHelper.trimNonTopLevelAliases [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/05/12 17:01:41 UTC, 3 replies.
- [PR] [SPARK-52089] Support `StreamingQueryManager` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/12 18:58:00 UTC, 5 replies.
- [PR] [SPARK-52091] Add `function` SQL test file and answer file [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/12 19:35:42 UTC, 2 replies.
- [PR] [SPARK-52092][PYTHON] Add UDF tests for empty DataFrames [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/05/12 21:02:53 UTC, 0 replies.
- [PR] [SPARK-52094] Support `session_id` parameter [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/12 22:23:05 UTC, 2 replies.
- [PR] [SPARK-52095][SQL] Alter table alter column to pass V2Expression to DSV2 [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/05/13 00:11:24 UTC, 8 replies.
- [PR] [SPARK-52022][PYTHON][FOLLOW-UP] Explicitly check thrown exceptions [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/13 01:47:31 UTC, 3 replies.
- [PR] WIP [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2025/05/13 02:06:17 UTC, 0 replies.
- [PR] Add Swift 6 CI [spark-connect-swift] - posted by "williamhyun (via GitHub)" <gi...@apache.org> on 2025/05/13 03:42:24 UTC, 0 replies.
- Re: [PR] Add Swift 6.0 CI [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/13 04:02:22 UTC, 0 replies.
- [PR] Support JDBC in DataFrameReader and Writer [spark-connect-swift] - posted by "williamhyun (via GitHub)" <gi...@apache.org> on 2025/05/13 04:03:32 UTC, 0 replies.
- Re: [PR] [SPARK-52097] Add Swift 6.0 GitHub Action CI [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/13 04:14:32 UTC, 0 replies.
- Re: [PR] [SPARK-52098] Support JDBC in DataFrameReader and Writer [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/13 04:20:53 UTC, 1 replies.
- [PR] [SPARK-52094][FOLLOWUP] Fix the test case to respect SPARK_REMOTE env variable [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/13 04:29:25 UTC, 2 replies.
- [PR] [SPARK-52082][PYTHON] Improve ExtractPythonUDF docs [spark] - posted by "benrobby (via GitHub)" <gi...@apache.org> on 2025/05/13 07:26:54 UTC, 3 replies.
- Re: [PR] [SPARK-51519][SQL] MERGE INTO/UPDATE/DELETE support join hint [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/05/13 08:59:45 UTC, 0 replies.
- [PR] [SPARK-52099][SQL] Enable overriding the recursion row limit by adding a LIMIT operator [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/05/13 09:40:31 UTC, 11 replies.
- [PR] Revert SPARK-52046 and SPARK-52019: Strip outer references and prettify correlated aggregate functions [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/05/13 10:29:13 UTC, 3 replies.
- [PR] [SPARK-52102] [SQL] Normalize correlated aggregate function names in HAVING condition [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/05/13 10:52:53 UTC, 0 replies.
- [PR] [SPARK-52103][SQL] Fallback complex expression whole-stage codegen [spark] - posted by "wankunde (via GitHub)" <gi...@apache.org> on 2025/05/13 13:10:47 UTC, 0 replies.
- [PR] [SQL][MINOR] SQL Scripting parser improvements [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2025/05/13 14:26:04 UTC, 4 replies.
- [PR] [SPARK-52104][CONNECT][SCALA] Validate column name eagerly in Spark Connect Scala Client [spark] - posted by "xi-db (via GitHub)" <gi...@apache.org> on 2025/05/13 15:01:33 UTC, 1 replies.
- Re: [PR] [SPARK-52092][PYTHON][TESTS] Add UDF tests for empty DataFrames [spark] - posted by "the-sakthi (via GitHub)" <gi...@apache.org> on 2025/05/13 16:47:58 UTC, 0 replies.
- [PR] [SPARK-52106] Update `Helm Chart` to use `apache/spark-kubernetes-operator` for `image.repository` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/13 16:51:03 UTC, 3 replies.
- Re: [PR] [SPARK-51272][CORE] Aborting instead of continuing partially completed indeterminate result stage at ResubmitFailedStages [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/13 17:41:50 UTC, 19 replies.
- [PR] [SPARK-52105] Provide Helm Chart repository [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/13 17:44:10 UTC, 3 replies.
- Re: [PR] [SPARK-52107] Add `workflow_dispatch` to `pages.yml` to support manual trigger [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/16 14:36:57 UTC, 1 replies.
- [PR] [SPARK-52108] Enable `GitHub Pages` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/16 14:37:08 UTC, 2 replies.
- [PR] [SPARK-52052][CORE][FOLLOW-UP] Remove extra broadcast [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/05/16 14:37:26 UTC, 0 replies.
- Re: [PR] [SPARK-52126][SS][PYTHON] Revert rename for TWS utility classes for forward compatibility in Spark Connect [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/05/16 14:38:10 UTC, 2 replies.
- Re: [PR] [SPARK-52122] [ML] [CONNECT] Fix DefaultParamsReader RCE vulnerability [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/05/16 14:42:41 UTC, 2 replies.
- [PR] [SPARK-52122] [ML] [CONNECT] [Branch-4.0] Fix DefaultParamsReader RCE vulnerability [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/05/16 14:43:10 UTC, 0 replies.
- Re: [PR] [SPARK-52109] Add listTableSummaries API to Data Source V2 Table Catalog API [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2025/05/16 14:43:37 UTC, 3 replies.
- Re: [PR] [SPARK-52134] Move execution logic to SqlScriptingExecution and enable Spark Connect path [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/16 14:44:07 UTC, 1 replies.
- [PR] [SPARK-52158] Add InvalidPlanInputErrors object to centralize errors in SparkConnectPlanner [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/05/16 14:44:09 UTC, 0 replies.
- Re: [PR] [SPARK-50762][SQL][TESTS] Add more scalar SQL UDF SQL query tests [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/16 14:44:22 UTC, 3 replies.
- Re: [PR] [SPARK-52157] [SQL] Use earlier computed name for OuterReference in single-pass resolver [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/16 14:44:29 UTC, 0 replies.
- Re: [PR] [SPARK-52181] Increase variant size limit to 128MiB [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/16 15:15:28 UTC, 20 replies.
- [PR] [MINOR] Revise `Helm` chart README [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/16 15:36:14 UTC, 0 replies.
- Re: [PR] [SPARK-52173] Fix OwnerReference Patching for Spark Application Driver Resources [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/16 15:49:43 UTC, 0 replies.
- Re: [PR] [SPARK-52190] Revise `Helm` chart README [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/16 15:50:50 UTC, 1 replies.
- [PR] [SPARK-52191] [ML] [CONNECT] Remove Java deserializer in model local path loader [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/05/16 16:16:43 UTC, 1 replies.
- Re: [PR] [SPARK-52165] [SQL] [SDP] Setup build scaffolding for the pipelines project [spark] - posted by "jonmio (via GitHub)" <gi...@apache.org> on 2025/05/16 16:25:04 UTC, 7 replies.
- [PR] [SPARK-52192][ML][CONNECT] MLCache loading path check [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/05/16 16:37:33 UTC, 2 replies.
- [PR] [SPARK-52188] Fix for StateDataSource where StreamExecution.RUN_ID_KEY is not set [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/05/16 17:07:37 UTC, 9 replies.
- Re: [PR] [SPARK-52184][SQL] Wrap external engine JDBC syntax errors with a unified exception [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/16 17:19:04 UTC, 11 replies.
- Re: [PR] [SPARK-52110][SDP][SQL] Implement SQL syntax support for pipelines [spark] - posted by "AnishMahto (via GitHub)" <gi...@apache.org> on 2025/05/16 17:27:15 UTC, 29 replies.
- [PR] [SPARK-52193][K8S] Add `Spark Connect` port to Spark Driver pod and service [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/16 19:22:08 UTC, 6 replies.
- Re: [PR] [SPARK-49308][CONNECT] Support UserDefinedAggregateFunction in Spark Connect Scala Client [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2025/05/16 19:23:16 UTC, 2 replies.
- Re: [PR] [SPARK-52174][CORE] Enable `spark.checkpoint.compress` by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/16 19:28:53 UTC, 1 replies.
- Re: [PR] [SPARK-52156][SQL] Put legacy CREATE TEMPORARY TABLE ... USING provider under the flag [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/16 19:37:29 UTC, 1 replies.
- Re: [PR] [SPARK-52101][SQL] Disable Inline Forcing for rCTEs [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/16 19:39:29 UTC, 5 replies.
- [PR] [SPARK-52194] Add `spark-connect-server.yaml` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/16 20:45:59 UTC, 3 replies.
- [PR] [SPARK-52195][PYTHON][SS] Fix initial state column dropping issue for Python TWS [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2025/05/16 22:00:55 UTC, 17 replies.
- [PR] [SPARK-52196] Promote `SparkSQLRepl` code to `Spark SQL REPL` example [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/16 22:12:56 UTC, 5 replies.
- [PR] [SPARK-52181][4.0] Increase variant size limit to 128MiB [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2025/05/16 22:29:26 UTC, 4 replies.
- [PR] [SPARK-52197] Upgrade `gRPC Swift` to 2.2.1 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/16 23:01:08 UTC, 3 replies.
- [PR] [SPARK-50762][SQL][TEST][FOLLOWUP][4.0] Regenerate `sql-udf.sql.out` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/16 23:43:25 UTC, 9 replies.
- Re: [PR] [DRAFT] Remove session collation [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/05/17 00:27:25 UTC, 0 replies.
- [PR] [SPARK-52199] Remove `Spark 3.4.3` bindings in `spark-versions` E2E test [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/17 02:22:39 UTC, 2 replies.
- [PR] [MINOR] Remove broken URL link from `StatusRecorder` javadoc [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/17 02:33:52 UTC, 2 replies.
- [PR] [SPARK-52200] Make `StatusRecorder.objectMapper` static [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/17 02:43:03 UTC, 1 replies.
- [PR] [SPARK-52201] Revisit `PMD` annotations [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/17 03:12:39 UTC, 8 replies.
- [PR] [SPARK-52202] Reduce PMD exclusion rules [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/17 04:07:29 UTC, 2 replies.
- Re: [PR] [SPARK-45417][PYTHON] Make InheritableThread inherit the active session [spark] - posted by "clee704 (via GitHub)" <gi...@apache.org> on 2025/05/17 05:44:27 UTC, 0 replies.
- Re: [PR] [SPARK-45854][SQL] listTables should not fail with a temp view and DelegatingCatalogExtension [spark] - posted by "clee704 (via GitHub)" <gi...@apache.org> on 2025/05/17 05:55:38 UTC, 1 replies.
- [PR] [SPARK-52203][SQL] New iteration of single-pass Analyzer functionality [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/05/17 11:46:29 UTC, 2 replies.
- [PR] [SPARK-52206] Update GitHub Action YAML file in `branch-0.2` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/17 12:52:00 UTC, 2 replies.
- [PR] [SPARK-52207] Bump version to 0.3.0-SNAPSHOT in `main` branch [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/17 13:09:42 UTC, 2 replies.
- [PR] [SPARK-52208] Add `branch-0.2` to `publish_snapshot_*.yml` GitHub Action jobs [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/17 13:21:33 UTC, 2 replies.
- [PR] [SPARK-52209] Fix `operatorContainer.env` type [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/17 13:39:10 UTC, 2 replies.
- [PR] [MINOR] Simplify `name` in `helm install` instruction [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/17 14:04:12 UTC, 0 replies.
- Re: [PR] [MINOR] Simplify `helm install` instruction [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/17 14:07:57 UTC, 1 replies.
- [PR] [SPARK-52210] Fix `watched-namespaces` E2E test [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/17 14:15:47 UTC, 3 replies.
- Re: [PR] [WIP][SPARK-52185][CORE] Automate the thread dump collection for Spark applications [spark] - posted by "roczei (via GitHub)" <gi...@apache.org> on 2025/05/18 12:31:34 UTC, 1 replies.
- Re: [PR] [SPARK-52185][CORE] Automate the thread dump collection for Spark applications [spark] - posted by "roczei (via GitHub)" <gi...@apache.org> on 2025/05/18 16:00:37 UTC, 0 replies.
- [PR] [SPARK-52211][CONNECT] Strip suffix from `SparkConnectServer` INFO log [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/18 21:18:19 UTC, 2 replies.
- Re: [PR] [SPARK-52158][CONNECT][SQL] Add InvalidInputErrors object to centralize errors in SparkConnectPlanner [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/19 00:26:44 UTC, 2 replies.
- Re: [PR] [SPARK-48881][SQL] Add FillStaticPartitions optimization rule [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/05/19 00:30:08 UTC, 1 replies.
- [PR] [MINOR] Revise SparkSession documentation [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/19 01:32:59 UTC, 2 replies.
- [PR] [SPARK-52212][PYTHON][INFRA] Upgrade linter image to python 3.11 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/05/19 01:53:33 UTC, 3 replies.
- Re: [PR] [DO-NOT-MERGE][SPARK-52179][INFRA] GitHub workflow for releasing the official Apache Spark [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/19 03:08:01 UTC, 1 replies.
- Re: [PR] [SPARK-52060][SQL] Make `OneRowRelationExec` node [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/19 07:02:15 UTC, 26 replies.
- Re: [PR] [SPARK-52189][SQL] New golden file tests for NATURAL JOIN with GROUP BY, HAVING, ORDER BY and LCAs [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/05/19 08:07:59 UTC, 1 replies.
- [PR] SPARK-52032: fix orc filter pushdown with null-safe equality operator [spark] - posted by "yuexing (via GitHub)" <gi...@apache.org> on 2025/05/19 08:37:43 UTC, 0 replies.
- Re: [PR] [SPARK-52032][SQL] Fix orc filter pushdown with null-safe equality operator [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/19 08:39:17 UTC, 11 replies.
- Re: [PR] [SPARK-52109][SQL] Add listTableSummaries API to Data Source V2 Table Catalog API [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/19 09:19:43 UTC, 1 replies.
- Re: [PR] [SPARK-52215][PYTHON][CONNECT] Implement Scalar Arrow UDF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/05/19 09:24:39 UTC, 11 replies.
- [PR] [WIP] [SPARK-47547] BloomFilter fpp degradation [spark] - posted by "ishnagy (via GitHub)" <gi...@apache.org> on 2025/05/19 09:37:47 UTC, 13 replies.
- Re: [PR] [SPARK-52159][SQL] Properly handle table existence check for jdbc dialects [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/05/19 09:38:31 UTC, 1 replies.
- [PR] [SPARK-52216] Make InvalidCommandInput a user-facing error [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/05/19 10:05:39 UTC, 0 replies.
- [PR] [SPARK-52217] [SQL] Skip outer reference validation under Filter in single-pass resolver [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/05/19 10:32:55 UTC, 5 replies.
- Re: [PR] [SPARK-51425][Connect] Add client API to set custom `operation_id` [spark] - posted by "virrrat (via GitHub)" <gi...@apache.org> on 2025/05/19 12:22:29 UTC, 1 replies.
- Re: [PR] [SPARK-51927][SPARK-52213][BUILD] Upgrade jackson to 2.19.0 and upgrade kubernetes-client to version 7.3.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/19 12:35:41 UTC, 12 replies.
- [PR] Bump google.golang.org/grpc from 1.71.0 to 1.72.1 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/05/19 13:13:04 UTC, 2 replies.
- Re: [PR] Bump google.golang.org/grpc from 1.71.0 to 1.72.0 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/05/19 13:13:06 UTC, 1 replies.
- Re: [PR] [SPARK-44422][CONNECT] Spark Connect fine grained interrupt [spark] - posted by "virrrat (via GitHub)" <gi...@apache.org> on 2025/05/19 13:13:57 UTC, 2 replies.
- [PR] [SPARK-52218][SQL] Make current datetime functions evaluable again [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/19 14:23:45 UTC, 6 replies.
- [PR] [SPARK-52219][SQL] Schema level collation support for tables [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2025/05/19 14:30:26 UTC, 19 replies.
- [PR] [SPARK-52220] Update `README.md` and integration test with Apache Spark 4.0.0 RC7 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/19 14:35:05 UTC, 3 replies.
- [PR] [SPARK-52221][SQL] Refactor SqlScriptingLocalVariableManager into more generic context manager [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2025/05/19 14:44:49 UTC, 3 replies.
- [PR] [SPARK-52079][SQL][Followup] Normalize internal projections under Aggregate as well [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/05/19 14:47:48 UTC, 5 replies.
- [PR] [] [spark] - posted by "anton5798 (via GitHub)" <gi...@apache.org> on 2025/05/19 15:17:23 UTC, 0 replies.
- [PR] [SPARK-52222] Upgrade `kubernetes-client` to 7.3.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/19 16:05:34 UTC, 2 replies.
- [PR] [SQL][MINOR] Fix error desription for RECURSION_LEVEL_LIMIT_EXCEEDED [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/05/19 16:14:27 UTC, 2 replies.
- Re: [PR] [SPARK-52166] [SDP] Add support for PipelineEvents [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/05/19 16:47:29 UTC, 27 replies.
- Re: [PR] [SPARK-52187][SQL] Introduce Join pushdown for DSv2 [spark] - posted by "alekjarmov (via GitHub)" <gi...@apache.org> on 2025/05/19 17:50:16 UTC, 35 replies.
- [PR] [WIP] Add SDP Spark Connect Protos [spark] - posted by "aakash-db (via GitHub)" <gi...@apache.org> on 2025/05/19 18:46:20 UTC, 0 replies.
- [PR] [SPARK-51984][SQL] Support Check Constraint enforcement in UpdateTable and MergeIntoTable [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/05/19 18:59:48 UTC, 9 replies.
- Re: [PR] [SPARK-51430][PYTHON] Stop PySpark context logger from propagating logs to stdout [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/05/19 19:07:00 UTC, 3 replies.
- Re: [PR] [SPARK-52223] Add SDP Spark Connect Protos [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/05/19 21:48:30 UTC, 5 replies.
- Re: [PR] [SPARK-42931][SS] Introduce dropDuplicatesWithinWatermark [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2025/05/19 23:38:56 UTC, 22 replies.
- [PR] [SPARK-52224] Introduce pyyaml as a dependency for the Python client [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/05/19 23:45:14 UTC, 0 replies.
- Re: [PR] [SPARK-52223][CONNECT] Add SDP Spark Connect Protos [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/05/20 01:49:25 UTC, 31 replies.
- [PR] [SPARK-52225][BUILD][4.0][3.5] Avoid using interactive TTY mode in release scripts for branch-3.5 and 4.0 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/20 03:47:38 UTC, 2 replies.
- [PR] [SPARK-51272][CORE][3.5] Aborting instead of continuing partially completed indeterminate result stage at ResubmitFailedStages [spark] - posted by "attilapiros (via GitHub)" <gi...@apache.org> on 2025/05/20 04:12:08 UTC, 7 replies.
- [PR] [SPARK-52178][BUILD][FOLLOW-UP] Respect ANSWER for checking tags [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/20 04:22:34 UTC, 2 replies.
- Re: [PR] [SPARK-45926][SQL] Implementing equals and hashCode which takes into account pushed runtime filters , in InMemoryTable related scans [spark] - posted by "li-boxuan (via GitHub)" <gi...@apache.org> on 2025/05/20 04:48:17 UTC, 3 replies.
- [PR] [SPARK-52178][BUILD][FOLLOW-UP] Pass ANSWER environment variable to Docker container [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/20 05:08:04 UTC, 2 replies.
- [PR] [SPARK-52226] Strengthen unusual equality checks in three operators [spark] - posted by "li-boxuan (via GitHub)" <gi...@apache.org> on 2025/05/20 05:41:01 UTC, 1 replies.
- [PR] [SPARK-52181][SQL][FOLLOWUP] Avoid OOM in variant tests [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/20 05:51:18 UTC, 4 replies.
- Re: [PR] [SPARK-52153][SQL] Fix from_json and to_json with variant [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2025/05/20 06:11:11 UTC, 6 replies.
- [PR] Test refactor Spark-protobuf assembly [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/20 06:41:06 UTC, 0 replies.
- Re: [PR] [SPARK-52227][PROTOBUF][BUILD] Make packaging results of the `spark-protobuf` module generated by Maven and sbt remain consistent [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/20 06:50:14 UTC, 1 replies.
- Re: [PR] [SPARK-52216][SQL][CONNECT] Make InvalidCommandInput a user-facing error [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/20 06:56:36 UTC, 2 replies.
- [PR] [SPARK-52228][SS][PYSPARK] Construct the benchmark purposed TWS state server with in-memory state impls and the benchmark code in python [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/05/20 07:33:07 UTC, 7 replies.
- [PR] [SPARK-52181][SQL][FOLLOWUP][4.0] Avoid OOM in variant tests [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/20 09:38:44 UTC, 3 replies.
- [PR] [SPARK-52229][ML][CONNECT] Improve model size estimation [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/05/20 10:05:32 UTC, 3 replies.
- [PR] [SPARK-52231][BUILD] Propagate GITHUB_ACTIONS environment variable in release script [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/20 10:08:37 UTC, 4 replies.
- Re: [PR] [SPARK-52227][PROTOBUF][BUILD] Make packaging results of the `spark-protobuf` module generated by maven and sbt remain consistent [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/20 13:02:00 UTC, 1 replies.
- [PR] [SPARK-52232][SQL] Fix non-deterministic queries to produce different results at every step [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/05/20 13:14:03 UTC, 25 replies.
- Re: [PR] [SPARK-52224][CONNECT][PYTHON] Introduce pyyaml as a dependency for the Python client [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/05/20 14:45:41 UTC, 4 replies.
- [PR] [SPARK-51820][SQL][FOLLOWUP][CONNECT] Don't add `UnresolvedOrdinal` when appending grouping to aggregate expressions [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/05/20 15:41:03 UTC, 2 replies.
- Re: [PR] [SPARK-52226] [SQL] Strengthen unusual equality checks in three operators [spark] - posted by "li-boxuan (via GitHub)" <gi...@apache.org> on 2025/05/20 17:25:21 UTC, 2 replies.
- Re: [PR] [SPARK-52234][SQL] Fix error on non-string input to schema_of_csv/xml [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/20 18:29:58 UTC, 1 replies.
- [PR] [SPARK-52235][SQL] Add implicit cast to DefaultValue V2 Expressions passed to DSV2 [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/05/20 20:16:02 UTC, 20 replies.
- [PR] [SPARK-52236][SQL] Standardize analyze exceptions for default value [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/05/20 22:10:46 UTC, 16 replies.
- [PR] [SPARK-XXXXX][SQL] Skip redundant row copy after unsafe projection [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/05/21 00:58:25 UTC, 2 replies.
- [PR] [SPARK-52237][DOCS] Fix the documentation of hypot function [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/05/21 03:12:11 UTC, 2 replies.
- [PR] [SPARK-52238] Python client for Declarative Pipelines [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/05/21 03:39:59 UTC, 0 replies.
- [PR] [SPARK-52239][PYTHON] Support register an arrow UDF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/05/21 04:18:29 UTC, 0 replies.
- [PR] [SPARK-52241][BUILD] Upload to repository in parallel in release script [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/21 05:14:47 UTC, 2 replies.
- [PR] [SPARK-52240][Core] Fix VectorizedDeltaLengthByteArrayReader.readBinary to handle current row [spark] - posted by "wgtmac (via GitHub)" <gi...@apache.org> on 2025/05/21 05:15:44 UTC, 6 replies.
- [PR] [SPARK-52233][SQL] Fix map_zip_with for Floating Point Types [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2025/05/21 06:09:37 UTC, 9 replies.
- Re: [PR] [SPARK-52238][PYTHON] Python client for Declarative Pipelines [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/05/21 08:40:06 UTC, 6 replies.
- Re: [PR] [SPARK-48234][SQL] Fix previous reader checks in Vectorized DELTA_BYTE_ARRAY decoder [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/05/21 08:46:04 UTC, 4 replies.
- [PR] Corrected row index usage when exploding packed arrays in vectorized reader [spark] - posted by "djspiewak (via GitHub)" <gi...@apache.org> on 2025/05/21 09:13:42 UTC, 8 replies.
- [PR] [SPARK-52241][BUILD][FOLLOW-UP] Make it fail if one of the curls fails [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/21 12:28:19 UTC, 2 replies.
- Re: [PR] [SPARK-52240][SQL] Fix VectorizedDeltaLengthByteArrayReader.readBinary to handle current row [spark] - posted by "wgtmac (via GitHub)" <gi...@apache.org> on 2025/05/21 14:46:40 UTC, 12 replies.
- [PR] [SPARK-52247] Upgrade `gRPC Swift Protobuf` to 1.3 and `gRPC Swift NIO Transport` to 1.2 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/21 15:38:12 UTC, 1 replies.
- [PR] Empty commit [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/21 16:19:42 UTC, 1 replies.
- Re: [PR] [SPARK-52247] Upgrade `gRPC Swift Protobuf` to 1.3 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/21 16:27:42 UTC, 1 replies.
- [PR] [SPARK-52248] Use `exact` versions of dependency [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/21 16:40:32 UTC, 5 replies.
- [PR] tijiao [spark] - posted by "a-little-tutu (via GitHub)" <gi...@apache.org> on 2025/05/21 16:52:40 UTC, 1 replies.
- Re: [PR] [SPARK-52247] Upgrade `gRPC Swift Protobuf` to 1.3.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/21 17:41:20 UTC, 1 replies.
- [PR] Added Test file [spark] - posted by "Ayush01800 (via GitHub)" <gi...@apache.org> on 2025/05/21 17:54:28 UTC, 1 replies.
- [PR] [WIP] [SPARK-51984][SQL] Support Check Constraint enforcement in UpdateTable and MergeIntoTable [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/05/21 20:14:23 UTC, 2 replies.
- Re: [PR] [SPARK-52239][PYTHON][CONNECT] Support register an arrow UDF [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/05/21 20:39:35 UTC, 2 replies.
- [PR] [WIP][SPARK-52249][PS] Enable divide-by-zero with ANSI enabled [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/05/21 20:46:11 UTC, 0 replies.
- Re: [PR] [SPARK-51250][K8S] Add Support for K8s PriorityClass Configuration fo… [spark] - posted by "zemin-piao (via GitHub)" <gi...@apache.org> on 2025/05/21 21:37:07 UTC, 0 replies.
- Re: [PR] [SPARK-52179][INFRA] GitHub workflow for releasing the official Apache Spark [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/21 23:40:10 UTC, 8 replies.
- [PR] [SPARK-52250] Promote Spark CRDs to `v1beta1` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/21 23:53:25 UTC, 3 replies.
- [PR] [SPARK-52252][SQL][FOLLOWUP] ScalaUDF encoders in subquery should be resolved [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/05/22 00:30:25 UTC, 0 replies.
- [PR] [SPARK-52253] Support both `v1alpha1` and `v1beta1` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/22 00:59:45 UTC, 3 replies.
- Re: [PR] [SPARK-52252][SQL] ScalaUDF encoders in subquery should be resolved [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/22 01:31:42 UTC, 4 replies.
- [PR] [DO-NOT-MERGE][SPARK-52254][INFRA] Adds a GitHub Actions workflow to convert RC to the official release [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/22 02:05:51 UTC, 2 replies.
- [PR] [SPARK-52255][BUILD] Adds a new environment variable SPARK_RC_COUNT in release script [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/22 02:24:10 UTC, 2 replies.
- [PR] [SPARK-52256][ML] Make Param.paramValueClassTag private [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/05/22 02:42:20 UTC, 2 replies.
- [PR] [MINOR][INFRA] Limit build_python_3.11_macos execution time to up to 2 hours [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/05/22 03:44:15 UTC, 0 replies.
- [PR] [MINOR][INFRA] Limit build_python_3.11_macos execution time to up to 2 hours [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/05/22 03:45:22 UTC, 3 replies.
- [PR] [SPARK-52179][INFRA][FOLLOW-UP] Do not quote wildcard in logs [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/22 04:08:26 UTC, 2 replies.
- [PR] [SPARK-52258][BUILD] Increase the number of retries and decrease the parallelism in the release script [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/22 04:12:07 UTC, 2 replies.
- [PR] [SPARK-52259][ML][CONNECT] Fix Param class binary compatibility [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/05/22 04:22:03 UTC, 5 replies.
- [PR] [SPARK-52260][SQL][TESTS] Add test for Update/Merge Into/Delete From table [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/05/22 04:46:20 UTC, 5 replies.
- Re: [PR] [SPARK-52257][PYTHON][TESTS] Add tests for chained arrow UDF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/05/22 08:04:14 UTC, 1 replies.
- [PR] [SPARK-52258][BUILD][FOLLOW-UP] Add retries when connecting to the ASF repo [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/22 08:05:18 UTC, 1 replies.
- [PR] [SPARK-52179][INFRA][FOLLOW-UP] Skip dryruns in forked repository [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/22 08:15:43 UTC, 3 replies.
- [PR] [SPARK-52262][SQL] swap order of withConnection and classifyException in loadTable [spark] - posted by "alekjarmov (via GitHub)" <gi...@apache.org> on 2025/05/22 11:55:12 UTC, 8 replies.
- [PR] Move the benchmark code related to Sorter from `SorterSuite` to `SorterBenchmark` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/22 12:29:37 UTC, 0 replies.
- Re: [PR] [SPARK-50137][SQL] Avoid fallback to Hive-incompatible ways when table creation fails by thrift exception [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/22 14:21:56 UTC, 3 replies.
- Re: [PR] [SPARK-52226] [SQL] Fix unusual equality checks in three operators [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/22 15:14:46 UTC, 1 replies.
- [PR] [SPARK-52264][PS][TESTS] Test divide-by-zero behavior with more numeric data types [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/05/22 18:33:59 UTC, 1 replies.
- [PR] [SPARK-52265][SQL][TEST] Fix regex leading to empty PROCESS_TABLES.testingVersions in HiveExternalCatalogVersionsSuite [spark] - posted by "efaracci018 (via GitHub)" <gi...@apache.org> on 2025/05/22 19:59:29 UTC, 3 replies.
- [PR] [SPARK-52267] Match field ID in ParquetToSparkSchemaConverter [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2025/05/22 20:58:50 UTC, 1 replies.
- [PR] [SPARK-52268] Add `variant` SQL test and answer file [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/22 21:06:26 UTC, 3 replies.
- [PR] [SPARK-52269] Add `cast` SQL test and answer file [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/22 21:15:41 UTC, 3 replies.
- [PR] [SPARK-52271] Upgrade Spark to 4.0.0 in CIs and docs [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/22 21:58:08 UTC, 5 replies.
- [PR] [SPARK-52005] Upgrade Spark build dependency to 4.0.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/22 22:02:33 UTC, 5 replies.
- [PR] [SPARK-52272][SQL] HiveExternalCatalog alter table loses comment updates [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/05/22 22:08:28 UTC, 0 replies.
- Re: [PR] [SPARK-52272][SQL] HiveExternalCatalog alter table should update column comments [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/05/22 22:19:41 UTC, 9 replies.
- [PR] [SPARK-52273] Use Apache Spark `4.0.0` docker image instead of `4.0.0-preview2` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/22 22:30:14 UTC, 5 replies.
- [PR] [SPARK-52169][PYTHON][DOCS] User guide for native plotting [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/05/22 22:42:25 UTC, 1 replies.
- [PR] [SPARK-52274] Update `ArrowReader/Writer` with GH-44910 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/22 22:47:28 UTC, 2 replies.
- Re: [PR] [SPARK-52240] Corrected row index usage when exploding packed arrays in vectorized reader [spark] - posted by "djspiewak (via GitHub)" <gi...@apache.org> on 2025/05/22 22:59:50 UTC, 9 replies.
- [PR] [SPARK-52143][TESTS] Add test for table constraints with `current_*` functions [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/05/22 23:17:46 UTC, 3 replies.
- Re: [PR] [SPARK-51088][SQL] Update comments for the `ResolveFunctions` rule [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/05/23 00:28:40 UTC, 1 replies.
- Re: [PR] [SPARK-41360][CORE] Avoid BlockManager re-registration if the executor has been lost [spark] - posted by "guangyu-yang-rokt (via GitHub)" <gi...@apache.org> on 2025/05/23 00:57:20 UTC, 0 replies.
- [PR] [SPARK-52225][BUILD][FOLLOW-UP] Change -it to -ti in Docker execution in release script [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/23 02:54:01 UTC, 2 replies.
- [PR] [SPARK-52276][BUILD] Make ANSWER not to be overwritten in release scripts [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/23 03:21:34 UTC, 2 replies.
- Re: [PR] [SPARK-52263][CORE][TESTS] Move the benchmark code related to `Sorter` from `SorterSuite` to `SorterBenchmark` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/23 04:20:02 UTC, 3 replies.
- [PR] [SPARK-52277] Upgrade Docker tags to `4.0.0` instead of `4.0.0-preview2` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/23 06:17:52 UTC, 4 replies.
- [PR] [SPARK-52278][PYTHON] Scalar Arrow UDF support named arguments [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/05/23 06:33:53 UTC, 2 replies.
- [PR] [SPARK-52243] Add NERF support for schema-related InvalidPlanInput errors [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/05/23 12:25:44 UTC, 0 replies.
- [PR] [MINOR] Update known_translations [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/23 15:18:52 UTC, 3 replies.
- [PR] [SPARK-52280][INFRA] Bump previousSparkVersion to 4.0.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/23 16:18:46 UTC, 5 replies.
- Re: [PR] [SPARK-52280][TEST] Upgrade `MiMa` to use 4.0.0 as `previousSparkVersion` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/23 16:46:35 UTC, 2 replies.
- [PR] Test sbt 1.0.11 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/23 16:50:56 UTC, 2 replies.
- [PR] [SPARK-52281][SQL] Changed `ALTER TABLE ALTER COLUMN TYPE STRING` not to apply default collation if original data type was instance of `StringType` [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2025/05/23 17:01:56 UTC, 0 replies.
- Re: [PR] [SPARK-52249][PS] Enable divide-by-zero with ANSI enabled [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/05/23 20:17:30 UTC, 6 replies.
- [PR] [SPARK-52283][CONNECT] SDP `DataflowGraph` creation and resolution [spark] - posted by "aakash-db (via GitHub)" <gi...@apache.org> on 2025/05/23 20:32:23 UTC, 0 replies.
- Re: [PR] [SPARK-52283][CONNECT] Declarative Pipelines `DataflowGraph` creation and resolution [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/05/23 21:35:37 UTC, 17 replies.
- [PR] [SPARK-52286] Publish Apache Spark 4.0.0 to docker registry [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/23 22:42:05 UTC, 12 replies.
- [PR] [SPARK-52171] StateDataSource join implementation for state v3 [spark] - posted by "liviazhu-db (via GitHub)" <gi...@apache.org> on 2025/05/24 00:12:02 UTC, 0 replies.
- [PR] [SPARK-52287][CORE] Improve `SparkContext` not to populate `o.a.s.internal.io.cloud.*`-related setting if not exist [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/24 00:35:29 UTC, 5 replies.
- [PR] [WIP] Avoid INVALID_ARRAY_INDEX in `split` when ANSI mode is on [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/05/24 02:39:34 UTC, 0 replies.
- [PR] [SPARK-52289] Enable `jsonToDdl` test in Linux environment [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/24 03:51:28 UTC, 3 replies.
- Re: [PR] [SPARK-44223][CORE] Remove LevelDB support [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/24 04:36:47 UTC, 11 replies.
- [PR] [SPARK-52272][SQL] V2SessionCatalog does not alter schema on Hive Catalog [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/05/24 05:00:45 UTC, 12 replies.
- Re: [PR] [SPARK-52281][SQL] Change `ALTER TABLE ALTER COLUMN TYPE STRING` not to apply default collation if original data type was instance of `StringType` [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2025/05/24 06:17:14 UTC, 15 replies.
- [PR] Fix the Maven compilation and testing issues for `sql/pipelines` module [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/24 07:43:48 UTC, 0 replies.
- Re: [PR] [SPARK-52290][SQL][BUILD] Fix the Maven compilation and testing issues for `sql/pipelines` module [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/24 07:54:19 UTC, 4 replies.
- [PR] [SPARK-52291] Remove `nightly` info from `README.md` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/24 14:20:56 UTC, 2 replies.
- [PR] [SPARK-52292] Use `super-linter` for markdown files [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/24 16:14:59 UTC, 4 replies.
- [PR] [INFRA] Add `sql/pipelines` to maven daily test module list [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/24 16:32:11 UTC, 0 replies.
- Re: [PR] [SPARK-52294][INFRA] Add `sql/pipelines` to maven daily test module list [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/24 16:33:06 UTC, 3 replies.
- [PR] [SPARK-52293] Use `super-linter` for markdown files [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/24 16:34:32 UTC, 4 replies.
- [PR] [SPARK-52295] Add `pi-v1alpha1.yaml` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/24 17:20:35 UTC, 3 replies.
- [PR] [SPARK-52296] Add `spark-role=operator` label [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/24 19:00:42 UTC, 5 replies.
- [PR] [SPARK-47618] Use Magic Committer for all S3 buckets by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/24 19:57:20 UTC, 1 replies.
- [PR] [SPARK-52297] Add `Swift`-based `SparkPi` K8s Job example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/24 21:56:00 UTC, 2 replies.
- Re: [PR] [SPARK-52297] Add `Swift`-based `SparkPi` K8s `Job` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/24 23:16:57 UTC, 1 replies.
- Re: [PR] [WIP][DO-NOT-MERGE][SPARK-51211][SS] Rename the option of readChangeFeed to readChangeLog in state store reader [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/05/25 00:31:41 UTC, 1 replies.
- Re: [PR] [SPARK-51203][SQL] Enhance force optimize skewed join [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/05/25 00:31:42 UTC, 1 replies.
- [PR] SPARK-52299: replace deprecated JsonNode.fields [spark] - posted by "yuexing (via GitHub)" <gi...@apache.org> on 2025/05/25 09:55:40 UTC, 0 replies.
- [PR] Increase report interval of spaming logs to 10 seconds [spark] - posted by "Avihais12344 (via GitHub)" <gi...@apache.org> on 2025/05/25 11:13:31 UTC, 1 replies.
- Re: [PR] [SPARK-52299][CORE] replace deprecated JsonNode.fields [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/25 13:09:41 UTC, 4 replies.
- [PR] SPARK-48660 fix explain result for CreateTableAsSelect [spark] - posted by "yuexing (via GitHub)" <gi...@apache.org> on 2025/05/25 15:51:18 UTC, 0 replies.
- Re: [PR] [SPARK-47618][CORE] Use Magic Committer for all S3 buckets by default [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/05/25 16:58:31 UTC, 3 replies.
- [PR] [SPARK-52300] Make SQL UDTVF resolution use consistent configurations with view resolution [spark] - posted by "brkyvz (via GitHub)" <gi...@apache.org> on 2025/05/25 21:58:56 UTC, 1 replies.
- Re: [PR] [Only Test][Don't Review] Make `FilterExec` to support `subexpressionElimination` in the codegen scenario [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/05/26 00:29:38 UTC, 1 replies.
- Re: [PR] [SPARK-46937][SQL] Improve concurrency performance for FunctionRegistry [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/05/26 00:29:39 UTC, 1 replies.
- Re: [PR] [SPARK-43301][CORE][SHUFFLE] BlockStoreClient getHostLocalDirs RPC supports IOException retry [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/05/26 00:29:40 UTC, 1 replies.
- [PR] [SPARK-52301] Support `Decimal` type [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/26 01:38:08 UTC, 4 replies.
- Re: [PR] [SPARK-48660][SQL] Fix explain result for CreateTableAsSelect [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/26 02:56:33 UTC, 11 replies.
- [PR] [SPARK-52302] Improve `stop` to use `ReleaseSessionRequest` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/26 03:07:18 UTC, 4 replies.
- [PR] [SPARK-52303][CORE] Promote `ExternalCommandRunner` to `Stable` API [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/26 03:37:38 UTC, 1 replies.
- Re: [PR] [SPARK-52303][CORE] Promote `ExternalCommandRunner` to `Stable` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/26 04:02:28 UTC, 2 replies.
- [PR] [SPARK-52304] Add `pi-with-driver-timeout.yaml` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/26 05:01:27 UTC, 0 replies.
- Re: [PR] [SPARK-52304] Add `pi-with-driver-timeout` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/26 05:57:48 UTC, 1 replies.
- [PR] [SPARK-52305][PYTHON] Refine the docstring for isnotnull, equal_null, nullif, nullifzero, nvl, nvl2, zeroifnull [spark] - posted by "drexler-sky (via GitHub)" <gi...@apache.org> on 2025/05/26 06:03:04 UTC, 2 replies.
- [PR] [SPARK-52306][SQL] Add support of ALTER TABLE ... UNSET SERDEPROPERTIES [spark] - posted by "wecharyu (via GitHub)" <gi...@apache.org> on 2025/05/26 06:19:53 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-52288][PS] Avoid INVALID_ARRAY_INDEX in `split` when ANSI mode is on [spark] - posted by "abhiips07 (via GitHub)" <gi...@apache.org> on 2025/05/26 06:21:05 UTC, 5 replies.
- [PR] [SPARK-52307][PYTHON][CONNECT] Support Scalar Arrow Iterator UDF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/05/26 07:07:09 UTC, 1 replies.
- Re: [PR] [SPARK-52243][CONNECT] Add NERF support for schema-related InvalidPlanInput errors [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/05/26 08:35:40 UTC, 5 replies.
- [PR] [SPARK-52308][CORE] Fix the issue that the actual configs of the driv… [spark] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2025/05/26 10:00:20 UTC, 0 replies.
- [PR] [SPARK-52309][SQL][TESTS] Add `log4j2.properties` to `pipelines` module for testing [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/26 10:57:18 UTC, 3 replies.
- Re: [PR] [SPARK-51534][Core] Improve parquet read performance by reducing unnecessary operations when converting parquet to row [spark] - posted by "TheR1sing3un (via GitHub)" <gi...@apache.org> on 2025/05/26 11:07:52 UTC, 2 replies.
- [PR] [SPARK-52310][SQL][BUILD] Fix code change detection for `pipelines` module [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/26 11:36:09 UTC, 4 replies.
- Re: [PR] [SPARK-52300][SQL] Make SQL UDTVF resolution use consistent configurations with view resolution [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/26 13:57:02 UTC, 15 replies.
- [PR] Bump google.golang.org/grpc from 1.71.0 to 1.72.2 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/05/26 13:57:26 UTC, 0 replies.
- [PR] [SPARK-52311][SQL] Fix bug with multiple self-references with UnresolvedSubqueries in rCTEs [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/05/26 13:58:35 UTC, 2 replies.
- [PR] [SPARK-52313][SQL] Correctly resolve reference data type for Views with default collation [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2025/05/26 21:04:27 UTC, 6 replies.
- [PR] SPARK-52314: Upgrade kubernetes-client to version 7.3.1 [spark] - posted by "williamhyun (via GitHub)" <gi...@apache.org> on 2025/05/26 21:07:27 UTC, 1 replies.
- [PR] SPARK-52315: Upgrade kubernetes-client to version 7.3.1 [spark-kubernetes-operator] - posted by "williamhyun (via GitHub)" <gi...@apache.org> on 2025/05/26 21:11:43 UTC, 2 replies.
- [PR] [SPARK-52316][BUILD] Upgrade Kafka to 3.9.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/26 21:42:51 UTC, 4 replies.
- Re: [PR] [SPARK-52314][K8S] Upgrade `kubernetes-client` to version 7.3.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/26 22:25:40 UTC, 1 replies.
- [PR] [SPARK-52317] Identify `InvalidTypeException` in `SparkConnectClient` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/26 23:45:26 UTC, 6 replies.
- [PR] [SPARK-52318] Refactor `SparkConnectError` to simplify case names [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/27 02:11:12 UTC, 4 replies.
- [PR] [SPARK-52319] Add `(Catalog|Schema|TableOrView)NotFound` to `SparkConnectError` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/27 03:04:13 UTC, 3 replies.
- [PR] [SPARK-52320] Add `ColumnNotFound/InvalidViewName/TableOrViewAlreadyExists` to `SparkConnectError` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/27 04:44:24 UTC, 2 replies.
- [PR] [SPARK-52321] Add `SessionClosed`, `SqlConfNotFound`, `ParseSyntaxError` to `SparkConnectError` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/27 05:38:05 UTC, 0 replies.
- [PR] [SPARK-52322] Publish `apache/spark-connect-swift:pi` docker image [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/27 05:50:23 UTC, 0 replies.
- Re: [PR] [SPARK-52321] Add `SessionClosed/SqlConfNotFound/ParseSyntaxError` to `SparkConnectError` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/27 05:54:35 UTC, 1 replies.
- Re: [PR] [SPARK-52322] Add `publish_image` GitHub Action job [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/27 05:56:18 UTC, 2 replies.
- [PR] [SPARK-52324][INFRA] Move Spark docs to the release directory [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/27 06:36:49 UTC, 3 replies.
- Re: [PR] [SPARK-52267][SQL] Match field ID in ParquetToSparkSchemaConverter [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/27 08:19:16 UTC, 1 replies.
- [PR] [SPARK-52088][repl]Redesign ClosureCleaner Implementation to not use … [spark] - posted by "yuexing (via GitHub)" <gi...@apache.org> on 2025/05/27 09:08:54 UTC, 0 replies.
- [PR] [SPARK-52325] Publish Apache Spark 3.5.6 to docker registry [spark-docker] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/27 09:57:05 UTC, 13 replies.
- Re: [PR] [SPARK-52254][INFRA] Adds a GitHub Actions workflow to convert RC to the official release [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/05/27 09:58:06 UTC, 1 replies.
- Re: [PR] [SPARK-47547] BloomFilter fpp degradation [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/05/27 10:54:32 UTC, 8 replies.
- [PR] [SPARK-52312][SQL] Ignore plans inapplicable for caching [spark] - posted by "qiyuandong-db (via GitHub)" <gi...@apache.org> on 2025/05/27 13:00:56 UTC, 0 replies.
- [PR] Add partition related ExternalCatalogEvent and post them in external catalog related operations [spark] - posted by "waterlx (via GitHub)" <gi...@apache.org> on 2025/05/27 13:09:52 UTC, 0 replies.
- Re: [PR] Add partitions related ExternalCatalogEvent and post them in corresponding operations [spark] - posted by "waterlx (via GitHub)" <gi...@apache.org> on 2025/05/27 13:19:02 UTC, 0 replies.
- [PR] Small improvements to Python Spark Connect installation docs [spark] - posted by "sryza (via GitHub)" <gi...@apache.org> on 2025/05/27 14:21:56 UTC, 2 replies.
- [PR] [SPARK-52328] Use `apache/spark-connect-swift:pi` image [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/27 15:06:31 UTC, 2 replies.
- Re: [PR] [SPARK-51069][SQL] Add big-endian support to UnsafeRowUtils.validateStructuralIntegrityWithReasonImpl [spark] - posted by "jonathan-albrecht-ibm (via GitHub)" <gi...@apache.org> on 2025/05/27 15:10:17 UTC, 0 replies.
- [PR] [SPARK-52286][FOLLOWUP] Move `latest`, `scala`, `python3`, `python3-java17`, `r` tag [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/27 15:20:07 UTC, 3 replies.
- Re: [PR] Enable -Xsource:3 compiler flag [spark] - posted by "MasseGuillaume (via GitHub)" <gi...@apache.org> on 2025/05/27 16:47:06 UTC, 6 replies.
- Re: [PR] [SPARK-52088][CORE] Refactor the `ClosureCleaner#clean` and avoid using the `-Djdk.reflect.useDirectMethodHandle=false` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/27 16:53:01 UTC, 13 replies.
- Re: [PR] [SPARK-52312][SQL] Ignore caching for inapplicable plans used by INSERT [spark] - posted by "qiyuandong-db (via GitHub)" <gi...@apache.org> on 2025/05/27 18:38:50 UTC, 0 replies.
- [PR] [SPARK-52312][SQL] Ignore V2WriteCommand when caching DataFrame [spark] - posted by "qiyuandong-db (via GitHub)" <gi...@apache.org> on 2025/05/27 19:01:17 UTC, 8 replies.
- [PR] [SPARK-52329][SS] Remove private sql scoping tags for new transformWithState API [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/05/27 19:15:41 UTC, 6 replies.
- [PR] Exception handling improvements [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2025/05/27 19:54:54 UTC, 0 replies.
- Re: [PR] [SPARK-48353][FOLLOW UP][SQL] Exception handling improvements [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2025/05/27 19:56:27 UTC, 4 replies.
- [PR] [SPARK-52331][PS][TESTS] Adjust test for promotion from float32 to float64 during division [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/05/28 00:10:12 UTC, 1 replies.
- Re: [PR] [SPARK-52283][SQL] Declarative Pipelines `DataflowGraph` creation and resolution [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/28 03:49:06 UTC, 73 replies.
- [PR] [SPARK-52333][SS][PYTHON] Squeeze the protocol of retrieving timers for transformWithState in PySpark [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/05/28 05:13:53 UTC, 12 replies.
- [PR] [SPARK-52334][CORE][K8S] update all files, jars, archiveFiles, and pyFiles to reference the working directory after they are downloaded [spark] - posted by "TongWei1105 (via GitHub)" <gi...@apache.org> on 2025/05/28 05:21:23 UTC, 1 replies.
- Re: [PR] [SPARK-51302][CONNECT] Spark Connect supports JDBC should use the DataFrameReader API [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/28 06:52:05 UTC, 0 replies.
- [PR] [INFRA][MINOR] Update mima exclude [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/28 07:38:43 UTC, 4 replies.
- Re: [PR] [SPARK-21113][CORE] Read ahead input stream to amortize disk IO cost … [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2025/05/28 08:06:28 UTC, 0 replies.
- [PR] [SPARK-52335][CONNET][SQL] Unify the 'invalid bucket count' error for both Connect and Classic [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/05/28 11:12:36 UTC, 3 replies.
- [PR] [SPARK-52338][SQL] Support for inheriting default collation from schema to View [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2025/05/28 13:48:23 UTC, 3 replies.
- [PR] [SPARK-52311][SQL] Redefine UnionLoop output to not be duplicated if the anchor output is duplicated [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/05/28 14:20:26 UTC, 5 replies.
- Re: [PR] [SPARK-50075][FOLLOWUP][DOCS] Add table-valued function API docs [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2025/05/28 14:55:36 UTC, 0 replies.
- [PR] added s3 offloading technique for RDD [spark] - posted by "Rafig9501 (via GitHub)" <gi...@apache.org> on 2025/05/28 17:03:00 UTC, 0 replies.
- Re: [PR] [SPARK-51919][PYTHON] Allow overwriting statically registered Python Data Source [spark] - posted by "the-sakthi (via GitHub)" <gi...@apache.org> on 2025/05/28 18:11:57 UTC, 0 replies.
- [PR] [SPARK-52340] Update `ArrowWriter(Helper)?` and `ProtoUtil` with GH-43170 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/28 19:37:51 UTC, 2 replies.
- [PR] [SPARK-52341] Upgrade Spark to 3.5.6 from 3.5.5 in Spark 3 and Iceberg integration tests [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/28 19:43:24 UTC, 4 replies.
- [PR] [SPARK-52342] Upgrade Spark 3 tests to use 3.5.6 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/28 19:47:00 UTC, 2 replies.
- [PR] Empty commit [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/28 20:01:18 UTC, 0 replies.
- [PR] [SPARK-52339][SQL] Fix comparison of `InMemoryFileIndex` instances [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2025/05/28 20:12:05 UTC, 0 replies.
- [PR] [SPARK-52343] Download Apache Spark distributions via ASF Mirrors site [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/28 21:21:38 UTC, 2 replies.
- Re: [PR] Empty commit for CI tests [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/28 21:30:09 UTC, 0 replies.
- Re: [PR] [SPARK-52249][PS] Enable divide-by-zero for truediv with ANSI enabled [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/05/28 22:07:04 UTC, 4 replies.
- Re: [PR] [SPARK-52288][PS] Avoid INVALID_ARRAY_INDEX in `split`/`rsplit` when ANSI mode is on [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/05/28 22:07:31 UTC, 0 replies.
- [PR] Move `DefineSqlGraphElements` to `PipelineCommand` [spark] - posted by "aakash-db (via GitHub)" <gi...@apache.org> on 2025/05/28 22:52:10 UTC, 1 replies.
- Re: [PR] [SPARK-34659] Fix that Web UI always correctly get appId [spark] - posted by "lordk911 (via GitHub)" <gi...@apache.org> on 2025/05/29 02:22:21 UTC, 0 replies.
- [PR] [SPARK-52327][Core] Glob based provider for history server [spark] - posted by "GauravWaghmare (via GitHub)" <gi...@apache.org> on 2025/05/29 04:55:28 UTC, 0 replies.
- [PR] [SPARK-51831][SQL] Column pruning with existsJoin for Datasource V2 [spark] - posted by "jackylee-ch (via GitHub)" <gi...@apache.org> on 2025/05/29 08:27:11 UTC, 0 replies.
- Re: [PR] [SPARK-52334][CORE][K8S] update all files, jars, and pyFiles to reference the working directory after they are downloaded [spark] - posted by "TongWei1105 (via GitHub)" <gi...@apache.org> on 2025/05/29 08:53:40 UTC, 0 replies.
- [PR] [SPARK-52345][SQL] Fix NULL behavior in scripting conditions [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2025/05/29 09:13:24 UTC, 3 replies.
- [PR] [SPARK-52130] [FOLLOW-UP] [ML] [CONNECT] Refine error message when model.summary is evicted [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/05/29 15:20:40 UTC, 1 replies.
- [PR] Supports file pruning when underlying Delta Parquet files are explici… [spark] - posted by "nemanjapetr-db (via GitHub)" <gi...@apache.org> on 2025/05/29 16:28:04 UTC, 0 replies.
- [PR] [SPARK-52346][SQL] Declarative Pipeline `DataflowGraph` execution and event logging [spark] - posted by "SCHJonathan (via GitHub)" <gi...@apache.org> on 2025/05/29 17:52:47 UTC, 4 replies.
- [PR] [SPARK-52350][SS] Fix link for SS programming guide in 4.0 [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/05/29 20:51:56 UTC, 5 replies.
- [PR] [FOLLOW-UP][SPARK-52233][SQL] Fix 0.0 and -0.0 issues in map_zip_with [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2025/05/29 21:47:35 UTC, 0 replies.
- Re: [PR] [SPARK-52233][SQL][FOLLOW-UP] Fix 0.0 and -0.0 issues in map_zip_with [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/05/30 01:38:58 UTC, 1 replies.
- [PR] [SPARK-48356][FOLLOW UP][SQL] Improve FOR statement's column schema inference [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2025/05/30 09:54:26 UTC, 1 replies.
- [PR] [SPARK-52337][CONNECT] Make InvalidPlanInput a user-facing error [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/05/30 09:55:13 UTC, 0 replies.
- [PR] Test sbt 1.11.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/05/30 10:28:34 UTC, 0 replies.
- [PR] [SPARK-52353] Fix bug with wrong constraints in LogicalRDDs referencing previous iterations [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/05/30 16:12:35 UTC, 0 replies.
- [PR] Sc pipelines [spark] - posted by "jonmio (via GitHub)" <gi...@apache.org> on 2025/05/30 20:44:30 UTC, 0 replies.
- [PR] [WIP][SPARK-52356][PS] Enable divide-by-zero for boolean mod/rmod with ANSI enabled [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/05/30 20:51:49 UTC, 1 replies.
- Re: [PR] [WIP] [DRAFT] Sc pipelines [spark] - posted by "jonmio (via GitHub)" <gi...@apache.org> on 2025/05/30 21:03:46 UTC, 0 replies.
- [PR] [SPARK-52357] Upgrade `Gradle` to `8.14.1` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/30 21:26:14 UTC, 2 replies.
- [PR] [SPARK-52359] Upgrade `gRPC Swift NIO Transport` to 1.2.2 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/30 21:55:06 UTC, 3 replies.
- Re: [PR] [SPARK-52249][PS] Enable divide-by-zero for numeric truediv with ANSI enabled [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/05/30 22:00:29 UTC, 1 replies.
- [PR] [SPARK-52360] Upgrade `gRPC Swift` to 2.2.2 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/30 22:09:44 UTC, 2 replies.
- [PR] [SPARK-52361] Support `executeCommand` in `SparkSession` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/30 23:58:31 UTC, 2 replies.
- [PR] [SPARK-52363] [SQL] Analyzer NameScope test for nested struct fields inside map values [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2025/05/31 07:27:43 UTC, 1 replies.
- [PR] [SPARK-52369] Fix `Session ID` to be lowercased always [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/31 18:58:40 UTC, 2 replies.
- [PR] [SPARK-52370] Use the official Apache Arrow Swift repository [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/31 19:51:15 UTC, 0 replies.
- Re: [PR] [SPARK-52370] Update `Requirement` section to point the official Apache Arrow Swift repository [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/31 19:54:12 UTC, 2 replies.
- [PR] [SPARK-52371] Update `Example` projects to use the latest `main` branch always [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/05/31 20:10:21 UTC, 2 replies.
- [PR] [SPARK-52372][SQL] Fix error handling in `ApplyDefaultCollationToStringType` [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2025/05/31 22:30:43 UTC, 0 replies.