You are viewing a plain text version of this content. The canonical link for it is here.

---

- [PR] [SPARK-51675] Fix col family creation after opening local DB to avoid snapshot creation, if not necessary [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/04/01 00:06:07 UTC, 0 replies.
- Re: [PR] [SPARK-51675][SS] Fix col family creation after opening local DB to avoid snapshot creation, if not necessary [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/04/01 00:08:59 UTC, 2 replies.
- Re: [PR] [WIP] state schema management [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/01 00:30:28 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-49631][SQL] Remove the ANSI config suggestion in ARITHMETIC_OVERFLOW [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/01 00:30:29 UTC, 0 replies.
- [PR] [WIP] Add column pruning API to Python Data Sources [spark] - posted by "wengh (via GitHub)" <gi...@apache.org> on 2025/04/01 00:45:06 UTC, 0 replies.
- Re: [PR] [SPARK-51650][ML][CONNECT] Support delete ml cached objects in batch [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/01 01:03:18 UTC, 2 replies.
- Re: [PR] [SPARK-51439][SQL] Support SQL UDF with DEFAULT argument [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/01 01:24:29 UTC, 30 replies.
- Re: [PR] [SPARK-51537][CONNECT][CORE] construct the session-specific classloader based on the default session classloader on executor [spark] - posted by "wbo4958 (via GitHub)" <gi...@apache.org> on 2025/04/01 02:23:33 UTC, 9 replies.
- Re: [PR] [SPARK-51670][SQL] Refactor Intersect and Except to follow Union example to reuse in single-pass Analyzer [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/01 02:44:46 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-51395][SQL] Refine handling of default values in procedures [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/01 02:52:46 UTC, 5 replies.
- Re: [PR] [SPARK-51657] UTF8_BINARY default table collation shown by default in Desc As JSON (v1) [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/04/01 03:52:19 UTC, 1 replies.
- Re: [PR] [SPARK-51358] [SS] Introduce snapshot upload lag detection through StateStoreCoordinator [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/04/01 04:28:51 UTC, 28 replies.
- [PR] [SPARK-51676] Support `printSchema` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/01 04:30:04 UTC, 2 replies.
- Re: [PR] [Core]Convert shuffleWriteTime from Nanoseconds to Milliseconds for Consistency with Other Metrics [spark] - posted by "CRYP70N1C4 (via GitHub)" <gi...@apache.org> on 2025/04/01 05:09:43 UTC, 2 replies.
- Re: [PR] [SPARK-51479][SQL] Nullable in Row Level Operation Column is not correct [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/04/01 05:32:55 UTC, 6 replies.
- [PR] [WIP][SQL] Pushdown filters with TIME values to parquet [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/04/01 06:25:01 UTC, 0 replies.
- Re: [PR] [SPARK-51653][CONNECT][TESTS] Migrate the tests related to RemoteSparkSession from the connect-client-jvm module to a standalone module [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/01 06:31:39 UTC, 0 replies.
- [PR] Enable -Xsource:3-cross compiler flag [spark] - posted by "joan38 (via GitHub)" <gi...@apache.org> on 2025/04/01 07:01:12 UTC, 14 replies.
- Re: [PR] [SPARK-51423][SQL] Add the current_time() function for TIME datatype [spark] - posted by "the-sakthi (via GitHub)" <gi...@apache.org> on 2025/04/01 07:18:27 UTC, 17 replies.
- Re: [PR] [SPARK-51666][CORE]Fix sparkStageCompleted executorRunTime metric calculation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/01 08:08:55 UTC, 1 replies.
- Re: [PR] [SPARK-51668][SQL] Report metrics for failed writes to V2 data sources [spark] - posted by "olaky (via GitHub)" <gi...@apache.org> on 2025/04/01 08:27:13 UTC, 2 replies.
- [PR] [SPARK-51537][CONNECT][CORE] construct the session-specific classload… [spark] - posted by "wbo4958 (via GitHub)" <gi...@apache.org> on 2025/04/01 08:36:52 UTC, 0 replies.
- [PR] [SPARK-51679] Support `dtypes` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/01 09:37:40 UTC, 2 replies.
- Re: [PR] [SPARK-51655][SQL] Fix metric collection in UnionLoopExec and add test [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/01 09:43:21 UTC, 1 replies.
- [PR] [WIP][SQL] Fix non-vectorized parquet reader for the TIME data type [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/04/01 10:10:58 UTC, 0 replies.
- Re: [PR] [SPARK-51653][CONNECT][TESTS] Migrate the tests related to `RemoteSparkSession` from the `connect-client-jvm` module to `connect-client-integration-tests` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/01 11:26:12 UTC, 1 replies.
- Re: [PR] [SPARK-44161][Connect] Handle Row input for UDFs [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2025/04/01 11:50:59 UTC, 0 replies.
- Re: [PR] [SPARK-51587][PYTHON][SS] Fix an issue where timestamp cannot be used in ListState when multiple state data is involved [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/01 13:37:51 UTC, 2 replies.
- [PR] [MINOR][CONNECT][BUILD] Remove redundant `build-helper-maven-plugin` configuration from `sql/connect/client/jvm/pom.xml` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/01 14:16:32 UTC, 0 replies.
- Re: [PR] [SPARK-51646][SQL] Fix propagating collation in views with default collation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/01 14:42:04 UTC, 8 replies.
- [PR] [SPARK-51333][ML][PYTHON][CONNECT] Unwrap `InvocationTargetException` thrown in `MLUtils.loadOperator` [spark] - posted by "xi-db (via GitHub)" <gi...@apache.org> on 2025/04/01 15:30:40 UTC, 4 replies.
- Re: [PR] [SPARK-51414][SQL] Add the make_time() function [spark] - posted by "robreeves (via GitHub)" <gi...@apache.org> on 2025/04/01 16:46:51 UTC, 22 replies.
- [PR] [SPARK-51562][SQL] Add the time() function [spark] - posted by "senthh (via GitHub)" <gi...@apache.org> on 2025/04/01 18:22:02 UTC, 10 replies.
- Re: [PR] [SPARK-51441][SQL] Add DSv2 APIs for constraints [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/04/01 19:41:55 UTC, 3 replies.
- Re: [PR] [SPARK-51680][SQL] Set the logical type for TIME in the parquet writer [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/01 19:42:46 UTC, 2 replies.
- [PR] [SPARK-51682][SS] State Store Checkpoint V2 should handle offset log ahead of commit log correctly [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2025/04/01 21:25:03 UTC, 3 replies.
- [PR] [WIP] Lock Hardening - RocksDB State Machine [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/04/01 21:30:59 UTC, 1 replies.
- [PR] [SPARK-51684][PYTHON][SS] Fix test failure in test_pandas_transform_with_state [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2025/04/01 22:59:34 UTC, 6 replies.
- Re: [PR] [SPARK-51298][SQL] Support variant in CSV scan [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/01 23:04:32 UTC, 6 replies.
- [PR] [SPARK-51685][SS] Excessive Info logging from RocksDb operations casing too big executor stderr files [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/04/01 23:47:53 UTC, 0 replies.
- [PR] [SPARK-50953][FOLLOW-UP] Allow whitespace/tab in variantGet paths [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2025/04/01 23:51:01 UTC, 2 replies.
- Re: [PR] [SPARK-51272][CORE]. Fix for the race condition in Scheduler causing failure in retrying all partitions in case of indeterministic shuffle keys [spark] - posted by "attilapiros (via GitHub)" <gi...@apache.org> on 2025/04/02 00:16:26 UTC, 45 replies.
- Re: [PR] [DO-NOT-MERGE] Use Unix Domain Socket between Python and JVM communication [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/02 00:25:34 UTC, 1 replies.
- Re: [PR] [SPARK-50613][CONNECT] Support Configurable Idle Timeout of Connect Server [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/02 00:26:48 UTC, 3 replies.
- [PR] revert '[SPARK-51333][ML][PYTHON][CONNECT] Unwrap InvocationTargetException thrown in MLUtils.loadOperator' from 4.0 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/02 01:34:31 UTC, 2 replies.
- [PR] [SPARK-51686][UI] Link the execution IDs of sub-executions for current execution if any [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/04/02 03:41:14 UTC, 3 replies.
- Re: [PR] [SPARK-51681][CONNECT][BUILD] Remove redundant `build-helper-maven-plugin` configuration from connect related modules [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/02 03:45:53 UTC, 1 replies.
- Re: [PR] [SPARK-51688][PYTHON] Use Unix Domain Socket between Python and JVM communication [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/02 07:33:13 UTC, 44 replies.
- [PR] [SPARK-51496][SQL][FOLLOW-UP] Preserve the case of DataSourceV2Relation option keys [spark] - posted by "drexler-sky (via GitHub)" <gi...@apache.org> on 2025/04/02 07:41:29 UTC, 4 replies.
- [PR] [SPARK-51689] Support `DataFrameWriter` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/02 08:00:20 UTC, 5 replies.
- Re: [PR] [SPARK-51687][SQL] Pushdown filters with TIME values to parquet [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/04/02 09:07:08 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-51040][SQL] Enforce determinism when assigning implicit aliases to collation types [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/04/02 09:11:15 UTC, 0 replies.
- [PR] [SPARK-51690][SS] Change the protocol of ListState.put()/get()/appendList() from Arrow to simple custom protocol [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/04/02 09:11:44 UTC, 9 replies.
- [PR] [SPARK-51691][CORE] SerializationDebugger should swallow exception when try to find the reason of serialization problem [spark] - posted by "summaryzb (via GitHub)" <gi...@apache.org> on 2025/04/02 11:12:15 UTC, 11 replies.
- [PR] [SPARK-51692][SQL]Fix bug while replace cte ref which contains dynamicpruning [spark] - posted by "lifulong (via GitHub)" <gi...@apache.org> on 2025/04/02 11:28:36 UTC, 3 replies.
- [PR] fix typo in pyspark documentation (minor edit) [spark] - posted by "kirisakow (via GitHub)" <gi...@apache.org> on 2025/04/02 11:34:26 UTC, 3 replies.
- [PR] [SPARK-51677][CONNECT][TESTS] Refactor `ClientE2ETestSuite/SparkSessionE2ESuite` to prevent memory leaks related to Arrow [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/02 12:15:35 UTC, 3 replies.
- [PR] [MINOR][SQL] Eliminate unnecessary collect operation [spark] - posted by "summaryzb (via GitHub)" <gi...@apache.org> on 2025/04/02 12:22:23 UTC, 3 replies.
- [PR] [SPARK-51693] Support `storageLevel` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/02 14:48:48 UTC, 4 replies.
- [PR] [SPARK-51694][SQL] Fix load v2 function with non-buildin V2 catalog [spark] - posted by "Zouxxyy (via GitHub)" <gi...@apache.org> on 2025/04/02 14:59:28 UTC, 0 replies.
- Re: [PR] [SPARK-51685][SS] Excessive Info logging from RocksDb operations causing too big executor stderr files [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/04/02 17:07:39 UTC, 24 replies.
- [PR] [SPARK-51695][SQL] Introduce Parser Changes for Table Constraints (CHECK, UNIQUE, PK, FK) [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/04/02 18:26:48 UTC, 40 replies.
- Re: [PR] [SPARK-51411][SS][DOCS] Add documentation for the transformWithState operator [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/04/02 19:10:25 UTC, 12 replies.
- [PR] [WIP] State machine hardening [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/04/02 19:33:39 UTC, 0 replies.
- [PR] [SPARK-51698][INFRA] Ignore sql/api/src/main/gen/ in Git [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/04/02 20:06:53 UTC, 2 replies.
- [PR] [SPARK-51697][PYTHON][SS] Fix list state test failure in TransformWithStateInPandas [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2025/04/02 20:08:57 UTC, 6 replies.
- [PR] [SPARK-51699][BUILD] Upgrade to Apache parent pom 34 [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/04/02 20:28:37 UTC, 8 replies.
- Re: [PR] Canonicalized CTEs to avoid cached result not being used and recomputed [spark] - posted by "nimesh1601 (via GitHub)" <gi...@apache.org> on 2025/04/02 20:43:47 UTC, 2 replies.
- Re: [PR] [SPARK-51503][SQL] Support Variant type in XML scan [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/02 23:41:23 UTC, 47 replies.
- Re: [PR] [SPARK-51537][CONNECT][CORE][3.5] construct the session-specific classloader based on the default session classloader on executor [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/02 23:42:57 UTC, 1 replies.
- Re: [PR] [SPARK-51638][CORE] Fix fetching the remote disk stored RDD blocks via the external shuffle service [spark] - posted by "attilapiros (via GitHub)" <gi...@apache.org> on 2025/04/02 23:46:19 UTC, 8 replies.
- Re: [PR] [Test Only][BUILD] Upgrade `sbt` to `1.10.6` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/03 00:26:04 UTC, 1 replies.
- [PR] [SPARK-51700] Fix incorrect logging when no files are eligible for deletion in RocksDBFileManager [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/04/03 01:10:11 UTC, 0 replies.
- Re: [PR] [SPARK-51700][SS] Fix incorrect logging when no files are eligible for deletion in RocksDBFileManager [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/04/03 01:10:44 UTC, 4 replies.
- [PR] [SPARK-51701][PYTHON][TESTS] Move test objects to a separate file [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/04/03 01:13:35 UTC, 3 replies.
- Re: [PR] [SPARK-51694][SQL] Fix load v2 function with non-buildin V2 session catalog [spark] - posted by "Zouxxyy (via GitHub)" <gi...@apache.org> on 2025/04/03 01:52:14 UTC, 2 replies.
- [PR] [SPARK-51702] Revise `sparkSession/read/write/columns/schema/dtypes/storageLevel` API [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/03 02:10:35 UTC, 4 replies.
- Re: [PR] [SPARK-44856][PYTHON] Improve Python UDTF arrow serializer performance [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/03 02:21:26 UTC, 7 replies.
- [PR] [SPARK-51696] Fix the VariantGet .sql method to also output the target data type [spark] - posted by "db-scnakandala (via GitHub)" <gi...@apache.org> on 2025/04/03 02:46:12 UTC, 0 replies.
- Re: [PR] Test sbt 1.10.10 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/03 02:46:23 UTC, 0 replies.
- [PR] [SPARK-51703][BUILD] Upgrade jetty to 11.0.25 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/03 03:12:22 UTC, 2 replies.
- Re: [PR] [SPARK-50131][SQL] Add IN Subquery DataFrame API [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/03 03:19:56 UTC, 13 replies.
- Re: [PR] [SPARK-51704][SQL] Eliminate unnecessary collect operation [spark] - posted by "summaryzb (via GitHub)" <gi...@apache.org> on 2025/04/03 03:41:30 UTC, 7 replies.
- [PR] [SPARK-51707][CONNECT][TESTS] Handling of `IllegalStateException` with `Memory leaked` message in the `afterAll` of `RemoteSparkSession` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/03 06:39:59 UTC, 3 replies.
- [PR] [SPARK-51708] Add `CaseInsensitiveDictionary` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/03 06:52:49 UTC, 13 replies.
- [PR] Propagates the active remote spark session to new threads to fix parallelFitTasks [spark] - posted by "xi-db (via GitHub)" <gi...@apache.org> on 2025/04/03 11:09:06 UTC, 0 replies.
- Re: [PR] [SPARK-51711][ML][PYTHON][CONNECT] Propagates the active remote spark session to new threads to fix CrossValidator [spark] - posted by "xi-db (via GitHub)" <gi...@apache.org> on 2025/04/03 11:21:50 UTC, 10 replies.
- Re: [PR] [SPARK-51512][CORE] Filter out null MapStatus when cleaning up shuffle data with ExternalShuffleService [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/04/03 11:56:57 UTC, 5 replies.
- [PR] [SPARK-51714][SS] Add Failure Ingestion test to test state store checkpoint format V2 [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2025/04/03 18:46:40 UTC, 33 replies.
- [PR] [SPARK-51715][SS] Clear internal maps on close to remove DB open dep in other places [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/04/03 19:24:57 UTC, 1 replies.
- [PR] [SPARK-51350][SQL][FOLLOW-UP] Cleanup Show Procedure Test [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/04/03 21:32:09 UTC, 4 replies.
- Re: [PR] [SPARK-50593][SQL] SPJ: Support truncate transform [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/04 00:26:13 UTC, 1 replies.
- [PR] [SPARK-51718] Update `README.md` with Spark 4.0.0 RC3 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/04 00:29:57 UTC, 2 replies.
- Re: [PR] [SPARK-51675][SS][FOLLOW-UP] Clear internal maps on close to remove DB open dep in other places [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/04/04 01:41:04 UTC, 1 replies.
- Re: [PR] Enable -Xsource:3 compiler flag [spark] - posted by "joan38 (via GitHub)" <gi...@apache.org> on 2025/04/04 03:38:27 UTC, 20 replies.
- Re: [PR] [SPARK-51068][SQL] Canonicalized CTEs to avoid cached result not being used and recomputed [spark] - posted by "nimesh1601 (via GitHub)" <gi...@apache.org> on 2025/04/04 03:58:23 UTC, 2 replies.
- [PR] [SPARK-51717][SS] [RocksDB] Fix SST mismatch corruption that can happen for second snapshot created for a new query [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2025/04/04 06:29:15 UTC, 12 replies.
- [PR] [SPARK-51719] Support `table` for `SparkSession` and `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/04 06:57:24 UTC, 0 replies.
- Re: [PR] [SPARK-50838][SQL] Add Cross Join as legal in recursion of Recursive CTE [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/04/04 08:50:36 UTC, 1 replies.
- [PR] Added constructor for backward compatibility. [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2025/04/04 09:55:35 UTC, 0 replies.
- [PR] [Do Not Merge] Investigate the code path for merge into [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/04/04 10:45:57 UTC, 2 replies.
- [PR] [SPARK-51712][SQL] Swallow non-fatal Throwables in spark.catalog.listTables() [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/04/04 10:55:19 UTC, 0 replies.
- Re: [PR] [SPARK-51720][SQL] Add Cross Join as legal in recursion of Recursive CTE [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/04/04 13:03:48 UTC, 2 replies.
- [PR] [SPARK-51721] [SQL] Change default value of ANALYZER_SINGLE_PASS_RESOLVER_RELATION_BRIDGING_ENABLED flag [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/04/04 16:25:04 UTC, 1 replies.
- Re: [PR] [SPARK-51296][SQL] Support collecting corrupt data in singleVariantColumn mode [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2025/04/04 18:02:14 UTC, 0 replies.
- [PR] [SPARK-51296][SQL] Support collecting corrupt data in singleVariantColumn mode. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2025/04/04 20:19:50 UTC, 8 replies.
- [PR] [SPARK-51722][SQL] Remove "stop" origin from ParseException [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/04/04 20:50:26 UTC, 4 replies.
- Re: [PR] [SPARK-51660][CORE] Gracefully handle when MDC is not supported [spark] - posted by "robreeves (via GitHub)" <gi...@apache.org> on 2025/04/04 21:48:07 UTC, 3 replies.
- [PR] [SPARK-51723][SQL] Add DSv2 APIs for create/get table constraints [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/04/04 22:44:25 UTC, 22 replies.
- [PR] [SPARK-51724] RocksDB StateStore's lineage manager should be synchronized [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2025/04/04 23:45:01 UTC, 2 replies.
- [PR] [SPARK-51726] Use TableInfo for Stage CREATE/REPLACE/CREATE OR REPLACE table [spark] - posted by "anoopj (via GitHub)" <gi...@apache.org> on 2025/04/05 00:18:36 UTC, 0 replies.
- Re: [PR] [SPARK-50662][PYTHON][WINDOWS] Escape ampersands in command arguments on windows [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/05 00:25:50 UTC, 1 replies.
- [PR] [SPARK-51725][SQL][TEST] Supplement tests for merge into [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/04/05 00:29:02 UTC, 5 replies.
- Re: [PR] [SPARK-XXXXX][SQL] Add maxRecordsPerOutputBatch to limit the number of record of Arrow output batch [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/04/05 05:46:22 UTC, 5 replies.
- [PR] [SQL][MINOR] Fix warnings in DataSource/WriterV2Suites [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/04/05 08:39:46 UTC, 6 replies.
- Re: [PR] [MINOR][DOC] grammatical corrections, spellings and typos [spark] - posted by "vrmorusu (via GitHub)" <gi...@apache.org> on 2025/04/05 10:11:22 UTC, 0 replies.
- [PR] [SPARK-51729] Support `head/tail` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/05 22:50:14 UTC, 2 replies.
- Re: [PR] [SPARK-48458][SQL] Data loss in dynamic override fix [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/06 00:28:41 UTC, 1 replies.
- Re: [PR] [SPARK-51719] Support `table` for `SparkSession` and `DataFrameReader` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/06 00:55:39 UTC, 5 replies.
- [PR] [SPARK-51519][SQL] MERGE INTO/UPDATE/DELETE support join hint [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/04/06 02:24:07 UTC, 1 replies.
- [PR] [SPARK-51730] Add `Catalog` actor and support `catalog/database` APIs [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/06 09:55:46 UTC, 2 replies.
- Re: [PR] [SPARK-48898][SQL] Add Variant shredding functions [spark] - posted by "adriangb (via GitHub)" <gi...@apache.org> on 2025/04/06 12:46:54 UTC, 0 replies.
- [PR] [SPARK-51421][SQL] Get seconds of TIME datatype [spark] - posted by "senthh (via GitHub)" <gi...@apache.org> on 2025/04/06 20:08:34 UTC, 22 replies.
- Re: [PR] [SPARK-50686][SQL] Hash to sort aggregation fallback - memory usage optimization [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/07 00:27:45 UTC, 1 replies.
- Re: [PR] [SPARK-51079] Added constructor for ArrowSerializer for backward compatibility. [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/07 01:16:40 UTC, 1 replies.
- Re: [PR] [SPARK-51712][SQL] Swallow non-fatal Throwables when resolving tables/views in spark.catalog.listTables() [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/07 01:18:30 UTC, 2 replies.
- Re: [PR] [SPARK-51243][CORE][ML] Configurable allow native BLAS [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/04/07 02:17:43 UTC, 3 replies.
- [PR] [SPARK-51537][CONNECT][CORE][FOLLOW-UP][TEST] Add test to ensure Spark plugins are not reloaded [spark] - posted by "wbo4958 (via GitHub)" <gi...@apache.org> on 2025/04/07 02:51:10 UTC, 5 replies.
- [PR] fix [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/04/07 08:06:49 UTC, 1 replies.
- [PR] [SPARK-51549][BUILD][3.5] Bump Parquet 1.15.1 [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2025/04/07 09:13:35 UTC, 13 replies.
- [PR] [SPARK-51733][BUILD] `make-distribution.sh` supports sbt [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/04/07 10:13:35 UTC, 8 replies.
- [PR] [SPARK-51736] Make `SparkConnectError` and `StorageLevel` fields public [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/07 12:26:05 UTC, 2 replies.
- [PR] [SPARK-51711][ML][CONNECT] Memory based MLCache eviction policy [spark] - posted by "xi-db (via GitHub)" <gi...@apache.org> on 2025/04/07 13:45:12 UTC, 4 replies.
- Re: [PR] [SPARK-51395][SQL] Refine handling of default values in procedures [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/07 13:56:03 UTC, 11 replies.
- Re: [PR] [SPARK-51182][SQL] DataFrameWriter should throw dataPathNotSpecifiedError when path is not specified [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/07 14:08:05 UTC, 5 replies.
- [PR] Bump golang.org/x/oauth2 from 0.28.0 to 0.29.0 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/04/07 14:29:44 UTC, 0 replies.
- Re: [PR] [SPARK-51064][SQL] Enable `spark.sql.sources.v2.bucketing.enabled` by default [spark] - posted by "guangyu-yang-rokt (via GitHub)" <gi...@apache.org> on 2025/04/07 14:31:08 UTC, 2 replies.
- [PR] Bump google.golang.org/grpc from 1.71.0 to 1.71.1 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/04/07 14:45:45 UTC, 2 replies.
- Re: [PR] [SPARK-51611][SQL] New iteration of single-pass Analyzer functionality [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/04/07 16:29:33 UTC, 8 replies.
- [PR] [WIP][PYTHON] Validate type in MapInBatchEvaluatorFactory [spark] - posted by "wengh (via GitHub)" <gi...@apache.org> on 2025/04/07 18:49:49 UTC, 0 replies.
- [PR] Remove --ONLY_IF spark for some subquery tests [spark] - posted by "andylam-db (via GitHub)" <gi...@apache.org> on 2025/04/07 22:30:30 UTC, 0 replies.
- [PR] [SPARK-51740] Allow get_json_object to consider leading spaces in paths [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2025/04/07 22:44:41 UTC, 0 replies.
- Re: [PR] [SPARK-51739][PYTHON] Validate Arrow schema from mapInArrow & mapInPandas & DataSource [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/04/07 23:25:16 UTC, 13 replies.
- Re: [PR] [SPARK-51740][SQL] Allow get_json_object to consider leading spaces in paths [spark] - posted by "gene-db (via GitHub)" <gi...@apache.org> on 2025/04/08 00:26:47 UTC, 1 replies.
- [PR] [TEST-ONLY] PySpark with free-threaded Python 3.13 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/08 01:10:43 UTC, 0 replies.
- [PR] [SPARK-51742][BUILD][TESTS] Upgrade snowflake-jdbc to 3.23.2 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/08 03:46:38 UTC, 0 replies.
- [PR] [SPARK-51743] Add `describe_(database|table)`, `show_(database|table)`, `explain` sql test and answer files [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/08 05:08:39 UTC, 2 replies.
- Re: [PR] [MINOR][PYTHON][DOCS] Fix a typo in pyspark documentation [spark] - posted by "kirisakow (via GitHub)" <gi...@apache.org> on 2025/04/08 05:35:22 UTC, 4 replies.
- Re: [PR] [SPARK-51691][CORE][TESTS] SerializationDebugger should swallow exception when try to find the reason of serialization problem [spark] - posted by "summaryzb (via GitHub)" <gi...@apache.org> on 2025/04/08 06:35:16 UTC, 10 replies.
- Re: [PR] [SPARK-50992][SQL] OOMs and performance issues with AQE in large plans [spark] - posted by "SauronShepherd (via GitHub)" <gi...@apache.org> on 2025/04/08 07:05:26 UTC, 1 replies.
- [PR] Feature/spark 51728 add except support [spark] - posted by "Gschiavon (via GitHub)" <gi...@apache.org> on 2025/04/08 07:32:51 UTC, 0 replies.
- Re: [PR] [SPARK-51721][SQL] Change default value of ANALYZER_SINGLE_PASS_RESOLVER_RELATION_BRIDGING_ENABLED flag [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/04/08 08:18:01 UTC, 1 replies.
- Re: [PR] [SPARK-51742][BUILD][TESTS] Upgrade `snowflake-jdbc` to 3.23.2 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/08 09:03:23 UTC, 1 replies.
- Re: [PR] [SPARK-51724][SS] RocksDB StateStore's lineage manager should be synchronized [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/04/08 13:14:27 UTC, 1 replies.
- [PR] [SPARK-51738][SQL] IN subquery with struct type [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/08 13:31:47 UTC, 5 replies.
- Re: [PR] [SPARK-51592][SQL] Avoid logging makes Driver OOM in AdaptiveSparkPlanExec [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2025/04/08 13:49:26 UTC, 1 replies.
- Re: [PR] [SPARK-51732][SQL] Apply `rpad` on attributes with same `ExprId` if they need to be deduplicated [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/08 14:30:25 UTC, 4 replies.
- [PR] [SPARK-51747][SQL] Data source cached plan should respect options [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/04/08 22:50:19 UTC, 11 replies.
- [PR] Run integration test on MacOS [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/08 23:27:26 UTC, 0 replies.
- [PR] [SPARK-49862][INFRA][PYTHON] Restore package installations for Python 3.13 daily builder [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/08 23:52:24 UTC, 2 replies.
- [PR] [SPARK-51748] Replace size() with length() in UnsafeKVExternalSorter.java [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2025/04/09 00:04:44 UTC, 2 replies.
- Re: [PR] [SPARK-50447][SQL] Skip the parameter mode check in `Call` command [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/09 00:34:53 UTC, 0 replies.
- Re: [PR] [SPARK-51749] Add `MacOS` integration test with Apache Spark 4.0.0 RC3 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/09 02:25:25 UTC, 2 replies.
- [PR] [SPARK-51750] Upgrade `FlatBuffers` to v25.2.10 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/09 02:34:56 UTC, 2 replies.
- Re: [PR] [SPARK-51717][SS][RocksDB] Fix SST mismatch corruption that can happen for second snapshot created for a new query [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/04/09 03:58:54 UTC, 1 replies.
- Re: [PR] [SPARK-51714][SS][TESTS] Add Failure Ingestion test to test state store checkpoint format V2 [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/04/09 04:48:56 UTC, 0 replies.
- Re: [PR] [SPARK-51596][SS] Fix concurrent StateStoreProvider maintenance and closing [spark] - posted by "hasnain-db (via GitHub)" <gi...@apache.org> on 2025/04/09 05:05:15 UTC, 40 replies.
- Re: [PR] [SPARK-51534][Core] Improve parquet read performance by reducing unnecessary operations when converting parquet to row [spark] - posted by "TheR1sing3un (via GitHub)" <gi...@apache.org> on 2025/04/09 05:50:45 UTC, 0 replies.
- [PR] [WIP][DO NOT MERGE] FIX NPE while serialzer produce null in case of EOF [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/04/09 07:50:40 UTC, 1 replies.
- [PR] Test ASM 9.8 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/09 08:45:26 UTC, 0 replies.
- [PR] [SPARK-51751][SQL] Fix multiple rCTEs for one WITH statement that reference each other [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/04/09 08:49:13 UTC, 3 replies.
- [PR] init [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/09 09:16:29 UTC, 1 replies.
- Re: [PR] Test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/09 10:06:46 UTC, 4 replies.
- [PR] [SPARK-51752][SQL] Enable rCTE referencing from within a CTE [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/04/09 11:28:09 UTC, 14 replies.
- [PR] [SPARK-51754][PYTHON][DOCS][TESTS] Make `sampleBy` doctest deterministic [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/09 12:42:36 UTC, 2 replies.
- Re: [PR] [SPARK-51420][SQL] Get minutes of TIME datatype [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/04/09 12:50:12 UTC, 3 replies.
- Re: [PR] [SPARK-51419][SQL] Get hours of TIME datatype [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/04/09 12:51:53 UTC, 1 replies.
- Re: [PR] [SPARK-51673][SQL] Apply default collation to alter view query [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/04/09 14:31:28 UTC, 3 replies.
- [PR] [SPARK-50983][SQL]Part 1.b Add analyzer support for nested correlated subqueries [spark] - posted by "AveryQi115 (via GitHub)" <gi...@apache.org> on 2025/04/09 20:33:51 UTC, 21 replies.
- [PR] [SPARK-51738][SQL][FOLLOWUP] Fix HashJoin to accept structurally-equal types [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/04/09 21:40:35 UTC, 2 replies.
- [PR] [SPARK-51758] Apply late record filtering based on watermark only if timeMode is passed as EventTime to the transformWithState operator [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/04/09 22:47:56 UTC, 0 replies.
- Re: [PR] [SPARK-51726][SQL] Use TableInfo for Stage CREATE/REPLACE/CREATE OR REPLACE table [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/04/10 00:15:13 UTC, 2 replies.
- [PR] [SPARK-51759] Add `ErrorUtils` and `SQLHelper` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/10 00:44:01 UTC, 6 replies.
- [PR] [SPARK-51420][SQL][FOLLOWUP] Support all valid TIME precisions in the minute function [spark] - posted by "the-sakthi (via GitHub)" <gi...@apache.org> on 2025/04/10 00:50:46 UTC, 4 replies.
- Re: [PR] [SPARK-51755][INFRA][PYTHON] Set up a scheduled builder for free-threaded Python 3.13 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/10 01:37:37 UTC, 1 replies.
- [PR] [SPARK-51757] Fix LEAD/LAG Function Offset Exceeds Partition Size [spark] - posted by "xin-aurora (via GitHub)" <gi...@apache.org> on 2025/04/10 02:06:36 UTC, 10 replies.
- [PR] Test on ubuntu-24.04-arm [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/10 02:43:36 UTC, 1 replies.
- Re: [PR] ProcfsMetricsGetterSuite [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/04/10 02:57:26 UTC, 1 replies.
- Re: [PR] [SPARK-51630][CORE][TESTS] Remove `pids` size check from "SPARK-45907: Use ProcessHandle APIs to computeProcessTree in ProcfsMetricsGetter" [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/10 03:47:34 UTC, 2 replies.
- Re: [PR] [SPARK-51760][BUILD] Upgrade ASM to 9.8 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/10 07:31:14 UTC, 2 replies.
- Re: [PR] [SPARK-50983][SQL]Part 1.a Add nested outer attributes for SubqueryExpression [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/04/10 07:32:45 UTC, 6 replies.
- Re: [PR] [SPARK-51761][INFRA] Add a daily test using the Ubuntu Arm Runner [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/10 07:51:02 UTC, 8 replies.
- [PR] [SPARK-51419][SQL][FOLLOWUP] Making hour function to accept any precision of TIME type [spark] - posted by "senthh (via GitHub)" <gi...@apache.org> on 2025/04/10 08:05:55 UTC, 6 replies.
- [PR] [SPARK-51762][SQL] Fix Resolution of Views in Single-Pass Analyzer When Bridging is Enabled [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2025/04/10 08:38:50 UTC, 9 replies.
- [PR] [SPARK-51763] Support `ArrowStruct` type [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/10 10:42:40 UTC, 0 replies.
- Re: [PR] [SPARK-31561][SQL] Add QUALIFY clause [spark] - posted by "kjstultz14 (via GitHub)" <gi...@apache.org> on 2025/04/10 12:18:00 UTC, 0 replies.
- Re: [PR] [SPARK-51756][CORE] Computes RowBasedChecksum in ShuffleWriters [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/10 13:01:46 UTC, 11 replies.
- [PR] [SPARK-51764] Add collation to AnalysisContext doc [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2025/04/10 13:34:07 UTC, 1 replies.
- [PR] [SPARK-51553][SQL] Modify EXTRACT to support TIME data type [spark] - posted by "vinodkc (via GitHub)" <gi...@apache.org> on 2025/04/10 19:41:55 UTC, 12 replies.
- Re: [PR] [SPARK-51758][SS] Apply late record filtering based on watermark only if timeMode is passed as EventTime to the transformWithState operator [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/04/10 20:20:02 UTC, 12 replies.
- Re: [PR] [SPARK-51644][BUILD][CONNECT] fix for spark shells [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/04/10 20:48:33 UTC, 0 replies.
- Re: [PR] [SPARK-51763] Support `struct` type in `ArrowReader` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/10 21:56:01 UTC, 1 replies.
- [PR] [SPARK-51768][SS] Create Failure Injection Test for Streaming offset and commit log write failures [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2025/04/10 22:27:01 UTC, 1 replies.
- [PR] [SPARK-51716][SQL] Support serializing Variant to XML [spark] - posted by "xiaonanyang-db (via GitHub)" <gi...@apache.org> on 2025/04/10 23:29:02 UTC, 10 replies.
- [PR] [SPARK-51770] Set Content-Type headers for Prometheus v3 compatibility [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/04/10 23:39:39 UTC, 0 replies.
- [PR] [SPARK-51771][SQL] Add DSv2 APIs for ALTER TABLE ADD/DROP CONSTRAINT [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/04/10 23:50:56 UTC, 24 replies.
- [PR] [SPARK-51773][SQL] Add hashCode and equals [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/04/11 07:44:26 UTC, 0 replies.
- Re: [PR] [SPARK-51769][SQL] Add maxRecordsPerOutputBatch to limit the number of record of Arrow output batch [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/04/11 08:02:04 UTC, 0 replies.
- Re: [PR] [SPARK-49653][SQL] Single join for correlated scalar subqueries [spark] - posted by "iwanttobepowerful (via GitHub)" <gi...@apache.org> on 2025/04/11 08:25:36 UTC, 0 replies.
- [PR] [SPARK-51775][SQL] Normalize LogicalRelation and HiveTableRelation by NormalizePlan [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/04/11 08:52:47 UTC, 6 replies.
- [PR] [SPARK-51774][CONNECT] Add GRPC Status code to Python Connect GRPC Exception [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/04/11 08:55:42 UTC, 2 replies.
- [PR] [SPARK-51776][SQL] Fix logging in single-pass Analyzer [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/04/11 09:02:12 UTC, 2 replies.
- [PR] [SPARK-51777][SQL][CORE] Register sql.columnar.* classes to KryoSerializer [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/04/11 09:45:12 UTC, 2 replies.
- [PR] Revert "[SPARK-47895][SQL] group by alias should be idempotent" [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/04/11 11:46:30 UTC, 8 replies.
- [PR] [SPARK-51778][SQL] Close SQL test gaps discovered during single-pass Analyzer implementation [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/04/11 14:54:33 UTC, 0 replies.
- Re: [PR] [SPARK-51728][SQL] Add SELECT EXCEPT Support [spark] - posted by "ik8 (via GitHub)" <gi...@apache.org> on 2025/04/11 16:01:08 UTC, 3 replies.
- [PR] [SPARK-51780][SQL] Implement Describe Procedure [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/04/11 20:16:54 UTC, 6 replies.
- [PR] [SPARK-46640][FOLLOW-UP] Consider the whole expression tree when excluding subquery references [spark] - posted by "nikhilsheoran-db (via GitHub)" <gi...@apache.org> on 2025/04/11 21:13:21 UTC, 6 replies.
- [PR] [SPARK-51747][SQL][FOLLOW-UP] Data source cached plan conf and migration guide [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/04/11 22:02:34 UTC, 21 replies.
- [PR] SPARK-51779 Use virtual column families for stream-stream joins [spark] - posted by "zecookiez (via GitHub)" <gi...@apache.org> on 2025/04/11 22:21:34 UTC, 0 replies.
- Re: [PR] [SPARK-51779] [SS] Use virtual column families for stream-stream joins [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/04/11 23:13:54 UTC, 16 replies.
- Re: [PR] [SPARK-51770] Set `Content-Type` headers for Prometheus v3 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/12 10:00:11 UTC, 1 replies.
- [PR] [SPARK-51781] Update `README.md` and integration test with Apache Spark 4.0.0 RC4 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/12 11:29:30 UTC, 2 replies.
- [PR] [SPARK-51782] Add `ubuntu-24.04-arm` to `build` and `integration-test-linux` test pipelines [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/12 11:46:33 UTC, 4 replies.
- [PR] [SPARK-51783] Support `ubuntu-24.04-arm` in `build-test` test pipeline [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/12 12:08:14 UTC, 2 replies.
- [PR] [SPARK-51784] Support `xml` in `DataFrame(Reader/Writer)` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/12 12:34:19 UTC, 2 replies.
- [PR] [SPARK-51785] Support `addTag/removeTag/getTags/clearTags` in `SparkSession` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/13 12:43:00 UTC, 2 replies.
- [PR] [SPARK-51691][CORE][FOLLOWUP] Make SerializationDebugger work in non-… [spark] - posted by "summaryzb (via GitHub)" <gi...@apache.org> on 2025/04/13 13:39:37 UTC, 14 replies.
- Re: [PR] [SPARK-51773][SQL] Add hashCode and equals to file formats [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/13 23:22:19 UTC, 3 replies.
- Re: [PR] [SPARK-48728][SQL] Support ignoreNulls for collect_list and collect_set [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/14 00:28:44 UTC, 1 replies.
- [PR] [SPARK-51787] Remove `sessionID` parameter from `getExecutePlanRequest` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/14 00:54:21 UTC, 2 replies.
- [PR] [SPARK-51788][INFRA] Add a PySpark daily test using the Ubuntu Arm Runner [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/14 02:36:41 UTC, 5 replies.
- [PR] [SPARK-51789][CORE] Respect spark.api.mode and spark.remote properly when parsing arguments in Spark Submission [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/14 03:12:27 UTC, 2 replies.
- [PR] [SPARK-51790][SQL] Register UTF8String to KryoSerializer [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/04/14 03:20:44 UTC, 7 replies.
- Re: [PR] [SPARK-51513][SQL] Fix RewriteMergeIntoTable rule produces unresolved plan [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/14 03:34:44 UTC, 1 replies.
- [PR] [SPARK-51395][SQL][TESTS][FOLLOW-UP] Explicitly sets failOnError in Abs at tests [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/14 03:55:56 UTC, 3 replies.
- Re: [PR] [SPARK-51788][INFRA] Add a PySpark test that runs every 3 days using the Ubuntu Arm Runner [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/14 04:14:21 UTC, 2 replies.
- [PR] [WIP][ML] `ImputerModel` stores coefficients with arrays instead of dataframe [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/14 04:41:31 UTC, 0 replies.
- Re: [PR] [SPARK-47081][CONNECT] Support Query Execution Progress [spark] - posted by "virrrat (via GitHub)" <gi...@apache.org> on 2025/04/14 06:06:48 UTC, 1 replies.
- [PR] [SPARK-51792] Support `saveAsTable` and `insertInto` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/14 07:56:35 UTC, 7 replies.
- [PR] [SPARK-51793] Support `ddlParse` and `jsonToDdl` in `SparkConnectClient` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/14 09:45:20 UTC, 2 replies.
- [PR] [SPARK-51633][CORE][TESTS] Test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/14 11:42:25 UTC, 0 replies.
- Re: [PR] [SPARK-51773][SQL] Turn file formats into case classes to properly compare them [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/04/14 12:02:20 UTC, 6 replies.
- [PR] Test no SPARK_LOCAL_IP [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/14 12:43:17 UTC, 1 replies.
- Re: [PR] [SPARK-51778][SQL][TESTS] Close SQL test gaps discovered during single-pass Analyzer implementation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/14 13:31:37 UTC, 1 replies.
- Re: [PR] [SPARK-43782][CORE] Support log level configuration with static Spark conf [spark] - posted by "mehulbatra-d11 (via GitHub)" <gi...@apache.org> on 2025/04/14 14:11:19 UTC, 0 replies.
- [PR] [SPARK-51796] [SQL] Disallow Sort order expressions under non-Sort operators [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/04/14 16:10:43 UTC, 2 replies.
- [PR] [SPARK-51795][BUILD] Bump Parquet 1.15.1 [spark] - posted by "CarterFendley (via GitHub)" <gi...@apache.org> on 2025/04/14 17:31:24 UTC, 14 replies.
- [PR] [SPARK-51797][SQL] Add table name to TableConstraint and remove parser dependencies [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/04/14 17:49:03 UTC, 22 replies.
- Re: [PR] [SPARK-51768][SS][TESTS] Create Failure Injection Test for Streaming offset and commit log write failures [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/04/14 21:59:20 UTC, 13 replies.
- [PR] [SPARK-51799] Support user-specified schema in `DataFrameReader` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/15 00:15:33 UTC, 7 replies.
- Re: [PR] [SPARK-50600][SQL] Set analyzed on analysis failure [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/15 00:27:28 UTC, 1 replies.
- [PR] [SPARK-51800][INFRA] Set up the CI for UDS in PySpark [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/15 01:44:14 UTC, 5 replies.
- Re: [PR] [SPARK-51633][CORE][TESTS] Reset `Utils#customHostname` in the `finally` block of `ExecutorSuite#withExecutor` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/15 02:52:17 UTC, 3 replies.
- [PR] Test kryo 4.0.3 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/15 03:33:59 UTC, 2 replies.
- [PR] Spark 51688 followup [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/15 04:09:05 UTC, 0 replies.
- Re: [PR] [SPARK-51688][PYTHON][FOLLOW-UP] Implement UDS in Accumulators [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/15 04:09:39 UTC, 7 replies.
- [PR] [SPARK-51801] Upgrade ORC Format to 1.1.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/15 05:05:16 UTC, 0 replies.
- Re: [PR] [SPARK-51794][INFRA] Install arm64 Python for MacOS daily test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/15 05:12:21 UTC, 5 replies.
- [PR] [SPARK-51802] OSS PySpark User Guide Docs [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/04/15 06:01:46 UTC, 0 replies.
- Re: [PR] [SPARK-51791][ML] `ImputerModel` stores coefficients with arrays instead of dataframe [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/15 06:49:54 UTC, 1 replies.
- Re: [PR] [SPARK-51568][SQL] Introduce isSupportedExtract to prevent happening unexpected behavior [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/15 07:28:05 UTC, 0 replies.
- [PR] [SPARK-51804] Support `sample` in `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/15 07:56:25 UTC, 4 replies.
- [PR] [SPARK-51805] [SQL] Get with null argument should return null instead of throwing cast error [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/04/15 10:32:26 UTC, 3 replies.
- [PR] [SPARK-51807] Support `drop` and `withColumnRenamed` in `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/15 10:55:44 UTC, 2 replies.
- [PR] Use Swift 6.1 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/15 11:02:36 UTC, 0 replies.
- Re: [PR] [SPARK-51806][BUILD] Upgrade `kryo-shaded` to 4.0.3 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/15 12:20:08 UTC, 8 replies.
- [PR] [SPARK-51803][Core] Store remote JDBC type in the spark schema in the… [spark] - posted by "alekjarmov (via GitHub)" <gi...@apache.org> on 2025/04/15 13:07:11 UTC, 8 replies.
- Re: [PR] [SPARK-51808] Use Swift 6.1 in GitHub Action CIs [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/15 13:37:18 UTC, 1 replies.
- [PR] [SPARK-51809] Support `offset` in `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/15 13:43:29 UTC, 3 replies.
- [PR] [SPARK-51765] SQL Scripting [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2025/04/15 14:12:09 UTC, 0 replies.
- [PR] [SPARK-51786][SQL] DSv2 expressions in column defaults in CREATE/REPLACE [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/04/15 16:00:30 UTC, 43 replies.
- [PR] [WIP][CORE] Call interrupt() without holding uninterruptibleLock to avoid possible deadlock [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/04/15 17:07:43 UTC, 2 replies.
- Re: [PR] [SPARK-51803][Core] Store external engine JDBC type in the spark schema in the… [spark] - posted by "alekjarmov (via GitHub)" <gi...@apache.org> on 2025/04/15 20:40:50 UTC, 7 replies.
- [PR] [SPARK-51638][CORE][3.5] Fix fetching the remote disk stored RDD blocks via the external shuffle service [spark] - posted by "attilapiros (via GitHub)" <gi...@apache.org> on 2025/04/15 22:29:51 UTC, 3 replies.
- Re: [PR] [SPARK-47854][PYTHON][CONNECT] Avoid shadowing python built-ins in python function variable naming [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/16 00:27:26 UTC, 1 replies.
- Re: [PR] [SPARK-50727] Call skipChildren for nested object [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/16 00:27:28 UTC, 1 replies.
- [PR] [SPARK-51811][BUILD] Upgrade `commons-io` to 2.19.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2025/04/16 01:00:20 UTC, 3 replies.
- [PR] [SPARK-51812][SQL] Remove redundant parameters of method `QueryExecution#createSparkPlan` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2025/04/16 02:11:08 UTC, 5 replies.
- [PR] [SPARK-51813][SQL][CORE] Add a nonnullable DefaultCachedBatchKryoSerializer to avoid null propagating in DefaultCachedBatch serde [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/04/16 04:13:14 UTC, 2 replies.
- [PR] [SPARK-51814][SS] Introduce a new API `transformWithState` in PySpark [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/04/16 04:53:23 UTC, 24 replies.
- [PR] [SPARK-50718][PYTHON][TESTS][FOLLOW-UP] Enable `pyspark.sql.tests.test_artifact` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/16 06:02:47 UTC, 3 replies.
- [PR] [SPARK-51815] Add `Row` struct [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/16 06:03:48 UTC, 10 replies.
- [PR] [SPARK-51816][SQL] Simplify `StatFunctions.multipleApproxQuantiles` with dataframe APIs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/16 06:07:47 UTC, 2 replies.
- [PR] [SPARK-51806][BUILD][4.0] Upgrade kryo-shaded to 4.0.3 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/16 06:41:46 UTC, 3 replies.
- [PR] [CONNECT][SPARK-51817][SPARK-49578] Re-introduce ansiConfig fields in messageParameters of CAST_INVALID_INPUT and CAST_OVERFLOW [spark] - posted by "nija-at (via GitHub)" <gi...@apache.org> on 2025/04/16 08:46:52 UTC, 0 replies.
- Re: [PR] [SPARK-48769][SQL] Support constant folding for ScalaUDF [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2025/04/16 08:59:41 UTC, 0 replies.
- Re: [PR] [SPARK-50572][SQL] Fix race condition in CachedRDDBuilder.cachedColumnBuffers [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2025/04/16 09:00:00 UTC, 0 replies.
- [PR] Move QueryExecution creation to AnalyzeHandler and don't Execute for AnalyzePlanRequests [spark] - posted by "peterpashkin (via GitHub)" <gi...@apache.org> on 2025/04/16 10:00:34 UTC, 0 replies.
- [PR] group by ordinal [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/04/16 10:31:37 UTC, 1 replies.
- [PR] [WIP][SPARK-51554][SQL] Add the time_trunc() function for TIME datatype [spark] - posted by "the-sakthi (via GitHub)" <gi...@apache.org> on 2025/04/16 11:00:16 UTC, 1 replies.
- Re: [PR] [SPARK-51812][SQL] Remove redundant parameters of some methods in `QueryExecution` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/16 11:57:18 UTC, 1 replies.
- [PR] [SPARK-51819][PYTHON] Update pyspark-errors test module to include missing tests [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/04/16 11:59:01 UTC, 2 replies.
- [PR] Split resolve ddl and view [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2025/04/16 13:39:56 UTC, 1 replies.
- [PR] Error handling for partition datatype conversion call [spark] - posted by "Madhukar525722 (via GitHub)" <gi...@apache.org> on 2025/04/16 13:44:18 UTC, 1 replies.
- Re: [PR] [SPARK-51149][CORE] Log classpath in SparkSubmit on ClassNotFoundException [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/04/16 16:38:44 UTC, 0 replies.
- Re: [PR] [SPARK-50639][SQL] Improve warning logging in CacheManager [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/04/16 16:41:00 UTC, 0 replies.
- [PR] Throwing classified error when disallowed functions are called during StatefulProcessor.init() [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/04/16 19:10:43 UTC, 0 replies.
- Re: [PR] [SPARK-51822] Throwing classified error when disallowed functions are called during StatefulProcessor.init() [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/04/16 20:22:55 UTC, 6 replies.
- Re: [PR] Delay `Join.metadataOutput` computation until `Join` is resolved [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/04/16 20:34:24 UTC, 0 replies.
- Re: [PR] [SPARK-51250][K8S] Add Support for K8s PriorityClass Configuration fo… [spark] - posted by "zemin-piao (via GitHub)" <gi...@apache.org> on 2025/04/16 20:47:43 UTC, 4 replies.
- Re: [PR] [SPARK-51822]][SS] Throwing classified error when disallowed functions are called during StatefulProcessor.init() [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/04/16 21:45:59 UTC, 2 replies.
- Re: [PR] [SPARK-51820][SQL] Move `UnresolvedOrdinal` construction before analysis to avoid issue with group by ordinal [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2025/04/16 21:51:28 UTC, 19 replies.
- [PR] Bump golang.org/x/net from 0.36.0 to 0.38.0 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/04/16 23:24:11 UTC, 0 replies.
- Re: [PR] [SPARK-51818][CONNECT] Move QueryExecution creation to AnalyzeHandler and don't Execute for AnalyzePlanRequests [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/16 23:35:17 UTC, 9 replies.
- [PR] [SPARK-51823][SS] Add config to not persist state store on executors [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2025/04/17 00:03:31 UTC, 15 replies.
- [PR] [SPARK-51739][PYTHON][FOLLOW-UP] Set spark.sql.execution.arrow.pyspark.validateSchema.enabled for 3.5 connect client build [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/17 01:25:23 UTC, 3 replies.
- [PR] [SPARK-51824][ML][CONNECT][TESTS] Force to clean up the ML cache after each test [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/17 01:25:44 UTC, 8 replies.
- [PR] [SPARK-51758][FOLLOWUP][SS] Fix flaky test around watermark due to additional batch causing empty df [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/04/17 03:56:16 UTC, 3 replies.
- [PR] [SPARK-51825] Add `SparkFileUtils` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/17 04:12:33 UTC, 2 replies.
- [PR] [SPARK-51800][INFRA][FOLLOW-UP] Respect PYSPARK_UDS_MODE environment variable in SparkContext initialization [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/17 04:20:20 UTC, 2 replies.
- [PR] [SPARK-51826][K8S][DOCS] Update `YuniKorn` docs with `1.6.2` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/17 04:33:35 UTC, 4 replies.
- Re: [PR] [SPARK-51757][SQL] Fix LEAD/LAG Function Offset Exceeds Window Group Size [spark] - posted by "xin-aurora (via GitHub)" <gi...@apache.org> on 2025/04/17 04:53:30 UTC, 14 replies.
- [PR] [SPARK-51828] Update `README.md` with YuniKorn 1.6.2 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/17 05:19:56 UTC, 2 replies.
- [PR] [SPARK-51829][PYTHON][ML] Client side should update `client.thread_local.ml_caches` after deletion [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/17 05:23:48 UTC, 2 replies.
- Re: [PR] [SPARK-51758][SS][FOLLOWUP][TESTS] Fix flaky test around watermark due to additional batch causing empty df [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/04/17 05:34:04 UTC, 4 replies.
- Re: [PR] [SPARK-51822][SS] Throwing classified error when disallowed functions are called during StatefulProcessor.init() [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/04/17 05:45:26 UTC, 5 replies.
- [PR] Windows [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/17 06:15:10 UTC, 2 replies.
- [PR] [SPARK-51832][BUILD] Use -q option to simplify maven version evaluation [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/04/17 07:43:11 UTC, 2 replies.
- [PR] Revert "[SPARK-51758][SS][FOLLOWUP][TESTS] Fix flaky test around watermark due to additional batch causing empty df" [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/17 09:38:29 UTC, 2 replies.
- [PR] [SPARK-51758][SS][FOLLOWUP][TESTS] Fix `TransformWithStateInPandasParityTests.test_transform_with_state_with_wmark_and_non_event_time` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/17 09:53:44 UTC, 3 replies.
- [PR] [WIP]HiveException: Unable to alter table. partition keys can not be changed. [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/04/17 10:28:11 UTC, 0 replies.
- [PR] FIX change type hint of pyspark percentile functions to reflect tuple of variable amount of floats [spark] - posted by "Rolfdv (via GitHub)" <gi...@apache.org> on 2025/04/17 10:36:48 UTC, 0 replies.
- Re: [PR] [SPARK-51223][CONNECT] Always use an ephemeral port for local connect [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2025/04/17 11:14:04 UTC, 1 replies.
- Re: [PR] [SPARK-51830] Exception handling for partition datatype conversion call [spark] - posted by "Madhukar525722 (via GitHub)" <gi...@apache.org> on 2025/04/17 13:15:49 UTC, 0 replies.
- [PR] Use the same property map for TableInfo [spark] - posted by "anoopj (via GitHub)" <gi...@apache.org> on 2025/04/17 16:06:19 UTC, 0 replies.
- [PR] SwiftyLab [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/17 16:08:04 UTC, 2 replies.
- [PR] [SPARK-51758] Fix test case related to extra batch causing empty df due to watermark [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/04/17 18:29:34 UTC, 0 replies.
- Re: [PR] [SPARK-51758][SS] Fix test case related to extra batch causing empty df due to watermark [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/04/17 18:35:38 UTC, 23 replies.
- Re: [PR] [SPARK-51745] Enforce State Machine for RocksDBStateStore [spark] - posted by "liviazhu-db (via GitHub)" <gi...@apache.org> on 2025/04/17 18:48:52 UTC, 1 replies.
- [PR] [MINOR][FOLLOW-UP] Update `flatMapGroupsWithState` test conf [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/04/17 21:15:34 UTC, 0 replies.
- [PR] [SPARK-51833][SQL] Normalize relations in NormalizePlan [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/04/17 21:36:38 UTC, 2 replies.
- Re: [PR] [SPARK-50967][SS][MINOR][FOLLOW-UP] Update `flatMapGroupsWithState` test conf [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/04/17 22:57:34 UTC, 2 replies.
- Re: [PR] [SPARK-51372][SQL][FOLLOW-UP] Retain the property map for DataSourceV2 TableInfo [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/17 23:14:36 UTC, 4 replies.
- Re: [PR] [MINOR][PYTHON] FIX change type hint of pyspark percentile functions to reflect tuple of variable amount of floats [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/17 23:16:33 UTC, 1 replies.
- [PR] [SPARK-51272][CORE] Aborting instead of re-submitting of partially completed indeterminate result stage [spark] - posted by "attilapiros (via GitHub)" <gi...@apache.org> on 2025/04/17 23:44:01 UTC, 11 replies.
- [PR] [SPARK-51834][SQL] Support end-to-end table constraint management [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/04/18 00:12:16 UTC, 55 replies.
- Re: [PR] [WIP][SPARK-50585][PYTHON] Visualize doctest examples for PySpark plotting [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/18 00:26:35 UTC, 1 replies.
- [PR] [SPARK-51836][PYTHON][CONNECT][TESTS] Avoid per-test-function connect session setup [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/18 01:49:12 UTC, 2 replies.
- [PR] [Do not Merge][SQL] Investigate default is null [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/04/18 02:53:23 UTC, 0 replies.
- Re: [PR] [SPARK-51663][SQL] Short circuit && operation for JoinSelectionHelper [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/18 02:55:53 UTC, 1 replies.
- Re: [PR] [SPARK-51814][SS][PYTHON] Introduce a new API `transformWithState` in PySpark [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/04/18 03:08:30 UTC, 2 replies.
- [PR] [SPARK-51837] Support `inputFiles` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/18 04:15:59 UTC, 2 replies.
- [PR] [SPARK-51838][PYTHON][TESTS] Add a test to check function wildcard import [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/18 04:33:22 UTC, 3 replies.
- [PR] Revert "[SPARK-51829][PYTHON][ML] Client side should update `client.thread_local.ml_caches` after deletion" From 4.0 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/18 04:44:02 UTC, 2 replies.
- Re: [PR] [SPARK-51609][SQL] Optimize Recursive CTE execution for simple queries [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/18 05:00:40 UTC, 22 replies.
- [PR] [SPARK-51839] Support `except(All)?/intersect(All)?/union(All)?/unionByName` in `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/18 05:51:27 UTC, 5 replies.
- [PR] [SPARK-51663][SQL][FOLLOWUP] modify buildLeft and buildRight with lazy [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/04/18 06:23:25 UTC, 4 replies.
- Re: [PR] [SPARK-49488][SQL][FOLLOWUP] Use correct MySQL datetime functions when pushing down EXTRACT [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/18 06:28:11 UTC, 1 replies.
- Re: [PR] [SPARK-51585][SQL] Oracle dialect supports pushdown datetime functions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/18 06:29:59 UTC, 0 replies.
- [PR] [SPARK-49488][SQL][FOLLOWUP] Do not push down extract expression if extracted field is second [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/04/18 07:18:41 UTC, 4 replies.
- [PR] [SPARK-51836][PYTHON][CONNECT][TESTS][FOLLOW-UP] update `test_connect_classification` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/18 07:22:21 UTC, 2 replies.
- [PR] [SPARK-51774][CONNECT][FOLLOW-UP][TESTS] Skip ConnectErrorsTest if grpc is not available [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/18 07:23:27 UTC, 5 replies.
- [PR] [SPARK-51841] Support `isLocal` and `isStreaming` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/18 07:38:43 UTC, 2 replies.
- [PR] [MINOR][INFRA] https://github.com/apache/spark/pull/50447 [spark-connect-swift] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/04/18 08:04:52 UTC, 0 replies.
- Re: [PR] [SPARK-51842][SQL] Remove unnecessary judgement from fillDefaultValue [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/04/18 08:11:14 UTC, 1 replies.
- Re: [PR] [SPARK-51840][SQL] Restore Partition columns in HiveExternalCatalog#alterTable [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/04/18 08:44:52 UTC, 7 replies.
- Re: [PR] [MINOR][INFRA] Fix `merge_spark_pr` script for no jira case [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/18 09:07:11 UTC, 2 replies.
- Re: [PR] [SPARK-51663][SQL][FOLLOWUP] change buildLeft and buildRight to function [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/18 09:08:23 UTC, 5 replies.
- [PR] [SPARK-51843][PYTHON][ML][TESTS] Avoid per-test classic session start & stop [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/18 09:28:25 UTC, 2 replies.
- [PR] [SPARK-51844][PYTHON][TESTS] Add ReusedMixedTestCase for test env with both classic and connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/18 09:33:08 UTC, 2 replies.
- [PR] Revert "[SPARK-51691][CORE][TESTS] SerializationDebugger should swallow exception when try to find the reason of serialization problem" [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/18 09:48:14 UTC, 1 replies.
- Re: [PR] [SPARK-49386][SPARK-27734][CORE][SQL] Add memory based thresholds for shuffle spill [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/04/18 10:02:10 UTC, 3 replies.
- [PR] [SPARK-51845][ML][CONNECT] Add proto message `Clean` to clean up all ml cache [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/18 10:04:58 UTC, 0 replies.
- [PR] [SPARK-51846] Upgrade `gRPC Swift Protobuf` to 1.2 and `gRPC Swift NIO Transport` to 1.0.3 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/18 10:49:54 UTC, 2 replies.
- Re: [PR] [SPARK-51801][BUILD] Upgrade ORC Format to 1.1.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/18 11:40:39 UTC, 3 replies.
- [PR] [SPARK-51847][PYTHON][TESTS] Extend PySpark testing framework util functions with basic data tests [spark] - posted by "stanlocht (via GitHub)" <gi...@apache.org> on 2025/04/18 16:41:51 UTC, 1 replies.
- [PR] add new parameter option to views [spark] - posted by "yumingxuanguo-db (via GitHub)" <gi...@apache.org> on 2025/04/18 17:32:04 UTC, 0 replies.
- [PR] draft [spark] - posted by "xiaonanyang-db (via GitHub)" <gi...@apache.org> on 2025/04/18 21:48:14 UTC, 0 replies.
- Re: [PR] [SPARK-51848] Fix parsing XML records with defined schema of array/structs of Variant [spark] - posted by "sandip-db (via GitHub)" <gi...@apache.org> on 2025/04/18 23:06:22 UTC, 0 replies.
- Re: [PR] [SPARK-51848] Fix parsing XML records with defined schema of array/structs/map of Variant [spark] - posted by "xiaonanyang-db (via GitHub)" <gi...@apache.org> on 2025/04/18 23:47:55 UTC, 1 replies.
- Re: [PR] Char varchar serde [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/19 00:25:35 UTC, 1 replies.
- Re: [PR] [SPARK-50753][PYTHON] Add CachedAccessor for PySpark Plotting [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/19 00:25:37 UTC, 1 replies.
- Re: [PR] [SPARK-48334] [CORE] Release RpcEnv when SparkContext Initialization Fails [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/19 00:25:39 UTC, 4 replies.
- Re: [PR] [SPARK-49008][PYTHON] Use `ParamSpec` to propagate `func` signature in `transform` [spark] - posted by "nicklamiller (via GitHub)" <gi...@apache.org> on 2025/04/19 04:57:24 UTC, 2 replies.
- Re: [PR] [SPARK-51849][SQL] Refactoring `ResolveDDLCommandStringTypes` [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/04/19 13:55:18 UTC, 3 replies.
- [PR] Minor update to example [spark] - posted by "CarterFendley (via GitHub)" <gi...@apache.org> on 2025/04/19 17:59:26 UTC, 1 replies.
- Re: [PR] [SPARK-48568][SQL] Improve Performance of CodeFormatter [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/20 00:29:50 UTC, 1 replies.
- Re: [PR] [SPARK-50469][SQL] V1Writes should respect the output ordering [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/20 00:29:51 UTC, 1 replies.
- [PR] [SPARK-51850] Fix `DataFrame.execute` to reset previously received Arrow batch data [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/20 11:17:19 UTC, 2 replies.
- [PR] [SPARK-51851] Refactor to use `withGPRC` wrappers [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/20 13:52:04 UTC, 2 replies.
- [PR] [SPARK-51852] Support `SPARK_CONNECT_AUTHENTICATE_TOKEN` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/20 23:18:05 UTC, 3 replies.
- [PR] [SPARK-51688][PYTHON][FOLLOW-UP] Log string instead of option instance [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/20 23:22:13 UTC, 2 replies.
- Re: [PR] [MINOR][DOCS] Minor update to example [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/20 23:25:49 UTC, 9 replies.
- Re: [PR] [SPARK-51848][SQL] Fix parsing XML records with defined schema of array/structs/map of Variant [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/20 23:28:20 UTC, 0 replies.
- [PR] [SPARK-51814][SS][PYTHON][FOLLOW-UP] Add pyspark.sql.tests.pandas.helper for testing pyspark-client [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/21 00:45:12 UTC, 3 replies.
- [PR] [SPARK-51838][PYTHON][TESTS][FOLLWO-UP] Skip `test_wildcard_import` in low python versions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/21 01:12:59 UTC, 3 replies.
- [PR] [SPARK-51853] Improve `show` to support all signatures [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/21 02:02:50 UTC, 0 replies.
- Re: [PR] [SPARK-51847][PYTHON] Extend PySpark testing framework util functions with basic data tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/21 03:18:43 UTC, 0 replies.
- Re: [PR] [SPARK-51845][ML][CONNECT] Add proto messages `CleanCache` and `GetCacheInfo` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/21 03:42:49 UTC, 2 replies.
- [PR] [SPARK-51838][PYTHON][TESTS][FOLLOW-UP] Skip `test_wildcard_import` in Python 3.10 and below [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/21 04:20:11 UTC, 3 replies.
- Re: [PR] [SPARK-51853] Improve `DataFrame.show` API to support all signatures [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/21 04:43:37 UTC, 1 replies.
- [PR] [SPARK-51854] Remove `SwiftyTextTable` dependency and unused `import` statements [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/21 04:51:24 UTC, 4 replies.
- [PR] [SPARK-51855] Support `Spark SQL REPL` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/21 06:07:47 UTC, 4 replies.
- [PR] [SPARK-51856] Add API for estimate saved model size [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/04/21 08:49:53 UTC, 0 replies.
- Re: [PR] [SPARK-51782] Add `build-ubuntu-arm` test pipeline [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/21 10:06:33 UTC, 1 replies.
- [PR] [SPARK-51838][PYTHON][TESTS][FOLLWO-UP] Skip typing module in `test_wildcard_import` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/21 12:38:09 UTC, 0 replies.
- [PR] [SPARK-51857] Support `token/userId/userAgent` parameters in `SparkConnectClient` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/21 13:01:40 UTC, 4 replies.
- Re: [PR] [SPARK-48585][SQL] Make `built-in` JdbcDialect's method `classifyException` throw out the `original` exception [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/21 13:44:57 UTC, 0 replies.
- [PR] [MINOR] rename the spark-connect-enabled tarball [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/21 14:18:12 UTC, 2 replies.
- [PR] [SPARK-51858] Support `SPARK_REMOTE` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/21 14:31:04 UTC, 3 replies.
- [PR] Bump google.golang.org/grpc from 1.71.0 to 1.72.0 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/04/21 14:31:38 UTC, 0 replies.
- Re: [PR] [SPARK-29397][core] Extend plugin interface to include the driver. [spark] - posted by "Madhukar525722 (via GitHub)" <gi...@apache.org> on 2025/04/21 20:37:07 UTC, 0 replies.
- Re: [PR] Add New Parameter `options` to Logical Plan `View`. [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/22 00:16:01 UTC, 0 replies.
- Re: [PR] Logistic Matrix Factorization(LMF) and Item2Vec models [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/22 00:27:10 UTC, 1 replies.
- Re: [PR] [SPARK-51838][PYTHON][TESTS][FOLLWO-UP] Ignore typing module in `test_wildcard_import` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/22 01:54:37 UTC, 1 replies.
- [PR] [SPARK-51860][CONNECT] Disable `spark.connect.grpc.debug.enabled` by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/22 02:20:17 UTC, 5 replies.
- [PR] [SPARK-51861][SQL][UI] Remove duplicated/unnecessary info InMemoryRelation Plan Detail [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/04/22 03:08:40 UTC, 1 replies.
- [PR] [SPARK-51688][PYTHON][FOLLOW-UP] Use `socketPath.get` for logging instead of `socketHost.get` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/22 04:06:23 UTC, 1 replies.
- [PR] [SPARK-51814][SS][PYTHON][FOLLLOW-UP] Use RecordBatch.schema.names instead of column_names for old pyarrow compatibility [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/22 04:14:31 UTC, 4 replies.
- [PR] [SPARK-51862][ML][CONNECT][TESTS] Clean up ml cache before ReusedConnectTestCase and ReusedMixedTestCase [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/22 05:01:32 UTC, 2 replies.
- Re: [PR] [SPARK-51861][SQL][UI] Remove duplicated/unnecessary info of InMemoryRelation Plan Detail [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/04/22 05:31:56 UTC, 2 replies.
- [PR] [SPARK-51863] Support `join` and `crossJoin` in `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/22 06:53:29 UTC, 4 replies.
- Re: [PR] [SPARK-50983][SQL]Part 1.a Add outer scope attributes for SubqueryExpression [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/04/22 07:38:17 UTC, 9 replies.
- [PR] [SPARK-51864] Rename parameters and support case-insensitively [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/22 07:51:48 UTC, 2 replies.
- [PR] [SPARK-51529] Support for TLS connections [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/22 08:04:39 UTC, 0 replies.
- Re: [PR] [SPARK-51529] Support `TLS` connections [spark-connect-swift] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2025/04/22 08:11:41 UTC, 2 replies.
- [PR] [SPARK-51861][CORE] NettyServer doesn't shutdown if SparkContext initialize failed [spark] - posted by "IsisPolei (via GitHub)" <gi...@apache.org> on 2025/04/22 08:32:32 UTC, 0 replies.
- Re: [PR] [SPARK-51821][CORE] Call interrupt() without holding uninterruptibleLock to avoid possible deadlock [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/22 08:49:42 UTC, 85 replies.
- Re: [PR] [SPARK-44155] Adding a dev utility to improve error messages based on LLM [spark] - posted by "smileyboy2019 (via GitHub)" <gi...@apache.org> on 2025/04/22 08:58:09 UTC, 0 replies.
- Re: [PR] [SPARK-51856][ML][CONNECT] Update model size API to count distributed DataFrame size [spark] - posted by "smileyboy2019 (via GitHub)" <gi...@apache.org> on 2025/04/22 08:59:39 UTC, 3 replies.
- [PR] [SPARK-51814][SS][PYTHON][FOLLLOW-UP] Uses `list(self)` instead of `StructType.fields` for old version compat [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/22 09:55:20 UTC, 2 replies.
- [PR] [MINOR] Make `README.md` up-to-date [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/22 10:26:07 UTC, 2 replies.
- [PR] [CONNECT][TESTS] Print stacktrace message when RootAllocator fails to close [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/22 13:37:46 UTC, 3 replies.
- Re: [PR] [SPARK-51400] Replace ArrayContains nodes to InSet [spark] - posted by "adrians (via GitHub)" <gi...@apache.org> on 2025/04/22 13:41:31 UTC, 4 replies.
- [PR] [SPARK-51866][CONNECT][TESTS] Close `serializerAllocator` and `deserializerAllocator` when the creation of `CloseableIterator` by `ArrowEncoderSuite#roundTripWithDifferentIOEncoders` fails [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/22 14:25:03 UTC, 0 replies.
- Re: [PR] [SPARK-51865][CONNECT][TESTS] Print stacktrace message when `RootAllocator` fails to close [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/22 14:36:06 UTC, 0 replies.
- [PR] [WIP] [SPARK-51867][ML] Make scala model supporting save / load methods against local filesystem path [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/04/22 14:42:02 UTC, 8 replies.
- [PR] [SPARK-51868][SQL] Move type coercion validation to a separate object [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/04/22 21:45:36 UTC, 4 replies.
- [PR] [WIP] Creating user error classification for TransformWithState [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/04/22 21:54:10 UTC, 0 replies.
- Re: [PR] [SPARK-48334][CORE] NettyServer doesn't shutdown if SparkContext initialize failed [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/22 22:55:16 UTC, 2 replies.
- [PR] [SPARK-50983][SQL]Part2.a Adds support for decorrelating nested correlated subqueries in Optimizer [spark] - posted by "AveryQi115 (via GitHub)" <gi...@apache.org> on 2025/04/22 23:01:06 UTC, 0 replies.
- Re: [PR] [SPARK-51869][SS] Create classification for user errors within handleInputRows for Scala TransformWithState [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/04/22 23:06:08 UTC, 15 replies.
- [PR] [SPARK-51870] Support `SPARK_GENERATE_GOLDEN_FILES` in `SQLTests` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/23 00:24:14 UTC, 4 replies.
- Re: [PR] [SPARK-50704][SQL] Support more pushdown functions for MySQL connector [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/23 00:27:05 UTC, 1 replies.
- Re: [PR] [SPARK-50625][BUILD] simplify shell scripts using mvn help:evaluate [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/23 00:27:08 UTC, 1 replies.
- [PR] [SPARK-51871] Improve `SQLTests` to check column names [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/23 00:48:01 UTC, 1 replies.
- Re: [PR] [SPARK-51866][CONNECT][TESTS] Ensure `serializerAllocator/deserializerAllocator` are closed if `ArrowEncoderSuite#roundTripWithDifferentIOEncoders` fails to create `CloseableIterator` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/23 02:48:28 UTC, 1 replies.
- [PR] Test branch-4.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/23 03:00:33 UTC, 0 replies.
- [PR] [MASTER] Test df-after-pyspark-test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/23 03:18:22 UTC, 1 replies.
- [PR] [SPARK-50582][PYTHON][FOLLOW-UP] Add `quote` to functions `__all__` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/23 03:37:29 UTC, 2 replies.
- [PR] [SPARK-51873][ML] For OneVsRest algorithm, allow using save / load to replace cache [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/04/23 04:37:39 UTC, 2 replies.
- [PR] [SPARK-47791][SQL][FOLLOWUP] Avoid invalid JDBC decimal scale [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/23 06:35:12 UTC, 5 replies.
- [PR] [SPARK-51874][CORE][SQL] Add TypedConfigBuilder for Scala Enumeration [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/04/23 07:54:05 UTC, 4 replies.
- [PR] [SPARK-51875] Support `repartition(ByExpression)?` and `coalesce` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/23 08:26:55 UTC, 2 replies.
- [PR] [SPARK-51820][SQL][FOLLOWUP] Fix `origin` for `UnresolvedOrdinal` [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/04/23 09:08:45 UTC, 4 replies.
- [PR] [WIP][SPARK-51821] Testing [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2025/04/23 09:08:56 UTC, 1 replies.
- Re: [PR] [SPARK-51876][PYTHON][TESTS] Add configuration for `log4j.configurationFile` in the PySpark submission args of `run_individual_python_test` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/23 09:20:27 UTC, 4 replies.
- Re: [PR] [4.0] Test df-after-pyspark-test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/23 09:23:39 UTC, 0 replies.
- [PR] [SPARK-51877][PYTHON][CONNECT] Add functions 'chr', 'random' and 'uuid' [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/23 10:00:00 UTC, 4 replies.
- Re: [PR] [SPARK-51805] [SQL] Get function with improper argument should throw proper exception instead of an internal one [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/04/23 10:00:52 UTC, 12 replies.
- Re: [PR] [SPARK-47954][K8S] Support creating ingress entry for external UI access [spark] - posted by "melin (via GitHub)" <gi...@apache.org> on 2025/04/23 10:13:50 UTC, 0 replies.
- [PR] Custom history provider [spark] - posted by "GauravWaghmare (via GitHub)" <gi...@apache.org> on 2025/04/23 10:18:14 UTC, 3 replies.
- [PR] [Do not merge][SQL] Investigate foldable [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/04/23 12:19:33 UTC, 0 replies.
- [PR] skip test_transform_with_state_in_pandas_event_time [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/23 12:51:42 UTC, 0 replies.
- Re: [PR] [SPARK-51865][CONNECT][TESTS] Print stacktrace message when `o.a.arrow.memory.BaseAllocator` fails to close [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/23 12:54:27 UTC, 8 replies.
- [PR] [SPARK-51879] Support `groupBy/rollup/cube` in `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/23 13:47:03 UTC, 4 replies.
- [PR] [SPARK-51880][ML][PYTHON][CONNECT] Avoid eager model removal in meta algorithms when collectSubModel is true [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/23 14:11:31 UTC, 3 replies.
- Re: [PR] [SPARK-51758][SS][FOLLOWUP][4.0] Skip the test `test_transform_with_state_with_wmark_and_non_event_time` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/23 14:27:40 UTC, 0 replies.
- [PR] [SPARK-51881][SQL] Make AvroOptions comparable [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/04/23 15:58:20 UTC, 23 replies.
- [PR] [SPARK-51883][DOCS][PYTHON] Python Data Source docs for filter pushdown [spark] - posted by "wengh (via GitHub)" <gi...@apache.org> on 2025/04/23 17:19:11 UTC, 0 replies.
- [PR] [SPARK-51119][SQL][FOLLOW-UP] Fix missing fallback case for parsing corrupt exists_default value [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/04/23 19:00:51 UTC, 4 replies.
- [PR] Fix a bug for MapState clear() in Python TWS [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2025/04/23 22:30:19 UTC, 0 replies.
- Re: [PR] [SPARK-51889][PYTHON][SS] Fix a bug for MapState clear() in Python TWS [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2025/04/23 22:33:16 UTC, 8 replies.
- Re: [PR] [SPARK-51882][SS][PYTHON][TESTS][4.0] Skip the test `test_transform_with_state_with_wmark_and_non_event_time` [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/04/23 23:10:49 UTC, 3 replies.
- Re: [PR] [SPARK-50775][SQL] Allow char/varchar in string expressions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/24 00:27:09 UTC, 1 replies.
- [PR] [MINOR][PYTHON][TESTS] Further fix scheduled builder without grpc [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/24 02:14:24 UTC, 2 replies.
- Re: [PR] [SPARK-51878][SQL] Improve fillDefaultValue by exec the foldable default expression. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/04/24 02:25:12 UTC, 6 replies.
- [PR] Test rockdbsjni 10 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/24 02:35:39 UTC, 0 replies.
- [PR] [SPARK-51891][SS] Squeeze the protocol of ListState GET / PUT / APPENDLIST for transformWithState in PySpark [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/04/24 03:45:34 UTC, 7 replies.
- [PR] [SPARK-51893] Upgrade CI to test K8s 1.33 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/24 06:49:34 UTC, 2 replies.
- [PR] [SPARK-51894] Update `setup-minikube` to v0.0.19 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/24 06:59:08 UTC, 2 replies.
- [PR] [SPARK-51895][K8S][INFRA] Update K8s IT CI to use K8s 1.33 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/24 07:06:58 UTC, 5 replies.
- [PR] [SPARK-51896][CORE][SQL] Add Java Enum Support for TypedConfigBuilder [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/04/24 07:39:59 UTC, 18 replies.
- [PR] [SPARK-51897][SQL] Fix compilation warnings related to "The auto insertion will be deprecated, please write `TimeType.apply` explicitly." [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/24 08:11:14 UTC, 1 replies.
- [PR] [SPARK-51898][PYTHON][CONNECT][TESTS] Refactor SparkConnectErrorTests to support connect-only mode [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/24 08:45:09 UTC, 2 replies.
- Re: [PR] [SPARK-51885][SQL]Part 1.b Add analyzer support for nested correlated subqueries [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/04/24 09:35:04 UTC, 2 replies.
- [PR] Custom-history-provider [spark] - posted by "GauravWaghmare (via GitHub)" <gi...@apache.org> on 2025/04/24 10:10:27 UTC, 1 replies.
- Re: [PR] [SPARK-51897][SQL] Fix compilation warnings related to "The auto insertion will be deprecated, please write `TimeType.apply` explicitly" [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/24 11:21:48 UTC, 1 replies.
- [PR] [SPARK-51899] Implement an error allowlist for spark.catalog.listTables() [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2025/04/24 11:48:05 UTC, 0 replies.
- [PR] [SPARK-51900][SQL] Properly throw datatype mismatch in single-pass Analyzer [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/04/24 12:21:10 UTC, 2 replies.
- Re: [PR] [SPARK-51817][SPARK-49578][CONNECT] Re-introduce ansiConfig fields in messageParameters of CAST_INVALID_INPUT and CAST_OVERFLOW [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/24 14:16:52 UTC, 3 replies.
- [PR] [SPARK-51901] [SQL] Disallow generator functions in grouping sets [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/04/24 15:40:30 UTC, 8 replies.
- [PR] Removing async metadata purging for OperatorStateMetadataV2 [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/04/24 19:00:51 UTC, 0 replies.
- Re: [PR] [SPARK-51904] Removing async metadata purging for OperatorStateMetadataV2 [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/04/24 20:56:54 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-51899][SQL] Implement an error allowlist for spark.catalog.listTables() [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/24 23:03:45 UTC, 4 replies.
- [PR] [SPARK-51906][SQL] Dsv2 expressions in alter table add columns [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/04/25 00:11:31 UTC, 1 replies.
- Re: [PR] [SPARK-50802][SQL] Remove ApplyCharTypePadding rule [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/25 00:27:38 UTC, 1 replies.
- Re: [PR] [SPARK-48665][PYTHON][CONNECT] Support providing a dict in pyspark lit to create a map. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/25 00:27:40 UTC, 1 replies.
- Re: [PR] [SPARK-49919][SQL] Add special limits support for return content as JSON dataset [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/25 00:27:41 UTC, 1 replies.
- [PR] [SPARK-51908][K8S][TESTS] Update `setup-minikube` to v0.0.19 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/25 01:16:23 UTC, 3 replies.
- [PR] [SPARK-51909][INFRA] Add a scheduled workflow for PySpark Classic-only [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/25 01:42:10 UTC, 3 replies.
- Re: [PR] [SPARK-51904][SS] Removing async metadata purging for StateSchemaV3 and ignoring non-batch files when listing OperatorMetadata files [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/04/25 02:05:36 UTC, 3 replies.
- [PR] [SPARK-51911] Support `lateralJoin` in `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/25 02:42:55 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-51880][ML][PYTHON][CONNECT] Avoid eager model removal in meta algorithms when collectSubModel is true [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/04/25 02:53:25 UTC, 1 replies.
- [PR] [SPARK-51827][SS][CONNECT] Support Spark Connect on transformWithState in PySpark [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/04/25 03:23:11 UTC, 13 replies.
- [PR] [SPARK-51912] Support `semanticHash` and `sameSemantics` in `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/25 03:54:22 UTC, 4 replies.
- [PR] [SPARK-51909][INFRA][FOLLOW-UP] Fix python lint [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/25 03:58:22 UTC, 2 replies.
- [PR] [SPARK-51913][SQL] JDBCTableCatalog#loadTable should throw no such table error correctly [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/25 05:30:49 UTC, 7 replies.
- [PR] [SPARK-51880][ML][PYTHON][CONNECT] Fix ML cache object python client references [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/04/25 05:58:59 UTC, 3 replies.
- [PR] [SPARK-51898][PYTHON][CONNECT][TESTS][FOLLOW-UP] Fix inconsistent exception [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/25 07:45:44 UTC, 4 replies.
- [PR] [MINOR][PYTHON][DOCS] Add 4 missing functions to API references [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/25 07:48:48 UTC, 2 replies.
- [PR] [SPARK-51915][PYTHON][CONNECT][TESTS] Enable SparkConnectDataFrameDebug in connect-only mode [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/25 07:54:51 UTC, 2 replies.
- [PR] [SPARK-51916] Add `create_(scala|table)_function` and `drop_function` test scripts [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/25 08:00:05 UTC, 2 replies.
- [PR] [SPARK-51914][SQL] Add com.mysql.cj to spark.sql.hive.metastore.sharedPrefixes [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/04/25 09:26:51 UTC, 2 replies.
- [PR] DESCRIPTION [spark] - posted by "klu2300030052 (via GitHub)" <gi...@apache.org> on 2025/04/25 10:06:35 UTC, 1 replies.
- [PR] Update CONTRIBUTING.md [spark] - posted by "klu2300030052 (via GitHub)" <gi...@apache.org> on 2025/04/25 10:09:26 UTC, 1 replies.
- [PR] [SPARK-51917] Add `DataFrameWriterV2` actor [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/25 10:37:16 UTC, 2 replies.
- [PR] SPARK-51710 Passing an empty array to PySpark Dataframe.dropDuplicates should behave the same as passing no arguments [spark] - posted by "joke1196 (via GitHub)" <gi...@apache.org> on 2025/04/25 14:19:25 UTC, 3 replies.
- Re: [PR] [SPARK-51820][SQL][CONNECT] Address remaining issues for new `group`/`order` by ordinal approach [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/04/25 14:22:38 UTC, 12 replies.
- [PR] [SPARK-51918][CORE] Wait for out/err appenders to stop + flush remaining data [spark] - posted by "m8719-github (via GitHub)" <gi...@apache.org> on 2025/04/25 14:42:06 UTC, 0 replies.
- Re: [PR] [SPARK-51918][CORE] Executor exit wait for out/err appenders to stop + flush remaining data [spark] - posted by "m8719-github (via GitHub)" <gi...@apache.org> on 2025/04/25 15:05:14 UTC, 1 replies.
- [PR] [PYTHON] Allow overwriting statically registered Python Data Source [spark] - posted by "wengh (via GitHub)" <gi...@apache.org> on 2025/04/25 15:48:07 UTC, 4 replies.
- [PR] [SPARK-51671][SQL] Add column pruning ro Recursive CTEs [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/04/25 15:49:35 UTC, 0 replies.
- [PR] [SPARK-51920][SS][PYTHON] Fix composite/nested StructType in value state for python [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2025/04/25 18:29:01 UTC, 1 replies.
- [PR] [SPARK-51921] Use long type for TTL duration in millisecond [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2025/04/25 21:33:33 UTC, 0 replies.
- [PR] [DO NOT MERGE]Testing nested correlations handling [spark] - posted by "AveryQi115 (via GitHub)" <gi...@apache.org> on 2025/04/25 21:55:21 UTC, 0 replies.
- Re: [PR] [SPARK-51921][PYTHON][SS] Use long type for TTL duration in millisecond [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/04/25 21:57:36 UTC, 5 replies.
- [PR] [SPARK-51922] [SS] Fix UTFDataFormatException thrown from StateStoreChangelogReaderFactory for v1 [spark] - posted by "liviazhu-db (via GitHub)" <gi...@apache.org> on 2025/04/25 21:58:57 UTC, 4 replies.
- Re: [PR] [WIP][SPARK-50983][SQL] Support Nested Correlated Subqueries for Analyzer [spark] - posted by "AveryQi115 (via GitHub)" <gi...@apache.org> on 2025/04/25 22:06:57 UTC, 0 replies.
- [PR] [MINOR][DOCS] Add migration note for mapInPandas and mapInArrow validation [spark] - posted by "wengh (via GitHub)" <gi...@apache.org> on 2025/04/25 22:09:24 UTC, 2 replies.
- Re: [PR] [SPARK-50800][PYTHON][TESTS] Upgrade python to 3.11 in Python Packaging test [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/26 00:26:23 UTC, 1 replies.
- Re: [PR] [SPARK-50758][K8S]Mounts the krb5 config map on the executor pod [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/26 00:26:23 UTC, 1 replies.
- [PR] [SPARK-51923][BUILD] Upgrade Apache `commons-collections4` to 4.5.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/26 14:41:22 UTC, 3 replies.
- [PR] [SPARK-51924][BUILD] Upgrade jupiter-interface to 0.14.0 and Junit5 to 5.12.2 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/26 14:50:30 UTC, 2 replies.
- [PR] [SPARK-51925][CONNECT][TESTS] Fix the erroneous `assume` in the `ClassFinderSuite` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/26 15:51:57 UTC, 4 replies.
- [PR] fix: (PySpark) Support for subclasses in type_verifier [spark] - posted by "ybhaw (via GitHub)" <gi...@apache.org> on 2025/04/26 18:07:22 UTC, 0 replies.
- [PR] Fix aliases names and attribute ref datatype [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2025/04/26 21:57:16 UTC, 0 replies.
- Re: [PR] [SPARK-51921][SS][PYTHON] Use long type for TTL duration in millisecond in transformWithState [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/04/27 00:42:57 UTC, 6 replies.
- [PR] [SPARK-51814][SS][PYTHON][FOLLOWUP] Sync missing Python function types [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/04/27 01:51:17 UTC, 3 replies.
- [PR] [SPARK-51926][CORE][SQL] Add INVALID_CONF_VALUE.subXXX error class to conf errors [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/04/27 06:33:02 UTC, 6 replies.
- [PR] [SPARK-51927][BUILD] Upgrade jackson to 2.19.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/27 07:14:47 UTC, 3 replies.
- [PR] [SPARK-51929][BUILD] Upgrade AWS SDK v2 to 2.29.52 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/27 07:20:35 UTC, 3 replies.
- [PR] [SPARK-51928][BUILD] Upgrade common-text to 1.13.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/27 07:24:10 UTC, 1 replies.
- [PR] [SPARK-51930][BUILD] Upgrade datasketches-java to 6.2.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/27 07:32:04 UTC, 3 replies.
- [PR] [SPARK-51827][FOLLOWUP] Re-Sync missing Python function types [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/27 09:38:54 UTC, 0 replies.
- Re: [PR] [SPARK-51827][PYTHON][CONNECT][FOLLOWUP] Fix incorrect `PythonEvalType` reference in `python/pyspark/sql/connect/group.py` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/27 09:46:31 UTC, 2 replies.
- Re: [PR] [SPARK-51428] Assign Aliases for collated expression trees deterministically [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/04/27 17:36:09 UTC, 3 replies.
- [PR] [SPARK-XXXXX][SQL] Add maxBytesPerOutputBatch to limit the number of bytes of Arrow output batch [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/04/27 18:26:07 UTC, 0 replies.
- Re: [PR] [SPARK-51928][BUILD] Upgrade Apache `common-text` to 1.13.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/27 19:29:11 UTC, 1 replies.
- Re: [PR] [SPARK-51869][SS] Create classification for user errors within UDFs for Scala TransformWithState [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/04/27 22:29:00 UTC, 4 replies.
- [PR] [SPARK-51814][SS][PYTHON][FOLLOWUP][MINOR] Add missing type handling for PythonEvalType.toString [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/04/27 23:55:35 UTC, 4 replies.
- Re: [PR] [SPARK-51931][SQL] Add maxBytesPerOutputBatch to limit the number of bytes of Arrow output batch [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/28 00:09:00 UTC, 24 replies.
- Re: [PR] [SPARK-42199][SQL] Fix issues around Dataset.groupByKey [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/28 00:28:51 UTC, 2 replies.
- [PR] [SPARK-51932][CONNECT][TESTS] Enable SparkConnectProgressHandlerE2E in connect-only mode [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/28 01:48:45 UTC, 2 replies.
- [PR] [SPARK-51933][SS][DOCS] Document the new API `transformWithState` in PySpark [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/04/28 02:22:50 UTC, 3 replies.
- Re: [PR] [SPARK-51899][SQL] Implement error handling rules for spark.catalog.listTables() [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/28 03:22:46 UTC, 1 replies.
- [PR] [SPARK-51934] Add `MacOS` integration test with Apache Spark 3.5.5 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/28 03:52:42 UTC, 4 replies.
- Re: [PR] [SPARK-47573][K8S] Support custom driver log url [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2025/04/28 04:48:25 UTC, 0 replies.
- Re: [PR] [SPARK-51919][PYTHON] Allow overwriting statically registered Python Data Source [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/28 08:03:41 UTC, 0 replies.
- [PR] [SPARK-51936][SQL] ReplaceTableAsSelect should overwrite the new table instead of append [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/28 08:32:00 UTC, 5 replies.
- Re: [PR] [SPARK-51428][SQL] Assign Aliases for collated expression trees deterministically [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2025/04/28 09:08:56 UTC, 6 replies.
- Re: [PR] [SPARK-51867][ML] Make scala model supporting save / load methods against local filesystem path [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/28 10:20:52 UTC, 12 replies.
- [PR] [SPARK-51817][SQL][TESTS] Re-generate golden files for Java 21 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/28 11:02:15 UTC, 0 replies.
- Re: [PR] [SPARK-51937][SQL][TESTS] Re-generate golden files of `postgreSQL/float4.sql` and `postgreSQL/int8.sql` for Java 21 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/28 11:14:20 UTC, 2 replies.
- Re: [PR] [SPARK-51069][SQL] Add big-endian support to UnsafeRowUtils.validateStructuralIntegrityWithReasonImpl [spark] - posted by "jonathan-albrecht-ibm (via GitHub)" <gi...@apache.org> on 2025/04/28 15:33:09 UTC, 0 replies.
- Re: [PR] [SPARK-51094][SQL][TESTS] Adjust some test parameters to work on s390x [spark] - posted by "jonathan-albrecht-ibm (via GitHub)" <gi...@apache.org> on 2025/04/28 15:35:33 UTC, 2 replies.
- [PR] [SPARK-51935] Fix lazy behavior of iterators in interpreted df.collect() [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2025/04/28 15:40:19 UTC, 1 replies.
- [PR] [WIP] Adding release() to ReadStateStore interface [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/04/28 17:24:05 UTC, 0 replies.
- [PR] [SPARK-51939][PYTHON][DOC] Refine Python data source docstring by adding arrow batch examples [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/04/28 18:03:00 UTC, 0 replies.
- Re: [PR] [SPARK-51939][PYTHON][DOCS] Refine Python data source docstring by adding arrow batch examples [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/04/28 18:04:19 UTC, 2 replies.
- Re: [PR] [SPARK-51883][DOCS][PYTHON] Python Data Source user guide for filter pushdown [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/04/28 18:07:46 UTC, 0 replies.
- [PR] update home path and fix for windows. [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2025/04/28 20:22:52 UTC, 1 replies.
- [PR] Use long type for TTL duration in millisecond in transformWithState [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2025/04/28 23:07:57 UTC, 0 replies.
- Re: [PR] [Python] (PySpark) Support for subclasses in type_verifier [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/28 23:11:27 UTC, 0 replies.
- Re: [PR] [SPARK-51921][SS][PYTHON][4.0] Use long type for TTL duration in millisecond in transformWithState [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/28 23:13:13 UTC, 3 replies.
- Re: [PR] [SPARK-51710][PYTHON] Passing an empty array to PySpark Dataframe.dropDuplicates should behave the same as passing no arguments [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/28 23:29:55 UTC, 5 replies.
- [PR] [SPARK-51940][SS] Add interface for managing streaming checkpoint metadata [spark] - posted by "jackierwzhang (via GitHub)" <gi...@apache.org> on 2025/04/28 23:46:55 UTC, 8 replies.
- Re: [PR] [SPARK-50720][CORE] Support external shuffle service enablement in local-cluster mode [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/29 00:27:36 UTC, 1 replies.
- Re: [PR] [SPARK-51935][SQL] Fix lazy behavior of iterators in interpreted df.collect() [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/29 00:43:38 UTC, 1 replies.
- Re: [PR] [SPARK-51802][PYTHON][DOCS] OSS PySpark User Guide Docs [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/29 00:57:01 UTC, 1 replies.
- Re: [PR] [SPARK-45741][BUILD] Upgrade Netty to 4.1.100.Final [spark] - posted by "1210170281-yyds (via GitHub)" <gi...@apache.org> on 2025/04/29 02:50:23 UTC, 1 replies.
- [PR] [SPARK-51941][SQL] Fix the precision problem for convertToCatalyst when the Input is BigDecimal between -1.0 and 1.0 [spark] - posted by "jackylee-ch (via GitHub)" <gi...@apache.org> on 2025/04/29 03:58:05 UTC, 3 replies.
- [PR] [SPARK-51942] Support `selectExpr` in `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/29 03:58:20 UTC, 2 replies.
- [PR] [MINOR][PYTHON][TESTS] Clean up a group of connect tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/29 04:04:29 UTC, 4 replies.
- [PR] Upgrade setup-swift to next tag [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/29 04:39:25 UTC, 0 replies.
- [PR] [SPARK-51944][BUILD] Upgrade Netty to 4.1.121.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/29 05:54:45 UTC, 6 replies.
- Re: [PR] [SPARK-51943] Upgrade `setup-swift` to `next` tag [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/29 06:10:40 UTC, 4 replies.
- Re: [PR] [SPARK-][CORE] Expand tilde `(~)` in spark.jars.ivy path configuration [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/29 06:34:27 UTC, 5 replies.
- Re: [PR] [SPARK-51943] Upgrade `setup-swift` to `3.0` dev version [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/29 06:43:49 UTC, 1 replies.
- [PR] [SPARK-51946][SQL] Eagerly fail for creating hive-incompatible datasource table with 'col' a partition name [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/04/29 08:23:22 UTC, 6 replies.
- [PR] [draft] Tree training early stop capped by model size [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/04/29 09:09:12 UTC, 0 replies.
- Re: [PR] [SPARK-51554][SQL] Add the time_trunc() function for TIME datatype [spark] - posted by "the-sakthi (via GitHub)" <gi...@apache.org> on 2025/04/29 10:11:12 UTC, 0 replies.
- [PR] [WIP][SPARK-51947] Spark connect model cache offloading [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/04/29 11:13:54 UTC, 0 replies.
- [PR] [SPARK-51948] Make the changes of `mllib` module to trigger the test for the `connect` module [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/29 11:55:17 UTC, 0 replies.
- Re: [PR] [SPARK-51948][BUILD] Make changes of `mllib` module to trigger the test for the `connect` module [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/29 12:02:04 UTC, 6 replies.
- [PR] [SPARK-51941][SQL][3.5] Fix the precision problem for convertToCatalyst when the Input is BigDecimal between -1.0 and 1.0 [spark] - posted by "jackylee-ch (via GitHub)" <gi...@apache.org> on 2025/04/29 13:05:22 UTC, 3 replies.
- Re: [PR] [SPARK-51890][SQL] Add New Parameter `options` to Logical Plan `View`. [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/04/29 13:43:16 UTC, 1 replies.
- [PR] [SPARK-51950][BUILD] Upgrade `Parquet` to 1.15.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/29 15:25:41 UTC, 0 replies.
- [PR] [SPARK-51949][CONNECT] Bump up the default value of `CONNECT_GRPC_MARSHALLER_RECURSION_LIMIT` [spark] - posted by "vicennial (via GitHub)" <gi...@apache.org> on 2025/04/29 16:18:14 UTC, 0 replies.
- [PR] [SPARK-51016][SQL] Non-deterministic SQL expressions should set indeterminate map stage output level [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/04/29 16:23:12 UTC, 9 replies.
- Re: [PR] [SPARK-51016][SQL] Stage.isIndeterminate gives wrong result in case the shuffle partitioner uses an inDeterministic attribute or expression. [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/04/29 16:28:10 UTC, 0 replies.
- [PR] [SPARK-51951] Upgrade `Gradle` to 8.14 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/29 16:59:16 UTC, 3 replies.
- [PR] [SPARK-51952] Disable `fail-fast` in `Build Test CI` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/29 17:11:37 UTC, 0 replies.
- Re: [PR] [SPARK-51952] Disable `fail-fast` in `Build Test CI` matrix [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/29 17:23:16 UTC, 1 replies.
- [PR] [SPARK-51953] Support Java 24 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/29 17:25:16 UTC, 7 replies.
- Re: [PR] [SPARK-51955] Adding release() to ReadStateStore interface and reusing ReadStore for Streaming Aggregations [spark] - posted by "liviazhu-db (via GitHub)" <gi...@apache.org> on 2025/04/29 22:49:19 UTC, 16 replies.
- [PR] [SPARK-51956][K8S] Fix `KerberosConfDriverFeatureStep` to warn in case of failures [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/29 23:43:17 UTC, 4 replies.
- [PR] [WIP][PYTHON][CONNECT] Introduce Scalar Arrow UDF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/30 00:48:12 UTC, 0 replies.
- [PR] [SPARK-51867][ML][FOLLOW-UP] Make `LogisticRegressionModel.Data` `private[spark]` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/30 02:36:29 UTC, 2 replies.
- [PR] [WIP][SPARK-51902][SQL] Enforce check constraint on table insertion [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/04/30 03:43:07 UTC, 0 replies.
- [PR] [SPARK-50605][CONNECT][TESTS][FOLLOW-UP] Remove unused YarnConnectTest [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/04/30 03:43:27 UTC, 2 replies.
- [PR] [SPARK-51867][ML][FOLLOW-UP] Use private[ml] to avoid exporting Data class [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/04/30 04:24:35 UTC, 1 replies.
- Re: [PR] [SPARK-51867][ML][FOLLOW-UP] Use private[ml] to avoid exposing Data class [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/30 06:20:18 UTC, 1 replies.
- [PR] [SPARK-51958][CORE][SQL][TESTS] Replace hardcoded icu version with `com.ibm.icu.util.VersionInfo.ICU_VERSION` it tests [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/04/30 07:45:51 UTC, 0 replies.
- [PR] [WIP] Reduce HDFS NameNode RPC on vectorized Parquet reader [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/04/30 09:09:49 UTC, 1 replies.
- [PR] [SPARK-51959][PYTHON] Make functions not import ParentDataFrame [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/30 09:19:30 UTC, 2 replies.
- [PR] [SPARK-51963][ML] Simplify IndexToString.transform [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/04/30 10:26:15 UTC, 2 replies.
- [PR] [SPARK-51962] [SQL] [TESTS] Improve ORDER BY testing coverage for non-orderable sort expressions [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/04/30 10:26:17 UTC, 3 replies.
- [PR] [SPARK-51964][SQL] Correctly resolve attributes from hidden output in ORDER BY and HAVING on top of an Aggregate in single-pass Analyzer [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/04/30 12:43:47 UTC, 9 replies.
- [PR] add better support for integrating with external cluster manager [spark] - posted by "dejanzele (via GitHub)" <gi...@apache.org> on 2025/04/30 12:54:27 UTC, 1 replies.
- [PR] [SPARK-51965] Update `Compatibility` section of `docs/operations.md` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/30 13:21:02 UTC, 2 replies.
- [PR] [SPARK-51967] Use `discardableResult` to prevent unnecessary warnings [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/30 15:50:50 UTC, 2 replies.
- [PR] [SPARK-51968] Support `(cache|uncache|refresh)Table`, `refreshByPath`, `isCached`, `clearCache` in `Catalog` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/30 16:39:14 UTC, 2 replies.
- Re: [PR] [SPARK-51958][CORE][SQL][TESTS] Replace hardcoded icu version with `c.ibm.icu.util.VersionInfo.ICU_VERSION` it tests [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/30 18:41:17 UTC, 0 replies.
- [PR] using threadlocal instead [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/04/30 18:44:21 UTC, 2 replies.
- Re: [PR] [SPARK-51902][SQL] Enforce check constraint on table insertion [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/04/30 21:11:40 UTC, 0 replies.
- [PR] [SPARK-51905][SQL] Disallow NOT ENFORCED CHECK constraint [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/04/30 22:48:58 UTC, 1 replies.
- [PR] [SPARK-51969] Support `createTable`, `tableExists`, `functionExists` in `Catalog` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/04/30 23:12:16 UTC, 0 replies.