reviews@spark.apache.org, 2025-03

You are viewing a plain text version of this content. The canonical link for it is here.

- [PR] Fix the teardown function of test_connect_function.py [spark] - posted by "sfc-gh-dyadav (via GitHub)" <gi...@apache.org> on 2025/03/01 00:02:08 UTC, 0 replies.
- Re: [PR] [SPARK-51290][SQL] Enable filling default values in DSv2 writes [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/03/01 00:26:49 UTC, 18 replies.
- Re: [PR] [SPARK-42856][GRAPHX] Break tie with highest vertex id in label propagation [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/01 00:27:46 UTC, 1 replies.
- Re: [PR] [SPARK-49644][SQL] Support drop multi-level partition V2 table with partial partition spec [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/01 00:27:48 UTC, 1 replies.
- [PR] [SPARK-50615][FOLLOWUP][SQL] Avoid dropping metadata in the push rule. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2025/03/01 00:28:56 UTC, 3 replies.
- [PR] [WIP][SPARK-43221][CORE] Host local block fetching should use a block status of a block stored on disk [spark] - posted by "attilapiros (via GitHub)" <gi...@apache.org> on 2025/03/01 00:39:23 UTC, 0 replies.
- [PR] [SPARK-51358] [SS] Introduce snapshot upload lag detection through StateStoreCoordinator [spark] - posted by "zecookiez (via GitHub)" <gi...@apache.org> on 2025/03/01 00:56:16 UTC, 59 replies.
- Re: [PR] [SPARK-49960][SQL] Custom ExpressionEncoder support and TransformingEncoder fixes [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/03/01 01:01:54 UTC, 1 replies.
- Re: [PR] [SPARK-51016][SQL] Fix for incorrect results on retry for Left Outer Join with indeterministic join keys [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2025/03/01 01:19:09 UTC, 0 replies.
- Re: [PR] [SPARK-49507][SQL] Fix Expected only partition pruning predicates exception [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2025/03/01 01:34:43 UTC, 6 replies.
- Re: [PR] [SPARK-44856][PYTHON] Improve Python UDTF arrow serializer performance [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/03/01 01:38:33 UTC, 14 replies.
- Re: [PR] [SPARK-51341][CORE] Cancel time task with suitable way. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/01 04:32:22 UTC, 7 replies.
- Re: [PR] [SPARK-51354][K8S][TEST][DOC] Fix sbt K8s integration test arg javaImageTag [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/03/01 07:23:43 UTC, 6 replies.
- Re: [PR] [SPARK-50793][SQL] Fix MySQL cast function for DOUBLE, LONGTEXT, BIGINT and BLOB types [spark] - posted by "sunxiaoguang (via GitHub)" <gi...@apache.org> on 2025/03/01 08:53:40 UTC, 10 replies.
- Re: [PR] [SPARK-49479][CORE] Cancel the Timer non-daemon thread on stopping the BarrierCoordinator [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/01 10:21:02 UTC, 53 replies.
- Re: [PR] [SPARK-51271][PYTHON] Add filter pushdown API to Python Data Sources [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/01 11:23:03 UTC, 44 replies.
- Re: [PR] [SPARK-51350][SQL] Implement Show Procedures [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/03/01 21:23:40 UTC, 50 replies.
- Re: [PR] [SPARK-43221][CORE] Host local block fetching should use a block status of a block stored on disk [spark] - posted by "attilapiros (via GitHub)" <gi...@apache.org> on 2025/03/02 00:08:51 UTC, 11 replies.
- Re: [PR] fixed ObjectAggregationIterator#createNewAggregationBuffer repeat computer bufferFieldTypes [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/02 00:27:33 UTC, 1 replies.
- Re: [PR] [MINOR][DOCS] Fix code comments for Executor [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/02 02:00:12 UTC, 1 replies.
- Re: [PR] [MINOR][TESTS][CONNECT] Fix the teardown function of test_connect_function.py [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/02 02:06:14 UTC, 1 replies.
- [PR] reduce toJSON latency [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2025/03/02 05:29:31 UTC, 0 replies.
- Re: [PR] [SPARK-49488][SQL][FOLLOWUP] Use correct MySQL datetime functions when pushing down EXTRACT [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/02 12:03:23 UTC, 16 replies.
- Re: [PR] [SPARK-51321][SQL] Add rpad and lpad support for PostgresDialect and MsSQLServerDialect expression pushdown [spark] - posted by "milosstojanovic (via GitHub)" <gi...@apache.org> on 2025/03/02 17:53:22 UTC, 21 replies.
- Re: [PR] [SPARK-51362][SQL] Change toJSON to use NextIterator API to eliminate adjacent record dependency [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2025/03/02 21:40:26 UTC, 11 replies.
- Re: [PR] [SPARK-50386][SQL] Improve SparkFatalException Propagation when OutOfMemoryError occurs on BroadcastExchangeExec building small table to broadcast [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/03 00:26:29 UTC, 1 replies.
- Re: [PR] [SPARK-49489][SQL][HIVE] HMS client respects `hive.thrift.client.maxmessage.size` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/03 02:23:51 UTC, 5 replies.
- [PR] [SPARK-51363] Delegate `Desc As JSON` clustering info to recursive jsonType struct [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/03/03 02:43:16 UTC, 0 replies.
- [PR] [WIP][SPARK-51364][SQL][TESTS] Improve the integration tests for external data source by check filter pushed down [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/03 02:49:24 UTC, 0 replies.
- [PR] Revert "[SPARK-51309][BUILD] Upgrade rocksdbjni to 9.10.0" [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/03 03:25:05 UTC, 3 replies.
- [PR] [SPARK-50578][PYTHON][SS][FOLLOW-UP] Add the Python new package into setup.py [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/03 03:28:02 UTC, 5 replies.
- [PR] [SPARK-51366][SQL] Add a new visitCaseWhen method to V2ExpressionSQLBuilder [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/03 03:28:14 UTC, 7 replies.
- Re: [PR] [SPARK-51353][INFRA][BUILD] Retry dyn/closer.lua for mvn before falling back to archive.a.o [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/03/03 05:52:04 UTC, 3 replies.
- Re: [PR] [SPARK-51301][BUILD] Bump zstd-jni 1.5.7-1 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/03/03 06:22:50 UTC, 2 replies.
- [PR] Disable Schema Evolution Suite in Connect TransformWithState in Python Suite [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2025/03/03 06:44:27 UTC, 0 replies.
- [PR] [SPARK-51316][PYTHON][FOLLOW-UP] Change default value from 256MB to 16MB [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/03 08:34:18 UTC, 1 replies.
- [PR] [SPARK-51369] Fix FOR cursor variable to work with mixed case names [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2025/03/03 08:58:04 UTC, 1 replies.
- Re: [PR] [SPARK-51364][SQL][TESTS] Improve the integration tests for external data source by check filter pushed down [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/03 09:00:10 UTC, 3 replies.
- [PR] [SPARK-48538][SQL][FOLLOWUP] Add warning logs when overriding HiveConf [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/03/03 10:01:29 UTC, 2 replies.
- Re: [PR] [SPARK-50714][SQL][SS] Enable schema evolution for TransformWithState when Avro encoding is used [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/03 11:19:51 UTC, 0 replies.
- Re: [PR] [SPARK-48538][SQL][FOLLOWUP] Add info logs when overriding HiveConf [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/03/03 11:29:57 UTC, 3 replies.
- [PR] [MINOR][DOCS] Fix docs for web-ui [spark] - posted by "tomscut (via GitHub)" <gi...@apache.org> on 2025/03/03 12:33:36 UTC, 0 replies.
- [PR] Bump golang.org/x/oauth2 from 0.25.0 to 0.27.0 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/03/03 13:50:08 UTC, 2 replies.
- Re: [PR] Bump golang.org/x/oauth2 from 0.25.0 to 0.26.0 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/03/03 13:50:10 UTC, 1 replies.
- Re: [PR] [SPARK-51342][SQL] Add `TimeType` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/03 14:00:30 UTC, 10 replies.
- [PR] Refactor AstBuilder.scala [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2025/03/03 14:03:00 UTC, 0 replies.
- Re: [PR] [SPARK-51357][SQL] Preserve plan change logging level for views [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/03 14:14:24 UTC, 5 replies.
- Re: [PR] [SPARK-51369][SQL] Fix FOR cursor variable to work with mixed case names [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/03 15:41:41 UTC, 1 replies.
- Re: [PR] [SPARK-51363][SQL] Delegate `Desc As JSON` clustering info to recursive jsonType struct [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/03 15:54:37 UTC, 0 replies.
- [PR] [SPARK-51371] [SQL] Change toString to toPrettySQL when building Aliases in ResolveAggregateFunctions [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/03/03 17:30:54 UTC, 5 replies.
- Re: [PR] [WIP][SPARK-51298][SQL] Support variant in CSV scan [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2025/03/03 17:46:55 UTC, 0 replies.
- Re: [PR] [SPARK-51370] Code clarity improvements for INSERT INTO parsing codes in AstBuilder.scala [spark] - posted by "bart-samwel (via GitHub)" <gi...@apache.org> on 2025/03/03 18:04:47 UTC, 3 replies.
- Re: [PR] [SPARK-17604][SS] FileStreamSource: provide a new option to have retention on input files [spark] - posted by "darxriggs (via GitHub)" <gi...@apache.org> on 2025/03/03 18:17:22 UTC, 0 replies.
- Re: [PR] [SPARK-51373] Removing extra copy for column family prefix from 'ReplyChangelog' [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/03/03 18:49:17 UTC, 1 replies.
- Re: [PR] [SPARK-51349] Change precedence of null and "null" in sorting in QueryTest [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2025/03/03 19:10:42 UTC, 1 replies.
- Re: [PR] [SPARK-50855][SS][CONNECT] Spark Connect Support for TransformWithState In Scala [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/03/03 19:12:52 UTC, 6 replies.
- [PR] [SPARK-51372] Introduce a builder pattern in TableCatalog [spark] - posted by "anoopj (via GitHub)" <gi...@apache.org> on 2025/03/03 19:29:40 UTC, 9 replies.
- [PR] [SPARK-51374][CORE] Switch to Using java.util.Map in Logging APIs [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/03/03 19:33:26 UTC, 3 replies.
- Re: [PR] [SPARK-51373] [SS] Removing extra copy for column family prefix from 'ReplyChangelog' [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/03/03 20:28:47 UTC, 3 replies.
- Re: [PR] [SPARK-51229][BUILD][CONNECT] Fix dependency:analyze goal on connect common [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/03/03 20:29:08 UTC, 14 replies.
- Re: [PR] [SPARK-51355][DOCS] Add a brief explanation for Spark Connect at PySpark Overview page [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/03 23:01:10 UTC, 1 replies.
- Re: [PR] [SPARK-51334][CONNECT] Add java/scala version in analyze spark_version response [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/03 23:06:45 UTC, 5 replies.
- Re: [PR] [SPARK-51272][CORE]. Fix for the race condition in Scheduler causing failure in retrying all partitions in case of indeterministic shuffle keys [spark] - posted by "attilapiros (via GitHub)" <gi...@apache.org> on 2025/03/03 23:17:21 UTC, 41 replies.
- [PR] [SPARK-51375][SQL][CONNECT] Suppress `SparkConnectExecutionManager.periodicMaintenance` log messages [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/03 23:24:54 UTC, 0 replies.
- Re: [PR] [SPARK-51149][CORE] Log classpath in SparkSubmit on ClassNotFoundException [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/03/03 23:27:00 UTC, 1 replies.
- [PR] [WIP] testing shcema evol [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/03/03 23:31:17 UTC, 1 replies.
- Re: [PR] [SPARK-50639][SQL] Improve warning logging in CacheManager [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/03/03 23:33:00 UTC, 1 replies.
- [PR] [SPARK-51378] [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2025/03/04 01:12:17 UTC, 0 replies.
- [PR] [WIP][ML][SPARK-51379] Move treeAggregate's final aggregation from driver to executor [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/04 01:15:45 UTC, 0 replies.
- Re: [PR] [SPARK-49507][SQL] Fix the case issue after enabling metastorePartitionPruningFastFallback [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2025/03/04 02:43:04 UTC, 4 replies.
- Re: [PR] [SPARK-51363][SQL]`Desc As JSON` clustering column names [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/04 03:03:38 UTC, 1 replies.
- Re: [PR] [SPARK-51187][SQL][SS] Implement the graceful deprecation of incorrect config introduced in SPARK-49699 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/04 03:09:32 UTC, 1 replies.
- [PR] [SPARK-51380][SQL] Make sure JDBC dialect could check the supported functions by Introduce functionToSQL and aggregateFunctionToSQL [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/04 03:44:00 UTC, 5 replies.
- Re: [PR] [SPARK-51307][SQL] locationUri in CatalogStorageFormat shall be decoded for display [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/04 04:14:36 UTC, 4 replies.
- Re: [PR] [SPARK-51252] [SS] Add instance metrics for last uploaded snapshot version in HDFS State Stores [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/03/04 04:20:26 UTC, 4 replies.
- [PR] [SPARK-51381][SQL][CONNECT] Show `Session ID` in `Spark Connect Sessi on` page [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/04 04:37:04 UTC, 0 replies.
- [PR] [SPARK-51382] Add `submit-spark-connect-server.sh` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/04 05:02:24 UTC, 3 replies.
- Re: [PR] [SPARK-51375][SQL][CONNECT] Suppress `SparkConnect(Execution|Session)Manager.periodicMaintenance` log messages [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/04 05:10:44 UTC, 1 replies.
- Re: [PR] [SPARK-51381][SQL][CONNECT] Show `Session ID` in `Spark Connect Session` page [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/04 05:11:41 UTC, 3 replies.
- Re: [PR] [SPARK-45641][DOCS][FOLLOWUP] Add `Started At` description for web-ui.md [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/03/04 05:39:20 UTC, 1 replies.
- Re: [PR] [SPARK-51378][CORE] Apply JsonProtocol's accumulableExcludeList to ExecutorMetricsUpdate and TaskEndReason [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/04 06:36:42 UTC, 1 replies.
- Re: [PR] [SPARK-51368][SS][PYTHON][TEST] Disable Schema Evolution Suite in Connect TransformWithState for Python Suite [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/04 06:44:13 UTC, 1 replies.
- [PR] [SPARK-51383][PYTHON][CONNECT] Avoid making RPC calls if clients are already known as stopped [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/04 08:02:36 UTC, 6 replies.
- Re: [PR] [SPARK-51372][SQL] Introduce a builder pattern in TableCatalog [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/04 08:43:12 UTC, 32 replies.
- [PR] [SPARK-51029][INFRA][FOLLOWUP] Remove LICENSE and NOTICE for unused/duplicated hive deps [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/03/04 08:47:24 UTC, 1 replies.
- Re: [PR] [SPARK-48547][DEPLOY] Add opt-in flag to have SparkSubmit automatically call System.exit after user code main method exits [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/03/04 10:10:57 UTC, 0 replies.
- [PR] [MINOR][DOCS] Add `spark.taskMetrics.trackUpdatedBlockStatuses` description for configuration.md [spark] - posted by "tomscut (via GitHub)" <gi...@apache.org> on 2025/03/04 11:38:55 UTC, 0 replies.
- Re: [PR] [SPARK-51349][SQL][TESTS] Change precedence of null and "null" in sorting in QueryTest [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/04 13:03:46 UTC, 7 replies.
- [PR] [SPARK-51385][SQL] Normalize out projection added in DeduplicateRelations for union child output deduplication [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/03/04 13:10:43 UTC, 2 replies.
- [PR] [SPARK-51386][CORE][SQL] Assign name to error conditions _LEGACY_ERROR_TEMP_3300-3302 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/03/04 14:23:32 UTC, 11 replies.
- Re: [PR] [WIP][SPARK-50892][SQL]Add UnionLoopExec, physical operator for recursion, to perform execution of recursive queries [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/03/04 15:01:36 UTC, 36 replies.
- [PR] [SPARK-51387][BUILD] Upgrade Netty to 4.1.119.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/04 15:17:18 UTC, 5 replies.
- [PR] Test sbt 1.10.10 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/04 16:14:02 UTC, 0 replies.
- [PR] [MINOR][CORE] Remove unused `private[executor] var httpUrlConnectionTimeoutMillis` from `ExecutorClassLoader` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/04 16:14:54 UTC, 2 replies.
- [PR] [WIP][SPARK-51384][SQL] Support `java.time.LocalTime` as the external type of `TimeType` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/04 16:35:44 UTC, 0 replies.
- [PR] [SPARK-51388][SQL] Improve SQL fragment propagation in to_timestamp and UNION [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/03/04 16:36:50 UTC, 6 replies.
- [PR] [SPARK-50855][CONNECT][TESTS][FOLLOWUP] Refactor `TransformWithStateConnectSuite` to run `DROP TABLE IF EXISTS my_sink` in `beforeAll/afterEach` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/04 17:53:45 UTC, 3 replies.
- Re: [PR] [WIP][SPARK-51180][BUILD] Upgrade Arrow to 19.0.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/04 18:10:53 UTC, 1 replies.
- Re: [PR] [SPARK-51367][BUILD] Upgrade slf4j to 2.0.17 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/04 18:12:08 UTC, 1 replies.
- Re: [PR] [SPARK-51072][CORE] CallerContext to set Hadoop cloud audit context [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/04 18:22:47 UTC, 0 replies.
- [PR] [SPARK-51389][BUILD] Allow full customization of profiles in scalastyle [spark] - posted by "cnauroth (via GitHub)" <gi...@apache.org> on 2025/03/04 21:16:10 UTC, 4 replies.
- [PR] [SPARK-51097] [SS] Split apart SparkPlan metrics and instance metrics [spark] - posted by "zecookiez (via GitHub)" <gi...@apache.org> on 2025/03/04 21:50:53 UTC, 7 replies.
- [PR] [SPARK-51390][INFRA] Add more dependencies in LICENSE-binary for Spark 4.0.0 release [spark] - posted by "cnauroth (via GitHub)" <gi...@apache.org> on 2025/03/04 22:22:59 UTC, 3 replies.
- Re: [PR] [MINOR][DOCS] Link to security reporting page [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/05 00:25:21 UTC, 2 replies.
- [PR] [SPARK-51391][SQL][CONNECT] Fix `SparkConnectClient` to respect `SPARK_USER` and `user.name` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/05 00:38:19 UTC, 17 replies.
- Re: [PR] [SPARK-51314][DOCS][PS] Add proper note for distributed-sequence about indeterministic case [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2025/03/05 00:48:45 UTC, 1 replies.
- Re: [PR] [SPARK-51330][PYTHON] Enable spark.sql.execution.pythonUDTF.arrow.enabled by default [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/05 01:56:38 UTC, 1 replies.
- Re: [PR] [SPARK-51276][PYTHON] Enable spark.sql.execution.arrow.pyspark.enabled by default [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/05 02:07:23 UTC, 0 replies.
- Re: [PR] [SPARK-48516][PYTHON][CONNECT] Turn on Arrow optimization for Python UDFs by default [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/05 02:10:18 UTC, 0 replies.
- [PR] [SPARK-51393][PYTHON] Fallback to regular Python UDF when Arrow is not found but Arrow-optimized Python UDFs enabled [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/05 02:21:20 UTC, 6 replies.
- [PR] [SPARK-51097] [SS] Revert RocksDB instance metrics changes [spark] - posted by "zecookiez (via GitHub)" <gi...@apache.org> on 2025/03/05 02:27:47 UTC, 2 replies.
- [PR] [MINOR] Remove unused imports [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/05 02:39:54 UTC, 3 replies.
- [PR] [SPARK-51277][PYTHON][FOLLOW-UP] Remove 0-arg check in Spark Connect side as well [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/05 02:56:58 UTC, 2 replies.
- [PR] [SPARK-51307][SQL][3.5] locationUri in CatalogStorageFormat shall be decoded for display [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/03/05 03:07:09 UTC, 4 replies.
- [PR] [SPARK-51097] [SS] Revert RocksDB instance metrics changes for branch-4.0 [spark] - posted by "zecookiez (via GitHub)" <gi...@apache.org> on 2025/03/05 03:07:13 UTC, 0 replies.
- [PR] [SPARK-51394][ML] Optimize out the additional shuffle in stats tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/05 03:10:12 UTC, 2 replies.
- Re: [PR] [SPARK-51182][SQL] DataFrameWriter should throw dataPathNotSpecifiedError when path is not specified [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/03/05 04:19:03 UTC, 6 replies.
- Re: [PR] [SPARK-51281][SQL] DataFrameWriterV2 should respect the path option [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/03/05 06:30:07 UTC, 5 replies.
- [PR] [SPARK-51396][SQL] RuntimeConfig.getOption shouldn't use exceptions for control flow [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2025/03/05 06:39:32 UTC, 4 replies.
- [PR] [SPARK-51397] Fix maintenance pool shutdown handling issue causing long test times [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/03/05 07:51:53 UTC, 0 replies.
- Re: [PR] [SPARK-51397][SS] Fix maintenance pool shutdown handling issue causing long test times [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/03/05 07:55:48 UTC, 5 replies.
- Re: [PR] [SPARK-51340][ML][CONNECT] Model size estimation for linear classification & regression models [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/03/05 09:04:41 UTC, 11 replies.
- [PR] [SPARK-51401][SQL] Change `ExplainUtils.generateFieldString` to directly call `QueryPlan.generateFieldString` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/05 12:41:46 UTC, 2 replies.
- [PR] [SPARK-51400] Replace ArrayContains nodes to InSet [spark] - posted by "adrians (via GitHub)" <gi...@apache.org> on 2025/03/05 13:30:34 UTC, 16 replies.
- Re: [PR] [SPARK-47573][K8S] Support custom driver log url [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/05 18:16:29 UTC, 1 replies.
- [PR] [SPARK-51405][K8S] Upgrade `build-tools` to use Ubuntu 24.04 LTS instead of 22.04 LTS docker image [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/05 20:33:56 UTC, 3 replies.
- [PR] [SPARK-51406][K8S] Remove no-op `spark.log.structuredLogging.enabled=false` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/05 20:53:55 UTC, 3 replies.
- [PR] [SPARK-51407][CONNECT][DOCS] Document missed `spark.connect.*` configurations [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/05 21:32:14 UTC, 0 replies.
- [PR] [SPARK-51407][CONNECT][DOCS][3.5] Document missed `Spark Connect` con figurations [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/05 22:16:42 UTC, 1 replies.
- Re: [PR] [SPARK-51407][CONNECT][DOCS] Document missed `Spark Connect` configurations [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/05 22:21:29 UTC, 3 replies.
- [PR] [SPARK-51408][YARN][TESTS] AmIpFilterSuite#testProxyUpdate fails in some networks [spark] - posted by "cnauroth (via GitHub)" <gi...@apache.org> on 2025/03/05 22:42:40 UTC, 16 replies.
- Re: [PR] Log exception on Python runner termination [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/03/05 22:45:54 UTC, 1 replies.
- [PR] [SPARK-51387][BUILD][4.0] Upgrade Netty to 4.1.119.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/05 23:05:21 UTC, 3 replies.
- [PR] [SPARK-51407][DOCS][FOLLOWUP] Fix `spark.connect.ml.backend.classes` description [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/05 23:38:08 UTC, 2 replies.
- Re: [PR] [SPARK-50413][SQL] Add a flag to insert commands to know if they are part of CTAS [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/06 00:25:34 UTC, 1 replies.
- [PR] [SPARK-51410][K8S] Add `Spark Connect Plugin` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/06 00:43:52 UTC, 2 replies.
- [PR] [SPARK-51409] Add error classification in the changelog writer creation path [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/03/06 01:52:58 UTC, 0 replies.
- Re: [PR] [SPARK-51409][SS] Add error classification in the changelog writer creation path [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/03/06 01:53:49 UTC, 2 replies.
- Re: [PR] [SPARK-51407][CONNECT][DOCS][3.5] Document missed `Spark Connect` configurations [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/06 02:43:20 UTC, 2 replies.
- Re: [PR] [SPARK-51097] [SS] [4.0] Revert RocksDB instance metrics changes [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/03/06 02:46:13 UTC, 1 replies.
- [PR] [SPARK-51411] Add documentation for the transformWithState operator [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/03/06 02:55:47 UTC, 0 replies.
- [PR] [SPARK-51412][K8S] Upgrade Gradle to 8.13 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/06 02:57:56 UTC, 4 replies.
- [PR] [SPARK-51365][TESTS] Test maven + macos [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/06 04:27:53 UTC, 7 replies.
- Re: [PR] [SPARK-51384][SQL] Support `java.time.LocalTime` as the external type of `TimeType` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/06 05:16:50 UTC, 1 replies.
- [PR] [SPARK-51281][SQL][3.5] DataFrameWriterV2 should respect the path option [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/06 06:35:01 UTC, 3 replies.
- Re: [PR] [SPARK-50763][SQL] Add Analyzer rule for resolving SQL table functions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/06 07:41:26 UTC, 17 replies.
- Re: [PR] [SPARK-19335][SPARK-38200][SQL] Add upserts for writing to JDBC [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/06 07:53:20 UTC, 2 replies.
- [PR] [SPARK-51416][CONNECT][PYTHON] Remove SPARK_CONNECT_MODE when starting Spark Connect server [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/06 08:11:27 UTC, 0 replies.
- [PR] [SPARK-51417][CONNECT] Give a second to wait for Spark Connect server to fully start [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/06 08:28:01 UTC, 3 replies.
- [PR] [SPARK-51418][SQL] Fix DataSource PARTITON TABLE w/ Hive type incompatible partition columns [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/03/06 09:11:55 UTC, 3 replies.
- [PR] Sumit/spark 48311 [spark] - posted by "sumitsingh-in (via GitHub)" <gi...@apache.org> on 2025/03/06 10:01:11 UTC, 0 replies.
- Re: [PR] [SPARK-51379][ML] Move treeAggregate's final aggregation from driver to executor [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/06 11:15:17 UTC, 1 replies.
- [PR] [SPARK-51422][ML][PYTHON] Optimize CrossValidator eliminating the JVM-Python data exchange [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/06 11:25:53 UTC, 0 replies.
- [PR] [MINOR][DOCS] Remove u prefix for py str [spark] - posted by "imba-tjd (via GitHub)" <gi...@apache.org> on 2025/03/06 12:07:14 UTC, 0 replies.
- [PR] [MINOR][DOCS] IP -> HOST [spark] - posted by "imba-tjd (via GitHub)" <gi...@apache.org> on 2025/03/06 12:42:32 UTC, 0 replies.
- [PR] [SPARK-51338] Add automated CI build for `connect-examples` [spark] - posted by "vicennial (via GitHub)" <gi...@apache.org> on 2025/03/06 14:57:46 UTC, 3 replies.
- [PR] Update foreachbatch docs [spark] - posted by "fbertsch (via GitHub)" <gi...@apache.org> on 2025/03/06 15:01:52 UTC, 0 replies.
- [PR] [SPARK-51424][BUILD] Upgrade ORC to 2.1.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/06 15:17:54 UTC, 5 replies.
- Re: [PR] [SPARK-51069][SQL] Add big-endian support to UnsafeRowUtils.validateStructuralIntegrityWithReasonImpl [spark] - posted by "jonathan-albrecht-ibm (via GitHub)" <gi...@apache.org> on 2025/03/06 15:54:25 UTC, 0 replies.
- Re: [PR] [SPARK-51094][SQL][TESTS] Adjust some test parameters to work on s390x [spark] - posted by "jonathan-albrecht-ibm (via GitHub)" <gi...@apache.org> on 2025/03/06 15:55:20 UTC, 0 replies.
- [PR] [WIP][SQL] Add `TimeFormatter` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/06 16:24:15 UTC, 0 replies.
- Re: [PR] [SPARK-49008][PYTHON] Use `ParamSpec` to propagate `func` signature in `transform` [spark] - posted by "MaicoTimmerman (via GitHub)" <gi...@apache.org> on 2025/03/06 16:27:15 UTC, 0 replies.
- [PR] [SPARK-51425][Connect] Add client API to set custom `operation_id` [spark] - posted by "vicennial (via GitHub)" <gi...@apache.org> on 2025/03/06 16:29:58 UTC, 2 replies.
- [PR] [WIP][SPARK-51428][SQL] Reassign Aliases for collated expression trees deterministically [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/03/06 17:07:04 UTC, 2 replies.
- Re: [PR] [CORE][CONNECT] Add cogroup and cogroupSorted variants for additional KeyValueGroupedDatasets. [spark] - posted by "kyle-winkelman (via GitHub)" <gi...@apache.org> on 2025/03/06 17:28:06 UTC, 0 replies.
- [PR] [SPARK-51429][Connect] Add "Acknowledgement" message to ExecutePlanResponse [spark] - posted by "vicennial (via GitHub)" <gi...@apache.org> on 2025/03/06 19:19:22 UTC, 3 replies.
- Re: [PR] [SPARK-44639][SS][YARN] Use Java tmp dir for local RocksDB state storage on Yarn [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2025/03/06 19:47:34 UTC, 0 replies.
- Re: [PR] [SPARK-22876][YARN] Respect YARN AM failure validity interval [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2025/03/06 19:50:08 UTC, 0 replies.
- [PR] [SPARK-51402][SQL][TESTS] Test TimeType in UDF [spark] - posted by "calilisantos (via GitHub)" <gi...@apache.org> on 2025/03/06 19:51:30 UTC, 14 replies.
- [PR] [SPARK-51097] [SS] Re-introduce RocksDB state store's last uploaded snapshot version instance metrics [spark] - posted by "zecookiez (via GitHub)" <gi...@apache.org> on 2025/03/06 21:00:32 UTC, 0 replies.
- [PR] [MINOR][DOCS] Fix small grammatical nit [spark] - posted by "the-sakthi (via GitHub)" <gi...@apache.org> on 2025/03/06 21:06:59 UTC, 2 replies.
- Re: [PR] [SPARK-50892][SQL]Add UnionLoopExec, physical operator for recursion, to perform execution of recursive queries [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2025/03/06 21:57:29 UTC, 36 replies.
- [PR] [WIP][SPARK-51395][SQL] Refine handling of default values in procedures [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/03/06 22:55:03 UTC, 13 replies.
- Re: [PR] [SPARK-51416][CONNECT] Remove SPARK_CONNECT_MODE when starting Spark Connect server [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/06 23:08:30 UTC, 1 replies.
- Re: [PR] [SPARK-48922][SQL] Optimize nested data type insertion performance [spark] - posted by "kazuyukitanimura (via GitHub)" <gi...@apache.org> on 2025/03/06 23:27:50 UTC, 3 replies.
- Re: [PR] corrected link to mllib-guide.md [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/07 00:25:41 UTC, 1 replies.
- Re: [PR] [DRAFT][SQL] Old collation resolution PR [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/07 00:25:42 UTC, 1 replies.
- Re: [PR] [SPARK-45278][YARN] Support executor bind address in Yarn executors [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/07 00:25:44 UTC, 1 replies.
- [PR] [SPARK-51430][PYTHON] Stop PySpark context logger from propagating logs to stdout [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/03/07 01:05:16 UTC, 2 replies.
- Re: [PR] [SPARK-50511][PYTHON][FOLLOWUP] Avoid wrapping streaming Python data source error messages [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/03/07 01:09:13 UTC, 2 replies.
- [PR] [WIP][ML][CONNECT] ML transformed dataframe keep a reference to the model [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/07 01:13:07 UTC, 0 replies.
- Re: [PR] log executing jdbc query sql text [spark] - posted by "gabry-lab (via GitHub)" <gi...@apache.org> on 2025/03/07 02:29:54 UTC, 0 replies.
- [PR] Revert "[SPARK-51396][SQL] RuntimeConfig.getOption shouldn't use exceptions for control flow" [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2025/03/07 02:30:18 UTC, 3 replies.
- [PR] [SPARK-51432][SQL][PYTHON] Throw a proper exception when Arrow schemas are mismatched [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/07 03:20:31 UTC, 5 replies.
- [PR] log executing SQL text [spark] - posted by "gabry-lab (via GitHub)" <gi...@apache.org> on 2025/03/07 04:46:27 UTC, 0 replies.
- [PR] [SPARK-47849][PYTHON][CONNECT] Change release script to release pyspark-connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/07 06:16:57 UTC, 0 replies.
- Re: [PR] [SPARK-47849][PYTHON][CONNECT] Change release script to release pyspark-client [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/07 06:19:11 UTC, 1 replies.
- [PR] session extension doc fix [spark] - posted by "Aishwarya-Lakshmi-M (via GitHub)" <gi...@apache.org> on 2025/03/07 07:11:51 UTC, 0 replies.
- Re: [PR] [SPARK-51422][ML][PYTHON] Eliminate the JVM-Python data exchange in CrossValidator [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/07 08:11:20 UTC, 1 replies.
- [PR] fix: handle compare_vals turn into str when parse IgnoreColumnType [spark] - posted by "phakawatfong (via GitHub)" <gi...@apache.org> on 2025/03/07 08:33:33 UTC, 0 replies.
- [PR] [SPARK-51365][SQL][TESTS] Reduce `SHUFFLE_EXCHANGE_MAX_THREAD_THRESHOLD/RESULT_QUERY_STAGE_MAX_THREAD_THRESHOLD` for tests related to `SharedSparkSession/TestHive` when using `macOS + Apple Silicon` on GitHub Action [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/07 08:50:50 UTC, 7 replies.
- [PR] [MINOR][SPARK-SQL] Improve readability of JDBC truncate table conditi… [spark] - posted by "jinkachy (via GitHub)" <gi...@apache.org> on 2025/03/07 10:15:38 UTC, 0 replies.
- [PR] [MINOR][SQL] Slightly refactor and optimize illegaility check in Recursive CTE Subqueries [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/03/07 10:50:57 UTC, 4 replies.
- [PR] [WIP][SPARK-51436][SQL] Change the mayInterruptIfRunning from true to false [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/07 11:05:59 UTC, 0 replies.
- Re: [PR] [SPARK-51029][BUILD] Remove `hive-llap-common` compile dependency [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/03/07 12:12:28 UTC, 1 replies.
- [PR] [MINOR][SPARK-CORE] Remove redundant synchronized in ThreadUtils [spark] - posted by "jinkachy (via GitHub)" <gi...@apache.org> on 2025/03/07 12:40:37 UTC, 2 replies.
- [PR] [WIP][SPARK-51437][CORE] Let timeoutCheckingTask could response thread interrupt [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/07 13:22:57 UTC, 0 replies.
- Re: [PR] [SPARK-50992][SQL] OOMs and performance issues with AQE in large plans [spark] - posted by "JackBuggins (via GitHub)" <gi...@apache.org> on 2025/03/07 14:28:02 UTC, 3 replies.
- [PR] [SPARK-51438][SQL] Make CatalystDataToProtobuf and ProtobufDataToCatalyst properly comparable and hashable [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/03/07 15:16:52 UTC, 10 replies.
- [PR] [WIP][SPARK-51348][BUILD][SQL] Upgrade Hive to 4.0 [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/03/07 16:35:32 UTC, 8 replies.
- Re: [PR] [SPARK-48231][BUILD] Remove unused CodeHaus Jackson dependencies [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/03/07 17:03:24 UTC, 11 replies.
- Re: [PR] [SPARK-51288][DOCS] Add link for Scala API of Spark Connect [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/07 18:55:52 UTC, 2 replies.
- Re: [PR] [MINOR][CORE] Remove redundant synchronized in ThreadUtils [spark] - posted by "jinkachy (via GitHub)" <gi...@apache.org> on 2025/03/07 19:43:53 UTC, 2 replies.
- Re: [PR] [MINOR][SQL] Format the SqlBaseParser.g4 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/07 20:37:13 UTC, 1 replies.
- [PR] [SPARK-51440] classify the NPE when null topic field value is in kafka message data and there is no topic option [spark] - posted by "huanliwang-db (via GitHub)" <gi...@apache.org> on 2025/03/07 21:09:21 UTC, 0 replies.
- Re: [PR] [SPARK-51437][CORE] Let timeoutCheckingTask could response thread interrupt [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/08 01:23:22 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-51436][CORE][SQL][K8s][SS] Fix bug that cancel Future specified mayInterruptIfRunning with true [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/08 02:57:31 UTC, 7 replies.
- Re: [PR] [SPARK-51298][SQL] Support variant in CSV scan [spark] - posted by "sandip-db (via GitHub)" <gi...@apache.org> on 2025/03/08 03:27:53 UTC, 3 replies.
- Re: [PR] [MINOR][SQL] Improve readability of JDBC truncate table condition check [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/08 03:38:04 UTC, 1 replies.
- Re: [PR] [SPARK-45265][SQL] Support Hive 4.0 metastore [spark] - posted by "hidataplus (via GitHub)" <gi...@apache.org> on 2025/03/08 07:54:36 UTC, 1 replies.
- Re: [PR] [SPARK-51436][CORE][SQL][K8s][SS] Fix bug that cancel Future specified mayInterruptIfRunning with true [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/08 12:28:12 UTC, 7 replies.
- Re: [PR] [SPARK-51338][INFRA] Add automated CI build for `connect-examples` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/08 13:52:13 UTC, 14 replies.
- [PR] [SPARK-51359][CORE][SQL] Set INT64 as the default timestamp type for Parquet files [spark] - posted by "ganeshashree (via GitHub)" <gi...@apache.org> on 2025/03/08 14:12:58 UTC, 2 replies.
- [PR] Change host to ip [spark] - posted by "AryelSouza (via GitHub)" <gi...@apache.org> on 2025/03/08 18:51:06 UTC, 0 replies.
- [PR] [SPARK-51443] Fix singleVariantColumn in DSv2 and readStream. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2025/03/08 19:38:24 UTC, 1 replies.
- Re: [PR] Remove session string calls [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/09 00:23:02 UTC, 1 replies.
- [PR] [SPARK-51444][CORE] Remove unreachable code from `TaskSchedulerImpl#statusUpdate` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/09 05:55:59 UTC, 0 replies.
- [PR] [SPARK-51445][SQL][CONNECT] Change the never changed `var` to `val` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/09 08:58:20 UTC, 0 replies.
- [PR] [WIP][SQL] Add `stringToTime` and `stringToTimeAnsi` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/09 11:12:38 UTC, 0 replies.
- [PR] [WIP][SPARK-51446][SQL] Improve the codecNameMap for the compression codec [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/09 14:22:03 UTC, 0 replies.
- Re: [PR] [SPARK-51442][SQL] Add time formatters [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/09 16:48:52 UTC, 3 replies.
- Re: [PR] [SPARK-51447][SQL] Add `stringToTime` and `stringToTimeAnsi` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/09 17:10:15 UTC, 3 replies.
- Re: [PR] [SPARK-51444][CORE] Remove the unreachable `if` branch from `TaskSchedulerImpl#statusUpdate` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/09 21:49:42 UTC, 1 replies.
- Re: [PR] [SPARK-51365][SQL][TESTS] Add Envs to control the number of `SHUFFLE_EXCHANGE/RESULT_QUERY_STAGE` threads used in test cases related to `SharedSparkSession/TestHive` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/10 00:22:04 UTC, 5 replies.
- Re: [PR] [SPARK-50456][PYTHON] Move hash functions to a separate file [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/10 00:22:10 UTC, 1 replies.
- Re: [PR] Revert "From json/xml should not change collations in the given schema" [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/10 00:22:11 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-50361][SQL] Fix bugs of using Lateral Column Alias in ORDER BY [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/10 00:22:13 UTC, 1 replies.
- Re: [PR] [SPARK-51445][CORE][SQL][SS][CONNECT] Change the never changed `var` to `val` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/10 00:39:56 UTC, 6 replies.
- Re: [PR] [SPARK-51446][SQL] Improve the codecNameMap for the compression codec [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/10 04:52:45 UTC, 6 replies.
- [PR] [SPARK-51449][BUILD] Restore hive-llap-common to compile scope [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/03/10 05:06:51 UTC, 5 replies.
- [PR] [SPARK-51450][CORE] BarrierCoordinator thread not exiting in Spark standalone mode [spark] - posted by "jjayadeep06 (via GitHub)" <gi...@apache.org> on 2025/03/10 05:34:13 UTC, 10 replies.
- Re: [PR] [SPARK-51445][SQL][SS][CONNECT] Change the never changed `var` to `val` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/10 07:08:41 UTC, 1 replies.
- [PR] [WIP][SQL] Support cast from time to string [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/10 09:27:19 UTC, 0 replies.
- [PR] [SPARK-51452][UI] Improve Thread dump table search [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/03/10 10:04:57 UTC, 4 replies.
- [PR] [SPARK-51453] [SQL] AssertTrue uses toPrettySQL instead of simpleString [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/03/10 10:16:09 UTC, 9 replies.
- Re: [PR] [SPARK-51269][SQL] SQLConf should manage the default value for avro compression level [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/03/10 10:19:05 UTC, 1 replies.
- Re: [PR] [SPARK-51269][SQL] Simplify AvroCompressionCodec by removing defaultCompressionLevel [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/03/10 10:45:18 UTC, 2 replies.
- [PR] [Minor][SQL][Tests] Remove duplicated plan node check in DataFrameSetOperationsSuite [spark] - posted by "Surbhi-Vijay (via GitHub)" <gi...@apache.org> on 2025/03/10 12:00:02 UTC, 6 replies.
- [PR] Bump golang.org/x/oauth2 from 0.25.0 to 0.28.0 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/03/10 13:28:21 UTC, 3 replies.
- [PR] Bump google.golang.org/grpc from 1.70.0 to 1.71.0 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/03/10 13:28:26 UTC, 2 replies.
- Re: [PR] [SPARK-51454][SQL] Support cast from time to string [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/10 17:44:15 UTC, 2 replies.
- [PR] [WIP][SQL] Support typed literals of the TIME data type [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/10 20:22:02 UTC, 0 replies.
- [PR] [SPARK-51457][R][INFRA] Use R 4.4.3 in `windows` R GitHub Action Windows job [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/10 20:54:53 UTC, 0 replies.
- [PR] Compute checksum for shuffle [spark] - posted by "JiexingLi (via GitHub)" <gi...@apache.org> on 2025/03/10 21:13:06 UTC, 0 replies.
- [PR] [SPARK-51318][TESTS] Remove `jar` files from Apache Spark repository and disable affected tests [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/03/10 21:17:59 UTC, 25 replies.
- Re: [PR] [SPARK-51457][R][INFRA] Use R 4.4.3 in `windows` R GitHub Action job [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/10 22:58:49 UTC, 2 replies.
- Re: [PR] [SPARK-51458] Add GitHub Action job to check ASF license [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/11 00:21:41 UTC, 1 replies.
- [PR] [SPARK-51459] Add `merge_spark_pr.py` and `PULL_REQUEST_TEMPLATE` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/11 00:45:23 UTC, 3 replies.
- [PR] [SPARK-51461] Setup `SparkConnect` Swift package structure and CI to test `build` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/11 02:30:15 UTC, 24 replies.
- [PR] [WIP] Eliminate Hive built-in UDFs initialization on Hive UDF evaluation [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/03/11 03:44:02 UTC, 0 replies.
- Re: [PR] [SPARK-50820][SQL] DSv2: Conditional nullification of metadata columns in DML [spark] - posted by "huaxingao (via GitHub)" <gi...@apache.org> on 2025/03/11 04:06:57 UTC, 0 replies.
- [PR] [SPARK-51463] Add `Spark Connect`-generated `Swift` source code [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/11 04:55:45 UTC, 5 replies.
- [PR] [SPARK-51465] Use `Apache Arrow Swift` 19.0.1 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/11 05:58:58 UTC, 11 replies.
- Re: [PR] [SPARK-51462][SQL] Support typed literals of the TIME data type [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/11 06:59:32 UTC, 3 replies.
- Re: [PR] [SPARK-51440][SS] classify the NPE when null topic field value is in kafka message data and there is no topic option [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/03/11 07:00:51 UTC, 1 replies.
- Re: [PR] [SPARK-51466][SQL][HIVE] Eliminate Hive built-in UDFs initialization on Hive UDF evaluation [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/03/11 08:33:53 UTC, 16 replies.
- [PR] [SPARK-51467][UI] Make tables of the environment page filterable [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/03/11 08:40:43 UTC, 10 replies.
- [PR] [SPARK-51468][SQL] Revert "From json/xml should not change collations in the given schema" [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2025/03/11 08:57:07 UTC, 3 replies.
- Re: [PR] [MINOR][SQL][TESTS] Remove duplicated plan node check in DataFrameSetOperationsSuite [spark] - posted by "Surbhi-Vijay (via GitHub)" <gi...@apache.org> on 2025/03/11 12:38:09 UTC, 2 replies.
- [PR] [SPARK-51469][SQL] Improve MapKeyDedupPolicy so that avoid calling toString [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/11 12:51:54 UTC, 3 replies.
- Re: [PR] [SPARK-43131][SQL][WIP] Add labels to identify UDFs [spark] - posted by "tgravescs (via GitHub)" <gi...@apache.org> on 2025/03/11 14:04:15 UTC, 0 replies.
- Re: [PR] [SPARK-50759][SQL] Deprecate a few legacy Catalog APIs [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/11 16:20:03 UTC, 5 replies.
- Re: [PR] Initial Implementation [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/11 17:01:39 UTC, 2 replies.
- Re: [PR] [SPARK-51097][SS] Re-introduce RocksDB state store's last uploaded snapshot version instance metrics [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/03/11 17:45:56 UTC, 12 replies.
- [PR] [WIP][SQL] Support cast from string to time [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/11 17:48:02 UTC, 0 replies.
- [PR] [MINOR][BUILD]: Fix merge_spark_pr script for no jira case [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/03/11 18:01:35 UTC, 3 replies.
- [PR] [SPARK-51471][SS] classify the ASSERT error when offset/timestamp in startOffset is larger than the endOffset. [spark] - posted by "huanliwang-db (via GitHub)" <gi...@apache.org> on 2025/03/11 18:08:45 UTC, 0 replies.
- [PR] [SPARK-51472] Add gRPC `Client` actor [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/11 18:30:40 UTC, 0 replies.
- [PR] [SPARK-XXXXX][SQL] Don't insert redundant ColumnarToRowExec [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/03/11 20:15:59 UTC, 1 replies.
- [PR] Delay `Join.metadataOutput` computation until `Join` is resolved [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/03/11 20:58:06 UTC, 0 replies.
- Re: [PR] [SPARK-50464] Support unsigned integer for Arrow [spark] - posted by "miscenko (via GitHub)" <gi...@apache.org> on 2025/03/11 21:47:38 UTC, 2 replies.
- [PR] [MINOR][PYTHON] Reformat error classes [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/11 22:16:25 UTC, 4 replies.
- Re: [PR] [SPARK-51250][K8S] Add Support for K8s PriorityClass Configuration fo… [spark] - posted by "zemin-piao (via GitHub)" <gi...@apache.org> on 2025/03/11 22:25:06 UTC, 0 replies.
- [PR] [SPARK-51476][PYTHON][DOCS] Update document type conversion for Pandas UDFs (pyarrow 17.0.0, pandas 2.2.3, Python 3.11) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/11 22:30:21 UTC, 3 replies.
- [PR] Update supported_api_gen.py: remove an invalid escape sequence "\_" using a raw string [spark] - posted by "wyattscarpenter (via GitHub)" <gi...@apache.org> on 2025/03/11 23:03:45 UTC, 1 replies.
- [PR] [WIP][ML] Validate SQLTransformer statement by parsed plan [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/11 23:35:41 UTC, 0 replies.
- [PR] [SPARK-51477] Enable autolink to SPARK jira issue [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/11 23:39:43 UTC, 3 replies.
- Re: [PR] [WIP][SPARK-XXXX][Collation] Prevent Regex with collated strings [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/12 00:25:25 UTC, 1 replies.
- Re: [PR] [SPARK-51478][ML] Validate SQLTransformer statement by parsed plan [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/03/12 00:35:04 UTC, 0 replies.
- Re: [PR] [SPARK-51473][ML][CONNECT] ML transformed dataframe keep a reference to the model [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/03/12 00:40:55 UTC, 10 replies.
- Re: [PR] [SPARK-51472] Add gRPC `SparkConnectClient` actor [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/12 01:25:03 UTC, 13 replies.
- Re: [PR] [SPARK-51380][SQL] Add visitSQLFunction and visitAggregateFunction to improve the flexibility of V2ExpressionSQLBuilder [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/12 02:58:41 UTC, 3 replies.
- Re: [PR] [SPARK-51179][SQL] Refactor SupportsOrderingWithinGroup so that centralized check [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/12 03:03:53 UTC, 2 replies.
- [PR] [SPARK-51481] Add `RuntimeConf` actor [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/12 03:52:43 UTC, 9 replies.
- [PR] [SPARK-48922][SQL] Avoid redundant array transform of identical expression for map type [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2025/03/12 03:53:14 UTC, 11 replies.
- [PR] [SPARK-51483] Add `SparkSession` and `DataFrame` actors [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/12 06:11:16 UTC, 13 replies.
- [PR] [SPARK-51479][SQL] Nullable in Row Level Operation Column is not correct [spark] - posted by "huaxingao (via GitHub)" <gi...@apache.org> on 2025/03/12 06:43:24 UTC, 7 replies.
- Re: [PR] [SPARK-50188][CONNECT][PYTHON] When the connect client starts, print the server's webUrl [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2025/03/12 06:44:10 UTC, 0 replies.
- Re: [PR] [SPARK-49485][CORE] Fix speculative task hang bug due to remaining executor lay on same host [spark] - posted by "buska88 (via GitHub)" <gi...@apache.org> on 2025/03/12 08:45:46 UTC, 0 replies.
- [PR] [MINOR][DOC] Improve the documentation for configuration [spark] - posted by "0xbadidea (via GitHub)" <gi...@apache.org> on 2025/03/12 09:33:04 UTC, 0 replies.
- Re: [PR] [MINOR][DOC] Improve the documentation for configuration. [spark] - posted by "0xbadidea (via GitHub)" <gi...@apache.org> on 2025/03/12 09:50:52 UTC, 0 replies.
- [PR] [SPARK-51398][SQL] SparkSQL supports sorting in the shuffle phase. [spark] - posted by "zhengchenyu (via GitHub)" <gi...@apache.org> on 2025/03/12 10:23:56 UTC, 0 replies.
- Re: [PR] [SPARK-51482][SQL] Support cast from string to time [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/12 10:32:56 UTC, 4 replies.
- [PR] [SPARK-51484][SS] Remove unused function `private def newDFSFileName(String)` from `RocksDBFileManager` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/12 11:21:43 UTC, 3 replies.
- [PR] [WIP][SQL] Support the TIME keyword as a data type [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/12 11:58:19 UTC, 0 replies.
- Re: [PR] [SPARK-50005][SQL] Enhance method verifyNotReadPath to identify subqueries hidden in the filter conditions. [spark] - posted by "xunxunmimi5577 (via GitHub)" <gi...@apache.org> on 2025/03/12 12:19:04 UTC, 0 replies.
- Re: [PR] [SPARK-51474][SQL] Don't insert redundant ColumnarToRowExec for node supporting both columnar and row output [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/03/12 13:51:36 UTC, 1 replies.
- [PR] [MINOR][SQL] Reuse `dateTimeUtilsCls` in `Cast` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/12 14:37:57 UTC, 3 replies.
- [PR] [SPARK-51271][PYTHON] Filter serialization for Python Data Source filter pushdown [spark] - posted by "wengh (via GitHub)" <gi...@apache.org> on 2025/03/12 15:33:07 UTC, 0 replies.
- [PR] [SPARK-51485] Add `How to use in your apps` section to `README.md` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/12 15:36:24 UTC, 2 replies.
- [PR] [SPARK-51441][SQL] Add DSv2 APIs for constraints [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/03/12 15:37:33 UTC, 57 replies.
- [PR] [MINOR][PYTHON] Generate with a newline at the end of error-conditions.json [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/12 15:44:21 UTC, 3 replies.
- [PR] [SPARK-51487][PYTHON][INFRA] Refresh testing images for pyarrow 19 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/12 16:42:35 UTC, 15 replies.
- [PR] [MINOR] Add compatibility badges [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/12 16:47:46 UTC, 2 replies.
- Re: [PR] [WIP] [SPARK-51097] [SS] Split apart SparkPlan metrics and instance metrics [spark] - posted by "zecookiez (via GitHub)" <gi...@apache.org> on 2025/03/12 17:54:01 UTC, 0 replies.
- [PR] [SPARK-51489][SQL] Represent SQL Script in Spark UI [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2025/03/12 17:56:28 UTC, 1 replies.
- [PR] [SPARK-51490] Support iOS, watchOS, and tvOS [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/12 18:12:39 UTC, 0 replies.
- Re: [PR] [SPARK-51490] Support `iOS`, `watchOS`, and `tvOS` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/12 18:21:43 UTC, 2 replies.
- Re: [PR] [SPARK-51488][SQL] Support the TIME keyword as a data type [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/12 18:38:29 UTC, 2 replies.
- [PR] [SPARK-51493] Refine `merge_spark_pr.py` to use `connect-swift-x.y.z`… [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/12 19:25:52 UTC, 0 replies.
- [PR] [SPARK-51492][SS]FileStreamSource: Avoid expensive file concatenation if not needed [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2025/03/12 19:27:17 UTC, 0 replies.
- Re: [PR] [SPARK-51493] Refine `merge_spark_pr.py` to use `connect-swift-x.y.z` version [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/12 19:30:10 UTC, 7 replies.
- [PR] [SPARK-51491][PYTHON] Simplify boxplot with subquery APIs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/12 19:39:27 UTC, 2 replies.
- [PR] [SPARK-43221][CORE][4.0] Host local block fetching should use a block status of a block stored on disk [spark] - posted by "attilapiros (via GitHub)" <gi...@apache.org> on 2025/03/12 21:05:40 UTC, 1 replies.
- [PR] [SPARK-43221][CORE][3.5] Host local block fetching should use a block status of a block stored on disk [spark] - posted by "attilapiros (via GitHub)" <gi...@apache.org> on 2025/03/12 21:08:06 UTC, 3 replies.
- [PR] [SPARK-51494][BUILD] Upgrade to Apache parent pom 33 [spark] - posted by "cnauroth (via GitHub)" <gi...@apache.org> on 2025/03/12 21:13:44 UTC, 2 replies.
- [PR] Run test [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/12 21:31:37 UTC, 0 replies.
- Re: [PR] [SPARK-31561][SQL] Add QUALIFY clause [spark] - posted by "ebonnal (via GitHub)" <gi...@apache.org> on 2025/03/12 22:41:19 UTC, 0 replies.
- [PR] [TEST-ONLY][4.0] Test pyarrow 4.0 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/12 23:45:09 UTC, 0 replies.
- Re: [PR] [SPARK-51495] Add `Integration Test` GitHub Action job [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/13 00:19:48 UTC, 2 replies.
- Re: [PR] [SPARK-51495] Add `Integration Test` GitHub Action job with `4.0.0-preview2` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/13 00:22:23 UTC, 7 replies.
- Re: [PR] [WIP][SPARK-xxxx][Collation] Guard collation regex expressions behind a flag [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/13 00:25:58 UTC, 1 replies.
- Re: [PR] [SPARK-XXXX][Avro] Fix avro deserialization breaking for UnionType[null, Record] [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/13 00:25:59 UTC, 1 replies.
- Re: [PR] [SPARK-50424][INFRA] Extract the common content of `Dockerfile` from `Docs`, `Linter`, and `SparkR` test images [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/13 00:26:00 UTC, 1 replies.
- Re: [PR] [SPARK-47672][SQL] Avoid double eval from filter pushDown [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/13 00:26:02 UTC, 1 replies.
- [PR] Spark 51272 51016 combined [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2025/03/13 01:33:25 UTC, 0 replies.
- [PR] Bump golang.org/x/net from 0.34.0 to 0.36.0 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/03/13 01:54:23 UTC, 5 replies.
- [PR] [SPARK-51466][SQL][HIVE][4.0] Eliminate Hive built-in UDFs initialization on Hive UDF evaluation [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/03/13 02:17:37 UTC, 2 replies.
- [PR] [SPARK-48922][SQL][3.5] Avoid redundant array transform of identical expression for map type [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2025/03/13 03:17:03 UTC, 3 replies.
- Re: [PR] [SPARK-47484][SQL] Allow trailing comma in column definition list [spark] - posted by "Nicolas-Parot-Alvarez-Paidy (via GitHub)" <gi...@apache.org> on 2025/03/13 03:42:23 UTC, 1 replies.
- Re: [PR] [SPARK-51492][SS]FileStreamSource: Avoid expensive string concatenation if not needed [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2025/03/13 03:58:44 UTC, 1 replies.
- [PR] [WIP][SQL] Add the default time formatter [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/13 08:12:15 UTC, 0 replies.
- Re: [PR] [SPARK-51443][SS] Fix singleVariantColumn in DSv2 and readStream. [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/13 13:33:15 UTC, 1 replies.
- Re: [PR] [SPARK-37019][SQL] Add codegen support to array higher-order functions [spark] - posted by "chris-twiner (via GitHub)" <gi...@apache.org> on 2025/03/13 16:42:06 UTC, 5 replies.
- [PR] [SPARK-51501][SQL] Disable ObjectHashAggregate for group by on collated columns [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2025/03/13 16:46:41 UTC, 3 replies.
- [PR] [SPARK-51502][SQL] Move collations test to collations package [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2025/03/13 16:56:07 UTC, 1 replies.
- [PR] [SPARK-51414][SQL] Add the make_time() function [spark] - posted by "robreeves (via GitHub)" <gi...@apache.org> on 2025/03/13 17:03:05 UTC, 17 replies.
- [PR] [SPARK-51504] Support `DataFrame.select` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/13 17:45:45 UTC, 0 replies.
- [PR] [SPARK-51270] Support nanosecond precision timestamp in Variant [spark] - posted by "cashmand (via GitHub)" <gi...@apache.org> on 2025/03/13 18:19:48 UTC, 10 replies.
- [PR] [SPARK-51191][SQL] Validate default values handling in DELETE, UPDATE, MERGE [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/03/13 18:38:18 UTC, 14 replies.
- Re: [PR] [SPARK-23890][SQL] Support DDL for adding nested columns to struct types [spark] - posted by "ottomata (via GitHub)" <gi...@apache.org> on 2025/03/13 19:01:01 UTC, 0 replies.
- Re: [PR] [SPARK-51504] Support `select/limit/sort/orderBy/isEmpty` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/13 21:57:24 UTC, 12 replies.
- [PR] [SPARK-51506][PYTHON][SS] Do not enforce users to implement close() in TransformWithStateInPandas [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2025/03/13 22:27:02 UTC, 6 replies.
- Re: [PR] [SPARK-51497][SQL] Add the default time formatter [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/13 23:13:51 UTC, 1 replies.
- [PR] [SPARK-51505][SQL] Log empty partition number metrics in AQE coalesce [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2025/03/14 00:22:11 UTC, 11 replies.
- Re: [PR] [SPARK-50404][PYTHON] PySpark DataFrame Pipe Method [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/14 00:25:33 UTC, 1 replies.
- [PR] [SPARK-51507] Support creating config map that can be mounted by Spark pods for apps [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/03/14 01:38:21 UTC, 2 replies.
- Re: [PR] [SPARK-50806][SQL] Support InputRDDCodegen interruption on task cancellation [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2025/03/14 01:40:06 UTC, 3 replies.
- [PR] [SPARK-51508] Support `collect(): [[String]]` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/14 02:04:30 UTC, 5 replies.
- Re: [PR] [SPARK-51508] Support `collect(): [[String?]]` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/14 03:20:53 UTC, 5 replies.
- [PR] [SPARK-51509][CORE][UI] Make `Spark Master` Environment page support filters [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/14 04:20:30 UTC, 4 replies.
- [PR] [SPARK-51510] Add SQL-file based `SQLTests` suite [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/14 05:32:36 UTC, 4 replies.
- [PR] [SPARK-51496][SQL] CaseInsensitiveStringMap comparison should ignore case [spark] - posted by "huaxingao (via GitHub)" <gi...@apache.org> on 2025/03/14 05:46:40 UTC, 11 replies.
- [PR] [SPARK-51511][INFRA] Upgrade `apache-rat` in the `dev/check-license to` 0.16.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/14 07:22:03 UTC, 2 replies.
- [PR] [SPARK-51512][CORE][MINOR] Filter out null MapStatus when cleaning up shuffle data with ExternalShuffleService [spark] - posted by "wankunde (via GitHub)" <gi...@apache.org> on 2025/03/14 08:15:47 UTC, 2 replies.
- [PR] [SPARK-51340][ML][CONNECT] Model size estimation [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/03/14 09:47:23 UTC, 8 replies.
- [PR] [MINOR][SQL] Improve the code for OracleDialect [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/14 10:25:25 UTC, 5 replies.
- Re: [PR] [SPARK-51512][CORE] Filter out null MapStatus when cleaning up shuffle data with ExternalShuffleService [spark] - posted by "wankunde (via GitHub)" <gi...@apache.org> on 2025/03/14 11:20:52 UTC, 2 replies.
- [PR] [MINOR][DOCS] Add Profile -Pdocker-integration-tests to sbt docker IT tests [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/03/14 11:37:48 UTC, 1 replies.
- Re: [PR] [SPARK-51428][SQL] Reassign Aliases for collated expression trees deterministically [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/03/14 11:46:08 UTC, 11 replies.
- [PR] [SPARK-51513][SQL] Fix RewriteMergeIntoTable rule produces unresolved plan [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2025/03/14 13:25:09 UTC, 6 replies.
- [PR] [WIP][SQL] Support the TIME data type in Hive results [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/14 14:23:00 UTC, 0 replies.
- [PR] [WIP][SPARK-51421] refactor fromJavaDate/toJavaDate [spark] - posted by "donan92 (via GitHub)" <gi...@apache.org> on 2025/03/14 15:11:59 UTC, 0 replies.
- Re: [PR] [SPARK-51502][SQL][TESTS] Move collations test to collations package [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/14 16:02:45 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-51515] refactor fromJavaDate/toJavaDate [spark] - posted by "donan92 (via GitHub)" <gi...@apache.org> on 2025/03/14 16:45:54 UTC, 2 replies.
- [PR] [SPARK-51518][SQL] Support | as an alternative to |> for the SQL pipe operator token [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2025/03/14 21:04:48 UTC, 8 replies.
- [PR] [SPARK-50983][SQL]Part 1.a Add unresolved outer attributes for SubqueryExpression [spark] - posted by "AveryQi115 (via GitHub)" <gi...@apache.org> on 2025/03/15 00:30:55 UTC, 1 replies.
- [PR] [SPARK-51451][SQL] Fix ExtractGenerator to wait for UnresolvedStarWithColumns to be resolved [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/03/15 00:57:18 UTC, 6 replies.
- [PR] Use JRE to reduce size of Docker image [spark-kubernetes-operator] - posted by "jacobsalway (via GitHub)" <gi...@apache.org> on 2025/03/15 10:05:51 UTC, 0 replies.
- Re: [PR] [SPARK-51517][SQL] Support the TIME data type in Hive results [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/15 18:14:12 UTC, 0 replies.
- [PR] [WIP][SQL] Add the `to_time` function [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/15 20:14:08 UTC, 0 replies.
- [PR] [SPARK-51521] Add `integral/floating/string/date` type test and answer files [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/15 22:11:10 UTC, 4 replies.
- Re: [PR] [WIP] Fix problem in NestedColumnAliasing.scala , replaceWithAliases in connection with Generate plan node [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/16 00:28:18 UTC, 1 replies.
- Re: [PR] [SPARK-50416][CORE] A more portable terminal / pipe test needed for bin/load-spark-env.sh [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/16 00:28:19 UTC, 9 replies.
- Re: [PR] [SPARK-49828][SQL] Expose ColumnNode to/from Expression utils as developer APIs [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/16 00:28:20 UTC, 1 replies.
- [PR] [MINOR][SQL] Re-generate `sql-expression-schema.md` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/16 06:42:21 UTC, 2 replies.
- Re: [PR] [SPARK-51280][CONNECT] Improve RESPONSE_ALREADY_RECEIVED error class [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/16 07:48:20 UTC, 1 replies.
- Re: [PR] Bump google.golang.org/protobuf from 1.36.4 to 1.36.5 [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2025/03/16 15:48:28 UTC, 1 replies.
- [PR] Updating to Spark 3.5.5 [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2025/03/16 16:02:27 UTC, 1 replies.
- [PR] Disable lazy union children test in single-pass Analyzer [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/03/16 19:40:24 UTC, 0 replies.
- Re: [PR] [SPARK-51520][K8S] Use JRE to reduce size of Docker image [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/16 22:01:48 UTC, 5 replies.
- [PR] [SPARK-51524] Fix Package Author information to `Apache Spark project` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/17 00:12:37 UTC, 3 replies.
- Re: [PR] [SPARK-50508][SQL]Add more detailed prompt information when broadcasting fails [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/17 00:27:11 UTC, 1 replies.
- Re: [PR] [SPARK-50502][SQL] Support pushing DeserializeToObject through union [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/17 00:27:12 UTC, 1 replies.
- Re: [PR] Adding typing for creating a pyspark dataframe from a list of dicts [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/17 00:27:13 UTC, 1 replies.
- Re: [PR] [TEST-ONLY][4.0] Test pyarrow 19 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/17 00:29:27 UTC, 0 replies.
- [PR] Collation field for Desc As JSON StringType [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/03/17 01:49:52 UTC, 0 replies.
- Re: [PR] [SPARK-51525][SQL] Collation field for Desc As JSON StringType [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/17 02:15:04 UTC, 7 replies.
- [PR] Revert "[SPARK-51172][SS] Rename to spark.sql.optimizer.pruneFiltersCanPruneStreamingSubplan" [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/17 02:28:37 UTC, 7 replies.
- [PR] [SPARK-51112][PYTHON][CONNECT][FOLLOW-UP] Explicitly set index=range(0) for empty table [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/17 02:34:56 UTC, 2 replies.
- Re: [PR] [SPARK-50994][CORE] Perform RDD conversion under tracked execution [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/17 03:40:23 UTC, 6 replies.
- Re: [PR] [SPARK-51172][SS] Rename to spark.sql.optimizer.pruneFiltersCanPruneStreamingSubplan [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/03/17 03:54:12 UTC, 1 replies.
- [PR] Test maven test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/17 05:34:05 UTC, 0 replies.
- [PR] [SPARK-45923] Upgrade Gradle shadow plugin to 8.3.6 [spark-kubernetes-operator] - posted by "jacobsalway (via GitHub)" <gi...@apache.org> on 2025/03/17 06:22:18 UTC, 0 replies.
- [PR] [SPARK-51527][SQL] Make codegen log level configurable via SQLConf [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/03/17 06:54:19 UTC, 9 replies.
- [PR] [SPARK-51528][SQL] Don't compare hash codes directly in ProtobufCatalystDataConversionSuite [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/03/17 08:32:34 UTC, 6 replies.
- Re: [PR] [SPARK-51526] Upgrade Gradle shadow plugin to 8.3.6 [spark-kubernetes-operator] - posted by "jacobsalway (via GitHub)" <gi...@apache.org> on 2025/03/17 08:49:27 UTC, 1 replies.
- Re: [PR] [SPARK-51456][SQL] Add the `to_time` function [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/03/17 09:47:33 UTC, 6 replies.
- Re: [PR] [SPARK-51187][SQL][SS][4.0] Implement the graceful deprecation of incorrect config introduced in SPARK-49699 [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2025/03/17 11:24:54 UTC, 6 replies.
- [PR] [SPARK-51420][SQL] Get minutes of TIME datatype [spark] - posted by "the-sakthi (via GitHub)" <gi...@apache.org> on 2025/03/17 11:37:56 UTC, 32 replies.
- Re: [PR] [SPARK-51532][INFRA] Restore the installation of Python 3.11 in macOS daily test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/17 12:23:38 UTC, 3 replies.
- Re: [PR] [SPARK-51522][SQL] Disable lazy union children test for single-pass Analyzer [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/17 13:40:53 UTC, 1 replies.
- [PR] Bump github.com/apache/arrow-go/v18 from 18.1.0 to 18.2.0 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/03/17 14:24:20 UTC, 2 replies.
- [PR] [SPARK-51534][Core] Improve parquet read performance by reducing unnecessary operations when converting parquet to row [spark] - posted by "TheR1sing3un (via GitHub)" <gi...@apache.org> on 2025/03/17 14:30:44 UTC, 3 replies.
- [PR] [SPARK-51535][SQL] Don't compare hash codes directly in ProtobufCatalystDataConversionSuite [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/03/17 14:36:35 UTC, 3 replies.
- Re: [PR] [SPARK-45110][BUILD] Upgrade rocksdbjni to 8.8.1 [spark] - posted by "ajanoni (via GitHub)" <gi...@apache.org> on 2025/03/17 15:57:32 UTC, 0 replies.
- [PR] [WIP][SQL] Support the `TIME` data type in `Literal` methods [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/17 17:18:30 UTC, 0 replies.
- [PR] [SPARK-51503] Support Variant type in XML scan [spark] - posted by "xiaonanyang-db (via GitHub)" <gi...@apache.org> on 2025/03/17 22:49:19 UTC, 0 replies.
- [PR] [SPARK-XXXXX][SQL] Add maxRecordsPerOutputBatch to limit the number of record of Arrow output batch [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/03/18 00:57:17 UTC, 8 replies.
- Re: [PR] [SPARK-51332][SQL] DS V2 supports push down BIT_AND, BIT_OR, BIT_XOR, BIT_COUNT and BIT_GET [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/18 02:14:10 UTC, 5 replies.
- [PR] [SPARK-51538] Add `spark-connect-server-with-spark-cluster.yaml` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/18 04:07:07 UTC, 2 replies.
- [PR] [SPARK-51539] Refactor `SparkConnectClient` to use `analyze` helper function [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/18 05:20:29 UTC, 2 replies.
- [PR] [SPARK-51540][PS][DOCS] Best practice for distributed-sequence misalignment case [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2025/03/18 06:08:13 UTC, 2 replies.
- Re: [PR] [SPARK-51541][SQL] Support the `TIME` data type in `Literal` methods [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/18 08:06:10 UTC, 1 replies.
- [PR] [BUILD] Upgrade jersey to 3.0.17 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/18 09:48:09 UTC, 1 replies.
- [PR] [WIP] Fix add metadata columns [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/03/18 09:48:30 UTC, 0 replies.
- [PR] [SPARK-51542][UI] Add a scroll-button for addressing top and bottom [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/03/18 11:50:16 UTC, 8 replies.
- [PR] [SPARK-51536][ML][PYTHON][CONNECT] Add missing whitelist for feature transformers / models [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/03/18 13:55:35 UTC, 2 replies.
- [PR] [WIP][SQL] Assign name to the error condition: _LEGACY_ERROR_TEMP_2130 [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/18 14:24:10 UTC, 0 replies.
- [PR] [SPARK-50838][SQL] Add Cross Join as legal in recursion of Recursive CTE [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/03/18 14:24:32 UTC, 0 replies.
- [PR] [SPARK-51546] Fix npm vulnerabilities by `npm audit fix` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/18 15:23:33 UTC, 1 replies.
- [PR] [SPARK-47241][SQL][FOLLOWUP] Fix issue when laterally referencing a `Generator` [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/03/18 15:48:07 UTC, 4 replies.
- Re: [PR] [SPARK-51547][SQL] Assign name to the error condition: _LEGACY_ERROR_TEMP_2130 [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/03/18 16:46:53 UTC, 2 replies.
- [PR] Revert #48786 - "Revert "[SPARK-48273][SQL] Fix late rewrite of PlanWithUnresolvedIdentifier"" [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2025/03/18 17:27:11 UTC, 4 replies.
- [PR] [MINIOR][PYTHON] Specifying udf type in SCHEMA_MISMATCH_FOR_PANDAS_UDF error message [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2025/03/18 19:44:50 UTC, 4 replies.
- Re: [PR] Add Sample functionality in DataFrame. [spark-connect-go] - posted by "imvtsl (via GitHub)" <gi...@apache.org> on 2025/03/18 23:45:40 UTC, 2 replies.
- [PR] [WIP] Python UDF traceback improvement [spark] - posted by "wengh (via GitHub)" <gi...@apache.org> on 2025/03/18 23:50:41 UTC, 0 replies.
- Re: [PR] [SPARK-51261][ML][PYTHON][CONNECT] Introduce model size estimation to control ml cache [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/19 00:05:22 UTC, 0 replies.
- [PR] [SPARK-51187][SQL][SS] Introduce the migration logic of config removal from SPARK-49699 [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/03/19 01:43:14 UTC, 1 replies.
- [PR] Initial commit [spark] - posted by "aldenlau-db (via GitHub)" <gi...@apache.org> on 2025/03/19 01:44:01 UTC, 0 replies.
- Re: [PR] [SPARK-49082][SQL] Support widening Date to TimestampNTZ in Avro reader [spark] - posted by "aldenlau-db (via GitHub)" <gi...@apache.org> on 2025/03/19 01:51:45 UTC, 11 replies.
- [PR] [MINOR][TESTS] Ignore messages below error level from `HadoopFSUtils` for sql module tests [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/19 02:42:21 UTC, 0 replies.
- Re: [PR] [SPARK-51546][TESTS] Fix npm vulnerabilities by `npm audit fix` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/19 03:05:09 UTC, 1 replies.
- [PR] Bump net.snowflake:snowflake-jdbc from 3.22.0 to 3.23.1 [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/03/19 03:06:13 UTC, 2 replies.
- Re: [PR] [SPARK-51543][BUILD] Upgrade jersey to 3.0.17 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/19 03:06:37 UTC, 1 replies.
- [PR] [SPARK-51548][SQL] Provides configuration to decide whether to copy objects before shuffle. [spark] - posted by "zhengchenyu (via GitHub)" <gi...@apache.org> on 2025/03/19 03:49:59 UTC, 0 replies.
- [PR] [SPARK-51549][BUILD] Bump Parquet 1.15.1 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/03/19 05:48:27 UTC, 7 replies.
- [PR] Test auto set OBJC_DISABLE_INITIALIZE_FORK_SAFETY for macos [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/19 06:10:13 UTC, 0 replies.
- [PR] [SPARK-51282][SPARK-51422][ML][FOLLOW-UP] Replace UDF with builtin functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/19 06:49:50 UTC, 2 replies.
- [PR] [SPARK-51550][PYTHON][INFRA] Upgrade pyarrow to 19 for PySpark on macOS [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/19 07:00:58 UTC, 2 replies.
- Re: [PR] [SPARK-51544][SQL] Add only unique and necessary metadata columns [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/19 08:01:31 UTC, 9 replies.
- [PR] [SPARK-40353][PYTHON] Fix nullable mismatch in `ps.read_excel` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/19 08:28:00 UTC, 0 replies.
- Re: [PR] [SPARK-40353][PS] Fix nullable mismatch in `ps.read_excel` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/19 08:29:17 UTC, 2 replies.
- Re: [PR] [MINOR][SQL][TESTS] Ignore messages below error level from `HadoopFSUtils` for sql module tests [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/19 10:09:37 UTC, 1 replies.
- [PR] [SPARK-51551] [ML] [PYTHON] [CONNECT] For tuning algorithm, allow using save / load to replace cache [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/03/19 10:25:50 UTC, 7 replies.
- [PR] [SPARK-51552] [SQL] Disallow temporary variables in persisted views when under identifier [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/03/19 11:19:07 UTC, 28 replies.
- [PR] [SQL] Add rule that pushes Project through Offset and Suite that tests it [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/03/19 12:38:42 UTC, 7 replies.
- Re: [PR] [SPARK-51433][PYTHON][CONNECT] Change release script to release pyspark-client [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/19 13:58:28 UTC, 2 replies.
- [PR] [SPARK-51559][SQL] Make max broadcast table size configurable [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2025/03/19 16:15:28 UTC, 8 replies.
- Re: [PR] [SPARK-43225][BUILD][SQL] Remove jackson-core-asl and jackson-mapper-asl from pre-built distribution [spark] - posted by "Madhukar525722 (via GitHub)" <gi...@apache.org> on 2025/03/19 16:48:30 UTC, 2 replies.
- [PR] [SPARK-51560] Support `cache/persist/unpersist` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/19 18:15:04 UTC, 6 replies.
- [PR] [SPARK-51561] Upgrade `gRPC Swift` to `2.1.2` and `gRPC Swift NIO Transport` to `1.0.2` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/19 18:40:37 UTC, 6 replies.
- [PR] [MINOR] Remove build warning on `try` expression in `SparkSession` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/19 19:20:08 UTC, 1 replies.
- Re: [PR] [MINOR] Remove build warnings on `try` expression in `SparkSession` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/19 19:25:10 UTC, 1 replies.
- [PR] [SPARK-51565][SQL] Support SQL parameters in window frame clause [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2025/03/19 21:40:14 UTC, 6 replies.
- [PR] [SQL][MINOR][TEST] InMemoryTableCatalog should calculate namespaces dynamically [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/03/20 00:25:48 UTC, 5 replies.
- [PR] [SPARK-51567][ML][CONNECT] Fix `DistributedLDAModel.vocabSize` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/20 02:04:59 UTC, 5 replies.
- [PR] [SPARK-51433][PYTHON][FOLLOWUP] Fix pyspark-client package file name [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/03/20 02:09:59 UTC, 2 replies.
- [PR] [WIP][PYTHON] Fix ThreadPoolExecutor failure in python 3.13 daily test [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/20 04:25:17 UTC, 0 replies.
- Re: [PR] [SPARK-51372][SQL] Introduce TableInfo for table creations [spark] - posted by "anoopj (via GitHub)" <gi...@apache.org> on 2025/03/20 05:30:16 UTC, 40 replies.
- Re: [PR] [SPARK-47241][SQL] Fix rule order issues for ExtractGenerator [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/20 05:48:30 UTC, 0 replies.
- [PR] [SPARK-51568][SQL] Introduce isSupportedExtract to prevent happening unexpected behavior [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/20 06:44:45 UTC, 1 replies.
- [PR] [SPARK-51537][CONNECT] [constructed classpath using both global jars and session specific jars in executor [spark] - posted by "wbo4958 (via GitHub)" <gi...@apache.org> on 2025/03/20 09:00:54 UTC, 0 replies.
- [PR] [WIP][SQL] Add the `try_to_time` function [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/20 09:06:07 UTC, 0 replies.
- Re: [PR] [SPARK-51556][SQL] Add the `try_to_time` function [spark] - posted by "the-sakthi (via GitHub)" <gi...@apache.org> on 2025/03/20 11:06:08 UTC, 3 replies.
- [PR] [WIP][SPARK-51423][SQL] Add the current_time() function for TIME datatype [spark] - posted by "the-sakthi (via GitHub)" <gi...@apache.org> on 2025/03/20 11:56:12 UTC, 2 replies.
- [PR] [WIP][PYTHON][TESTS] Add a helper function to fail time outed tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/20 13:36:11 UTC, 0 replies.
- [PR] [FOLLOW-UP][SPARK-42746][SQL] Fix flaky listagg tests and refactor code [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2025/03/20 13:44:10 UTC, 5 replies.
- [PR] [SPARK-51569] Don't reinstantiate `InSubquery` in `InTypeCoercion` if there are no type changes [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/03/20 13:52:23 UTC, 1 replies.
- [PR] [SPARK-51570] Support `filter/where` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/20 14:22:28 UTC, 6 replies.
- [PR] [SPARK-51572] Support `binary` type in `show` and `collect` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/20 18:14:00 UTC, 3 replies.
- [PR] [WIP][SPARK-51575][PYTHON] Combine Python Data Source pushdown & plan read workers [spark] - posted by "wengh (via GitHub)" <gi...@apache.org> on 2025/03/20 20:16:51 UTC, 0 replies.
- [PR] [SPARK-51118][PYTHON] Fix ExtractPythonUDFs to check the chained UDF input types for fallback [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/03/20 21:00:55 UTC, 6 replies.
- [PR] [SPARK-50953][FOLLOW-UP] Improve path parsing in variant_get [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2025/03/20 21:12:18 UTC, 2 replies.
- [PR] [SPARK-51576] Prohibit ANSI cast from `array` to `array<_, containsNull = false>` [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2025/03/20 22:28:12 UTC, 7 replies.
- [PR] [SPARK-51577] Make gradle build to automatically append SNAPSHOT suffix to version for non-release builds [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/03/20 23:59:47 UTC, 2 replies.
- [PR] [SPARK-51573] Fix Streaming State Checkpoint v2 checkpointInfo race condition [spark] - posted by "liviazhu-db (via GitHub)" <gi...@apache.org> on 2025/03/21 00:46:49 UTC, 0 replies.
- Re: [PR] [SPARK-51558][BUILD][INFRA] Automatically set env `OBJC_DISABLE_INITIALIZE_FORK_SAFETY=YES` when testing on macOS [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/21 02:38:31 UTC, 7 replies.
- Re: [PR] [SPARK-51537][CONNECT][CORE] construct classpath using both global jars and session specific jars on executor [spark] - posted by "wbo4958 (via GitHub)" <gi...@apache.org> on 2025/03/21 05:57:13 UTC, 0 replies.
- Re: [PR] [SQL][MINOR][TEST] InMemoryTableCatalog should list procedures namespaces [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/21 07:45:34 UTC, 1 replies.
- Re: [PR] [SPARK-51569][SQL] Don't reinstantiate `InSubquery` in `InTypeCoercion` if there are no type changes [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/21 07:56:29 UTC, 1 replies.
- [PR] [SPARK-51580][SQL] Throw proper user facing error message when lambda function is out of place in `HigherOrderFunction` [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/03/21 09:02:14 UTC, 21 replies.
- [PR] [SPARK-51581][CORE][SQL] Use `nonEmpty`/`isEmpty` for empty check for explicit `Iterable` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/21 09:24:48 UTC, 3 replies.
- [PR] [SPARK-51583] [SQL] Improve error message when to_timestamp function has arguments of wrong type [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/03/21 13:48:07 UTC, 4 replies.
- Re: [PR] [SPARK-51584][SQL] Add rule that pushes Project through Offset and Suite that tests it [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/03/21 13:55:41 UTC, 3 replies.
- [PR] [SPARK-51586][SS] initialize input partitions independent of columnar support [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/03/21 17:52:02 UTC, 8 replies.
- [PR] [SPARK-51587][PYTHON][SS] Fix an issue where timestamp cannot be used in ListState when multiple state data is involved [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2025/03/21 18:07:00 UTC, 20 replies.
- Re: [PR] [SPARK-51575][PYTHON] Combine Python Data Source pushdown & plan read workers [spark] - posted by "wengh (via GitHub)" <gi...@apache.org> on 2025/03/21 18:17:06 UTC, 6 replies.
- [PR] [SQL][UI] [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2025/03/21 18:34:28 UTC, 0 replies.
- Re: [PR] [SPARK-48466][SQL][UI] Handle nested empty relation in SparkPlanInfo [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2025/03/21 18:35:12 UTC, 0 replies.
- [PR] [SPARK-51588][SQL] Validate default values handling in micro-batch writes [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/03/21 22:08:06 UTC, 0 replies.
- Re: [PR] [SPARK-SPARK-50519][SQL]Simplify the method of creating SparkPlan for queryExecution [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/22 00:25:20 UTC, 1 replies.
- Re: [PR] [SPARK-50496][SQL]Change rebalance partitioning to SinglePartition if partition number is 1 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/22 00:25:21 UTC, 1 replies.
- Re: [PR] [SPARK-49938][K8S] Prefer to use Hadoop configMap when specified [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/22 00:25:22 UTC, 1 replies.
- Re: [PR] [SPARK-47672][SQL] Avoid double eval from filter pushDown w/ projection pushdown [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/22 00:25:23 UTC, 1 replies.
- Re: [PR] [SPARK-42038][SQL] SPJ: Support partially clustered distribution [spark] - posted by "anigos (via GitHub)" <gi...@apache.org> on 2025/03/22 02:06:34 UTC, 0 replies.
- [PR] [SPARK-51589][SQL] Fix small bug failing to check for aggregate functions in |> SELECT [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2025/03/22 03:02:57 UTC, 3 replies.
- [PR] [SPARK-51585][SQL] Oracle dialect supports pushdown datetime functions [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/22 14:01:22 UTC, 0 replies.
- [PR] [SPARK-49858][SQL] Fix Spark JSON reader incorrectly considers a string of digits a timestamp [spark] - posted by "lam1051999 (via GitHub)" <gi...@apache.org> on 2025/03/22 17:40:03 UTC, 1 replies.
- Re: [PR] [SPARK-50521][SQL] Align list table method of JDBCTableCatalog to TableCatalog API [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/23 00:28:27 UTC, 1 replies.
- [PR] [SPARK-51419][SQL] Get hour of TIME datatype [spark] - posted by "senthh (via GitHub)" <gi...@apache.org> on 2025/03/23 06:10:09 UTC, 26 replies.
- [PR] [MINOR][SQL][TESTS] Check file based V2 datasources on unsupported types [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/23 13:15:22 UTC, 3 replies.
- [PR] [SPARK-42746][SQL] Fixing potential flakiness in ListAgg golden files [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2025/03/23 15:29:18 UTC, 0 replies.
- [PR] [WIP][SPARK-51590][SQL] Disable TIME in builtin file-based datasources [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/23 16:24:43 UTC, 0 replies.
- Re: [PR] [SPARK-50572][SQL] Fix race condition in CachedRDDBuilder.cachedColumnBuffers [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/24 00:27:26 UTC, 4 replies.
- Re: [PR] [SPARK-50354][SQL] No need to set initialInputBufferOffset when Aggregate mode is Complete [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/24 00:27:29 UTC, 1 replies.
- Re: [PR] [SPARK-51590][SQL] Disable TIME in builtin file-based datasources [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/24 02:00:51 UTC, 1 replies.
- Re: [PR] [SPARK-51578][PYTHON][TESTS] Add a helper function to fail time outed tests [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/24 02:08:29 UTC, 1 replies.
- Re: [PR] [SPARK-40353][PS][CONNECT] Fix index nullable mismatch in `ps.read_excel` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/24 02:33:25 UTC, 1 replies.
- Re: [PR] [SPARK-42746][SQL][FOLLOWUP] Fixing potential flakiness in ListAgg golden files [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/24 02:35:23 UTC, 8 replies.
- Re: [PR] [SPARK-51566][PYTHON] Python UDF traceback improvement [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/24 03:26:08 UTC, 22 replies.
- [PR] [MINOR][SQL][DOCS] Improve the SQL example for join strategy [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/24 03:28:04 UTC, 4 replies.
- [PR] Canonicalized CTEs to avoid cached result not being used and recomputed [spark] - posted by "nimesh1601 (via GitHub)" <gi...@apache.org> on 2025/03/24 05:15:52 UTC, 3 replies.
- Re: [PR] [SPARK-51591][PYTHON][CONNECT] Fix ThreadPoolExecutor failure in python 3.13 daily test [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/24 05:34:09 UTC, 2 replies.
- [PR] [SPARK-51420][SQL][TESTS][FOLLOWUP] Re-generate `sql-expression-schema.md` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/24 06:09:57 UTC, 7 replies.
- [PR] [SPARK-51062][PYTHON] Fix assertSchemaEqual to compare decimal precision and scale [spark] - posted by "amoghantarkar (via GitHub)" <gi...@apache.org> on 2025/03/24 08:27:01 UTC, 1 replies.
- [PR] [SPARK-51146][INFRA][FOLLOW-UP] Explicitly disable Spark Connect in server side scripts [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/24 08:50:44 UTC, 8 replies.
- [PR] [SPARK-51062][PYTHON] Fix assertSchemaEqual to compare decimal precision and scale [spark] - posted by "amoghantarkar (via GitHub)" <gi...@apache.org> on 2025/03/24 09:36:46 UTC, 7 replies.
- [PR] [SPARK-51593][SQL] Refactor `QueryExecutionMetering` instantiation [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/03/24 10:41:14 UTC, 19 replies.
- Re: [PR] [SPARK-48466][SQL][UI][FOLLOWUP] Handle nested empty relation in SparkPlanInfo [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/24 10:51:28 UTC, 1 replies.
- Re: [PR] [SPARK-48936][CONNECT] Makes spark-shell works with Spark connect [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/24 12:12:04 UTC, 0 replies.
- Re: [PR] [SPARK-51576][SQL] Prohibit ANSI cast from `array` to `array<_, containsNull = false>` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/24 13:29:23 UTC, 1 replies.
- [PR] [SPARK-51594][SQL] Use empty schema when saving a view which is not Hive compatible [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/24 14:15:50 UTC, 6 replies.
- [PR] Bump google.golang.org/protobuf from 1.36.5 to 1.36.6 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/03/24 15:24:36 UTC, 0 replies.
- [PR] [SPARK-51592][SQL] Avoid logging makes Driver OOM in AdaptiveSparkPlanExec [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2025/03/24 15:32:06 UTC, 9 replies.
- [PR] [PYTHON] Fix deprecated/invalid config in `setup.cfg` (3.5) [spark] - posted by "abravalheri (via GitHub)" <gi...@apache.org> on 2025/03/24 16:04:14 UTC, 19 replies.
- [PR] docs: update commet for `nullIntolerant` [spark] - posted by "rluvaton (via GitHub)" <gi...@apache.org> on 2025/03/24 16:43:38 UTC, 0 replies.
- [PR] [3.5][SPARK-45994][PYTHON] Change `description-file` to `description_file` [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2025/03/24 17:30:36 UTC, 5 replies.
- Re: [PR] [SPARK-51573][SS] Fix Streaming State Checkpoint v2 checkpointInfo race condition [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2025/03/24 17:50:28 UTC, 6 replies.
- [PR] [Pyspark 3.4][SPARK-45994][PYTHON] Change description-file to description_file [spark] - posted by "Xinihiko (via GitHub)" <gi...@apache.org> on 2025/03/24 18:58:15 UTC, 6 replies.
- [PR] [WIP][SPARK-51439] Support SQL UDF with DEFAULT argument [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/03/24 18:59:27 UTC, 1 replies.
- [PR] [3.4][SPARK-45994][PYTHON] Change `description-file` to `description_file` [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2025/03/24 19:23:30 UTC, 0 replies.
- Re: [PR] [SPARK-45994][PYTHON][3.4] Change `description-file` to `description_file` [spark] - posted by "drsnyder (via GitHub)" <gi...@apache.org> on 2025/03/24 20:06:46 UTC, 4 replies.
- Re: [PR] [SPARK-45994][PYTHON][3.5] Change `description-file` to `description_file` [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2025/03/24 21:10:40 UTC, 4 replies.
- [PR] [SPARK-46860]Enable basic authentication when downloading jars and other files from secured repos [spark] - posted by "krzys9876 (via GitHub)" <gi...@apache.org> on 2025/03/24 21:23:18 UTC, 0 replies.
- Re: [PR] [SPARK-46860][CORE]Enable basic authentication when downloading jars and other files from secured repos [spark] - posted by "krzys9876 (via GitHub)" <gi...@apache.org> on 2025/03/24 21:49:45 UTC, 2 replies.
- [PR] [MINOR][DOCS]: corrected spellings and typos [spark] - posted by "vrmorusu (via GitHub)" <gi...@apache.org> on 2025/03/24 21:57:09 UTC, 1 replies.
- Re: [PR] [SPARK-51597][PYTHON] Fix deprecated/invalid config in `setup.cfg` (3.5) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/25 01:00:19 UTC, 0 replies.
- Re: [PR] [SPARK-51586][SS] initialize input partitions independent of columnar support in continuous mode [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/03/25 01:34:26 UTC, 3 replies.
- Re: [PR] [SPARK-51471][SS] RatePerMicroBatchStream - classify the ASSERT error when offset/timestamp in startOffset is larger than the endOffset [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/03/25 02:21:54 UTC, 1 replies.
- [PR] [SPARK-51318][BUILD] Remove test jars in source releases [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/25 02:30:26 UTC, 72 replies.
- Re: [PR] [SPARK-51252][SS] Add instance metrics for last uploaded snapshot version in HDFS State Stores [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/03/25 02:38:52 UTC, 6 replies.
- [PR] [SPARK-51598][SQL][TEST] Improve the ExpressionsSchemaSuite [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/25 03:20:13 UTC, 5 replies.
- [PR] [MINOR][DOCS]: corrected spellings and typos [spark] - posted by "vrmorusu (via GitHub)" <gi...@apache.org> on 2025/03/25 04:59:01 UTC, 5 replies.
- [PR] [SPARK-51599][PS][CONNECT] Optimize `ps.read_excel` for large excel file [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/25 06:00:23 UTC, 6 replies.
- Re: [PR] [SPARK-51419][SQL] Get hours of TIME datatype [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/25 06:06:34 UTC, 14 replies.
- Re: [PR] [SPARK-51597][PYTHON][3.5] Fix deprecated/invalid config in `setup.cfg` [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2025/03/25 08:02:30 UTC, 3 replies.
- [PR] [SPARK-51600] Prepend classes of `sql/hive` and `sql/hive-thriftserver` when `spark-hive_*.jar` exists in `SPARK_DIST_CLASSPATH` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/25 08:37:40 UTC, 1 replies.
- [PR] [WIP][SPARK-51404][SQL] Parse the `time(n)` type as `TimeType(n)` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/25 10:15:31 UTC, 0 replies.
- Re: [PR] [SPARK-51537][CONNECT][CORE] construct the session-specific classloader based on the default session classloader on executor [spark] - posted by "vicennial (via GitHub)" <gi...@apache.org> on 2025/03/25 11:09:17 UTC, 11 replies.
- [PR] [SPARK-51600][CORE] Prepend classes of `sql/hive` and `sql/hive-thriftserver` when `isTesting || isTestingSql` is true [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/25 13:03:51 UTC, 4 replies.
- [PR] [MINOR][SQL] Desc As JSON test for top-level default collation field [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/03/25 16:01:47 UTC, 4 replies.
- [PR] Clean up the `assembly` module before maven testing [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/25 17:25:11 UTC, 0 replies.
- [PR] [SPARK-51602][SQL] Regenerate AttributeReferences to Aliases with collated expression trees [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/03/25 17:34:43 UTC, 1 replies.
- Re: [PR] [SPARK-51404][SQL] Parse the `time(n)` type as `TimeType(n)` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/25 18:12:18 UTC, 1 replies.
- [PR] [WIP][SQL] Support the TIME data type in the parquet datasource [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/25 18:40:06 UTC, 0 replies.
- [PR] [SPARK-51596][SS] Fix concurrent StateStoreProvider maintenance and closing [spark] - posted by "liviazhu-db (via GitHub)" <gi...@apache.org> on 2025/03/25 20:27:50 UTC, 3 replies.
- [PR] [SPARK-51118][TESTS][FOLLOWUP] Move test_udf_with_udt to BaseUDFTestsMixin [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/03/25 21:18:13 UTC, 3 replies.
- [PR] [SQL][MINOR] Refactor ShowNamespaces to use RunnableCommand [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/03/25 21:54:31 UTC, 1 replies.
- Re: [PR] [SPARK-50240][CORE] Added Simple Sanitization of Extra JVM Options [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/26 00:26:12 UTC, 1 replies.
- Re: [PR] [SPARK-50332][CORE] Optimize accurate CompressedMapStatus [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/26 00:26:13 UTC, 1 replies.
- Re: [PR] [SPARK-49629][CORE] JsonProtocol should use 'Shuffle Push Read Metrics' and 'Merged Fetch Fallback Count' fields of shuffle read metrics [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/26 00:26:15 UTC, 1 replies.
- [PR] [WIP] StateStore state machine [spark] - posted by "liviazhu-db (via GitHub)" <gi...@apache.org> on 2025/03/26 00:33:05 UTC, 0 replies.
- [PR] [SPARK-51118][TESTS][FOLLOWUP][4.0] Move test_udf_with_udt to BaseUDFTestsMixin [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/03/26 01:24:48 UTC, 8 replies.
- [PR] [SPARK-51603][TESTS] Auto ignore tests that require starting `SparkConnectServer` when the directory `assembly/target/$scalaDir/jars/` not exist [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/26 05:25:35 UTC, 0 replies.
- [PR] [SPARK-51604][PYTHON][TESTS] Split `test_connect_session` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/26 07:04:20 UTC, 1 replies.
- [PR] Convert shuffleWriteTime from Nanoseconds to Milliseconds for Consistency with Other Metrics tokens used: 263, model: Azure OpenAI API (o3-mini) [spark] - posted by "CRYP70N1C4 (via GitHub)" <gi...@apache.org> on 2025/03/26 07:41:03 UTC, 0 replies.
- [PR] [Spark-50873][SQL] Prune column after RewriteSubquery rule for DSV2 [spark] - posted by "Akeron-Zhu (via GitHub)" <gi...@apache.org> on 2025/03/26 07:46:10 UTC, 0 replies.
- Re: [PR] [Core]Convert shuffleWriteTime from Nanoseconds to Milliseconds for Consistency with Other Metrics [spark] - posted by "CRYP70N1C4 (via GitHub)" <gi...@apache.org> on 2025/03/26 07:50:02 UTC, 9 replies.
- [PR] [SPARK-51607][BUILD] Set `combine.self = "override"` to configuration of `maven-shade-plugin` in `connect` modules [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/26 09:50:32 UTC, 0 replies.
- Re: [PR] [SPARK-51608] Log exception on Python runner termination [spark] - posted by "antban (via GitHub)" <gi...@apache.org> on 2025/03/26 11:13:47 UTC, 0 replies.
- [PR] [SPARK-51609][SQL] Optimize Recursive CTE execution for simple queries [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/03/26 11:28:32 UTC, 0 replies.
- [PR] [4.0][SPARK-42746][SQL][FOLLOWUP] Regen golden files for LISTAGG [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2025/03/26 12:21:32 UTC, 1 replies.
- Re: [PR] [SPARK-51574][PYTHON] Filter serialization for Python Data Source filter pushdown [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/26 13:04:50 UTC, 1 replies.
- [PR] [DOCS][SPARK-51525][SQL] Desc As JSON test for top-level default collation field [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/03/26 14:59:13 UTC, 2 replies.
- [PR] [SPARK-51252][SS] Make tests more consistent for StateStoreInstanceMetricSuite [spark] - posted by "zecookiez (via GitHub)" <gi...@apache.org> on 2025/03/26 15:01:26 UTC, 0 replies.
- Re: [PR] [SPARK-51607][CONNECT][BUILD] Set `combine.self = "override"` to configuration of `maven-shade-plugin` in `connect` modules [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/26 15:56:02 UTC, 1 replies.
- Re: [PR] [SPARK-42746][SQL][FOLLOWUP][4.0] Regen golden files for LISTAGG [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/26 16:01:28 UTC, 1 replies.
- [PR] [WIP][SPARK-51611][SQL] New iteration of single-pass Analyzer functionality [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/03/26 16:38:59 UTC, 0 replies.
- Re: [PR] [SPARK-51610][SQL] Support the TIME data type in the parquet datasource [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/26 17:01:18 UTC, 1 replies.
- [PR] [SPARK-51612][SQL] Display Spark confs set at view creation in Desc As Json [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/03/26 17:19:40 UTC, 8 replies.
- Re: [PR] [SPARK-51615][SQL] Refactor ShowNamespaces to use RunnableCommand [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/03/26 18:04:43 UTC, 28 replies.
- [PR] [SPARK-51614] [SQL] Fix error message when there is a Generate under an UnresolvedHaving [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/03/26 18:09:38 UTC, 5 replies.
- Re: [PR] [SPARK-51611][SQL] New iteration of single-pass Analyzer functionality [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/03/26 19:52:19 UTC, 0 replies.
- [PR] [SPARK-51616][SQL] Run CollationTypeCasts before ResolveAliases and ResolveAggregateFunctions [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/03/26 20:43:11 UTC, 6 replies.
- [PR] [SPARK-51350][SQL][FOLLOW-UP] Allow query for all namespaces [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/03/26 21:11:44 UTC, 4 replies.
- Re: [PR] [SPARK-51603][CONNECT][TESTS] Auto ignore tests that require starting `SparkConnectServer` when the directory `assembly/target/scala-2.13/jars/` not exist [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/03/26 21:20:07 UTC, 9 replies.
- [PR] Propagate GetStructField metadata in CreateNamedStruct.dataType [spark] - posted by "andylam-db (via GitHub)" <gi...@apache.org> on 2025/03/26 21:26:56 UTC, 1 replies.
- [PR] Report metrics for failed writes for V2 data sources [spark] - posted by "olaky (via GitHub)" <gi...@apache.org> on 2025/03/26 21:51:24 UTC, 0 replies.
- [PR] [WIP][PYTHON] Implement createColumnarReader for Python Data Source [spark] - posted by "wengh (via GitHub)" <gi...@apache.org> on 2025/03/26 22:57:17 UTC, 0 replies.
- Re: [PR] [SPARK-51252][SS][TESTS] Make tests more consistent for StateStoreInstanceMetricSuite [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/03/26 22:57:49 UTC, 2 replies.
- [PR] [SPARK-51617][BUILD] Explicitly commit/revert jar removals [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/27 00:12:37 UTC, 3 replies.
- Re: [PR] [CORE][SPARK-49788] Add optional TTL based cleaning for blocks to better support notebooks [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/27 00:26:16 UTC, 1 replies.
- Re: [PR] [SPARK-49953][CORE] Require `errorClass` in `SparkException` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/27 00:26:18 UTC, 1 replies.
- Re: [PR] [SPARK-47193][SQL] Ensure SQL conf is propagated to executors when actions are called on RDD returned by `Dataset#rdd` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/27 00:26:20 UTC, 1 replies.
- [PR] [SPARK-51618][INFRA] Add a check to reject jars in CI [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/27 00:39:30 UTC, 5 replies.
- [PR] [SPARK-51619][PYTHON] Support UDT in Arrow-optimized Python UDF [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/03/27 01:13:48 UTC, 0 replies.
- [PR] [WIP][SPARK-24815] [CORE] Trigger Interval based DRA for Structured Streaming [spark] - posted by "pkotikalapudi (via GitHub)" <gi...@apache.org> on 2025/03/27 01:23:07 UTC, 3 replies.
- Re: [PR] [SPARK-51588][SQL][TESTS] Validate default values handling in micro-batch writes [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/27 01:48:04 UTC, 2 replies.
- [PR] [MINOR][SPARK-51612][SQL]Update Desc As JSON test to use withSQLConf [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/03/27 01:59:06 UTC, 0 replies.
- [PR] [SPARK-51620] Support `columns` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/27 02:02:24 UTC, 4 replies.
- Re: [PR] [SPARK-51612][SQL]Update Desc As JSON test to use withSQLConf [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/03/27 02:14:55 UTC, 0 replies.
- [PR] [SPARK-51621] Support `sparkSession` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/27 02:29:41 UTC, 5 replies.
- [PR] [MINOR][PYTHON][CONNECT][TESTS] Add `@timeout` to fail suspicious tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/27 02:38:33 UTC, 2 replies.
- [PR] [SPARK-51605][CONNECT] Try to create the parent directory before touching the logFile [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/27 03:18:11 UTC, 4 replies.
- [PR] [SPARK-51623][BUILD] Remove class files in source releases [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/27 03:50:27 UTC, 5 replies.
- [PR] [WIP][INFRA] Add a job to guide spark shell [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/27 03:57:50 UTC, 0 replies.
- [PR] [SPARK-51622][UI] Titling sections on ExecutionPage [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/03/27 04:03:13 UTC, 3 replies.
- [PR] [SPARK-51625][SQL] Command in CTE relations should trigger inline [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/27 04:57:33 UTC, 2 replies.
- Re: [PR] [SPARK-51624] Propagate GetStructField metadata in CreateNamedStruct.dataType [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/27 05:02:15 UTC, 0 replies.
- [PR] [SPARK-51626] Support `DataFrameReader` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/27 05:12:44 UTC, 3 replies.
- [PR] [SPARK-51627][INFRA][PYTHON] Add a scheduled workflow for numpy 2.1.3 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/27 05:38:57 UTC, 2 replies.
- Re: [PR] [SPARK-51628][INFRA] Clean up the `assembly` module before maven testing in maven daily test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/27 06:13:52 UTC, 2 replies.
- [PR] [SPARK-51629][UI] Add a download link on the ExecutionPage for svg/dot/txt format plans [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/03/27 06:28:33 UTC, 4 replies.
- [PR] [WIP][SQL] Support TIME in off-heap column vectors [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/27 06:53:50 UTC, 2 replies.
- Re: [PR] [SPARK-51624][SQL] Propagate GetStructField metadata in CreateNamedStruct.dataType [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/27 07:43:58 UTC, 1 replies.
- [PR] [SPARK-51631][PYTHON][INFRA] Refresh docker images for minimum versions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/27 08:33:12 UTC, 2 replies.
- [PR] [SPARK-51632][INFRA] Passing Command Line Arguments of lint-js to eslint [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/03/27 08:43:00 UTC, 2 replies.
- [PR] [SQL][Minor] Merge PushLimitThroughLimit and PushLimitThroughOffset [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/03/27 10:02:00 UTC, 0 replies.
- [PR] [SPARK-50657][DOCS][FOLLOW-UP] Change the recommended pyarrow version [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/27 10:02:07 UTC, 0 replies.
- Re: [PR] [SPARK-51634][SQL] Support TIME in off-heap column vectors [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/27 10:02:52 UTC, 1 replies.
- [PR] [WIP][SPARK-51455][SQL][TESTS] Improve test coverage of the TIME data type [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/27 12:27:06 UTC, 0 replies.
- Re: [PR] [SQL][SPARK-51635] Merge PushProjectionThroughLimit and PushProjectionThroughOffset [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/27 13:51:34 UTC, 1 replies.
- [PR] [SPARK-51636] Add `StorageLevel` struct [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/27 14:45:09 UTC, 3 replies.
- Re: [PR] [SPARK-51439][SQL] Support SQL UDF with DEFAULT argument [spark] - posted by "wengh (via GitHub)" <gi...@apache.org> on 2025/03/27 15:55:07 UTC, 17 replies.
- Re: [PR] [SPARK-51455][SQL][TESTS] Improve test coverage of the TIME data type [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/27 16:36:42 UTC, 1 replies.
- [PR] [MINOR] Fix build warnings [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/27 16:36:55 UTC, 4 replies.
- [PR] fix [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2025/03/27 18:47:09 UTC, 0 replies.
- Re: [PR] [SPARK-51641][SQL] Fixed CREATE OR REPLACE TABLE ... DEFAULT COLLATION and views with default collation [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2025/03/27 18:49:46 UTC, 4 replies.
- [PR] [SPARK-51642] Support `explain` for `DataFrame` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/27 20:25:30 UTC, 2 replies.
- Re: [PR] [SPARK-51619][PYTHON] Support UDT input / output in Arrow-optimized Python UDF [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/03/27 22:22:05 UTC, 1 replies.
- [PR] [SPARK-51645][SQL] Fix `CREATE OR REPLACE TABLE ... DEFAULT COLLATION ...` query [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2025/03/27 22:29:38 UTC, 3 replies.
- [PR] [SPARK-51646][SQL] Fix propagating collation in views with default collation [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2025/03/27 22:53:32 UTC, 8 replies.
- [PR] [SPARK-51644][BUILD][CONNECT] fix for spark shells [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/03/27 23:10:39 UTC, 0 replies.
- Re: [PR] [SPARK-51608][PYTHON] Log exception on Python runner termination [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/03/28 01:01:21 UTC, 4 replies.
- Re: [PR] [SPARK-50657][DOCS][FOLLOW-UP] Fix the recommended pyarrow version [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/28 01:10:08 UTC, 1 replies.
- [PR] [SPARK-51606][CONNECT] Add SPARK_IDENT_STRING when stopping Spark Connect server [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/28 01:38:40 UTC, 4 replies.
- Re: [PR] [SPARK-51647][INFRA] Add a job to guide REPLs: spark-sql and spark-shell [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/28 02:11:46 UTC, 1 replies.
- [PR] [WIP][SPARK-51638][CORE] Fix fetching the remote disk stored RDD blocks via the external shuffle service [spark] - posted by "attilapiros (via GitHub)" <gi...@apache.org> on 2025/03/28 02:33:30 UTC, 0 replies.
- Re: [PR] [SPARK-51614] [SQL] Introduce ResolveUnresolvedHaving rule in the Analyzer [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/28 02:58:05 UTC, 6 replies.
- [PR] [SPARK-51648][UI] Move inlined javascript in ExecutionPage to spark-sql-viz.js [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/03/28 03:17:29 UTC, 2 replies.
- Re: [PR] [SPARK-51647][INFRA] Add a job to guard REPLs: spark-sql and spark-shell [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/28 03:31:53 UTC, 3 replies.
- [PR] [SPARK-51650][ML][CONNECT] Support delete ml cached objects in batch [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/28 07:17:46 UTC, 6 replies.
- [PR] [WIP][SPARK-51649][SQL] Dynamic writes/reads of TIME partitions [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/28 07:18:14 UTC, 0 replies.
- [PR] [MINOR][DOCS] Fixe variable name typo in document [spark] - posted by "Mrhs121 (via GitHub)" <gi...@apache.org> on 2025/03/28 07:54:36 UTC, 0 replies.
- [PR] [SPARK-51651][UI] Link the root execution id for current execution if any [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/03/28 08:12:20 UTC, 3 replies.
- [PR] [SPARK-51627][INFRA][FOLLOW-UP] Fix the workflow file name [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/28 08:15:03 UTC, 2 replies.
- [PR] [SPARK-51652][SQL] Refactor SetOperation computation out to reuse it in the single-pass Analyzer [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2025/03/28 08:21:17 UTC, 2 replies.
- Re: [PR] [MINOR][DOCS] Fix variable name typo in document [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/03/28 09:11:42 UTC, 1 replies.
- [PR] [MINOR][BUILD][FOLLOWUP] Fix merge_spark_pr script for no jira case [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/03/28 09:14:14 UTC, 4 replies.
- [PR] [SPARK-40353][SPARK-51599][PS][FOLLOW-UP] Fix failure in Python PS with old dependencies [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/03/28 09:32:48 UTC, 2 replies.
- [PR] [SPARK-51655][SQL] Fix metric collection in UnionLoopExec and add test [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/03/28 14:44:14 UTC, 0 replies.
- Re: [PR] [SPARK-49872][CORE] allow unlimited json size again [spark] - posted by "allekai (via GitHub)" <gi...@apache.org> on 2025/03/28 15:12:40 UTC, 1 replies.
- [PR] [MINOR][DOC] grammatical corrections, spellings and typos [spark] - posted by "vrmorusu (via GitHub)" <gi...@apache.org> on 2025/03/28 15:20:24 UTC, 1 replies.
- [PR] [SPARK-51656] Support `time` for `SparkSession` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/28 15:46:18 UTC, 3 replies.
- [PR] [SPARK-51657] UTF8_BINARY default table collation shown by default in Desc As JSON (v1) [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/03/28 17:21:43 UTC, 1 replies.
- [PR] [SPARK-51659] Add `cache` and `describe`-related sql test and answer files [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/28 18:21:08 UTC, 6 replies.
- Re: [PR] [SPARK-51638][CORE] Fix fetching the remote disk stored RDD blocks via the external shuffle service [spark] - posted by "attilapiros (via GitHub)" <gi...@apache.org> on 2025/03/28 19:07:57 UTC, 5 replies.
- Re: [PR] [SPARK-51649][SQL] Dynamic writes/reads of TIME partitions [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/28 19:28:56 UTC, 1 replies.
- [PR] [SPARK-51660][CORE] Gracefully handle when MDC is not supported [spark] - posted by "robreeves (via GitHub)" <gi...@apache.org> on 2025/03/28 21:40:32 UTC, 3 replies.
- Re: [PR] [WIP] State Schema Mapping [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/29 00:26:10 UTC, 1 replies.
- [PR] [WIP][SQL] Infer the TIME type from time partition values [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/29 13:15:50 UTC, 0 replies.
- [PR] [SPARK-51662][SQL] Make OrcFileFormat comparable [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/03/29 23:34:17 UTC, 2 replies.
- Re: [PR] [SPARK-50628] fix stop error on windows [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/30 00:29:13 UTC, 1 replies.
- Re: [PR] [SPARK-50623][SQL] respect table lookup error from the catalog [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/30 00:29:15 UTC, 1 replies.
- Re: [PR] [SPARK-40993][CONNECT][PYTHON][DOCS] Migrate markdown style README to PySpark Development Documentation [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/30 00:29:16 UTC, 1 replies.
- [PR] [SPARK-51663][SQL] Short circuit && operation for JoinSelectionHelper [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/03/30 09:46:26 UTC, 3 replies.
- [PR] [WIP][SQL] Support the TIME data type in the Hash expression [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/30 10:27:48 UTC, 0 replies.
- Re: [PR] [MINOR][FOLLOW-UP][SPARK-51612][SQL]Update Desc As JSON test to use withSQLConf [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/30 12:41:22 UTC, 1 replies.
- [PR] [SPARK-50994][SQL][FOLLOWUP] Do not use RDD with tracked execution in QueryTest [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/03/30 16:18:21 UTC, 3 replies.
- Re: [PR] [SPARK-51664][SQL] Support the TIME data type in the Hash expression [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/30 19:44:22 UTC, 2 replies.
- Re: [PR] [SPARK-51661][SQL] Partitions discovery of TIME column values [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/03/30 22:50:42 UTC, 2 replies.
- [PR] [SPARK-51665][BUILD] Truncate the lists in dev/test-jars.txt and dev/test-classes.txt during release process [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/30 23:50:49 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-49631][SQL] Remove the ANSI config suggestion in ARITHMETIC_OVERFLOW [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/31 00:28:27 UTC, 0 replies.
- Re: [PR] [WIP] state schema management [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/31 00:28:27 UTC, 0 replies.
- [PR] [SPARK-51666][CORE]Fix sparkStageCompleted executorRunTime metric calculation [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2025/03/31 02:51:40 UTC, 2 replies.
- [PR] [SPARK-51667][SS] Disable Nagle's algorithm (TCP_NODELAY = true) in TWS + PySpark for python <-> state server [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/03/31 05:14:16 UTC, 0 replies.
- Re: [PR] [SPARK-51667][SS] Disable Nagle's algorithm (via TCP_NODELAY = true) in TWS + PySpark for python <-> state server [spark] - posted by "neilramaswamy (via GitHub)" <gi...@apache.org> on 2025/03/31 07:22:57 UTC, 1 replies.
- [PR] [SPARK-47895][SQL] group by alias should be idempotent [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2025/03/31 07:47:12 UTC, 4 replies.
- Re: [PR] [SPARK-51667][SS][PYTHON] Disable Nagle's algorithm (via TCP_NODELAY = true) in TWS + PySpark for python <-> state server [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/03/31 07:56:18 UTC, 3 replies.
- [PR] [WIP][SQL][TESTS] Generate random TIME values in tests [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/31 08:37:11 UTC, 0 replies.
- [PR] [SPARK-51653][TESTS] Migrate the tests related to RemoteSparkSession from the connect-client-jvm module to a standalone module. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/03/31 09:12:17 UTC, 10 replies.
- [PR] [SPARK-36600] [PYTHON] Minor fix to avoid list creation for generators with schema [spark] - posted by "Pawan-Bishnoi (via GitHub)" <gi...@apache.org> on 2025/03/31 09:26:40 UTC, 1 replies.
- [PR] [SPARK-51670][SQL] Refactor Intersect and Except to follow Union example to reuse in single-pass Analyzer [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2025/03/31 09:36:52 UTC, 3 replies.
- [PR] [DO-NOT-MERGR] Use Unix Domain Socket between Python and JVM communication [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/03/31 10:31:43 UTC, 0 replies.
- [PR] [SPARK-51672][SQL] Regenerate golden files with collation aliases in branch-4.0 [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/03/31 12:08:53 UTC, 2 replies.
- Re: [PR] [SPARK-51669][SQL][TESTS] Generate random TIME values in tests [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/31 12:58:16 UTC, 1 replies.
- [PR] [SPARK-51673][SQL] Apply default collation to alter view query [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2025/03/31 16:07:26 UTC, 2 replies.
- Re: [PR] [SPARK-51423][SQL] Add the current_time() function for TIME datatype [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/03/31 19:00:07 UTC, 0 replies.
- [PR] [SPARK-51674][DOCS] Remove unnecessary Spark Connect doc link from Spark website [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2025/03/31 19:58:56 UTC, 3 replies.
- Re: [PR] [SPARK-51637][PYTHON] Implement createColumnarReader for Python Data Source [spark] - posted by "wengh (via GitHub)" <gi...@apache.org> on 2025/03/31 20:17:18 UTC, 0 replies.
- [PR] [SPARK-50131][SQL] Add IN Subquery DataFrame API [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/03/31 22:54:53 UTC, 0 replies.