reviews@spark.apache.org, 2025-02

You are viewing a plain text version of this content. The canonical link for it is here.

- [PR] [SPARK-50126][PYTHON][CONNECT][3.5] PySpark expr() (expression) SQL Function returns None in Spark Connect [spark] - posted by "the-sakthi (via GitHub)" <gi...@apache.org> on 2025/02/01 00:00:42 UTC, 12 replies.
- [PR] [SPARK-51054][BUILD] Upgrade Netty to 4.1.117.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/01 00:11:59 UTC, 7 replies.
- Re: [PR] Disallowing non-nullable schema when Avro encoding is used for TransformWithState [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/02/01 00:23:36 UTC, 1 replies.
- Re: [PR] [SPARK-50045][K8S] Spark supports executor HostNetwork on k8s mode [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/01 00:26:12 UTC, 0 replies.
- Re: [PR] [SPARK-49968][SQL] The split function produces incorrect results with an empty regex and a limit [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/01 00:26:13 UTC, 6 replies.
- Re: [PR] [SPARK-50043][BUILD] Build should be stopped when Antrun script fails [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/01 00:26:13 UTC, 0 replies.
- Re: [PR] [SPARK-49774][BUILD] Upgrade guava to 33.3.1-jre [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/01 00:26:14 UTC, 0 replies.
- Re: [PR] [SPARK-50856][SS][PYTHON][CONNECT] Spark Connect Support for TransformWithStateInPandas In Python [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2025/02/01 01:04:54 UTC, 64 replies.
- [PR] [SPARK-51055][SS][CONNECT] Streaming foreachBatch should call init logic inside a try [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2025/02/01 01:34:24 UTC, 5 replies.
- Re: [PR] [SPARK-50967][SS] Add option to skip emitting initial state keys within the FMGWS operator [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/02/01 01:45:13 UTC, 2 replies.
- [PR] [SPARK-51056][PYTHON] Avoid unnecessary object creation in SparkSession.getActiveSession. [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/02/01 01:46:53 UTC, 3 replies.
- Re: [PR] [SPARK-51044][SS][TESTS] Add ordering related tests for list state [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/02/01 02:14:07 UTC, 3 replies.
- [PR] [SPARK-50265][CONNECT] Support spark.udf.registerJavaUdf in Connect [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/02/01 02:44:05 UTC, 2 replies.
- Re: [PR] [SPARK-51047][SS] Add tests to verify scan ordering for non-zero start ordinals as well as non-ascending ordinals [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/02/01 03:23:26 UTC, 1 replies.
- Re: [PR] [MINOR][SQL] Remove signature from Hive thriftserver DEBUG log [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/01 08:44:39 UTC, 0 replies.
- Re: [PR] [SPARK-45891][SQL] Rebuild variant binary from shredded data. [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/02/01 09:09:31 UTC, 1 replies.
- Re: [PR] [SPARK-51050] [SQL] Add group by alias tests to the group-by.sql [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/02/01 12:20:58 UTC, 4 replies.
- Re: [PR] [SPARK-50854][SS] Make path fully qualified before passing it to FileStreamSink [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/02/01 13:25:11 UTC, 9 replies.
- Re: [PR] [SPARK-51047][SS][TESTS] Add tests to verify scan ordering for non-zero start ordinals as well as non-ascending ordinals [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/02/01 13:48:06 UTC, 1 replies.
- [PR] [SPARK-51058][PYTHON][FOLLOW-UP] Avoid using jvm.SparkSession [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/02/01 20:48:57 UTC, 0 replies.
- Re: [PR] [SQL][TEST] Optimize from_json + to_json [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/02 00:25:47 UTC, 1 replies.
- Re: [PR] [SPARK-50095][CONNECT][TESTS] Enable `ProtoToParsedPlanTestSuite` to run successfully in IDE [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/02 00:25:49 UTC, 1 replies.
- Re: [PR] [SPARK-50843][ML][PYTHON][CONNECT] Support return a new model from existing one [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/02 01:14:59 UTC, 1 replies.
- Re: [PR] [SPARK-51015][ML][PYTHON][CONNECT] Support RFormulaModel.toString on Connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/02 01:19:08 UTC, 1 replies.
- Re: [PR] [SPARK-50974][ML][PYTHON][CONNECT] Add support foldCol for CrossValidator on connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/02 01:23:26 UTC, 1 replies.
- [PR] [SPARK-51060][ML][PYTHON][CONNECT] Support `QuantileDiscretizer` on Conenct [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/02 02:40:18 UTC, 4 replies.
- Re: [PR] [SPARK-50082][CORE][ML] Upgrade `pmml-model` to 1.7.1 and migrate `jaxb-api` to `jakarta.xml.bind-api`, `activation` to `jakarta.activation-api` to remove jersey-related warning logs [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2025/02/02 02:45:39 UTC, 4 replies.
- [PR] [SPARK-51061][CORE] Hide `Jetty` info in REST Submission API [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/02 05:11:26 UTC, 7 replies.
- [PR] [SPARK-50899][ML][PYTHON][CONNECT] Support PrefixSpan on connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/02 08:31:00 UTC, 5 replies.
- Re: [PR] [SPARK-50917][EXAMPLES] Add SparkConnectPi Scala example to work both for Connect and Classic [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/02/02 12:29:44 UTC, 2 replies.
- Re: [PR] [DRAFT][SPARK-48375][SQL] Add support for SIGNAL statement [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2025/02/02 12:41:08 UTC, 0 replies.
- Re: [PR] [SPARK-48353][SQL] Introduction of Error Handling mechanism in SQL Scripting [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/02/02 12:59:15 UTC, 28 replies.
- [PR] [SPARK-50843][ML][PYTHON][CONNECT][FOLLOW-UP] Optimize the RPC for `TreeEnsembleModel.trees` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/02 13:26:00 UTC, 2 replies.
- Re: [PR] [DOCS] Add note on compatibility with Confluent Schema Registry in Avro Data Source Guide [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/03 00:24:54 UTC, 1 replies.
- [PR] [SPARK-51063][BUILD][TESTS] Upgrade `bouncycastle` to 1.80 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/03 01:21:30 UTC, 3 replies.
- [PR] [SPARK-51064][SQL] Enable `spark.sql.sources.v2.bucketing.enabled` by… [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/03 03:11:30 UTC, 0 replies.
- Re: [PR] [SPARK-51064][SQL] Enable `spark.sql.sources.v2.bucketing.enabled` by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/03 03:24:24 UTC, 4 replies.
- [PR] [SPARK-50969][ML][CONNECT][PYTHON] Fix `GaussianMixtureModel.gaussians` on connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/03 03:27:35 UTC, 2 replies.
- Re: [PR] [SPARK-51011][CORE] Add logging for whether a task is going to be interrupted when killed [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/03 04:19:56 UTC, 3 replies.
- Re: [PR] [SPARK-51048][CORE] Support stop java spark context with exit code [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/03 04:31:36 UTC, 6 replies.
- Re: [PR] [SPARK-50881][PYTHON] Use cached schema where possible in conenct dataframe.py [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/03 04:33:16 UTC, 5 replies.
- Re: [PR] [SPARK-51043][SS][CONNECT] Fine grained user logging for Spark Connect foreachBatch [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2025/02/03 05:15:47 UTC, 2 replies.
- [PR] [SPARK-51066][ML][PYTHON][CONNECT][TESTS] Enable more parity tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/03 05:16:40 UTC, 2 replies.
- Re: [PR] [SPARK-51065][SQL] Disallowing non-nullable schema when Avro encoding is used for TransformWithState [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/02/03 06:32:19 UTC, 22 replies.
- [PR] [SPARK-51057] Remove scala option based variant api for value state [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/02/03 06:34:12 UTC, 0 replies.
- Re: [PR] [SPARK-51057][SS] Remove scala option based variant api for value state [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/02/03 06:35:19 UTC, 0 replies.
- [PR] [SPARK-51060][ML][PYTHON][CONNECT][FOLLOW-UP] Fix the `uid` of `Bucketizer` fitted by `QuantileDiscretizer` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/03 07:04:17 UTC, 2 replies.
- [PR] [SPARK-50942][ML][PYTHON][CONNECT] Support `ChiSquareTest` on Connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/03 08:06:38 UTC, 7 replies.
- Re: [PR] [SPARK-50982][SQL] Support more SQL/DataFrame read path functionality in single-pass Analyzer [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/02/03 12:05:41 UTC, 9 replies.
- [PR] [SPARK-51067][SQL] Revert session level collation changes [spark] - posted by "dejankrak-db (via GitHub)" <gi...@apache.org> on 2025/02/03 12:32:29 UTC, 1 replies.
- [PR] Add big-endian support to UnsafeRowUtils.validateStructuralIntegrityWithReasonImpl [spark] - posted by "jonathan-albrecht-ibm (via GitHub)" <gi...@apache.org> on 2025/02/03 15:30:23 UTC, 0 replies.
- [PR] [SPARK-50104][CONNECT] Support SparkSession.executeCommand in Connect [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/02/03 16:02:23 UTC, 7 replies.
- [PR] [SPARK-43131][SQL][WIP] Add labels to identify UDFs [spark] - posted by "amahussein (via GitHub)" <gi...@apache.org> on 2025/02/03 17:35:00 UTC, 1 replies.
- [PR] [SPARK-51070][SQL] Use scala.collection.Set instead of Set in ValidateExternalType [spark] - posted by "cryeo (via GitHub)" <gi...@apache.org> on 2025/02/03 17:39:28 UTC, 0 replies.
- [PR] [SPARK-51071][INFRA][3.5] Upgrade `upload-artifact` to v4 to recover `branch-3.5` CI [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/03 17:45:35 UTC, 5 replies.
- [PR] [SPARK-50541][SQL][FOLLOW-UP] Describe As JSON test case for non-existent table [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/02/03 17:47:06 UTC, 3 replies.
- Re: [PR] [SPARK-50639][SQL] Improve warning logging in CacheManager [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/02/03 18:06:17 UTC, 13 replies.
- Re: [PR] [SPARK-51034][SQL] Reformat Describe As JSON statistics dict for parse-ability [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/02/03 18:25:58 UTC, 2 replies.
- Re: [PR] [CORE][CONNECT] Add cogroup and cogroupSorted variants for additional KeyValueGroupedDatasets. [spark] - posted by "kyle-winkelman (via GitHub)" <gi...@apache.org> on 2025/02/03 18:31:43 UTC, 1 replies.
- [PR] [SPARK-51072][CORE] CallerContext to set Hadoop cloud audit context [spark] - posted by "steveloughran (via GitHub)" <gi...@apache.org> on 2025/02/03 19:19:04 UTC, 8 replies.
- Re: [PR] [SPARK-51070][SQL] Use `scala.collection.Set` instead of Set in ValidateExternalType [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/03 20:53:15 UTC, 2 replies.
- Re: [PR] [SPARK-50133][PYTHON][CONNECT] Support DataFrame conversion to table argument in Spark Connect Python Client [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/02/03 22:04:18 UTC, 1 replies.
- [PR] [SPARK-51073][SQL] Remove `Unstable` from `SparkSessionExtensionsProvider` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/03 22:56:19 UTC, 1 replies.
- [PR] [DO-NOT-REVIEW] Test code feb timeout [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2025/02/03 23:23:47 UTC, 1 replies.
- Re: [PR] [SPARK-49565][SQL] Add SQL pipe syntax for the FROM operator [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/03 23:34:47 UTC, 1 replies.
- [PR] [WIP] Introduce common TableArg for Spark Classic and Spark Connect [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/02/04 00:06:34 UTC, 2 replies.
- [PR] [DO-NOT-REVIEW] demo feb [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2025/02/04 00:09:00 UTC, 1 replies.
- Re: [PR] [SPARK-51008][SQL] Add ResultStage for AQE [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2025/02/04 00:12:54 UTC, 58 replies.
- [PR] [SPARK-xxxxx][SS][CONNECT] Set timeout for communicating init configs in streaming foreachBatch [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2025/02/04 00:16:10 UTC, 1 replies.
- Re: [PR] [SPARK-51067][SQL] Partially revert session level collation as object level collation will be used instead [spark] - posted by "dejankrak-db (via GitHub)" <gi...@apache.org> on 2025/02/04 00:26:26 UTC, 4 replies.
- Re: [PR] [SPARK-51058][PYTHON] Avoid using jvm.SparkSession [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/04 00:27:40 UTC, 2 replies.
- Re: [PR] [SPARK-51074][SS][CONNECT] Set timeout for communicating init configs in streaming foreachBatch [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2025/02/04 00:29:14 UTC, 6 replies.
- Re: [PR] [SPARK-51073][SQL] Remove `Unstable` from `SparkSessionExtensionsProvider` trait [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/04 00:35:15 UTC, 9 replies.
- [PR] [SPARK-51075][K8S] Use `container resource` for HPA [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/04 00:46:38 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-48516][PYTHON][CONNECT] Turn on Arrow optimization for Python UDFs by default [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/02/04 01:11:24 UTC, 2 replies.
- [PR] [SPARK-49308][CONNECT] Support UserDefinedAggregateFunction in Spark Connect Scala Client [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/02/04 01:28:18 UTC, 2 replies.
- [PR] [WIP][SPARK-51076][PYTHON][CONNECT] Fallback for UDT input and return type [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/02/04 01:30:44 UTC, 0 replies.
- Re: [PR] [SPARK-51076][PYTHON][CONNECT] Arrow Python UDF fallback for UDT input and output types [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/02/04 01:58:01 UTC, 6 replies.
- Re: [PR] [SPARK-43415][CONNECT][SQL] Implement `KVGDS.agg` with custom `mapValues` function [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/02/04 02:30:35 UTC, 20 replies.
- Re: [PR] [SPARK-51057][SS] Remove scala option based variant API for value state [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/02/04 02:53:51 UTC, 4 replies.
- [PR] [SPARK-50943][ML][PYTHON][CONNECT] Support `Correlation` on Connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/04 04:04:44 UTC, 3 replies.
- Re: [PR] [SPARK-48353][SQL] Introduction of Exception Handling mechanism in SQL Scripting [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/02/04 04:47:24 UTC, 7 replies.
- Re: [PR] [SPARK-50963][ML][PYTHON][CONNECT] Support Tokenizers, SQLTransform and StopWordsRemover on Connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/04 04:59:05 UTC, 0 replies.
- [PR] [SPARK-51078][CONNECT][TESTS][PYTHON] Skip unsupported StopWordsRemover test in Spark Connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/04 05:02:06 UTC, 4 replies.
- Re: [PR] [SPARK-46090][SQL] Support plan fragment level SQL configs in AQE [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/02/04 05:25:23 UTC, 0 replies.
- Re: [PR] [SPARK-50605][CONNECT] Support SQL API mode for easier migration to Spark Connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/04 05:25:59 UTC, 25 replies.
- Re: [PR] [SPARK-50985][SS] Classify Kafka Timestamp Offsets mismatch error instead of assert and throw error for missing server in KafkaTokenProvider [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/02/04 06:22:57 UTC, 2 replies.
- [PR] [SPARK-51078][SPARK-50963][ML][PYTHON][CONNECT] Fix the py4j call in `StopWordsRemover` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/04 08:02:25 UTC, 4 replies.
- [PR] Support large variable types in pandas UDF, createDataFrame and toPan… [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/04 09:54:22 UTC, 0 replies.
- Re: [PR] [SPARK-51079][PYTHON] Support large variable types in pandas UDF, createDataFrame and toPandas with Arrow [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/04 11:12:05 UTC, 7 replies.
- [PR] [SPARK-50944][ML][PYTHON][CONNECT] Support `KolmogorovSmirnovTest` on Connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/04 11:33:20 UTC, 2 replies.
- [PR] [SPARK-50930][ML][PYTHON][CONNECT] Support `PowerIterationClustering` on Connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/04 12:05:39 UTC, 5 replies.
- [PR] [DRAFT] Remove session collation [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2025/02/04 13:35:05 UTC, 0 replies.
- [PR] [SPARK-51081] Refactor `Join.output` for single-pass resolver [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/02/04 16:26:19 UTC, 0 replies.
- Re: [PR] [SPARK-51023][CORE] log remote address on RPC exception [spark] - posted by "fe2s (via GitHub)" <gi...@apache.org> on 2025/02/04 17:09:21 UTC, 1 replies.
- [PR] [SPARK-51082] [SQL] Move all group by alias related tests to group-by-alias.sql [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/02/04 17:20:53 UTC, 1 replies.
- Re: [PR] [SPARK-50655][SS] Move virtual col family related mapping into db layer instead of encoder [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/02/04 19:16:03 UTC, 29 replies.
- Re: [PR] [SPARK-50393][PYTHON][CONNECT] Introduce common TableArg for Spark Classic and Spark Connect [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/02/04 20:14:16 UTC, 2 replies.
- [PR] [SPARK-51083][CORE] Modify JavaUtils to not swallow InterruptedExceptions [spark] - posted by "neilramaswamy (via GitHub)" <gi...@apache.org> on 2025/02/04 22:59:12 UTC, 3 replies.
- Re: [PR] [SPARK-50767][SQL] Remove codegen of `from_json` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2025/02/05 00:13:49 UTC, 8 replies.
- [PR] [SPARK-51087][PYTHON][CONNECT] Raise an error when memory-profiler is not installed for memory profiling [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/02/05 00:20:44 UTC, 1 replies.
- [PR] [SPARK-51078][PYTHOM][ML][TESTS][FOLLOW-UP] Separate language selection test for StopWordsRemover [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/05 00:29:14 UTC, 2 replies.
- [PR] [SPARK-50949][ML][PYTHON][CONNECT] Introduce a helper model to support `StringIndexModel.from_labels_xxx` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/05 00:53:09 UTC, 3 replies.
- [PR] [SPARK-49371][SPARK-51086][SQL][CONNECT][DOCS] Fix various doc SQL issues. [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/02/05 01:54:13 UTC, 5 replies.
- Re: [PR] [SPARK-48516][PYTHON][CONNECT] Turn on Arrow optimization for Python UDFs by default [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/02/05 02:02:20 UTC, 11 replies.
- Re: [PR] [SPARK-51087][PYTHON][CONNECT] Raise a warning when memory-profiler is not installed for memory profiling [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/02/05 02:35:47 UTC, 4 replies.
- [PR] [SPARK-49698][CONNECT][SQL] Add ClassicOnly annotation for classic only methods. [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/02/05 03:45:51 UTC, 2 replies.
- [PR] [SPARK-50949][ML][PYTHON][CONNECT][FOLLOW-UP] Fix uid issue and empty array args [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/05 03:46:55 UTC, 3 replies.
- [PR] [SPARK-51089][ML][PYTHON][CONNECT] Fix `VectorIndexerModel.categoryMaps` on connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/05 04:57:05 UTC, 0 replies.
- [PR] [SPARK-50958][ML][PYTHON][CONNECT] Fix `Word2VecModel.findSynonymsArray` on connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/05 05:04:52 UTC, 0 replies.
- [PR] [SPARK-51090][DOCS][INFRA] Upgrade jekyll from 4.3.3 to 4.4.1 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/05 05:06:19 UTC, 2 replies.
- [PR] [SPARK-50975][ML][PYTHON][CONNECT] Support `CountVectorizerModel.from_vocabulary` on connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/05 05:13:00 UTC, 2 replies.
- [PR] [SPARK-51084] Assign appropriate error class for `negativeScaleNotAllowedError` [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2025/02/05 05:25:08 UTC, 0 replies.
- Re: [PR] [DO-NOT-MERGE] Pythonic approach of setting Spark SQL configurations [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/05 05:39:27 UTC, 1 replies.
- Re: [PR] [SPARK-51081][SQL] Refactor `Join.output` for single-pass resolver [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/02/05 06:46:59 UTC, 1 replies.
- Re: [PR] [SPARK-51084][SQL] Assign appropriate error class for `negativeScaleNotAllowedError` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/02/05 06:51:39 UTC, 4 replies.
- [PR] SPARK-51088. Update comments for the `ResolveFunctions` rule [spark] - posted by "shuyouZZ (via GitHub)" <gi...@apache.org> on 2025/02/05 06:55:52 UTC, 0 replies.
- Re: [PR] [SPARK-51082] [SQL] [TESTS] Move all group by alias related tests to group-by-alias.sql [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/02/05 09:56:08 UTC, 0 replies.
- Re: [PR] [SPARK-50958][ML][PYTHON][CONNECT] Support `Word2VecModel.findSynonymsArray` on connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/05 10:19:49 UTC, 1 replies.
- Re: [PR] [SPARK-50994][CORE] Perform RDD conversion under tracked execution [spark] - posted by "BOOTMGR (via GitHub)" <gi...@apache.org> on 2025/02/05 10:42:39 UTC, 15 replies.
- [PR] [SPARK-51091][ML][PYTHON][CONNECT] Fix the default params of `StopWordsRemover` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/05 11:19:43 UTC, 1 replies.
- Re: [PR] [SPARK-35437][SQL][FOLLOWUP] Relax cast if does not need timezone with PrunePartitionsFastFallback [spark] - posted by "littlelittlewhite09 (via GitHub)" <gi...@apache.org> on 2025/02/05 11:40:28 UTC, 2 replies.
- [PR] [SPARK-50954][ML][PYTHON][CONNECT] Support client side model path overwrite for meta algorithms [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/05 11:42:45 UTC, 6 replies.
- Re: [PR] [SPARK-51082][SQL][TESTS] Move all group by alias related tests to group-by-alias.sql [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/02/05 13:12:03 UTC, 1 replies.
- [PR] [SPARK-49942][SQL] Rename `errorClass` to `condition` in `classifyException()` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/02/05 13:14:24 UTC, 2 replies.
- [PR] [SPARK-51092][SQL] FlatMapGroups: Change the `dataType` of the `timestampTimeoutAttribute` from IntegerType to LongType [spark] - posted by "jonathan-albrecht-ibm (via GitHub)" <gi...@apache.org> on 2025/02/05 13:31:47 UTC, 7 replies.
- [PR] Fix minor endianness issues in tests. [spark] - posted by "jonathan-albrecht-ibm (via GitHub)" <gi...@apache.org> on 2025/02/05 13:42:33 UTC, 0 replies.
- Re: [PR] [SPARK-51089][ML][PYTHON][CONNECT] Support `VectorIndexerModel.categoryMaps` on connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/05 13:45:57 UTC, 1 replies.
- [PR] [SPARK-51094][SQL] Adjust some test parameters to work on s390x [spark] - posted by "jonathan-albrecht-ibm (via GitHub)" <gi...@apache.org> on 2025/02/05 13:59:42 UTC, 0 replies.
- [PR] [DRAFT] [SPARK-51095]. Include caller context for hdfs audit logs for calls from driver [spark] - posted by "sririshindra (via GitHub)" <gi...@apache.org> on 2025/02/05 16:59:36 UTC, 0 replies.
- [PR] Splitting TransformWithStateSuite into two different test suites with encoding [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/02/05 17:14:43 UTC, 0 replies.
- Re: [PR] [SPARK-48375][SQL] Add support for SIGNAL statement [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2025/02/05 17:23:00 UTC, 61 replies.
- [PR] [SPARK-51097] [SS] Adding partition-level metrics for last uploaded snapshot version in RocksDB [spark] - posted by "zecookiez (via GitHub)" <gi...@apache.org> on 2025/02/05 19:17:51 UTC, 19 replies.
- Re: [PR] [SPARK-51096] Splitting TransformWithStateSuite into UnsafeRow and Avro encoding suites [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/02/05 19:39:36 UTC, 1 replies.
- Re: [PR] [SPARK-51050] [SQL] [TESTS] Add group by alias tests to the group-by-alias.sql [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/02/05 19:43:05 UTC, 0 replies.
- Re: [PR] [SPARK-51093][SQL] Fix minor endianness issues in tests. [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/02/05 21:15:44 UTC, 0 replies.
- [PR] [SPARK-51098] [DOCS] Link exceptAll and subtract in Python DataFrame docs [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2025/02/05 21:33:46 UTC, 2 replies.
- Re: [PR] [SPARK-51095][CORE][SQL] Include caller context for hdfs audit logs for calls from driver [spark] - posted by "sririshindra (via GitHub)" <gi...@apache.org> on 2025/02/05 21:54:19 UTC, 31 replies.
- [PR] [SPARK-51099][PYTHON] Add logs when the Python worker looks stuck [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/02/05 23:57:16 UTC, 7 replies.
- [PR] [SPARK-51100][ML][PYTHON][CONNECT] Replace transformer wrappers with helper model attributes [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/06 00:10:54 UTC, 0 replies.
- Re: [PR] [SPARK-51100][ML][PYTHON][CONNECT] Replace transformer wrappers with helper model attribute relations [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/06 00:13:08 UTC, 2 replies.
- Re: [PR] [DRAFT] New collation precedence [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/06 00:24:33 UTC, 1 replies.
- Re: [PR] [TEST-ONLY] Directly invoke functions in JVM side [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/06 00:24:35 UTC, 1 replies.
- [PR] [SPARK-50922][ML][PYTHON][CONNECT][FOLLOw-UP] Import pyspark.core module later for Spark Classic only [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/06 00:37:25 UTC, 1 replies.
- [PR] [SPARK-51101][ML][PYTHON][CONNECT][TESTS] Add doctest for `pyspark.ml.connect.functions` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/06 00:58:41 UTC, 7 replies.
- [PR] [WIP] Add DataFrame.asTable to API documentation [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/02/06 01:12:31 UTC, 1 replies.
- Re: [PR] [SPARK-50799][PYTHON] Refine the docstring of rlike, length, octet_length, bit_length, and transform [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/06 01:27:16 UTC, 1 replies.
- Re: [PR] [SPARK-50922][ML][PYTHON][CONNECT][FOLLOW-UP] Import pyspark.core module later for Spark Classic only [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/06 01:28:59 UTC, 1 replies.
- [PR] [SPARK-51104][Doc] Use self-host javascript and CSS in Spark website [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/02/06 03:07:28 UTC, 1 replies.
- [PR] [SPARK-51105][ML][PYTHON][CONNECT][TESTS] Add parity test for ml functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/06 03:43:47 UTC, 2 replies.
- Re: [PR] [SPARK-51104][DOC] Self-host JavaScript and CSS in Spark website [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2025/02/06 04:20:19 UTC, 7 replies.
- Re: [PR] [SPARK-51096][SQL] Splitting TransformWithStateSuite into UnsafeRow and Avro encoding suites [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/02/06 04:52:51 UTC, 2 replies.
- [PR] [CORE][TESTS] Use `try-with-resources` to ensure resources are closed after testing. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/02/06 06:39:41 UTC, 0 replies.
- Re: [PR] [SPARK-51106][CORE][TESTS] Use `try-with-resources` to ensure resources are closed after testing. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/02/06 06:49:49 UTC, 2 replies.
- [PR] [SPARK-51107][LAUNCHER] Minor polish for Minor polish for CommandBuilderUtils class. [spark] - posted by "RocMarshal (via GitHub)" <gi...@apache.org> on 2025/02/06 07:03:00 UTC, 0 replies.
- Re: [PR] [SPARK-50992][SQL] OOMs and performance issues with AQE in large plans [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/02/06 07:29:38 UTC, 2 replies.
- Re: [PR] [SPARK-51096][SQL][TESTS] Splitting TransformWithStateSuite into UnsafeRow and Avro encoding suites [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/02/06 08:12:26 UTC, 1 replies.
- Re: [PR] [SPARK-51107][LAUNCHER] Minor polish for CommandBuilderUtils class. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/02/06 08:25:35 UTC, 1 replies.
- [PR] [SPARK-51108][INFRA] Install Python packages for `yarn` module in `maven_test.yml` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/02/06 08:47:01 UTC, 8 replies.
- [PR] [SPARK-51105][ML][PYTHON][CONNECT][TESTS][4.0] Add parity test for ml functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/06 09:39:32 UTC, 2 replies.
- Re: [PR] [SPARK-51050][SQL][TESTS] Add group by alias tests to the group-by-alias.sql [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/02/06 09:40:27 UTC, 1 replies.
- [PR] [SPARK-51109][SQL] CTE in subquery expression as grouping column [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/02/06 09:44:34 UTC, 3 replies.
- Re: [PR] [SPARK-51107][CORE] Minor polish for CommandBuilderUtils class. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/02/06 10:42:36 UTC, 0 replies.
- Re: [PR] [SPARK-51010][SQL] Fix AlterColumnSpec not reporting resolved status correctly [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/02/06 11:08:40 UTC, 1 replies.
- [PR] [SPARK-48881][SQL] Add FillStaticPartitions optimization rule to fill the static partiti… [spark] - posted by "fusheng9399 (via GitHub)" <gi...@apache.org> on 2025/02/06 11:13:58 UTC, 0 replies.
- Re: [PR] [SPARK-48881][SQL] Some dynamic partitions can be compensated to specific partition values [spark] - posted by "fusheng9399 (via GitHub)" <gi...@apache.org> on 2025/02/06 11:36:14 UTC, 0 replies.
- Re: [PR] [SPARK-48530][SQL] Support for local variables in SQL Scripting [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2025/02/06 12:57:49 UTC, 81 replies.
- Re: [PR] [SPARK-51107][CORE] Refactor CommandBuilderUtils#join to reuse the lines about strings join and reduce the redundant lines. [spark] - posted by "RocMarshal (via GitHub)" <gi...@apache.org> on 2025/02/06 13:45:01 UTC, 4 replies.
- [PR] [SPARK-51111][SS] Avoid consumer rebalancing stuck when starting a spark streaming job [spark] - posted by "yabola (via GitHub)" <gi...@apache.org> on 2025/02/06 13:49:05 UTC, 1 replies.
- Re: [PR] [SPARK-48881][SQL] Add FillStaticPartitions optimization rule [spark] - posted by "fusheng9399 (via GitHub)" <gi...@apache.org> on 2025/02/06 13:51:23 UTC, 0 replies.
- [PR] [SPARK-48881][SQL] Add FillStaticPartitions optimization rule [spark] - posted by "fusheng9399 (via GitHub)" <gi...@apache.org> on 2025/02/06 13:55:09 UTC, 1 replies.
- [PR] Proper error handling for file status when reading files [spark] - posted by "fusheng9399 (via GitHub)" <gi...@apache.org> on 2025/02/06 14:19:15 UTC, 0 replies.
- [PR] [SPARK-51112][CONNECT] Avoid using pyarrow's `to_pandas` on an empty table [spark] - posted by "vicennial (via GitHub)" <gi...@apache.org> on 2025/02/06 14:49:43 UTC, 9 replies.
- Re: [PR] [SPARK-51093][SQL][TESTS] Fix minor endianness issues in tests. [spark] - posted by "jonathan-albrecht-ibm (via GitHub)" <gi...@apache.org> on 2025/02/06 15:04:25 UTC, 7 replies.
- [PR] [SQL][SPARK-51113] Fix correctness with UNION/EXCEPT/INTERSECT inside a view [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/02/06 16:11:46 UTC, 1 replies.
- Re: [PR] [SPARK-51110][CORE][SQL] Proper error handling for file status when reading files [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/02/06 16:20:16 UTC, 9 replies.
- [PR] [SPARK-50557][CONNECT][SQL] Support RuntimeConfig.contains(..) in Scala SQL Interface [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/02/06 16:52:47 UTC, 7 replies.
- Re: [PR] [SPARK-51042][SQL] Read and write the month and days fields of intervals with one call in Unsafe* classes [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/02/06 16:54:41 UTC, 8 replies.
- [PR] [SPARK-51114] [SQL] Refactor PullOutNondeterministic rule [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/02/06 20:45:17 UTC, 14 replies.
- Re: [PR] [SQL][SPARK-51113] Fix correctness with UNION/EXCEPT/INTERSECT inside a view or EXECUTE IMMEDIATE [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/02/06 21:16:29 UTC, 23 replies.
- [PR] [SPARK-51104][DOC][FollowUp] Self-host docsearch.min.css in Spark website [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/02/06 21:20:13 UTC, 2 replies.
- Re: [PR] [MINOR][SQL] Remove unused TableSchema constructor [spark] - posted by "the-sakthi (via GitHub)" <gi...@apache.org> on 2025/02/06 21:31:22 UTC, 1 replies.
- [PR] [SPARK-50075][FOLLOWUP][DOCS] Add table-valued function API docs [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/02/06 21:32:47 UTC, 4 replies.
- [PR] [SPARK-51119][SQL] Readers on executors resolving EXISTS_DEFAULT should not call catalogs [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/02/06 23:20:50 UTC, 28 replies.
- [PR] [SPARK-50753][PYTHON][DOCS] Add pyspark plotting to API documentation [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/02/07 01:23:59 UTC, 1 replies.
- Re: [PR] [SPARK-51067][SQL] Revert session level collation as object level collation will be used instead [spark] - posted by "dejankrak-db (via GitHub)" <gi...@apache.org> on 2025/02/07 02:13:38 UTC, 5 replies.
- [PR] [SPARK-51126][PS][DOCS] Optimize the memory usage in kde examples [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/07 02:14:56 UTC, 2 replies.
- [PR] [SPARK-51127][PYTHON] Kill the Python worker on idle timeout [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/02/07 02:21:08 UTC, 11 replies.
- [PR] [SPARK-51128][DOC] Self host docsearch.min.css.map in Spark website [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/02/07 02:33:20 UTC, 2 replies.
- [PR] [SPARK-50605][CONNECT][FOLLOW-UP] Install dependencies for Yarn tests in Maven build [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/07 03:53:35 UTC, 3 replies.
- [PR] [SPARK-49531][PYTHON][CONNECT][INFRA] Match pandas version of Python Connect build with development build [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/07 05:06:36 UTC, 0 replies.
- Re: [PR] [SPARK-49531][PYTHON][CONNECT][INFRA][FOLLOW-UP] Match pandas version of Python Connect build with development build [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/07 05:18:59 UTC, 1 replies.
- [PR] [SPARK-50945][ML][PYTHON][CONNECT] Support Summarizer and SummaryBuilder on Connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/07 05:38:27 UTC, 4 replies.
- [PR] [SPARK-51130][YARN][TESTS] Run the test cases related to 'connect' in the `YarnClusterSuite` on Github Actions only [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/02/07 09:08:20 UTC, 1 replies.
- Re: [PR] [SPARK-50855][SS][CONNECT] Spark Connect Support for TransformWithState In Scala [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/02/07 09:26:48 UTC, 49 replies.
- Re: [PR] [SPARK-51130][YARN][TESTS] Run the test cases related to `connect` in the `YarnClusterSuite` on Github Actions only [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/02/07 10:45:02 UTC, 2 replies.
- [PR] [SPARK-51080][ML][PYTHON][CONNECT] Fix save/load for `PowerIterationClustering` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/07 11:31:37 UTC, 3 replies.
- Re: [PR] [SPARK-51069][SQL] Add big-endian support to UnsafeRowUtils.validateStructuralIntegrityWithReasonImpl [spark] - posted by "jonathan-albrecht-ibm (via GitHub)" <gi...@apache.org> on 2025/02/07 13:22:21 UTC, 4 replies.
- [PR] [SPARK-51131][SQL] Throw exception when SQL Script is used inside EXECUTE IMMEDIATE [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2025/02/07 15:58:48 UTC, 1 replies.
- Re: [PR] [SPARK-51131][SQL] Throw exception when SQL Script is found inside EXECUTE IMMEDIATE command [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/02/07 16:08:38 UTC, 10 replies.
- [PR] [SPARK-48239][INFRA][FOLLOWUP] Update the release docker image to follow what we use in Github Action jobs [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/02/07 16:45:04 UTC, 3 replies.
- [PR] [SPARK-48353][SQL][MINOR] Follow-up PR to enable ANSI for scripting execution suites [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2025/02/07 17:52:29 UTC, 1 replies.
- Re: [PR] [SPARK-50953][PYTHON][CONNECT] Add support for non-literal paths in VariantGet [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2025/02/07 18:37:14 UTC, 4 replies.
- [PR] [SPARK-51129][DOC] Fix code tab switching in Spark Website [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/02/07 19:42:15 UTC, 2 replies.
- Re: [PR] [SPARK-48353][SQL][FOLLOWUP] Enable ANSI for SQL Scripting execution suites [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/02/07 21:38:41 UTC, 1 replies.
- Re: [PR] [SPARK-51103][PYTHON][DOCS] Add DataFrame conversion to table argument to API documentation [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2025/02/07 23:47:05 UTC, 1 replies.
- Re: [PR] [SPARK-50137][HIVE] Avoid fallback to Hive-incompatible ways when table creation fails by thrift exception [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/08 00:23:51 UTC, 0 replies.
- Re: [PR] [SPARK-50005][SQL] Enhance method verifyNotReadPath to identify subqueries hidden in the filter conditions. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/08 00:23:52 UTC, 1 replies.
- Re: [PR] [SPARK-48284][SQL] Fix UTF8String indexOf behaviour for empty string search [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/08 00:23:53 UTC, 1 replies.
- Re: [PR] [SPARK-46861][CORE] Avoid Deadlock in DAGScheduler [spark] - posted by "attilapiros (via GitHub)" <gi...@apache.org> on 2025/02/08 01:42:44 UTC, 0 replies.
- [PR] [SPARK-51132][ML][BUILD] Upgrade `JPMM`L to 1.7.1 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2025/02/08 03:06:30 UTC, 0 replies.
- Re: [PR] [SPARK-51132][ML][BUILD] Upgrade `JPMML` to 1.7.1 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2025/02/08 04:13:03 UTC, 30 replies.
- [PR] [Test Only][BUILD] Remove `javax.activation:activation` dependence [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2025/02/08 07:32:46 UTC, 2 replies.
- Re: [PR] [SPARK-49547][SQL][PYTHON] Support returning iterator of RecordBatches in applyInArrow [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2025/02/08 13:59:25 UTC, 1 replies.
- [PR] [SPARK-51133][BUILD] Upgrade Apache `commons-pool2` to 2.12.1 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2025/02/08 17:28:36 UTC, 2 replies.
- Re: [PR] [SPARK-50101][SQL] Fix collated behavior of StringToMap expression [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/09 00:26:22 UTC, 1 replies.
- [PR] [SPARK-51135][SQL] Fix ViewResolverSuite for ANSI modes [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/02/09 15:03:44 UTC, 2 replies.
- [PR] [SPARK-51136][HISTORYSERVER] Set CallerContext for History Server [spark] - posted by "cnauroth (via GitHub)" <gi...@apache.org> on 2025/02/09 21:29:49 UTC, 2 replies.
- [PR] [SPARK-51138][PYTHON][CONNECT][TESTS] Skip pyspark.sql.tests.connect.test_parity_frame_plot_plotly.FramePlotPlotlyParityTests.test_area_plot [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/10 00:22:52 UTC, 5 replies.
- Re: [PR] [TYPING] Add type overloads for inplace dataframe operations [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/10 00:25:24 UTC, 1 replies.
- Re: [PR] [SPARK-49730][SQL] classify syntax errors for pgsql, mysql, sqlserver and h2 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/10 00:25:25 UTC, 1 replies.
- Re: [PR] [SPARK-49827][SQL] Fetching all partitions from hive metastore in batches [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/10 00:25:26 UTC, 1 replies.
- [PR] [SPARK-51139][ML][CONNECT] Refine error class `MLAttributeNotAllowedException` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/10 02:06:23 UTC, 2 replies.
- [PR] [SPARK-51140][ML] Sort the params before saving [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/10 02:31:52 UTC, 7 replies.
- Re: [PR] [SPARK-50917][EXAMPLES] Add Pi Scala example to work both for Connect and Classic [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/02/10 02:38:48 UTC, 3 replies.
- Re: [PR] [SPARK-51067][SQL] Revert session level collation for DML queries and apply object level collation for DDL queries [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/02/10 02:43:38 UTC, 37 replies.
- Re: [PR] [SPARK-51111][DSTREAM] Avoid consumer rebalancing stuck when starting a spark streaming job [spark] - posted by "yabola (via GitHub)" <gi...@apache.org> on 2025/02/10 02:46:19 UTC, 0 replies.
- Re: [PR] [SPARK-35564][SQL] Support subexpression elimination for conditionally evaluated expressions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/02/10 03:04:48 UTC, 6 replies.
- [PR] [SPARK-51142][ML][CONNECT] ML protobufs clean up [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/10 03:45:50 UTC, 7 replies.
- [PR] [SPARK-51143][PYTHON] Pin `plotly==5.24.1` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/10 04:06:20 UTC, 2 replies.
- [PR] Migration kyverno [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2025/02/10 07:58:46 UTC, 1 replies.
- Re: [PR] [SPARK-51143][PYTHON] Pin `plotly<6.0.0` and `torch<2.6.0` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/02/10 08:53:56 UTC, 2 replies.
- [PR] [SPARK-51145][BUILD][TESTS] Upgrade `mysql-connector-j`, `MySQL` docker image version to 9.2.0 and `MariaDB` docker image version to 11.4.5 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2025/02/10 12:18:44 UTC, 3 replies.
- [PR] Bump google.golang.org/protobuf from 1.36.4 to 1.36.5 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/02/10 13:30:12 UTC, 0 replies.
- [PR] Bump golang.org/x/oauth2 from 0.25.0 to 0.26.0 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2025/02/10 13:30:16 UTC, 0 replies.
- [PR] [SPARK-51146][INFRA] Publish a new Spark distribution with Spark Connect enabled (step 1) [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/02/10 15:30:03 UTC, 3 replies.
- [PR] [SPARK-51093][SQL][TESTS] Branch 3.5 Fix minor endianness issues in tests. [spark] - posted by "jonathan-albrecht-ibm (via GitHub)" <gi...@apache.org> on 2025/02/10 15:59:38 UTC, 0 replies.
- Re: [PR] [SPARK-51093][SQL][TESTS][3.5] Fix minor endianness issues in tests [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/10 19:35:34 UTC, 1 replies.
- Re: [PR] [SPARK-51136][CORE] Set `CallerContext` for History Server [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/10 19:57:25 UTC, 15 replies.
- Re: [PR] [SPARK-51146][INFRA][4.0] Publish a new Spark distribution with Spark Connect enabled (step 1) [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/10 20:56:44 UTC, 1 replies.
- [PR] [SPARK-51147][SS] Refactor streaming related classes to a dedicated streaming directory [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2025/02/10 22:52:37 UTC, 3 replies.
- Re: [PR] [SPARK-51097] [SS] Adding state store instance metrics for last uploaded snapshot version in RocksDB [spark] - posted by "zecookiez (via GitHub)" <gi...@apache.org> on 2025/02/10 23:36:52 UTC, 32 replies.
- [PR] [SPARK-51148][BUILD] Upgrade `zstd-jni` to 1.5.6-10 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/11 00:05:42 UTC, 3 replies.
- Re: [PR] [SPARK-49482][SQL] Refactor V2 parquet datasource [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/11 00:24:24 UTC, 1 replies.
- Re: [PR] [SPARK-50582][SQL][PYTHON] Add quote builtin function [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2025/02/11 01:51:09 UTC, 5 replies.
- [PR] Revert "[SPARK-51140][ML] Sort the params before saving" [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/11 01:51:49 UTC, 0 replies.
- [PR] [SPARK-51149][CORE] Log classpath in SparkSubmit on ClassNotFoundException [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/02/11 01:55:48 UTC, 5 replies.
- Re: [PR] Revert "[SPARK-51140][ML][4.0] Sort the params before saving" [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/11 01:58:01 UTC, 3 replies.
- Re: [PR] [SPARK-50793][SQL] Fix MySQL cast function for DOUBLE, LONGTEXT, BIGINT and BLOB types [spark] - posted by "sunxiaoguang (via GitHub)" <gi...@apache.org> on 2025/02/11 01:58:38 UTC, 31 replies.
- [PR] [SPARK-51150][ML] Explicitly pass the session in meta algorithm writers [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/11 02:24:27 UTC, 3 replies.
- [PR] [MINOR][DOCS] Fix incorrect description of constraint on spark.sql.adaptive.coalescePartitions.minPartitionSize [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2025/02/11 02:30:15 UTC, 2 replies.
- [PR] [SPARK-51151][SS] Fix internal and public API naming for `TimeMode.None()` for TransformWithState [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2025/02/11 02:42:59 UTC, 2 replies.
- [PR] [SPARK-45891][SQL][FOLLOWUP] Disable `spark.sql.variant.allowReadingShredded` by default [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/02/11 03:46:01 UTC, 8 replies.
- [PR] Add an example for get_json_object when the JSON object is of JSON array type [spark] - posted by "fusheng9399 (via GitHub)" <gi...@apache.org> on 2025/02/11 03:51:23 UTC, 0 replies.
- Re: [PR] [SPARK-42746][SQL] Implement LISTAGG function [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/02/11 04:11:20 UTC, 2 replies.
- [PR] [SPARK-51153][BUILD] Remove unused `javax.activation:activation` dependence [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2025/02/11 04:44:41 UTC, 3 replies.
- [PR] [SPARK-51154][KAFKA] Remove unused jopt dependency. [spark] - posted by "cnauroth (via GitHub)" <gi...@apache.org> on 2025/02/11 05:24:42 UTC, 2 replies.
- [PR] [SPARK-51155][CORE] Make `SparkContext` show total runtime after stopping [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/11 05:38:39 UTC, 4 replies.
- Re: [PR] [SPARK-51152][SQL]Add an example for get_json_object when the JSON object is of JSON array type [spark] - posted by "fusheng9399 (via GitHub)" <gi...@apache.org> on 2025/02/11 05:55:40 UTC, 7 replies.
- [PR] [SPARK-42746][SQL][FOLLOWUP] Change the delimiter parameter of listagg scala functions from Column to String [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/02/11 06:03:01 UTC, 15 replies.
- [PR] [SPARK-51156][CONNECT] Provide a basic authentication token when running Spark Connect server locally [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/11 06:09:41 UTC, 47 replies.
- [PR] [SPARK-51119][SQL][FOLLOW-UP] Readers on executors resolving EXISTS_DEFAULT should not call catalogs [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/02/11 06:28:08 UTC, 3 replies.
- Re: [PR] [SPARK-51153][BUILD] Remove unused `javax.activation:activation` dependency [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/11 06:40:54 UTC, 3 replies.
- [PR] [SPARK-50940][SPARK-50941][ML][PYTHON][CONNECT][FOLLOW-UP] Directly reuse the CrossValidatorModelWriter and TrainValidationSplitModelWriter [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/11 06:41:04 UTC, 3 replies.
- Re: [PR] [SPARK-51154][BUILD][TESTS] Remove unused `jopt` test dependency [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/11 06:59:03 UTC, 2 replies.
- [PR] [SPARK-51157][SQL] Add missing @varargs Scala annotation for Scala function APIs [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/02/11 07:11:11 UTC, 3 replies.
- [PR] [SPARK-51158][YARN][TESTS] No longer restrict the test cases related to `connect` in the `YarnClusterSuite` to only run on GitHub Actions [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/02/11 08:18:41 UTC, 4 replies.
- [PR] [SPARK-51146][INFRA] Publish a new Spark distribution with Spark Connect enabled (extra tarball) [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/02/11 09:15:58 UTC, 5 replies.
- [PR] [SPARK-51159][INFRA] Pin `plotly<6.0.0` and `torch<2.6.0` in release docker image [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/11 10:22:23 UTC, 8 replies.
- [PR] [SPARK-51160][SQL] Refactor literal function resolution [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/02/11 10:39:12 UTC, 2 replies.
- [PR] [SPARK-51161][BUILD] Fix sed command in make-distribution.sh script on macOS [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/02/11 12:09:42 UTC, 6 replies.
- [PR] [SPARK-42746][SQL][FOLLOWUP] Improve the golden files by print the hex string of binary [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/11 13:17:02 UTC, 3 replies.
- [PR] Log exception on Python runner termination [spark] - posted by "antban (via GitHub)" <gi...@apache.org> on 2025/02/11 13:24:11 UTC, 0 replies.
- [PR] [SPARK-51146][INFRA] Use awk to update release scripts [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/02/11 14:02:34 UTC, 12 replies.
- [PR] [SPARK-51163][BUILD] Exclude duplicated jars from connect-repl [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/02/11 14:12:43 UTC, 11 replies.
- Re: [PR] [DRAFT][DO NOT REVIEW][SQL] SQL Scripting Exception Handling Mechanism POC [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2025/02/11 14:39:23 UTC, 0 replies.
- Re: [PR] [SPARK-49960][SQL] Provide extension point for custom AgnosticEncoder serde [spark] - posted by "chris-twiner (via GitHub)" <gi...@apache.org> on 2025/02/11 15:39:57 UTC, 2 replies.
- [PR] [SPARK-51164][CORE][TESTS] Fix `CallerContext` test by enabling `hadoop.caller.context.enabled` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/11 16:18:56 UTC, 10 replies.
- Re: [PR] [SPARK-51088][SQL] Update comments for the `ResolveFunctions` rule [spark] - posted by "the-sakthi (via GitHub)" <gi...@apache.org> on 2025/02/11 19:02:23 UTC, 0 replies.
- Re: [PR] [SPARK-51094][SQL][TESTS] Adjust some test parameters to work on s390x [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/11 21:29:16 UTC, 6 replies.
- [PR] [SPARK-51165][CORE] Enable `spark.master.rest.enabled` by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/11 21:42:56 UTC, 3 replies.
- [PR] [SPARK-51127][PYTHON][FOLLOWUP] Update version for the config [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/02/11 23:29:48 UTC, 0 replies.
- [PR] [SPARK-51170][PYTHON][CONNECT][TESTS] Separate local and local-cluster in pure Python build in master [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/12 00:24:57 UTC, 2 replies.
- Re: [PR] [SPARK-49699][SS] Disable PruneFilters for streaming workloads [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/12 00:53:20 UTC, 1 replies.
- [PR] [SPARK-49699][SS][FOLLOW-UP] Rename to spark.sql.optimizer.pruneFiltersCanPruneStreamingSubplan [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/12 00:57:09 UTC, 4 replies.
- [PR] [SPARK-51164][CORE][TESTS] Add hadoop.caller.context.enabled for scalatest-maven-plugin. [spark] - posted by "cnauroth (via GitHub)" <gi...@apache.org> on 2025/02/12 01:06:01 UTC, 0 replies.
- Re: [PR] [SPARK-51164][CORE][TESTS][FOLLOWUP] Add hadoop.caller.context.enabled for scalatest-maven-plugin. [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/12 01:11:51 UTC, 5 replies.
- Re: [PR] [SPARK-51127][PYTHON][FOLLOWUP] Update version for the configs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/12 01:12:49 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-51083][CORE] Modify JavaUtils to not swallow InterruptedExceptions [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/02/12 01:49:38 UTC, 1 replies.
- [PR] [SPARK-51171][BUILD] Upgrade `checkstyle` to 10.21.2 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2025/02/12 01:59:12 UTC, 2 replies.
- [PR] [SPARK-51173][TESTS] Add `configName` Scalastyle rule [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/12 02:03:24 UTC, 6 replies.
- Re: [PR] [SPARK-51172][SS] Rename to spark.sql.optimizer.pruneFiltersCanPruneStreamingSubplan [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/12 02:05:54 UTC, 7 replies.
- [PR] [MINOR][INFRA] List pip installation before test in python macos test and python connect test [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/12 03:35:52 UTC, 3 replies.
- [PR] [SPARK-51141][ML][CONNECT][DOCS] Document the Support of ML on Connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/12 04:00:59 UTC, 2 replies.
- Re: [PR] [SPARK-50666][SQL] Support hint for reading in JDBC data source [spark] - posted by "gabry-lab (via GitHub)" <gi...@apache.org> on 2025/02/12 05:36:04 UTC, 1 replies.
- [PR] [SPARK-51175][CORE] Make `Master` show elapsed time when removing drivers [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/12 06:10:00 UTC, 4 replies.
- [PR] Test arrow 18.2.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/02/12 06:38:38 UTC, 1 replies.
- Re: [PR] [SPARK-51152][SQL] Add richer examples for the get_json_object function [spark] - posted by "fusheng9399 (via GitHub)" <gi...@apache.org> on 2025/02/12 06:45:07 UTC, 3 replies.
- Re: [PR] [SPARK-51113][SQL] Fix correctness with UNION/EXCEPT/INTERSECT inside a view or EXECUTE IMMEDIATE [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/02/12 07:37:17 UTC, 22 replies.
- [PR] [SPARK-51157][SQL][3.5] Add missing @VarArgs Scala annotation for Scala function APIs [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/02/12 08:34:05 UTC, 2 replies.
- Re: [PR] [SPARK-51146][INFRA][FOLLOWUP] Use awk to update release scripts [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/02/12 08:51:26 UTC, 0 replies.
- [PR] [SPARK-42746][SQL][FOLLOWUP] Improve the code for SupportsOrderingWithinGroup and Mode [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/12 10:08:09 UTC, 9 replies.
- [PR] [SPARK-51179][SQL] Refactor SupportsOrderingWithinGroup so that centralized check [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/12 12:52:28 UTC, 5 replies.
- [PR] [SPARK-51180][BUILD] Upgrade Arrow to 19.0.0 [spark] - posted by "aimtsou (via GitHub)" <gi...@apache.org> on 2025/02/12 13:54:59 UTC, 0 replies.
- Re: [PR] [SPARK-47995][INFRA][PYTHON] Refresh testing image for pyarrow 17 [spark] - posted by "aimtsou (via GitHub)" <gi...@apache.org> on 2025/02/12 14:24:26 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-51180][BUILD] Upgrade Arrow to 19.0.0 [spark] - posted by "aimtsou (via GitHub)" <gi...@apache.org> on 2025/02/12 14:33:52 UTC, 3 replies.
- [PR] Link to Parquet spec. [spark] - posted by "cashmand (via GitHub)" <gi...@apache.org> on 2025/02/12 18:17:43 UTC, 0 replies.
- Re: [PR] [SPARK-51183][SQL] Link to Parquet spec in Variant docs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/12 18:34:08 UTC, 16 replies.
- [PR] [MINOR] Style fix [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2025/02/12 19:16:36 UTC, 1 replies.
- [PR] [SPARK-51042][SQL][3.5] Read and write the month and days fields of intervals with one call in Unsafe* classes [spark] - posted by "jonathan-albrecht-ibm (via GitHub)" <gi...@apache.org> on 2025/02/12 19:21:40 UTC, 2 replies.
- Re: [PR] [MINOR][SQL][TESTS] Style fix [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/12 19:39:02 UTC, 1 replies.
- [PR] [SPARK-51184][CORE] Remove `TaskState.LOST` logic from `TaskSchedulerImpl` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/12 21:04:36 UTC, 5 replies.
- Re: [PR] [SPARK-50849][Connect] Add example project to demonstrate Spark Connect Server Libraries [spark] - posted by "vicennial (via GitHub)" <gi...@apache.org> on 2025/02/12 22:03:19 UTC, 11 replies.
- Re: [PR] [SPARK-51172][SS][3.5] Rename to spark.sql.optimizer.pruneFiltersCanPruneStreamingSubplan [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/02/12 23:26:54 UTC, 18 replies.
- [PR] [WIP] TransformWithState docs [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/02/13 00:06:20 UTC, 0 replies.
- [PR] [SPARK-51185][Core] Revert simplifications to PartitionedFileUtil API to reduce memory requirements [spark] - posted by "LukasRupprecht (via GitHub)" <gi...@apache.org> on 2025/02/13 00:13:43 UTC, 11 replies.
- Re: [PR] [MINOR][SQL][TESTS] Remove redundant space at `PropagateEmptyRelationSuite` class definition [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/13 00:33:54 UTC, 0 replies.
- Re: [PR] [SPARK-50960][PYTHON][CONNECT] Add `InvalidPlanInput` to Spark Connect Python client [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/13 00:34:51 UTC, 1 replies.
- [PR] [SPARK-51177][PYTHON][CONNECT] Add `InvalidCommandInput` to Spark Connect Python client [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2025/02/13 00:59:58 UTC, 2 replies.
- [PR] [SPARK-51186][PYTHON] Add `StreamingPythonRunnerInitializationException` to PySpark base exception [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2025/02/13 01:53:19 UTC, 2 replies.
- [PR] [SPARK-51059][ML][CONNECT][DOCS] Document how ALLOWED_ATTRIBUTES works [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/13 03:20:26 UTC, 2 replies.
- [PR] [SPARK-51190][ML][PYTHON][CONNECT] Fix TreeEnsembleModel.treeWeights [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/13 03:23:53 UTC, 3 replies.
- [PR] [SPARK-51189][CORE] Promote `JobFailed` to `DeveloperApi` [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/02/13 03:25:09 UTC, 3 replies.
- Re: [PR] [SPARK-51188][BUILD] Upgrade Arrow to 18.2.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/02/13 03:31:11 UTC, 3 replies.
- [PR] [SPARK-51192][CONNECT] Expose `processWithoutResponseObserverForTesting` in `SparkConnectPlanner` [spark] - posted by "vicennial (via GitHub)" <gi...@apache.org> on 2025/02/13 04:26:14 UTC, 1 replies.
- [PR] [SPARK-51182][SQL] Throw a `dataPathNotSpecifiedError` instead of `multiplePathsSpecifiedError` when saving a `DataFrame` to a path without specifying the path [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2025/02/13 04:28:16 UTC, 1 replies.
- [PR] [SPARK-51193][CORE] Upgrade Netty to 4.1.118.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/13 04:57:40 UTC, 0 replies.
- [PR] [SPARK-51194][BUILD] Upgrade `scalafmt` to 3.8.6 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2025/02/13 05:03:08 UTC, 2 replies.
- Re: [PR] [SPARK-51193][CORE] Upgrade Netty to 4.1.118.Final and netty-tcnative to 2.0.70.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/13 05:05:11 UTC, 4 replies.
- [PR] [SPARK-51195][BUILD][K8S] Upgrade `kubernetes-client` to 7.1.0 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2025/02/13 05:25:47 UTC, 3 replies.
- [PR] [SPARK-51176][PYTHON][CONNECT] Meet consistency for unexpected errors PySpark Connect <> Classic [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2025/02/13 06:15:39 UTC, 3 replies.
- [PR] [SPARK-51197][ML][PYTHON][CONNECT][TESTS] Unit test clean up [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/13 06:24:54 UTC, 2 replies.
- [PR] [SPARK-51182][SQL] DataFrameWriter should throw dataPathNotSpecifiedError when path is not specified [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/02/13 06:42:33 UTC, 7 replies.
- [PR] [SPARK-51198][CORE][DOCS] Revise `defaultMinPartitions` function description [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/13 07:04:33 UTC, 3 replies.
- [PR] [SPARK-51146][SQL][FOLLOWUP] Respect system env `SPARK_CONNECT_MODE` in places that access the api mode config [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/02/13 07:15:10 UTC, 11 replies.
- [PR] [SPARK-51200][BUILD] Add SparkR deprecation info to `README.md` and `make-distribution.sh` help [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/13 07:29:11 UTC, 4 replies.
- Re: [PR] [SPARK-28973][SQL] Add `TimeType` and support `java.time.LocalTime` as its external type. [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/02/13 08:42:53 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-24815] [CORE] Trigger Interval based DRA for Structured Streaming [spark] - posted by "WebdeveloperIsaac (via GitHub)" <gi...@apache.org> on 2025/02/13 08:43:10 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-7101][SQL] support java.sql.Time [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/02/13 08:47:09 UTC, 0 replies.
- [PR] [SPARK-51202][ML][PYTHON] Pass the session in meta algorithm python writers [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/13 09:32:27 UTC, 3 replies.
- [PR] [SPARK-51201][SQL] Make Partitioning Hints support byte and short values [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/02/13 10:09:36 UTC, 4 replies.
- [PR] [SPARK-49479][CORE] Cancel the Timer non-daemon thread on stopping the BarrierCoordinator [spark] - posted by "bcheena (via GitHub)" <gi...@apache.org> on 2025/02/13 10:23:56 UTC, 19 replies.
- [PR] [SPARK-51181] [SQL] Enforce determinism when pulling out non deterministic expressions from logical plan [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/02/13 10:36:26 UTC, 5 replies.
- Re: [PR] [SPARK-46937][SQL] Improve concurrency performance for FunctionRegistry [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/02/13 11:57:56 UTC, 4 replies.
- [PR] [SPARK-51203] Enhance force optimize skewed join [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2025/02/13 13:05:24 UTC, 0 replies.
- Re: [PR] [SPARK-50903][CONNECT] Cache logical plans after analysis [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2025/02/13 15:33:46 UTC, 0 replies.
- [PR] [SPARK-51046][SQL][TEST] Reduce `numCols` in `withFilter()` to prevent `SubExprEliminationBenchmark` from failing due to a Codegen error [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2025/02/13 16:20:07 UTC, 9 replies.
- [PR] [SPARK-51204][BUILD] Upgrade `sbt-assembly` to 2.3.1 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2025/02/13 16:36:39 UTC, 5 replies.
- [PR] [SPARK-51205][BUILD][TESTS] Upgrade `bytebuddy` to 1.17.0 to support Java 25 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/13 18:07:50 UTC, 4 replies.
- [PR] [SPARK-51206][PYTHON][CONNECT] Move Arrow conversion helpers out of Spark Connect [spark] - posted by "wengh (via GitHub)" <gi...@apache.org> on 2025/02/13 20:30:38 UTC, 21 replies.
- [PR] [SPARK-51208][SQL] ColumnDefinition.toV1Column should preserve EXISTS…_DEFAULT resolution [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/02/13 20:59:59 UTC, 0 replies.
- [PR] [SPARK-51209][CORE] Improve `getCurrentUserName` to handle Java 24+ [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/13 22:28:26 UTC, 8 replies.
- [PR] [SPARK-51210][CORE] Add `--enable-native-access=ALL-UNNAMED` to Java options [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/13 22:43:24 UTC, 0 replies.
- Re: [PR] [SPARK-51208][SQL] `ColumnDefinition.toV1Column` should preserve `EXISTS_DEFAULT` resolution [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/02/13 22:49:59 UTC, 11 replies.
- [PR] [SPARK-51211][SS] Rename the option of readChangeFeed to readChangeLog in state store reader [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/02/13 23:05:43 UTC, 0 replies.
- Re: [PR] [WIP][DO-NOT-MERGE][SPARK-51211][SS] Rename the option of readChangeFeed to readChangeLog in state store reader [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/02/13 23:15:52 UTC, 0 replies.
- Re: [PR] [SPARK-51210][CORE] Add `--enable-native-access=ALL-UNNAMED` to Java options for Java 24+ [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/14 00:11:20 UTC, 4 replies.
- [PR] [SPARK-51212][PYTHON] Add a separated PySpark package for Spark Connect by default [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/02/14 01:02:26 UTC, 29 replies.
- [PR] [SPARK-51119][SQL][FOLLOW-UP] ColumnDefinition.toV1Column should preserve EXISTS_DEFAULT resolution [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/02/14 02:06:09 UTC, 4 replies.
- Re: [PR] [Only Test][Don't Review] Make `FilterExec` to support `subexpressionElimination` in the codegen scenario [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/02/14 02:37:56 UTC, 0 replies.
- [PR] [SPARK-51214][ML][PYTHON][CONNECT] Don't eagerly remove the cached models for `fit_transform` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/14 03:32:36 UTC, 5 replies.
- [PR] [SPARK-51209][CORE][FOLLOWUP] Use `user.name` system property first as a fallback [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/14 03:32:54 UTC, 10 replies.
- [PR] [SPARK-51213][SQL] Keep Expression class info when resolving hint parameters [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/02/14 03:34:01 UTC, 4 replies.
- [PR] [SPARK-51215][ML][PYTHON][CONNECT] Add a helper function to invoke helper model attr [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/14 05:56:07 UTC, 2 replies.
- [PR] [BUILD] Remove the useless `bigtop-dist` profile [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/02/14 06:28:45 UTC, 0 replies.
- Re: [PR] [SPARK-51216][BUILD] Remove the useless `bigtop-dist` profile and the related outdated files [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/02/14 06:36:32 UTC, 4 replies.
- [PR] [SPARK-51178][CONNECT][PYTHON] Raise proper PySpark error instead of `SparkConnectGrpcException` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2025/02/14 08:20:42 UTC, 3 replies.
- [PR] Apply Milan's already existing changes [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/02/14 09:01:27 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-50892][SQL]Add UnionLoopExec, physical operator for recursion, to perform execution of recursive queries [spark] - posted by "Pajaraja (via GitHub)" <gi...@apache.org> on 2025/02/14 09:03:13 UTC, 16 replies.
- [PR] [SPARK-51217][ML][CONNECT] ML model helper constructor clean up [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/14 09:26:35 UTC, 2 replies.
- Re: [PR] [SPARK-49113] Dont assert on translation bugs - silently swallow the exception [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/14 11:53:50 UTC, 0 replies.
- Re: [PR] [SPARK-50087] Robust handling of boolean expressions in CASE WHEN for MsSqlServer and future connectors [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/14 12:17:27 UTC, 0 replies.
- [PR] [SPARK-50692][SQL][FOLLOWUP] Add comments for LPAD and RPAD [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/14 12:34:15 UTC, 4 replies.
- Re: [PR] [SPARK-47463][SQL] Use V2Predicate to wrap expression with return type of boolean [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/14 13:32:17 UTC, 0 replies.
- [PR] [SPARK-51218][SQL] Avoid map/flatMap in NondeterministicExpressionCollection [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/02/14 13:49:50 UTC, 6 replies.
- [PR] [SPARK-51219][SQL] Fix `ShowTablesExec.isTempView` to work with non-`V2SessionCatalog` catalogs [spark] - posted by "ostronaut (via GitHub)" <gi...@apache.org> on 2025/02/14 15:36:53 UTC, 12 replies.
- [PR] [SPARK-51220] Upgrade `kubernetes-client` to 7.1.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/14 17:00:57 UTC, 2 replies.
- [PR] [SPARK-51221] Use unresolvable host name in SparkConnectClientSuite [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/02/14 17:35:18 UTC, 0 replies.
- [PR] [WIP][PYTHON] Add filter pushdown API to Python Data Sources [spark] - posted by "wengh (via GitHub)" <gi...@apache.org> on 2025/02/14 22:48:52 UTC, 0 replies.
- [PR] [SPARK-51119][SQL][FOLLOW-UP] Add fallback to ResolveDefaultColumnsUtil existenceDefaultValues [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/02/14 23:03:32 UTC, 13 replies.
- [PR] [SPARK-51222][SQL] Optimize ReplaceCurrentLike [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/02/15 00:34:52 UTC, 14 replies.
- [PR] [SPARK-51085][SQL] Restore SQLContext Companion [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/02/15 02:44:42 UTC, 1 replies.
- Re: [PR] [MINOR][SQL] Optimize ReplaceCurrentLike [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/02/15 08:04:53 UTC, 2 replies.
- [PR] [SPARK-51223][CONNECT] Always use an ephemeral port for local connect [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2025/02/15 15:17:52 UTC, 5 replies.
- [PR] [SPARK-51225][BUILD] Upgrade several Maven plugins to the latest versions [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/16 01:56:11 UTC, 3 replies.
- [PR] [SPARK-51226][BUILD] Upgrade `extra-enforcer-rules` to support Java 24 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/16 02:46:13 UTC, 3 replies.
- [PR] [SPARK-51227][PYTHON][CONNECT] Fix PySpark Connect `_minimum_grpc_version` to 1.67.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/16 07:10:34 UTC, 3 replies.
- [PR] [SPARK-50098][PYTHON][CONNECT][FOLLOWUP] Fix PySpark Connect `_minimum_googleapis_common_protos_version` to 1.65.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/16 07:23:58 UTC, 3 replies.
- Re: [PR] [SPARK-42746][SQL][FOLLOWUP] Correct the comments for SupportsOrderingWithinGroup and Mode [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/02/16 08:14:28 UTC, 2 replies.
- [PR] [SPARK-51228][SQL] Introduce subquery normalization to NormalizePlan [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/02/16 11:15:03 UTC, 2 replies.
- [PR] [SPARK-51229][BUILD][CONNECT] Fix dependency:analyze goal on connect common [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/02/16 16:48:28 UTC, 4 replies.
- [PR] [SPARK-51231][BUILD] Add `.mvn/jvm.config` with `--enable-native-access=ALL-UNNAMED` to suppress Maven warnings [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/16 19:22:55 UTC, 0 replies.
- Re: [PR] [SPARK-51231][BUILD] Add `--enable-native-access=ALL-UNNAMED` to `.mvn/jvm.config` and `jvmArgs` to suppress Maven warnings [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/17 00:12:51 UTC, 5 replies.
- [PR] [SPARK-51232][PYTHON][DOCS] Remove PySpark 3.3 and older logic from `binder/postBuild` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/17 00:41:02 UTC, 6 replies.
- [PR] [SPARK-51233][BUILD] Update `pom.xml` to use `https` for `licenses` element [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/17 01:06:13 UTC, 3 replies.
- [PR] [SPARK-51234][PYTHON][DOCS] Document an import change in `from pyspark.sql.functions import *` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/17 01:45:34 UTC, 3 replies.
- Re: [PR] [SPARK-51152][PYTHON][SQL][DOCS] Add usage examples for the get_json_object function [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/17 02:13:03 UTC, 10 replies.
- [PR] [SPARK-51235][K8S][DOCS] Update `YuniKorn` docs with `1.6.1` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/17 03:10:20 UTC, 2 replies.
- [PR] [SPARK-51238][K8S][INFRA][DOCS] Upgrade Volcano to 1.11.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/17 03:54:29 UTC, 3 replies.
- [PR] [SPARK-51237] Add API details for new transformWithState helper APIs as needed [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/02/17 04:10:09 UTC, 0 replies.
- Re: [PR] [SPARK-51237][SS] Add API details for new transformWithState helper APIs as needed [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/02/17 04:57:43 UTC, 5 replies.
- [PR] [BUILD] Upgrade commons-codec to 1.18.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/02/17 05:54:52 UTC, 1 replies.
- [PR] [SPARK-51239][INFRA] Upgrade Github Action image for `TPCDSQueryBenchmark` from 20.04 to 24.04 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2025/02/17 05:57:47 UTC, 8 replies.
- [PR] [SPARK-51241][SQL] Remove the redundant code path for ANY_VALUE [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/17 06:17:10 UTC, 6 replies.
- [PR] [SPARK-51242][CONENCT][PYTHON] Improve Column performance when DQC is disabled [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2025/02/17 07:09:35 UTC, 4 replies.
- [PR] [SPARK-51187][SQL][SS] Implement the graceful deprecation of incorrect config introduced in SPARK-49699 [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/02/17 07:55:39 UTC, 17 replies.
- [PR] [SPARK-51187][SQL][SS][4.0] Implement the graceful deprecation of incorrect config introduced in SPARK-49699 [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/02/17 08:01:44 UTC, 1 replies.
- [PR] [SPARK-51187][SQL][SS][3.5] Implement the graceful deprecation of incorrect config introduced in SPARK-49699 [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/02/17 08:02:17 UTC, 10 replies.
- [PR] [SPARK-51243][CORE][ML] Configurable allow native BLAS [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/02/17 09:58:41 UTC, 19 replies.
- [PR] [MINOR][SQL] Format the SqlBaseParser.g4 [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/17 12:04:06 UTC, 6 replies.
- [PR] [SPARK-51244][INFRA][3.5] Upgrade Github Action image to `ubuntu-latest` and solved the `TPCDSQueryBenchmark` and `k8s-integration-tests` compatibility issue after upgrading to the latest version [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2025/02/18 02:50:02 UTC, 2 replies.
- [PR] [MINOR][DOCS] Add missing backticks in `Upgrading from PySpark 3.5 to 4.0` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/18 05:48:05 UTC, 2 replies.
- Re: [PR] [SPARK-51244][INFRA][3.5] Upgrade left Github Action image from `ubuntu-20.04` to `ubuntu-22.04` and solved the `TPCDSQueryBenchmark` compatibility issue [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2025/02/18 08:25:12 UTC, 1 replies.
- [PR] [SPARK-51241][SQL] Add test cases with ignore nulls for ANY_VALUE [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/18 10:59:52 UTC, 1 replies.
- [PR] [SPARK-51246][SQL] Make InTypeCoercion produce resolved Casts [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/02/18 13:13:22 UTC, 2 replies.
- Re: [PR] [SPARK-47383][CORE] Support `spark.shutdown.timeout` config [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/02/18 14:56:43 UTC, 2 replies.
- [PR] [SPARK-51247][SQL] Move SubstituteExecuteImmediate to 'resolution' batch and prepare it for SQL Scripting local variables. [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2025/02/18 16:21:10 UTC, 13 replies.
- [PR] [SPARK-48114][SQL] Move subquery validation out of CheckAnalysis [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/02/18 16:53:15 UTC, 3 replies.
- Re: [PR] [SPARK-51241][SQL][TESTS] Add test cases with ignore nulls for ANY_VALUE [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/02/18 20:47:56 UTC, 1 replies.
- [PR] [WIP] Fixing NoPrefixKeyStateEncoder [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/02/18 21:18:46 UTC, 0 replies.
- [PR] Add DataType class for timestamp with nanoseconds [spark] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2025/02/18 21:36:24 UTC, 0 replies.
- [PR] [SPARK-51250][K8S] Add Support for K8s PriorityClass Configuration fo… [spark] - posted by "zemin-piao (via GitHub)" <gi...@apache.org> on 2025/02/18 21:41:43 UTC, 0 replies.
- Re: [PR] [SPARK-51248][SQL] Move subquery validation out of CheckAnalysis [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/02/18 22:02:25 UTC, 0 replies.
- Re: [PR] [SPARK-51251][SQL] Add DataType class for timestamp with nanoseconds [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/18 23:54:49 UTC, 1 replies.
- [PR] [SPARK-51253][SQL][CONNECT] Mapped KVDS.agg should support sql-expressions [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2025/02/19 02:32:05 UTC, 1 replies.
- Re: [PR] [SPARK-51240][BUILD] Upgrade commons-codec to 1.18.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/02/19 02:33:23 UTC, 1 replies.
- Re: [PR] [SPARK-51239][INFRA] Upgrade Github Action image for `TPCDSQueryBenchmark` from 20.04 to latest [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/02/19 02:35:48 UTC, 1 replies.
- [PR] [SPARK-51254][PYTHON][CONNECT] Disallow --master with Spark Connect URL [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/19 04:33:47 UTC, 6 replies.
- [PR] [SPARK-51255][INFRA] Install dependencies related to docs in release image [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/19 06:40:27 UTC, 2 replies.
- [PR] [MINOR][PYTHON][DOCS] Refine the docstring of `VariantVal` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/19 08:27:44 UTC, 2 replies.
- [PR] [SPARK-51150][ML][FOLLOW-UP] Pass session in `OneVsRestParams.saveImpl` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/19 08:31:12 UTC, 4 replies.
- [PR] [SPARK-51256][SQL] Increase parallelism if joining with small bucket table [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2025/02/19 09:18:11 UTC, 5 replies.
- [PR] [SPARK-51258][SQL] Remove unnecessary inheritance from SQLConfHelper [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/19 11:38:30 UTC, 11 replies.
- [PR] [SPARK-51156] Static token authentication support to Spark Connect [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2025/02/19 11:54:01 UTC, 12 replies.
- [PR] [SPARK-51082][SQL][TESTS] Add order-by-alias.sql [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/02/19 12:31:08 UTC, 1 replies.
- [PR] [SPARK-51219][SQL][TESTS][FOLLOWUP] `ShowTablesExec` remove `ArrayImplicits` [spark] - posted by "ostronaut (via GitHub)" <gi...@apache.org> on 2025/02/19 13:26:43 UTC, 3 replies.
- [PR] [SPARK-51081][SQL][FOLLOWUP] Refactor natural and using join keys computation [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/02/19 13:59:47 UTC, 0 replies.
- Re: [PR] [SPARK-51259][SQL] Refactor and improve performance for natural and using join keys computation [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/02/19 14:48:25 UTC, 0 replies.
- Re: [PR] [SPARK-51259][SQL] Refactor natural and using join keys computation [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/02/19 14:55:27 UTC, 3 replies.
- [PR] [SPARK-51259][SQL][FOLLOWUP] Improve performance of natural and using join keys computation [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2025/02/19 15:03:27 UTC, 4 replies.
- Re: [PR] [SPARK-51257][SQL][TESTS] Add order-by-alias.sql [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/02/19 15:48:30 UTC, 1 replies.
- Re: [PR] [SPARK-51156][CONNECT] Static token authentication support to Spark Connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/19 22:57:09 UTC, 18 replies.
- [PR] [SPARK-51260][SQL] Move V2ExpressionBuilder and PushableExpression to Catalyst module [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2025/02/19 23:04:30 UTC, 2 replies.
- Re: [PR] [SPARK-51185][Core][3.5] Revert simplifications to PartitionedFileUtil API to reduce memory requirements [spark] - posted by "LukasRupprecht (via GitHub)" <gi...@apache.org> on 2025/02/20 00:41:48 UTC, 7 replies.
- Re: [PR] [SPARK-51249][SS] Fixing the NoPrefixKeyStateEncoder and Avro encoding to use the correct number of version bytes [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2025/02/20 01:57:48 UTC, 7 replies.
- [PR] [TESTS] Clean up unnecessary `invokePrivate` method calls in test code [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/02/20 02:39:16 UTC, 0 replies.
- [PR] [SPARK-51261][ML][PYTHON][CONNECT] Introduce model size estimation to control ml cache [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/20 02:53:27 UTC, 25 replies.
- [PR] [SPARK-51264][SQL][JDBC] JDBC write keeps driver connection open unnecessarily [spark] - posted by "SauronShepherd (via GitHub)" <gi...@apache.org> on 2025/02/20 05:41:00 UTC, 0 replies.
- [PR] [SPARK-51265][SQL][SS] Throw proper error for eagerlyExecuteCommands containing streaming source marker [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/02/20 05:41:17 UTC, 32 replies.
- [PR] [SPARK-51266][CORE] Remove the unused definition of `private[spark] object TaskDetailsClassNames` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/02/20 05:53:26 UTC, 3 replies.
- [PR] [SPARK-51267][CONNECT] Match local Spark Connect server logic between Python and Scala [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/20 07:43:30 UTC, 10 replies.
- Re: [PR] [DO-NOT-MERGE] GHA Test. [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/02/20 08:16:55 UTC, 0 replies.
- Re: [PR] [SPARK-44366][BUILD] Upgrade antlr4 to 4.13.1 [spark] - posted by "melin (via GitHub)" <gi...@apache.org> on 2025/02/20 08:20:45 UTC, 1 replies.
- Re: [PR] [SPARK-47018][BUILD][SQL] Bump built-in Hive to 2.3.10 [spark] - posted by "shrprasa (via GitHub)" <gi...@apache.org> on 2025/02/20 08:26:07 UTC, 1 replies.
- [PR] [SPARK-47208][DOCS][FOLLOWUP] Replace spark.driver.minMemoryOverhead with spark.executor.minMemoryOverhead [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/02/20 09:01:08 UTC, 0 replies.
- [PR] [SPARK-51268][SQL] Make `TreeNode` lock-free [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/20 11:19:03 UTC, 3 replies.
- Re: [PR] [SPARK-51156][CONNECT] Static token authentication support in Spark Connect [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2025/02/20 12:46:51 UTC, 7 replies.
- [PR] [SPARK-51269][SQL] SQLConf should manage the default value for avro compression level [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/20 13:36:25 UTC, 4 replies.
- Re: [PR] [SPARK-51263][CORE][SQL][TESTS] Clean up unnecessary `invokePrivate` method calls in test code [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/20 14:03:29 UTC, 5 replies.
- Re: [PR] [SPARK-51092][SQL] FlatMapGroups: Skip the v1 FlatMapGroupsWithState tests with timeout on big endian platforms [spark] - posted by "jonathan-albrecht-ibm (via GitHub)" <gi...@apache.org> on 2025/02/20 14:03:58 UTC, 0 replies.
- [PR] [SPARK-49489][SQL][HIVE] HMS client respects `hive.thrift.client.maxmessage.size` [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/02/20 15:35:36 UTC, 21 replies.
- [PR] [SPARK-49960][SQL] Custom ExpressionEncoder support and TransformingEncoder fixes [spark] - posted by "chris-twiner (via GitHub)" <gi...@apache.org> on 2025/02/20 15:39:04 UTC, 40 replies.
- [PR] [SQL] Fix SQL Script execution for empty result [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2025/02/20 16:01:19 UTC, 7 replies.
- [PR] [SPARK-51270][SQL] Support UUID type in Variant [spark] - posted by "cashmand (via GitHub)" <gi...@apache.org> on 2025/02/20 16:03:54 UTC, 9 replies.
- [PR] [SPARK-50785][SQL] Refactor FOR statement to utilize local variables properly. [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2025/02/20 16:41:06 UTC, 13 replies.
- Re: [PR] [SPARK-47208][DOCS][FOLLOWUP] Replace `spark.driver.minMemoryOverhead` with `spark.executor.minMemoryOverhead` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/20 16:45:33 UTC, 0 replies.
- [PR] [SPARK-49912] Refactor simple CASE statement to evaluate the case variable only once [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2025/02/20 18:54:44 UTC, 11 replies.
- [PR] [SPARK-51222][SQL][FOLLOW-UP] Optimize ReplaceCurrentLike [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/02/20 19:50:20 UTC, 4 replies.
- Re: [PR] [SPARK-51092][SS] Skip the v1 FlatMapGroupsWithState tests with timeout on big endian platforms [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/02/20 22:11:37 UTC, 2 replies.
- Re: [PR] [SPARK-51016][SQL] Fix for incorrect results on retry for Left Outer Join with indeterministic join keys [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2025/02/20 23:04:22 UTC, 4 replies.
- [PR] [SPARK-51252] [SS] Add instance metrics for last uploaded snapshot version in HDFS State Stores [spark] - posted by "zecookiez (via GitHub)" <gi...@apache.org> on 2025/02/20 23:12:14 UTC, 11 replies.
- [PR] [SPARK-51273][SQL] Spark Connect Call Procedure runs the procedure twice [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/02/20 23:58:38 UTC, 17 replies.
- Re: [PR] [SPARK-50357][Core]If a stage contains ExpandExec, the CoalesceShuffl… [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/21 00:24:53 UTC, 1 replies.
- Re: [PR] [SPARK-50272][SQL] Merge options of table and relation in FallBackFileSourceV2 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/21 00:24:55 UTC, 1 replies.
- Re: [PR] [SPARK-50160][SQL][KAFKA] KafkaWriteTask: allow customizing record timestamp [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/21 00:24:56 UTC, 1 replies.
- Re: [PR] [SPARK-50110][SQL] Fix read csv fails when data contains spaces before and after [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/21 00:24:57 UTC, 1 replies.
- Re: [PR] [SPARK-49008][PYTHON] Use `ParamSpec` to propagate `func` signature in `transform` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/21 00:24:59 UTC, 1 replies.
- [PR] [SPARK-51274][PYTHON] PySparkLogger should respect the expected keyword arguments [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/02/21 00:30:37 UTC, 2 replies.
- [PR] SPARK-51272. Fix for the race condition in Scheduler causing failure … [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2025/02/21 00:50:10 UTC, 1 replies.
- Re: [PR] [SPARK-50864][TESTS] Disable slow tests [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/02/21 01:14:03 UTC, 1 replies.
- [PR] [SPARK-48516][PYTHON][FOLLOW-UP] Add a note in migration guide about Arrow-optimized Python UDF enabled by default [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/21 03:21:54 UTC, 4 replies.
- [PR] [SPARK-51275][PYTHON][ML][CONNECT] Session propagation in python readwrite [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/21 03:53:00 UTC, 5 replies.
- [PR] [SPARK-51276][PYTHON] Enable spark.sql.execution.arrow.pyspark.enabled by default [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/21 05:06:46 UTC, 3 replies.
- [PR] [SPARK-51265][SQL] IncrementalExecution should set the command execution code correctly [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/02/21 05:26:46 UTC, 7 replies.
- [PR] [SPARK-51278][PYTHON] Use appropriate structure of JSON format for `PySparkLogger` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2025/02/21 07:00:17 UTC, 8 replies.
- Re: [PR] [SPARK-49872][CORE] allow unlimited json size again [spark] - posted by "arunaru-te (via GitHub)" <gi...@apache.org> on 2025/02/21 07:28:17 UTC, 0 replies.
- [PR] [SPARK-51279][CONNECT] Avoid constant sleep for waiting Spark Connect server in Scala [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/21 08:13:27 UTC, 4 replies.
- [PR] [SPARK-51281][SQL] DataFrameWriterV2 should respect the path option [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/02/21 08:47:58 UTC, 22 replies.
- [PR] [SPARK-51282][ML][CONNECT] Optimize OneVsRestModel transform by eliminating the JVM-Python data exchange [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/21 09:10:47 UTC, 0 replies.
- [PR] add link [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2025/02/21 09:19:58 UTC, 0 replies.
- [PR] [SPARK-51283][SQL] Add test cases for LZ4 and SNAPPY for text [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/21 09:48:03 UTC, 1 replies.
- Re: [PR] [SPARK-51284][SQL] Fix SQL Script execution for empty result [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2025/02/21 09:50:46 UTC, 2 replies.
- Re: [PR] [SPARK-51282][ML][PYTHON][CONNECT] Optimize OneVsRestModel transform by eliminating the JVM-Python data exchange [spark] - posted by "srowen (via GitHub)" <gi...@apache.org> on 2025/02/21 11:07:39 UTC, 7 replies.
- Re: [PR] [SPARK-51288] Add link for Scala API of Spark Connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/21 11:21:16 UTC, 0 replies.
- Re: [PR] [SPARK-51283][SQL][TESTS] Add test cases for LZ4 and SNAPPY for text [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/21 16:10:19 UTC, 2 replies.
- [PR] [SPARK-51290][SQL] Enable filling default values in DSv2 writes [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2025/02/21 18:53:53 UTC, 16 replies.
- Re: [PR] [SPARK-11077] [SQL] Join elimination in Catalyst [spark] - posted by "jzhuge (via GitHub)" <gi...@apache.org> on 2025/02/21 21:52:38 UTC, 0 replies.
- Re: [PR] [SPARK-49992][SQL] Session level collation should not impact DDL queries [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/22 00:23:48 UTC, 1 replies.
- [PR] [SPARK-51291] [WIP] Reclassify validation errors thrown from state store loading [spark] - posted by "liviazhu-db (via GitHub)" <gi...@apache.org> on 2025/02/22 00:34:59 UTC, 0 replies.
- [PR] [SPARK-51258][SQL][FOLLOWUP] Remove unnecessary inheritance from SQLConfHelper [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/22 04:21:37 UTC, 3 replies.
- [PR] [SPARK-51292][SQL] Remove unnecessary inheritance from PlanTestBase, ExpressionEvalHelper and PlanTest [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/22 07:51:23 UTC, 3 replies.
- Re: [PR] [SPARK-49941][CORE] Rename `errorClass` to `condition` in errors of the JSON format [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/22 09:47:46 UTC, 1 replies.
- [PR] [MINOR][DOCS] Fixed the scope of the query option in sql-data-sources-jdbc.md [spark] - posted by "llphxd (via GitHub)" <gi...@apache.org> on 2025/02/22 11:17:01 UTC, 6 replies.
- [PR] [SPARK-51293][TESTS] Cleanup unused private functions from test suites [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/02/22 11:29:38 UTC, 0 replies.
- [PR] [SPARK-51294][CONNECT] Improve the readability by split the variable of jars and configs for SparkConnectServerUtils. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/22 13:55:45 UTC, 0 replies.
- [PR] [SPARK-51296][SQL] Support collecting corrupt data in singleVariantColumn mode [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2025/02/22 23:49:46 UTC, 0 replies.
- Re: [PR] [SPARK-50292] Add MapStatus RowCount optimize skewed job [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/23 00:26:56 UTC, 1 replies.
- Re: [PR] [SPARK-47094][SQL] SPJ : Dynamically rebalance number of buckets when they are not equal [spark] - posted by "rekbun (via GitHub)" <gi...@apache.org> on 2025/02/23 01:10:58 UTC, 1 replies.
- Re: [PR] [SPARK-51294][SQL][CONNECT] Improve the readability by split the variable of jars and configs for SparkConnectServerUtils. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/23 03:01:22 UTC, 0 replies.
- Re: [PR] [SPARK-51272][CORE]. Fix for the race condition in Scheduler causing failure in retrying all partitions in case of indeterministic shuffle keys [spark] - posted by "sririshindra (via GitHub)" <gi...@apache.org> on 2025/02/23 03:45:20 UTC, 1 replies.
- Re: [PR] [SPARK-51293][CORE][SQL][SS][MLLIB][TESTS] Cleanup unused private functions from test suites [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/23 03:55:06 UTC, 9 replies.
- Re: [PR] [SPARK-48899][K8S] Fix `ENV` key value format in K8s Dockerfiles [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/23 06:55:19 UTC, 0 replies.
- [PR] [SPARK-51298][WIP] Support variant in CSV scan [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2025/02/23 22:56:21 UTC, 2 replies.
- [PR] [DRAFT] Resolve default string exprs [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2025/02/23 23:14:25 UTC, 1 replies.
- Re: [PR] [DRAFT] Two string types [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/24 00:26:01 UTC, 1 replies.
- Re: [PR] [SPARK-50319] Reorder ResolveIdentifierClause and BindParameter rules [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/24 00:26:01 UTC, 1 replies.
- [PR] [MINOR][DOCS] Clarify spark.remote and spark.master in pyspark-connect and pyspark-client at install.rst [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/24 01:10:21 UTC, 6 replies.
- Re: [PR] [SPARK-51294][SQL][CONNECT][TESTS] Improve the readability by split the variable of jars and configs for SparkConnectServerUtils. [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/24 01:33:10 UTC, 2 replies.
- [PR] [WIP][SPARK-51299][SQL][Web UI] Filter out invalid metric values with initValue [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2025/02/24 03:00:17 UTC, 0 replies.
- Re: [PR] [SPARK-51297][DOCS] Fixed the scope of the query option in sql-data-sources-jdbc.md [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/24 03:57:23 UTC, 1 replies.
- Re: [PR] [SPARK-51299][SQL][UI] MetricUtils.stringValue should filter metric values with initValue rather than a hardcoded value [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2025/02/24 05:02:50 UTC, 3 replies.
- [PR] [SPARK-51300][PS][DOCS] Fix broken link for `ps.sql` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2025/02/24 06:21:25 UTC, 2 replies.
- [PR] [SPARK-51301][BUILD] Bump zstd-jni 1.5.7-1 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/02/24 06:53:44 UTC, 12 replies.
- [PR] [DO-NOT-MERGE] Debug Build / Spark Connect Python-only (master, Python 3.11) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/24 08:05:44 UTC, 0 replies.
- [PR] [WIP][SPARK-51302][CONNECT] Spark Connect supports JDBC should use the DataFrameReader API [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/24 08:11:56 UTC, 0 replies.
- [PR] Add rpad and lpad support for PostgreDialect and MsSQLServerDialect [spark] - posted by "milosstojanovic (via GitHub)" <gi...@apache.org> on 2025/02/24 09:39:05 UTC, 2 replies.
- [PR] [MINOR][TESTS] Fix test errors caused by improper DROP TABLE/VIEW in describe.sql [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/02/24 09:52:23 UTC, 0 replies.
- [PR] [SPARK-51304][DOCS][PYTHON] Use `getCondition` instead of `getErrorClass` in contribution guide [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2025/02/24 10:06:28 UTC, 3 replies.
- Re: [PR] [DRAFT] Resolve default string producing expressions [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2025/02/24 10:25:57 UTC, 0 replies.
- [PR] [SPARK-50098][PYTHON][FOLLOW-UP] Update _minimum_googleapis_common_protos_version in setup.py for pyspark-client [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/24 10:48:05 UTC, 2 replies.
- [PR] [SPARK-50015][PYTHON][FOLLOW-UP] Update _minimum_grpc_version in setup.py for pyspark-client [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/24 10:51:18 UTC, 2 replies.
- [PR] [SPARK-50795][SQL][FOLLOWUP] Set isParsing to false for the timestamp formatter in DESCRIBE AS JSON [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/02/24 11:18:23 UTC, 3 replies.
- Re: [PR] [SPARK-51302][CONNECT] Spark Connect supports JDBC should use the DataFrameReader API [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/24 11:18:32 UTC, 5 replies.
- [PR] [SPARK-51305][CONNECT] Improve the code for createObservedMetricsResponse [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/24 11:48:05 UTC, 0 replies.
- Re: [PR] [WIP][SQL] Add rpad and lpad support for PostgresDialect and MsSQLServerDialect expression pushdown [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/24 12:10:42 UTC, 0 replies.
- [PR] [SPARK-51078][SPARK-50963][ML][PYTHON][CONNECT][TESTS][FOLLOW-UP] Add back tests for default value [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/24 12:11:54 UTC, 2 replies.
- [PR] [SPARK-50692] Add the LPAD and RPAD pushdown support for H2 [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/24 13:26:54 UTC, 0 replies.
- [PR] [SPARK-51303] [SQL] [TESTS] Extend `ORDER BY` testing coverage [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2025/02/24 13:53:23 UTC, 23 replies.
- Re: [PR] [SPARK-51156][CONNECT][FOLLOWUP] Remove unused `private val AUTH_TOKEN_ON_INSECURE_CONN_ERROR_MSG` from `SparkConnectClient` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/02/24 16:21:47 UTC, 2 replies.
- Re: [PR] [SPARK-51221][CONNECT][TESTS] Use unresolvable host name in SparkConnectClientSuite [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2025/02/24 16:47:44 UTC, 2 replies.
- Re: [PR] [SPARK-51305][SQL][CONNECT] Improve `SparkConnectPlanExecution.createObservedMetricsResponse` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/24 17:19:32 UTC, 2 replies.
- Re: [PR] [SPARK-50692][SQL] Add the LPAD and RPAD pushdown support for H2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/24 17:32:29 UTC, 0 replies.
- Re: [PR] [SPARK-50692][SQL][FOLLOWUP] Add the LPAD and RPAD pushdown support for H2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/24 17:35:05 UTC, 3 replies.
- [PR] [SPARK-51099][PYTHON][FOLLOWUP] Avoid logging when selector.select returns 0 without waiting the configured timeout [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/02/24 20:19:08 UTC, 2 replies.
- [PR] [SPARK-51099][PYTHON][FOLLOWUP][4.0] Avoid logging when selector.select returns 0 without waiting the configured timeout [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/02/24 20:30:27 UTC, 2 replies.
- Re: [PR] [SPARK-50914][PYTHON][CONNECT] Match GRPC dependencies for Python-only master scheduled job [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/25 00:11:29 UTC, 3 replies.
- Re: [PR] [SPARK-51306][TESTS] Fix test errors caused by improper DROP TABLE/VIEW in describe.sql [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/02/25 01:59:45 UTC, 2 replies.
- [PR] [SPARK-51289][SQL] Throw a proper error message for not fully implemented `SQLTableFunction` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2025/02/25 02:28:51 UTC, 5 replies.
- [PR] [SPARK-51307][SQL] locationUri in CatalogStorageFormat shall be decoded for display [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/02/25 03:11:59 UTC, 8 replies.
- [PR] [SPARK-51308][CONNECT][BUILD] Update the relocation rules for the `connect` module in `SparkBuild.scala` to ensure that both Maven and SBT produce the assembly JAR according to the same rules [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2025/02/25 05:58:38 UTC, 3 replies.
- [PR] [SPARK-51309][BUILD] Upgrade rocksdbjni to 9.10.0 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2025/02/25 06:43:34 UTC, 3 replies.
- [PR] [SPARK-51311][BUILD] Promote bcprov-jdk18on to compile scope [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/02/25 09:53:20 UTC, 9 replies.
- [PR] SPARK-34616 requireDbExists is called too many times [spark] - posted by "sohurdc (via GitHub)" <gi...@apache.org> on 2025/02/25 09:56:40 UTC, 0 replies.
- [PR] [SPARK-51312][SQL] Fix createDataFrame from RDD[Row] [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2025/02/25 10:10:24 UTC, 8 replies.
- Re: [PR] [SPARK-51310][SQL] Resolve the type of default string producing expressions [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2025/02/25 11:27:13 UTC, 7 replies.
- [PR] [DO-NOT-MERGE] Allow Arrow batches in bytes instead of number of rows [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/25 12:39:55 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-51308][CONNECT][BUILD] Update the relocation rules for the `connect` module in `SparkBuild.scala` to ensure that both Maven and SBT produce the assembly JAR according to the same rules [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2025/02/25 15:37:40 UTC, 1 replies.
- [PR] [SPARK-51313][PYTHON] Fix timestamp format for PySparkLogger [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/02/26 00:16:44 UTC, 2 replies.
- [PR] [SPARK-51315][SQL] Enabling object level collations by default [spark] - posted by "dejankrak-db (via GitHub)" <gi...@apache.org> on 2025/02/26 02:05:20 UTC, 7 replies.
- [PR] [SPARK-51317][PYTHON] Require pandas as well for Arrow-optimized Python UDF [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/26 03:44:54 UTC, 2 replies.
- [PR] [SPARK-51277][PYTHON] Implement 0-arg implementation in Arrow-optimized Python UDF [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/26 04:52:49 UTC, 3 replies.
- [PR] [SPARK-50759][SQL] Deprecate a few legacy Catalog APIs [spark] - posted by "drexler-sky (via GitHub)" <gi...@apache.org> on 2025/02/26 05:43:11 UTC, 0 replies.
- Re: [PR] [SPARK-51316][PYTHON] Allow Arrow batches in bytes instead of number of rows [spark] - posted by "dbtsai (via GitHub)" <gi...@apache.org> on 2025/02/26 07:03:28 UTC, 16 replies.
- [PR] [SPARK-51314][DOCS][PS] Add proper note for distributed-sequence about indeterministic case [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2025/02/26 08:02:50 UTC, 5 replies.
- Re: [PR] [SPARK-51321][SQL] Add rpad and lpad support for PostgresDialect and MsSQLServerDialect expression pushdown [spark] - posted by "milosstojanovic (via GitHub)" <gi...@apache.org> on 2025/02/26 11:03:45 UTC, 1 replies.
- [PR] [SPARK-50792][SQL][FOLLOWUP] Test case should reuse the exists table. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/26 11:08:41 UTC, 2 replies.
- [PR] [SPARK-51322][SQL] Better error message for streaming subquery expression [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/02/26 12:07:56 UTC, 5 replies.
- [PR] [] Duplicate "total" on Py SQL metrics [spark] - posted by "sebastianhillig-db (via GitHub)" <gi...@apache.org> on 2025/02/26 12:31:10 UTC, 0 replies.
- [PR] [SPARK-51324][SQL] Fix nested FOR statement throwing error if empty result [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2025/02/26 12:48:56 UTC, 5 replies.
- [PR] [SPARK-51280][CONNECT] Improve RESPONSE_ALREADY_RECEIVED error class [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2025/02/26 12:57:41 UTC, 3 replies.
- [PR] [SPARK-51325] Check in source code for `smallJar.jar` [spark] - posted by "vicennial (via GitHub)" <gi...@apache.org> on 2025/02/26 19:02:15 UTC, 4 replies.
- Re: [PR] [SPARK-51323] Duplicate "total" on Py SQL metrics [spark] - posted by "the-sakthi (via GitHub)" <gi...@apache.org> on 2025/02/26 20:33:51 UTC, 0 replies.
- [PR] [SPARK-51326][CONNECT] Remove LazyExpression proto message [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/02/26 22:33:15 UTC, 4 replies.
- [PR] [SPARK-51326][CONNECT][4.0] Remove LazyExpression proto message [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2025/02/27 00:17:23 UTC, 3 replies.
- Re: [PR] Dev/milast/recurisve cte [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/27 00:25:06 UTC, 1 replies.
- [PR] [SPARK-51329][ML][PYTHON] Add `numFeatures` for clustering models [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/27 02:10:37 UTC, 2 replies.
- [PR] [SPARK-51330][PYTHON] Enable spark.sql.execution.pythonUDTF.arrow.enabled by default [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/27 02:26:50 UTC, 2 replies.
- [PR] [SPARK-51332][SQL] DS V2 supports push down BIT_AND, BIT_OR, BIT_XOR, BIT_COUNT and BIT_GET [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/27 03:33:27 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-51271][PYTHON] Add filter pushdown API to Python Data Sources [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2025/02/27 04:05:56 UTC, 14 replies.
- Re: [PR] [SPARK-50792][SQL][TESTS][FOLLOWUP] Test case should reuse the exists table [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/02/27 04:19:28 UTC, 2 replies.
- [PR] [SPARK-51333][ML][PYTHON][CONNECT] Unwrap `InvocationTargetException` thrown by `invokeMethod` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/27 04:34:34 UTC, 6 replies.
- [PR] [SPARK-44856][PYTHON] Improve Python UDTF arrow serializer performance [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/27 05:13:38 UTC, 0 replies.
- Re: [PR] [SPARK-51323][PYTHON] Duplicate "total" on Py SQL metrics [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/27 06:56:02 UTC, 1 replies.
- [PR] [SPARK-51278][FOLLOWUP][DOCS] Update JSON format from documentation [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2025/02/27 07:09:50 UTC, 3 replies.
- [PR] [SPARK-49756][SQL][FOLLOWUP] Use correct pgsql datetime fields when pushing down EXTRACT [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/02/27 09:23:37 UTC, 12 replies.
- [PR] [SPARK-51335] Publish Apache Spark 3.5.5 to docker registry [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/27 10:10:19 UTC, 8 replies.
- [PR] [SPARK-51336] Upgrade `upload-artifact` to v4 in `spark-docker` repository [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/27 10:14:24 UTC, 3 replies.
- [PR] Add java/scala version in response [spark] - posted by "garlandz-db (via GitHub)" <gi...@apache.org> on 2025/02/27 10:52:24 UTC, 0 replies.
- [PR] [WIP][SQL] Add `TimeType` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/02/27 11:09:43 UTC, 0 replies.
- [PR] [SPARK-51337][SQL] Add maxRows to CTERelationRef [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/02/27 11:20:51 UTC, 0 replies.
- [PR] [SPARK-51339] Remove `IllegalImportsChecker` for `scala.collection.Seq/IndexedSeq` from `scalastyle-config.xml` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/02/27 11:55:14 UTC, 0 replies.
- [PR] [SPARK-51340][ML][CONNECT] Model size estimation for linear classification & regression models [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2025/02/27 11:57:59 UTC, 0 replies.
- [PR] [SPARK-51341][SQL] Cancel time task with suitable way. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/27 13:41:50 UTC, 0 replies.
- Re: [PR] [SPARK-51341][CORE] Cancel time task with suitable way. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/27 14:04:05 UTC, 4 replies.
- Re: [PR] [SPARK-51342][SQL] Add `TimeType` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2025/02/27 17:00:23 UTC, 3 replies.
- [PR] [SPARK-51344] Fix `ENV` key value format in `*.template` [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/27 21:21:48 UTC, 2 replies.
- Re: [PR] [SPARK-51339][BUILD] Remove `IllegalImportsChecker` for `s.c.Seq/IndexedSeq` from `scalastyle-config.xml` [spark] - posted by "the-sakthi (via GitHub)" <gi...@apache.org> on 2025/02/27 21:24:44 UTC, 3 replies.
- [PR] [SPARK-51345] Remove all EOL versions from `spark-docker` repository [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/27 21:56:26 UTC, 4 replies.
- Re: [PR] [SPARK-51334] Add java/scala version in analyze spark_version response [spark] - posted by "the-sakthi (via GitHub)" <gi...@apache.org> on 2025/02/27 21:58:10 UTC, 0 replies.
- Re: [PR] [SPARK-51288][DOCS] Add link for Scala API of Spark Connect [spark] - posted by "the-sakthi (via GitHub)" <gi...@apache.org> on 2025/02/27 22:14:54 UTC, 0 replies.
- [I] Context cancel doesn't work [spark-connect-go] - posted by "curtisr7 (via GitHub)" <gi...@apache.org> on 2025/02/27 23:08:12 UTC, 0 replies.
- [PR] [SPARK-51347] Enable Ingress and Service Support for Spark Driver [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2025/02/28 00:48:51 UTC, 4 replies.
- Re: [PR] [SPARK-51337][SQL] Add maxRows to CTERelationDef and CTERelationRef [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2025/02/28 01:06:17 UTC, 1 replies.
- [PR] [SPARK-51349] Change precedence of null and "null" in sorting in QueryTest [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2025/02/28 01:18:25 UTC, 2 replies.
- [PR] [SPARK-51350][SQL] Implement Show Procedures [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2025/02/28 01:39:17 UTC, 0 replies.
- [PR] [SPARK-51351][SS] Do not materialize the output in Python worker for TWS [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2025/02/28 02:24:40 UTC, 7 replies.
- [PR] [SPARK-51352] Use Spark 3.5.5 in E2E tests [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2025/02/28 05:39:38 UTC, 2 replies.
- [PR] [SPARK-51316][PYTHON][FOLLOW-UP] Revert unrelated changes and mark mapInPandas/mapInArrow batched in byte size [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/28 07:32:03 UTC, 2 replies.
- [PR] [WIP][SPARK-49488][SQL][FOLLOWUP] Use correct mysql datetime fields when pushing down EXTRACT [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2025/02/28 07:59:56 UTC, 0 replies.
- Re: [PR] [SPARK-51334][CONNECT] Add java/scala version in analyze spark_version response [spark] - posted by "garlandz-db (via GitHub)" <gi...@apache.org> on 2025/02/28 08:43:39 UTC, 0 replies.
- [PR] [SPARK-51354][K8S][TEST][DOC] Fix sbt K8s integration test arg javaImageTag [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/02/28 09:08:51 UTC, 4 replies.
- [PR] [SPARK-51353][INFRA][BUILD]Retry dyn/closer.lua for mvn before falling back to archive.a.o [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2025/02/28 09:17:25 UTC, 0 replies.
- [PR] [BUILD] Test slf4j 2.0.17 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2025/02/28 10:00:07 UTC, 0 replies.
- [PR] [MINOR][DOCS] Fix code comments for Executor [spark] - posted by "tomscut (via GitHub)" <gi...@apache.org> on 2025/02/28 10:34:30 UTC, 0 replies.
- [PR] [SPARK-51355][DOCS] Add a brief explanation for Spark Connect at PySpark Overview page [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/28 10:35:58 UTC, 0 replies.
- Re: [PR] [SPARK-50714][SQL][SS] Enable schema evolution for TransformWithState when Avro encoding is used [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2025/02/28 11:22:48 UTC, 1 replies.
- [PR] [SPARK-51357][SQL] Preserve plan change logging level for views [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2025/02/28 16:10:53 UTC, 1 replies.
- [PR] [WIP] Removing extra copy for the changelog replay [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2025/02/28 23:17:24 UTC, 0 replies.