reviews@spark.apache.org, 2024-12

You are viewing a plain text version of this content. The canonical link for it is here.

- Re: [PR] [SPARK-44473][SQL] [BUG] Overwriting the same partition of a partitioned table multiple times with empty data yields non-idempotent results [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/01 00:31:45 UTC, 0 replies.
- Re: [PR] [SPARK-50032][SQL] Allow use of fully qualified collation name [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/12/01 15:02:09 UTC, 1 replies.
- Re: [PR] [MINOR] Use putAll to populate Properties [spark] - posted by "tedyu (via GitHub)" <gi...@apache.org> on 2024/12/01 16:37:33 UTC, 2 replies.
- Re: [PR] [SPARK-48148][FOLLOWUP] Fix JSON parser feature flag. [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/01 23:37:29 UTC, 1 replies.
- Re: [PR] [SPARK-50240][CORE] Added Simple Sanitization of Extra JVM Options [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/01 23:38:11 UTC, 15 replies.
- Re: [PR] [SPARK-50436][PYTHON][TESTS] Use assertDataFrameEqual in pyspark.sql.tests.test_udf [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/01 23:42:02 UTC, 2 replies.
- [PR] [SPARK-50463][SQL] FIx ConstantColumnVector with Columnar to Row conversion [spark] - posted by "richardc-db (via GitHub)" <gi...@apache.org> on 2024/12/02 00:03:43 UTC, 0 replies.
- Re: [PR] [SPARK-50463][SQL] Fix ConstantColumnVector with Columnar to Row conversion [spark] - posted by "richardc-db (via GitHub)" <gi...@apache.org> on 2024/12/02 00:21:45 UTC, 8 replies.
- [PR] [WIP][SPARK-50464] Support unsigned integer for Arrow [spark] - posted by "chenkovsky (via GitHub)" <gi...@apache.org> on 2024/12/02 00:37:12 UTC, 0 replies.
- Re: [PR] [SPARK-50435][PYTHON][TESTS] Use assertDataFrameEqual in pyspark.sql.tests.test_functions [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/12/02 01:59:22 UTC, 1 replies.
- [PR] [SPARK-50465][PYTHON][TESTS] Use assertDataFrameEqual in pyspark.sql.tests.test_group and test_readwriter [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/12/02 02:16:18 UTC, 3 replies.
- Re: [PR] [SPARK-46934][SQL][FOLLOWUP] Read/write roundtrip for struct type with special characters with HMS - a backward compatible approach [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/12/02 02:21:04 UTC, 18 replies.
- [PR] [WIP][PYTHON] Add `__all__` for builtin function [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/02 02:44:28 UTC, 0 replies.
- [PR] [SPARK-50466][PYTHON] Refine the docstring for string functions - part 1 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/02 02:47:16 UTC, 2 replies.
- Re: [PR] [SPARK-49294][UI] Add width attribute for shuffle-write-time checkbox. [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/12/02 03:03:19 UTC, 5 replies.
- Re: [PR] [SPARK-50437][SS] Reduce overhead of creating deserializers in TransformWithStateExec [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2024/12/02 03:33:45 UTC, 0 replies.
- [PR] [WIP][SPARK-xxxx][Collation] Guard collation regex expressions behind a flag [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2024/12/02 08:20:32 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-50454][SQL] Replace assertEqual with assertDataFrameEqual in pyspark.sql.tests.test_functions [spark] - posted by "karim-ramadan (via GitHub)" <gi...@apache.org> on 2024/12/02 09:33:38 UTC, 0 replies.
- Re: [PR] [SPARK-50405][SQL] Handle collation type coercion of complex data types properly [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/12/02 09:45:57 UTC, 9 replies.
- Re: [PR] [SPARK-50338][CORE] Make LazyTry exceptions less verbose [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2024/12/02 09:50:23 UTC, 13 replies.
- Re: [PR] [SPARK-50417] Make number of FallbackStorage sub-directories configurable [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/12/02 11:07:27 UTC, 3 replies.
- [PR] [SPARK-50469][SQL] V1Writes should respect the output ordering [spark] - posted by "wecharyu (via GitHub)" <gi...@apache.org> on 2024/12/02 11:09:40 UTC, 16 replies.
- Re: [PR] [SPARK-49670][SQL] Enable trim collation for all passthrough expressions [spark] - posted by "jovanpavl-db (via GitHub)" <gi...@apache.org> on 2024/12/02 12:17:56 UTC, 2 replies.
- [PR] [SPARK-50471][PYTHON] Support Arrow-based Python Data Source Writer [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/12/02 12:29:55 UTC, 3 replies.
- Re: [PR] [SPARK-50468][BUILD] Upgrade Guava to 33.3.1-jre [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/02 12:39:37 UTC, 3 replies.
- Re: [PR] [WIP][SPARK-50357][PYTHON] Support Interrupt(Tag|All) APIs for PySpark [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/12/02 14:03:09 UTC, 2 replies.
- Re: [PR] [SPARK-49883][SS] State Store Checkpoint Structure V2 Integration with RocksDB and RocksDBFileManager [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/12/02 14:13:20 UTC, 57 replies.
- Re: [PR] [SPARK-47573][K8S] Support custom driver log url [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/12/02 14:19:02 UTC, 4 replies.
- [PR] [SPARK-50472][SQL] Introduce initial implementation of the single-pass Analyzer [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/12/02 14:51:01 UTC, 41 replies.
- [PR] [SPARK-50470] Block usage of collations for map keys [spark] - posted by "Alexvsalexvsalex (via GitHub)" <gi...@apache.org> on 2024/12/02 15:27:47 UTC, 0 replies.
- [PR] [SPARK-48898] Fix Variant shredding bug [spark] - posted by "cashmand (via GitHub)" <gi...@apache.org> on 2024/12/02 16:30:14 UTC, 0 replies.
- Re: [PR] [SPARK-50470][Collation] Block usage of collations for map keys [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/12/02 16:50:51 UTC, 1 replies.
- Re: [PR] [SPARK-50421]fix executor related memory config incorrect when multiple resource profile worked [spark] - posted by "tgravescs (via GitHub)" <gi...@apache.org> on 2024/12/02 17:26:23 UTC, 5 replies.
- Re: [PR] [SPARK-50243][SQL][Connect] Cached classloader for ArtifactManager [spark] - posted by "vicennial (via GitHub)" <gi...@apache.org> on 2024/12/02 17:47:35 UTC, 6 replies.
- Re: [PR] [SPARK-50384] Update docs for first-time YuniKorn installation [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/02 18:00:20 UTC, 0 replies.
- Re: [PR] [SPARK-50373] Prohibit Variant from set operations [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/12/02 18:15:24 UTC, 1 replies.
- [PR] [SPARK-47672][SQL] Avoid double eval from filter pushDown w/ projection pushdown [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2024/12/02 18:23:23 UTC, 3 replies.
- [PR] [SPARK-47672][SQL] Avoid double eval from filter pushDown [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2024/12/02 18:26:19 UTC, 0 replies.
- [PR] [WIP][CORE][SPARK-49788] Add optional TTL based cleaning for blocks to better support notebooks [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2024/12/02 18:30:33 UTC, 0 replies.
- Re: [PR] [SPARK-48821][SQL] Support `Update` in `DataFrameWriterV2` [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2024/12/02 18:35:11 UTC, 0 replies.
- Re: [PR] [Test Only][BUILD] Upgrade `sbt` to `1.10.6` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/02 19:32:51 UTC, 2 replies.
- Re: [PR] [SPARK-50432][BUILD] Remove workaround for THRIFT-4805 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/02 19:34:57 UTC, 0 replies.
- Re: [PR] [SPARK-50433][DOCS][TESTS] Fix confguring log4j2 guide docs for Spark on YARN and UT [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/02 19:37:11 UTC, 3 replies.
- Re: [PR] [SPARK-50452][BUILD] Upgrade jackson to 2.18.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/02 19:38:35 UTC, 0 replies.
- Re: [PR] [SPARK-50263][CONNECT] Replace `System.currentTimeMillis` with `System.nanoTime` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/02 19:52:59 UTC, 5 replies.
- Re: [PR] [SPARK-50424][INFRA] Extract the common content of `Dockerfile` from `Docs`, `Linter`, and `SparkR` test images [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/02 19:54:49 UTC, 1 replies.
- Re: [PR] [WIP] Fixing maven build for Guava dependency [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/12/02 22:06:15 UTC, 0 replies.
- [PR] [SPARK-50132][SQL][PYTHON] Add DataFrame API for Lateral Joins [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/12/02 22:39:29 UTC, 9 replies.
- Re: [PR] [SPARK-50372][CONNECT][SQL] Make all DF execution path collect observed metrics [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/02 23:21:43 UTC, 1 replies.
- Re: [PR] [SPARK-50458][CORE][SQL] Proper error handling for unsupported file system when reading files [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/02 23:46:42 UTC, 2 replies.
- [PR] [MINOR][INFRA] Add a space in the JIRA user assignment message [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/02 23:51:34 UTC, 2 replies.
- [PR] [SPARK-47993][DOCS][FOLLOWUP] Update RDD programing guide to Python 3.9+ [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/02 23:54:54 UTC, 5 replies.
- Re: [PR] [SPARK-49565][SQL] Add SQL pipe syntax for the FROM operator [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/12/03 00:06:02 UTC, 21 replies.
- [PR] [SPARK-50430][CORE][FOLLOW-UP] Keep the logic of manual putting key and values in Properties [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/03 00:18:20 UTC, 8 replies.
- Re: [PR] [SPARK-47482] Add HiveDialect to sql module [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/03 00:27:17 UTC, 1 replies.
- [PR] [SPARK-50343][SQL] Add SQL pipe syntax for the DROP and AS operators [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/12/03 00:56:11 UTC, 9 replies.
- Re: [PR] [SPARK-50446][PYTHON] Concurrent level in Arrow-optimized Python UDF [spark] - posted by "dbtsai (via GitHub)" <gi...@apache.org> on 2024/12/03 01:38:53 UTC, 2 replies.
- [PR] [SPARK-50473][SQL] Simplify classic Column handling [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/12/03 01:45:28 UTC, 2 replies.
- Re: [PR] [SPARK-49436][Connect][SQL] Common interface for SQLContext [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/12/03 02:06:17 UTC, 17 replies.
- Re: [PR] [DO-NOT-MERGE] Support SQL API mode [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/12/03 02:34:50 UTC, 5 replies.
- Re: [PR] [SPARK-49547][SQL][PYTHON] Add iterator of `RecordBatch` API to `applyInArrow` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/03 03:23:44 UTC, 6 replies.
- [PR] log executing jdbc query sql text [spark] - posted by "gabrywu (via GitHub)" <gi...@apache.org> on 2024/12/03 07:06:50 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-50392][PYTHON] Implement partitionBy, orderBy and withSinglePartition of df.argument() in Spark Classic [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/12/03 07:39:05 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-50133][PYTHON] Support df.argument() for conversion to table argument in Spark Classic [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/12/03 07:39:59 UTC, 0 replies.
- Re: [PR] [SPARK-50218][BUILD] Upgrade checkstyle to 10.20.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/03 07:56:43 UTC, 0 replies.
- [PR] [SPARK-50474][BUILD] Upgrade checkstyle to 10.20.2 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/03 08:05:28 UTC, 5 replies.
- [PR] [WIP][SPARK-50460][PYTHON][CONNECT] Generalize and simplify Connect exception handling [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/12/03 09:42:34 UTC, 0 replies.
- [PR] [SPARK-50477][INFRA] Add a separate docker file for python 3.9 daily build [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/03 10:01:38 UTC, 7 replies.
- [PR] [SPARK-50478] Allow upcasting to collated string [spark] - posted by "jovanm-db (via GitHub)" <gi...@apache.org> on 2024/12/03 10:38:40 UTC, 1 replies.
- Re: [PR] [SPARK-50470][SQL] Block usage of collations for map keys [spark] - posted by "Alexvsalexvsalex (via GitHub)" <gi...@apache.org> on 2024/12/03 11:47:31 UTC, 6 replies.
- Re: [PR] [SPARK-50467][PYTHON] Add `__all__` for builtin functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/03 11:55:42 UTC, 1 replies.
- Re: [PR] [SPARK-50421]Fix executor related memory config incorrect when multiple resource profile worked [spark] - posted by "zjuwangg (via GitHub)" <gi...@apache.org> on 2024/12/03 12:59:29 UTC, 3 replies.
- [PR] [DRAFT] Milan dankovic data/exception handlers poc [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2024/12/03 13:41:29 UTC, 0 replies.
- Re: [PR] [DRAFT][SPARK-48344][SQL] Add Frames and Scopes to support Exception Handlers and Local Variables [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2024/12/03 14:18:44 UTC, 0 replies.
- Re: [PR] [SPARK-50404][PYTHON] PySpark DataFrame Pipe Method [spark] - posted by "lucas-nelson-uiuc (via GitHub)" <gi...@apache.org> on 2024/12/03 15:00:02 UTC, 1 replies.
- Re: [PR] [SPARK-48898][SQL] Fix Variant shredding bug [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/12/03 15:07:49 UTC, 1 replies.
- Re: [PR] [SPARK-50425][BUILD] Bump Apache Parquet to 1.15.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/03 16:07:57 UTC, 3 replies.
- Re: [PR] [SPARK-50339][SPARK-50360][SS] Enable changelog to store lineage information [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/12/03 16:29:58 UTC, 11 replies.
- Re: [PR] [SPARK-50433][DOCS][TESTS][3.5] Fix configuring log4j2 guide docs for Spark on YARN and UT [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/03 16:31:34 UTC, 0 replies.
- Re: [PR] [SPARK-50463][SQL] Fix `ConstantColumnVector` with Columnar to Row conversion [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/03 16:37:05 UTC, 3 replies.
- [PR] [SPARK-50481][CORE] Improve `SortShuffleManager.unregisterShuffle` to skip checksum file logic if checksum is disabled [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/03 18:07:48 UTC, 8 replies.
- [PR] [SPARK-50482][CORE] Deprecated no-op `spark.shuffle.spill` config [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/03 18:31:26 UTC, 3 replies.
- Re: [PR] [SPARK-50384] Update docs with YuniKorn 1.6.0 and first-time installation guide [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/03 18:59:24 UTC, 0 replies.
- Re: [PR] [SPARK-47463][SQL] Use V2Predicate to wrap expression with return type of boolean [spark] - posted by "rami-lv (via GitHub)" <gi...@apache.org> on 2024/12/03 19:06:32 UTC, 5 replies.
- Re: [PR] [SPARK-48344][SQL] Add SQL Scripting Execution Framework [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2024/12/03 20:29:27 UTC, 2 replies.
- Re: [PR] [SPARK-48344][SQL] Add Frames and Scopes to support Exception Handlers and Local Variables [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2024/12/03 20:47:44 UTC, 38 replies.
- Re: [PR] [SPARK-49038][SQL] Fix regression in Spark UI SQL operator metrics calculation to filter out invalid accumulator values correctly [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/04 00:26:24 UTC, 1 replies.
- [PR] [SPARK-50484][TESTS][CONNECT][PYTHON] Skip ClassificationTestsOnConnect tests properly if dependences are not found [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/04 01:19:01 UTC, 1 replies.
- Re: [PR] [SPARK-50310][PYTHON] Add a flag to disable DataFrameQueryContext for PySpark [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/04 01:24:14 UTC, 2 replies.
- [PR] [SPARK-50486][PYTHON][DOCS] Refine the docstring for string functions - part 2 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/04 02:32:16 UTC, 2 replies.
- [PR] [SPARK-50485][SQL] Unwrap SparkThrowable in (Unchecked)ExecutionException thrown by tableRelationCache [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/12/04 02:38:25 UTC, 5 replies.
- Re: [PR] [SPARK-49907][ML][CONNECT] Support spark.ml on Connect [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/12/04 04:00:24 UTC, 53 replies.
- [PR] [MINOR][INFRA] Update labeler [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/04 04:52:34 UTC, 3 replies.
- [PR] [SPARK-50487][CORE] Update broken jira link [spark] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2024/12/04 05:11:21 UTC, 0 replies.
- [PR] [DO-NOT-MERGE] Support SQL API mode, prototype 2 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/04 06:10:27 UTC, 3 replies.
- [PR] [SPARK-50310][CONNECT][PYTHON] Call `with_origin_to_class` when the `Column` initializing [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/12/04 06:20:48 UTC, 11 replies.
- Re: [PR] [SPARK-50487][DOCS] Update broken jira link [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/04 07:03:49 UTC, 2 replies.
- Re: [PR] [SPARK-16675][SQL] Avoid per-record type dispatch in JDBC when writing [spark] - posted by "jneira-stratio (via GitHub)" <gi...@apache.org> on 2024/12/04 07:20:56 UTC, 3 replies.
- [PR] [WIP][SPARK-50392][PYTHON] DataFrame conversion to table argument in Spark Classic [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/12/04 08:01:15 UTC, 0 replies.
- [PR] [SPARK-50489][SQL][PYTHON] Fix self-join after `applyInArrow` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/04 09:58:01 UTC, 3 replies.
- [PR] [SPARK-50063] Add support for Variant in the Spark Connect Scala client [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/12/04 09:59:22 UTC, 0 replies.
- [PR] [MINOR][DOCS] Add a migration guide for encode/decode unmappable characters [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/12/04 10:27:33 UTC, 2 replies.
- Re: [PR] [SPARK-50478] Fix StringType matching [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/12/04 10:47:41 UTC, 1 replies.
- [PR] [Only Test] MariaDBDatabaseOnDocker [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/12/04 10:53:11 UTC, 0 replies.
- [PR] Feature/add dict as rowlike [spark] - posted by "VictorAtIfInsurance (via GitHub)" <gi...@apache.org> on 2024/12/04 11:05:52 UTC, 0 replies.
- [PR] [WIP] Fix problem in NestedColumnAliasing.scala , replaceWithAliases in connection with Generate plan node [spark] - posted by "trohwer (via GitHub)" <gi...@apache.org> on 2024/12/04 11:24:09 UTC, 0 replies.
- Re: [PR] [MINOR] Fix some typos [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/12/04 12:54:22 UTC, 2 replies.
- Re: [PR] [SPARK-39854][SQL] replaceWithAliases should keep the original children for Generate [spark] - posted by "trohwer (via GitHub)" <gi...@apache.org> on 2024/12/04 13:40:27 UTC, 0 replies.
- Re: [PR] [SPARK-50449][SQL] Fix SQL Scripting grammar allowing empty bodies for loops, IF and CASE [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/12/04 14:36:36 UTC, 6 replies.
- Re: [PR] [SPARK-49695][SQL] Postgres fix xor push-down [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/12/04 14:42:12 UTC, 7 replies.
- [PR] [SPARK-49709][CONNECT][SQL] Support ConfigEntry in the RuntimeConfig interface [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/12/04 14:55:33 UTC, 4 replies.
- Re: [PR] [SPARK-45891][SQL] Rebuild variant binary from shredded data. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/12/04 16:12:09 UTC, 9 replies.
- [PR] [SPARK-49461][SS][FOLLOWUP] Add compatibility test for new commit log [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/12/04 16:55:37 UTC, 5 replies.
- [PR] [SPARK-50491][SQL] Fix bug where empty BEGIN END blocks throw an error [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2024/12/04 21:32:38 UTC, 9 replies.
- [PR] [SPARK-50492] [SS] Fix java.util.NoSuchElementException when watermark column is dropped after dropDuplicatesWithinWatermark [spark] - posted by "liviazhu-db (via GitHub)" <gi...@apache.org> on 2024/12/04 23:16:08 UTC, 2 replies.
- Re: [PR] [SPARK-49461][SS][TESTS][FOLLOWUP] Add compatibility test for new commit log [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/12/05 00:02:17 UTC, 7 replies.
- Re: [PR] [WIP][SPARK-47227][FOLLOW][DOCS] Building Extensions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/05 00:26:33 UTC, 1 replies.
- [PR] [SPARK-50493][BUILD] Upgrade kubernetes-client to 7.0.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/12/05 00:34:16 UTC, 11 replies.
- Re: [PR] Adding typing for creating a pyspark dataframe from a list of dicts [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/05 01:02:25 UTC, 1 replies.
- [PR] [SPARK-50494][INFRA] Add a separate docker file for python 3.10 daily build [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/05 01:53:17 UTC, 5 replies.
- Re: [PR] [DO-NOT-MERGE] Support SQL API mode, prototype 1 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/05 02:19:06 UTC, 4 replies.
- [PR] [SPARK-50495][K8S][INFRA][DOCS] Upgrade Volcano to 1.10.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/12/05 02:51:14 UTC, 3 replies.
- Re: [PR] [SPARK-50235][SQL] Clean up ColumnVector resource after processing all rows in ColumnarToRowExec [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2024/12/05 03:28:20 UTC, 4 replies.
- Re: [PR] [SPARK-50157][SQL] Using SQLConf provided by SparkSession first. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2024/12/05 05:01:27 UTC, 6 replies.
- [PR] [SPARK-50489][SQL][PYTHON][FOLLOW-UP] Add applyInArrow in `DeduplicateRelations#collectConflictPlans` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/05 08:24:32 UTC, 2 replies.
- [PR] Test pandas with ansi [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/12/05 08:59:00 UTC, 1 replies.
- Re: [PR] [SPARK-49695][3.5][SQL] Postgres fix xor push-down [spark] - posted by "andrej-db (via GitHub)" <gi...@apache.org> on 2024/12/05 09:59:26 UTC, 0 replies.
- [PR] Fix generators [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/12/05 10:19:38 UTC, 0 replies.
- Re: [PR] [SPARK-50497][SQL] Fail queries with proper message if MultiAlias contains non-generator function [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/12/05 10:26:26 UTC, 7 replies.
- Re: [PR] [SPARK-49695][SQL][3.5] Postgres fix xor push-down [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/12/05 10:36:25 UTC, 11 replies.
- [PR] [SPARK-50498][PYTHON] Avoid unnecessary py4j call in `listFunctions` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/05 10:58:04 UTC, 2 replies.
- [PR] [MINOR][PYTHON][TESTS] Group pandas function related tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/05 12:30:19 UTC, 0 replies.
- [PR] [DRAFT] Fix casts on complex types in collation coercion [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/12/05 13:50:57 UTC, 0 replies.
- Re: [PR] [SPARK-49884][SS] State Store Checkpoint Structure V2 Backward compatibility Tests [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/12/05 14:14:24 UTC, 0 replies.
- [PR] add-basepythonrunner-metrics [spark] - posted by "sebastianhillig-db (via GitHub)" <gi...@apache.org> on 2024/12/05 14:17:47 UTC, 0 replies.
- Re: [PR] [SPARK-50421][CORE] Fix executor related memory config incorrect when multiple resource profiles worked [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/05 16:26:01 UTC, 8 replies.
- [PR] [SPARK-50501][BUILD] Update cross-spawn to surpress a warning in lint [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2024/12/05 17:50:46 UTC, 1 replies.
- Re: [PR] [SPARK-50492] [SS] Fix java.util.NoSuchElementException when event time column is dropped after dropDuplicatesWithinWatermark [spark] - posted by "liviazhu-db (via GitHub)" <gi...@apache.org> on 2024/12/05 17:59:21 UTC, 0 replies.
- Re: [PR] [SPARK-50343][SPARK-50344][SQL] Add SQL pipe syntax for the DROP and AS operators [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/05 18:19:09 UTC, 3 replies.
- Re: [PR] [SPARK-50416][CORE] A more portable terminal / pipe test needed for bin/load-spark-env.sh [spark] - posted by "philwalk (via GitHub)" <gi...@apache.org> on 2024/12/05 18:29:35 UTC, 0 replies.
- [PR] SPARK-50502: Support pushing DeserializeToObject through union [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2024/12/05 20:36:39 UTC, 0 replies.
- Re: [PR] Draft timer [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/12/05 20:57:09 UTC, 2 replies.
- Re: [PR] Schema id avro [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/12/05 20:57:19 UTC, 0 replies.
- Re: [PR] [SPARK-50418][SQL] Allow an optional trailing comma at the end of SELECT lists [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/12/05 20:57:55 UTC, 1 replies.
- [PR] [SPARK-50504][SQL] Enable SQL pipe syntax by default [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/12/05 21:08:05 UTC, 13 replies.
- [PR] [SPARK-50503] Prohibit partitioning by Variant data [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/12/05 21:08:18 UTC, 6 replies.
- [PR] [SPARK-50505][DOCS] Fix `spark.storage.replication.proactive` default value documentation [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/05 21:46:19 UTC, 5 replies.
- Re: [PR] [SPARK-49828][SQL] Expose ColumnNode to/from Expression utils as developer APIs [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2024/12/05 22:32:56 UTC, 0 replies.
- [PR] [SPARK-50506][DOCS] Codify Spark Standalone documentation consistently [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/05 22:41:46 UTC, 7 replies.
- Re: [PR] [SPARK-50460][PYTHON][CONNECT] Generalize and simplify Connect exception handling [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/12/06 01:18:34 UTC, 4 replies.
- Re: [PR] [SPARK-50507][PYTHON][TESTS] Group pandas function related tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/06 01:33:22 UTC, 1 replies.
- Re: [PR] [SPARK-46912] Use worker JAVA_HOME and SPARK_HOME instead of from submitter [spark] - posted by "jywjyw (via GitHub)" <gi...@apache.org> on 2024/12/06 01:50:48 UTC, 1 replies.
- Re: [PR] [SPARK-50492][SS] Fix java.util.NoSuchElementException when event time column is dropped after dropDuplicatesWithinWatermark [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/12/06 02:27:32 UTC, 3 replies.
- [PR] [SPARK-50134][SPARK-50132][SQL][CONNECT][PYTHON] Support DataFrame API for Lateral Join in Spark Connect [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/12/06 02:32:28 UTC, 6 replies.
- Re: [PR] [SPARK-50063][SQL][CONNECT] Add support for Variant in the Spark Connect Scala client [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/12/06 02:55:28 UTC, 4 replies.
- [PR] Table and view level collations support [spark] - posted by "dejankrak-db (via GitHub)" <gi...@apache.org> on 2024/12/06 03:19:44 UTC, 21 replies.
- [PR] [SPARK-50496][Core]Change partitioning to SinglePartition if partition number is 1 [spark] - posted by "guixiaowen (via GitHub)" <gi...@apache.org> on 2024/12/06 03:20:18 UTC, 0 replies.
- [PR] [SPARK-50508][SQL]Add more detailed prompt information when broadcasting fails [spark] - posted by "guixiaowen (via GitHub)" <gi...@apache.org> on 2024/12/06 03:55:40 UTC, 0 replies.
- [PR] [SPARK-50492][SS][FOLLOWUP][3.5] Change `def references` to `lazy val references` in `DeduplicateWithinWatermark` to fix the compilation issue [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/06 05:23:13 UTC, 11 replies.
- Re: [PR] [SPARK-50480] Extend CharType and VarcharType from StringType [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/12/06 07:36:03 UTC, 0 replies.
- [PR] [SPARK-50509][build][sql] DeduplicateWithinWatermark def references change to lazy val [spark] - posted by "CuiYanxiang (via GitHub)" <gi...@apache.org> on 2024/12/06 07:41:23 UTC, 4 replies.
- [PR] [SPARK-50483][CORE][SQL] BlockMissingException should be thrown even if ignoreCorruptFiles is enabled [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2024/12/06 08:11:24 UTC, 5 replies.
- Re: [PR] [SPARK-50421][CORE][3.5] Fix executor related memory config incorrect when multiple resource profiles worked [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/06 08:42:33 UTC, 3 replies.
- Re: [PR] [SPARK-49349][SQL] Improve error message for LCA with Generate [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2024/12/06 08:54:16 UTC, 5 replies.
- Re: [PR] [SPARK-50378][SS] Add custom metric for tracking spent for proc initial state in transformWithState [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/06 09:31:23 UTC, 0 replies.
- Re: [PR] [SPARK-50480][SQL] Extend CharType and VarcharType from StringType [spark] - posted by "jovanm-db (via GitHub)" <gi...@apache.org> on 2024/12/06 09:57:16 UTC, 6 replies.
- Re: [PR] [SPARK-50478][SQL] Fix StringType matching [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/12/06 10:10:40 UTC, 2 replies.
- [PR] [MINOR] Assign null to input after closing it [spark] - posted by "tedyu (via GitHub)" <gi...@apache.org> on 2024/12/06 10:38:22 UTC, 2 replies.
- [PR] [SPARK-50511][PYTHON] Avoid wrapping Python data source error messages [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/12/06 11:34:28 UTC, 3 replies.
- [PR] [SPARK-48416][SQL] Support nested correlated With expression [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/12/06 14:22:59 UTC, 6 replies.
- Re: [PR] [SPARK-48416][SQL] Support related nested WITH expression [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/12/06 14:23:46 UTC, 0 replies.
- [PR] [SPARK-50356][CORE] Fix inconsitent skipped stage & tasks data on UI when jobs share the same stage [spark] - posted by "mikoszilard (via GitHub)" <gi...@apache.org> on 2024/12/06 14:41:12 UTC, 8 replies.
- [PR] [SPARK-] Align list table method of JDBCTableCatalog to TableCatalog API [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2024/12/06 16:45:41 UTC, 4 replies.
- [PR] [SPARK-50512][SQL][DOCS] Fix `CREATE TABLE` syntax in `sql-pipe-syntax.md` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/06 18:47:33 UTC, 5 replies.
- [PR] [SPARK-50514][DOCS] Add `IDENTIFIER clause` page to `menu-sql.yaml` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/06 19:35:22 UTC, 6 replies.
- [PR] [SPARK-48426][DOCS][FOLLOWUP] Add `Operators` page to `sql-ref.md` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/06 19:41:38 UTC, 5 replies.
- [PR] [SPARK-50513][SS] Split EncoderImplicits from SQLImplicits and provide helper object within StatefulProcessor to access underlying SQL Encoder related implicit functions [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/12/06 21:01:25 UTC, 0 replies.
- Re: [PR] [SPARK-50513][SS][SQL] Split EncoderImplicits from SQLImplicits and provide helper object within StatefulProcessor to access underlying SQL Encoder related implicit functions [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/12/06 21:03:31 UTC, 8 replies.
- [PR] [CORE] Add read-only interface to `SparkConf` [spark] - posted by "pmenon (via GitHub)" <gi...@apache.org> on 2024/12/06 21:03:49 UTC, 1 replies.
- Re: [PR] [SPARK-50350][SQL] Avro: add new function `schema_of_avro` (`scala` side) [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/06 21:10:15 UTC, 0 replies.
- Re: [PR] [SPARK-50329][SQL] fix InSet$toString [spark] - posted by "averyqi-db (via GitHub)" <gi...@apache.org> on 2024/12/06 22:01:24 UTC, 3 replies.
- [PR] [SPARK-49249][SQL][FOLLOWUP] Rename `spark.sql.artifact.isolation.(always.apply.classloader -> alwaysApplyClassloader)` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/06 23:00:44 UTC, 5 replies.
- Re: [PR] [SPARK-49249][SPARK-49122] Artifact isolation in Spark Classic [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/06 23:04:47 UTC, 0 replies.
- [PR] [SPARK-50516] Fix the test assert for init state proc time metric [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/12/06 23:14:18 UTC, 0 replies.
- Re: [PR] [SPARK-50516][SS] Fix the test assert for init state proc time metric [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/12/06 23:28:12 UTC, 0 replies.
- Re: [PR] [SPARK-50348][PYTHON] Make static import Python data source configurable [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/12/07 01:14:35 UTC, 1 replies.
- [PR] [DRAFT][SQL] Support for indeterminate collation [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/12/07 04:45:13 UTC, 0 replies.
- Re: [PR] [SPARK-50515][CORE] Add read-only interface to `SparkConf` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/07 07:30:39 UTC, 2 replies.
- [PR] [SPARK-50517][PYTHON][TESTS] Group pandas function related tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/07 07:42:28 UTC, 0 replies.
- Re: [PR] [SPARK-50516][SS][MINOR] Fix the init state related test to use StreamManualClock [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/12/07 12:25:09 UTC, 1 replies.
- [PR] [SPARK-50483][CORE][SQL][3.5] BlockMissingException should be thrown even if ignoreCorruptFiles is enabled [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2024/12/07 16:17:14 UTC, 6 replies.
- Re: [PR] [SPARK-48063][CORE] Enable `spark.stage.ignoreDecommissionFetchFailure` by default [spark] - posted by "akki (via GitHub)" <gi...@apache.org> on 2024/12/07 20:03:16 UTC, 4 replies.
- Re: [PR] [SPARK-48292][CORE] Revert [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort stage when committed file not consistent with task status [spark] - posted by "grishaw (via GitHub)" <gi...@apache.org> on 2024/12/08 11:29:54 UTC, 0 replies.
- Re: [PR] [SPARK-48867][BUILD] Upgrade `okhttp` to 4.12.0, `okio` to 3.9.0 and `esdk-obs-java` to 3.24.3 [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2024/12/08 13:44:23 UTC, 0 replies.
- Re: [PR] [SPARK-][SQL] Align list table method of JDBCTableCatalog to TableCatalog API [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/09 00:26:42 UTC, 0 replies.
- Re: [PR] [SPARK-48486][SQL] To solve the issue of generating excessively large execution plans when encountering multiple levels of subqueries while enabling DynamicPartitionPruning. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/09 00:27:36 UTC, 1 replies.
- Re: [PR] Handle Concurrent Create Table AS Select FROM commands [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/09 00:27:37 UTC, 1 replies.
- Re: [PR] [SPARK-48359][SQL] Built-in functions for Zstd compression and decompression [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/09 00:27:39 UTC, 1 replies.
- Re: [PR] [SPARK-45744][CORE] Switch `spark.history.store.serializer` to use `PROTOBUF` by default [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/09 00:27:41 UTC, 1 replies.
- [PR] [SPARK-50507][PYTHON][TESTS][FOLLOw-UP] Add refactored package into pure Python test [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/09 01:02:29 UTC, 0 replies.
- Re: [PR] [SPARK-50517][PYTHON][TESTS] Group arrow function related tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/09 01:45:25 UTC, 1 replies.
- [PR] [DO-NOT-MERGE] Support SQL API mode, prototype 3 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/09 04:53:46 UTC, 3 replies.
- Re: [PR] [SPARK-50507][PYTHON][TESTS][FOLLOW-UP] Add refactored package into pure Python test [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/09 05:23:17 UTC, 4 replies.
- [PR] [SPARK-49134][INFRA][3.5] Support retry for deploying artifacts to Nexus staging repository [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/09 07:11:31 UTC, 5 replies.
- [PR] [WIP][SPARK-50518][K8S] Add default value for driver/executor CPU limit co… [spark] - posted by "TongWei1105 (via GitHub)" <gi...@apache.org> on 2024/12/09 08:51:16 UTC, 0 replies.
- [PR] [SPARK-SPARK-50519][SQL]Simplify the method of creating SparkPlan for queryExecution [spark] - posted by "guixiaowen (via GitHub)" <gi...@apache.org> on 2024/12/09 09:07:18 UTC, 2 replies.
- Re: [PR] [SPARK-48769][SQL] Support constant folding for ScalaUDF [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2024/12/09 10:43:23 UTC, 0 replies.
- Re: [PR] [SPARK-48728][SQL] Support ignoreNulls for collect_list and collect_set [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2024/12/09 10:47:25 UTC, 7 replies.
- Re: [PR] [SPARK-50521][SQL] Align list table method of JDBCTableCatalog to TableCatalog API [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2024/12/09 11:34:13 UTC, 13 replies.
- Re: [PR] [SPARK-50518][K8S] Add default value for driver/executor CPU limit configuration [spark] - posted by "TongWei1105 (via GitHub)" <gi...@apache.org> on 2024/12/09 13:25:48 UTC, 2 replies.
- Re: [PR] [SPARK-50523] Fix casts on complex types in collation coercion [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/12/09 13:53:36 UTC, 3 replies.
- [PR] [SPARK-43415][Connect][SQL] Implement `KVGDS.agg` with custom `mapValues` function [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/12/09 16:39:27 UTC, 1 replies.
- [PR] [DRAFT] Generalize collation coercion [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/12/09 18:02:55 UTC, 0 replies.
- [PR] [SPARK-50428][SS][PYTHON] Support TransformWithStateInPandas in batch queries [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2024/12/09 18:56:16 UTC, 4 replies.
- Re: [PR] [SPARK-50503][SQL] Prohibit partitioning by Variant data [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/12/09 18:58:43 UTC, 7 replies.
- [PR] Fix bad implicit string type context calculation [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/12/09 19:47:55 UTC, 0 replies.
- [PR] [SPARK-50087] Robust handling of boolean expressions in CASE WHEN for MsSqlServer and future connectors [spark] - posted by "andrej-db (via GitHub)" <gi...@apache.org> on 2024/12/09 19:48:42 UTC, 0 replies.
- [PR] [SPARK-50524][SQL] Lower `RowBasedKeyValueBatch.spill` warning message to debug level [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/09 20:47:27 UTC, 6 replies.
- Re: [PR] [SPARK-50523][SQL] Fix casts on complex types in collation coercion [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/12/09 21:57:11 UTC, 0 replies.
- Re: [PR] [DO-NOT-REVIEW][SPARK-49722][CONNECT] Fix Column ordering of dropDuplicates and dropDuplicatesWithinWatermarks [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/12/09 22:16:22 UTC, 0 replies.
- [PR] SPARK-33152. Implement new optimized logic for constraint propagation… [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2024/12/09 22:18:26 UTC, 0 replies.
- [PR] [SPARK-48898] Set nullability correctly in the Variant schema [spark] - posted by "cashmand (via GitHub)" <gi...@apache.org> on 2024/12/09 22:22:14 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-48353][SQL] Introduction of Error Handling mechanism in SQL Scripting [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/10 00:26:56 UTC, 1 replies.
- Re: [PR] K8s with pvc fix [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/10 00:26:56 UTC, 1 replies.
- Re: [PR] add possibility to set log filename & disable spark log rotation #47373 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/10 00:26:57 UTC, 1 replies.
- [PR] [SPARK-50507][PYTHON][TESTS][FOLLOW-UP] Add refactored package into pure Python test [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/10 00:28:01 UTC, 2 replies.
- Re: [PR] [SPARK-48898][SQL] Set nullability correctly in the Variant schema [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/10 00:41:40 UTC, 17 replies.
- [PR] [SPARK-50526][SS] Add store encoding format conf into offset log and block non supported stateful operators from using avro [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/12/10 02:25:41 UTC, 9 replies.
- [PR] [SPARK-50527][INFRA] Add a separate docker file for python 3.12 daily build [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/10 03:11:52 UTC, 6 replies.
- [PR] [SPARK-50477][INFRA][FOLLOW-UP] Python 3.9 testing image clean up [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/10 03:15:47 UTC, 2 replies.
- [PR] [SPARK-45959][SQL] Improving performance when addition of 1 column at a time causes increase in the LogicalPlan tree depth [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2024/12/10 04:49:14 UTC, 0 replies.
- [PR] [SPARK-50528][CONNECT] Move `InvalidCommandInput` to common module [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/10 05:31:07 UTC, 3 replies.
- [PR] [SPARK-48730][SQL] Implement CreateSQLFunctionCommand for SQL Scalar and Table Functions [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/12/10 05:50:30 UTC, 6 replies.
- Re: [PR] [SPARK-50496][SQL]Change rebalance partitioning to SinglePartition if partition number is 1 [spark] - posted by "guixiaowen (via GitHub)" <gi...@apache.org> on 2024/12/10 06:07:11 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-50323][CONNECT][PYTHON] Add missing schema check for createDataFrame from numpy ndarray on Spark Connect [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/12/10 07:21:35 UTC, 0 replies.
- [PR] [SPARK-5051] Fix sporadic ReattachableExecuteSuite failure [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/12/10 09:33:46 UTC, 0 replies.
- Re: [PR] [SPARK-50510][CONNECT][3.5] Fix sporadic ReattachableExecuteSuite failure [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/12/10 09:43:32 UTC, 15 replies.
- [PR] [SPARK-50529][SQL] Add a configuration flat [spark] - posted by "jovanm-db (via GitHub)" <gi...@apache.org> on 2024/12/10 09:52:53 UTC, 1 replies.
- Re: [PR] [SPARK-50530] Fix bad implicit string type context calculation [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/12/10 11:03:32 UTC, 2 replies.
- [PR] [DRAFT] Add back casting for collated types [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/12/10 11:30:56 UTC, 0 replies.
- [PR] [SPARK-50531][SQL] Update `StringType` proto to support constraints [spark] - posted by "jovanm-db (via GitHub)" <gi...@apache.org> on 2024/12/10 11:33:49 UTC, 0 replies.
- [PR] [SPARK-50463][SQL][3.5] Fix `ConstantColumnVector` with Columnar to Row conversion [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/10 15:27:57 UTC, 13 replies.
- Re: [PR] [SPARK-50087][SQL][3.5] Robust handling of boolean expressions in CASE WHEN for MsSqlServer and future connectors [spark] - posted by "andrej-db (via GitHub)" <gi...@apache.org> on 2024/12/10 15:40:39 UTC, 5 replies.
- Re: [PR] [SPARK-50529][SQL] Add `spark.sql.charVarcharExtendsString` configuration flag [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/10 16:02:51 UTC, 0 replies.
- Re: [PR] [SPARK-49839][SQL] SPJ: Skip shuffles if possible for sorts [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2024/12/10 16:23:28 UTC, 9 replies.
- [PR] [SPARK-50536][CORE] Log downloaded archive file sizes in `SparkContext` and `Executor` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/10 17:54:12 UTC, 10 replies.
- Re: [PR] [SPARK-50530][SQL] Fix bad implicit string type context calculation [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/12/10 18:47:25 UTC, 1 replies.
- Re: [PR] [SPARK-43415][CONNECT][SQL] Implement `KVGDS.agg` with custom `mapValues` function [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/12/10 20:21:27 UTC, 7 replies.
- [PR] [SPARK-50537][CONNECT][PYTHON] Fix compression option being overwritten in `df.write.parquet` [spark] - posted by "khakhlyuk (via GitHub)" <gi...@apache.org> on 2024/12/10 20:52:53 UTC, 2 replies.
- [PR] [Minor] Rename isContainsUnsupportedLCA function [spark] - posted by "tedyu (via GitHub)" <gi...@apache.org> on 2024/12/10 21:24:55 UTC, 1 replies.
- [PR] [SPARK-45891] Account for stableDerivedColumnAlias in Variant test [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/12/10 22:02:37 UTC, 0 replies.
- Re: [PR] [SPARK-45891] Make VariantSuite test agnostic of the stableDerivedColumnAlias config [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/12/10 22:14:28 UTC, 0 replies.
- Re: [PR] [SPARK-49349][SQL][FOLLOWUP] Rename isContainsUnsupportedLCA function [spark] - posted by "tedyu (via GitHub)" <gi...@apache.org> on 2024/12/10 23:14:08 UTC, 5 replies.
- [PR] [SPARK-47320][SQL] : The behaviour of Datasets involving self joins is inconsistent, unintuitive, with contradictions [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2024/12/11 00:13:58 UTC, 0 replies.
- [PR] [SPARK-50517][PYTHON][TESTS][FOLLOW-UP] Add refactored package into pure Python test [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/11 00:15:07 UTC, 6 replies.
- [PR] [SPARK-50540][PYTHON][SS] Fix string schema for StatefulProcessorHandle [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2024/12/11 00:17:48 UTC, 21 replies.
- [PR] [SPARK-50541] Describe Table As JSON [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2024/12/11 01:19:47 UTC, 69 replies.
- [PR] [SPARK-50542][INFRA] Add a separate docker file for python 3.13 daily build [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/11 02:16:25 UTC, 2 replies.
- [PR] [SPARK-50543] Fix log printing in `dev/check-protos.py`. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/11 03:10:43 UTC, 0 replies.
- Re: [PR] [SPARK-50543][BUILD] Fix log printing in `dev/check-protos.py` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/11 03:18:45 UTC, 3 replies.
- [PR] [SPARK-50544][PYTHON][CONNECT] Implement `StructType.toDDL` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/11 04:27:39 UTC, 6 replies.
- [PR] [SPARK-50545][CORE][SQL] AccessControlException should be thrown even if ignoreCorruptFiles is enabled [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/12/11 06:42:37 UTC, 2 replies.
- [PR] [SPARK-50525] Prohibit partitioning by MapType [spark] - posted by "ostronaut (via GitHub)" <gi...@apache.org> on 2024/12/11 10:01:06 UTC, 1 replies.
- [PR] [WIP][SPARK-24497][SQL] Recursive CTE. Instruction for reviewers https://d… [spark] - posted by "nemanjapetr-db (via GitHub)" <gi...@apache.org> on 2024/12/11 11:54:24 UTC, 0 replies.
- [PR] [WIP][SPARK-24497][SQL] An initial, no-op commit that makes a number of changes in CTESubstitution.scala that are self-contained and that make CTE substitions and resolutions aware of the recursion. We also make minimal, no-op changes in basicLogicalOperators.scala. [spark] - posted by "nemanjapetr-db (via GitHub)" <gi...@apache.org> on 2024/12/11 12:14:04 UTC, 0 replies.
- [PR] [SPARK-50546] Add subquery cast support to collation type coercion [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/12/11 13:56:02 UTC, 0 replies.
- Re: [PR] [SPARK-50546][SQL] Add subquery cast support to collation type coercion [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/12/11 13:57:07 UTC, 9 replies.
- Re: [PR] [SPARK-50545][CORE][SQL] `AccessControlException` should be thrown even if `ignoreCorruptFiles` is enabled [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/11 16:21:15 UTC, 5 replies.
- Re: [PR] [SPARK-49938][K8S] Prefer to use Hadoop configMap when specified [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/12/11 16:41:15 UTC, 0 replies.
- [PR] [SPARK-50548] Extended DataSet API to support specifying JSON options in toJSON method [spark] - posted by "vladanvasi-db (via GitHub)" <gi...@apache.org> on 2024/12/11 16:44:28 UTC, 10 replies.
- Re: [PR] [SPARK-33720][K8S] Support submit to k8s only with token [spark] - posted by "apiwoni (via GitHub)" <gi...@apache.org> on 2024/12/11 17:29:44 UTC, 0 replies.
- [PR] [SPARK-50549][DOCS] Use `rouge` `4.5.x` by remove the upper bound `3.x` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/11 17:31:41 UTC, 0 replies.
- Re: [PR] [SPARK-50549][DOCS] Use `rouge` `4.5.x` by removing the upper bound `3.x` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/11 18:42:30 UTC, 4 replies.
- [PR] SPARK-47609. Making CacheLookup more optimal to minimize cache miss [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2024/12/11 19:32:35 UTC, 0 replies.
- Re: [PR] [SPARK-47609][SQL] Making CacheLookup more optimal to minimize cache miss [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2024/12/11 19:34:57 UTC, 0 replies.
- [PR] [SARK-45866][SQL] Fix for Reuse of Exchange in AQE not happening when DPP filters are pushed down to the underlying Scan (like iceberg) [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2024/12/11 20:31:14 UTC, 2 replies.
- [PR] [SPARK-45926][SQL] Implementing equals and hashCode which takes into account pushed runtime filters , in InMemoryTable related scans [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2024/12/11 20:42:10 UTC, 1 replies.
- [PR] [SPARK-45658][SQL] Fix canonicalization of DynamicPruningSubquery to canonicalize build keys relative to build query output [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2024/12/11 20:49:11 UTC, 0 replies.
- [PR] [SPARK-45373][SQL] Minimize partitions fetch call to HiveMetaStoreLayer [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2024/12/11 22:00:40 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-49690][SQL] UDT type not showing up in sql type representation in the schema [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2024/12/11 22:02:26 UTC, 1 replies.
- [PR] [WIP] Python TWS metadata [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/12/11 23:56:22 UTC, 0 replies.
- [PR] Tws batch [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/12/12 00:17:25 UTC, 1 replies.
- [PR] [SPARK-50493][BUILD] Migrate kubernetes-client to 7.0.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/12/12 01:52:59 UTC, 16 replies.
- Re: [PR] [SPARK-11374][SQL] Support `skip.header.line.count` option for Hive Table [spark] - posted by "liujiayi771 (via GitHub)" <gi...@apache.org> on 2024/12/12 02:04:14 UTC, 2 replies.
- [PR] [SPARK-50552][INFRA] Add a separate docker file for PyPy 3.10 daily build [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/12 03:00:47 UTC, 3 replies.
- [PR] [SPARK-50553][CONNECT] Throw `InvalidPlanInput` for invalid plan message [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/12 03:54:33 UTC, 2 replies.
- [PR] [SPARK-50545][CORE][SQL][3.5] `AccessControlException` should be thrown even if `ignoreCorruptFiles` is enabled [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/12/12 04:54:09 UTC, 3 replies.
- [PR] [SPARK-49872][HISTORYSERVER] allow unlimited json size again [spark] - posted by "steven-aerts (via GitHub)" <gi...@apache.org> on 2024/12/12 08:06:18 UTC, 10 replies.
- [PR] [CONNECTOR] Fix KafkaMicroBatchSourceSuite to cover KafkaOffsetReaderConsumer with unit tests [spark] - posted by "ostronaut (via GitHub)" <gi...@apache.org> on 2024/12/12 09:44:58 UTC, 0 replies.
- [PR] [SPARK-50554][INFRA] Add a separate docker file for Python 3.11 daily coverage build [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/12 13:01:21 UTC, 2 replies.
- Re: [PR] [DRAFT][SCRIPTING] Sql scripting local vars [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2024/12/12 15:37:01 UTC, 0 replies.
- [PR] [SQL][SPARK-50559] Store Except, Intersect and Union's outputs as lazy vals [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/12/12 22:46:36 UTC, 8 replies.
- Re: [PR] [SPARK-48213][SQL] Do not push down predicate if non-cheap expression exceed reused limit [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/12/12 23:37:23 UTC, 1 replies.
- Re: [PR] [SPARK-49886][SS] Query level failure test for rocksDB format V2 [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/12/12 23:51:18 UTC, 16 replies.
- Re: [PR] [SS][TESTS] Fix KafkaMicroBatchSourceSuite to cover KafkaOffsetReaderConsumer with unit tests [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/12/13 00:08:48 UTC, 2 replies.
- Re: [PR] [WIP] Do not consider empty partitions for skew join calculations [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/13 00:26:53 UTC, 1 replies.
- Re: [PR] [SPARK-48449][SQL] Using `getPropertyInfo` instead of `reflection` to obtain `JAAS application name` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/13 00:26:54 UTC, 1 replies.
- [PR] [SPARK_50076] Fix logkeys [spark] - posted by "michaelzhan-db (via GitHub)" <gi...@apache.org> on 2024/12/13 02:23:04 UTC, 2 replies.
- [PR] [SPARK-50562][INFRA] Apply Python 3.11 image in Java 21 daily build [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/13 04:41:07 UTC, 2 replies.
- [PR] [BUILD] Upgrade `protobuf-java` to 4.29.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/13 05:22:48 UTC, 1 replies.
- [PR] [PYTHON] Upgrade `protobuf` Python package to 5.29.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/13 05:30:11 UTC, 0 replies.
- [PR] [WIP] Adding state schema Id to state rows [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/12/13 07:18:26 UTC, 0 replies.
- Re: [PR] [DO-NOT-REVIEW][DRAFT] integration3 [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/12/13 07:26:31 UTC, 0 replies.
- [PR] [SPARK-49461][SS][FOLLOWUP] Move related resource files to correct place [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/12/13 07:36:36 UTC, 0 replies.
- [PR] [SPARK-50565][SS][TEST] Add transformWithState correctness test [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/12/13 07:42:13 UTC, 0 replies.
- [PR] [SPARK-50566][MINOR] Style improvement of RocksDB file [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/12/13 07:53:10 UTC, 0 replies.
- [PR] [SPARK-49883][SS][TESTS] RocksDB Fault Tolerance Test [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/12/13 08:36:57 UTC, 0 replies.
- [PR] [SPARK-50567][INFRA] Apply Python 3.11 image in No-ANSI daily build [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/13 09:27:03 UTC, 2 replies.
- Re: [PR] [SPARK-50525][SQL] Prohibit partitioning by MapType [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/12/13 11:17:23 UTC, 9 replies.
- Re: [PR] [SPARK-50566][MINOR][SS] Fix code style violation for RocksDB file [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/12/13 12:55:42 UTC, 1 replies.
- Re: [PR] [SPARK-49461][SS][TESTS][FOLLOWUP] Move related resource files to correct place [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/12/13 12:58:06 UTC, 3 replies.
- [PR] [SPARK-50558] Add configurable logging limits for the number of elements in InSet and In [spark] - posted by "olaky (via GitHub)" <gi...@apache.org> on 2024/12/13 13:08:19 UTC, 6 replies.
- [PR] [SPARK-50571][INFRA] Apply Python 3.11 image in RocksDB as UI Backend daily build [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/13 13:15:01 UTC, 2 replies.
- [PR] [SPARK-50572][SQL] Fix race condition in CachedRDDBuilder.cachedColumnBuffers [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2024/12/13 13:55:50 UTC, 2 replies.
- Re: [PR] [SPARK-50568][SS][TESTS] Fix KafkaMicroBatchSourceSuite to cover KafkaOffsetReaderConsumer with unit tests [spark] - posted by "ostronaut (via GitHub)" <gi...@apache.org> on 2024/12/13 14:16:23 UTC, 1 replies.
- [PR] [SPARK-24497][SQL] An initial, no-op PR which adds new parameters to already existing classes UnresolvedWith, CTERelationRef and CTERelationDef to enable later implementation of recursive CTEs. [spark] - posted by "milanisvet (via GitHub)" <gi...@apache.org> on 2024/12/13 14:17:32 UTC, 9 replies.
- Re: [PR] [SPARK-50563][BUILD] Upgrade `protobuf-java` to 4.29.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/13 15:17:21 UTC, 1 replies.
- Re: [PR] [SPARK-50564][PYTHON] Upgrade `protobuf` Python package to 5.29.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/13 15:23:47 UTC, 4 replies.
- Re: [PR] [SPARK-50354][SQL] No need to set initialInputBufferOffset when Aggregate mode is Complete [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/12/13 17:23:34 UTC, 0 replies.
- [PR] [SPARK-50574][DOCS] Upgrade `rexml` to 3.3.9 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/13 18:49:13 UTC, 7 replies.
- [PR] [SPARK-50134][SPARK-50130][SQL][CONNECT] Support DataFrame API for SCALAR and EXISTS subqueries in Spark Connect [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/12/13 19:24:06 UTC, 29 replies.
- Re: [PR] [SPARK-45891][SQL][TESTS] Make VariantSuite test agnostic of the stableDerivedColumnAlias config [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/12/13 19:36:58 UTC, 1 replies.
- [PR] Osm upgrade [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/12/13 20:24:32 UTC, 0 replies.
- [PR] [SPARK-49954][SQL][FOLLOWUP] Move states to SchemaOfJsonEvaluator [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/12/13 20:36:09 UTC, 4 replies.
- Re: [PR] [SPARK-50529][SQL] Add `spark.sql.charVarcharExtendsString` config [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/12/13 20:38:15 UTC, 1 replies.
- Re: [PR] [SPARK-50017][SQL] Support Avro encoding for TransformWithState operator [spark] - posted by "brkyvz (via GitHub)" <gi...@apache.org> on 2024/12/13 20:49:11 UTC, 4 replies.
- [PR] [SPARK-50576][BUILD] Upgrade `common-text` to `1.13.0` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/12/13 23:12:07 UTC, 3 replies.
- Re: [PR] [Follow-up] [MINOR] Make readVersion lazy value [spark] - posted by "tedyu (via GitHub)" <gi...@apache.org> on 2024/12/13 23:20:21 UTC, 4 replies.
- [PR] [SPARK-49661][SQL]Removing redudant checks of collation in binary collation hashing expression [spark] - posted by "jovanpavl-db (via GitHub)" <gi...@apache.org> on 2024/12/13 23:41:16 UTC, 5 replies.
- Re: [PR] [SPARK-47193][SQL] Ensure SQL conf is propagated to executors when actions are called on RDD returned by `Dataset#rdd` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/12/13 23:55:39 UTC, 2 replies.
- Re: [PR] [SPARK-49110][SQL] Fix reading metadata columns for tables with CHAR columns [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/14 00:25:43 UTC, 1 replies.
- Re: [PR] [SPARK-48758][Core] Race condition between executor registration and heartbeat [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/14 00:25:44 UTC, 1 replies.
- Re: [PR] [SPARK-50565][SS][TESTS] Add transformWithState correctness test [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/12/14 01:56:33 UTC, 1 replies.
- Re: [PR] [SPARK-50360] [Follow-up] [MINOR] Make readVersion lazy value [spark] - posted by "tedyu (via GitHub)" <gi...@apache.org> on 2024/12/14 02:08:51 UTC, 1 replies.
- Re: [PR] [SPARK-50573][SS] Adding State Schema ID to State Rows to schema evolution [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/12/14 02:47:58 UTC, 31 replies.
- [PR] [WIP][SQL] Fix `truncatedString` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/12/14 13:12:14 UTC, 0 replies.
- Re: [PR] [SPARK-50559][SQL] Store Except, Intersect and Union's outputs as lazy vals [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/12/14 15:50:08 UTC, 0 replies.
- [PR] [MINOR][SS] Minor update to watermark propagation comments [spark] - posted by "neilramaswamy (via GitHub)" <gi...@apache.org> on 2024/12/14 23:05:31 UTC, 3 replies.
- Re: [PR] [SPARK-49485][CORE] Fix speculative task hang bug due to remaining executor lay on same host [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/12/15 00:23:48 UTC, 0 replies.
- Re: [PR] [SPARK-49629][CORE] JsonProtocol should use 'Shuffle Push Read Metrics' and 'Merged Fetch Fallback Count' fields of shuffle read metrics [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/12/15 00:26:18 UTC, 0 replies.
- Re: [PR] [SPARK-49783][YARN] Fix resource leak of yarn allocator [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/12/15 00:30:31 UTC, 5 replies.
- Re: [PR] [SPARK-49991][SQL] Make HadoopMapReduceCommitProtocol respect 'mapreduce.output.basename' to generate file names [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/12/15 02:35:00 UTC, 0 replies.
- [PR] [SPARK-50580][BUILD] Upgrade log4j2 to 2.24.3 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/12/15 05:57:39 UTC, 4 replies.
- [PR] [SPARK-50581] fix support for UDAF in Dataset.observe() [spark] - posted by "tomsisso (via GitHub)" <gi...@apache.org> on 2024/12/15 13:55:39 UTC, 2 replies.
- Re: [PR] [SPARK-38897][SQL] DS V2 supports push down string functions [spark] - posted by "7yyo (via GitHub)" <gi...@apache.org> on 2024/12/15 14:49:09 UTC, 0 replies.
- Re: [PR] [SPARK-49953][CORE] Require `errorClass` in `SparkException` [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/12/15 16:16:57 UTC, 6 replies.
- Re: [PR] [SPARK-50034][CORE] Fix Misreporting of Fatal Errors as Uncaught Exceptions in `SparkUncaughtExceptionHandler` [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/12/15 16:21:37 UTC, 0 replies.
- Re: [PR] [SPARK-49980][CORE][SQL] Fix potential file stream leaks caused by interruption in canceled tasks [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/12/15 16:35:53 UTC, 0 replies.
- Re: [PR] [SPARK-50332][CORE] Optimize accurate CompressedMapStatus [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/12/15 16:58:15 UTC, 0 replies.
- [PR] [SPARK-50582][SQL] Add quote builtin function [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2024/12/15 20:24:30 UTC, 1 replies.
- [PR] [MINOR][DOCS] Modify a link in running-on-yarn.md [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2024/12/15 20:51:15 UTC, 1 replies.
- Re: [PR] [SPARK-50430][CORE] Use the standard Properties.clone instead of manual clone [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/12/15 21:26:48 UTC, 2 replies.
- [PR] [SPARK-50583][INFRA] Apply Python 3.11 image in PR build [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/16 01:18:04 UTC, 6 replies.
- Re: [PR] [SPARK-50370][SQL] Codegen Support for `json_tuple` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/12/16 01:24:22 UTC, 21 replies.
- Re: [PR] [SPARK-50568][SS][TESTS] Fix `KafkaMicroBatchSourceSuite` to cover `KafkaOffsetReaderConsumer` [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/12/16 03:33:47 UTC, 1 replies.
- Re: [PR] [SPARK-50360][SS][FOLLOWUP][MINOR] Make readVersion lazy value [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/12/16 03:37:33 UTC, 3 replies.
- [PR] [SPARK-50584][SS] Modify state eviction metrics in TransformWithState to represent physical deletions [spark] - posted by "neilramaswamy (via GitHub)" <gi...@apache.org> on 2024/12/16 04:22:10 UTC, 12 replies.
- [PR] [TEST-ONLY][3.5] Check 3.5 PR builder [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/16 04:29:56 UTC, 1 replies.
- [PR] [PYTHON] Upgrade buf plugins to v29.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/16 04:53:04 UTC, 1 replies.
- Re: [PR] [SPARK-50581][SQL] fix support for UDAF in Dataset.observe() [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/16 05:43:05 UTC, 7 replies.
- [PR] [WIP][SPARK-50585][PYTHON] Visualize doctest examples for PySpark plotting [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/12/16 05:58:13 UTC, 0 replies.
- Re: [PR] [SPARK-50579][SQL] Fix `truncatedString` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/16 06:04:39 UTC, 1 replies.
- [PR] [SPARK-50586][BUILD] Use CommonJS format for ESLint configuration file [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2024/12/16 06:52:21 UTC, 3 replies.
- [PR] [SPARK-50311][TESTS][FOLLOWUP] Fix test name properly [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/12/16 07:31:37 UTC, 1 replies.
- [PR] [SPARK-50588][BUILD] `build-docs` skips building R docs on host when `SKIP_RDOC=1` [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/12/16 08:24:39 UTC, 5 replies.
- [PR] [SPARK-50587][INFRA][3.5] Remove unsupported `curl` option `--retry-all-errors` from `release-build.sh` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/16 08:36:59 UTC, 3 replies.
- Re: [PR] [CONNECT][SS][PYTHON] Upgrade buf plugins to v29.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/16 09:03:07 UTC, 1 replies.
- [PR] [SPARK-50589][SQL] Avoid produce duplicate non-cheap expressions when push down predicate [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2024/12/16 09:47:42 UTC, 8 replies.
- Re: [PR] [SPARK-50558][SQL] Add configurable logging limits for the number of elements in InSet and In [spark] - posted by "olaky (via GitHub)" <gi...@apache.org> on 2024/12/16 09:51:28 UTC, 8 replies.
- [PR] [SPARK-50510][CONNECT][TEST][3.5] Fix flaky ReattachableExecuteSuite [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/12/16 10:28:52 UTC, 4 replies.
- Re: [PR] [SPARK-50493][BUILD] Migrate kubernetes-client from `6.x` to `7.x` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/12/16 10:59:58 UTC, 4 replies.
- [PR] [SPARK-50590][INFRA] Skip uncessary image build and push [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/16 11:34:03 UTC, 3 replies.
- [PR] Align the gRPC-related Python package version and pin protobuf version in `page.yml` and `docs/Dockerfile` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/16 11:58:08 UTC, 1 replies.
- [PR] [SPARK-50583][INFRA][FOLLOW-UP] Fix 3.5 daily build [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/16 13:40:40 UTC, 7 replies.
- Re: [PR] [SPARK-49661][SQL] Removing redudant checks of collation in binary collation hashing expression [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/12/16 13:58:15 UTC, 3 replies.
- [PR] [SPARK-50592][INFRA] Make 3.5 daily build able to manually trigger [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/16 14:30:44 UTC, 6 replies.
- [PR] refactor [spark] - posted by "anton5798 (via GitHub)" <gi...@apache.org> on 2024/12/16 14:48:31 UTC, 0 replies.
- Re: [PR] [SPARK-50529][SQL] Add `spark.sql.preserveCharVarcharTypeInfo` config [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/12/16 16:27:54 UTC, 4 replies.
- Re: [PR] [SPARK-50578][PYTHON][SS] Add support for new version of state metadata for TransformWithStateInPandas [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/12/16 20:29:05 UTC, 36 replies.
- [PR] [WIP][SPARK-44662] Perf improvement in BroadcastHashJoin queries with stream side join key on non partition columns [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2024/12/16 22:26:56 UTC, 0 replies.
- Re: [PR] [SPARK-49883][SS][TESTS][FOLLOWUP] RocksDB Fault Tolerance Test [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2024/12/16 23:40:56 UTC, 4 replies.
- Re: [PR] [SPARK-50392][PYTHON] DataFrame conversion to table argument in Spark Classic [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/12/17 00:06:47 UTC, 21 replies.
- [PR] [SPARK-50560][SQL] Improve type coercion and boundary checking for RANDSTR SQL function [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/12/17 00:17:38 UTC, 10 replies.
- [PR] [SPARK-50593][SQL] SPJ: Support truncate transform [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2024/12/17 01:43:52 UTC, 4 replies.
- Re: [PR] [REFACTOR] Refactor batch construction in Optimizer.scala and SparkOptimizer.scala [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/12/17 03:38:23 UTC, 4 replies.
- Re: [PR] [WIP][SPARK-50590][INFRA] Skip uncessary image build and push [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/17 03:42:03 UTC, 0 replies.
- Re: [PR] [SPARK-50594][BUILD][INFRA] Align the gRPC-related Python package version and pin protobuf version in `page.yml` and `docs/Dockerfile` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/17 04:19:36 UTC, 2 replies.
- [PR] [TEST-ONLY][SQL] Make `QueryPlan` lockless [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/17 08:09:36 UTC, 24 replies.
- [PR] [SPARK-49636][SQL] Remove the ANSI config suggestion in INVALID_ARRAY_INDEX and INVALID_ARRAY_INDEX_IN_ELEMENT_AT [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/12/17 11:00:10 UTC, 4 replies.
- [PR] [SPARK-50596][PYTHON] Upgrade Py4J from 0.10.9.7 to 0.10.9.8 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/17 11:09:52 UTC, 2 replies.
- [PR] [SPARK-50370][SQL] Codegen Support for json_tuple - simplified version [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/12/17 11:20:42 UTC, 2 replies.
- Re: [PR] [SPARK-50206][SQL] Added separate collation id for UTF8_BINARY and non-collated strings [spark] - posted by "vladanvasi-db (via GitHub)" <gi...@apache.org> on 2024/12/17 13:55:28 UTC, 1 replies.
- Re: [PR] [SPARK-50548][SQL] Extended DataSet API to support specifying JSON options in toJSON method [spark] - posted by "vladanvasi-db (via GitHub)" <gi...@apache.org> on 2024/12/17 13:57:36 UTC, 1 replies.
- Re: [PR] [SPARK-50597][SQL] Refactor batch construction in Optimizer.scala and SparkOptimizer.scala [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/12/17 14:37:33 UTC, 2 replies.
- [PR] [MINOR][CORE] Place the comments in the appropriate location [spark] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2024/12/17 15:30:04 UTC, 0 replies.
- Re: [PR] [SPARK-50598][SQL] An initial, no-op PR which adds new parameters to already existing classes UnresolvedWith, CTERelationRef and CTERelationDef to enable later implementation of recursive CTEs. [spark] - posted by "milanisvet (via GitHub)" <gi...@apache.org> on 2024/12/17 18:03:12 UTC, 1 replies.
- [PR] Broadcast schemas [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/12/17 18:26:17 UTC, 1 replies.
- [PR] [WIP] state schema management [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/12/17 20:46:23 UTC, 1 replies.
- Re: [PR] [SPARK-50599][SQL] Create the DataEncoder trait that allows for Avro and UnsafeRow encoding [spark] - posted by "brkyvz (via GitHub)" <gi...@apache.org> on 2024/12/17 21:02:09 UTC, 2 replies.
- [PR] [SPARK-50602][SQL] Fix transpose to show a proper error message when invalid index columns are specified [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/12/18 01:34:43 UTC, 4 replies.
- [PR] [SPARK-50603][SQL] Respect user-provided basePath for streaming file source reads without glob [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2024/12/18 01:43:47 UTC, 2 replies.
- Re: [PR] [SPARK-50604][SQL][TESTS] Extract MariaDBDatabaseOnDocker and upgrade `Mariadb` docker image version [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/12/18 01:55:34 UTC, 4 replies.
- [PR] [SPARK-40993][CONNECT][PYTHON][DOCS] Migrate markdown style README to PySpark Development Documentation [spark] - posted by "seilylook (via GitHub)" <gi...@apache.org> on 2024/12/18 02:39:10 UTC, 3 replies.
- [PR] [SPARK-50606][CONNECT] Fix NPE on uninitiated SessionHolder [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/12/18 05:59:56 UTC, 7 replies.
- [PR] [SPARK-50608][SQL][DOCS] Fix malformed configuration page caused by unclosed tags [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/12/18 07:12:22 UTC, 16 replies.
- [PR] [SPARK-50609][INFRA] Eliminate warnings in docker image building [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/12/18 07:37:29 UTC, 3 replies.
- [PR] [SPARK-50607][SQK] Passdown fileLength when reading parquet footer to avoid call HDFS namenode in executor side [spark] - posted by "WangGuangxin (via GitHub)" <gi...@apache.org> on 2024/12/18 07:53:29 UTC, 0 replies.
- [PR] Adding State Schema ID to State Rows for schema evolution [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/12/18 07:55:54 UTC, 0 replies.
- [PR] [SPARK-49632][SQL] Remove the ANSI config suggestion in CANNOT_PARSE_TIMESTAMP [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/12/18 08:07:32 UTC, 4 replies.
- Re: [PR] [WIP] Adding State Schema ID to State Rows for schema evolution [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/12/18 09:02:02 UTC, 0 replies.
- Re: [PR] [SPARK-50607][SQL] Passdown fileLength when reading parquet footer to avoid call HDFS namenode in executor side [spark] - posted by "WangGuangxin (via GitHub)" <gi...@apache.org> on 2024/12/18 09:53:18 UTC, 0 replies.
- Re: [PR] [SPARK-50605][CONNECT] Support SQL API mode for easier migration to Spark Connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/18 10:37:07 UTC, 0 replies.
- [PR] [Only Test] codecov/codecov-action@v5 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/12/18 11:49:12 UTC, 4 replies.
- [PR] initial commit [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2024/12/18 11:54:03 UTC, 0 replies.
- [PR] [SPARK-50612][SQL] Normalize ordering in the project list of an inner Project [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2024/12/18 13:18:26 UTC, 6 replies.
- Re: [PR] [SPARK-50611] [SQL] Improve HybridAnalyzer so it throws ExplicitlyUnsupportedResolverFeature in specific cases [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/12/18 14:52:15 UTC, 1 replies.
- [PR] [WIP][SPARK-50220] add listagg to pyspark [spark] - posted by "mikhailnik-db (via GitHub)" <gi...@apache.org> on 2024/12/18 15:25:18 UTC, 0 replies.
- [PR] [WIP][SPARK-24497][SQL] Extending CTESubstitution.scala to make it aware of recursion [spark] - posted by "milanisvet (via GitHub)" <gi...@apache.org> on 2024/12/18 17:41:38 UTC, 10 replies.
- [PR] Add File Extension Option to CSV DataSource Writer [spark] - posted by "jabbaugh (via GitHub)" <gi...@apache.org> on 2024/12/18 18:42:48 UTC, 0 replies.
- [PR] Add shredding support [spark] - posted by "cashmand (via GitHub)" <gi...@apache.org> on 2024/12/18 20:23:50 UTC, 0 replies.
- [PR] [SPARK-50615] Push variant into scan. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/12/18 20:48:01 UTC, 1 replies.
- Re: [PR] [SPARK-50614][SQL] Add Variant shredding support for Parquet [spark] - posted by "cashmand (via GitHub)" <gi...@apache.org> on 2024/12/18 20:52:36 UTC, 14 replies.
- [PR] [SPARK-50600] [spark] - posted by "jdesjean (via GitHub)" <gi...@apache.org> on 2024/12/18 23:30:39 UTC, 0 replies.
- [PR] [SPARK-50561][SQL] Improve type coercion and boundary checking for UNIFORM SQL function [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/12/18 23:36:20 UTC, 15 replies.
- Re: [PR] [SPARK-50499][PYTHON] Expose metrics from BasePythonRunner [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/18 23:47:11 UTC, 1 replies.
- [PR] [SPARK-50618] Make DataFrameReader and DataStreamReader leverage the analyzer more [spark] - posted by "brkyvz (via GitHub)" <gi...@apache.org> on 2024/12/19 00:14:48 UTC, 6 replies.
- [PR] [SPARK-50619] Refactor VariantGet.cast to pack the cast arguments [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/12/19 01:22:56 UTC, 1 replies.
- Re: [PR] [SPARK-50619][SQL] Refactor VariantGet.cast to pack the cast arguments [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/12/19 02:44:16 UTC, 4 replies.
- Re: [PR] [SPARK-50447][SQL] Skip the parameter mode check in `Call` command [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/12/19 03:36:05 UTC, 0 replies.
- Re: [PR] [SPARK-49491][SQL] Replace AnyRefMap with HashMap [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2024/12/19 03:44:09 UTC, 2 replies.
- Re: [PR] [SPARK-50493][SPARK-37687][BUILD] Migrate kubernetes-client from `6.x` to `7.x` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/19 05:53:56 UTC, 12 replies.
- Re: [PR] [SPARK-44284][CONNECT] Create simple conf system for sql/api [spark] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/12/19 06:38:31 UTC, 3 replies.
- [PR] [SPARK-50620] Fix dead lock caused by SQLConf$ and SqlApiConf initialization [spark] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/12/19 07:53:21 UTC, 2 replies.
- [PR] [SPARK-50621][PYTHON] Upgrade Cloudpickle to 3.1.0 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/19 08:13:28 UTC, 2 replies.
- [PR] [SPARK-50622] RocksDB Refactor [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/12/19 08:29:57 UTC, 0 replies.
- Re: [PR] [SPARK-50615][SQL] Push variant into scan. [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/12/19 09:21:05 UTC, 7 replies.
- Re: [PR] [WIP][SPARK-50220][SQL] Support listagg in PySpark [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/19 10:09:44 UTC, 3 replies.
- Re: [PR] [SPARK-50409][SQL] Fix set statement to ignore `;` at the end of `SET;`, `SET -v;` and `SET key;` [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/12/19 10:30:12 UTC, 9 replies.
- [PR] [SPARK-50623][SQL] respect table lookup error from the catalog [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/12/19 13:53:08 UTC, 0 replies.
- [PR] [SPARK-50624][SQL] Add TimestampNTZType to ColumnarRow [spark] - posted by "nastra (via GitHub)" <gi...@apache.org> on 2024/12/19 17:43:51 UTC, 0 replies.
- [PR] [SPARK-49565][SQL] Improve auto-generated expression aliases with pipe SQL operators [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/12/19 18:39:52 UTC, 4 replies.
- Re: [PR] [SPARK-50616][SQL] Add File Extension Option to CSV DataSource Writer [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/12/19 19:22:55 UTC, 2 replies.
- [PR] [SPARK-50625][BUILD] simplify shell scripts using mvn help:evaluate [spark] - posted by "Arnaud-Nauwynck (via GitHub)" <gi...@apache.org> on 2024/12/19 20:15:26 UTC, 0 replies.
- [PR] [SPARK-50628] fix stop error on windows [spark] - posted by "Arnaud-Nauwynck (via GitHub)" <gi...@apache.org> on 2024/12/19 22:37:48 UTC, 0 replies.
- [PR] [SPARK-50630][SQL] Fix GROUP BY ordinal support for pipe SQL AGGREGATE operators [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/12/20 00:04:58 UTC, 5 replies.
- Re: [PR] [SPARK-38862][Core] - allow integration of a secure gateway to SparkSubmissionServer alongside spark.authenticate props [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/20 00:24:31 UTC, 1 replies.
- [PR] [SPARK-50613][CONNECT] Support Configurable Idle Timeout of Connect Server [spark] - posted by "soumasish (via GitHub)" <gi...@apache.org> on 2024/12/20 00:47:33 UTC, 0 replies.
- [PR] [SPARK-50632][BUILD] Upgrade tink to 1.16.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/12/20 01:24:32 UTC, 2 replies.
- [PR] [SPARK-50633][INFRA] Fix `codecov/codecov-action@v4` daily scheduling failure [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/12/20 03:01:15 UTC, 1 replies.
- Re: [PR] [SPARK-50589][SQL] Avoid extra expression duplication when push filter [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/12/20 06:40:35 UTC, 73 replies.
- Re: [PR] [SPARK-50529][SQL] Change char/varchar behavior under the `spark.sql.preserveCharVarcharTypeInfo` config [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/12/20 07:44:35 UTC, 14 replies.
- [PR] [SPARK-50483][SPARK-50545][DOC][FOLLOWUP] Mention behavior changes in migration guide [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/12/20 10:43:57 UTC, 4 replies.
- [PR] [SPARK-50534][SPARK-50535][TEST][CONNECT] Fix sporadic test failures [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/12/20 10:55:25 UTC, 2 replies.
- [PR] [SPARK-50637][SQL] Fix code style for the single-pass Analyzer [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/12/20 11:39:59 UTC, 2 replies.
- [PR] [SQL][SPARK-50638] Refactor the view resolution into the separate file to reuse it in the single-pass Analyzer [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/12/20 11:58:14 UTC, 0 replies.
- [PR] Publish 3.5.4 to docker registry [spark-docker] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/20 12:12:08 UTC, 15 replies.
- [PR] [SPARK-50483][SPARK-50545][DOC][FOLLOWUP][3.5] Mention behavior changes in migration guide [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/12/20 17:14:45 UTC, 3 replies.
- [PR] [SPARK-48568][SQL] Improve Performance of CodeFormatter [spark] - posted by "anton-erofeev (via GitHub)" <gi...@apache.org> on 2024/12/20 17:26:18 UTC, 4 replies.
- [PR] [SPARK-50640][CORE][TESTS] Update `ChecksumBenchmark` by removing `PureJavaCrc32C` and setting `Adler32` as a baseline [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/20 19:27:14 UTC, 4 replies.
- Re: [PR] [SPARK-49479][CORE] Use daemon ScheduledThreadPoolExecutor for BarrierCoordinator [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/21 00:23:55 UTC, 1 replies.
- [PR] [SPARK-50641][SQL] Move `GetJsonObjectEvaluator` to `JsonExpressionEvalUtils` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/12/21 01:50:35 UTC, 4 replies.
- [PR] Install r for ubuntu-latest [spark-docker] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/21 02:44:56 UTC, 2 replies.
- [PR] Fix the state schema for FlatMapGroupsWithState in spark connect when… [spark] - posted by "huanliwang-db (via GitHub)" <gi...@apache.org> on 2024/12/21 03:54:24 UTC, 0 replies.
- Re: [PR] [SPARK-50642][CONNECT][SS]Fix the state schema for FlatMapGroupsWithState in spark connect when there is no initial state [spark] - posted by "huanliwang-db (via GitHub)" <gi...@apache.org> on 2024/12/21 04:19:14 UTC, 3 replies.
- [PR] [SPARK-xxxxx][PYTHON] Add Python Arrow UDF concurrency mode [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2024/12/21 22:04:55 UTC, 2 replies.
- [PR] [SPARK-50644] Read variant struct in Parquet reader. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/12/21 22:40:46 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-49608][SQL] Improve SQL function `sort_array` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/22 00:27:05 UTC, 1 replies.
- Re: [PR] [SPARK-49537][SQL] Improve Join stats estimate [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/22 00:27:06 UTC, 1 replies.
- Re: [PR] [SPARK-49469][CONNECT][TESTS] Add dummy protos for expression and datatype [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/22 00:27:09 UTC, 1 replies.
- Re: [PR] [SPARK-48499][SQL] Use Math.abs to get Positive Numbers [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/22 00:27:10 UTC, 1 replies.
- Re: [PR] [SPARK-50638][SQL] Refactor the view resolution into the separate file to reuse it in the single-pass Analyzer [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/12/22 19:34:40 UTC, 1 replies.
- Re: [PR] [SPARK-50644][SQL] Read variant struct in Parquet reader. [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/23 00:10:16 UTC, 10 replies.
- Re: [PR] [SPARK-49627][SQL] Run SortMergeJoin in batch [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/23 00:25:28 UTC, 1 replies.
- Re: [PR] [TEST Only] Eliminate ui warnings [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/23 00:25:31 UTC, 1 replies.
- [PR] [SPARK-50645][INFRA] Make more daily builds able to manually trigger [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/23 02:03:09 UTC, 5 replies.
- [PR] [SPARK-50646][PYTHON][DOCS] Document explicit style of pyspark plotting [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/12/23 02:54:22 UTC, 2 replies.
- [PR] [SPARK-50527][INFRA][FOLLOW-UP] Python 3.12 image clean up [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/23 04:14:19 UTC, 2 replies.
- [PR] [SPARK-50647][INFRA] Add a daily build for PySpark with old dependencies [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/23 04:50:34 UTC, 8 replies.
- Re: [PR] [SPARK-50618][SS][SQL] Make DataFrameReader and DataStreamReader leverage the analyzer more [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/12/23 05:59:14 UTC, 0 replies.
- [PR] [SPARK-49530][PYTHON] Support pie subplots in pyspark plotting [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/12/23 08:31:14 UTC, 6 replies.
- [PR] Change collations cast behavior [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/12/23 09:29:35 UTC, 0 replies.
- [PR] add home dir for spark user [spark-docker] - posted by "robbertvanwaveren (via GitHub)" <gi...@apache.org> on 2024/12/23 10:53:40 UTC, 0 replies.
- [PR] [SPARK-50648] [core] when the job is cancelled during shuffle retry in parent stage, might leave behind zombie tasks [spark] - posted by "yabola (via GitHub)" <gi...@apache.org> on 2024/12/23 11:31:55 UTC, 0 replies.
- [PR] [SPARK-50650][SQL] Improve logging in single-pass Analyzer [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/12/23 13:38:24 UTC, 9 replies.
- [PR] [SPARK-50360][SS][FOLLOWUP][TESTS] Changelog reader test improvements [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/12/23 15:07:30 UTC, 2 replies.
- [PR] [SPARK-50651][SQL][DOCS] Add note about octal representation for characters [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2024/12/23 16:00:26 UTC, 3 replies.
- [PR] [SPARK-49087] Distinguish UnresolvedFunction calling internal functions [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/12/23 16:25:17 UTC, 0 replies.
- Re: [PR] [SPARK-50649] Fix inconsistencies with casting between different collations [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/12/23 16:33:45 UTC, 2 replies.
- [PR] [SPARK-50652][SS] Add checks to RocksDB V2 backward compatibility [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/12/23 17:43:09 UTC, 0 replies.
- [PR] [SPARK-50639][SQL] Improve warning logging in CacheManager [spark] - posted by "vrozov (via GitHub)" <gi...@apache.org> on 2024/12/23 19:32:30 UTC, 1 replies.
- [PR] Ssm [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/12/23 19:32:55 UTC, 8 replies.
- Re: [PR] [SPARK-49087][SQL][CONNECT] Distinguish UnresolvedFunction calling internal functions [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/23 23:53:14 UTC, 1 replies.
- [PR] [SPARK-49461][SS][FOLLOWUP] [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/12/24 01:09:18 UTC, 0 replies.
- Re: [PR] [SPARK-50648][CORE] when the job is cancelled during shuffle retry in parent stage, might leave behind zombie running tasks [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2024/12/24 02:12:31 UTC, 46 replies.
- [PR] [MINOR][INFRA] Skip step `List Python packages` when `PYTHON_TO_TEST` is not specified [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/24 02:59:10 UTC, 2 replies.
- [PR] [MINOR][SQL][DOCS] Fix spacing with SQL configuration documentation [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/24 07:00:28 UTC, 2 replies.
- [PR] [SPARK-50590][INFRA][FOLLOW-UP] Further skip unnecessary image build by the job modules [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/24 08:37:07 UTC, 2 replies.
- [PR] [SPARK-50657][PYTHON] Upgrade the minimum version of `pyarrow` to 11.0.0 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/24 09:33:38 UTC, 2 replies.
- [PR] [SPARK-50659][SQL] Refactor Union output computation out to reuse it in the single-pass Analyzer [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/12/24 11:01:17 UTC, 3 replies.
- [PR] [SPARK-50659][SQL] Move Union-related errors to QueryCompilationErrors [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/12/24 11:49:57 UTC, 3 replies.
- [PR] [SPARK-50612][SQL][FOLLOWUP] Put normalization of inner project lists under a flag [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2024/12/24 12:57:09 UTC, 0 replies.
- [PR] [SPARK-50662][PYTHON][WINDOWS] Escape ampersands in command arguments on windows [spark] - posted by "Nassizouz (via GitHub)" <gi...@apache.org> on 2024/12/24 14:32:30 UTC, 0 replies.
- [PR] [SPARK-50665][SQL] Substitute LocalRelation with ComparableLocalRelation in NormalizePlan [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/12/24 23:02:14 UTC, 3 replies.
- [PR] [SPARK-50667][PYTHON][TESTS] Make jinja2 optional in PySpark Tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/25 03:36:59 UTC, 0 replies.
- [PR] Add Python Arrow UDF concurrency mode [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2024/12/25 07:27:03 UTC, 1 replies.
- [PR] [SPARK-49632][SQL][FOLLOW-UP] Fix suggestion for `to_date` function [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/12/25 07:48:46 UTC, 3 replies.
- Re: [PR] [SPARK-50220][PYTHON] Support listagg in PySpark [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/25 09:14:12 UTC, 1 replies.
- [PR] [SPARK-50669][SQL] Change the signature of TimestampAdd expression [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2024/12/25 14:26:29 UTC, 5 replies.
- Re: [PR] [SPARK-50510][CONNECT][TEST][FOLLOWUP][3.5] Fix flaky ReattachableExecuteSuite [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/25 16:22:36 UTC, 1 replies.
- [PR] [SPARK-50670] Use Spark 3.5.4 in E2E tests [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/12/25 20:51:43 UTC, 2 replies.
- [PR] [SPARK-48334] [CORE] Release RpcEnv when SparkContext Initialization Fails [spark] - posted by "soumasish (via GitHub)" <gi...@apache.org> on 2024/12/25 21:13:26 UTC, 0 replies.
- [PR] [SPARK-50644][FOLLOWUP][SQL] Fix scalar cast in the shredded reader. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/12/25 22:43:48 UTC, 3 replies.
- Re: [PR] [SPARK-50522][SQL] Support for indeterminate collation [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/12/25 23:23:08 UTC, 7 replies.
- Re: [PR] [SPARK-50667][PYTHON][TESTS] Make `jinja2` optional in PySpark Tests [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/26 00:16:03 UTC, 3 replies.
- Re: [PR] [DO NOT REVIEW] Table and schema level collations [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/26 00:24:07 UTC, 1 replies.
- [PR] [SPARK-50672][PYTHON][TESTS] Make `openpyxl` optional in PySpark Tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/26 06:29:34 UTC, 2 replies.
- [PR] [SPARK-48458][SQL] Data loss in dynamic override fix [spark] - posted by "akupchinskiy (via GitHub)" <gi...@apache.org> on 2024/12/26 06:33:03 UTC, 0 replies.
- [PR] [SPARK-50671][BUILD] Error compiling spark-protobuf module using user-defined protoc [spark] - posted by "morvenhuang (via GitHub)" <gi...@apache.org> on 2024/12/26 06:33:21 UTC, 3 replies.
- [PR] [DO-NOT-MERGE] Pythonic approach of setting Spark SQL configurations [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/26 06:58:56 UTC, 3 replies.
- [PR] [SPARK-50673][ML] Avoid traversing model coefficients twice in `Word2VecModel` constructor [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/26 08:11:45 UTC, 2 replies.
- [PR] [SPARK-50674][PYTHON] Fix check for ‘terminate’ method existence in UDTF evaluation [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/12/26 08:41:21 UTC, 6 replies.
- Re: [PR] [SPARK-50675][SQL] Table and view level collations support [spark] - posted by "dejankrak-db (via GitHub)" <gi...@apache.org> on 2024/12/26 08:52:01 UTC, 2 replies.
- [PR] [SPARK-50676][SQL] Remove unused `private lazy val mapValueContainsNull` from `ElementAt` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/26 10:50:09 UTC, 2 replies.
- [PR] [SPARK-50677][BUILD] Upgrade jupiter-interface to 0.13.3 and Junit5 to 5.11.4 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/26 11:16:50 UTC, 3 replies.
- [PR] Clean up outdated style check rules related to Guava [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/26 12:11:33 UTC, 1 replies.
- Re: [PR] [SPARK-50678][BUILD] Clean up outdated style check rules related to Guava [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/26 12:38:53 UTC, 1 replies.
- [PR] [SPARK-50679][SQL] Duplicated common expressions in different With should be projected only once [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/12/26 14:30:12 UTC, 5 replies.
- Re: [PR] [WIP][SPARK-50636][SQL] Extending CTESubstitution.scala to make it aware of recursion [spark] - posted by "milanisvet (via GitHub)" <gi...@apache.org> on 2024/12/26 16:24:30 UTC, 20 replies.
- Re: [PR] [SPARK-50575][SS] Modifying OperatorStateMetadataV2 to enable schema evolution [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/12/26 22:08:12 UTC, 0 replies.
- Re: [PR] [SPARK-48788][CORE][UI] Expose task peak onheap/offheap execution memory to API and Spark UI [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/27 00:24:14 UTC, 1 replies.
- [PR] [SPARK-50655][SS] Move virt col family related mapping into db layer instead of encoder [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/12/27 00:39:23 UTC, 1 replies.
- [PR] [SPARK-50681][PYTHON][CONNECT] Cache the parsed schema for MapInXXX and ApplyInXXX [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/27 02:20:14 UTC, 3 replies.
- Re: [PR] [SPARK-50622][SS][MINOR] RocksDB Refactor [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/12/27 02:41:33 UTC, 1 replies.
- [PR] [MINOR][PYTHON] Leverage functools.cached_property in `SparkSession` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/27 02:47:43 UTC, 2 replies.
- [PR] [MINOR][PYTHON] Leverage functools.cached_property in ImageSchema [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/27 02:57:34 UTC, 0 replies.
- [PR] [MINOR][PYTHON] Leverage functools.cached_property in `DataFrame` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/27 03:03:48 UTC, 2 replies.
- Re: [PR] [MINOR][PYTHON] Leverage functools.cached_property in `ImageSchema` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/27 03:51:21 UTC, 1 replies.
- [PR] [SPARK-50682][SQL] Inner Alias should be canonicalized [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/12/27 03:55:46 UTC, 2 replies.
- [PR] [SPARK-50683][SQL] Inline the common expression in With if used once [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2024/12/27 05:40:41 UTC, 10 replies.
- [PR] [SPARK-50310][CONNECT][PYTHON][FOLLOW-UP] Delay is_debugging_enabled call after modules are initialized [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/27 06:05:39 UTC, 3 replies.
- [PR] [SPARK-50684][PYTHON] Improve Py4J performance in DataFrameQueryContext [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/27 06:18:03 UTC, 2 replies.
- [PR] [SPARK-50685][PYTHON] Improve Py4J performance by leveraging getattr [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/27 06:41:08 UTC, 2 replies.
- [PR] Aggregation memory usage optimization [spark] - posted by "akupchinskiy (via GitHub)" <gi...@apache.org> on 2024/12/27 07:40:40 UTC, 0 replies.
- [PR] [SPARK-50687][PYTHON] Optimize the logic to get stack traces for DataFrameQueryContext [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/27 08:02:44 UTC, 2 replies.
- [PR] [MINOR][DOCS]fix miss semicolon on describe sql example [spark] - posted by "camilesing (via GitHub)" <gi...@apache.org> on 2024/12/27 10:23:26 UTC, 0 replies.
- [PR] [SPARK-50688][SQL] Eliminate ambiguity for rowTag missing in xml write path [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/12/27 10:31:29 UTC, 1 replies.
- [PR] [SPARK-48665][PYTHON][CONNECT] Support providing a dict in pyspark lit to create a map. [spark] - posted by "skanderboudawara (via GitHub)" <gi...@apache.org> on 2024/12/27 12:31:59 UTC, 7 replies.
- [PR] [SPARK-50689][SQL] Enforce deterministic ordering in LCA project lists [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2024/12/27 12:32:29 UTC, 4 replies.
- [PR] [WIP][PYTHON] Optimize Py4J call for DDL parse method [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/27 13:35:32 UTC, 0 replies.
- [PR] [SPARK-50690][SQL] Fix discrepancy in DESCRIBE TABLE view query output columns quoting [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2024/12/27 14:18:07 UTC, 2 replies.
- [PR] [SQL][FOLLOWUP] Update ComparableLocalRelation to support UnsafeRow comparison [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/12/27 15:19:26 UTC, 0 replies.
- [PR] [SPARK-50661] Fix Spark Connect Scala foreachBatch impl. to support Dataset[T]. [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2024/12/27 15:23:17 UTC, 0 replies.
- [PR] [SPARK-49229][Connect] Deduplicate Scala UDF handling in the SparkConnectPlanner [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/12/27 16:37:31 UTC, 2 replies.
- [PR] [SPARK-50692] Add RPAD pushdown support [spark] - posted by "andrej-db (via GitHub)" <gi...@apache.org> on 2024/12/27 17:34:48 UTC, 5 replies.
- Re: [PR] [SPARK-50661][CONNECT][SS] Fix Spark Connect Scala foreachBatch impl. to support Dataset[T]. [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/12/27 22:05:07 UTC, 4 replies.
- [PR] [WIP][SPARK-47854][PYTHON][CONNECT] Avoid shadowing python built-ins in python function variable naming [spark] - posted by "skanderboudawara (via GitHub)" <gi...@apache.org> on 2024/12/27 22:29:06 UTC, 4 replies.
- [PR] [SPARK-50693][CONNECT] The inputs for TypedScalaUdf should be analyzed [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/12/27 22:31:30 UTC, 3 replies.
- Re: [PR] [SPARK-21195][CORE] Dynamically register metrics from sources as they are reported [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/28 00:23:44 UTC, 1 replies.
- Re: [PR] [SPARK-48532][BUILD] Upgrade maven plugin to latest version [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/28 00:23:45 UTC, 1 replies.
- [PR] When aliasMap doesn't contain alias, throw exception [spark] - posted by "tedyu (via GitHub)" <gi...@apache.org> on 2024/12/28 05:47:00 UTC, 1 replies.
- Re: [PR] [SPARK-49303][SS] Implement TTL for ValueState in transformWithStateInPandas API [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/28 07:31:36 UTC, 0 replies.
- Re: [PR] [SPARK-43338]Session Catalog Name support modification [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/29 00:27:11 UTC, 1 replies.
- Re: [PR] [SPARK-49675][SQL][HIVE] Support push down CaseWhen filter to Hive metastore [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/29 00:27:13 UTC, 1 replies.
- [PR] Alter optizime [spark] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/12/29 06:03:58 UTC, 0 replies.
- Re: [PR] [SPARK-50695][SQL] Alter table with properties check for empty string [spark] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/12/29 12:38:50 UTC, 5 replies.
- [I] Integration tests are panic due to localhost resolved to IPv6 address [spark-connect-go] - posted by "alexott (via GitHub)" <gi...@apache.org> on 2024/12/29 18:32:57 UTC, 1 replies.
- [PR] [Doc] Improve contributor guide [spark-connect-go] - posted by "alexott (via GitHub)" <gi...@apache.org> on 2024/12/29 18:40:53 UTC, 3 replies.
- [PR] [ADHOC] Updated Spark Version for CI build [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/12/29 21:43:12 UTC, 2 replies.
- Re: [I] UserContext userid handling in Go is not aligned with Pyspark Connect [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/12/29 21:55:38 UTC, 0 replies.
- Re: [I] `types.Row.FieldNames()` not in order [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/12/29 22:00:00 UTC, 0 replies.
- [PR] [#58] Adding Unpivot/Melt [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/12/29 22:31:05 UTC, 2 replies.
- Re: [PR] [Minor] Catch exception from snapshot uploading [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/30 00:25:38 UTC, 1 replies.
- Re: [PR] [SPARK-49730][SQL] classify syntax errors for pgsql, mysql, sqlserver and h2 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/30 00:25:39 UTC, 1 replies.
- Re: [PR] [SPARK-50696][PYTHON] Optimize Py4J call for DDL parse method [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/30 01:46:47 UTC, 3 replies.
- Re: [PR] [SPARK-50691][SQL][FOLLOWUP] Use UnsafeProjection for LocalRelation rows instead of ComparableLocalRelation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/12/30 04:05:51 UTC, 5 replies.
- [PR] Add `@tailrec` to `ForStatementExec#treeIterator.next/SinglePartitionShuffleWithGlobalOrdering.unapply/SparkPlanWithGlobalOrdering` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/12/30 06:00:56 UTC, 0 replies.
- [PR] [SPARK-50699][PYTHON] Parse and generate DDL string with a specified session [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/30 07:03:23 UTC, 2 replies.
- [PR] [SPARK-50700][SQL] `spark.sql.catalog.spark_catalog` supports `builtin` magic value [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/12/30 07:50:19 UTC, 6 replies.
- [PR] [WIP] Added implementation of FillNa [spark-connect-go] - posted by "alexott (via GitHub)" <gi...@apache.org> on 2024/12/30 08:50:28 UTC, 18 replies.
- Re: [I] Add Support for Additional DataFrame Functionality [spark-connect-go] - posted by "alexott (via GitHub)" <gi...@apache.org> on 2024/12/30 09:06:04 UTC, 1 replies.
- [PR] [SPARK-50701][PYTHON] Make plotting require the minimum plotly version [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/12/30 09:30:43 UTC, 5 replies.
- [PR] [SPARK-50689][SQL][FOLLOWUP] Enforce deterministic ordering in LCA aggregate lists [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2024/12/30 10:24:43 UTC, 2 replies.
- [PR] [SPARK-50704][SQL] Support more pushdown functions for MySQL connector [spark] - posted by "sunxiaoguang (via GitHub)" <gi...@apache.org> on 2024/12/30 13:48:48 UTC, 3 replies.
- [I] Make Types and Literals Safer [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/12/30 14:59:55 UTC, 2 replies.
- [PR] [#95]Improve Compile-Time Safety for Literals [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/12/30 15:01:55 UTC, 0 replies.
- [PR] #84 adding `Replace()` and `ReplaceWithColumns` [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/12/30 15:59:47 UTC, 2 replies.
- Re: [PR] #95 Improve Compile-Time Safety for Literals [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/12/30 16:01:04 UTC, 1 replies.
- [PR] [SPARK-50694][SQL] Support renames in subqueries [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/12/30 21:04:32 UTC, 1 replies.
- [PR] Supporting Spark-Submit for Spark Connect Go [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/12/30 21:20:15 UTC, 2 replies.
- Re: [PR] [SPARK-46088][PYTHON][SQL][DOCS] Add a self-contained example dataframe from jdbc MySQL [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/12/31 00:24:16 UTC, 0 replies.
- Re: [PR] [SPARK-50697][SQL] Enable tail-recursion wherever possible [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/31 05:11:50 UTC, 2 replies.
- [PR] [SPARK-50706][PYTHON][TESTS] Skip test_value_state_ttl_expiration in Coverage build [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/12/31 05:28:46 UTC, 4 replies.
- [PR] [SPARK-50702][PYTHON] Refine the docstring of regexp_count, regexp_extract and regexp_extract_all [spark] - posted by "drexler-sky (via GitHub)" <gi...@apache.org> on 2024/12/31 07:50:22 UTC, 2 replies.
- Re: [PR] [SPARK-50705][SQL] Make `QueryPlan` lockfree [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/12/31 09:58:51 UTC, 2 replies.
- [PR] [SPARK-49230] Do not return UnboundRowEncoder when not needed [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/12/31 10:40:42 UTC, 0 replies.
- [PR] [SPARK-50707] Enable casting to/from char/varchar [spark] - posted by "jovanm-db (via GitHub)" <gi...@apache.org> on 2024/12/31 10:58:15 UTC, 1 replies.
- [PR] [SPARK-50708] Delete Artifact resources on GC of `ArtifactManager` instance [spark] - posted by "vicennial (via GitHub)" <gi...@apache.org> on 2024/12/31 11:59:15 UTC, 4 replies.
- Re: [PR] Added implementations of FillNa [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/12/31 12:09:44 UTC, 1 replies.
- Re: [PR] [SPARK-50648][CORE] Cleanup zombie tasks in non-running stages when the job is cancelled [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2024/12/31 12:20:50 UTC, 2 replies.
- Re: [PR] #84 adding `Replace()` [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/12/31 13:37:06 UTC, 1 replies.
- Re: [PR] [SPARK-49230][Connect][SQL] Do not return UnboundRowEncoder when not needed [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/12/31 14:45:22 UTC, 0 replies.
- [PR] #58 Adding `DropNa` and `df.na.*` methods [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/12/31 15:56:57 UTC, 0 replies.