reviews@spark.apache.org, 2024-11

You are viewing a plain text version of this content. The canonical link for it is here.

- Re: [PR] [SS] [SPARK-50163] Fix the RocksDB extra acquireLock release due to the completion listener [spark] - posted by "liviazhu-db (via GitHub)" <gi...@apache.org> on 2024/11/01 00:06:11 UTC, 2 replies.
- [PR] [SPARK-50197][PYTHON][INFRA] Install Jinja2 for Python 3.13 build [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/01 00:13:13 UTC, 8 replies.
- [PR] [SPARK-50198][ML][CONNECT] Skip CrossValidatorTestsOnConnect if torch is not installed [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/01 00:20:40 UTC, 2 replies.
- Re: [PR] [SPARK-50166][SQL][BUILD] Fix shade and relocation rule of `sql/core` module [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/01 00:24:48 UTC, 3 replies.
- Re: [PR] [SPARK-44884][Core] Create _SUCCESS marker file for spark write with … [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/01 00:27:06 UTC, 0 replies.
- Re: [PR] [SPARK-48948][SQL] Introduce `SHOW VARIABLES LIKE ... ` SQL syntax to get variables [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/01 00:27:07 UTC, 5 replies.
- Re: [PR] [SPARK-48856][SQL] Use isolated JobArtifactSet for each spark session [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/01 00:27:08 UTC, 1 replies.
- Re: [PR] [SPARK-50196][CONNECT] Fix Python error context to use a proper context [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/11/01 00:30:26 UTC, 4 replies.
- Re: [PR] [SPARK-50189][SQL] Upgrade ICU4J to `76.1` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/01 01:14:52 UTC, 31 replies.
- Re: [PR] [SPARK-50195][CORE] Fix `StandaloneRestServer` to propagate `spark.app.name` to `SparkSubmit` properly [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/01 02:37:12 UTC, 2 replies.
- Re: [PR] [SPARK-50193][SS] Fix exception handling for validating time modes [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/11/01 02:41:16 UTC, 1 replies.
- Re: [PR] [SPARK-50162][SS][TESTS] Add tests for loading snapshot with given version for transformWithState operator state and state data source reader [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/11/01 02:52:45 UTC, 14 replies.
- Re: [PR] [SPARK-50176][CONNECT][3.5] Disallow reattaching after the session is closed [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/01 03:03:02 UTC, 4 replies.
- Re: [PR] [SQL] Add SQL pipe syntax for the FROM operator [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/01 03:04:02 UTC, 1 replies.
- Re: [PR] [SPARK-50157][SQL] Using SQLConf provided by SparkSession first. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2024/11/01 03:12:29 UTC, 7 replies.
- Re: [PR] [SPARK-50092][SQL] Fix PostgreSQL connector behaviour for multidimensional arrays [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/11/01 03:19:07 UTC, 14 replies.
- Re: [PR] [SPARK-50190][PYTHON] Remove direct dependency of Numpy from Histogram [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/11/01 03:20:41 UTC, 0 replies.
- Re: [PR] [SPARK-50151][SS][RocksDB Hardening] - Fix ineffective file reuse bug in the new file management change [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2024/11/01 03:28:54 UTC, 7 replies.
- Re: [PR] [SPARK-50188][CONNECT] When the connect client starts, print the server's webUrl [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/01 03:40:46 UTC, 4 replies.
- Re: [PR] [TYPING] Add type overloads for inplace dataframe operations [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/01 03:50:44 UTC, 0 replies.
- Re: [PR] [SPARK-49868][DOC][FOLLOWUP] Update docs for executor failure tracking configrations [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/11/01 04:57:51 UTC, 0 replies.
- [PR] [SPARK-50199][PYTHON][TESTS] Use Spark 3.4.4 version instead of 3.0.1 in `test_install_spark` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/01 05:10:47 UTC, 0 replies.
- Re: [PR] [SPARK-50199][PYTHON][TESTS] Use Spark 3.4.4 instead of 3.0.1 in `test_install_spark` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/01 05:15:52 UTC, 5 replies.
- [PR] [SPARK-50200][PYTHON] Remove unused `have_numpy` testing utility [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/11/01 05:18:18 UTC, 0 replies.
- Re: [PR] Publish 3.4.4 to docker registry [spark-docker] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/11/01 05:46:31 UTC, 1 replies.
- Re: [PR] [SPARK-50200][PYTHON] Remove unused `have_numpy` testing utility from `sqlutils.py` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/01 05:54:02 UTC, 2 replies.
- Re: [PR] [SPARK-50163][SS] Fix the RocksDB extra acquireLock release due to the completion listener [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/11/01 05:56:01 UTC, 10 replies.
- Re: [PR] [SPARK-50184][SS][TESTS]Make test case 'SPARK-48997: maintenance threads with exceptions unload only themselves' use a self-cleaning `rootLocation` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/11/01 06:03:16 UTC, 0 replies.
- Re: [PR] [SPARK-50184][SS][TESTS] Make test case `SPARK-48997: maintenance threads with exceptions unload only themselves` use a self-cleaning `rootLocation` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/01 06:52:58 UTC, 2 replies.
- Re: [PR] [SPARK-50146][PYTHON][CONNECT] Configurable schema validation when creating DataFrames from Arrow tables [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/11/01 07:31:40 UTC, 0 replies.
- [PR] [SPARK-49530][PYTHON] Get active session from dataframes [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/01 07:43:49 UTC, 2 replies.
- Re: [PR] [SPARK-49730][SQL] classify syntax errors for pgsql, mysql, sqlserver and h2 [spark] - posted by "ivanjevtic-db (via GitHub)" <gi...@apache.org> on 2024/11/01 11:59:32 UTC, 0 replies.
- Re: [PR] [SPARK-48139][CONNECT][TESTS] Try stabilising multi-thread tests in CI [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/11/01 14:15:37 UTC, 1 replies.
- [PR] [SPARK-50205][SQL] Disable flaky test `Cancellation APIs in SparkSession are isolated` [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/11/01 14:21:20 UTC, 2 replies.
- [PR] [SPARK-50206 ]Added separate collation id for utf8_binary and non-collated strings [spark] - posted by "vladanvasi-db (via GitHub)" <gi...@apache.org> on 2024/11/01 14:55:35 UTC, 1 replies.
- Re: [PR] Add Sample functionality in DataFrame. [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/11/01 15:07:02 UTC, 5 replies.
- [PR] [SPARK-50204][SQL] Factor out `HiveTableRelation` read path resolution [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/11/01 15:14:52 UTC, 2 replies.
- Re: [PR] Add config support [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/11/01 15:35:38 UTC, 1 replies.
- Re: [PR] [SPARK-49696][SPARK-50207][SQL] Disable flaky test `Cancellation APIs in SparkSession are isolated` [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/11/01 15:40:16 UTC, 0 replies.
- Re: [PR] [SPARK-49249][SPARK-49122] Artifact isolation in Spark Classic [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/11/01 16:14:50 UTC, 34 replies.
- Re: [PR] [SPARK-50033][SQL] Add a hint to logical.Aggregate() node [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/01 16:59:36 UTC, 1 replies.
- Re: [PR] [SPARK-50112] Allowing the TransformWithState operator to use Avro encoding [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/01 17:03:02 UTC, 0 replies.
- [PR] [SPARK-49670][SQL]Enable trim collation for all passthrough expressions [spark] - posted by "jovanpavl-db (via GitHub)" <gi...@apache.org> on 2024/11/01 17:59:02 UTC, 8 replies.
- Re: [PR] [SPARK-49827][SQL] Fetching all partitions from hive metastore in batches [spark] - posted by "Madhukar525722 (via GitHub)" <gi...@apache.org> on 2024/11/01 18:37:49 UTC, 0 replies.
- Re: [PR] [SPARK-49563][SQL] Add SQL pipe syntax for the WINDOW operator [spark] - posted by "Angryrou (via GitHub)" <gi...@apache.org> on 2024/11/01 19:09:26 UTC, 47 replies.
- Re: [PR] [SPARK-49565][SQL] Add SQL pipe syntax for the FROM operator [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/11/01 19:18:02 UTC, 7 replies.
- Re: [PR] [SPARK-50206][SQL] Added separate collation id for UTF8_BINARY and non-collated strings [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/11/01 22:14:36 UTC, 26 replies.
- [PR] [SPARK-50208][CORE] Support `spark.master.useDriverIdAsAppName.enabled` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/01 22:42:05 UTC, 7 replies.
- Re: [PR] [MINOR][DOC] Fix window function docs [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/02 00:23:54 UTC, 1 replies.
- Re: [PR] [SPARK-48637][CORE] On-demand shuffle migration peer refresh during decommission [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/02 00:23:56 UTC, 1 replies.
- Re: [PR] [SPARK-37178][ML] Add Target Encoding to ml.feature [spark] - posted by "srowen (via GitHub)" <gi...@apache.org> on 2024/11/02 13:09:05 UTC, 10 replies.
- Re: [I] Add docker file for spark connect server. [spark-connect-go] - posted by "imvtsl (via GitHub)" <gi...@apache.org> on 2024/11/02 20:15:06 UTC, 0 replies.
- Re: [PR] [SPARK-50154][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_0043`: `INVALID_RESET_COMMAND_FORMAT` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/02 22:18:53 UTC, 1 replies.
- Re: [PR] [SPARK-50032][SQL] Allow use of fully qualified collation name [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/02 22:25:11 UTC, 28 replies.
- Re: [PR] [SPARK-49696][SQL][TESTS] Disable flaky test `Cancellation APIs in SparkSession are isolated` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/02 22:51:46 UTC, 4 replies.
- [PR] [SPARK-50209][R][INFRA] Use R 4.4.2 in `windows` R GitHub Action Windows job [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/02 23:07:24 UTC, 5 replies.
- Re: [PR] [TEST janino] v3.1.12 VS v3.1.9 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/03 00:26:50 UTC, 2 replies.
- [PR] [SPARK-50210][CORE] Fix `SparkSubmit` to show REST API `kill` response properly [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/03 06:15:16 UTC, 5 replies.
- Re: [PR] [SPARK-49490][SQL] Add benchmarks for initCap [spark] - posted by "mrk-andreev (via GitHub)" <gi...@apache.org> on 2024/11/03 16:46:50 UTC, 20 replies.
- [PR] [SPARK-50211][PYTHON][CONNECT][TESTS] Skip FeatureTests if torch is not installed [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/03 22:12:58 UTC, 2 replies.
- Re: [PR] [SPARK-50128][SS] Add stateful processor handle APIs using implicit encoders in Scala [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/11/04 01:27:32 UTC, 7 replies.
- [PR] Is change 3.5 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/11/04 05:17:13 UTC, 0 replies.
- Re: [PR] [SPARK-49601][SS][PYTHON] Support Initial State Handling for TransformWithStateInPandas [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/11/04 05:45:52 UTC, 20 replies.
- Re: [PR] [SPARK-50212][BUILD][3.5] Fix the conditional check for executing the `build` task in `build_and_test.yml` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/11/04 05:55:24 UTC, 10 replies.
- Re: [PR] [SPARK-49899][PYTHON][SS] Support deleteIfExists for TransformWithStateInPandas [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/11/04 06:43:19 UTC, 4 replies.
- Re: [PR] [SPARK-50017] Support Avro encoding for TransformWithState operator - ValueState, ListState [spark] - posted by "09306677806 (via GitHub)" <gi...@apache.org> on 2024/11/04 07:41:36 UTC, 13 replies.
- Re: [PR] [WIP][SPARK-48344][SQL] SQL Scripting execution (including Spark Connect) [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2024/11/04 08:59:57 UTC, 1 replies.
- Re: [PR] [SPARK-50152][SS] Support handleInitialState with state data source reader [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/11/04 09:03:53 UTC, 21 replies.
- [PR] [WIP][SPARK-50176][CONNECT][FOLLOWUP][3.5] TEST [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/11/04 09:42:36 UTC, 0 replies.
- Re: [PR] [SPARK-50176][CONNECT][FOLLOWUP][3.5] Fix ReattachableExecuteSuite failure [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/11/04 10:15:22 UTC, 4 replies.
- Re: [PR] [SPARK-49661][SQL] Implement trim collation hashing and comparison. [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/04 11:04:48 UTC, 1 replies.
- [PR] [Only TEST] Test sbt 1.10.5 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/04 11:49:19 UTC, 1 replies.
- [PR] [SPARK-49615] [ML] Make all ML feature transformers conforming "spark.sql.caseSensitive" config. [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2024/11/04 12:04:02 UTC, 0 replies.
- [PR] [WIP][SPARK-42746][SQL] Implement LISTAGG function [spark] - posted by "mikhailnik-db (via GitHub)" <gi...@apache.org> on 2024/11/04 15:22:12 UTC, 8 replies.
- [PR] [SPARK-50215] Refactored StringType pattern matching in jdbc code stack [spark] - posted by "vladanvasi-db (via GitHub)" <gi...@apache.org> on 2024/11/04 15:35:05 UTC, 1 replies.
- [PR] [SPARK-50214][SQL] From json/xml should not change collations in the given schema [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/11/04 15:39:36 UTC, 13 replies.
- Re: [PR] [SPARK-50189][BUILD][SQL] Upgrade ICU4J to `76.1` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/04 17:23:39 UTC, 2 replies.
- [PR] [SPARK-50217][BUILD][TESTS] Upgrade `bouncycastle` to 1.79 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/04 17:39:25 UTC, 3 replies.
- [PR] [SPARK-50218][BUILD] Upgrade checkstyle to 10.20.0 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/04 17:54:33 UTC, 2 replies.
- Re: [PR] [SPARK-49815] Refactoring type coercion rules for binary operators [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2024/11/04 18:02:28 UTC, 0 replies.
- [PR] Refactor `ApplyCharTypePadding` so that helper methods can be used in single-pass resolver [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2024/11/04 18:03:44 UTC, 2 replies.
- Re: [PR] [SPARK-50219] Refactor `ApplyCharTypePadding` so that helper methods can be used in single-pass resolver [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2024/11/04 19:55:09 UTC, 2 replies.
- Re: [PR] [WIP] [SPARK-50127] Implement Avro encoding for MapState and PrefixKeyScanStateEncoder [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/11/04 20:01:46 UTC, 0 replies.
- Re: [PR] [SPARK-49615] [ML] Make all ML feature transformers dataset schema validation conforming "spark.sql.caseSensitive" config. [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/04 21:41:13 UTC, 0 replies.
- Re: [PR] [MINOR][DOCS][3.5] Fix specified java versions in `install.rst` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/04 21:44:36 UTC, 0 replies.
- [PR] [WIP][SPARK-50221][SQL] GROUP BY ALL support for SQL pipe aggregation [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/11/05 00:38:18 UTC, 2 replies.
- [PR] [SPARK-50222][CORE] Support `spark.submit.appName` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/05 00:54:07 UTC, 35 replies.
- Re: [PR] [SPARK-50144][SS] Address the limitation of metrics calculation with DSv1 streaming sources [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/11/05 01:28:59 UTC, 0 replies.
- [PR] Test upgrade buf gen plugins [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/11/05 05:51:47 UTC, 1 replies.
- [PR] Add a script to generate StateMessage_pb2.py and StateMessage_pb2.pyi using buf [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/11/05 05:56:09 UTC, 3 replies.
- [PR] [SPARK-50224][SQL] The replacements of IsValidUTF8|ValidateUTF8|TryValidateUTF8|MakeValidUTF8 shall be NullIntolerant [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/11/05 07:07:31 UTC, 5 replies.
- Re: [PR] [SPARK-47573][K8S] Support custom driver log url [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/11/05 07:32:34 UTC, 6 replies.
- Re: [PR] [SPARK-50055][SQL] Add TryMakeInterval alternative [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/11/05 08:06:17 UTC, 10 replies.
- Re: [PR] [SPARK-42746][SQL] Implement LISTAGG function [spark] - posted by "mikhailnik-db (via GitHub)" <gi...@apache.org> on 2024/11/05 10:36:27 UTC, 83 replies.
- Re: [PR] [SPARK-50028][CONNECT] Replace global locks in Spark Connect server listener with fine-grained locks [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/11/05 13:15:27 UTC, 2 replies.
- Re: [PR] [SPARK-50215][SQL] Refactored StringType pattern matching in jdbc code stack [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/05 13:22:26 UTC, 3 replies.
- Re: [PR] [SPARK-50139][INFRA][SS][PYTHON] Introduce scripts to re-generate and checking `StateMessage_pb2.py` and `StateMessage_pb2.pyi` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/11/05 14:45:05 UTC, 2 replies.
- Re: [PR] [SPARK-50219][SQL] Refactor `ApplyCharTypePadding` so that helper methods can be used in single-pass resolver [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/05 15:25:16 UTC, 1 replies.
- Re: [PR] [SPARK-50227][CONNECT][PYTHON] Upgrade buf plugins to `v28.3` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/05 15:34:00 UTC, 7 replies.
- [PR] [WIP][SQL] Move the `RewriteCollationJoin` rule to `FinishAnalysis` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/05 16:43:04 UTC, 0 replies.
- Re: [PR] [SPARK-50228][SQL] Move the `RewriteCollationJoin` rule to `FinishAnalysis` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/05 16:58:02 UTC, 4 replies.
- Re: [PR] [SPARK-50112][SQL] Allowing the TransformWithState operator to use Avro encoding [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/05 17:08:27 UTC, 5 replies.
- [PR] [SPARK-50230][SQL] Added logic to support reading unknown collation name as utf8_binary [spark] - posted by "vladanvasi-db (via GitHub)" <gi...@apache.org> on 2024/11/05 17:20:57 UTC, 8 replies.
- [PR] [SPARK-50231][PYTHON] Make function `instr` accept Column `substring` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/05 17:25:47 UTC, 2 replies.
- [PR] [SPARK-50229] Reduce memory usage on driver for wide schemas by reducing the lifetime of AttributeReference objects created during logical planning [spark] - posted by "utkarsh39 (via GitHub)" <gi...@apache.org> on 2024/11/05 17:28:36 UTC, 2 replies.
- [PR] [SPARK-50232][PYTHON][CONNECT] Add 'protobuf==5.28.3' in dev/requirements.txt [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/05 17:54:36 UTC, 3 replies.
- [PR] [SPARK-50233][PYTHON][CONNECT][TESTS] Skip PipelineTests if torch is not installed [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/05 18:05:59 UTC, 3 replies.
- Re: [PR] [SPARK-50118][CONNET] Reset isolated state cache when tasks are running [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/05 18:11:17 UTC, 2 replies.
- Re: [PR] [SPARK-50156][SQL] Integrate `_LEGACY_ERROR_TEMP_2113` into `UNRECOGNIZED_STATISTIC` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/11/05 18:35:57 UTC, 2 replies.
- [PR] [MINOR][SQL] Add more description to SKIP_TYPE_VALIDATION_ON_ALTER_PARTITION [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2024/11/05 19:26:49 UTC, 12 replies.
- [PR] [SPARK-50234][PYTHON][SQL] Improve error message and test for transpose DataFrame API [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/11/05 20:04:24 UTC, 5 replies.
- Re: [PR] [SPARK-49995][SQL] Add named argument support to more TVFs [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/11/05 20:44:50 UTC, 2 replies.
- [PR] [SPARK-XXXXX][SQL] Clean up ColumnVector resource after processing all rows in ColumnarToRowExec [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2024/11/05 22:10:37 UTC, 0 replies.
- [PR] [SPARK-50236][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_1156`: `COLUMN_NOT_FOUND_IN_SCHEMA` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/11/05 22:15:48 UTC, 2 replies.
- Re: [PR] [SPARK-50235][SQL] Clean up ColumnVector resource after processing all rows in ColumnarToRowExec [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2024/11/05 22:17:18 UTC, 4 replies.
- [PR] [SPARK-50237][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_2139`: `CIRCULAR_CLASS_REFERENCE` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/11/05 23:03:49 UTC, 1 replies.
- Re: [PR] [SPARK-50135][BUILD] Upgrade ZooKeeper to 3.9.3 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/06 00:49:30 UTC, 36 replies.
- Re: [PR] [SPARK-50130][SQL][PYTHON] Add DataFrame APIs for scalar and exists subqueries [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/11/06 00:54:31 UTC, 13 replies.
- Re: [PR] [SPARK-50188][CONNECT][PYTHON] When the connect client starts, print the server's webUrl [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/06 01:19:15 UTC, 5 replies.
- [PR] [SPARK-50238][PYTHON] Add Variant Support in PySpark UDFs/UDTFs [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/11/06 01:47:41 UTC, 24 replies.
- Re: [PR] [SPARK-50011][INFRA] Add a separate docker file for doc build [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/06 03:40:01 UTC, 2 replies.
- Re: [PR] [SPARK-50096][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_2150`: `TUPLE_SIZE_EXCEEDS_LIMIT` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/06 08:03:26 UTC, 1 replies.
- [PR] [SPARK-50241][SQL] Replace NullIntolerant Mixin with Expression.nullIntolerant method [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/11/06 08:30:34 UTC, 22 replies.
- Re: [PR] [SPARK-50016][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_2067`: `UNSUPPORTED_PARTITION_TRANSFORM` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/06 08:47:48 UTC, 6 replies.
- [PR] [WIP] [SPARK-50226] Throw ARITHMETIC_OVERFLOW in MakeYMInterval and MakeDTInterval [spark] - posted by "gotocoding-DB (via GitHub)" <gi...@apache.org> on 2024/11/06 10:24:22 UTC, 0 replies.
- Re: [PR] [WIP] [SPARK-50226] [SQL] Throw ARITHMETIC_OVERFLOW in MakeYMInterval and MakeDTInterval [spark] - posted by "gotocoding-DB (via GitHub)" <gi...@apache.org> on 2024/11/06 10:36:29 UTC, 3 replies.
- Re: [PR] [SPARK-48590][BUILD] Upgrade netty to `4.1.114.Final` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/06 10:44:51 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-50226][SQL] Correct MakeDTInterval and MakeYMInterval to catch Java exceptions [spark] - posted by "gotocoding-DB (via GitHub)" <gi...@apache.org> on 2024/11/06 11:24:33 UTC, 23 replies.
- Re: [PR] [SPARK-43190][SQL] ListQuery.childOutput should be consistent with child output [spark] - posted by "PengleiShi (via GitHub)" <gi...@apache.org> on 2024/11/06 13:28:06 UTC, 0 replies.
- [PR] [SPARK-50245][SQL] Extended CollationSuite and added tests where SortMergeJoin is forced [spark] - posted by "vladanvasi-db (via GitHub)" <gi...@apache.org> on 2024/11/06 15:08:15 UTC, 7 replies.
- Re: [PR] [SPARK-45278][YARN] Support executor bind address in Yarn executors [spark] - posted by "gedeh (via GitHub)" <gi...@apache.org> on 2024/11/06 16:20:12 UTC, 7 replies.
- [PR] [SPARK-50246][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_2167`: `MALFORMED_RECORD_IN_SCHEMA_INFERENCE` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/11/06 17:06:31 UTC, 2 replies.
- [PR] [SPARK-50247][CORE] Define `BLOCK_MANAGER_REREGISTRATION_FAILED` as `ExecutorExitCode` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/06 17:22:34 UTC, 9 replies.
- [PR] [MINOR][PYTHON][SQL] Trigger Python source lookup only once [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/06 17:56:30 UTC, 2 replies.
- [PR] [SPARK-50248][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_2058`: `INVALID_PARTITION_COLUMN_CAST` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/11/06 18:35:47 UTC, 2 replies.
- [PR] [SPARK-48898] Add Variant shredding functions [spark] - posted by "cashmand (via GitHub)" <gi...@apache.org> on 2024/11/06 19:16:35 UTC, 1 replies.
- Re: [PR] [SPARK-50249][PYTHON][SQL] Trigger Python source lookup only once [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/06 19:45:38 UTC, 3 replies.
- [PR] [SPARK-50250][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_2075`: `UNSUPPORTED_FEATURE.WRITE_FOR_BINARY_SOURCE` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/11/06 20:14:34 UTC, 5 replies.
- Re: [PR] [SPARK-48898][SQL] Add Variant shredding functions [spark] - posted by "cashmand (via GitHub)" <gi...@apache.org> on 2024/11/06 20:48:38 UTC, 11 replies.
- [PR] [SPARK-50251][PYTHON] Add `getSystemProperty` to PySpark `SparkContext` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/06 21:06:12 UTC, 12 replies.
- [PR] [SPARK-50208][CORE][FOLLOWUP] Rename `useDriverIdAsAppId` variable to `useDriverIdAsAppName` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/06 21:37:11 UTC, 6 replies.
- [PR] [SPARK-50253] Stream-Stream Join should not fetch checkpoint ID if not supported. [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2024/11/06 23:19:24 UTC, 0 replies.
- [PR] [SPARK-50254][PS][TESTS] Enable test `DataFramePlotParityTests` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/07 00:04:01 UTC, 2 replies.
- [PR] [SPARK-50255][PYTHON] Avoid unnecessary casting in `compute_hist` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/07 00:09:42 UTC, 2 replies.
- Re: [PR] [SPARK-47618][CORE] Use `Magic Committer` for all S3 buckets by default [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/07 00:23:51 UTC, 0 replies.
- Re: [PR] [SPARK-42199][SQL] Fix issues around Dataset.groupByKey [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/07 01:07:02 UTC, 6 replies.
- [PR] Revert "[SPARK-48273][SQL] Fix late rewrite of PlanWithUnresolvedIdentifier [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/07 01:18:29 UTC, 3 replies.
- [PR] [SPARK-50256][SQL] Add lightweight validation to check if a logical plan becomes unresolved after every optimizer rule [spark] - posted by "kelvinjian-db (via GitHub)" <gi...@apache.org> on 2024/11/07 01:29:17 UTC, 2 replies.
- Re: [PR] [SPARK-49886] Query level failure test for rocksDB format V2 [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2024/11/07 05:00:18 UTC, 1 replies.
- Re: [PR] [SPARK-50253][SS] Stream-Stream Join should not fetch checkpoint ID if not supported. [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/11/07 05:32:41 UTC, 1 replies.
- [PR] [SPARK-50222][PYTHON][FOLLOWUP] Support `spark.submit.appName` in PySpark [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/07 08:06:40 UTC, 10 replies.
- Re: [PR] [SPARK-48292][CORE] Revert [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort stage when committed file not consistent with task status [spark] - posted by "grishaw (via GitHub)" <gi...@apache.org> on 2024/11/07 08:10:37 UTC, 1 replies.
- [PR] [SPARK-50258][SQL] Keep the output order after AQE optimization [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2024/11/07 08:55:21 UTC, 9 replies.
- [PR] [SPARK-50259][BUILD] Update Parquet-Java to 1.14.4 [spark] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2024/11/07 09:51:29 UTC, 6 replies.
- [PR] [SPARK-49907] Support spark.ml on Connect [spark] - posted by "wbo4958 (via GitHub)" <gi...@apache.org> on 2024/11/07 10:16:10 UTC, 3 replies.
- [PR] [SPARK-50260][CONNECT] Refactor and optimize Spark Connect execution and session management [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/11/07 13:01:19 UTC, 2 replies.
- Re: [PR] [SPARK-50113][CONNECT][PYTHON][TESTS] Compatibility check should respect `ONLY_SUPPORTED_WITH_SPARK_CONNECT` [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/11/07 14:01:03 UTC, 1 replies.
- [PR] [SPARK-50261] Fix error signature for invalid fraction of a second [spark] - posted by "markonik-db (via GitHub)" <gi...@apache.org> on 2024/11/07 15:03:22 UTC, 0 replies.
- [PR] [WIP][SPARK-48356][SQL] Support for FOR statement [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2024/11/07 15:32:37 UTC, 13 replies.
- [I] spark.Config fails to set values in the current session / user due to lacking UserContext [spark-connect-go] - posted by "magpierre (via GitHub)" <gi...@apache.org> on 2024/11/07 16:18:06 UTC, 1 replies.
- [PR] [SPARK-49913] Add check for unique label names in nested labeled scopes [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2024/11/07 16:36:13 UTC, 1 replies.
- Re: [PR] [SPARK-49913][SQL] Add check for unique label names in nested labeled scopes [spark] - posted by "dejankrak-db (via GitHub)" <gi...@apache.org> on 2024/11/07 17:38:51 UTC, 19 replies.
- [PR] (FIX Issue #87) Correct Config to accurately set UserContext [spark-connect-go] - posted by "magpierre (via GitHub)" <gi...@apache.org> on 2024/11/07 17:44:16 UTC, 2 replies.
- [PR] [SPARK-50264][SQL][CONNECT ]Add missing methods to DataStreamWriter. [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/11/07 18:05:26 UTC, 0 replies.
- [PR] [SPARK-50267][ML] Improve `TargetEncoder.fit` to be based on DataFrame APIs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/07 21:22:02 UTC, 4 replies.
- [PR] [SPARK-50268][SQL][TESTS] Upgrade oracle jdbc driver to 23.6.0.24.10 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/07 23:42:56 UTC, 0 replies.
- [PR] [SPARK-48912][SQL][TESTS] Further improve collation support testing for various collations [spark] - posted by "dejankrak-db (via GitHub)" <gi...@apache.org> on 2024/11/07 23:51:47 UTC, 0 replies.
- Re: [PR] [SPARK-50261][SQL] Fix error signature for invalid fraction of a second [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/08 00:01:21 UTC, 1 replies.
- Re: [PR] [SPARK-49037][SQL][TESTS] Replace `schema()` with `columns()` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/08 00:23:37 UTC, 2 replies.
- Re: [PR] [SPARK-48210][DOC]Modify the description of whether dynamic partition… [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/08 00:23:39 UTC, 1 replies.
- Re: [PR] [SPARK-50017] Support Avro encoding for TransformWithState operator [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/11/08 00:43:39 UTC, 48 replies.
- [PR] draft [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/11/08 04:45:40 UTC, 0 replies.
- Re: [PR] [SPARK-49791][SQL] Make DelegatingCatalogExtension more extendable [spark] - posted by "zhouyuan (via GitHub)" <gi...@apache.org> on 2024/11/08 05:55:34 UTC, 0 replies.
- Re: [PR] [SPARK-42838][SQL] Assign a name to the error class _LEGACY_ERROR_TEMP_2000 [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/11/08 07:05:39 UTC, 5 replies.
- [I] UserContext userid handling in Go is not aligned with Pyspark Connect [spark-connect-go] - posted by "magpierre (via GitHub)" <gi...@apache.org> on 2024/11/08 08:30:50 UTC, 0 replies.
- Re: [PR] [SPARK-50245][SQL][TESTS] Extended CollationSuite and added tests where SortMergeJoin is forced [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/08 10:05:34 UTC, 3 replies.
- Re: [PR] [SPARK-50269][SQL][TESTS] Further improve collation support testing for various collations [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/08 10:10:08 UTC, 1 replies.
- Re: [I] Add support for Config() API [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/11/08 10:55:26 UTC, 0 replies.
- [PR] [SPARK-50272][SQL] Merge options of table and relation in FallBackFileSourceV2 [spark] - posted by "Zouxxyy (via GitHub)" <gi...@apache.org> on 2024/11/08 13:21:19 UTC, 1 replies.
- [PR] expose configure_logging [spark] - posted by "nija-at (via GitHub)" <gi...@apache.org> on 2024/11/08 13:21:46 UTC, 0 replies.
- [PR] [SPARK-50262][SQL] Forbid specification complex types during altering collation [spark] - posted by "Alexvsalexvsalex (via GitHub)" <gi...@apache.org> on 2024/11/08 14:13:42 UTC, 2 replies.
- [PR] [SPARK-50216][SQL] Address UTF8_BINARY performance regression [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2024/11/08 14:23:54 UTC, 11 replies.
- Re: [PR] [SPARK-50110][SQL] Fix `from_csv`: parse fails when data contains spaces before and after [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/08 16:42:53 UTC, 6 replies.
- [PR] Enable test_pandas_transform_with_state unit test [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2024/11/08 17:34:54 UTC, 0 replies.
- Re: [PR] [SPARK-50226][SQL] Correct MakeDTInterval and MakeYMInterval to catch Java exceptions [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/08 19:51:54 UTC, 27 replies.
- [PR] [SPARK-50273] Improve logging for RocksDB lock acquire/release cases [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/11/08 23:28:49 UTC, 0 replies.
- Re: [PR] [SPARK-50273][SS] Improve logging for RocksDB lock acquire/release cases [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/11/08 23:33:28 UTC, 2 replies.
- [PR] [SPARK-50274][CORE] Guard against use-after-close in DirectByteBufferOutputStream [spark] - posted by "ankurdave (via GitHub)" <gi...@apache.org> on 2024/11/08 23:38:28 UTC, 8 replies.
- [PR] [SPARK-50270][PYTHON][SS] Added custom state metrics for TransformWithStateInPandas [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2024/11/09 00:03:05 UTC, 1 replies.
- Re: [PR] [SPARK-50268][SQL][TESTS] Upgrade oracle jdbc driver to `ojdbc17:23.6.0.24.10` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/09 00:17:30 UTC, 1 replies.
- Re: [PR] [SPARK-49058][SQL] Display more primitive name for the `::` operator [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/09 00:23:24 UTC, 1 replies.
- Re: [PR] [SPARK-50275][PYTHON][SS] Enable test_pandas_transform_with_state unit test [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2024/11/09 00:35:51 UTC, 1 replies.
- Re: [PR] [SPARK-50275][SS][PYTHON] Enable test_pandas_transform_with_state unit test [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/11/09 02:09:22 UTC, 6 replies.
- Re: [PR] [SPARK-50270][SS][PYTHON] Added custom state metrics for TransformWithStateInPandas [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/11/09 08:21:25 UTC, 2 replies.
- Re: [PR] [SPARK-50083][SQL] Integrate `_LEGACY_ERROR_TEMP_1231` into `PARTITIONS_NOT_FOUND` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/09 17:15:45 UTC, 1 replies.
- Re: [PR] [SPARK-50267][ML] Improve `TargetEncoder.fit` with DataFrame APIs [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/10 00:30:26 UTC, 1 replies.
- [PR] [MINOR][DOCS][PYTHON] Fix groupped aggreagte pandas UDF example in df.groupby.agg [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/10 09:38:37 UTC, 3 replies.
- [PR] [SPARK-50278][BUILD] Upgrade `netty-tcnative` to 2.0.69.Final [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/10 09:53:02 UTC, 4 replies.
- [PR] fixed ObjectAggregationIterator#createNewAggregationBuffer repeat computer bufferFieldTypes [spark] - posted by "bryanwongsz (via GitHub)" <gi...@apache.org> on 2024/11/10 13:18:42 UTC, 3 replies.
- Re: [PR] [SPARK-50102][SQL][CONNECT] Add shims need for missing public SQL methods. [spark] - posted by "asfgit (via GitHub)" <gi...@apache.org> on 2024/11/10 21:59:24 UTC, 0 replies.
- Re: [PR] [SPARK-50264][SQL][CONNECT] Add missing methods to DataStreamWriter [spark] - posted by "asfgit (via GitHub)" <gi...@apache.org> on 2024/11/10 22:00:20 UTC, 0 replies.
- Re: [PR] Multiple spark application can be submitted within the current process [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/11 00:24:54 UTC, 1 replies.
- [PR] [SQL] Add hints to Sort and Window nodes [spark] - posted by "agubichev (via GitHub)" <gi...@apache.org> on 2024/11/11 02:07:27 UTC, 0 replies.
- [PR] [SPARK-50279][DOCS][PYTHON] Add DataFrame.plot to DataFrame API reference [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/11/11 02:13:25 UTC, 1 replies.
- [PR] [SPARK-50280][PYTHON] Refactor result sorting and empty bin filling in `compute_hist` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/11 05:13:15 UTC, 2 replies.
- [PR] [SPARK-50139][INFRA][SS][PYTHON] Introduce scripts to re-generate and checking StateMessage_pb2.py and StateMessage_pb2.pyi [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/11/11 05:43:28 UTC, 6 replies.
- Re: [PR] [SPARK-49676][SS][PYTHON] Add Support for Chaining of Operators in transformWithStateInPandas API [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/11/11 08:51:04 UTC, 32 replies.
- [PR] [SPARK-50282][ML] Simplify `TargetEncoderModel.transform` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/11 10:20:09 UTC, 2 replies.
- [PR] [SPARK-50283][INFRA] Reuse `docs` image for linter [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/11 12:31:00 UTC, 13 replies.
- Re: [PR] [SPARK-50087] Robust handling of boolean expressions in CASE WHEN for MsSqlServer and future connectors [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/11 12:40:36 UTC, 24 replies.
- [PR] Spark 49700 [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/11/11 14:19:22 UTC, 0 replies.
- Re: [PR] [SPARK-49700][CONNECT][SQL] Unified Scala Interface for Connect and Classic [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/11/11 14:21:01 UTC, 46 replies.
- Re: [PR] [SPARK-50110][SQL] Fix read csv fails when data contains spaces before and after [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/11 14:49:25 UTC, 6 replies.
- Re: [PR] [SPARK-50056][SQL] Codegen Support for ParseUrl (by Invoke & RuntimeReplaceable) [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/11 14:50:09 UTC, 7 replies.
- Re: [PR] [SPARK-49883][SS] State Store Checkpoint Structure V2 Integration with RocksDB and RocksDBFileManager [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/11/11 15:37:49 UTC, 10 replies.
- Re: [PR] [SPARK-49886][SS] Query level failure test for rocksDB format V2 [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/11/11 16:00:42 UTC, 0 replies.
- Re: [PR] [SPARK-50259][BUILD] Update Parquet to 1.14.4 [spark] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2024/11/11 21:25:27 UTC, 4 replies.
- Re: [PR] [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort stage when committed file not consistent with task status [spark] - posted by "dfit99 (via GitHub)" <gi...@apache.org> on 2024/11/12 03:53:24 UTC, 0 replies.
- [PR] [SPARK-50357][Core]If a stage contains ExpandExec, the CoalesceShuffl… [spark] - posted by "guixiaowen (via GitHub)" <gi...@apache.org> on 2024/11/12 04:00:47 UTC, 0 replies.
- Re: [PR] [SPARK-50033][SQL] Add hints to Sort and Window nodes [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/12 04:55:42 UTC, 0 replies.
- [PR] [SPARK-50130][SQL][FOLLOWUP] Simplify the resolution of LazyOuterReference [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/12 05:34:10 UTC, 11 replies.
- [PR] [SPARK-50287][SQL] Merge options of table and relation when creating WriteBuilder in FileTable [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/11/12 05:39:41 UTC, 6 replies.
- Re: [PR] [SPARK-50160][SQL][KAFKA] KafkaWriteTask: allow customizing record timestamp [spark] - posted by "schulzp (via GitHub)" <gi...@apache.org> on 2024/11/12 05:50:30 UTC, 0 replies.
- [PR] [SPARK-50286][SQL] Correctly propagate SQL options to WriteBuilder [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/11/12 06:22:35 UTC, 22 replies.
- [PR] [SPARK-45265][SQL] Support Hive 4 [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/11/12 07:20:59 UTC, 5 replies.
- [PR] [ONLY TEST] Docker file optimize [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/12 09:09:51 UTC, 3 replies.
- Re: [PR] [SPARK-50066][SQL] Codegen Support for `SchemaOfXml` (by Invoke & RuntimeReplaceable) [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/12 11:49:47 UTC, 8 replies.
- [PR] [SPARK-50292] Add MapStatus RowCount optimize skewed job [spark] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2024/11/12 11:54:04 UTC, 1 replies.
- [PR] [SPARK-50283][INFRA] Add a separate docker file for linter [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/12 11:57:19 UTC, 7 replies.
- [PR] [SPARK-50290][SQL] Add a flag to disable DataFrameQueryContext creation [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/11/12 13:58:04 UTC, 7 replies.
- [PR] [SPARK-50130][SQL][PYTHON][TEST] Add more test for outer reference [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/11/12 19:23:34 UTC, 2 replies.
- [PR] [SPARK-50130][SQL][FOLLOWUP] Make Encoder generation lazy [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/11/12 20:13:27 UTC, 17 replies.
- [PR] [SPARK-50285] Metrics for commits to StagedTable instances [spark] - posted by "olaky (via GitHub)" <gi...@apache.org> on 2024/11/12 21:54:20 UTC, 13 replies.
- Re: [PR] [SPARK-49008][PYTHON] Use `ParamSpec` to propagate `func` signature in `transform` [spark] - posted by "nicklamiller (via GitHub)" <gi...@apache.org> on 2024/11/13 00:15:47 UTC, 0 replies.
- Re: [PR] [SPARK-48728][SQL] Support ignoreNulls for collect_list and collect_set [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/13 00:23:52 UTC, 1 replies.
- Re: [PR] [SPARK-50238][PYTHON] Add Variant Support in PySpark UDFs/UDTFs/UDAFs [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/13 00:52:40 UTC, 1 replies.
- Re: [PR] [SPARK-49002][SQL] Consistently handle invalid locations in WAREHOUSE/SCHEMA/TABLE/PARTITION/DIRECTORY [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/13 03:05:04 UTC, 7 replies.
- [PR] [SPARK-50296][PYTHON][CONNECT] Avoid using a classproperty in threadpool for Python Connect client [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/13 04:28:26 UTC, 3 replies.
- [PR] [SPARK-38912][PYTHON] Remove the comment related to classmethod and property [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/13 04:32:51 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-50291][PYTHON] Standardize verifySchema parameter of createDataFrame in Spark Classic [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/11/13 07:23:19 UTC, 0 replies.
- Re: [PR] [SPARK-50291][PYTHON] Standardize verifySchema parameter of createDataFrame in Spark Classic [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/11/13 07:33:40 UTC, 9 replies.
- Re: [PR] [SPARK-50248][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_2058`: `INVALID_PARTITION_VALUE` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/13 08:17:44 UTC, 1 replies.
- Re: [PR] [SPARK-50246][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_2167`: `INVALID_JSON_RECORD_TYPE` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/13 08:20:21 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-49610] Do not use protobuf messages as keys of the session-local plan cache [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/11/13 09:33:37 UTC, 2 replies.
- [PR] Revert [SPARK-50215][SQL] Refactored StringType pattern matching in jdbc code stack [spark] - posted by "vladanvasi-db (via GitHub)" <gi...@apache.org> on 2024/11/13 11:38:13 UTC, 3 replies.
- [PR] Test junit 5.11.3 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/11/13 12:25:24 UTC, 0 replies.
- Re: [PR] [SPARK-50299][BUILD] Upgrade jupiter-interface to 0.13.1 and Junit5 to 5.11.3 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/11/13 12:53:16 UTC, 9 replies.
- [PR] [FOLLOW-UP][SPARK-49611][SQL] Make collations TVF consistent and return null on no result for country and language [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/11/13 13:04:27 UTC, 1 replies.
- Re: [PR] [SPARK-50153][SQL] Add `name` to `RuleExecutor` to make printing `QueryExecutionMetrics`'s logs clearer [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/13 14:37:55 UTC, 5 replies.
- Re: [PR] [SPARK-49611][SQL][FOLLOW-UP] Make collations TVF consistent and return null on no result for country and language [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/13 15:40:23 UTC, 0 replies.
- [PR] [SPARK-50300][BUILD] Use mirror host instead of `archive.apache.org` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/13 18:31:36 UTC, 3 replies.
- Re: [PR] [SPARK-50216][SQL][TESTS] Update `CollationBenchmark` to invoke `collationNameToId` outside of cases [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/13 19:34:48 UTC, 3 replies.
- [PR] [SPARK-50304][INFRA] Remove `(any|empty).proto` from RAT exclusion [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/13 20:47:33 UTC, 7 replies.
- [PR] [SPARK-50305] Upgrade `Gradle` to 8.11 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/13 21:09:22 UTC, 2 replies.
- [PR] Python new timer [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/11/13 22:14:05 UTC, 0 replies.
- [PR] [SPARK-50306][PYTHON][CONNECT] Support Python 3.13 in Spark Connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/13 23:59:57 UTC, 2 replies.
- Re: [PR] [SPARK-50049][SQL] Support custom driver metrics in writing to v2 table [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/14 02:05:37 UTC, 8 replies.
- [PR] [SPARK-48755][DOCS][PYTHON][FOLLOWUP] Add PySpark doc for `transformWithState` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/11/14 02:15:32 UTC, 3 replies.
- Re: [PR] [SPARK-50258][SQL] Keep the output column order after AQE optimization [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/14 04:14:36 UTC, 6 replies.
- [PR] [WIP][SPARK-50298][CONNECT] Implement verifySchema parameter of createDataFrame in Spark Connect [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/11/14 09:44:42 UTC, 0 replies.
- [PR] [SPARK-50313][SQL][TESTS] Enable ANSI in SQL *SQLQueryTestSuite by default [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/11/14 10:34:50 UTC, 5 replies.
- Re: [PR] [SPARK-49907][ML][CONNECT] Support spark.ml on Connect [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2024/11/14 10:47:46 UTC, 17 replies.
- [PR] [SPARK-50311][PYTHON] Support `(add|remove|get|clear)Tag(s)` for PySpark [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/11/14 11:27:30 UTC, 0 replies.
- [PR] Fix session collation dmlddl [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/11/14 11:33:10 UTC, 3 replies.
- Re: [PR] [SPARK-50311][PYTHON] Support `(add|remove|get|clear)Tag(s)` APIs for PySpark [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/11/14 12:22:13 UTC, 13 replies.
- [PR] [SPARK-50316][BUILD] Upgrade ORC to 1.9.5 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/14 15:47:39 UTC, 0 replies.
- [PR] [SPARK-50317][BUILD] Upgrade ORC to 2.0.3 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/14 16:15:12 UTC, 5 replies.
- [PR] [WIP] Fix parameterized identifier in a sub-query [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/14 16:50:51 UTC, 0 replies.
- [PR] [SQL][SPARK-50318] Add IntervalUtils.makeYearMonthInterval to deduplicate code between interpreted and codegen [spark] - posted by "gotocoding-DB (via GitHub)" <gi...@apache.org> on 2024/11/14 17:07:37 UTC, 1 replies.
- [PR] [SPARK-50319] Reorder ResolveIdentifierClause and BindParameter rules [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2024/11/14 17:21:59 UTC, 0 replies.
- Re: [PR] [SPARK-50316][BUILD][3.5] Upgrade ORC to 1.9.5 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/14 17:34:37 UTC, 4 replies.
- [PR] [SPARK-50320][CORE] Make `--remote` be an official option by removing `experimental` warning [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/14 18:31:55 UTC, 0 replies.
- Re: [PR] [SPARK-50320][CORE] Make `--remote` an official option by removing `experimental` warning [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/14 19:02:56 UTC, 2 replies.
- [PR] [SPARK-45891][SQL] Rebuild variant binary from shredded data. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/11/14 19:31:23 UTC, 4 replies.
- Re: [PR] [SPARK-50175][SQL] Change collation precedence calculation [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/11/14 20:14:15 UTC, 42 replies.
- [PR] commit [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/11/14 21:30:38 UTC, 0 replies.
- Re: [PR] [SPARK-50309][SQL] Add documentation for SQL pipe syntax [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/11/14 21:32:07 UTC, 9 replies.
- [PR] [SPARK-50302] Ensure secondary index sizes equal primary index sizes for TransformWithState stateful variables with TTL [spark] - posted by "neilramaswamy (via GitHub)" <gi...@apache.org> on 2024/11/14 21:39:40 UTC, 73 replies.
- Re: [PR] [SPARK-45265][SQL] Support Hive 4.0 metastore [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/14 22:12:37 UTC, 2 replies.
- [PR] [WIP][SPARK-49566][SQL] Implement SQL pipe syntax EXTEND + SET + DROP + AS operators [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/11/14 23:55:17 UTC, 1 replies.
- Re: [PR] Enhance the metrics in SparkUI with logical plan stats [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/15 00:25:43 UTC, 1 replies.
- Re: [PR] [SPARK-48769][SQL] Support constant folding for ScalaUDF [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/15 00:25:44 UTC, 1 replies.
- Re: [PR] [SPARK-50113][CONNECT][PYTHON][TESTS] Add `@spark_connect_only` to check the APIs that only supported with Spark Connect [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/11/15 02:13:00 UTC, 2 replies.
- Re: [PR] [MINOR] Fix code style for if/for/while statements [spark] - posted by "exmy (via GitHub)" <gi...@apache.org> on 2024/11/15 03:10:07 UTC, 2 replies.
- [PR] [SPARK-50312][SQL] SparkThriftServer createServer parameter passing e… [spark] - posted by "CuiYanxiang (via GitHub)" <gi...@apache.org> on 2024/11/15 03:36:15 UTC, 0 replies.
- Re: [PR] [SPARK-48195][CORE] Save and reuse RDD/Broadcast created by SparkPlan [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/11/15 04:05:13 UTC, 5 replies.
- [PR] [SPARK-50324][PYTHON][CONNECT] Make `createDataFrame` trigger Config RPC at most once [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/15 05:35:04 UTC, 1 replies.
- Re: [PR] [SPARK-50312][SQL] SparkThriftServer createServer parameter passing error when kerberos is true [spark] - posted by "CuiYanxiang (via GitHub)" <gi...@apache.org> on 2024/11/15 05:51:10 UTC, 3 replies.
- [PR] [SPARK-50325][SQL] Factor out alias resolution to be reused in the single-pass Analyzer [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/11/15 08:55:37 UTC, 2 replies.
- [PR] [SPARK-50327][SQL] Factor out function resolution to be reused in the single-pass Analyzer [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/11/15 09:49:13 UTC, 4 replies.
- Re: [PR] [SPARK-50322][SQL] Fix parameterized identifier in a sub-query [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/15 09:57:40 UTC, 8 replies.
- Re: [PR] [SPARK-50237][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_2138-9`: `CIRCULAR_CLASS_REFERENCE` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/15 10:12:07 UTC, 1 replies.
- [PR] [SPARK-50328][INFRA] Add a separate docker file for SparkR [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/15 11:04:18 UTC, 2 replies.
- [PR] [SPARK-50295][INFRA] Add a script to build docs with image [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/15 11:46:46 UTC, 31 replies.
- Re: [PR] [SPARK-50081][SQL] Codegen Support for `XPath*`(by Invoke & RuntimeReplaceable) [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/15 14:39:41 UTC, 3 replies.
- Re: [PR] [SPARK-50091][SQL] Handle case of aggregates in left-hand operand of IN-subquery [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2024/11/15 15:38:50 UTC, 9 replies.
- [PR] [DRAFT] Two string types [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/11/15 15:58:01 UTC, 0 replies.
- Re: [PR] [SPARK-50236][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_1156`: `COLUMN_NOT_DEFINED_IN_TABLE ` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/15 16:20:45 UTC, 1 replies.
- Re: [PR] [SPARK-45592][SPARK-45282][SQL] Correctness issue in AQE with InMemoryTableScanExec [spark] - posted by "Tom-Newton (via GitHub)" <gi...@apache.org> on 2024/11/15 16:36:10 UTC, 3 replies.
- [PR] [SPARK-50301][SS] Make TransformWithState metrics reflect their intuitive meanings [spark] - posted by "neilramaswamy (via GitHub)" <gi...@apache.org> on 2024/11/15 19:46:33 UTC, 15 replies.
- Re: [PR] [SPARK-50309][DOCS] Document `SQL Pipe` Syntax [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/11/15 22:04:39 UTC, 2 replies.
- Re: [PR] [SPARK-49789][SQL] Handling of generic parameter with bounds while creating encoders [spark] - posted by "sririshindra (via GitHub)" <gi...@apache.org> on 2024/11/15 22:50:53 UTC, 9 replies.
- [PR] Subquery only Spark Connect. [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/11/15 23:33:27 UTC, 0 replies.
- Re: [PR] [WIP] Subquery only Spark Connect. [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/11/15 23:34:00 UTC, 2 replies.
- [PR] [SQL][SPARK-50329] fix InSet$toString [spark] - posted by "averyqi-db (via GitHub)" <gi...@apache.org> on 2024/11/16 00:12:25 UTC, 0 replies.
- Re: [PR] Fixed comma splice in cluster-overview.md [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/16 00:24:57 UTC, 1 replies.
- Re: [PR] [MINOR] Use LinkedHashSet for ResolveLateralColumnAliasReference to generate stable hash for the plan [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/16 00:24:58 UTC, 1 replies.
- Re: [PR] [SPARK-48835] Introduce versoning to jdbc connectors [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/16 00:24:59 UTC, 1 replies.
- Re: [PR] [SPARK-50194][SS][PYTHON] Integration of New Timer API and Initial State API with Timer [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2024/11/16 00:28:16 UTC, 29 replies.
- Re: [PR] [SPARK-50329][SQL] fix InSet$toString [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/16 01:04:45 UTC, 17 replies.
- Re: [PR] [SPARK-50324][PYTHON][CONNECT] Make `createDataFrame` trigger `Config` RPC at most once [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/16 01:28:31 UTC, 7 replies.
- Re: [PR] [SPARK-49787][SQL] Cast between UDT and other types [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/16 01:53:11 UTC, 4 replies.
- Re: [PR] [SPARK-48710][PYTHON][3.5] Limit NumPy version to supported range (>=1.15,<2) [spark] - posted by "anthonycroft (via GitHub)" <gi...@apache.org> on 2024/11/16 13:12:34 UTC, 4 replies.
- [PR] [WIP] Avro encoding only in StateStore code [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/11/16 20:53:02 UTC, 1 replies.
- [PR] [SPARK-50315] Support custom metrics for V1Fallback writes [spark] - posted by "olaky (via GitHub)" <gi...@apache.org> on 2024/11/16 21:25:25 UTC, 7 replies.
- Re: [PR] [SPARK-49095][SQL] Update `DecimalType`and `decimal fields` compatible logic of `Avro` data source to avoid loss of decimal precision [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/17 00:27:34 UTC, 1 replies.
- Re: [PR] [SPARK-49073][SQL][DOCS] Improve the doc `sql-ref-syntax-qry-select.md` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/17 00:27:36 UTC, 1 replies.
- [PR] [SPARK-50331][INFRA] Add a daily test for PySpark on MacOS [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/11/18 02:37:46 UTC, 11 replies.
- [PR] test tpcds [spark] - posted by "zizdlp (via GitHub)" <gi...@apache.org> on 2024/11/18 02:51:18 UTC, 1 replies.
- [PR] [SPARK-45265][SQL][BUILD][FOLLOWUP] Add `-Xss64m` for Maven testing of the Hive module [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/11/18 03:29:42 UTC, 2 replies.
- [PR] [SPARK-42856][GRAPHX] Break tie with highest vertex id in label propagation [spark] - posted by "awadhesh14 (via GitHub)" <gi...@apache.org> on 2024/11/18 03:41:52 UTC, 3 replies.
- [PR] [SPARK-50313][SQL][TESTS][FOLLOWUP] Restore some tests in *SQLQueryTestSuite for ANSI mode [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/11/18 05:37:15 UTC, 7 replies.
- Re: [PR] [SPARK-45265][SQL][BUILD][FOLLOWUP] Add `-Xss64m` for Maven testing of the `sql/hive` module [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/11/18 05:44:00 UTC, 6 replies.
- [PR] [SPARK-50333][SQL] Codegen Support for `CsvToStructs` (by Invoke & RuntimeReplaceable) [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/18 06:47:23 UTC, 7 replies.
- Re: [PR] [SPARK-50330][SQL] Add hints to Sort and Window nodes [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/18 07:38:45 UTC, 1 replies.
- [PR] [SPARK-50334][SQL] Extract common logic for reading PB files [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/18 08:16:00 UTC, 0 replies.
- [PR] [MINOR][PYTHON][DOCS] Fix the type hint of `histogram_numeric` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/18 08:22:15 UTC, 3 replies.
- [PR] Revert [SPARK-50230][SQL] Added logic to support reading unknown collation name as utf8_binary [spark] - posted by "vladanvasi-db (via GitHub)" <gi...@apache.org> on 2024/11/18 10:34:31 UTC, 4 replies.
- [PR] [SPARK-50335][PYTHON][DOCS] Refine docstrings for window/aggregation functions - part 2 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/18 11:24:53 UTC, 2 replies.
- [PR] Dev/milast/recurisve cte [spark] - posted by "milastdbx (via GitHub)" <gi...@apache.org> on 2024/11/18 11:50:01 UTC, 0 replies.
- [PR] [SPARK-48344] Prepare SQL Scripting for addition of Execution Framework [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2024/11/18 13:00:35 UTC, 5 replies.
- [PR] [SPARK-SPARK-50339] Enable changelog to store lineage information [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/11/18 14:02:59 UTC, 2 replies.
- [PR] [SPARK-50340][SQL] unwrap UDT in INSERT input query [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/18 14:57:32 UTC, 1 replies.
- Re: [PR] [SPARK-49841][PYTHON][TESTS][3.5] Skip PySpark `test_cast_to_udt_with_udt`test during `SPARK_SKIP_CONNECT_COMPAT_TESTS` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/18 15:05:26 UTC, 6 replies.
- [PR] [SPARK-50338] Make LazyTry exceptions less verbose [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2024/11/18 15:17:54 UTC, 0 replies.
- Re: [PR] [SPARK-50338][CORE] Make LazyTry exceptions less verbose [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2024/11/18 15:30:30 UTC, 5 replies.
- [PR] Char varchar [spark] - posted by "jovanm-db (via GitHub)" <gi...@apache.org> on 2024/11/18 16:30:51 UTC, 10 replies.
- [PR] [SPARK-50341][SS][PYTHON] Use UDS for JVM and Python worker communication [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2024/11/18 19:46:35 UTC, 15 replies.
- Re: [PR] [WIP][SPARK-49566][SQL] Add SQL pipe syntax for the EXTEND operator [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/11/18 23:16:53 UTC, 0 replies.
- Re: [PR] [SPARK-49566][SQL] Add SQL pipe syntax for the EXTEND operator [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/11/18 23:24:33 UTC, 9 replies.
- Re: [PR] [SPARK-49249][SPARK-49320] Add new tag-related APIs in Connect back to Spark Core [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/11/19 01:29:19 UTC, 5 replies.
- Re: [PR] [SPARK-50298][PYTHON][CONNECT] Implement verifySchema parameter of createDataFrame in Spark Connect [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/11/19 01:42:56 UTC, 2 replies.
- [PR] [SPARK-50345][BUILD] Upgrade Kafka to 3.9.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/19 02:19:02 UTC, 4 replies.
- Re: [PR] [SPARK-50340][SQL] Unwrap UDT in INSERT input query [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/19 02:44:05 UTC, 2 replies.
- Re: [PR] [SPARK-50339][SS] Enable changelog to store lineage information [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2024/11/19 04:19:55 UTC, 12 replies.
- [PR] [SPARK-50313][SQL][TESTS][FOLLOWUP] Regenerate golden files for Java 21 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/11/19 05:35:20 UTC, 4 replies.
- [PR] [SPARK-50323][CONNECT][PYTHON] Add missing schema check for createDataFrame from numpy ndarray [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/11/19 06:14:53 UTC, 0 replies.
- [PR] [SPARK-50348] Make static import Python data source configurable [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/11/19 08:21:57 UTC, 0 replies.
- [PR] [SPARK-50350][SQL] Avro: add new function `schema_of_avro` (`scala` side) [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/19 08:37:31 UTC, 1 replies.
- [PR] [SPARK-49550][FOLLOWUP][SQL][DOC] Switch Hadoop to 3.4.1 in IsolatedClientLoader and docs [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/11/19 08:54:38 UTC, 4 replies.
- [PR] [SPARK-50352][PYTHON][DOCS] Refine docstrings for window/aggregation functions - part 3 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/19 09:42:20 UTC, 2 replies.
- [PR] [SPARK-50335][PYTHON][DOCS][FOLLOW-UP] Make percentile doctests more stable [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/19 09:44:13 UTC, 2 replies.
- [PR] [SPARK-35110][SQL][FOLLOW-UP] Fix DayTimeIntevalType handling in WindowExecBase [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/11/19 10:36:52 UTC, 23 replies.
- Re: [PR] [SPARK-50323][CONNECT][PYTHON] Add missing schema check for createDataFrame from numpy ndarray on Spark Connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/19 10:38:46 UTC, 0 replies.
- Re: [PR] [SPARK-49976] [SQL] Disallow lambda functions from being clauses in CASE WHEN expressions [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2024/11/19 10:54:32 UTC, 0 replies.
- [PR] [SPARK-50353] [SQL] Refactor ResolveSQLOnFile [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2024/11/19 10:55:45 UTC, 2 replies.
- Re: [PR] [SPARK-41344][SQL] Make error clearer when table not found in SupportsCatalogOptions catalog [spark] - posted by "cdagraca (via GitHub)" <gi...@apache.org> on 2024/11/19 11:09:47 UTC, 0 replies.
- Re: [PR] [SPARK-48344][SQL] Prepare SQL Scripting for addition of Execution Framework [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2024/11/19 11:30:32 UTC, 11 replies.
- [PR] [SPARK-37455][SQL] No need to set initialInputBufferOffset when Aggre… [spark] - posted by "zhixingheyi-tian (via GitHub)" <gi...@apache.org> on 2024/11/19 11:54:03 UTC, 0 replies.
- [PR] [SPARK-50332] Optimize accurate CompressedMapStatus [spark] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2024/11/19 12:01:27 UTC, 0 replies.
- Re: [PR] [SPARK-50354][SQL] No need to set initialInputBufferOffset when Aggregate mode is Complete [spark] - posted by "zhixingheyi-tian (via GitHub)" <gi...@apache.org> on 2024/11/19 12:08:49 UTC, 4 replies.
- Re: [PR] [SPARK-50315][SQL] Support custom metrics for V1Fallback writes [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/19 12:25:32 UTC, 1 replies.
- Re: [PR] [SPARK-48356][SQL] Support for FOR statement [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2024/11/19 16:16:31 UTC, 38 replies.
- Re: [PR] [SPARK-49241][CORE] Add `OpenTelemetryPush` Sink with `opentelemetry` profile [spark] - posted by "asafm (via GitHub)" <gi...@apache.org> on 2024/11/19 20:46:16 UTC, 0 replies.
- Re: [PR] [SPARK-50348][PYTHON] Make static import Python data source configurable [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/20 00:17:40 UTC, 1 replies.
- [PR] [SPARK-50358][SQL][TESTS] Update postgres docker image to 17.1 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/20 00:40:30 UTC, 8 replies.
- [PR] [SPARK-7008][PYTHON] Upgrade PyArrow to 18.0 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/20 00:45:43 UTC, 0 replies.
- Re: [PR] [SPARK-50359][PYTHON] Upgrade PyArrow to 18.0 [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/11/20 01:56:23 UTC, 2 replies.
- [PR] [MINOR][DOCS] Fix a HTML/Markdown syntax error in sql-migration-guide.md [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/11/20 03:00:54 UTC, 2 replies.
- [PR] [SPARK-50331][INFRA][FOLLOW-UP] Skip Torch/DeepSpeed tests in MacOS PySpark Daily test [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/20 03:59:34 UTC, 3 replies.
- Re: [PR] [SPARK-49210][SQL] Support driver metrics for DS v2 write [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/20 04:45:19 UTC, 1 replies.
- Re: [PR] [SPARK-49644][SQL] Support drop multi-level partition V2 table with partial partition spec [spark] - posted by "Zouxxyy (via GitHub)" <gi...@apache.org> on 2024/11/20 05:44:23 UTC, 0 replies.
- [PR] Test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/11/20 06:10:45 UTC, 0 replies.
- [PR] [SPARK-49801][INFRA][FOLLOWUP] Sync pandas version in release environment [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/11/20 06:18:18 UTC, 2 replies.
- Re: [PR] [SPARK-50332][CORE] Optimize accurate CompressedMapStatus [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/11/20 06:33:50 UTC, 1 replies.
- Re: [PR] [SPARK-48821][SQL] Support `Update` in `DataFrameWriterV2` [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2024/11/20 06:38:18 UTC, 0 replies.
- Re: [PR] [SPARK-50258][SQL] Fix output column order changed issue after AQE optimization [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2024/11/20 08:47:30 UTC, 5 replies.
- [PR] [WIP][SPARK-50361][SQL] Aggregates using Lateral Column Alias in ORDER BY should throw LATERAL_COLUMN_ALIAS_IN_AG GREGATE_FUNC [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/11/20 09:15:55 UTC, 0 replies.
- Re: [PR] [SPARK-50353][SQL] Refactor ResolveSQLOnFile [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/20 09:44:50 UTC, 1 replies.
- [PR] [SPARK-50363][PYTHON][DOCS] Refine the docstring for datetime functions - part 1 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/20 10:44:35 UTC, 2 replies.
- [PR] [SPARK-50364] Implement serialization for LocalDateTime type in Row.jsonValue [spark] - posted by "karim-ramadan (via GitHub)" <gi...@apache.org> on 2024/11/20 11:07:04 UTC, 1 replies.
- [PR] [SPARK-50366] Isolate user-defined tags on thread level for SparkSession in Classic [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/11/20 11:33:43 UTC, 0 replies.
- Re: [PR] [SPARK-50366][SQL] Isolate user-defined tags on thread level for SparkSession in Classic [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/20 11:40:25 UTC, 8 replies.
- Re: [PR] [SPARK-50362][PYTHON][ML] Skip `CrossValidatorTests` if `torch/torcheval` not installed [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/20 12:22:44 UTC, 0 replies.
- Re: [PR] [SPARK-50362][PYTHON][ML][TESTS] Skip `CrossValidatorTests` if `torch/torcheval` not installed [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/20 12:23:24 UTC, 2 replies.
- [PR] [SPARK-50258][SQL][3.4] Fix output column order changed issue after AQE optimization [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2024/11/20 14:05:07 UTC, 2 replies.
- [PR] [SPARK-50370][SQL] Codegen Support for `json_tuple` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/20 14:11:06 UTC, 9 replies.
- Re: [PR] [SPARK-50364][SQL] Implement serialization for LocalDateTime type in Row.jsonValue [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/20 15:59:53 UTC, 4 replies.
- [PR] [SPARK-50373] Prohibit Variant from set operations [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/11/20 17:23:00 UTC, 3 replies.
- Re: [PR] [SPARK-47193][SQL] Ensure SQL conf is propagated to executors when actions are called on RDD returned by `Dataset#rdd` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/20 23:41:06 UTC, 3 replies.
- Re: [PR] [SPARK-49136][SQL] Eagerly initialize DriverManager on Driver [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/21 00:25:19 UTC, 1 replies.
- Re: [PR] [SPARK-48674][Connect] Extracted error handling functions from SparkConnectService to a trait. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/21 00:25:20 UTC, 1 replies.
- [PR] [SPARK-50375][BUILD] Upgrade `commons-io` to 2.18.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/21 02:11:36 UTC, 2 replies.
- [PR] [SPARK-50376][PYTHON][ML][TESTS] Centralize the dependency check in ML tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/21 03:07:39 UTC, 3 replies.
- [PR] [SPARK-50377][SQL] Allow to evaluate foldable RuntimeReplaceable [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/21 05:56:14 UTC, 10 replies.
- [PR] [SPARK-50378] Add custom metric for tracking spent for proc initial state in transformWithState [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/11/21 06:17:33 UTC, 0 replies.
- Re: [PR] [SPARK-50378][SS] Add custom metric for tracking spent for proc initial state in transformWithState [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/11/21 06:18:19 UTC, 3 replies.
- [PR] [WIP][SPARK-50133][PYTHON] Support df.argument() for conversion to table argument [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/11/21 06:25:57 UTC, 1 replies.
- [PR] [SPARK-49349][SQL] Improve error message for LCA with Generate [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2024/11/21 06:50:35 UTC, 2 replies.
- Re: [PR] [SPARK-50379][SQL] Fix DayTimeIntevalType handling in WindowExecBase [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/11/21 07:25:34 UTC, 2 replies.
- [PR] [DOCS] fix miss semicolon on create table example sql [spark] - posted by "camilesing (via GitHub)" <gi...@apache.org> on 2024/11/21 08:18:43 UTC, 0 replies.
- [PR] Remove .*? from parser [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/11/21 08:19:41 UTC, 1 replies.
- [PR] [SPARK-50380][SQL] ReorderAssociativeOperator should respect the contract in ConstantFolding [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/21 08:23:57 UTC, 7 replies.
- [PR] [MINOR][DOCS] Remove wrong and ambiguous default statement in datetime rebase mode settings [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/11/21 08:26:19 UTC, 3 replies.
- Re: [PR] [SPARK-50113][CONNECT][PYTHON][TESTS] Add `@remote_only` to check the APIs that only supported with Spark Connect [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/11/21 08:29:28 UTC, 1 replies.
- Re: [PR] [DOCS][MINOR] fix miss semicolon on create table example sql [spark] - posted by "camilesing (via GitHub)" <gi...@apache.org> on 2024/11/21 08:32:43 UTC, 0 replies.
- Re: [PR] [SPARK-50334][SQL] Extract common logic for reading the descriptor of PB file [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/21 09:21:07 UTC, 3 replies.
- Re: [PR] [MINOR][DOCS] Fix miss semicolon on create table example sql [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/21 10:23:53 UTC, 1 replies.
- [PR] [SPARK-50372][Connect][SQL] Make all DF execution path collect observed metrics [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/11/21 12:56:26 UTC, 6 replies.
- [PR] [SPARK-50381][CORE] Support `spark.master.rest.maxThreads` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/21 16:14:23 UTC, 4 replies.
- [PR] [SPARK-50382][CONNECT] Add documentation for general information on application development with/extending Spark Connect [spark] - posted by "vicennial (via GitHub)" <gi...@apache.org> on 2024/11/21 16:47:10 UTC, 13 replies.
- [PR] [SPARK-50383][CORE] Support Virtual Threads in REST Submission API [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/21 18:19:26 UTC, 0 replies.
- [PR] [SPARK-50384] Update docs for first-time YuniKorn installation [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/11/21 18:42:14 UTC, 1 replies.
- Re: [PR] [SPARK-50383][CORE] Support `Virtual Threads` in REST Submission API [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/21 19:21:45 UTC, 6 replies.
- [PR] [SPARK-50385][CORE] Use class name prefix for REST Submission API thread pool [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/21 22:03:44 UTC, 10 replies.
- [PR] [SPARK-50386][SQL] Improve SparkFatalException Propagation when OutOfMemoryError occurs on BroadcastExchangeExec building small table to broadcast [spark] - posted by "erenavsarogullari (via GitHub)" <gi...@apache.org> on 2024/11/21 22:24:08 UTC, 0 replies.
- Re: [PR] [SPARK-49175][PYTHON][MIRROR] Use UnsupportedType to check DataType validation for Arrow UDF [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/22 00:26:01 UTC, 1 replies.
- Re: [PR] [SPARK-48980][ML] Avoid per-row param read in `LSH/DCT/NGram/PolynomialExpansion` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/22 00:26:04 UTC, 1 replies.
- [PR] [SPARK-50388][PYTHON][TESTS] Further centralized import checks [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/22 01:33:24 UTC, 0 replies.
- [PR] [SPARK-50387] Update condition for timer expiry and relevant test [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/11/22 01:40:00 UTC, 0 replies.
- Re: [PR] [SPARK-50387][SS] Update condition for timer expiry and relevant test [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/11/22 01:40:37 UTC, 6 replies.
- Re: [PR] [SPARK-50388][PYTHON][TESTS] Further centralize import checks [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/22 02:22:44 UTC, 1 replies.
- [PR] [SPARK-50389][SQL][TESTS] Remove`sql-tests/results/try_arithmetic.sql.out.java21` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/11/22 02:35:52 UTC, 8 replies.
- [PR] [SPARK-50390][PYTHON][DOCS] Refine the docstring for datetime functions - part 2 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/22 02:48:23 UTC, 2 replies.
- [PR] [DO-NOT-MERGE] Support SQL API mode [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/22 02:58:13 UTC, 0 replies.
- [PR] [SPARK-48248][PYTHON][TESTS][FOLLOW-UP] Avoid duplicated test name for `test_infer_array_element_type_with_struct` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/22 03:22:16 UTC, 2 replies.
- Re: [PR] [SPARK-50133][PYTHON] Support df.argument() for conversion to table argument in Spark Classic [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/11/22 05:31:10 UTC, 2 replies.
- [PR] [SPARK-50394][PYTHON][INFRA] Reduce parallelism in Pure Python library builds [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/22 06:50:45 UTC, 1 replies.
- [PR] Link to security reporting page [spark] - posted by "raboof (via GitHub)" <gi...@apache.org> on 2024/11/22 10:27:08 UTC, 0 replies.
- Re: [PR] [SPARK-50339][SPARK-50360][SS] Enable changelog to store lineage information [spark] - posted by "brkyvz (via GitHub)" <gi...@apache.org> on 2024/11/22 13:00:13 UTC, 4 replies.
- [PR] [SPARK-50395][Connect][SQL] Fix malformed URI syntax in Windows [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/11/22 13:37:56 UTC, 0 replies.
- [PR] [SPARK-50396][PYTHON][DOCS] Refine the docstring for datetime functions - part 3 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/22 14:28:33 UTC, 3 replies.
- [PR] [DRAFT] Collation type coercion of complex types [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/11/22 17:02:31 UTC, 0 replies.
- [PR] A more portable terminal / pipe test needed for bin/load-spark-env.sh [spark] - posted by "philwalk (via GitHub)" <gi...@apache.org> on 2024/11/22 18:50:44 UTC, 8 replies.
- Re: [PR] [SPARK-50372][CONNECT][SQL] Make all DF execution path collect observed metrics [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/11/22 19:39:27 UTC, 0 replies.
- [PR] [SPARK-50397][CORE] Remove deprecated `--ip` and `-i` arguments from `Master/Worker` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/22 20:20:02 UTC, 10 replies.
- [PR] [SPARK-50398][CORE] Use ExitCode `0` for `--help` usage in Spark scripts [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/22 22:32:49 UTC, 4 replies.
- [PR] [WIP][SPARK-49566][SQL] Add SQL pipe syntax for the SET operator [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/11/23 00:15:29 UTC, 0 replies.
- Re: [PR] [SPARK-49062][SQL] Migrate XML to File Data Source V2 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/23 00:24:51 UTC, 1 replies.
- Re: [PR] [SPARK-48408][SQL] Simplify `date_format` & `from_unixtime` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/23 00:24:52 UTC, 1 replies.
- [PR] [SPARK-50240] Added Simple Sanitization of Extra JVM Options [spark] - posted by "soumasish (via GitHub)" <gi...@apache.org> on 2024/11/23 02:39:50 UTC, 0 replies.
- Re: [PR] [SPARK-49566][SQL] Add SQL pipe syntax for the SET operator [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/11/23 04:05:05 UTC, 20 replies.
- [PR] [MINOR][DOCS] Fix miss semicolon on insert example sql [spark] - posted by "camilesing (via GitHub)" <gi...@apache.org> on 2024/11/23 05:26:11 UTC, 2 replies.
- Re: [PR] [SPARK-49670][SQL] Enable trim collation for all passthrough expressions [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/23 11:07:34 UTC, 9 replies.
- Re: [PR] Fix some typos [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/11/23 16:36:06 UTC, 0 replies.
- [PR] [SPARK-50380][SQL][TESTS][FOLLOWUP] Enable ANSI for conditional branches with error expression test [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/23 19:46:53 UTC, 8 replies.
- [PR] [WIP] init [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/11/23 21:36:54 UTC, 0 replies.
- [PR] [SPARK-50400][BUILD] Upgrade log4j2 to 2.24.2 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/23 23:44:44 UTC, 3 replies.
- Re: [PR] [SPARK-49140][SQL] Widening type promotion from int/long to decimal and support custom decimal logic type for int in `AvroDeserializer` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/24 00:28:27 UTC, 1 replies.
- [PR] [SPARK-50401] Upgrade `kubernetes-client` to 6.13.4 and `log4j` to 2.24.2 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/24 05:11:29 UTC, 3 replies.
- [PR] [SPARK-50402][SQL][TESTS] Upgrade PostgreSQL docker image to 17.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/24 05:24:07 UTC, 6 replies.
- [PR] [SPARK-50404][PySpark] PySpark DataFrame Pipe Method [spark] - posted by "lucas-nelson-uiuc (via GitHub)" <gi...@apache.org> on 2024/11/24 21:46:23 UTC, 0 replies.
- Re: [PR] [SPARK-50395][SQL] Fix malformed URI syntax in Windows [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/24 23:48:41 UTC, 4 replies.
- Re: [PR] [SPARK-50404][PYTHON] PySpark DataFrame Pipe Method [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/24 23:51:59 UTC, 3 replies.
- Re: [PR] [SPARK-50240][CORE] Added Simple Sanitization of Extra JVM Options [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/25 00:03:34 UTC, 8 replies.
- [PR] [SPARK-50394][PYTHON][INFRA][FOLLOW-UP] Reduce parallelism further in Pure Python library builds [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/25 00:49:34 UTC, 6 replies.
- Re: [PR] [SPARK-50405] Handle collation type coercion of complex data types properly [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/11/25 01:37:48 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-50361][SQL] Fix bugs of using Lateral Column Alias in ORDER BY [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/11/25 05:39:43 UTC, 1 replies.
- Re: [PR] [SPARK-50116][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_2067`: `UNSUPPORTED_PARTITION_TRANSFORM` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/11/25 07:43:06 UTC, 0 replies.
- [PR] [SPARK-50406][PYTHON] Improve pyspark.sql.tests.test_udtf [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/11/25 07:57:59 UTC, 0 replies.
- [PR] [SPARK-48344][SQL] Prepare SQL Scripting for addition of Execution Framework 2 [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2024/11/25 09:51:23 UTC, 0 replies.
- Re: [PR] [SPARK-39142][SPARK-42235][PYTHON] Add overloads in pandas function stub file [spark] - posted by "bjtho08 (via GitHub)" <gi...@apache.org> on 2024/11/25 09:55:56 UTC, 0 replies.
- [PR] Fix reminder to follow context [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/11/25 10:00:23 UTC, 1 replies.
- [PR] [SPARK-45151][UI][FOLLOWUP] Add missing space before date value [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/11/25 10:11:27 UTC, 1 replies.
- [PR] [SPARK-50408][PYTHON][DOCS] Refine the docstring for datetime functions - part 4 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/25 10:14:00 UTC, 2 replies.
- Re: [PR] [SPARK-50406][PYTHON][TESTS] Improve pyspark.sql.tests.test_udtf [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/25 10:20:09 UTC, 5 replies.
- Re: [PR] [SPARK-48344][SQL] Prepare SQL Scripting for addition of Execution Framework - part 2 [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2024/11/25 10:33:31 UTC, 23 replies.
- [PR] [MINOR][PYTHON] Remove some unused third-part library imports [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/25 11:06:15 UTC, 0 replies.
- [PR] [CONNECT] Refactor the `sql` function in `SparkSession` to remove duplicate code [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/11/25 11:25:25 UTC, 0 replies.
- Re: [PR] [MINOR][PYTHON] Remove some unused third-party library imports [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/25 11:30:54 UTC, 1 replies.
- Re: [PR] [SPARK-50409][SQL] Fix reminder to follow query context [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/25 11:54:04 UTC, 1 replies.
- Re: [PR] [SPARK-49547][SQL][PYTHON] Support returning iterator of RecordBatches in applyInArrow [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2024/11/25 12:30:32 UTC, 4 replies.
- [PR] [DRAFT] Add ctas flag to insert [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/11/25 13:22:24 UTC, 0 replies.
- [PR] [SPARK-50412][BUILD] Rename `ojdbc11.version` to `ojdbc17.version` [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/11/25 13:48:22 UTC, 2 replies.
- [PR] [SPARK-49436][Connect][SQL][WIP] Common interface for SQLContext [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/11/25 16:50:34 UTC, 9 replies.
- Re: [PR] [CONNECT] Refactor the `sql` function in `SparkSession` to eliminate duplicate code [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/25 17:34:54 UTC, 0 replies.
- [PR] [SPARK-50415][BUILD] Upgrade `zstd-jni` to 1.5.6-8 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/25 17:48:42 UTC, 3 replies.
- [PR] [SPARK-50417] Make number of FallbackStorage sub-directories configurable [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/11/25 19:37:52 UTC, 1 replies.
- [PR] [SPARK-50418][SQL] Allow an optional trailing comma at the end of SELECT lists [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/11/25 20:07:09 UTC, 5 replies.
- Re: [PR] [SPARK-48344][SQL] Add SQL Scripting Execution Framework [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/11/25 22:28:19 UTC, 26 replies.
- [PR] [DRAFT] Fix session collation order [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/11/25 23:19:51 UTC, 0 replies.
- Re: [PR] [SPARK-46934][SQL] Read/write roundtrip for struct type with special characters with HMS [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/26 01:19:54 UTC, 8 replies.
- Re: [PR] [SPARK-50410][CONNECT] Refactor the `sql` function in `SparkSession` to eliminate duplicate code [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/11/26 02:20:45 UTC, 3 replies.
- [PR] [SPARK-50421][wip]fix executor related memory config incorrect when multiple resource profile worked [spark] - posted by "zjuwangg (via GitHub)" <gi...@apache.org> on 2024/11/26 03:44:42 UTC, 1 replies.
- Re: [PR] [SPARK-50017][SS] Support Avro encoding for TransformWithState operator [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/11/26 04:33:13 UTC, 3 replies.
- [PR] [SPARK-50310][PYTHON] Add a flag to disable DataFrameQueryContext for PySpark [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/11/26 05:20:20 UTC, 4 replies.
- [PR] [SPARK-50422][SQL] Make `Parameterized SQL queries` of `SparkSession.sql` API GA [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/11/26 05:53:18 UTC, 5 replies.
- [PR] [MINPR][TESTS] Use SparkContext.setLogLevel in QuietTest [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/26 06:29:37 UTC, 0 replies.
- Re: [PR] [SPARK-50310][PYTHON] Apply a flag to disable DataFrameQueryContext for PySpark [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/26 06:30:50 UTC, 5 replies.
- [PR] [Test Only][INFRA] extract common dockerfile [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/26 06:30:56 UTC, 0 replies.
- [PR] corrected link to mllib-guide.md [spark] - posted by "oshindutta (via GitHub)" <gi...@apache.org> on 2024/11/26 06:49:59 UTC, 0 replies.
- [PR] [SPARK-50423][PYTHON][DOCS] Refine the docstring for misc and hash functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/26 07:28:20 UTC, 2 replies.
- Re: [PR] [MINOR][TESTS] Use SparkContext.setLogLevel in QuietTest [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/26 09:03:43 UTC, 5 replies.
- [PR] [SPARK-50425][BUILD] Bump Apache Parquet to 1.15.0 [spark] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2024/11/26 09:26:14 UTC, 2 replies.
- [PR] [SPARK-50426][PYTHON] Avoid static Python data source lookup when using builtin or Java data sources [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/11/26 09:43:05 UTC, 12 replies.
- Re: [PR] [SPARK-50427][CONNECT][PYTHON] Expose configure_logging as a public API [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/26 10:16:55 UTC, 3 replies.
- Re: [PR] [SPARK-50130][SQL][FOLLOWUP] Simplify the implementation of col.outer() [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/11/26 10:19:57 UTC, 7 replies.
- Re: [PR] [SPARK-50424][INFRA] Extract the common content of `Dockerfile` from `Docs`, `Linter`, and `SparkR` test images [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/26 11:16:00 UTC, 3 replies.
- [PR] [Test Only][BUILD] Test sbt 1.10.5 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/26 11:36:31 UTC, 4 replies.
- [PR] [SPARK-50388][PYTHON][TESTS][FOLLOW-UP] Move `have_flameprof` to `pyspark.testing.utils` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/26 12:27:10 UTC, 2 replies.
- [PR] Remove session string calls [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/11/26 12:56:37 UTC, 0 replies.
- Re: [PR] [SPARK-49966][SQL] Use `Invoke` to implement `JsonToStructs`(`from_json`) [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/26 13:11:36 UTC, 9 replies.
- [PR] [BUILD] Test arrow 18.1.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/11/26 16:04:40 UTC, 0 replies.
- [PR] [BUILD] Test Guava 33.3.1-jre [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/11/26 16:15:11 UTC, 0 replies.
- Re: [PR] [SPARK-48867][BUILD] Upgrade `okhttp` to 4.12.0, `okio` to 3.9.0 and `esdk-obs-java` to 3.24.3 [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2024/11/26 16:16:36 UTC, 0 replies.
- Re: [PR] [SPARK-50302][SS] Ensure secondary index sizes equal primary index sizes for TransformWithState stateful variables with TTL [spark] - posted by "neilramaswamy (via GitHub)" <gi...@apache.org> on 2024/11/26 19:08:55 UTC, 7 replies.
- [PR] [SPARK-50430][CORE] Use the standard Properties.clone instead of manual clone [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/27 03:10:53 UTC, 2 replies.
- [PR] [SPARK-49966][SQL][FOLLOWUP] Codegen Support for JsonToStructs(`from_json`) - remove Invoke [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/27 03:23:44 UTC, 1 replies.
- [PR] [SPARK-50432] Remove workaround for THRIFT-4805 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/11/27 05:52:31 UTC, 4 replies.
- [PR] [SPARK-50433][DOCS][TEST] Fix confguring log4j2 guide docs for Spark on YARN and UT [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/11/27 06:39:47 UTC, 7 replies.
- [PR] [WIP][SPARK-50392][PYTHON] Implement partitionBy, orderBy and withSinglePartition of df.argument() in Spark Classic [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/11/27 06:57:57 UTC, 0 replies.
- [PR] [SPARK-50333][SQL][FOLLOWUP] Codegen Support for `CsvToStructs`(`from_csv`) - remove Invoke [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/27 07:38:37 UTC, 3 replies.
- [PR] [SPARK-50434][CORE] Make Utils.setLogLevel synchronized [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/27 07:39:23 UTC, 4 replies.
- [PR] [SPARK-50437][SS] Reduce overhead of creating deserializers in TransformWithStateExec [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2024/11/27 07:44:46 UTC, 11 replies.
- Re: [PR] [SPARK-49992][SQL] Default collation resolution for DDL and DML queries [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/27 07:45:08 UTC, 50 replies.
- [PR] [WIP][SPARK-46934][SQL][FOLLOWUP] Read/write roundtrip for struct type with special characters with HMS - a backward compatible approach [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/11/27 09:26:15 UTC, 6 replies.
- Re: [PR] [SPARK-49966][SQL][FOLLOWUP] Codegen Support for `JsonToStructs`(`from_json`) - remove Invoke [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/27 12:00:39 UTC, 1 replies.
- [PR] [SPARK-50067]][SPARK-50066][SPARK-49954][SQL][FOLLOWUP] Make returnNullable as false [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/27 13:47:33 UTC, 3 replies.
- [PR] [SPARK-50440] [SQL] Refactor AttributeSeq.resolveCandidates [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2024/11/27 15:21:31 UTC, 6 replies.
- [PR] [SQL] Fix SQL Scripting grammar allowing empty bodies for loops, IF and CASE [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2024/11/27 15:28:05 UTC, 5 replies.
- Re: [PR] [SPARK-49436][Connect][SQL] Common interface for SQLContext [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/11/27 16:42:40 UTC, 0 replies.
- [PR] Schema id avro [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/11/27 17:30:36 UTC, 0 replies.
- [PR] [WIP] State Schema Mapping [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/11/27 18:47:41 UTC, 1 replies.
- [PR] Draft timer [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/11/27 19:28:34 UTC, 0 replies.
- [PR] Use putAll to populate Properties [spark] - posted by "tedyu (via GitHub)" <gi...@apache.org> on 2024/11/27 19:34:28 UTC, 1 replies.
- [PR] fix [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2024/11/27 19:43:10 UTC, 0 replies.
- [PR] [WIP] Fixing maven build for Guava dependency [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/11/27 23:07:40 UTC, 0 replies.
- [PR] [SPARK-50443] Fixing Maven build errors introduced by Guava cache in RocksDBStateStoreProvider [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/11/27 23:54:12 UTC, 7 replies.
- Re: [PR] [SPARK-49294][UI] Add width attribute for shuffle-write-time checkbox. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/28 00:26:01 UTC, 6 replies.
- Re: [PR] [SPARK-45854][SQL] listTables should not fail with a temp view and DelegatingCatalogExtension [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/28 00:26:02 UTC, 1 replies.
- [PR] [SPARK-50444][BUILD] Upgrade dropwizard metrics to 4.2.29 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/28 01:25:37 UTC, 4 replies.
- [PR] [SPARK-50445][PYTHON][DOCS] Refine docString of generator Functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/28 01:53:17 UTC, 2 replies.
- [PR] [WIP][SQL] Skip the parameter mode check in `Call` command [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/28 02:14:51 UTC, 0 replies.
- Re: [PR] [SPARK-50443][SS] Fixing Maven build errors introduced by Guava cache in RocksDBStateStoreProvider [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/11/28 03:48:01 UTC, 2 replies.
- Re: [PR] [SPARK-46934][SQL][FOLLOWUP] Read/write roundtrip for struct type with special characters with HMS - a backward compatible approach [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/11/28 05:30:28 UTC, 8 replies.
- [PR] [SPARK-50446][PYTHON] Concurrent level in Arrow-optimized Python UDF [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/11/28 06:42:45 UTC, 8 replies.
- [PR] [SPARK-50436][PYTHON][TESTS] Use assertDataFrameEqual in pyspark.sql.tests.test_udf [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/11/28 07:38:18 UTC, 0 replies.
- [PR] [TEST Only] Test mima check for sbt 1.10. [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/28 08:21:43 UTC, 1 replies.
- Re: [PR] [SPARK-50439][BUILD] Upgrade `Arrow` to 18.1.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/28 09:30:36 UTC, 2 replies.
- [PR] [WIP][SPARK-50263][CONNECT] Replace System.currentTimeMillis with System.nanoTime [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/11/28 10:49:01 UTC, 0 replies.
- [PR] [SPARK-50448][SQL][TESTS] Extract postgres image common configuration as PostgresDatabaseOnDocker [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/28 11:48:40 UTC, 2 replies.
- Re: [PR] [SPARK-50448][SQL][TESTS] Extract postgres image common conf as PostgresDatabaseOnDocker [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/28 11:55:19 UTC, 4 replies.
- Re: [PR] [SPARK-50449][SQL] Fix SQL Scripting grammar allowing empty bodies for loops, IF and CASE [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2024/11/28 12:32:28 UTC, 0 replies.
- Re: [PR] [Test Only][BUILD] Upgrade `sbt` to `1.10.5` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/11/28 13:13:35 UTC, 0 replies.
- [PR] [SPARK-49547][SQL][PYTHON] Add iterator of `RecordBatch` API to `applyInArrow` [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2024/11/28 13:54:18 UTC, 7 replies.
- [PR] [DRAFT][SPARK-48344][SQL] Add Frames and Scopes to support Exception Handlers and Local Variables [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2024/11/28 14:53:05 UTC, 0 replies.
- [PR] [WIP] Cached classloader for ArtifactManager [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/11/28 15:36:12 UTC, 0 replies.
- [PR] Test netty 4.1.115 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/11/28 16:12:11 UTC, 1 replies.
- [PR] Revert "From json/xml should not change collations in the given schema" [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/11/28 16:15:39 UTC, 0 replies.
- Re: [PR] [SPARK-49321][SQL] Bind JDBC dialect to JDBCRDD at construction [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/29 00:25:49 UTC, 1 replies.
- [PR] [SPARK-50452][BUILD] Upgrade jackson to 2.18.2 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/29 01:22:43 UTC, 0 replies.
- Re: [PR] [SPARK-50441][SQL] Fix parametrized identifiers not working when referencing CTEs [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/29 02:13:07 UTC, 7 replies.
- Re: [PR] [SPARK-50453][BUILD] Upgrade Netty to 4.1.115 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/11/29 03:02:30 UTC, 4 replies.
- Re: [PR] [SPARK-50447][SQL] Skip the parameter mode check in `Call` command [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/11/29 03:29:02 UTC, 2 replies.
- [PR] [SPARK-50436][PYTHON][TESTS] Use assertDataFrameEqual in pyspark.sql.tests.test_functions [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/11/29 05:01:02 UTC, 0 replies.
- [PR] [SPARK-50311][PYTHON][FOLLOWUP] remove @remote_only from supported APIs [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/11/29 06:13:36 UTC, 0 replies.
- [PR] [SPARK-50295][DOCS][FOLLOWUP] Document `build-docs` in `docs/README.md` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/11/29 07:12:51 UTC, 15 replies.
- [PR] [WIP][SPARK-50357][PYTHON] Support Interrupt(Tag|All) APIs for PySpark [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/11/29 07:54:51 UTC, 2 replies.
- [PR] [SPARK-50456][PYTHON] Move hash functions to a separate file [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/11/29 08:07:28 UTC, 3 replies.
- Re: [PR] [SPARK-50311][PYTHON][FOLLOWUP] Remove @remote_only from supported APIs [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/11/29 09:00:25 UTC, 1 replies.
- [PR] [SPARK-50458][CORE][SQL] Proper error handling for unsupported file system when reading files [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/11/29 11:01:38 UTC, 0 replies.
- [PR] [WIP][SPARK-50454][SQL] Replace assertEqual with assertDataFrameEqual in pyspark.sql.tests.test_functions [spark] - posted by "karim-ramadan (via GitHub)" <gi...@apache.org> on 2024/11/29 11:33:52 UTC, 0 replies.
- Re: [PR] [SPARK-44473][SQL] [BUG] Overwriting the same partition of a partitioned table multiple times with empty data yields non-idempotent results [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/11/30 00:25:05 UTC, 0 replies.
- [PR] [SPARK-48148][FOLLOWUP] Fix JSON parser feature flag. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/11/30 01:08:00 UTC, 1 replies.
- [PR] [WIP][SPARK-XXXX] Fix avro deserialization breaking for UnionType[null, Record] [spark] - posted by "rbs392 (via GitHub)" <gi...@apache.org> on 2024/11/30 05:29:38 UTC, 0 replies.
- [PR] [WIP][SPARK-XXXX][Collation] Prevent Regex with collated strings [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2024/11/30 22:42:26 UTC, 0 replies.