reviews@spark.apache.org, 2024-09

You are viewing a plain text version of this content. The canonical link for it is here.

- Re: [PR] [WIP][DO NOT REVIEW] dummy PR [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/01 00:27:11 UTC, 0 replies.
- Re: [PR] [SPARK-48354][SQL] JDBC Connectors predicate pushdown testing [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/01 00:27:12 UTC, 0 replies.
- Re: [PR] [SPARK-48298][Core] Add TCP mode to StatsD sink [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/01 00:27:13 UTC, 1 replies.
- [PR] [SPARK-49483][BUILD] Upgrade `commons-lang3` to 3.17.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/01 02:07:40 UTC, 2 replies.
- Re: [PR] [SPARK-47263][SQL] Rename the error class _LEGACY_ERROR_TEMP_13[44-46… [spark] - posted by "PaysonXu (via GitHub)" <gi...@apache.org> on 2024/09/01 03:58:00 UTC, 4 replies.
- Re: [PR] [SPARK-49015][CORE] Connect Server should respect `spark.log.structuredLogging.enabled` [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/09/01 04:32:27 UTC, 2 replies.
- Re: [PR] [SPARK-46798][Structured Streaming] Kafka custom partition location assignment (rack awareness) [spark] - posted by "neilramaswamy (via GitHub)" <gi...@apache.org> on 2024/09/01 06:33:17 UTC, 4 replies.
- Re: [PR] [SPARK-49347][R][FOLLOW-UP] Set SPARK_TESTING in Windows build [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/01 06:51:17 UTC, 1 replies.
- Re: [PR] [SPARK-49476] Fix nullability of base64 function [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/01 07:28:46 UTC, 1 replies.
- Re: [PR] [SPARK-49392] Catch errors when failing to write to external data source [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/01 08:14:16 UTC, 12 replies.
- Re: [PR] [SPARK-47336][SQL][CONNECT] Provide to PySpark a functionality to get estimated size of DataFrame in bytes [spark] - posted by "SemyonSinchenko (via GitHub)" <gi...@apache.org> on 2024/09/01 08:31:38 UTC, 0 replies.
- Re: [PR] [SPARK-49275][SQL] Fix return type nullness of the xpath expression [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/01 08:45:02 UTC, 4 replies.
- Re: [PR] [SPARK-48549][SQL] Restrict the number of parameters for function `sentences` to `1` or `3` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/01 09:20:45 UTC, 1 replies.
- Re: [PR] [SPARK-48682][SQL][FOLLOW-UP] Changed initCap behaviour with UTF8_BINARY collation [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/01 10:15:36 UTC, 1 replies.
- [PR] [SPARK-49485] Fix speculative task hang bug due to remaining executor… [spark] - posted by "buska88 (via GitHub)" <gi...@apache.org> on 2024/09/01 13:40:28 UTC, 1 replies.
- Re: [PR] [SPARK-47263][SQL] Assign names to the legacy conditions _LEGACY_ERROR_TEMP_13[44-46] [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/01 15:27:06 UTC, 9 replies.
- Re: [PR] [SPARK-49044][SQL] ValidateExternalType should return child in error [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/01 16:27:26 UTC, 18 replies.
- Re: [PR] [SPARK-49411][SS] Communicate CheckpointID between driver and stateful operators [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/09/01 18:32:32 UTC, 13 replies.
- Re: [PR] [SPARK-49476][SQL] Fix nullability of base64 function [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2024/09/01 21:44:03 UTC, 5 replies.
- Re: [PR] [SPARK-48352][SQL]set max file counter through spark conf [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/02 00:23:26 UTC, 1 replies.
- Re: [PR] [SPARK-48385][SQL] Migrate the jdbc driver of mariadb from `2.x` to `3.x` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/02 00:23:28 UTC, 1 replies.
- Re: [PR] [SPARK-43815][SQL] Wrap NPE with AnalysisException in CSV, XML, and JSON options [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/02 00:23:29 UTC, 1 replies.
- Re: [PR] [SPARK-48309][YARN]Stop am retry, in situations where some errors and retries may not be successful [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/02 00:23:30 UTC, 1 replies.
- [PR] [SPARK-49486][BUILD] Upgrade tink to 1.15.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/02 01:43:21 UTC, 1 replies.
- Re: [PR] [SPARK-49383][SQL][PYTHON][CONNECT] Support Transpose DataFrame API [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/09/02 02:12:28 UTC, 53 replies.
- Re: [PR] [SPARK-41469][CORE] Avoid unnecessary task rerun on decommissioned executor lost if shuffle data migrated [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2024/09/02 02:20:02 UTC, 0 replies.
- Re: [PR] [SPARK-49480][CORE] Fix NullPointerException from `SparkThrowableHelper.isInternalError` [spark] - posted by "jshmchenxi (via GitHub)" <gi...@apache.org> on 2024/09/02 02:48:45 UTC, 4 replies.
- Re: [PR] [SPARK-49085][SQL] Remove special casing for Protobuf functions in Connect [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/09/02 02:54:25 UTC, 15 replies.
- Re: [PR] [SPARK-49451] Allow duplicate keys in parse_json. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/09/02 02:58:35 UTC, 2 replies.
- Re: [PR] [SPARK-46698][SPARK-46895][CORE][3.5] Replace Timer with single thread scheduled executor [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/09/02 03:04:28 UTC, 2 replies.
- Re: [PR] [SPARK-49455][SQL][TESTS] Refactor `StagingInMemoryTableCatalog` to override the non-deprecated functions [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/02 03:27:39 UTC, 2 replies.
- Re: [PR] [SPARK-49459][CORE][SHUFFLE] Support `CRC32C` for Shuffle Checksum [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/09/02 05:36:23 UTC, 0 replies.
- Re: [PR] [SPARK-49016][SQL] Restore the behavior that queries from raw CSV files are disallowed when only include corrupt record column and assign name to `_LEGACY_ERROR_TEMP_1285` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/09/02 05:39:38 UTC, 1 replies.
- [PR] [WIP][SPARK-49488][SQL] Improve the DS V2 pushdown framework for DayOfWeek and WeekDay [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2024/09/02 05:49:42 UTC, 0 replies.
- Re: [PR] [SPARK-49470][UI] Update dataTables stylesheets and javascripts from 1.13.5 to 1.13.11 [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/09/02 06:48:47 UTC, 3 replies.
- [PR] [SPARK-47307][SQL][FOLLOWUP] Fix Base64#nullable [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/09/02 06:50:35 UTC, 4 replies.
- Re: [PR] [SPARK-47307][SQL][3.5] Add a config to optionally chunk base64 strings [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/09/02 06:51:19 UTC, 0 replies.
- Re: [PR] [SPARK-49396][SQL] remain nullability while simplifyConditional [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/09/02 08:00:03 UTC, 3 replies.
- Re: [PR] [SPARK-49162][SQL] Push down date_trunc function [spark] - posted by "stefanbuk-db (via GitHub)" <gi...@apache.org> on 2024/09/02 08:02:38 UTC, 32 replies.
- Re: [PR] [SPARK-48549][SQL] Improve SQL function `sentences` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/02 08:51:35 UTC, 23 replies.
- Re: [PR] [SPARK-49445][UI] Support show tooltip in the progress bar of UI [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/09/02 08:59:48 UTC, 5 replies.
- Re: [PR] [SPARK-47573][K8S] Support custom driver log url [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/09/02 09:12:35 UTC, 17 replies.
- [PR] ODP-2165 Upgrade Jackson, Jetty and common-compress versions [spark] - posted by "senthh (via GitHub)" <gi...@apache.org> on 2024/09/02 09:47:55 UTC, 1 replies.
- Re: [PR] [SPARK-49241][CORE] Add `OpenTelemetryPush` Sink with `opentelemetry` profile [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/02 11:50:23 UTC, 9 replies.
- [PR] [WIP] Do not consider empty partitions for skew join calculations [spark] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2024/09/02 11:59:03 UTC, 2 replies.
- Re: [PR] [SPARK-49203][SQL] Add expression for `java.util.Arrays.binarySearch` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/02 12:23:03 UTC, 5 replies.
- [PR] [SPARK-49492] Reattach attempted on inactive ExecutionHolder [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/09/02 12:49:23 UTC, 0 replies.
- Re: [PR] [SPARK-48782][SQL] Add support for executing procedures in catalogs [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/09/02 12:54:36 UTC, 25 replies.
- [PR] [SPARK-49479][CORE] Use daemon ScheduledThreadPoolExecutor for BarrierCoordinator [spark] - posted by "jshmchenxi (via GitHub)" <gi...@apache.org> on 2024/09/02 13:25:35 UTC, 4 replies.
- [PR] [SPARK-46698][CORE][3.5] Replace Timer with single thread scheduled executor for ConsoleProgressBar [spark] - posted by "jshmchenxi (via GitHub)" <gi...@apache.org> on 2024/09/02 13:42:51 UTC, 1 replies.
- Re: [PR] [SPARK-46895][CORE][3.5] Replace Timer with single thread scheduled executor [spark] - posted by "jshmchenxi (via GitHub)" <gi...@apache.org> on 2024/09/02 14:00:22 UTC, 0 replies.
- Re: [PR] [SPARK-44239][SQL] Free memory allocated by large vectors when vectors are reset [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/09/02 14:27:23 UTC, 2 replies.
- Re: [PR] [SPARK-48824] Add Identity Column SQL syntax [spark] - posted by "zhipengmao-db (via GitHub)" <gi...@apache.org> on 2024/09/02 15:07:51 UTC, 2 replies.
- [PR] Added test to check difference between SR_AI and SR_Latn_AI collations [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2024/09/02 15:34:21 UTC, 2 replies.
- [PR] [SPARK-49275][SQL][3.5] Fix return type nullness of the xpath expression [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/09/02 16:28:13 UTC, 4 replies.
- [PR] [SPARK-49422][CONNECT][SQL] Create a shared KeyValueGroupedDataset [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/02 19:04:19 UTC, 0 replies.
- [PR] [SPARK-49420][CONNECT][SQL] Add shared interface for DataFrameNaFunctions [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/02 20:26:15 UTC, 2 replies.
- [PR] [SPARK-49426][CONNECT][SQL] Create a shared interface for DataFrameWriterV2 [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/02 21:05:25 UTC, 1 replies.
- Re: [PR] [SPARK-49441][ML] `StringIndexer` sort arrays in executors [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/03 00:27:40 UTC, 1 replies.
- [PR] [SPARK-49427][CONNECT][SQL] Create a shared interface for MergeIntoWriter [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/03 00:30:21 UTC, 6 replies.
- [PR] [SPARK-49476][SQL][FOLLOWUP] Fix base64 proto test [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2024/09/03 00:36:50 UTC, 0 replies.
- Re: [PR] [SPARK-49443][SQL][PYTHON] Implement to_variant_object expression and make schema_of_variant expressions print OBJECT for for Variant Objects [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/09/03 02:23:55 UTC, 14 replies.
- Re: [PR] [SPARK-42199][SQL] Fix issues around Dataset.groupByKey [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/09/03 02:34:34 UTC, 17 replies.
- [PR] [WIP][INFRA] Refresh testing image for pyarrow 17 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/03 02:45:53 UTC, 0 replies.
- [PR] [SPARK-49494][DOCS] Use spark logos from spark-website in docs [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/09/03 03:40:34 UTC, 6 replies.
- [PR] List state [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/09/03 04:36:36 UTC, 1 replies.
- Re: [PR] [SPARK-49425][CONNECT][SQL]Create a shared DataFrameWriter [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/03 04:44:27 UTC, 1 replies.
- Re: [PR] [SPARK-49476][SQL][3.5][FOLLOWUP] Fix base64 proto test [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/09/03 05:44:35 UTC, 1 replies.
- [PR] [SPARK-49495][SQL] Document and Feature Preview on the master branch via Live GitHub Pages Updates [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/09/03 06:41:30 UTC, 6 replies.
- Re: [PR] [SPARK-49496][INFRA][PYTHON] Refresh testing image for pyarrow 17 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/03 06:46:55 UTC, 3 replies.
- [PR] [spark][BUILD] Upgrade protobuf-java to 3.25.4 [spark] - posted by "dev-lpq (via GitHub)" <gi...@apache.org> on 2024/09/03 06:50:29 UTC, 1 replies.
- Re: [PR] [SPARK-49444][SQL] Modified UnivocityParser to throw runtime exceptions caused by ArrayIndexOutOfBounds with more user-oriented messages [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/03 07:11:47 UTC, 5 replies.
- Re: [PR] [SPARK-49492][CONNECT] Reattach attempted on inactive ExecutionHolder [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/03 07:26:49 UTC, 18 replies.
- Re: [PR] [MINOR][INFRA] Exclude .python-version from git [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/03 07:28:34 UTC, 1 replies.
- Re: [PR] [SPARK-49458][CONNECT][PYTHON] Supply server-side session id via ReattachExecute [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/03 07:30:14 UTC, 7 replies.
- [PR] [SPARK-49202][PS] Apply `ArrayBinarySearch` for histogram [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/03 07:38:28 UTC, 2 replies.
- Re: [PR] [SPARK-49497][BUILD] Upgrade protobuf-java to 3.25.4 [spark] - posted by "dev-lpq (via GitHub)" <gi...@apache.org> on 2024/09/03 07:57:52 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-49488][SQL] MySQL dialect supports pushdown datetime functions. [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/03 08:07:36 UTC, 1 replies.
- Re: [PR] [SPARK-49485][CORE] Fix speculative task hang bug due to remaining executor lay on same host [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/03 08:33:53 UTC, 1 replies.
- [PR] ODP-2175 Upgrade libthrift version from 0.14.1 to 0.16 [spark] - posted by "senthh (via GitHub)" <gi...@apache.org> on 2024/09/03 08:55:08 UTC, 1 replies.
- [PR] [SPARK-49347][R][FOLLOW-UP] Use dedicated environment variable for SparkR deprecation warning [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/03 09:02:14 UTC, 2 replies.
- [PR] [SPARK-48348][SPARK-48376][SQL] Introduce LEAVE and ITERATE statements [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2024/09/03 10:36:25 UTC, 8 replies.
- Re: [PR] [SPARK-48698][SQL] Support analyze column stats for tables with collated columns [spark] - posted by "nikolamand-db (via GitHub)" <gi...@apache.org> on 2024/09/03 10:57:25 UTC, 1 replies.
- [PR] [SPARK-49249][SPARK-49122][Connect][SQL] Add missing doc for the `addArtifact` API [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/09/03 11:00:20 UTC, 0 replies.
- [PR] [SPARK-49414][CONNECT][SQL] Add Shared DataFrameReader interface [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/03 14:05:49 UTC, 2 replies.
- [PR] [SPARK-49501] Fix double-escaping of table location [spark] - posted by "cstavr (via GitHub)" <gi...@apache.org> on 2024/09/03 14:25:22 UTC, 0 replies.
- [PR] [SPARK-49502][CORE] Avoid NPE in SparkEnv.get.shuffleManager.unregisterShuffle [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/09/03 14:31:25 UTC, 6 replies.
- Re: [PR] [SPARK-48867][BUILD] Upgrade `okhttp` to 4.12.0, `okio` to 3.9.0 and `esdk-obs-java` to 3.24.3 [spark] - posted by "roczei (via GitHub)" <gi...@apache.org> on 2024/09/03 14:42:07 UTC, 0 replies.
- Re: [PR] [SPARK-27085][SQL] Migrate CSV to File Data Source V2 [spark] - posted by "liujiayi771 (via GitHub)" <gi...@apache.org> on 2024/09/03 15:35:09 UTC, 6 replies.
- Re: [PR] [SPARK-47995][PYTHON][INFRA][TESTS] Upgrade `pyarrow` to 17.0.0 in GitHub Action CI [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/03 15:43:02 UTC, 0 replies.
- Re: [PR] [SPARK-47995][INFRA][PYTHON] Refresh testing image for pyarrow 17 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/03 15:43:03 UTC, 10 replies.
- [PR] [SPARK-49467] Add support for state data source reader and list state [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/09/03 19:25:23 UTC, 0 replies.
- Re: [PR] [SPARK-49467][SS] Add support for state data source reader and list state [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/09/03 19:31:46 UTC, 27 replies.
- Re: [PR] [SPARK-48449][SQL] Using `getPropertyInfo` instead of `reflection` to obtain `JAAS application name` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/03 20:10:56 UTC, 0 replies.
- [PR] [SPARK-49504][BUILD] Add `jjwt` profile [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/03 20:56:45 UTC, 5 replies.
- [PR] [SPARK-49413][CONNECT][SQL] Create a shared RuntimeConfig interface [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/03 20:56:56 UTC, 21 replies.
- [PR] [SPARK-49396][SQL] modify nullability check for CaseWhen expression [spark] - posted by "averyqi-db (via GitHub)" <gi...@apache.org> on 2024/09/03 21:02:56 UTC, 6 replies.
- Re: [PR] [SPARK-49474][SS] Classify Error class for FlatMapGroupsWithState user function error [spark] - posted by "liviazhu-db (via GitHub)" <gi...@apache.org> on 2024/09/03 22:16:43 UTC, 8 replies.
- [PR] [SPARK-48965][SQL] Use the correct schema in `Dataset#toJSON` [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2024/09/03 23:10:05 UTC, 9 replies.
- Re: [PR] [SPARK-49422][CONNECT][SQL] Create a shared interface for KeyValueGroupedDataset [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/03 23:18:18 UTC, 1 replies.
- Re: [PR] [SPARK-49249][SPARK-49122][CONNECT][SQL] Add missing doc for the `addArtifact` API [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/03 23:22:45 UTC, 1 replies.
- Re: [PR] [SPARK-49478][CONNECT] Handle null metrics in ConnectProgressExecutionListener [spark] - posted by "davintjong-db (via GitHub)" <gi...@apache.org> on 2024/09/03 23:44:14 UTC, 6 replies.
- Re: [PR] [SPARK-49477][PYTHON] Improve pandas udf invalid return type error message [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/04 00:26:12 UTC, 1 replies.
- Re: [PR] [SPARK-48960][CONNECT] Makes spark-submit works with Spark connect [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/09/04 02:01:23 UTC, 5 replies.
- Re: [PR] [SPARK-21195][CORE] Dynamically register metrics from sources as they are reported [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/09/04 03:54:25 UTC, 7 replies.
- Re: [PR] [SPARK-48758][Core] Race condition between executor registration and heartbeat [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/09/04 04:09:37 UTC, 0 replies.
- [PR] [SPARK-49307][CONNECT][SQL] Add Kryo serialization to agnostic encoder framework. [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/04 04:10:49 UTC, 5 replies.
- Re: [PR] [SPARK-49408][SQL] Use IndexedSeq in ProjectingInternalRow [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2024/09/04 04:13:27 UTC, 4 replies.
- Re: [PR] [SPARK-43301][CORE][SHUFFLE] BlockStoreClient getHostLocalDirs RPC supports IOException retry [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/09/04 04:19:22 UTC, 2 replies.
- Re: [PR] [SPARK-48788][CORE][UI] Expose task peak onheap/offheap execution memory to API and Spark UI [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/09/04 04:30:00 UTC, 3 replies.
- Re: [PR] [SPARK-49303][SS] Implement TTL for ValueState in transformWithStateInPandas API [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2024/09/04 04:31:02 UTC, 8 replies.
- [PR] [SPARK-49506][SQL] Optimize ArrayBinarySearch for foldable array [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/04 06:28:45 UTC, 66 replies.
- [PR] [MINOR][DOCS] Fix site.SPARK_VERSION pattern in RDD Programming Guide [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/09/04 06:52:41 UTC, 2 replies.
- [PR] Refactor the code structure of `opentelemetry` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/04 08:07:04 UTC, 1 replies.
- Re: [PR] [SPARK-48493][PYTHON] Enhance Python Datasource Reader with direct Arrow Batch support for improved performance [spark] - posted by "LucaCanali (via GitHub)" <gi...@apache.org> on 2024/09/04 08:19:32 UTC, 3 replies.
- [PR] [SPARK-49509][CORE] Use `Platform.allocateDirectBuffer` instead of `ByteBuffer.allocateDirect` [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/09/04 09:02:49 UTC, 2 replies.
- [PR] [SPARK-44239][SQL][MINOR] Update default hugeVectorThreshold from 0 to -1 in code [spark] - posted by "wankunde (via GitHub)" <gi...@apache.org> on 2024/09/04 10:06:34 UTC, 0 replies.
- Re: [PR] [SPARK-49495][DOCS] Document and Feature Preview on the master branch via Live GitHub Pages Updates [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/09/04 10:32:15 UTC, 26 replies.
- Re: [PR] [SPARK-49110][SQL] Fix reading metadata columns for tables with CHAR columns [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/09/04 12:48:36 UTC, 0 replies.
- Re: [PR] [SPARK-44239][SQL] Update default hugeVectorThreshold from 0 to -1 in code [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/09/04 14:32:04 UTC, 0 replies.
- Re: [PR] [CORE][BUILD] Change to using `build-helper-maven-plugin` to manage the code for `opentelemetry` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/04 15:09:29 UTC, 1 replies.
- [PR] [WIP][SPARK-49511][SQL] Apply formatting rules to sql/api [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/04 15:30:51 UTC, 4 replies.
- [PR] [SPARK-49512][K8S][DOCS] Drop K8s v1.27 Support [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/04 17:10:34 UTC, 6 replies.
- [PR] [SPARK-49284][CONNECT][SQL] Create a shared Catalog interface [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/04 17:17:03 UTC, 5 replies.
- [PR] [SPARK-49514] Fix K8s version in GitHub Action CI [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/04 17:39:17 UTC, 7 replies.
- Re: [PR] [SPARK-49464] Add docs for operator [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/04 17:46:10 UTC, 0 replies.
- Re: [PR] [SPARK-49006] Implement purging for OperatorStateMetadataV2 and StateSchemaV3 files [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/09/04 18:50:45 UTC, 32 replies.
- [PR] [SPARK-49516] Upgrade the minimum K8s version to v1.28 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/04 20:39:09 UTC, 4 replies.
- [PR] [DO-NOT-REVIEW] Integration 1 [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/09/04 22:21:49 UTC, 0 replies.
- Re: [PR] [SPARK-47047] TransformWithState integration with statedata source integration - Value State [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/09/04 23:13:33 UTC, 0 replies.
- [PR] [SPARK-49517][BUILD] Upgrade `netty-tcnative` to 2.0.66.Final [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/04 23:34:34 UTC, 4 replies.
- [PR] [DO-NOT-MERGE] will it work [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/09/05 00:25:48 UTC, 3 replies.
- Re: [PR] [SPARK-48348][SPARK-48376][SQL] Introduce `LEAVE` and `ITERATE` statements [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/09/05 03:06:43 UTC, 7 replies.
- [PR] [SPARK-49152][SQL][FOLLOWUP] DelegatingCatalogExtension should also use V1 commands [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2024/09/05 03:08:43 UTC, 19 replies.
- Re: [PR] [SPARK-44239][SQL] Update default hugeVectorThreshold from 0 to -1 [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/09/05 03:09:20 UTC, 0 replies.
- [PR] [SPARK-49519][SQL] Combine options of table and relation when constructing CSVScanBuilder [spark] - posted by "liujiayi771 (via GitHub)" <gi...@apache.org> on 2024/09/05 03:13:34 UTC, 5 replies.
- Re: [PR] [SPARK-48549][SQL][PYTHON] Improve SQL function `sentences` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/09/05 03:13:39 UTC, 34 replies.
- Re: [PR] [SPARK-49396][SQL] Modify nullability check for CaseWhen expression [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/09/05 03:16:09 UTC, 3 replies.
- Re: [PR] [SPARK-44239][SQL][FOLLOWUP] Do not disable vector memory optimization when hugeVectorThreshold=0 to align its document [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/09/05 03:19:30 UTC, 6 replies.
- Re: [PR] [SPARK-49518][CORE][BUILD] Change to using `build-helper-maven-plugin` to manage the code for `opentelemetry` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/05 03:28:18 UTC, 4 replies.
- Re: [PR] [SPARK-49488][SQL] MySQL dialect supports pushdown datetime functions. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2024/09/05 03:46:29 UTC, 12 replies.
- [PR] Test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/05 05:14:26 UTC, 0 replies.
- Re: [PR] [K8S][BUILD] Change to using `build-helper-maven-plugin` to manage the code for `volcano` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/05 05:26:20 UTC, 0 replies.
- [PR] [WIP][SPARK-49507] Fix Expected only partition pruning predicates exception [spark] - posted by "TongWei1105 (via GitHub)" <gi...@apache.org> on 2024/09/05 05:26:37 UTC, 0 replies.
- Re: [PR] [SPARK-49464] Add documentations [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/05 05:47:07 UTC, 42 replies.
- [PR] [SPARK-49521][DOCS] Remove the ambiguous term “constructor” from the documentation for logical plan nodes [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/09/05 05:48:10 UTC, 3 replies.
- [PR] [SPARK-49191][SS] Add support for reading transformWithState map state variables with state data source reader [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/09/05 06:11:28 UTC, 21 replies.
- Re: [PR] [SPARK-49518][K8S][BUILD] Change to using `build-helper-maven-plugin` to manage the code for `volcano` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/05 07:22:07 UTC, 6 replies.
- Re: [PR] [SPARK-49326][SS] Classify Error class for Foreach sink user function error [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/09/05 07:38:03 UTC, 8 replies.
- [PR] [SPARK-48493][PYTHON][FOLLOW-UP] Fix documentation for Arrow batch support in Python Data Source [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/05 08:07:21 UTC, 3 replies.
- Re: [PR] [SPARK-49523][CONNECT] Increase maximum wait time for connect server to come up for testing [spark] - posted by "asfgit (via GitHub)" <gi...@apache.org> on 2024/09/05 12:44:38 UTC, 1 replies.
- Re: [PR] [SPARK-49249][SPARK-49320] Add new tag-related APIs in Connect back to Spark Core [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/05 12:49:09 UTC, 32 replies.
- Re: [PR] [SPARK-48906][SQL] Introduce `SHOW COLLATIONS LIKE ...` syntax to show all collations [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/09/05 13:33:21 UTC, 64 replies.
- Re: [PR] [SPARK-49501][SQL] Fix double-escaping of table location [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/09/05 13:44:51 UTC, 9 replies.
- Re: [PR] [SPARK-49507][SQL] Fix Expected only partition pruning predicates exception [spark] - posted by "TongWei1105 (via GitHub)" <gi...@apache.org> on 2024/09/05 14:27:57 UTC, 2 replies.
- Re: [PR] [SPARK-49519][SQL] Merge options of table and relation when constructing FileScanBuilder [spark] - posted by "liujiayi771 (via GitHub)" <gi...@apache.org> on 2024/09/05 14:36:51 UTC, 6 replies.
- Re: [PR] [SS][RocksDB Hardening] Improve RocksDB SST file mapping management, and fix issue with reloading same version with existing snapshot [spark] - posted by "sahnib (via GitHub)" <gi...@apache.org> on 2024/09/05 15:15:01 UTC, 16 replies.
- [PR] [SPARK-49525][SS][CONNECT] Minor log improvement to Server Side Streaming Query ListenerBus Listener [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/09/05 18:11:51 UTC, 3 replies.
- Re: [PR] [SPARK-49463] Support ListState for TransformWithStateInPandas [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/09/05 19:40:26 UTC, 38 replies.
- [PR] [SPARK-49526][CONNECT] Support Windows-style paths in ArtifactManager [spark] - posted by "vicennial (via GitHub)" <gi...@apache.org> on 2024/09/05 21:25:08 UTC, 2 replies.
- [PR] [SPARK-49505][SQL] Create new SQL functions "randstr" and "uniform" to generate random strings or numbers within ranges [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/09/05 22:46:14 UTC, 25 replies.
- Re: [PR] [SPARK-49048][SS] Add support for reading relevant operator metadata at given batch id [spark] - posted by "neilramaswamy (via GitHub)" <gi...@apache.org> on 2024/09/05 22:59:21 UTC, 0 replies.
- [PR] [SS][PYTHON] Support Initial State for TransformWithStateInPandas [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/09/05 23:15:59 UTC, 0 replies.
- [PR] [SPARK-49527] Generate Spark Operator Config Property Doc [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/09/06 01:09:31 UTC, 3 replies.
- Re: [PR] [SPARK-48590][BUILD] Upgrade netty to `4.1.113.Final` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/06 01:52:53 UTC, 0 replies.
- [PR] [CORE][TESTS] Change default `ivySettings` in the `IvyTestUtis#withRepository` function to use `.ivy2.5.2` as the Default Ivy User Dir [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/06 02:44:58 UTC, 1 replies.
- [PR] [MINOR][TEST] Fix the spell mistake [spark] - posted by "Shadowell (via GitHub)" <gi...@apache.org> on 2024/09/06 02:54:33 UTC, 2 replies.
- Re: [PR] [SPARK-48823][DOCS] Improve clarity in `lag` docstring [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/06 06:08:59 UTC, 3 replies.
- [PR] [WIP][SPARK-49531] Support line plot with plotly backend [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/09/06 06:14:12 UTC, 0 replies.
- [PR] [SPARK-47737][PYTHON][FOLLOWUP] Bump PyArrow to 10.0.0 in `requirements.txt` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/06 06:55:36 UTC, 4 replies.
- [PR] [SPARK-47948][PYTHON][FOLLOWUP] Bump Pandas to 2.0.0 in `requirements.txt` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/06 07:04:38 UTC, 3 replies.
- [PR] [CI][MINOR] Upgrade actions in test_report.yml workflow [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/09/06 07:07:43 UTC, 2 replies.
- [PR] [CI][MINOR] Do not upload docker build record [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/09/06 07:09:52 UTC, 2 replies.
- [PR] [SPARK-49532][DOCS] Improve documentation of "plotting.sample_ratio" option [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/09/06 07:15:14 UTC, 0 replies.
- Re: [PR] [SPARK-49511][SQL] Apply formatting rules to sql/api [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/06 07:26:07 UTC, 1 replies.
- Re: [PR] [SPARK-49533][CORE][TESTS] Change default `ivySettings` in the `IvyTestUtis#withRepository` function to use `.ivy2.5.2` as the Default Ivy User Dir [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/06 08:21:25 UTC, 2 replies.
- [PR] [SPARK-49511][SQL][FOLLOW-UP] Fix `@see` links to recover Scaladoc build [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/06 08:26:40 UTC, 3 replies.
- Re: [PR] [MINOR][INFRA] Upgrade actions in test_report.yml workflow [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/06 08:34:38 UTC, 1 replies.
- [PR] [SPARK-49534][CORE] No longer prepend `sql/hive` when `spark-hive_xxx.jar` is not in the classpath [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/06 09:10:27 UTC, 3 replies.
- Re: [PR] [SPARK-49532][DOCS][PS] Improve documentation of "plotting.sample_ratio" option [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/06 11:30:02 UTC, 2 replies.
- [PR] [MINOR][SQL] Replace parseScript with runSqlScript in SQL Scripting Interpreter test suite [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2024/09/06 12:27:09 UTC, 0 replies.
- Re: [PR] [SPARK-48358][SQL] Support for REPEAT statement [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2024/09/06 12:35:53 UTC, 14 replies.
- Re: [PR] [SPARK-48355][SQL] Support for CASE statement [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/06 13:01:54 UTC, 18 replies.
- Re: [PR] [SPARK-47259][SQL] Assign names to error conditions for interval errors [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/06 13:03:16 UTC, 7 replies.
- [PR] [SPARK-49287][SPARK-49432][CONNECT][SQL] Move streaming classes to sql/api [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/06 14:03:12 UTC, 6 replies.
- Re: [PR] [SPARK-48348][SPARK-48376][FOLLOWUP][SQL] Replace parseScript with runSqlScript in SQL Scripting Interpreter test suite [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/06 14:34:06 UTC, 1 replies.
- [PR] [SPARK-29474] [CORE] [WIP] CLI support for Spark-on-Docker-on-Yarn [spark] - posted by "retpolanne (via GitHub)" <gi...@apache.org> on 2024/09/06 19:26:17 UTC, 1 replies.
- [PR] [SPARK-49246][SQL][FOLLOW-UP] The behavior of SaveAsTable should not be changed by falling back to v1 command [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2024/09/06 19:27:18 UTC, 2 replies.
- Re: [PR] [SPARK-48700] [SQL] Mode expression for complex types (all collations) [spark] - posted by "GideonPotok (via GitHub)" <gi...@apache.org> on 2024/09/06 19:29:27 UTC, 27 replies.
- Re: [PR] [SPARK-42204][CORE] Add option to disable redundant logging of TaskMetrics internal accumulators in event logs [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2024/09/06 22:55:10 UTC, 1 replies.
- Re: [PR] [SPARK-48469][SQL][TESTS] Replace `deprecated` method in `integrationtest` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/07 00:21:57 UTC, 1 replies.
- Re: [PR] [SPARK-48437][SQL] Improve IsolatedClientLoader [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/07 00:21:59 UTC, 1 replies.
- Re: [PR] [SPARK-48380][CORE][WIP]: SerDeUtil.javaToPython to support rows up to 2GB [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/07 00:22:00 UTC, 1 replies.
- Re: [PR] [SPARK-44050][K8S]add retry config when creating Kubernetes resources. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/07 00:22:01 UTC, 1 replies.
- [PR] [SPARK-49369][CONNECT][SQL] Add implicit Column conversions [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/07 01:36:46 UTC, 8 replies.
- [PR] [SPARK-49424][CONNECT][SQL] Consolidate Encoders.scala [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/07 02:19:55 UTC, 4 replies.
- [PR] [SPARK-48376][FOLLOWUP][SQL] Add ITERATE statement fixes [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2024/09/07 05:48:21 UTC, 2 replies.
- [PR] [SPARK-49536] Handle error in python streaming data source record prefetching [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2024/09/07 07:06:52 UTC, 5 replies.
- [PR] [DO-NOT-REVIEW][DRAFT] integration2 [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/09/07 07:22:26 UTC, 0 replies.
- Re: [PR] [SPARK-39347][SS] Bug fix for time window calculation when event time < 0 [spark] - posted by "corgy-w (via GitHub)" <gi...@apache.org> on 2024/09/07 10:05:19 UTC, 0 replies.
- Re: [PR] [SHUFFLE] [WIP] Prototype: store shuffle file on external storage like S3 [spark] - posted by "xleoken (via GitHub)" <gi...@apache.org> on 2024/09/07 10:43:29 UTC, 0 replies.
- [PR] [SPARK-49537][SQL] Improve Join stats estimate [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2024/09/07 16:51:33 UTC, 8 replies.
- Re: [PR] [SPARK-47008][CORE] Added Hadoops fileSystems hasPathCapability check to avoid FileNotFoundException(s) when using S3 Express One Zone Storage. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/08 00:25:18 UTC, 1 replies.
- Re: [PR] [SPARK-48376][SQL][FOLLOWUP] Add ITERATE statement fixes [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2024/09/08 09:54:12 UTC, 1 replies.
- [PR] [WIP][SPARK-49538][SQL][TESTS] Detect unused error message parameters [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/08 09:59:13 UTC, 1 replies.
- Re: [PR] [SPARK-43299][FOLLOWUP][CONNECT][SS] Followup on StreamingQueryExceptions [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/08 10:58:03 UTC, 0 replies.
- Re: [PR] [SPARK-49538][SQL][TESTS] Detect unused error message parameters [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/08 16:34:30 UTC, 14 replies.
- Re: [PR] [SPARK-49534][CORE] No longer prepend `sql/hive`and `sql/hive-thriftserver` when `spark-hive_xxx.jar` is not in the classpath [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/08 16:59:32 UTC, 2 replies.
- Re: [PR] [SPARK-49498][SQL] Added test to check difference between SR_AI and SR_Latn_AI collations [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2024/09/08 17:24:57 UTC, 2 replies.
- [PR] [WIP][TESTS] Rename `errorClass` to `condition` in `checkError()` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/08 20:42:54 UTC, 0 replies.
- [PR] [SPARK-49540][PS] Unify the usage of `distributed_sequence_id` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/09 01:28:51 UTC, 3 replies.
- [PR] [WIP][SPARK-49541][BUILD] Upgrade log4j2 to 2.24.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/09 01:41:53 UTC, 3 replies.
- [PR] [SPARK-49539] Update internal col families start identifier to a different one [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/09/09 06:39:32 UTC, 0 replies.
- Re: [PR] [SPARK-49539][SS] Update internal col families start identifier to a different one [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/09/09 06:43:26 UTC, 3 replies.
- [PR] [SPARK-49246][TESTS] Fix CollationSuite [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/09 06:54:21 UTC, 0 replies.
- Re: [PR] [SPARK-49246][FOLLOWUP][TESTS] Fix CollationSuite [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/09/09 08:42:29 UTC, 7 replies.
- Re: [PR] [SPARK-49246][SQL][TESTS][FOLLOWUP] Fix CollationSuite [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/09 10:57:26 UTC, 1 replies.
- Re: [PR] [SPARK-49246][SQL][TESTS][FOLLOWUP] Fix flaky CollationSuite [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/09 11:15:18 UTC, 4 replies.
- [PR] [SPARK-49534][CORE][FOLLOWUP] Update outdated code comments related to the `AbstractCommandBuilder#isJarAvailable` method [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/09 11:35:37 UTC, 3 replies.
- [PR] [SPARK-49545][INFRA] Increase timeout for build from 3 to 4 hours [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/09 11:41:43 UTC, 3 replies.
- [PR] [SPARK-49544] Replace coarse-locking in SparkConnectExecutionManager with ConcurrentMap [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/09/09 13:15:20 UTC, 0 replies.
- [PR] [DRAFT][SCRIPTING] Sql scripting local vars [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2024/09/09 13:17:22 UTC, 0 replies.
- [PR] [WIP][SPARK_49548][CONNECT] Replace coarse-locking in SparkConnectSessionManager with ConcurrentMap [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/09/09 16:02:45 UTC, 0 replies.
- [PR] [SPARK-48195] Save and reuse RDD/Broadcast created by SparkPlan [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2024/09/09 16:08:11 UTC, 28 replies.
- [PR] [SPARK-49547][SQL][PYTHON] Support returning iterator of RecordBatches in applyInArrow [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2024/09/09 16:34:43 UTC, 26 replies.
- [PR] [SPARK-49551][SS] Improve RocksDB log for replaychangelog [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/09/09 17:09:01 UTC, 0 replies.
- [PR] [SPARK-46088][PYTHON][SQL][DOCS] Add a self-contained example about c… [spark] - posted by "eder001 (via GitHub)" <gi...@apache.org> on 2024/09/09 17:23:21 UTC, 2 replies.
- [PR] [SPARK-46088][PYTHON][SQL][DOCS] Add a self-contained example about creating dataframe from jdbc MySQL [spark] - posted by "eder001 (via GitHub)" <gi...@apache.org> on 2024/09/09 20:06:46 UTC, 2 replies.
- [PR] [SPARK-49553][PYTHON][DOCS] Remove the experimental API notes for pandas related functions [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/09/09 20:21:45 UTC, 6 replies.
- Re: [PR] [WIP] Prototype to implement new SQL pipe syntax [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/09/09 20:52:30 UTC, 1 replies.
- Re: [PR] [SPARK-49551][SS] Improve RocksDB log for replayChangelog [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/09/09 21:21:10 UTC, 1 replies.
- [PR] [SPARK-48939][AVRO] Support reading Avro with recursive schema reference [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/09/09 21:36:23 UTC, 7 replies.
- [PR] [SPARK-49567][PYTHON] Use `classic` instead of `vanilla` from PySpark code base [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/09/09 22:34:32 UTC, 2 replies.
- [PR] [SPARK-46088][PYTHON][SQL][DOCS] Add a self-contained example dataframe from jdbc MySQL [spark] - posted by "eder001 (via GitHub)" <gi...@apache.org> on 2024/09/09 22:55:52 UTC, 2 replies.
- [PR] [SPARK-49534][CORE][3.5] No longer prepend `sql/hive`and `sql/hive-thriftserver` when `spark-hive_xxx.jar` is not in the classpath [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/10 02:42:30 UTC, 4 replies.
- [PR] [SPARK-49556][SQL] Add SQL pipe syntax for the SELECT operator [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/09/10 04:05:17 UTC, 32 replies.
- [PR] [SPARK-49576][INFRA] Upload Python logs in CI [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/10 04:08:14 UTC, 2 replies.
- [PR] [DO-NOT-MERGE] Test Python 3.12 build [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/10 04:09:29 UTC, 5 replies.
- [PR] [SPARK-49575] Add logging for lock release only if acquiredThreadInfo is not null [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/09/10 04:11:13 UTC, 0 replies.
- Re: [PR] [SPARK-49575][SS] Add logging for lock release only if acquiredThreadInfo is not null [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/09/10 04:15:23 UTC, 2 replies.
- [PR] [SPARK-49085][FOLLOWUP] Update the scope of `spark-protobuf` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/10 05:07:49 UTC, 3 replies.
- [PR] [MINOR][DOCS] Fix scaladoc for `FlatMapGroupsInArrowExec` and `FlatMapCoGroupsInArrowExec` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/10 05:54:04 UTC, 2 replies.
- Re: [PR] [SPARK-49579][SQL][TESTS] Rename `errorClass` to `condition` in `checkError()` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/10 06:47:00 UTC, 3 replies.
- [PR] Improve DeduplicateRelations performance [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2024/09/10 06:51:15 UTC, 0 replies.
- [PR] [SPARK-49578][SQL] Change error message for CAST_INVALID_INPUT and CAST_OVERFLOW [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/09/10 06:55:05 UTC, 0 replies.
- Re: [PR] [SPARK-49548][CONNECT] Replace coarse-locking in SparkConnectSessionManager with ConcurrentMap [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/09/10 07:23:53 UTC, 10 replies.
- Re: [PR] [SPARK-49544][CONNECT] Replace coarse-locking in SparkConnectExecutionManager with ConcurrentMap [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/09/10 07:24:13 UTC, 26 replies.
- Re: [PR] [SPARK-36796][BUILD][CORE][SQL] Pass all `sql/core` and dependent modules UTs with JDK 17 except one case in `postgreSQL/text.sql` [spark] - posted by "lachen-rms (via GitHub)" <gi...@apache.org> on 2024/09/10 07:51:17 UTC, 2 replies.
- Re: [PR] [WIP] Use ICU case mappings for upper and lower casing [spark] - posted by "mkaravel (via GitHub)" <gi...@apache.org> on 2024/09/10 07:56:11 UTC, 0 replies.
- [PR] [SPARK-49398][SQL] Cache Table with Parameter markers returns wrong error [spark] - posted by "mikhailnik-db (via GitHub)" <gi...@apache.org> on 2024/09/10 08:06:24 UTC, 10 replies.
- [PR] [SPARK-49582][PYTHON][CONNECT] Fix "dispatch_window_method" utility and documentation [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/09/10 08:16:53 UTC, 0 replies.
- Re: [PR] [SPARK-49582][PYTHON][CONNECT] Fix "dispatch_window_method" utility and docstring [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/10 08:33:49 UTC, 2 replies.
- [PR] [SPARK-49584][BUILD] Upgrade log4j2 to 2.24.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/10 09:10:08 UTC, 10 replies.
- [PR] [WIP][SPARK-49583][SQL] Define the error sub-condition `SECONDS_FRACTION` for invalid seconds fraction pattern [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/10 09:36:29 UTC, 0 replies.
- [PR] [MINOR][SQL][TESTS] Check `sqlState` in `checkError()` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/10 11:16:39 UTC, 2 replies.
- Re: [PR] [SPARK-43838][SQL][FOLLOWUP] Improve DeduplicateRelations performance [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/09/10 12:54:15 UTC, 2 replies.
- Re: [PR] [SPARK-38862][Core] - allow integration of a secure gateway to SparkSubmissionServer alongside spark.authenticate props [spark] - posted by "JackBuggins (via GitHub)" <gi...@apache.org> on 2024/09/10 13:31:10 UTC, 0 replies.
- Re: [PR] [SPARK-49583][SQL] Define the error sub-condition `SECONDS_FRACTION` for invalid seconds fraction pattern [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/10 13:47:34 UTC, 1 replies.
- [PR] SPARK-49443][SQL][FOLLOWUP] Fix formatting of a comment for `to_variant_object()` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/10 15:26:02 UTC, 0 replies.
- Re: [PR] [SPARK-49443][SQL][FOLLOWUP] Fix formatting of a comment for `to_variant_object()` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/10 15:46:59 UTC, 3 replies.
- [PR] [SPARK-49579][SQL][TESTS][FOLLOWUP] Use `condition` instead of `errorClass` in `SparkThrowableSuite` and in `DateTimeFormatterHelperSuite` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/10 15:53:29 UTC, 5 replies.
- Re: [PR] [SPARK-49398][SQL] Improve the error for parameters in the query of CACHE TABLE and CREATE VIEW [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/10 16:14:43 UTC, 6 replies.
- [PR] [SPARK-49574][CONNECT][SQL] ExpressionEncoder tracks the AgnosticEncoder that created it. [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/10 17:48:03 UTC, 0 replies.
- [PR] [SPARK-49590] E2E test template includes invalid spec field [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/09/10 18:36:54 UTC, 1 replies.
- Re: [PR] [SPARK-49590] Fix `javaVersion` to `jdkVersion` in E2E `spark-versions` test template [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/10 20:22:37 UTC, 2 replies.
- [PR] [SPARK-49591] Add Logical Type columnt to variant readme [spark] - posted by "cashmand (via GitHub)" <gi...@apache.org> on 2024/09/10 20:29:05 UTC, 1 replies.
- [PR] [SPARK-49569][CONNECT][SQL] Add shims to support SparkContext and RDD [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/10 20:35:38 UTC, 9 replies.
- [PR] [SPARK-49592] Modify OperatorStateMetadataV2Reader to return the right metadata for the provided batchId [spark] - posted by "neilramaswamy (via GitHub)" <gi...@apache.org> on 2024/09/10 22:32:56 UTC, 2 replies.
- [PR] [WIP] Adding check on whether columnFamilies were added or removed to write… [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/09/10 22:55:47 UTC, 0 replies.
- [PR] [SPARK-49593] Throw RocksDB exception to the caller on DB close if an error is seen [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/09/10 22:58:12 UTC, 0 replies.
- Re: [PR] [SPARK-49593][SS] Throw RocksDB exception to the caller on DB close if an error is seen [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/09/10 22:59:25 UTC, 3 replies.
- Re: [PR] [SPARK-48397][SQL] Add data write time metric to FileFormatDataWriter [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/11 00:22:22 UTC, 1 replies.
- Re: [PR] [SPARK-49582][PYTHON][CONNECT] Improve "dispatch_window_method" utility and docstring [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/11 01:18:25 UTC, 2 replies.
- [PR] [SPARK-49595] Fix DataFrame.unpivot/melt in Spark Connect [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/09/11 03:06:32 UTC, 0 replies.
- [PR] [MINOR][CONNECT] Fix missing request metadata in RPC call [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/09/11 07:42:22 UTC, 2 replies.
- [PR] [WIP][SPARK-49585][CONNECT] Replace executions map in SessionHolder with operationID set [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/09/11 07:50:20 UTC, 0 replies.
- Re: [PR] [SPARK-49531][PYTHON][CONNECT] Support line plot with plotly backend [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/09/11 07:57:26 UTC, 50 replies.
- [PR] [SPARK-48358][SQL][TESTS][FOLLOWUP] Use `condition` instead of `errorClass` in `SqlScriptingInterpreterSuite` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/11 09:07:57 UTC, 2 replies.
- [PR] [SPARK-49596][SQL] Improve the expression `FormatString` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/11 09:10:54 UTC, 3 replies.
- Re: [PR] [SPARK-27734][CORE][SQL] Add memory based thresholds for shuffle spill [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/09/11 10:16:20 UTC, 0 replies.
- [PR] [SPARK-49597][PYTHON][CONNECT] Support non-column arguments in UDTF for simpler usage [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/09/11 11:07:55 UTC, 10 replies.
- Re: [PR] [SPARK-49244][SQL] Further exception improvements for parser/interpreter [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/11 11:20:36 UTC, 9 replies.
- [PR] [SPARK-49598] Added support to create custom user-defined labels for onDemand PVCs [spark] - posted by "prathit06 (via GitHub)" <gi...@apache.org> on 2024/09/11 11:22:15 UTC, 3 replies.
- Re: [PR] [SPARK-49585][CONNECT] Replace executions map in SessionHolder with operationID set [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/09/11 13:03:32 UTC, 13 replies.
- Re: [PR] [SPARK-49591][SQL] Add Logical Type columnt to variant readme [spark] - posted by "cashmand (via GitHub)" <gi...@apache.org> on 2024/09/11 13:05:42 UTC, 2 replies.
- Re: [PR] [SPARK-49578][SQL] Remove the ANSI config suggestion in CAST_INVALID_INPUT and CAST_OVERFLOW [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/11 13:10:31 UTC, 1 replies.
- [PR] [SPARK-49599][BUILD] Upgrade snappy-java to 1.1.10.7 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/11 13:31:26 UTC, 3 replies.
- [PR] reapply changes [spark] - posted by "GideonPotok (via GitHub)" <gi...@apache.org> on 2024/09/11 13:55:02 UTC, 0 replies.
- Re: [PR] [SPARK-48821][SQL] Support Update in DataFrameWriterV2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/11 14:44:21 UTC, 6 replies.
- Re: [PR] [SPARK-49527] Add `ConfOptionDocGenerator` to generate Spark Operator Config Property Doc [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/11 14:59:53 UTC, 3 replies.
- Re: [PR] [SPARK-45278][YARN] Support executor bind address in Yarn executors [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/11 15:04:29 UTC, 3 replies.
- Re: [PR] [SPARK-49595][CONNECT][SQL] Fix DataFrame.unpivot/melt in Spark Connect Scala Client [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/11 15:13:27 UTC, 0 replies.
- Re: [PR] [SPARK-49386][SPARK-27734][CORE][SQL] Add memory based thresholds for shuffle spill [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/11 15:27:24 UTC, 3 replies.
- [PR] [SPARK-49600][PYTHON] Remove `Python 3.6 and older`-related logic from `try_simplify_traceback` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/11 15:42:06 UTC, 3 replies.
- Re: [PR] [SPARK-49595][CONNECT][SQL] Fix `DataFrame.unpivot/melt` in Spark Connect Scala Client [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/11 15:52:39 UTC, 3 replies.
- [PR] Ondemand pvc labels [spark] - posted by "prathit06 (via GitHub)" <gi...@apache.org> on 2024/09/11 16:20:06 UTC, 0 replies.
- Re: [PR] [SPARK-49574][CONNECT][SQL] ExpressionEncoder tracks the AgnosticEncoder that created it [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/11 16:31:11 UTC, 1 replies.
- Re: [PR] [SPARK-49596][SQL] Improve performance of `FormatString` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/11 17:20:20 UTC, 2 replies.
- Re: [PR] [SPARK-49262][SQL] Add trim sensitivity support for collations [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/09/11 17:24:38 UTC, 0 replies.
- [PR] [SPARK-49085][BUILD][FOLLOWUP] Remove the erroneous `type` definition for `spark-protobuf` from `sql/connect/server/pom.xml` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/11 17:25:09 UTC, 3 replies.
- Re: [PR] [SPARK-49598][K8S] Support user-defined labels for OnDemand PVCs [spark] - posted by "prathit06 (via GitHub)" <gi...@apache.org> on 2024/09/11 17:26:30 UTC, 29 replies.
- Re: [PR] [SPARK-49085][CONNECT][BUILD][FOLLOWUP] Remove the erroneous `type` definition for `spark-protobuf` from `sql/connect/server/pom.xml` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/11 17:42:35 UTC, 4 replies.
- [PR] [SPARK-49602][BUILD] Fix `assembly/pom.xml` to use `{project.version}` instead of `{version}` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/11 18:10:20 UTC, 4 replies.
- Re: [PR] [SPARK-44811][BUILD] Upgrade Guava to 33.2.1-jre [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/09/11 18:27:59 UTC, 6 replies.
- Re: [PR] [SPARK-49591][SQL] Add Logical Type column to variant readme [spark] - posted by "cashmand (via GitHub)" <gi...@apache.org> on 2024/09/11 18:29:54 UTC, 2 replies.
- Re: [PR] [SPARK-49310][BUILD] Upgrade `Parquet` to 1.14.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/11 18:53:39 UTC, 1 replies.
- Re: [PR] [SPARK-49594][SS] Adding check on whether columnFamilies were added or removed to write StateSchemaV3 file [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/09/11 19:19:55 UTC, 7 replies.
- Re: [PR] [SPARK-49261][SQL] Don't replace literals in aggregate expressions with group-by expressions [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/11 20:11:42 UTC, 5 replies.
- Re: [PR] [SPARK-49155][SQL][SS] Use more appropriate parameter type to construct `GenericArrayData` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/11 20:21:21 UTC, 2 replies.
- Re: [PR] [SPARK-48700] [SQL] Mode expression for complex types (all collations) (WIP) [spark] - posted by "GideonPotok (via GitHub)" <gi...@apache.org> on 2024/09/11 21:06:37 UTC, 0 replies.
- Re: [PR] [TEST Only][V2] Eliminate ui warnings [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/12 00:22:55 UTC, 1 replies.
- Re: [PR] [TEST Only] Eliminate ui warnings [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/12 00:22:57 UTC, 2 replies.
- Re: [PR] [SPARK-48499][SQL] Use Math.abs to get Positive Numbers [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/12 00:22:59 UTC, 1 replies.
- Re: [PR] [SPARK-45373][SQL] Minimize partitions fetch call to HiveMetaStoreLayer [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/12 00:23:01 UTC, 1 replies.
- Re: [PR] [SPARK-47424][SQL] Add getDatabaseCalendar method to the JdbcDialect [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/12 00:23:01 UTC, 1 replies.
- Re: [PR] [SPARK-49469][CONNECT][TESTS] Add dummy protos for expression and datatype [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/12 02:12:12 UTC, 2 replies.
- [PR] [SPARK-49605][SQL] Fix the prompt when `ascendingOrder` is `DataTypeMismatch` in `SortArray` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/12 03:15:47 UTC, 6 replies.
- Re: [PR] [SPARK-49592][SS] Modify OperatorStateMetadataV2Reader to return the right metadata for the provided batchId [spark] - posted by "neilramaswamy (via GitHub)" <gi...@apache.org> on 2024/09/12 07:00:39 UTC, 1 replies.
- [PR] [SPARK-49606][PS][DOCS] Improve documentation of Pandas on Spark plotting API [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/09/12 08:46:22 UTC, 3 replies.
- [PR] [SPARK-49608][SQL] Improve SQL function `sort_array` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/12 09:12:00 UTC, 0 replies.
- [PR] [SPARK-49609][PYTHON][CONNECT] Add API compatibility check between Classic and Connect [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/09/12 09:15:12 UTC, 22 replies.
- Re: [PR] [WIP][SPARK-49608][SQL] Improve SQL function `sort_array` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/12 09:19:11 UTC, 0 replies.
- [PR] [SPARK-42846] Remove error class _LEGACY_ERROR_TEMP_2011 [spark] - posted by "ivanjevtic-db (via GitHub)" <gi...@apache.org> on 2024/09/12 10:12:07 UTC, 0 replies.
- [PR] [SPARK-49611][SQL] Introduce TVF all_collations() [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/12 11:43:33 UTC, 8 replies.
- [PR] [WIP][SPARK-49610] Do not use protobuf messages as keys of the session-local plan cache [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/09/12 11:48:15 UTC, 0 replies.
- Re: [PR] [SPARK-49610] Do not use protobuf messages as keys of the session-local plan cache [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/09/12 12:24:46 UTC, 3 replies.
- Re: [PR] [SPARK-42846][SQL] Remove error condition _LEGACY_ERROR_TEMP_2011 [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/12 12:39:35 UTC, 4 replies.
- [PR] [SPARK-49578][SQL][TESTS][FOLLOWUP] Regenerate Java 21 golden file for `postgreSQL/float4.sql` and `postgreSQL/int8.sql` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/12 12:59:58 UTC, 3 replies.
- Re: [PR] [SPARK-48779][SQL][TESTS] Improve collation support testing - add golden files [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/09/12 13:37:13 UTC, 5 replies.
- [PR] [DO NOT REVIEW] Table and schema level collations [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/09/12 14:58:02 UTC, 0 replies.
- Re: [PR] [SPARK-48824][SQL] Add Identity Column SQL syntax [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/09/12 17:05:46 UTC, 13 replies.
- [PR] [WIP][SPARK-49557][SQL] Add SQL pipe syntax for the WHERE operator [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/09/12 17:10:21 UTC, 0 replies.
- Re: [PR] [SPARK-47741] Added stack overflow handling in parser [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/12 17:42:02 UTC, 0 replies.
- [PR] [SPARK-47741][SQL][TESTS][FOLLOWUP] Reduce test query size by reducing iterations from 20k to 5k [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/12 17:44:28 UTC, 4 replies.
- Re: [PR] [SPARK-47741][SQL] Added stack overflow handling in parser [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/12 17:44:42 UTC, 1 replies.
- [PR] [WIP][SPARK-49561][SQL] Add SQL pipe syntax for the PIVOT and UNPIVOT operators [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/09/12 20:13:59 UTC, 0 replies.
- [PR] [SPARK-49619] Upgrade Gradle to 8.10.1 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/12 20:33:17 UTC, 2 replies.
- [PR] [SPARK-49618][SQL]: Union & UnionExec nodes equality not take into account unaligned positions of branches causing cache miss and non reuse of exchange [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2024/09/12 20:38:01 UTC, 0 replies.
- [PR] [SPARK-49620][INFRA] Fix `spark-rm` and `infra` docker files to create `pypy3.9` links [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/12 20:51:27 UTC, 3 replies.
- [PR] [SPARK-49621][SQL][TESTS] Disable the flaky `EXEC IMMEDIATE STACK OVERFLOW` test case [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/12 21:51:51 UTC, 3 replies.
- Re: [PR] [SPARK-49081][SQL][DOCS] Add data source options docs of `Protobuf` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/12 23:26:40 UTC, 0 replies.
- [PR] [SPARK-49623]Refactor prefix `appResources` to `workloadResources` in helm chart [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/09/12 23:30:56 UTC, 1 replies.
- [PR] [SPARK-43354][PYTHON][TESTS] Re-enable `test_create_dataframe_from_pandas_with_day_time_interval` in PyPy3.9 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/12 23:41:55 UTC, 3 replies.
- [PR] [SPARK-49624][BUILD] Upgrade `aircompressor` to 2.0.2 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/12 23:46:44 UTC, 4 replies.
- Re: [PR] [SPARK-48532][BUILD] Upgrade maven plugin to latest version [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/13 00:09:40 UTC, 2 replies.
- Re: [PR] [SPARK-49623] Refactor prefix `appResources` to `workloadResources` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/13 00:11:45 UTC, 1 replies.
- Re: [PR] [PYTHON] Fix `assertDataFrameEqual` behavior with mixed DataFrame types [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/13 00:22:34 UTC, 1 replies.
- Re: [PR] [SPARK-47609][SQL] Making CacheLookup more optimal to minimize cache miss [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/13 00:22:35 UTC, 1 replies.
- Re: [PR] (DRAFT) [SPARK-46798] Kafka custom partition location assignment in Spark Structured Streaming (rack awareness) [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/13 00:22:37 UTC, 1 replies.
- Re: [PR] [SPARK-45959][SQL] Improving performance when addition of 1 column at a time causes increase in the LogicalPlan tree depth [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/13 00:22:38 UTC, 1 replies.
- [PR] Add state transition happy test for Spark Cluster [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2024/09/13 00:37:11 UTC, 0 replies.
- Re: [PR] [SPARK-49621][SQL][TESTS] Remove the flaky `EXEC IMMEDIATE STACK OVERFLOW` test case [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/13 01:15:36 UTC, 4 replies.
- Re: [PR] [SPARK-49611][SQL] Introduce TVF string_collations() and remove the `SHOW COLLATIONS` command [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/09/13 02:18:31 UTC, 0 replies.
- [PR] [SPARK-48549][SQL][DOCS][FOLLOWUP] Add migration guide for SQL function `sentences` behavior changes [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/13 03:05:29 UTC, 7 replies.
- [PR] [SPARK-49626][PYTHON][CONNECT] Support horizontal and vertical bar plots [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/09/13 03:08:24 UTC, 4 replies.
- [PR] [SPARK-49627][SQL] Run SortMergeJoin in batch [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2024/09/13 03:34:18 UTC, 3 replies.
- Re: [PR] [SPARK-49625] Add `SparkCluster` state transition test [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/13 03:42:29 UTC, 1 replies.
- [PR] [SPARK-49629][CORE] JsonProtocol should write 'Shuffle Push Read Metrics' and 'Merged Fallback Count' field of shuffle read metrics [spark] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/09/13 03:47:42 UTC, 0 replies.
- [PR] [SPARK-49604] GROUP_BY_POS_OUT_OF_RANGE if group by Literal [spark] - posted by "George314159 (via GitHub)" <gi...@apache.org> on 2024/09/13 03:51:40 UTC, 0 replies.
- Re: [PR] [SPARK-49611][SQL] Introduce TVF `string_collations()` and remove the `SHOW COLLATIONS` command [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2024/09/13 04:40:52 UTC, 7 replies.
- [PR] [SPARK-49628][SQL] ConstantFolding should copy stateful expression before evaluating [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/09/13 05:45:56 UTC, 3 replies.
- Re: [PR] [SPARK-49611][SQL] Introduce TVF `all_collations()` and remove the `SHOW COLLATIONS` command [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/13 09:01:26 UTC, 16 replies.
- Re: [PR] [SPARK-49234][BUILD] Upgrade `xz` to `1.10` [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/09/13 10:30:03 UTC, 3 replies.
- [PR] [SPARK-49640][PS] Apply Reservoir sampling in `SampledPlotBase` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/13 10:50:31 UTC, 3 replies.
- [PR] [SPARK-49641][DOCS] nclude `table_funcs` and `variant_funcs` in the built-in function list doc [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/13 12:04:38 UTC, 0 replies.
- [PR] [SPARK-49234][BUILD][FOLLOWUP] Add `LICENSE-xz.txt` to `licenses-binary` folder [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/13 15:07:48 UTC, 3 replies.
- [PR] [SPARK-49645] Update `e2e/python/chainsaw-test.yaml` to use non-R image [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/13 16:40:49 UTC, 3 replies.
- [PR] [SPARK-49644][SQL] Support drop multi-level partition V2 table with partial partition spec [spark] - posted by "Zouxxyy (via GitHub)" <gi...@apache.org> on 2024/09/13 16:49:31 UTC, 1 replies.
- Re: [PR] [SPARK-49392][SQL] Catch errors when failing to write to external data source [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/13 17:04:56 UTC, 0 replies.
- [PR] [SPARK-49646][SQL] fix subquery decorrelation for union/set operations when parentOuterReferences has references not covered in collectedChildOuterReferences [spark] - posted by "averyqi-db (via GitHub)" <gi...@apache.org> on 2024/09/13 18:53:27 UTC, 12 replies.
- [PR] [SPARK-49630] Add flatten option to process collection types with state data source reader [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/09/13 19:35:08 UTC, 0 replies.
- [PR] [SPARK-49647][TESTS] Change SharedSparkContext so that its SparkConf loads defaults [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2024/09/13 20:02:08 UTC, 2 replies.
- [PR] [SPARK-49648][DOCS] Update `Configuring Ports for Network Security` section with JWS [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/13 21:56:44 UTC, 4 replies.
- Re: [PR] [SPARK-47230] [SQL] Push projection through Filter-> Generate [spark] - posted by "rahulmadhavan (via GitHub)" <gi...@apache.org> on 2024/09/13 21:57:07 UTC, 1 replies.
- [PR] [SPARK-49649][DOCS] Make `docs/index.md` up-to-date for 4.0.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/13 22:55:02 UTC, 14 replies.
- Re: [PR] [SPARK-49611][SQL] Introduce TVF `all_collations()` & remove the `SHOW COLLATIONS` command [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2024/09/13 23:39:34 UTC, 13 replies.
- [PR] [SPARK-49650][SQL][DOCS] Updates references to deprecated Hive JDBC client params in tests and docs [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2024/09/13 23:46:58 UTC, 4 replies.
- Re: [PR] [SPARK-48537][SQL] Support Hive UDAF inherited from `GenericUDAFResolver` or `GenericUDAFResolver2` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/14 00:22:22 UTC, 1 replies.
- Re: [PR] [SPARK-49630][SS] Add flatten option to process collection types with state data source reader [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/09/14 01:42:45 UTC, 19 replies.
- Re: [PR] [SPARK-49641][DOCS] Include `table_funcs` and `variant_funcs` in the built-in function list doc [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/14 04:09:11 UTC, 11 replies.
- Re: [PR] [SPARK-37075][SQL] Move UDAF expression building from sql/catalyst to sql/core [spark] - posted by "PengleiShi (via GitHub)" <gi...@apache.org> on 2024/09/14 08:36:57 UTC, 2 replies.
- Re: [PR] [Test Only] [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/15 00:25:50 UTC, 1 replies.
- Re: [PR] [SPARK-48547][DEPLOY] Add opt-in flag to have SparkSubmit automatically call System.exit after user code main method exits [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/15 00:25:52 UTC, 1 replies.
- Re: [PR] [SPARK-48524][SQL] Make Not IsNull semantically equal to IsNotNull and vice versa [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/15 00:25:54 UTC, 1 replies.
- Re: [PR] [SPARK-47050][SQL] Collect and publish partition level metrics for V1 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/15 00:25:55 UTC, 1 replies.
- Re: [PR] [SPARK-47050][SQL] Collect and publish partition level metrics [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/15 00:25:57 UTC, 1 replies.
- Re: [PR] [SPARK-46714][SQL] Overwrite a partition with custom location [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/15 00:25:58 UTC, 1 replies.
- [PR] [SPARK-48355][SQL][FOLLOWUP] Disable a test case failing on non-ANSI mode [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/15 02:48:34 UTC, 0 replies.
- Re: [PR] [SPARK-48355][SQL][TESTS][FOLLOWUP] Disable a test case failing on non-ANSI mode [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/15 02:53:20 UTC, 9 replies.
- Re: [PR] [SPARK-47063][SQL] CAST long to timestamp has different behavior for codegen vs interpreted [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/09/15 09:36:17 UTC, 3 replies.
- Re: [PR] [SPARK-48821][SQL] Support `Update` in `DataFrameWriterV2` [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2024/09/15 17:55:52 UTC, 25 replies.
- [PR] Avoid sorting in validateAndMaybeEvolveStateSchema [spark] - posted by "tedyu (via GitHub)" <gi...@apache.org> on 2024/09/16 00:14:01 UTC, 0 replies.
- [PR] [SPARK-49655][BUILD] Link `python3` to `python3.9` in `spark-rm` Docker image [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/16 00:57:50 UTC, 8 replies.
- Re: [PR] [Minor] Avoid sorting in validateAndMaybeEvolveStateSchema [spark] - posted by "tedyu (via GitHub)" <gi...@apache.org> on 2024/09/16 03:29:43 UTC, 5 replies.
- [PR] WIP [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2024/09/16 07:01:10 UTC, 1 replies.
- Re: [PR] [SPARK-49611][SQL] Introduce TVF `collations()` & remove the `SHOW COLLATIONS` command [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/09/16 08:33:20 UTC, 2 replies.
- [PR] [SPARK-49659][SQL] Add a nice user-facing error for scalar subqueries inside VALUES clause [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/09/16 08:52:25 UTC, 10 replies.
- [PR] [DOCS][MINOR] Remove spark-sql-api dependency from connect docs [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/09/16 09:33:21 UTC, 2 replies.
- [PR] [SPARK-49249][SPARK-49122] Makes `SparkSession.addArtifact` work with REPL [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/09/16 10:06:47 UTC, 19 replies.
- [PR] [SPARK-49667] Disallowed CS_AI collators with expressions that use StringSearch [spark] - posted by "vladanvasi-db (via GitHub)" <gi...@apache.org> on 2024/09/16 14:42:34 UTC, 22 replies.
- Re: [PR] [SPARK-49557][SQL] Add SQL pipe syntax for the WHERE operator [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/09/16 15:24:17 UTC, 10 replies.
- [PR] [SPARK-49673] Increase maxBatchSize to 0.7 * CONNECT_GRPC_MAX_MESSAGE_SIZE for sqlCommandResult [spark] - posted by "dillitz (via GitHub)" <gi...@apache.org> on 2024/09/16 15:34:51 UTC, 0 replies.
- Re: [PR] [SPARK-49513][SS] Add Support for timer in transformWithStateInPandas API [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2024/09/16 17:35:36 UTC, 12 replies.
- [PR] Refactor e2e tests pipelines [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2024/09/16 17:44:17 UTC, 0 replies.
- Re: [PR] [SPARK-49658] Refactor e2e tests pipelines [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2024/09/16 17:46:37 UTC, 2 replies.
- [PR] [SPARK-49675][SQL][HIVE] Support push down CaseWhen filter to Hive metastore [spark] - posted by "wecharyu (via GitHub)" <gi...@apache.org> on 2024/09/16 18:28:45 UTC, 1 replies.
- [PR] [SS] Add Support for Chaining of Operators in transformWithStateInPandas API [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/09/16 20:11:52 UTC, 0 replies.
- [PR] [SPARK-49677][SS] Ensure that changelog files are written on commit and forceSnapshot flag is also reset [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/09/16 20:28:27 UTC, 5 replies.
- [PR] [SPARK-49678][CORE] Support `spark.test.master` in `SparkSubmitArguments` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/16 20:51:51 UTC, 15 replies.
- [PR] [SPARK-49679][SQL]validateSchemaOutput should refer to case sensitivity flag [spark] - posted by "averyqi-db (via GitHub)" <gi...@apache.org> on 2024/09/16 21:06:48 UTC, 1 replies.
- [PR] [SPARK-49491] Replace AnyRefMap with HashMap [spark] - posted by "George314159 (via GitHub)" <gi...@apache.org> on 2024/09/16 22:16:53 UTC, 1 replies.
- Re: [PR] [SPARK-49491][SQL] Replace AnyRefMap with HashMap [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/16 23:17:12 UTC, 20 replies.
- [PR] [SPARK-49657] Add multi instances e2e [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2024/09/16 23:23:48 UTC, 2 replies.
- Re: [PR] [SPARK-46668][DOCS] Parallelize Sphinx build of Python API docs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/16 23:42:32 UTC, 5 replies.
- [PR] [SPARK-49680][PYTHON] Limit `Sphinx` build parallelism to 4 by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/16 23:48:31 UTC, 3 replies.
- Re: [PR] [SPARK-47547][SQL] Fix inaccurate false positive rates when N is large for Bloom Filter [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/17 00:19:26 UTC, 1 replies.
- [PR] [SPARK-49682][BUILD] Upgrade joda-time to 2.13.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/17 01:24:31 UTC, 2 replies.
- Re: [PR] [SPARK-49676][SS][PYTHON] Add Support for Chaining of Operators in transformWithStateInPandas API [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2024/09/17 03:14:25 UTC, 0 replies.
- Re: [PR] [SPARK-49640][PS] Apply reservoir sampling in `SampledPlotBase` [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/09/17 06:09:19 UTC, 5 replies.
- Re: [PR] [SPARK-49673] Increase maxBatchSize to 0.7 * CONNECT_GRPC_MAX_MESSAGE_SIZE in handleSqlCommand [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/17 06:38:03 UTC, 2 replies.
- [PR] [SPARK-49684][CONNECT] Remove global locks from session and execution managers [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/09/17 08:13:25 UTC, 5 replies.
- Re: [PR] [SPARK-49498][SQL][TESTS] Check differences between SR_AI and SR_Latn_AI collations [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2024/09/17 08:57:22 UTC, 2 replies.
- [PR] feat: init devenv [spark-connect-go] - posted by "farbodahm (via GitHub)" <gi...@apache.org> on 2024/09/17 09:21:40 UTC, 3 replies.
- [PR] Test sbt 1.10.2 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/17 09:37:35 UTC, 2 replies.
- Re: [PR] [MINOR] Avoid sorting in validateAndMaybeEvolveStateSchema [spark] - posted by "tedyu (via GitHub)" <gi...@apache.org> on 2024/09/17 12:08:32 UTC, 0 replies.
- Re: [PR] [SPARK-49673] Increase CONNECT_GRPC_ARROW_MAX_BATCH_SIZE to 0.7 * CONNECT_GRPC_MAX_MESSAGE_SIZE [spark] - posted by "dillitz (via GitHub)" <gi...@apache.org> on 2024/09/17 12:15:34 UTC, 5 replies.
- [PR] [SPARK-49685][CONNECT] Increase CONNECT_GRPC_MARSHALLER_RECURSION_LIMIT from 1024 to 4096 [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2024/09/17 13:20:34 UTC, 0 replies.
- Re: [PR] [SPARK-49687] [MINOR] Avoid sorting in validateAndMaybeEvolveStateSchema [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/17 14:50:25 UTC, 7 replies.
- Re: [PR] [SPARK-49687][SQL] Delay sorting in `validateAndMaybeEvolveStateSchema` [spark] - posted by "tedyu (via GitHub)" <gi...@apache.org> on 2024/09/17 15:46:40 UTC, 4 replies.
- Re: [PR] [SPARK-49679][SQL] validateSchemaOutput should refer to case sensitivity flag [spark] - posted by "xil-db (via GitHub)" <gi...@apache.org> on 2024/09/17 19:16:56 UTC, 9 replies.
- Re: [PR] [SPARK-46037][SQL] Correctness fix for Shuffled Hash Join build left without codegen [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2024/09/17 21:44:07 UTC, 0 replies.
- [PR] [SPARK-49678][CORE][FOLLOWUP] Support `spark.master` in `SparkSubmitArguments` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/17 22:04:17 UTC, 7 replies.
- Re: [PR] [WIP][SPARK-49604] GROUP_BY_POS_OUT_OF_RANGE if group by Literal [spark] - posted by "George314159 (via GitHub)" <gi...@apache.org> on 2024/09/17 22:58:58 UTC, 0 replies.
- [PR] [SPARK-49691][PYTHON][CONNECT] Function `substring` should accept column names [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/18 02:34:59 UTC, 3 replies.
- [PR] [SPARK-49495][DOCS][FOLLOWUP] Fix Pandoc installation for GitHub Pages publication action [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/09/18 03:12:04 UTC, 6 replies.
- [PR] [SPARK-49692][PYTHON][CONNECT] Refine the string representation of literal date and timestamp [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/18 04:03:08 UTC, 1 replies.
- [PR] Session Catalog Name support modification [spark] - posted by "melin (via GitHub)" <gi...@apache.org> on 2024/09/18 04:35:40 UTC, 1 replies.
- [PR] [BUILD] Upgrade datasketches-java to 6.1.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/18 06:34:23 UTC, 2 replies.
- [PR] [SPARK-49495][DOCS][FOLLOWUP] Enable GitHub Pages settings via .asf.yml [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/09/18 07:38:57 UTC, 3 replies.
- [PR] [SPARK-49688][CONNECT] Fix a sporadic SparkConnectServiceSuite failure [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/09/18 08:02:24 UTC, 1 replies.
- Re: [PR] [SPARK-48495][SQL][DOCS] Describe shredding scheme for Variant [spark] - posted by "Zouxxyy (via GitHub)" <gi...@apache.org> on 2024/09/18 08:50:27 UTC, 3 replies.
- [PR] [WIP][SPARK-49552][Python] Add DataFrame API support for new 'randstr' and 'uniform' SQL functions [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/09/18 09:33:04 UTC, 0 replies.
- [PR] [SPARK-49695] Postgres fix xor push-down [spark] - posted by "andrej-db (via GitHub)" <gi...@apache.org> on 2024/09/18 10:22:38 UTC, 3 replies.
- [PR] [SPARK-49653] Single join for scalar subqueries [spark] - posted by "agubichev (via GitHub)" <gi...@apache.org> on 2024/09/18 15:46:23 UTC, 0 replies.
- Re: [PR] [SPARK-49552][Python] Add DataFrame API support for new 'randstr' and 'uniform' SQL functions [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/09/18 16:02:09 UTC, 0 replies.
- [PR] [SPARK-49568][CONNECT][SQL] Remove Dataset self type from Dataset [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/18 16:18:30 UTC, 0 replies.
- Re: [PR] [SPARK-49568][CONNECT][SQL] Remove self type from Dataset [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/18 16:19:42 UTC, 2 replies.
- Re: [PR] [SPARK-49688][CONNECT][TESTS] Fix a sporadic `SparkConnectServiceSuite` failure [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/18 16:25:57 UTC, 6 replies.
- [PR] [SPARK-49422][CONNECT][SQL] Add groupByKey to sql/api [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/18 16:50:50 UTC, 9 replies.
- [PR] [SPARK-49656] Add support for state variables with value state collection types and read change feed options [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/09/18 17:59:56 UTC, 0 replies.
- [PR] [SPARK-49699] Disable PruneFilters for streaming workloads [spark] - posted by "n-young-db (via GitHub)" <gi...@apache.org> on 2024/09/18 18:20:08 UTC, 0 replies.
- [PR] [SPARK-49699] Disable PruneFilters for sideeffect workloads [spark] - posted by "n-young-db (via GitHub)" <gi...@apache.org> on 2024/09/18 18:27:36 UTC, 2 replies.
- [PR] [SPARK-49415][CONNECT][SQL] Move SQLImplicits to sql/api [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/18 20:15:09 UTC, 5 replies.
- [PR] [FOLLOW-UP][SPARK-49611][SQL] Fix wrong results of collations() TVF [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/09/18 21:26:09 UTC, 1 replies.
- [PR] [SPARK-49701] Use JDK for Spark 3.5+ Docker image [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/18 21:30:59 UTC, 4 replies.
- [PR] [SPARK-45497] Add a symbolic link file `spark-examples.jar` in K8s Docker images [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/18 21:39:36 UTC, 4 replies.
- [PR] [SPARK-44935] Fix `RELEASE` file to have the correct information in Docker images if exists [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/18 21:54:29 UTC, 4 replies.
- [PR] Abort changelog writer before resetting [spark] - posted by "tedyu (via GitHub)" <gi...@apache.org> on 2024/09/18 22:43:12 UTC, 0 replies.
- Re: [PR] [Minor] Abort changelog writer before resetting [spark] - posted by "tedyu (via GitHub)" <gi...@apache.org> on 2024/09/18 22:59:49 UTC, 0 replies.
- Re: [PR] [SPARK-44167][SQL] Support loading stored procedures in catalogs [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2024/09/18 23:07:55 UTC, 1 replies.
- Re: [PR] [SPARK-49656][SS] Add support for state variables with value state collection types and read change feed options [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/09/18 23:18:04 UTC, 7 replies.
- Re: [PR] [SPARK-49692][PYTHON][CONNECT] Refine the string representation of literal date and datetime [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/18 23:46:31 UTC, 1 replies.
- Re: [PR] [SPARK-49673][CONNECT] Increase CONNECT_GRPC_ARROW_MAX_BATCH_SIZE to 0.7 * CONNECT_GRPC_MAX_MESSAGE_SIZE [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/18 23:54:10 UTC, 1 replies.
- [PR] [SPARK-49703] Publish Java 21 Docker image for preview1 [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/18 23:54:42 UTC, 13 replies.
- Re: [PR] [SPARK-49699][SQL] Disable PruneFilters for streaming workloads [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/18 23:57:10 UTC, 1 replies.
- Re: [PR] [MINOR] Abort changelog writer before resetting [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/18 23:59:45 UTC, 6 replies.
- Re: [PR] [SPARK-49611][SQL][FOLLOW-UP] Fix wrong results of collations() TVF [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/19 00:01:20 UTC, 2 replies.
- [PR] [SPARK-49704][BUILD] Upgrade `commons-io` to 2.17.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/19 00:09:41 UTC, 3 replies.
- [PR] [SPARK-49705] Use `spark-examples.jar` instead of `spark-examples_2.13-4.0.0-preview1.jar` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/19 00:22:54 UTC, 3 replies.
- Re: [PR] [WIP][SQL] Collation support for Char/Varchar (v2) [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/19 00:23:07 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-48311][SQL] Fix nested pythonUDF in groupBy and aggregate Bind… [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/19 00:23:08 UTC, 1 replies.
- Re: [PR] [WIP][SQL] Collation support for Char/Varchar [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/19 00:23:09 UTC, 1 replies.
- Re: [PR] [SPARK-48416][SQL] Support related nested WITH expression [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/19 00:23:11 UTC, 1 replies.
- Re: [PR] [SPARK-49653][SQL] Single join for correlated scalar subqueries [spark] - posted by "agubichev (via GitHub)" <gi...@apache.org> on 2024/09/19 00:35:19 UTC, 25 replies.
- [PR] [SPARK-49706] Use `apache/spark` images instead of `spark` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/19 00:38:21 UTC, 3 replies.
- [PR] [WIP][SPARK-49707][BUILD] Upgrade rocksdbjni to 9.6.1 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/19 01:16:55 UTC, 0 replies.
- [PR] [SPARK-49708][BUILD] Upgrade `RoaringBitmap` to `1.3.0` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/19 01:19:49 UTC, 0 replies.
- Re: [PR] [SPARK-49152][SQL] V2SessionCatalog should use V2Command [spark] - posted by "manuzhang (via GitHub)" <gi...@apache.org> on 2024/09/19 03:43:03 UTC, 8 replies.
- [PR] [SPARK-49713][PYTHON][CONNECT] Make function `count_min_sketch` accept number arguments [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/19 03:58:36 UTC, 9 replies.
- [PR] [WIP][SPARK-46679][SQL]: Handling of generic parameter with bounds while creating encoders [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2024/09/19 04:02:23 UTC, 0 replies.
- [PR] [SPARK-49693][PYTHON][CONNECT] Refine the string representation of `timedelta` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/19 04:04:55 UTC, 7 replies.
- [PR] [SPARK-49714] Add Java 21 Pi example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/19 04:10:43 UTC, 0 replies.
- Re: [PR] [SPARK-49714] Add `Java 21`-based `SparkPi` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/19 04:15:29 UTC, 2 replies.
- Re: [PR] [SPARK-49552][PYTHON] Add DataFrame API support for new 'randstr' and 'uniform' SQL functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/19 04:25:47 UTC, 9 replies.
- [PR] [SPARK-49715] Add `Java 21`-based `SparkCluster` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/19 04:27:27 UTC, 3 replies.
- [PR] [SPARK-46535][SQL][3.4] Fix NPE when describe extended a column without col stats [spark] - posted by "saitharun15 (via GitHub)" <gi...@apache.org> on 2024/09/19 06:03:44 UTC, 5 replies.
- Re: [PR] [SPARK-49699][SS] Disable PruneFilters for streaming workloads [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/09/19 06:28:35 UTC, 5 replies.
- Re: [PR] [SPARK-49667][SQL] Disallowed CS_AI collators with expressions that use StringSearch [spark] - posted by "vladanvasi-db (via GitHub)" <gi...@apache.org> on 2024/09/19 06:43:28 UTC, 3 replies.
- Re: [PR] [SPARK-24497][SQL] Support recursive SQL [spark] - posted by "sb-mirakl (via GitHub)" <gi...@apache.org> on 2024/09/19 07:40:39 UTC, 3 replies.
- [PR] [SPARK-49716][PS] Imrpove documentation and test of barh plot [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/09/19 08:09:07 UTC, 0 replies.
- [PR] [SPARK-48280][SQL][FOLLOW-UP] Add expressions that are built via expressionBuilder to Expression Walker [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/09/19 08:09:49 UTC, 3 replies.
- [PR] [SPARK-49717][SQL][TESTS] Function parity test ignore private functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/19 08:58:27 UTC, 0 replies.
- [PR] [SPARK-49718][PS] Switch `Scatter` plot to sampled data [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/19 09:22:58 UTC, 3 replies.
- [PR] [SPARK-49392][SQL][FOLLOWUP] Catch errors when failing to write to external data source [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/09/19 12:25:50 UTC, 3 replies.
- Re: [PR] [SPARK-48292][CORE] Revert [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort stage when committed file not consistent with task status [spark] - posted by "lihao712 (via GitHub)" <gi...@apache.org> on 2024/09/19 12:46:29 UTC, 5 replies.
- Re: [PR] [SPARK-49717][SQL][TESTS] Function parity test ignore private[xxx] functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/19 13:01:11 UTC, 1 replies.
- [PR] [SPARK-49719][SQL] Make `UUID` and `SHUFFLE` accept integer `seed` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/19 14:27:10 UTC, 2 replies.
- [PR] [SPARK-49720][PYTHON][INFRA] Add a script to clean up PySpark temp files [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/19 15:00:03 UTC, 2 replies.
- [PR] [WIP][SPARK-49561][SQL] Add SQL pipe syntax for the TABLESAMPLE operator [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/09/19 15:06:15 UTC, 0 replies.
- [PR] Bump google-protobuf from 3.25.3 to 3.25.5 in /docs [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/09/19 16:26:33 UTC, 2 replies.
- [PR] Bump com.google.protobuf:protobuf-java from 3.25.4 to 3.25.5 [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/09/19 16:27:26 UTC, 2 replies.
- Re: [PR] [SPARK-49716][PS][DOCS][TESTS] Fix documentation and add test of barh plot [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/19 17:09:41 UTC, 1 replies.
- [PR] [SPARK-49721][BUILD] Upgrade `protobuf-java` to 3.25.5 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/19 17:16:50 UTC, 5 replies.
- Re: [PR] [SPARK-46090][SQL] Support plan fragment level SQL configs in AQE [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/09/19 19:45:53 UTC, 4 replies.
- Re: [PR] [SPARK-49685][CONNECT] Increase CONNECT_GRPC_MARSHALLER_RECURSION_LIMIT from 1024 to 2048 [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2024/09/19 20:23:01 UTC, 3 replies.
- [PR] [SPARK-49723][SQL] Add Variant metrics to the JSON File Scan node [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/09/19 21:50:50 UTC, 10 replies.
- [PR] [SPARK-49722][CONNECT] Fix Column ordering of dropDuplicates and dropDuplicatesWithinWatermarks [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/09/19 21:56:37 UTC, 3 replies.
- [PR] Try java21 [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2024/09/20 00:34:16 UTC, 1 replies.
- [PR] [SPARK-45923]Add java21 to the e2e tests [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2024/09/20 00:45:54 UTC, 4 replies.
- Re: [PR] [SPARK-48195][CORE] Save and reuse RDD/Broadcast created by SparkPlan [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/20 01:21:22 UTC, 10 replies.
- [PR] [WIP][SPARK-49690][SQL] UDT type not showing up in sql type representation in the schema [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2024/09/20 02:38:15 UTC, 0 replies.
- Re: [PR] [SPARK-49008][PYTHON] Use `ParamSpec` to propagate `func` signature in `transform` [spark] - posted by "nicklamiller (via GitHub)" <gi...@apache.org> on 2024/09/20 02:46:46 UTC, 0 replies.
- [PR] [MINOR][INFRA] Disable 'pages build and deployment' action [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/09/20 03:39:19 UTC, 3 replies.
- [PR] [SPARK-49451][FOLLOW-UP] Add support for duplicate keys in from_json(_, 'variant') [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/09/20 06:37:37 UTC, 5 replies.
- [PR] [MINOR][FOLLOWUP] Fix rat check for .nojekyll [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/09/20 06:56:31 UTC, 3 replies.
- [PR] [SPARK-49729][SQL][DOCS] Forcefully check `usage` and correct the non-standard writing of 4 expressions [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/20 08:04:36 UTC, 5 replies.
- [PR] [WIP] Upgrade numpy to 2.1.0 [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/09/20 08:11:10 UTC, 3 replies.
- [PR] [SPARK-49731][K8S] Add hostPath volume type and mount subPathExpr to kubernetes volume options [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/09/20 08:18:35 UTC, 0 replies.
- [PR] [SPARK-49730] classify syntax errors for pgsql, mysql, sqlserver and h2 [spark] - posted by "milastdbx (via GitHub)" <gi...@apache.org> on 2024/09/20 08:24:27 UTC, 0 replies.
- [PR] [SPARK-49733][SQL][DOCS] Delete `ExpressionInfo[between]` from `gen-sql-api-docs.py` to avoid duplication [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/20 09:16:12 UTC, 4 replies.
- [PR] [SPARK-49734][PYTHON] Add `seed` argument for function `shuffle` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/20 10:34:28 UTC, 6 replies.
- [PR] [SPARK-49735][K8S] Upgrade Spark to `4.0.0-preview2` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/20 11:27:03 UTC, 0 replies.
- Re: [PR] [SPARK-49724] Add java21 to the e2e tests [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/20 11:54:40 UTC, 0 replies.
- [PR] [SPARK-49736] Add Apache Spark 4.0.0-preview2 Dockerfiles [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/20 12:16:21 UTC, 0 replies.
- [PR] Improve channel builder for external applications [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/09/20 12:26:15 UTC, 2 replies.
- [PR] Catch exception from snapshot upload [spark] - posted by "tedyu (via GitHub)" <gi...@apache.org> on 2024/09/20 12:43:49 UTC, 0 replies.
- Re: [PR] [Minor] Catch exception from snapshot upload [spark] - posted by "tedyu (via GitHub)" <gi...@apache.org> on 2024/09/20 13:13:39 UTC, 0 replies.
- Re: [PR] [Minor] Catch exception from snapshot uploading [spark] - posted by "tedyu (via GitHub)" <gi...@apache.org> on 2024/09/20 14:10:54 UTC, 0 replies.
- [PR] [SPARK-49737] Disable bucketing on collated columns in complex types [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/09/20 14:48:25 UTC, 0 replies.
- Re: [PR] [SPARK-49737][SQL] Disable bucketing on collated columns in complex types [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/20 14:56:25 UTC, 2 replies.
- [PR] [SPARK-49738][SQL] Endswith bug fix [spark] - posted by "viktorluc-db (via GitHub)" <gi...@apache.org> on 2024/09/20 15:55:43 UTC, 10 replies.
- Re: [PR] [SPARK-49735] Upgrade Spark to `4.0.0-preview2` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/20 16:27:44 UTC, 2 replies.
- [PR] [SPARK-49739][SQL] Throw Custom error condition for invalid options in SaveIntoDataSourceCommand class [spark] - posted by "ivanjevtic-db (via GitHub)" <gi...@apache.org> on 2024/09/20 16:51:06 UTC, 6 replies.
- Re: [PR] [SPARK-49736] Add Apache Spark `4.0.0-preview2` Dockerfiles [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/20 17:28:55 UTC, 2 replies.
- [PR] [SPARK-49740] Update `publish-java17.yaml` and `publish-java21.yaml` to use `preview2` by default [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/20 18:06:55 UTC, 4 replies.
- [PR] [SPARK-49741][Docs] Add spark.sql.adaptive.skewJoin.skewedPartitionFactor to config docs page [spark] - posted by "timlee0119 (via GitHub)" <gi...@apache.org> on 2024/09/20 18:35:29 UTC, 2 replies.
- [PR] [SPARK-49742] Upgrade `README`, examples, tests to use `preview2` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/20 18:41:19 UTC, 4 replies.
- [PR] [SPARK-49743][SQL] OptimizeCsvJsonExpr should not change schema fields when pruning GetArrayStructFields [spark] - posted by "nikhilsheoran-db (via GitHub)" <gi...@apache.org> on 2024/09/20 19:19:24 UTC, 9 replies.
- Re: [PR] [SPARK-48712][SQL] Perf Improvement for encode with empty values or UTF-8 charset [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/09/20 20:01:44 UTC, 2 replies.
- [PR] [SPARK-49460][SQL] Followup: fix potential NPE risk [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2024/09/20 20:03:27 UTC, 2 replies.
- [PR] [WIP][SPARK-49746][BUILD] Upgrade Scala to 2.13.15 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/20 23:11:25 UTC, 16 replies.
- Re: [PR] [SPARK-49741][Docs] Add `spark.sql.adaptive.skewJoin.skewedPartitionFactor` to config docs page [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/21 00:09:18 UTC, 1 replies.
- [PR] [SPARK-48782][SQL][TESTS][FOLLOW-UP] Enable ANSI for malformed input test in ProcedureSuite [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/21 04:03:07 UTC, 2 replies.
- Re: [PR] [SPARK-49741][Docs] Add `spark.shuffle.accurateBlockSkewedFactor ` to config docs page [spark] - posted by "timlee0119 (via GitHub)" <gi...@apache.org> on 2024/09/21 04:03:59 UTC, 0 replies.
- [PR] [WIP][SQL][TESTS][FOLLOWUP] Enable a SQL Scripting test in ANSI and non-ANSI modes [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/21 08:29:27 UTC, 0 replies.
- [PR] [SPARK-49747][CONNECT] Migrate connect/ files to structured logging [spark] - posted by "nemanja-boric-databricks (via GitHub)" <gi...@apache.org> on 2024/09/21 19:59:35 UTC, 2 replies.
- Re: [PR] [SPARK-48511][SS] Remove TimeMode None from TransformWithState. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/22 00:25:59 UTC, 1 replies.
- Re: [PR] [SPARK-49741][DOCS] Add `spark.shuffle.accurateBlockSkewedFactor` to config docs page [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/22 05:40:15 UTC, 1 replies.
- Re: [PR] [SPARK-48355][SQL][TESTS][FOLLOWUP] Enable a SQL Scripting test in ANSI and non-ANSI modes [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/22 05:41:16 UTC, 1 replies.
- [PR] [WIP] Add `getCondition` and deprecate `getErrorClass` in `SparkThrowable` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/22 08:52:04 UTC, 0 replies.
- [PR] [SPARK-49749][CORE] Change log level to debug in BlockManagerMasterEndpoint [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2024/09/22 10:29:57 UTC, 0 replies.
- Re: [PR] [SPARK-49748][CORE] Add `getCondition` and deprecate `getErrorClass` in `SparkThrowable` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/09/22 12:19:43 UTC, 5 replies.
- [PR] [SPARK-49732][CORE][K8S] Spark deamons should respect `spark.log.structuredLogging.enabled` conf [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/09/22 13:21:54 UTC, 7 replies.
- [PR] [SPARK-49750][DOC] Mention delegation token support in K8s mode [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/09/22 14:05:06 UTC, 11 replies.
- Re: [PR] [SPARK-49695][SQL] Postgres fix xor push-down [spark] - posted by "andrej-db (via GitHub)" <gi...@apache.org> on 2024/09/22 14:48:02 UTC, 2 replies.
- [PR] [SPARK-49751][CONNECT] Fix deserialization of SparkListenerConnectServiceStarted event [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/09/22 15:12:28 UTC, 6 replies.
- [PR] [SPARK-49752][YARN] Remove workaround for YARN-3350 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/09/22 15:46:42 UTC, 2 replies.
- Re: [PR] [SPARK-49749][CORE] Change log level to debug in BlockManagerInfo [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/09/22 17:14:14 UTC, 2 replies.
- Re: [PR] [SPARK-48605][CORE][UI] UI display driver thread first on the thread dump page [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/23 00:24:21 UTC, 1 replies.
- [PR] [SPARK-49725][SQL][DOC] Enhance the doc of spark.sql.codegen.wholeStage [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2024/09/23 03:13:43 UTC, 2 replies.
- [PR] [SPARK-48712][SQL][FOLLOWUP] Check whether input is valid utf-8 string or not before entering fast path [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/09/23 03:14:02 UTC, 13 replies.
- [PR] [SPARK-49753][BUILD] Upgrade ZSTD-JNI to 1.5.6-6 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/23 03:32:02 UTC, 3 replies.
- [PR] [SPARK-49745] Add change to read registered timers through state data source reader [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/09/23 04:59:03 UTC, 0 replies.
- Re: [PR] [SPARK-49745][SS] Add change to read registered timers through state data source reader [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/09/23 05:12:25 UTC, 11 replies.
- [PR] [WIP][SPARK-49631][SQL]Remove the ANSI config suggestion in ARITHMETIC_OVERFLOW [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/09/23 07:27:55 UTC, 0 replies.
- [PR] [MINOR][PYTHON][DOCS] Fix the docstring of `to_timestamp` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/23 07:29:05 UTC, 2 replies.
- [PR] [SPARK-49754] Support HPA for `SparkCluster` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/23 07:31:38 UTC, 11 replies.
- [PR] [SPARK-49688][CONNECT] Fix a data race between interrupt and execute plan [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/09/23 07:55:22 UTC, 15 replies.
- [PR] [SPARK-49755][CONNECT] Remove special casing for avro functions in Connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/23 09:32:10 UTC, 2 replies.
- [PR] [#58] Add CreateDataFrame, Corr, ColRegex, Columns [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/09/23 10:06:32 UTC, 0 replies.
- [PR] [WIP][SPARK-49756][SQL] Postgres dialect supports pushdown datetime functions. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2024/09/23 10:46:38 UTC, 0 replies.
- Re: [PR] [SPARK-46679][SQL]: Handling of generic parameter with bounds while creating encoders [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/23 15:31:18 UTC, 12 replies.
- [PR] [SPARK-48196] Turn QueryExecution lazy val plans into LazyTry [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2024/09/23 16:14:17 UTC, 1 replies.
- [PR] [SPARK-49429][CONNECT][SQL] Add Shared DataStreamWriter interface [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/23 20:30:44 UTC, 2 replies.
- [PR] [SPARK-49416][CONNECT][SQL] Add Shared DataStreamReader interface [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/23 20:33:19 UTC, 2 replies.
- [PR] [SPARK-49760][YARN] Correct handling of `SPARK_USER` environment vari… [spark] - posted by "cnauroth (via GitHub)" <gi...@apache.org> on 2024/09/23 21:02:57 UTC, 1 replies.
- Re: [PR] [SPARK-49760][YARN] Correct handling of `SPARK_USER` env variable override in app master [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/23 21:17:32 UTC, 7 replies.
- [PR] [SPARK-48994][FOLLOW-UP] Disable support for interval types in Variant by default [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/09/23 22:40:30 UTC, 3 replies.
- [PR] [SPARK-49760][YARN] Correct handling of `SPARK_USER` env variable ove… [spark] - posted by "cnauroth (via GitHub)" <gi...@apache.org> on 2024/09/23 22:42:08 UTC, 1 replies.
- [PR] [SPARK-49417][CONNECT][SQL] Add Shared StreamingQueryManager interface [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/23 23:40:28 UTC, 5 replies.
- Re: [PR] [SPARK-49756][SQL] Postgres dialect supports pushdown datetime functions. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2024/09/24 01:16:28 UTC, 0 replies.
- [PR] [SPARK-49607][PYTHON] Update the sampling approach for sampled based plots [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/24 02:35:38 UTC, 3 replies.
- [PR] [SPARK-49694][PYTHON][CONNECT] Support scatter plots [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/09/24 02:59:20 UTC, 4 replies.
- [PR] [WIP] [SPARK-49763] [spark] - posted by "babumahesh (via GitHub)" <gi...@apache.org> on 2024/09/24 04:39:36 UTC, 0 replies.
- [PR] [SPARK-49765][DOCS][PYTHON] Adjust documentation of "spark.sql.pyspark.plotting.max_rows" [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/09/24 07:27:56 UTC, 5 replies.
- [PR] [SPARK-49666][SQL] Add feature flag for trim collation feature [spark] - posted by "jovanpavl-db (via GitHub)" <gi...@apache.org> on 2024/09/24 07:52:31 UTC, 41 replies.
- Re: [PR] [Don't Merge] upgrade sbt 1.9.8 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/24 09:38:49 UTC, 0 replies.
- [PR] [SPARK-49713][PYTHON][FOLLOWUP] Make function `count_min_sketch` accept long seed [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/24 10:23:19 UTC, 2 replies.
- [PR] [SPARK-49766][SQL] Codegen Support for `json_array_length` (by `Invoke` & `RuntimeReplaceable`) [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/24 11:23:01 UTC, 1 replies.
- Re: [PR] [SPARK-48196][SQL] Turn QueryExecution lazy val plans into LazyTry [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2024/09/24 11:29:59 UTC, 0 replies.
- [PR] [SPARK-49767][PS][CONNECT] Refactor the internal function invocation [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/24 12:32:28 UTC, 3 replies.
- [PR] [SPARK-49757][SQL] Support IDENTIFIER expression in SET CATALOG statement [spark] - posted by "mikhailnik-db (via GitHub)" <gi...@apache.org> on 2024/09/24 15:00:28 UTC, 7 replies.
- [PR] [SPARK-49282][CONNECT][SQL] Create a shared SparkSessionBuilder interface. [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/24 16:38:46 UTC, 2 replies.
- Re: [PR] [#58] Add CreateDataFrame, Corr, Cov, Count, ColRegex, Columns [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/09/24 18:48:16 UTC, 1 replies.
- [PR] Timer draft [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/09/24 20:24:18 UTC, 1 replies.
- [PR] [SPARK-49771][PYTHON] Improve Pandas Scalar Iter UDF error when output rows exceed input rows [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/09/24 20:41:33 UTC, 3 replies.
- [PR] [#58] Add Support for more DataFrame functions [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/09/24 21:22:04 UTC, 2 replies.
- [PR] [SPARK-49772] Remove ColumnFamilyOptions and add configs directly to dbOptions in RocksDB [spark] - posted by "liviazhu-db (via GitHub)" <gi...@apache.org> on 2024/09/24 21:37:23 UTC, 0 replies.
- [PR] [SPARK-49774][BUILD] Upgrade guava to 33.3.1-jre [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/24 23:39:01 UTC, 3 replies.
- [PR] Bump webrick from 1.8.1 to 1.8.2 in /docs [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/09/25 01:23:47 UTC, 2 replies.
- Re: [PR] [SPARK-49772][SS] Remove ColumnFamilyOptions and add configs directly to dbOptions in RocksDB [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/09/25 01:45:30 UTC, 2 replies.
- [PR] [SPARK-49775][SQL][TESTS] Make tests of `INVALID_PARAMETER_VALUE.CHARSET` deterministic [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/25 02:46:31 UTC, 10 replies.
- [PR] area [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/09/25 03:50:55 UTC, 0 replies.
- Re: [PR] [SPARK-49259][SS]Size based partition creation during kafka read [spark] - posted by "SubhamSinghal (via GitHub)" <gi...@apache.org> on 2024/09/25 04:50:48 UTC, 6 replies.
- Re: [PR] [SPARK-49746][BUILD] Upgrade Scala to 2.13.15 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/25 04:57:39 UTC, 4 replies.
- Re: [PR] [SPARK-49731][K8S] Support K8s volume `mount.subPathExpr` and `hostPath` volume `type` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/25 05:08:56 UTC, 3 replies.
- [PR] [SPARK-49778] Remove (master|worker) prefix from field names of `(Master|Worker)Spec` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/25 05:30:18 UTC, 4 replies.
- Re: [PR] [SPARK-49764][PYTHON][CONNECT] Support area plots [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/09/25 07:30:13 UTC, 5 replies.
- [PR] [SPARK-49781][SQL] Optimize size of `MapFromArrays` / `MapFromEntries` to be the size of its children [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/25 07:34:06 UTC, 2 replies.
- [PR] Publish Apache Spark 3.5.3 to docker registry [spark-docker] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/09/25 07:38:05 UTC, 8 replies.
- [PR] [SPARK-49783] fix(yarn): Resource leak of yarn allocator [spark] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/09/25 08:17:50 UTC, 0 replies.
- [PR] [SPARK-49609][PYTHON][TESTS][FOLLOW-UP] Skip Spark Connect tests if dependencies are not found [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/25 08:24:01 UTC, 3 replies.
- [PR] [SPARK-49782][SQL] ResolveDataFrameDropColumns rule resolves UnresolvedAttribute with child output [spark] - posted by "LantaoJin (via GitHub)" <gi...@apache.org> on 2024/09/25 09:43:08 UTC, 6 replies.
- [PR] [SPARK-49723][FOLLOW-UP][SQL] Add Variant metrics to the parse_json expression in the project node [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/09/25 10:13:51 UTC, 0 replies.
- [PR] [SPARK-49768][SQL] Provide error conditions for `make_date`/`make_timestamp` errors `_LEGACY_ERROR_TEMP_2000` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/09/25 10:44:03 UTC, 9 replies.
- [PR] [SPARK-48195][FOLLOWUP] Accumulator reset() no longer needed in CollectMetricsExec.doExecute() [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2024/09/25 10:55:24 UTC, 3 replies.
- [PR] [SPARK-49609][PYTHON][FOLLOWUP] Correct the typehint for `filter` and `where` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/25 10:55:53 UTC, 2 replies.
- [PR] [SPARK-49775][SQL][FOLLOW-UP] Use SortedSet instead of Array with sorting [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/25 11:09:09 UTC, 2 replies.
- [PR] [SPARK-49784][PYTHON][TESTS] Add more test for `spark.sql` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/25 12:11:24 UTC, 5 replies.
- [PR] Refactoring type coercion rules for binary operators [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2024/09/25 12:30:38 UTC, 0 replies.
- [PR] [#58] More DataFrame Features [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/09/25 15:51:14 UTC, 2 replies.
- [PR] [WIP] Clean up deprecated Guava API usage [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/25 16:27:34 UTC, 1 replies.
- [PR] [SPARK-49786][K8S] Lower `KubernetesClusterSchedulerBackend.onDisconnected` log level to debug [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/25 16:41:52 UTC, 6 replies.
- [PR] Add thread info to all state store operation logs [spark] - posted by "huanliwang-db (via GitHub)" <gi...@apache.org> on 2024/09/25 17:36:27 UTC, 0 replies.
- Re: [PR] [SPARK-49763] [CSV] [SQL] [Schema Detection] [spark] - posted by "babumahesh (via GitHub)" <gi...@apache.org> on 2024/09/25 18:22:51 UTC, 1 replies.
- Re: [PR] [SPARK-49770][SS][RocksDB Hardening] Improve RocksDB SST file mapping management, and fix issue with reloading same version with existing snapshot [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/09/25 19:10:59 UTC, 3 replies.
- Re: [PR] [SPARK-49561][SQL] Add SQL pipe syntax for the PIVOT and UNPIVOT operators [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/09/25 19:41:41 UTC, 5 replies.
- [PR] [SPARK-49787][SQL] Cast between UDT and other types [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2024/09/25 19:47:29 UTC, 9 replies.
- [PR] [SPARK-49789][SQL]: Handling of generic parameter with bounds while creating encoders [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2024/09/25 20:58:12 UTC, 1 replies.
- [PR] [SPARK-49790] Support `HPA` template for `SparkCluster` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/25 21:14:10 UTC, 3 replies.
- [PR] [SPARK-49744] Implement TTL support for ListState in TransformWithStateInPandas [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2024/09/25 21:55:25 UTC, 0 replies.
- [PR] Timer cache [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/09/25 23:56:02 UTC, 1 replies.
- [PR] [SPARK-49211][SQL][FOLLOW-UP] Support catalog in QualifiedTableName [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2024/09/26 00:28:49 UTC, 5 replies.
- [PR] [WIP] Support pie plots [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/09/26 00:31:11 UTC, 0 replies.
- [PR] [SPARK-49791][SQL] Make DelegatingCatalogExtension more extendable [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/09/26 01:00:09 UTC, 4 replies.
- Re: [PR] [SPARK-49783][YARN] Fix resource leak of yarn allocator [spark] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/09/26 02:06:16 UTC, 6 replies.
- Re: [PR] [WIP][CORE] Clean up deprecated Guava API usage [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/09/26 02:51:34 UTC, 1 replies.
- Re: [PR] [SPARK-49792][PS][BUILD] Upgrade numpy to 2.1.0 for building and testing Spark branches [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/09/26 03:16:00 UTC, 0 replies.
- [PR] [SPARK-49286][CONNECT][SQL] Move Avro/Protobuf functions to sql/api [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/26 03:22:34 UTC, 1 replies.
- [PR] [SPARK-49609][PYTHON][TESTS][FOLLOW-UP] Avoid import connect modules when connect dependencies not installed [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/26 03:34:05 UTC, 3 replies.
- Re: [PR] [SPARK-49792][PS][BUILD] Upgrade to numpy 2 for building and testing Spark branches [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/09/26 05:18:04 UTC, 0 replies.
- Re: [PR] [SPARK-49776][PYTHON][CONNECT] Support pie plots [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/09/26 05:18:44 UTC, 9 replies.
- [PR] [SPARK-49773][SQL] uncaught Java exception from make_timestamp() with bad timezone [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/09/26 05:45:41 UTC, 5 replies.
- [PR] [SPARK-49794][SQL] Fix the expression `ArrayContains` bug where `value` is null [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/26 06:04:48 UTC, 10 replies.
- [PR] [MINOR][SQL][TESTS] Use `formatString.format(value)` instead of `value.formatted(formatString)` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/26 08:55:53 UTC, 5 replies.
- [PR] [SPARK-49797][INFRA] Align the running OS image of `maven_test.yml` to `ubuntu-latest` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/26 09:20:07 UTC, 6 replies.
- Re: [PR] [SPARK-45919][CORE][SQL] Use Java 16 `record` to simplify Java class definition [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/09/26 12:07:04 UTC, 6 replies.
- [PR] [SPARK-47341] Fix inaccurate documentation of RuntimeConfig.get [spark] - posted by "xi-db (via GitHub)" <gi...@apache.org> on 2024/09/26 13:35:40 UTC, 0 replies.
- Re: [PR] [SPARK-47341][SQL] Fix inaccurate documentation of RuntimeConfig.get [spark] - posted by "xi-db (via GitHub)" <gi...@apache.org> on 2024/09/26 14:25:59 UTC, 0 replies.
- [PR] Rename StringTypeAnyCollation [spark] - posted by "jovanpavl-db (via GitHub)" <gi...@apache.org> on 2024/09/26 16:32:18 UTC, 5 replies.
- Re: [PR] [SPARK-28595][SQL] explain should not trigger partition listing [spark] - posted by "natangsalgia (via GitHub)" <gi...@apache.org> on 2024/09/26 16:58:19 UTC, 0 replies.
- [PR] [SPARK-49712][SQL] Remove encoderFor from connect-client-jvm [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/26 18:13:16 UTC, 3 replies.
- [PR] [SPARK-49434][SPARK-49435][CONNECT][SQL] Move aggregators to sql/api [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/09/26 18:47:38 UTC, 1 replies.
- [PR] [SPARK-49800][BUILD][K8S] Upgrade `kubernetes-client` to 6.13.4 [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2024/09/26 19:04:44 UTC, 1 replies.
- [PR] [SPARK-49801][PYTHON][PS][BUILD] Update `pandas` to 2.2.3 [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2024/09/26 19:16:49 UTC, 4 replies.
- [PR] [WIP][SPARK-49564] Add SQL pipe syntax for the JOIN operator [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/09/26 20:46:28 UTC, 0 replies.
- [PR] [SPARK-49791][SQL][FOLLOWUP][3.5] Fix `import` statement [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/26 20:47:36 UTC, 4 replies.
- [PR] [#58] More DataFrame Functionality [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/09/26 22:05:30 UTC, 2 replies.
- [PR] [SPARK-49803][SQL][TESTS] Increase `spark.test.docker.connectionTimeout` to 10min [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/26 22:52:17 UTC, 4 replies.
- [PR] ghfix [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/26 23:25:25 UTC, 2 replies.
- Re: [PR] [SPARK-47341][SQL] Fix inaccurate documentation of RuntimeConfig#get [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/26 23:47:27 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-24815] [CORE] Trigger Interval based DRA for Structured Streaming [spark] - posted by "mentasm (via GitHub)" <gi...@apache.org> on 2024/09/27 01:19:20 UTC, 0 replies.
- [PR] [SPARK-49802][SS] Add support for read change feed for map types used in stateful processors [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/09/27 01:25:43 UTC, 1 replies.
- [PR] [SPARK-49804] Incorrect exit code on Kubernetes when deploying with s… [spark] - posted by "fe2s (via GitHub)" <gi...@apache.org> on 2024/09/27 02:54:10 UTC, 0 replies.
- Re: [PR] [SPARK-39821][PYTHON][PS] Fix error during using DatetimeIndex [spark] - posted by "DAAworld (via GitHub)" <gi...@apache.org> on 2024/09/27 03:15:46 UTC, 0 replies.
- Re: [PR] [SPARK-49795][CORE][SQL][SS][DSTREAM][ML][MLLIB][K8S][YARN][EXAMPLES] Clean up deprecated Guava API usage [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/27 03:23:54 UTC, 2 replies.
- Re: [PR] [SPARK-49804][K8S] Fix to use the exit code of executor container always [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/27 04:46:58 UTC, 2 replies.
- [PR] [SPARK-49805][SQL][ML] Remove private[xxx] functions from `function.scala` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/27 04:52:55 UTC, 3 replies.
- [PR] [SPARK-49806][SQL][CONNECT] Remove redundant `blank space` after `show` in `Scala` and `Connect` clients [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/27 07:49:52 UTC, 3 replies.
- [PR] [WIP] fix pandas upgrade 2.2.3 [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2024/09/27 08:10:57 UTC, 2 replies.
- [PR] [SPARK-49808][SQL] Fix a deadlock in subquery execution due to lazy vals [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/27 08:22:11 UTC, 4 replies.
- [PR] [SPARK-49809] Use `sbt.IO` in `SparkBuild.scala` to avoid naming conflicts with `java.io.IO` in Java 23 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/27 08:34:14 UTC, 0 replies.
- [PR] [WIP] Test the correct loading of `byte-buddy` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/27 08:45:41 UTC, 0 replies.
- [PR] [SPARK-49810][PYTHON] Extract the preparation of df.sort to parent class [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/09/27 09:04:50 UTC, 0 replies.
- Re: [PR] [SPARK-49813] Publish Apache Spark 3.5.3 to docker registry [spark-docker] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/09/27 10:57:19 UTC, 2 replies.
- Re: [PR] [SPARK-49801][FOLLOWUP][PYTHON][PS][BUILD] Update `pandas` to 2.2.3 [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/09/27 11:16:52 UTC, 0 replies.
- [PR] [SPARK-49814][CONNECT] When Spark Connect Client starts, show the `spark version` of the `connect server` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/27 11:35:49 UTC, 3 replies.
- Re: [PR] [SPARK-49801][FOLLOWUP][INFRA] Update `pandas` to 2.2.3 in `pages.yml` too [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/27 14:49:14 UTC, 0 replies.
- [PR] [SPARK-49816][SQL] Should only update out-going-ref-count for referenced outer CTE relation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/09/27 15:29:13 UTC, 2 replies.
- Re: [PR] [SPARK-49811][SQL]Rename StringTypeAnyCollation [spark] - posted by "jovanpavl-db (via GitHub)" <gi...@apache.org> on 2024/09/27 15:34:52 UTC, 0 replies.
- Re: [PR] [SPARK-49809][BUILD] Use `sbt.IO` in `SparkBuild.scala` to avoid naming conflicts with `java.io.IO` in Java 23 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/09/27 15:42:10 UTC, 3 replies.
- [PR] [SPARK-49817][BUILD] Upgrade `gcs-connector` to `2.2.25` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/27 16:35:48 UTC, 4 replies.
- [PR] [SPARK-49818] Update E22 tests to use Spark 3.5.3 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/27 16:47:38 UTC, 0 replies.
- [PR] [SPARK-49819] Disable CollapseProject for correlated subqueries in projection over aggregate correctly [spark] - posted by "n-young-db (via GitHub)" <gi...@apache.org> on 2024/09/27 18:15:05 UTC, 2 replies.
- [PR] [SPARK-49820] [PYTHON] Change `IOError` to `OSError` [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2024/09/27 19:28:57 UTC, 1 replies.
- [PR] [SPARK-49549][SQL] Assign a name to the error conditions _LEGACY_ERROR_TEMP_3055, 3146 [spark] - posted by "mrk-andreev (via GitHub)" <gi...@apache.org> on 2024/09/27 20:14:56 UTC, 0 replies.
- Re: [PR] [SPARK-49818] Update E2E tests to use Spark 3.5.3 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/27 21:19:47 UTC, 2 replies.
- Re: [PR] [SPARK-49601][SS][PYTHON] Support Initial State Handling for TransformWithStateInPandas [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2024/09/27 21:25:14 UTC, 0 replies.
- [PR] [SPARK-46525][DOCKER][TESTS][3.5] Fix docker-integration-tests on Apple Silicon [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/27 21:34:09 UTC, 1 replies.
- Re: [PR] [SPARK-46525][SQL][TESTS][3.5] Fix `docker-integration-tests` on Apple Silicon [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/27 22:22:12 UTC, 4 replies.
- Re: [PR] [SPARK-49820] [PYTHON] Change `raise IOError` to `raise OSError` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/27 23:51:55 UTC, 1 replies.
- Re: [PR] [SPARK-48619] Fix reference error when grouping by MapType [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/28 00:23:31 UTC, 1 replies.
- Re: [PR] [SPARK-48580][CORE] Add consistency check and fallback for mapIds in push-merged block meta [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/28 00:23:32 UTC, 1 replies.
- [PR] [SPARK-49821] Implement MapState for TransformWithStateInPandas [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2024/09/28 00:24:03 UTC, 0 replies.
- [PR] [SPARK-49822][SQL][TESTS] Update postgres docker image to 17.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/28 00:27:47 UTC, 2 replies.
- [PR] [SPARK-49823] Avoid flush during shutdown in rocksdb close path [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/09/28 01:25:02 UTC, 0 replies.
- Re: [PR] [SPARK-49823][SS] Avoid flush during shutdown in rocksdb close path [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/09/28 01:25:42 UTC, 0 replies.
- [PR] [SPARK-49824][SS][CONNECT] Improve logging in SparkConnectStreamingQueryCache [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/09/28 03:11:14 UTC, 0 replies.
- [PR] Cleanup row type and Arrow conversion [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/09/28 06:07:36 UTC, 0 replies.
- Re: [PR] [SPARK-49810][PYTHON] Extract the preparation of `DataFrame.sort` to parent class [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/09/28 07:21:20 UTC, 1 replies.
- [PR] [SPARK-49826][BUILD] Upgrade jackson to 2.18.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/09/28 23:24:01 UTC, 0 replies.
- Re: [PR] [SPARK-48663][CORE] Use a double-check locking mechanism to minimize synchronization overhead in NettyUtils [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/29 00:26:49 UTC, 0 replies.