You are viewing a plain text version of this content. The canonical link for it is here.

---

- [PR] [SPARK-48466][SQL][FOLLOWUP] Fix missing pattern match in EmptyRelationExec [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2024/07/02 16:56:02 UTC, 0 replies.
- Re: [PR] [SPARK-46798][Structured Streaming] Kafka custom partition location assignment (rack awareness) [spark] - posted by "rangadi (via GitHub)" <gi...@apache.org> on 2024/07/02 16:56:19 UTC, 0 replies.
- [PR] [SPARK-39901][CORE][SQL] Redesign `ignoreCorruptFiles` feature to make it more accurate by adding a new config `spark.files.ignoreCorruptFiles.errorClasses` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/02 16:57:06 UTC, 0 replies.
- Re: [PR] [SPARK-48699][SQL] Refine collation API [spark] - posted by "mkaravel (via GitHub)" <gi...@apache.org> on 2024/07/02 16:57:29 UTC, 0 replies.
- Re: [PR] [SPARK-48687][SS] Add change to perform state schema validation and update on driver in planning phase for stateful queries [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/07/02 16:59:58 UTC, 1 replies.
- Re: [PR] [SPARK-48697] Add collation aware string filters [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/07/02 17:00:59 UTC, 0 replies.
- [PR] Adding tests, structure, best practices to productionize code base [spark-connect-go] - posted by "mathiasschw-db (via GitHub)" <gi...@apache.org> on 2024/07/02 17:01:14 UTC, 3 replies.
- Re: [PR] [SPARK-47952][CORE][CONNECT] Support retrieving the real SparkConnectService GRPC address and port programmatically when running on Yarn [spark] - posted by "jshmchenxi (via GitHub)" <gi...@apache.org> on 2024/07/02 17:01:31 UTC, 0 replies.
- [PR] [SPARK-48738][SQL] Correct since for method alias `random`, `position`, `mod`, `cardinality`, `current_schema`, `user` and `session_user` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/02 17:01:51 UTC, 1 replies.
- Re: [PR] [SPARK-48735][SQL] Performance Improvement for BIN function [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/02 17:02:21 UTC, 1 replies.
- Re: [PR] [SPARK-48726] Create the StateSchemaV3 file format, and write this out for the TransformWithStateExec operator [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/07/02 17:04:15 UTC, 51 replies.
- Re: [PR] [SPARK-47445][CONNECT][SQL] Add new ExplainMode - SilentMode [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/02 17:04:44 UTC, 0 replies.
- Re: [PR] [SPARK-47471][SQL] Support order-insensitive lateral column alias [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/02 17:04:44 UTC, 0 replies.
- Re: [PR] [SPARK-47404][SQL] Add hooks to release the ANTLR DFA cache after parsing SQL [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/02 17:04:45 UTC, 0 replies.
- Re: [PR] Allow spark-class script to be ran in an environment where /dev/fd is unavailable (AWS Lambda) [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/02 17:04:46 UTC, 0 replies.
- Re: [PR] [SPARK-46653][SQL] Code-gen for full outer sort merge join output row by row [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/02 17:04:46 UTC, 0 replies.
- Re: [PR] [SPARK-43242][CORE] Fix throw 'Unexpected type of BlockId' in shuffle corruption diagnose [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/02 17:04:47 UTC, 1 replies.
- Re: [PR] [SPARK-48589][SQL][SS] Add option snapshotStartBatchId and snapshotPartitionId to state data source [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2024/07/02 17:04:56 UTC, 2 replies.
- Re: [PR] [SPARK-48751][INFRA][PYTHON][TESTS] Re-balance `pyspark-pandas-connect` tests on GA [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/02 17:06:11 UTC, 0 replies.
- Re: [PR] [SPARK-48742][SS] Virtual Column Family for RocksDB [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/07/02 17:06:34 UTC, 49 replies.
- [PR] [SPARK-48769][SQL] Support constant folding for ScalaUDF [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2024/07/02 17:06:47 UTC, 5 replies.
- Re: [PR] [SPARK-44718][SQL][DOCS] Avoid using ConfigEntry in spark.sql.columnVector.offheap.enabled's doc field [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/02 17:06:55 UTC, 1 replies.
- Re: [PR] [SPARK-48414][PYTHON] Fix breaking change in python's `fromJson` [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/07/02 17:08:56 UTC, 5 replies.
- [PR] [SPARK-48759][SQL] Add migration doc for CREATE TABLE AS SELECT behavior change behavior change since Spark 3.4 (branch-3.5) [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2024/07/02 17:09:34 UTC, 3 replies.
- [PR] [SPARK-48282][SQL][FOLLOWUP] Fix FindInSet code generation [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/07/02 17:09:38 UTC, 2 replies.
- [PR] [SPARK-46625] CTE with Identifier clause as reference [spark] - posted by "nebojsa-db (via GitHub)" <gi...@apache.org> on 2024/07/02 17:10:33 UTC, 20 replies.
- Re: [PR] [WIP][SPARK-48529][SQL] Introduction of Labels in SQL Scripting [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2024/07/02 17:11:06 UTC, 1 replies.
- Re: [PR] [SPARK-48177][BUILD] Upgrade `Apache Parquet` to 1.14.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/02 17:33:44 UTC, 4 replies.
- Re: [PR] [SPARK-48776] Fix timestamp formatting for json, xml and csv [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/07/02 17:47:56 UTC, 2 replies.
- Re: [PR] [SPARK-48773] Document config "spark.default.parallelism" by config builder framework [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/07/02 17:54:16 UTC, 7 replies.
- Re: [PR] [SPARK-48755] State V2 base implementation and ValueState support [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/07/02 18:10:31 UTC, 78 replies.
- [PR] [DO-NOT-MERGE] Structured logging style [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2024/07/02 18:14:04 UTC, 0 replies.
- [PR] [SPARK-44167][SQL] Support loading stored procedures in catalogs [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2024/07/02 18:48:12 UTC, 2 replies.
- [PR] [SPARK-48783][DOCS] Update the table-valued function docs [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/07/02 19:14:39 UTC, 3 replies.
- [PR] [SPARK-48307][SQL][FOLLOWUP] Eliminate the use of mutable.ArrayBuffer [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2024/07/02 19:48:24 UTC, 8 replies.
- [PR] [SPARK-48784][SQL] Add ::: syntax as a shorthand for try_cast [spark] - posted by "gene-db (via GitHub)" <gi...@apache.org> on 2024/07/02 20:11:35 UTC, 20 replies.
- Re: [PR] [SPARK-48770][SS] Change to read operator metadata once on driver to check if we can find info for numColsPrefixKey used for session window agg queries [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/07/02 20:21:31 UTC, 1 replies.
- [PR] [SPARK-48785][DOCS] Add a simple Python data source example in the user guide [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/07/02 20:55:36 UTC, 2 replies.
- Re: [PR] [DRAFT] Virtual Column Family for RocksDB - StateStore API change [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/07/02 21:10:16 UTC, 0 replies.
- [PR] [SPARK-48772][SS][SQL] State Source Change Feed Reader Mode [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2024/07/02 21:38:25 UTC, 0 replies.
- Re: [PR] [SPARK-48493][PYTHON] Enhance Python Datasource Reader with direct Arrow Batch support for improved performance [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/07/02 21:40:08 UTC, 0 replies.
- [PR] [SPARK-48780][SQL] Make errors in NamedParametersSupport generic to handle functions and procedures [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2024/07/02 22:05:19 UTC, 7 replies.
- Re: [PR] [SPARK-48710][PYTHON] Use NumPy 2.0 compatible types [spark] - posted by "jakirkham (via GitHub)" <gi...@apache.org> on 2024/07/02 22:18:03 UTC, 12 replies.
- [PR] [SPARK-44167][SQL] Add Catalog APIs for loading stored procedures [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2024/07/02 22:20:25 UTC, 21 replies.
- [PR] [SPARK-48786]Define Conf Properties for Spark Operator Controller [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/07/02 22:36:37 UTC, 3 replies.
- Re: [PR] [SPARK-48720][SQL] Clarify the command `ALTER TABLE ... UNSET TBLPROPERTIES ...` diff between v1 and v2 in doc [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/02 23:14:10 UTC, 2 replies.
- Re: [PR] Op state metadata [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/07/02 23:19:12 UTC, 0 replies.
- [PR] [SPARK-48787][BUILD] Upgrade Kafka to 3.7.1 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/02 23:35:31 UTC, 4 replies.
- Re: [PR] [SPARK-48710][PYTHON][3.5] Limit NumPy version to supported range (>=1.15,<2) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/03 00:21:21 UTC, 2 replies.
- Re: [PR] [SPARK-48777][BUILD]Migrate build system to Bazel [spark-connect-go] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/03 00:24:38 UTC, 2 replies.
- Re: [PR] [SPARK-48714][PYTHON] Implement `DataFrame.mergeInto` in PySpark [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/03 00:26:43 UTC, 2 replies.
- Re: [PR] [SPARK-48510][2/2] Support UDAF `toColumn` API in Spark Connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/03 00:39:32 UTC, 9 replies.
- Re: [PR] [SPARK-46741][SQL] Cache Table with CTE won't work [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/03 00:41:40 UTC, 1 replies.
- [PR] [SPARK-48628] Add task peak on/off heap memory metrics [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2024/07/03 01:21:58 UTC, 0 replies.
- [PR] [Only Test] Make HiveGenericUDF lazy [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/03 02:54:18 UTC, 0 replies.
- Re: [PR] [SPARK-42051][SQL] Codegen Support for HiveGenericUDF [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/03 02:59:39 UTC, 2 replies.
- Re: [PR] [Only Test] Make HiveGenericUDF's DeferredObject lazy [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/03 03:16:00 UTC, 6 replies.
- Re: [PR] [SPARK-39901][CORE][SQL] Redesign `ignoreCorruptFiles` to make it more accurate by adding a new config `spark.files.ignoreCorruptFiles.errorClasses` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/03 03:17:53 UTC, 0 replies.
- [PR] [MINOR][TESTS] Replace `getResource` with `getWorkspaceFilePath` to enable `HiveUDFSuite` to run successfully in the IDE [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/03 03:19:40 UTC, 4 replies.
- Re: [PR] [SPARK-48760][SQL] Introduce ALTER TABLE ... CLUSTER BY SQL syntax to change clustering columns [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/07/03 03:31:25 UTC, 1 replies.
- Re: [PR] [SPARK-48774][SQL] Use SparkSession in SQLImplicits [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/03 03:36:44 UTC, 1 replies.
- [PR] FileStreamSource maxCachedFiles set to 0 causes batch with no files to be processed [spark] - posted by "ragnarok56 (via GitHub)" <gi...@apache.org> on 2024/07/03 04:12:38 UTC, 1 replies.
- [PR] [SPARK-48790][TESTING] Use checkDatasetUnorderly in DeprecatedDatasetAggregatorSuite [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2024/07/03 04:32:08 UTC, 3 replies.
- [PR] [SPARK-48791][CORE] Fix perf regression caused by the accumulators registration overhead using CopyOnWriteArrayList [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2024/07/03 06:41:14 UTC, 38 replies.
- Re: [PR] [SPARK-48719][SQL] Fix the calculation bug of `RegrSlope` & `RegrIntercept` when the first parameter is null [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/03 07:08:51 UTC, 16 replies.
- Re: [PR] [SPARK-48771][SQL] Speed up `LogicalPlanIntegrity.validateExprIdUniqueness` for large query plans [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/07/03 07:31:40 UTC, 2 replies.
- Re: [PR] [SPARK-48720][SQL] Align the command `ALTER TABLE ... UNSET TBLPROPERTIES ...` in v1 and v2 [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/07/03 07:37:42 UTC, 2 replies.
- Re: [PR] [SPARK-43742][SQL] Refactor default column value resolution [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/03 09:10:14 UTC, 1 replies.
- [PR] [SPARK-48792][SQL] Fix regression for INSERT with partial column list to a table with char/varchar [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/03 09:21:48 UTC, 6 replies.
- [PR] [SPARK-48777][BUILD][FOLLOW] Set version to `v35` since v1 is not allowed and it follows the Spark release. [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/07/03 09:50:10 UTC, 2 replies.
- Re: [PR] Introduce versoning to jdbc connectors [spark] - posted by "mitkedb (via GitHub)" <gi...@apache.org> on 2024/07/03 10:07:34 UTC, 5 replies.
- [PR] Separate session code from sql module [spark-connect-go] - posted by "mathiasschw-db (via GitHub)" <gi...@apache.org> on 2024/07/03 10:10:15 UTC, 0 replies.
- Re: [PR] [SPARK-48754] Separate session code from sql module [spark-connect-go] - posted by "mathiasschw-db (via GitHub)" <gi...@apache.org> on 2024/07/03 10:12:33 UTC, 9 replies.
- [PR] [SPARK-48777] Adjusting the version identifier to v3.5 to match Spark [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/07/03 10:27:39 UTC, 2 replies.
- [PR] [SPARK-48777] Set version to v35 as only major versions are allowed in Go [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/07/03 10:32:04 UTC, 2 replies.
- Re: [PR] [SPARK-24497][SQL] Support recursive SQL [spark] - posted by "travis-leith (via GitHub)" <gi...@apache.org> on 2024/07/03 11:36:04 UTC, 0 replies.
- [PR] [SPARK-48793][SQL][TESTS] Unify v1 and v2 `ALTER TABLE .. DROP (COLUMN | COLUMNS) ...` tests [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/03 11:37:54 UTC, 0 replies.
- Re: [PR] Bump google.golang.org/grpc from 1.54.0 to 1.56.3 [spark-connect-go] - posted by "ptxmac (via GitHub)" <gi...@apache.org> on 2024/07/03 12:10:09 UTC, 4 replies.
- Re: [PR] [SPARK-48280][SQL] Improve collation testing surface area using expression walking [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/07/03 12:12:29 UTC, 2 replies.
- Re: [PR] [SPARK-47978][CONNECT] Use v1 as spark connect go library starting version [spark-connect-go] - posted by "ptxmac (via GitHub)" <gi...@apache.org> on 2024/07/03 12:15:13 UTC, 0 replies.
- Re: [PR] [SPARK-48343][SQL] Introduction of SQL Scripting interpreter [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/07/03 12:26:56 UTC, 11 replies.
- Re: [PR] [Connect][SPARK-48794] df.mergeInto support for Spark Connect (Scala and Python) [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/07/03 14:06:11 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-48715][SQL] Integrate UTF8String validation into collation-aware string function implementations [spark] - posted by "mkaravel (via GitHub)" <gi...@apache.org> on 2024/07/03 15:00:02 UTC, 1 replies.
- [PR] [SPARK-47046][BUILD][TESTS] Upgrade `mysql-connector-j` to 9.0.0 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/03 16:18:55 UTC, 3 replies.
- Re: [PR] [SPARK-48679] Upgrade checkstyle and spotbugs version [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/03 17:29:16 UTC, 0 replies.
- [PR] [SPARK-48797][SQL] Upgrade `mariadb-java-client` to 3.4.0 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/03 17:59:34 UTC, 0 replies.
- Re: [PR] [SPARK-48767][SQL] Fix some error prompts when `variant` type data is invalid [spark] - posted by "cashmand (via GitHub)" <gi...@apache.org> on 2024/07/03 18:06:57 UTC, 6 replies.
- [PR] [SPARK-48798][PYTHON] Introduce `spark.profile.render` for SparkSession-based profiling [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/07/03 21:24:03 UTC, 5 replies.
- Re: [PR] [SPARK-48613][SQL] SPJ: Support auto-shuffle one side + less join keys than partition keys [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2024/07/03 22:02:38 UTC, 8 replies.
- [PR] [SPARK-48799] Refactor versioning for operator metadata read/write and callers [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/07/03 22:08:40 UTC, 0 replies.
- Re: [PR] [SPARK-48799][SS] Refactor versioning for operator metadata read/write and callers [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/07/03 22:09:21 UTC, 3 replies.
- Re: [PR] [SPARK-48495][SQL][DOCS] Describe shredding scheme for Variant [spark] - posted by "cashmand (via GitHub)" <gi...@apache.org> on 2024/07/03 22:43:35 UTC, 22 replies.
- Re: [PR] [SPARK-48794][CONNECT] df.mergeInto support for Spark Connect (Scala and Python) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/03 23:11:35 UTC, 12 replies.
- Re: [PR] [SPARK-46992]Fix cache consistency [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/04 00:20:13 UTC, 1 replies.
- [PR] Jingz db/virtual col family [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/07/04 00:24:35 UTC, 1 replies.
- [PR] [SPARK-48800] Deflake ClientStreamingQuerySuite [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/07/04 00:31:00 UTC, 0 replies.
- Re: [PR] [SPARK-48703][SQL][TESTS] Upgrade `mssql-jdbc` to 12.6.3.jre11 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/04 00:48:55 UTC, 2 replies.
- [PR] [SPARK-48801][BUILD][K8S] Upgrade `kubernetes-client` to 6.13.1 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/04 01:16:17 UTC, 3 replies.
- [PR] [ONLY TEST][HOLD] Upgrade rocksdbjni to 9.3.1 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/04 01:36:26 UTC, 1 replies.
- Re: [PR] [SPARK-48802][SS] FileStreamSource maxCachedFiles set to 0 causes batch with no files to be processed [spark] - posted by "ragnarok56 (via GitHub)" <gi...@apache.org> on 2024/07/04 01:42:09 UTC, 0 replies.
- [PR] [SPARK-48803][SQL] Throw internal error in Orc(De)serializer to align with ParquetWriteSupport [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/04 02:22:08 UTC, 2 replies.
- [PR] [WIP][SPARK-42204][CORE] Remove redundant logging of TaskMetrics internal accumulators in event logs [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2024/07/04 02:27:16 UTC, 4 replies.
- Re: [PR] [SPARK-48795][BUILD][TESTS] Upgrade `mysql-connector-j` to 9.0.0 [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/04 02:28:57 UTC, 0 replies.
- Re: [PR] [SPARK-48743][SS]MergingSessionIterator should better handle when getStruct returns null [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/07/04 04:00:39 UTC, 0 replies.
- [PR] [SPARK-48804][SQL] Add classIsLoadable & OutputCommitter.isAssignableFrom check for output committer class configrations [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/04 05:48:16 UTC, 4 replies.
- [PR] [WIP] Replace calls to the bridged APIs based on `SparkSession#sqlContext` with the `SparkSession` API [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/04 06:03:23 UTC, 0 replies.
- Re: [PR] [SPARK-46937][SQL] Improve concurrency performance for FunctionRegistry [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2024/07/04 06:41:14 UTC, 0 replies.
- Re: [PR] [SPARK-48805][SQL][ML][SS][AVRO][EXAMPLES] Replace calls to bridged APIs based on `SparkSession#sqlContext` with `SparkSession` API [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/04 07:12:21 UTC, 4 replies.
- Re: [PR] [SPARK-48715][SQL] Integrate UTF8String validation into collation-aware string function implementations [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/07/04 07:27:35 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-48797][SQL] Upgrade `mariadb-java-client` to 3.4.0 [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/04 07:39:31 UTC, 2 replies.
- Re: [PR] [SPARK-39041][SQL] Mapping Spark Query ResultSet/Schema to TRowSet/TTableSchema directly [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2024/07/04 08:51:12 UTC, 1 replies.
- [PR] [SPARK-48754] Refactoring the package names for more clarity and ergonomics [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/07/04 09:02:44 UTC, 2 replies.
- [PR] [SPARK-48806][SQL] Pass actual exception when url_decode fails [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/07/04 09:24:04 UTC, 4 replies.
- [PR] [SPARK-48807][SQL] Binary Support for CSV datasource [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/04 10:59:31 UTC, 10 replies.
- [PR] [SPARK-48808][SQL] Fix NPE when connecting thriftserver through Hive 1.2.1 and the result schema is empty [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/04 11:13:26 UTC, 3 replies.
- [PR] [SPARK-48809][PYTHON][DOCS] Implementing `spark version drop down` of the `PySpark doc site` using embedded version-switcher [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/04 12:04:45 UTC, 3 replies.
- [PR] session stop [spark] - posted by "nija-at (via GitHub)" <gi...@apache.org> on 2024/07/04 13:11:45 UTC, 3 replies.
- [PR] [SPARK-48280][SQL][FOLLOWUP] Improve collation testing surface area using expression walking [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/07/04 13:30:50 UTC, 2 replies.
- Re: [PR] [SPARK-48440][SQL] Fix StringTranslate behaviour for non-UTF8_BINARY collations [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/07/04 14:20:54 UTC, 12 replies.
- Re: [PR] [SPARK-36680][SQL] Supports Dynamic Table Options for Spark SQL [spark] - posted by "huaxingao (via GitHub)" <gi...@apache.org> on 2024/07/04 17:18:24 UTC, 14 replies.
- [PR] [SPARK-48812][CONNECT][TESTS] Add some test suites for `mariadb` jdbc connector [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/04 18:04:35 UTC, 0 replies.
- [PR] [MINOR][SQL][TESTS] Optimize the run tests command in the doc of suites in `docker-integration-tests` module [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/04 18:18:33 UTC, 4 replies.
- [PR] [SPARK-29430] Documented new metric endpoints for Prometheus [spark] - posted by "jerryzhou196 (via GitHub)" <gi...@apache.org> on 2024/07/04 18:20:52 UTC, 0 replies.
- [PR] [SPARK-48813][SQL][DOCS] Add a notice that `mariadb` protocol does not apply when the database is `MariaDB` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/04 19:03:24 UTC, 4 replies.
- [PR] [SPARK-48814][BUILD] Upgrade `tink` to 1.14.0 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/04 19:20:07 UTC, 6 replies.
- [PR] [SPARK-48754] Refactor Channel builder to support other implementations [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/07/04 20:31:12 UTC, 13 replies.
- [PR] [TEST ONLY][MINOR][PYTHON] Eliminating warnings for panda [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/05 02:27:16 UTC, 0 replies.
- Re: [PR] [SPARK-48775][SQL][STS] Replace SQLContext with SparkSession in STS [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/05 02:54:59 UTC, 5 replies.
- Re: [PR] [SPARK-48812][SQL][TESTS] Add some test suites for `mariadb` jdbc connector [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/05 04:07:16 UTC, 2 replies.
- [PR] [SPARK-48815][CONNECT] Update environment when stoping connect session [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2024/07/05 05:29:15 UTC, 4 replies.
- [PR] [SPARK-48817][SQL] Eagerly execute union multi commands together [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/07/05 07:09:52 UTC, 6 replies.
- Re: [PR] [SPARK-48809][PYTHON][DOCS] Reimplemented `spark version drop down` of the `PySpark doc site` and fix bug [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/07/05 07:36:08 UTC, 4 replies.
- [PR] [SPARK-48818][PYTHON] Simplify `percentile` functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/05 07:41:31 UTC, 2 replies.
- Re: [PR] [SPARK-48810][CONNECT] Session stop() API should be idempotent and not fail if the session is already closed by the server. [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/07/05 07:48:40 UTC, 4 replies.
- [PR] [SPARK-48820][SQL][DOC] Correct the examples for Collate functions [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2024/07/05 09:09:16 UTC, 10 replies.
- [PR] [SPARK-48816][SQL] Shorthand for interval converters in UnivocityParser [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/05 09:13:38 UTC, 8 replies.
- [PR] [SPARK-48754][FOLLOW] Fix remaining comments about channel refactoring. [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/07/05 09:19:03 UTC, 1 replies.
- Re: [PR] [SPARK-45873][CORE][YARN][K8S] Make ExecutorFailureTracker more tolerant when app remains sufficient resources [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/05 09:48:57 UTC, 0 replies.
- [PR] [SPARK-48777][BUILD] Properly lint, vet and check for license headers. [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/07/05 10:13:32 UTC, 7 replies.
- [PR] [DOCS][MINOR] Update format_number docstring [spark] - posted by "thomhart31 (via GitHub)" <gi...@apache.org> on 2024/07/05 13:58:59 UTC, 1 replies.
- [PR] [DOCS][MINOR] Update countDistinct docstring with example [spark] - posted by "thomhart31 (via GitHub)" <gi...@apache.org> on 2024/07/05 14:42:39 UTC, 1 replies.
- [PR] [SPARK-48719][SQL][3.5] Fix the calculation bug of RegrSlope & RegrIntercept when the first parameter is null [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/05 14:53:08 UTC, 3 replies.
- [PR] Docstring-lag [spark] - posted by "thomhart31 (via GitHub)" <gi...@apache.org> on 2024/07/05 15:13:54 UTC, 0 replies.
- [PR] [DOCS][MINOR] Adding example to `drop_duplicates` [spark] - posted by "thomhart31 (via GitHub)" <gi...@apache.org> on 2024/07/05 15:48:54 UTC, 2 replies.
- Re: [PR] [MINOR][DOCS] Adding example to `drop_duplicates` [spark] - posted by "thomhart31 (via GitHub)" <gi...@apache.org> on 2024/07/05 17:41:55 UTC, 5 replies.
- Re: [PR] [MINOR][DOCS] Update grammar in pyspark.sql.functions.lag docstring [spark] - posted by "thomhart31 (via GitHub)" <gi...@apache.org> on 2024/07/05 17:41:57 UTC, 0 replies.
- [PR] [SPARK-48821][SQL] Support Update in DataFrameWriterV2 [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2024/07/05 17:43:45 UTC, 24 replies.
- [PR] [MINOR][DOCS] Add example to `countDistinct` [spark] - posted by "thomhart31 (via GitHub)" <gi...@apache.org> on 2024/07/05 17:45:10 UTC, 4 replies.
- [PR] [MINOR][DOCS] Update `format_number` docstring [spark] - posted by "thomhart31 (via GitHub)" <gi...@apache.org> on 2024/07/05 17:45:23 UTC, 0 replies.
- [PR] [MINOR][DOCS] Improve clarity in `lag` docstring [spark] - posted by "thomhart31 (via GitHub)" <gi...@apache.org> on 2024/07/05 17:45:50 UTC, 2 replies.
- Re: [PR] [MINOR][DOCS] Add examples section header to `format_number` docstring [spark] - posted by "thomhart31 (via GitHub)" <gi...@apache.org> on 2024/07/05 17:51:28 UTC, 0 replies.
- [PR] [SPARK-47047] Add changes to support reading transformWithState value state variables [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/07/05 18:28:36 UTC, 0 replies.
- [PR] [SPARK-48592][INFRA] Add structured logging style script and GitHub workflow [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2024/07/05 18:43:29 UTC, 25 replies.
- Re: [PR] [SPARK-48628][CORE] Add task peak on/off heap memory metrics [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2024/07/05 20:02:36 UTC, 20 replies.
- [PR] [SPARK-48825][DOCS] Unify the 'See Also' section formatting across PySpark docstrings [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/07/05 20:15:52 UTC, 3 replies.
- Re: [PR] [WIP][SPARK-48752][PYTHON][CONNECT][DOCS] Introduce `pyspark.logger` for improved structured logging for PySpark [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/07/05 23:03:21 UTC, 3 replies.
- Re: [PR] [MINOR][PYTHON] Eliminating warnings for panda [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/05 23:38:22 UTC, 3 replies.
- Re: [PR] [SPARK-47518][CORE] Skip transfer the last spilled shuffle data [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/06 00:19:36 UTC, 1 replies.
- Re: [PR] [SPARK-46351][SQL] Require an error class in `AnalysisException` [spark] - posted by "huaxingao (via GitHub)" <gi...@apache.org> on 2024/07/06 00:23:47 UTC, 3 replies.
- Re: [PR] [SPARK-48800][CONNECT][SS] Deflake ClientStreamingQuerySuite [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/07/06 03:18:03 UTC, 2 replies.
- [PR] [SPARK-48826]BUILD] Upgrade `fasterxml.jackson` to 2.17.2 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/06 08:54:35 UTC, 3 replies.
- [PR] [SPARK-48177][BUILD][FOLLOWUP] Update parquet version in `sql-data-sources-parquet.md` doc [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/06 09:04:38 UTC, 3 replies.
- [PR] [WIP][SPARK-48827] Upgrade `RoaringBitmap` to 1.2.0 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/06 09:22:00 UTC, 0 replies.
- [PR] Client refactoring [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/07/06 22:19:57 UTC, 0 replies.
- [PR] [SPARK-48828][DOCS][MINOR] Update documentation to add `column` as alias of `col` [spark] - posted by "thomhart31 (via GitHub)" <gi...@apache.org> on 2024/07/06 22:43:44 UTC, 2 replies.
- Re: [PR] [SPARK-47217][SQL] Fix deduplicated expression resolution [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/07 00:22:46 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-24815] [CORE] Trigger Interval based DRA for Structured Streaming [spark] - posted by "sauletawil (via GitHub)" <gi...@apache.org> on 2024/07/07 13:49:20 UTC, 2 replies.
- [PR] Documentation [spark] - posted by "jerryzhou196 (via GitHub)" <gi...@apache.org> on 2024/07/07 21:05:36 UTC, 1 replies.
- [PR] [SPARK-48652][SQL] Fix casting issue in Spark SQL when comparing string column to integer value [spark] - posted by "Zawa-ll (via GitHub)" <gi...@apache.org> on 2024/07/07 21:49:31 UTC, 14 replies.
- Re: [PR] [SPARK-47239][SQL] Support distinct window function [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/08 00:21:40 UTC, 1 replies.
- Re: [PR] [SPARK-48752][PYTHON][CONNECT][DOCS] Introduce `pyspark.logger` for improved structured logging for PySpark [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/07/08 01:01:52 UTC, 49 replies.
- [PR] [SPARK-48829][BUILD] Upgrade `RoaringBitmap` to 1.2.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/08 01:10:44 UTC, 1 replies.
- [PR] [SPARK-48830][BUILD] Upgrade jackson to 2.17.2 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/08 01:35:41 UTC, 3 replies.
- Re: [PR] [SPARK-48827] Upgrade `RoaringBitmap` to 1.2.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/08 02:58:05 UTC, 3 replies.
- Re: [PR] [SPARK-48441][SQL] Fix StringTrim behaviour for non-UTF8_BINARY collations [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/07/08 03:05:26 UTC, 14 replies.
- [PR] [SPARK-48831][PYTHON][CONNECT] Fix the default column name of `cast` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/08 05:09:48 UTC, 0 replies.
- [PR] [SPARK-48832][CONNECT][TESTS] Add dedicated error tests for Spark Connect [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/07/08 05:27:19 UTC, 5 replies.
- [PR] Test sbt 1.10.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/08 06:00:39 UTC, 2 replies.
- Re: [PR] [SPARK-48671][SQL][TESTS] Add test cases for `Hex.hex` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/08 06:01:34 UTC, 0 replies.
- Re: [PR] [SPARK-48772][SS][SQL] State Data Source Change Feed Reader Mode [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/07/08 06:13:13 UTC, 24 replies.
- [PR] [SPARK-48833][SQL][VARIANT] Support variant in `InMemoryTableScan` [spark] - posted by "richardc-db (via GitHub)" <gi...@apache.org> on 2024/07/08 06:44:05 UTC, 4 replies.
- [PR] [SPARK-48834][SQL] Disable variant input/output to scalar UDFs during query compilation [spark] - posted by "richardc-db (via GitHub)" <gi...@apache.org> on 2024/07/08 07:16:12 UTC, 0 replies.
- Re: [PR] [SPARK-48802][SS][FOLLOWUP] FileStreamSource maxCachedFiles set to 0 causes batch with no files to be processed [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/07/08 07:23:42 UTC, 1 replies.
- Re: [PR] [SPARK-48793][SQL][TESTS] Unify v1 and v2 `ALTER TABLE .. `DROP|RENAME` COLUMN[S] ...` tests [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/08 07:34:40 UTC, 2 replies.
- [PR] [SPARK-48760][SQL][FOLLOWUP] Add `CLUSTER BY` to doc `sql-ref-syntax-ddl-alter-table.md` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/08 09:18:34 UTC, 0 replies.
- Re: [PR] [SPARK-48760][SQL][DOCS][TESTS][FOLLOWUP] Add `CLUSTER BY` to doc `sql-ref-syntax-ddl-alter-table.md` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/08 09:36:02 UTC, 0 replies.
- [PR] [WIP][SQL] Scala, Python, and R APIs for string validation functions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/07/08 12:44:35 UTC, 2 replies.
- Re: [PR] [SPARK-29430][DOCS] Documented new metric endpoints for Prometheus [spark] - posted by "jerryzhou196 (via GitHub)" <gi...@apache.org> on 2024/07/08 15:32:10 UTC, 0 replies.
- Re: [PR] [SPARK-48676][INFRA] Structured Logging Framework Scala Style Migration [Part 2] [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2024/07/08 18:05:00 UTC, 0 replies.
- [PR] [SPARK-48623][CORE] Structured logging migrations [Part 2] [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2024/07/08 18:05:30 UTC, 17 replies.
- Re: [PR] [SPARK-48786]Define Config Loading Framework for Spark Operator Controller [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/07/08 18:05:32 UTC, 3 replies.
- [PR] [WIP] Integrate SQL schema with state schema/metadata [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/07/08 18:10:36 UTC, 0 replies.
- Re: [PR] [SPARK-48716] Add jobGroupId to SparkListenerSQLExecutionStart [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2024/07/08 18:16:02 UTC, 2 replies.
- Re: [PR] [SPARK-48666][SQL] Do not push down filter if it contains Unevaluable expression [spark] - posted by "weiatwork (via GitHub)" <gi...@apache.org> on 2024/07/08 18:52:04 UTC, 17 replies.
- Re: [PR] [SPARK-48831][CONNECT] Make default column name of `cast` compatible with Spark Classic [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/07/08 19:00:12 UTC, 3 replies.
- [PR] [SPARK-48837][ML] In CountVectorizer, only read binary parameter once per transform, not once per row [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2024/07/08 20:39:05 UTC, 1 replies.
- Re: [PR] [SPARK-48822][MINOR][DOCS] Add examples section header to `format_number` docstring [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/09 01:24:47 UTC, 1 replies.
- [PR] [ONLY TEST] Sbt 1.10.1 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/09 01:40:58 UTC, 1 replies.
- Re: [PR] [SPARK-48743][SQL][SS] MergingSessionIterator should better handle when getStruct returns null [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/07/09 03:06:43 UTC, 3 replies.
- Re: [PR] [SPARK-13473][SQL] Don't push predicate through project with nondeterministic field(s) [spark] - posted by "wecharyu (via GitHub)" <gi...@apache.org> on 2024/07/09 03:50:17 UTC, 0 replies.
- [PR] [SPARK-48839][SQL] Inject Runtime Filter for multi-level join with function condition [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/07/09 04:06:03 UTC, 1 replies.
- [PR] [MINOR][DOCS] Fix some typos in docs [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/09 05:51:08 UTC, 7 replies.
- [PR] Remove the check for the existence of `./dev/free_disk_space_container` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/09 06:28:46 UTC, 0 replies.
- Re: [PR] [SPARK-48840][INFRA] Remove unnecessary existence check for `./dev/free_disk_space_container` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/09 06:36:55 UTC, 1 replies.
- [PR] [SPARK-48840][INFRA] Remove unnecessary existence check for `./dev/free_disk_space_container` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/09 06:44:13 UTC, 4 replies.
- Re: [PR] [SPARK-48722][K8S] Patch executor pod without optimistic locking [spark] - posted by "dcoliversun (via GitHub)" <gi...@apache.org> on 2024/07/09 07:15:52 UTC, 0 replies.
- Re: [PR] [SPARK-48366][CORE][SQL][CONNECT] Simplify code statements related to `.filter` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/09 07:27:48 UTC, 0 replies.
- Re: [PR] [SPARK-48826][BUILD] Upgrade `fasterxml.jackson` to 2.17.2 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/09 08:01:35 UTC, 2 replies.
- [PR] [SPARK-33902][SQL] Throw error for CREATE TABLE LIKE in V2 tables [spark] - posted by "shardulm94 (via GitHub)" <gi...@apache.org> on 2024/07/09 08:56:23 UTC, 1 replies.
- [PR] [SPARK-48841][SQL] Include `collationName` to `sql()` of `Collate` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/09 09:22:32 UTC, 4 replies.
- Re: [PR] [SPARK-48529][SQL] Introduction of Labels in SQL Scripting [spark] - posted by "dbatomic (via GitHub)" <gi...@apache.org> on 2024/07/09 10:30:16 UTC, 24 replies.
- [PR] [SPARK-48842][PYTHON][DOCS] Document non-determinism of max_by and min_by [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/09 10:30:19 UTC, 1 replies.
- Re: [PR] [SPARK-48243][SQL][HIVE] Support push down char and varchar predicates to Hive Metastore [spark] - posted by "wecharyu (via GitHub)" <gi...@apache.org> on 2024/07/09 10:42:34 UTC, 0 replies.
- Re: [PR] [SPARK-48754] Further refactoring to make the code more stable and accessible [spark-connect-go] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/09 10:51:05 UTC, 1 replies.
- Re: [PR] [SPARK-48763][CONNECT][BUILD] Move connect server and common to builtin module [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/09 10:54:13 UTC, 7 replies.
- [PR] [SPARK-48844][SQL] USE INVALID_EMPTY_LOCATION instead of UNSUPPORTED_DATASOURCE_FOR_DIRECT_QUERY when path is empty [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/09 11:51:48 UTC, 2 replies.
- [PR] [SPARK-48845][SQL] GenericUDF catch exceptions from children [spark] - posted by "jackylee-ch (via GitHub)" <gi...@apache.org> on 2024/07/09 12:51:39 UTC, 32 replies.
- [PR] [SPARK-44728][PYTHON][DOCS] Fix the incorrect naming and missing params in func docs in `builtin.py` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/09 12:58:20 UTC, 6 replies.
- Re: [PR] [SPARK-48760][SQL][DOCS][FOLLOWUP] Add `CLUSTER BY` to doc `sql-ref-syntax-ddl-alter-table.md` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/07/09 13:16:51 UTC, 1 replies.
- Re: [PR] [SPARK-48668][SQL] Support ALTER NAMESPACE ... UNSET PROPERTIES in v2 [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/07/09 13:35:40 UTC, 6 replies.
- [PR] [SPARK-48848][PYTHON][DOCS] Pin 'sphinxcontrib-*' in `dev/requirements.txt` with `sphinx==4.5.0` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/09 14:48:44 UTC, 0 replies.
- [PR] [SPARK-48843] Prevent infinite loop with BindParameters [spark] - posted by "nemanja-boric-databricks (via GitHub)" <gi...@apache.org> on 2024/07/09 15:12:49 UTC, 7 replies.
- Re: [PR] [SPARK-48726][SS] Create the StateSchemaV3 file format, and write this out for the TransformWithStateExec operator [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/07/09 15:30:53 UTC, 9 replies.
- [PR] [SPARK-48388][SQL] Fix SET statement behavior for SQL Scripts [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2024/07/09 16:23:22 UTC, 13 replies.
- Re: [PR] [SPARK-48786] Define Config Loading Framework for Spark Operator Controller [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/09 17:44:56 UTC, 0 replies.
- [PR] [SPARK-48849][SS]Create OperatorStateMetadataV2 for the TransformWithStateExec operator [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/07/09 17:48:14 UTC, 32 replies.
- Re: [PR] [SPARK-46032][CORE] Add jars from default session state into isolated session state for spark connect sessions [spark] - posted by "prabodh1194 (via GitHub)" <gi...@apache.org> on 2024/07/09 18:42:30 UTC, 1 replies.
- Re: [PR] [SPARK-48175][SQL][PYTHON] Store collation information in metadata and not in type for SER/DE [spark] - posted by "gatorsmile (via GitHub)" <gi...@apache.org> on 2024/07/09 20:11:55 UTC, 0 replies.
- Re: [PR] Metrics state v2 [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/07/09 21:05:57 UTC, 0 replies.
- [PR] [SPARK-48850][DOCS][SS][SQL] Add documentation for snapshot related options in State Data Source [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2024/07/09 21:22:43 UTC, 0 replies.
- Re: [PR] [SPARK-48382]Add controller / reconciler module to operator [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/09 21:33:25 UTC, 96 replies.
- [PR] Bump google.golang.org/grpc from 1.64.0 to 1.64.1 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/07/09 22:01:12 UTC, 2 replies.
- Re: [PR] [SPARK-44790][SQL] XML: to_xml implementation and bindings for python, connect and SQL [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/09 22:12:30 UTC, 6 replies.
- [PR] More structured log migration [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2024/07/09 22:25:01 UTC, 0 replies.
- Re: [PR] [SPARK-48623][CORE] Structured logging migrations [Part 3] [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/07/09 22:48:23 UTC, 13 replies.
- [PR] [WIP][SPARK-48851][SQL] Attach full name for `SCHEMA_NOT_FOUND` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/10 02:27:07 UTC, 6 replies.
- Re: [PR] [SPARK-46837] [SPARK-48700] Mode expression for complex types (all collations) [spark] - posted by "GideonPotok (via GitHub)" <gi...@apache.org> on 2024/07/10 02:41:30 UTC, 0 replies.
- Re: [PR] [SPARK-43569][SQL] Remove workaround for HADOOP-14067 [spark] - posted by "rowandavies (via GitHub)" <gi...@apache.org> on 2024/07/10 03:18:40 UTC, 1 replies.
- Re: [PR] [SPARK-48848][PYTHON][DOCS] Pin `sphinxcontrib-*` in `dev/requirements.txt` with `sphinx==4.5.0` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/10 03:19:59 UTC, 4 replies.
- Re: [PR] [SPARK-48822][DOCS] Add examples section header to `format_number` docstring [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/10 04:14:20 UTC, 1 replies.
- Re: [PR] [SPARK-48848][PYTHON][DOCS] Set the upper bound version of `sphinxcontrib-*` in `dev/requirements.txt` with `sphinx==4.5.0` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/10 05:23:07 UTC, 2 replies.
- [PR] [DRAFT][CONNECT] Fix trim function in connect [spark] - posted by "biruktesf-db (via GitHub)" <gi...@apache.org> on 2024/07/10 07:20:36 UTC, 0 replies.
- [PR] [SPARK-48854][DOCS] Add missing options in CSV documentation [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/10 09:02:44 UTC, 2 replies.
- [PR] [SPARK-48855][K8S][TESTS] Make ExecutorPodsAllocatorSuite independent from default allocation batch size [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/10 09:42:03 UTC, 0 replies.
- [PR] [SPARK-48857][SQL] Restrict charsets in CSVOptions [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/10 12:05:21 UTC, 2 replies.
- [PR] [SPARK-48856][SQL] Use isolated JobArtifactSet for each spark session [spark] - posted by "lifulong (via GitHub)" <gi...@apache.org> on 2024/07/10 12:08:40 UTC, 23 replies.
- Re: [PR] [SPARK-48851][SQL] Change the value of `SCHEMA_NOT_FOUND` from `namespace` to `catalog.namespace` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/07/10 12:31:32 UTC, 4 replies.
- Re: [PR] [SPARK-48846][PYTHON][DOCS] Fix the incorrect naming and missing params in func docs in `builtin.py` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/10 13:12:10 UTC, 0 replies.
- [PR] [SPARK-48858][PYTHON] Remove deprecated `setDaemon` method call of `Thread` in `log_communication.py` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/10 13:20:00 UTC, 3 replies.
- Re: [PR] [SPARK-48855][K8S][TESTS] Make `ExecutorPodsAllocatorSuite` independent from default allocation batch size [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/10 14:30:47 UTC, 2 replies.
- Re: [PR] [SPARK-48823][DOCS] Improve clarity in `lag` docstring [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/10 14:37:18 UTC, 3 replies.
- Re: [PR] [SPARK-48828][DOCS] Update documentation to add `column` as alias of `col` [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/10 14:41:45 UTC, 1 replies.
- [PR] [SPARK-48463][ML] Make StringIndexer supporting nested input columns [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2024/07/10 15:39:40 UTC, 11 replies.
- Re: [PR] [SPARK-48835] Introduce versoning to jdbc connectors [spark] - posted by "kostabiz-db (via GitHub)" <gi...@apache.org> on 2024/07/10 16:15:32 UTC, 4 replies.
- Re: [PR] [SPARK-48842][DOCS] Document non-determinism of max_by and min_by [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/07/10 19:03:32 UTC, 3 replies.
- Re: [PR] [SPARK-48834][SQL] Disable variant input/output to python scalar UDFs, UDTFs, UDAFs during query compilation [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/07/10 19:14:13 UTC, 8 replies.
- [PR] [SPARK-48459][CONNECT][PYTHON][FOLLOWUP] Ignore to_plan from with_origin [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/07/10 20:50:31 UTC, 2 replies.
- [PR] Metadata v2 purging [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/07/10 21:37:55 UTC, 1 replies.
- [PR] [SPARK-48860][TESTS] Update `ui-test` to use `ws` 8.18.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/10 21:48:17 UTC, 5 replies.
- Re: [PR] [SPARK-48700] [SQL] Mode expression for complex types (all collations) [spark] - posted by "GideonPotok (via GitHub)" <gi...@apache.org> on 2024/07/10 23:06:36 UTC, 29 replies.
- [PR] [SPARK-48760][SQL] Fix CatalogV2Util.applyClusterByChanges [spark] - posted by "zedtang (via GitHub)" <gi...@apache.org> on 2024/07/10 23:37:32 UTC, 4 replies.
- Re: [PR] [WIP] improve StaticInvoke [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/11 00:21:20 UTC, 1 replies.
- [PR] [SPARK-48862][PYTHON][CONNECT] Avoid calling `_proto_to_string` when INFO level is not enabled [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/07/11 00:29:38 UTC, 2 replies.
- [PR] [SPARK-46743][SQL][FOLLOW UP] Count bug after ScalarSubqery is folded if it has an empty relation [spark] - posted by "andylam-db (via GitHub)" <gi...@apache.org> on 2024/07/11 00:42:53 UTC, 11 replies.
- [PR] [SPARK-48763][FOLLOWUP] Make `dev/lint-scala` error message more accurate [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/11 02:09:45 UTC, 5 replies.
- [PR] [SPARK-48863][SQL] Fix ClassCastException when parsing JSON with "spark.sql.json.enablePartialResults" enabled [spark] - posted by "sadikovi (via GitHub)" <gi...@apache.org> on 2024/07/11 02:50:34 UTC, 3 replies.
- [PR] [SPARK-48864][SQL][TESTS] Refactor `HiveQuerySuite` and fix bug [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/11 03:29:17 UTC, 23 replies.
- [PR] [SPARK-48865][SQL] Add try_url_decode function [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/07/11 05:50:10 UTC, 11 replies.
- [PR] [SPARK-48866][SQL] Fix hints of valid charset in the error message of INVALID_PARAMETER_VALUE.CHARSET [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/11 06:01:33 UTC, 4 replies.
- Re: [PR] [SPARK-47307][SQL] Add a config to optionally chunk base64 strings [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/11 06:41:57 UTC, 33 replies.
- Re: [PR] [SPARK-48850][DOCS][SS][SQL] Add documentation for new options added to State Data Source [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/07/11 06:47:14 UTC, 5 replies.
- [PR] Test guava used by the connect module to 33.2.1-jre [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/11 06:54:12 UTC, 1 replies.
- Re: [PR] [MINOR][DOCS] Add `docs/_generated/` to .gitignore [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/11 07:13:29 UTC, 0 replies.
- [PR] [SPARK-48791][CORE][3.5][3.4] Fix perf regression caused by the accumulators registration overhead using CopyOnWriteArrayList [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2024/07/11 07:33:41 UTC, 1 replies.
- [PR] [MINOR][SQL][TESTS] Remove a duplicate test case in `CSVExprUtilsSuite` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/11 08:11:44 UTC, 2 replies.
- [PR] [WIP][SQL] Table with catalog name [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/11 09:02:34 UTC, 0 replies.
- [PR] [WIP][SQL] JDBCTableCatalog with catalog name [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/11 09:28:12 UTC, 0 replies.
- [PR] [SPARK-48761][SQL] Add clusterBy DataFrame API for Scala [spark] - posted by "zedtang (via GitHub)" <gi...@apache.org> on 2024/07/11 09:32:16 UTC, 0 replies.
- Re: [PR] [SPARK-48852][CONNECT] Fix string trim function in connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/11 09:43:37 UTC, 3 replies.
- Re: [PR] [SPARK-48350][SQL] Introduction of Custom Exceptions for Sql Scripting [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2024/07/11 10:00:43 UTC, 8 replies.
- [PR] [SPARK-46738][PYTHON] Reenable a group of doctests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/11 10:04:25 UTC, 1 replies.
- Re: [PR] [SPARK-48148][CORE] JSON objects should not be modified when read as STRING [spark] - posted by "revans2 (via GitHub)" <gi...@apache.org> on 2024/07/11 13:41:04 UTC, 6 replies.
- [PR] [SPARK-48871] Fix INVALID_NON_DETERMINISTIC_EXPRESSIONS validation in… [spark] - posted by "zhipengmao-db (via GitHub)" <gi...@apache.org> on 2024/07/11 15:07:48 UTC, 9 replies.
- Re: [PR] [SPARK-48791][CORE][3.5] Fix perf regression caused by the accumulators registration overhead using CopyOnWriteArrayList [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/11 15:51:05 UTC, 7 replies.
- Re: [PR] [SPARK-48761][SQL] Introduce clusterBy DataFrame API for Scala [spark] - posted by "zedtang (via GitHub)" <gi...@apache.org> on 2024/07/11 16:50:37 UTC, 0 replies.
- [PR] save some change [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/07/11 17:28:08 UTC, 0 replies.
- [PR] [WIP] State data integration [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/07/11 18:20:05 UTC, 1 replies.
- [PR] [SPARK-48717][FOLLOWUP][PYTHON][SS] Catch Cancelled Job Group wrapped by Py4JJavaError in StreamExecution [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/07/11 18:39:10 UTC, 3 replies.
- [PR] [SPARK-48872] Reduce the overhead of _capture_call_site [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/07/11 22:47:34 UTC, 1 replies.
- Re: [PR] [SPARK-48872][PYTHON] Reduce the overhead of _capture_call_site [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/07/11 22:54:43 UTC, 2 replies.
- [PR] [MINOR][TESTS} Remove unused test jar (udf_noA.jar) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/11 23:37:35 UTC, 0 replies.
- [PR] [SPARK-48873] Use UnsafeRow in JSON parser. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/07/11 23:53:31 UTC, 4 replies.
- Re: [PR] [SPARK-47687][SQL] When creating a table through ThriftServer, set the table owner to the connected user [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/12 00:20:41 UTC, 1 replies.
- Re: [PR] [SPARK-47141][CORE] Support enabling migration of shuffle data directly to external storage using config parameter. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/12 00:20:42 UTC, 1 replies.
- [PR] [SPARK-48874][SQL][DOCKER] Upgrade `MySQL` docker image version to `9.0.0` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/12 00:23:23 UTC, 0 replies.
- Re: [PR] [MINOR][TESTS] Remove unused test jar (udf_noA.jar) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/12 00:37:17 UTC, 10 replies.
- Re: [PR] [SPARK-48874][SQL][DOCKER][BUILD][TESTS] Upgrade `MySQL` docker image version to `9.0.0` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/12 02:04:17 UTC, 2 replies.
- [PR] [SPARK-46654][DOCS][FOLLOW-UP] Remove obsolete TODO item [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/12 02:10:49 UTC, 2 replies.
- Re: [PR] [SPARK-47257][SQL] Assign names to error classes _LEGACY_ERROR_TEMP_105[3-4] and _LEGACY_ERROR_TEMP_1113 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/12 03:28:30 UTC, 1 replies.
- [PR] [SPARK-48875][COMMON] Variant support quick exit in getFieldByKey [spark] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/07/12 04:08:56 UTC, 10 replies.
- [PR] [SPARK-48804][SQL][TESTS][FOLLOWUP] Fix compilation warning `adaptation of an empty argument list by inserting () is deprecated` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/12 06:15:27 UTC, 5 replies.
- Re: [PR] [SPARK-48666][SQL] Do not push down filter if it contains PythonUDFs [spark] - posted by "weiatwork (via GitHub)" <gi...@apache.org> on 2024/07/12 06:15:44 UTC, 11 replies.
- [PR] [SPARK-48877][PYTHON][DOCS] Test the default column name of array functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/12 07:07:56 UTC, 2 replies.
- [PR] [SPARK-48878][PYTHON][DOCS] Add doctests for `options` in json functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/12 07:14:37 UTC, 4 replies.
- [PR] [SPARK-48879][SQL] Expand the charset list with Chinese Standard Charsets [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/12 07:40:30 UTC, 9 replies.
- [PR] [SPARK-48880][CORE] Avoid throw NullPointerException if driver plugin fails to initialize [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2024/07/12 07:52:19 UTC, 9 replies.
- [PR] [SPARK-47911][SQL][FOLLOWUP] Rename UTF8 to UTF-8 in spark.sql.binaryOutputStyle [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/12 08:19:50 UTC, 3 replies.
- Re: [PR] [SPARK-48876][BUILD] Upgrade Guava used by the connect module to 33.2.1-jre [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/12 09:01:48 UTC, 2 replies.
- Re: [PR] [SPARK-44811][BUILD] Upgrade Guava to 33.1.0-jre [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/12 09:05:01 UTC, 0 replies.
- [PR] Update dataframe.py [spark] - posted by "nugget-cloud (via GitHub)" <gi...@apache.org> on 2024/07/12 10:10:39 UTC, 1 replies.
- Re: [PR] [MINOR][DOCS] Update dataframe.py [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/12 10:12:40 UTC, 3 replies.
- [PR] fix can't submit second Spark job on K8S in a process [spark] - posted by "scanry (via GitHub)" <gi...@apache.org> on 2024/07/12 10:22:18 UTC, 1 replies.
- Re: [PR] [SPARK-48756][CONNECT][PYTHON]Support for `df.debug()` in Connect Mode [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/07/12 10:37:30 UTC, 1 replies.
- [PR] [SPARK-47307][SQL][3.5] Add a config to optionally chunk base64 strings [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/07/12 10:49:47 UTC, 15 replies.
- [PR] [WIP][SQL] Implement ASCII fast path in collation support for UTF8_LCASE [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/07/12 11:16:17 UTC, 0 replies.
- [PR] [SPARK-48882][SS] Assign names to streaming output mode related error classes [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/12 12:04:14 UTC, 8 replies.
- [PR] [SPARK-48883][ML] Replace RDD read / write API invocation with Dataframe read / write API [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2024/07/12 12:40:02 UTC, 0 replies.
- [PR] [SPARK-48714][SPARK-48794][FOLLOW-UP][DOCS] Add `mergeInto` to API reference [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/12 12:47:28 UTC, 0 replies.
- [PR] [SPARK-48884][PYTHON] Remove unused helper function `PythonSQLUtils.makeInterval` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/12 13:29:35 UTC, 2 replies.
- [PR] [WIP][SC-170296] GROUP BY with MapType nested inside complex type [spark] - posted by "nebojsa-db (via GitHub)" <gi...@apache.org> on 2024/07/12 14:06:58 UTC, 0 replies.
- Re: [PR] [SPARK-48883][ML][R] Replace RDD read / write API invocation with Dataframe read / write API [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2024/07/12 14:20:48 UTC, 26 replies.
- [PR] [CONNECT][SPARK-45155] Add API Docs for Spark Connect JVM/Scala Client [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/07/12 14:23:06 UTC, 1 replies.
- Re: [PR] [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort stage when committed file not consistent with task status [spark] - posted by "steveloughran (via GitHub)" <gi...@apache.org> on 2024/07/12 16:55:14 UTC, 1 replies.
- [PR] [SPARK-48885][SQL] Make some subclasses of RuntimeReplaceable override replacement to lazy val [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/12 17:21:56 UTC, 6 replies.
- [PR] [SPARK-45161][3.5.x][INFRA] Bump previousSparkVersion to 3.5.0 [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2024/07/12 17:43:55 UTC, 1 replies.
- [PR] Metadata schema compatibility [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/07/12 17:47:32 UTC, 1 replies.
- Re: [PR] [SPARK-45161][3.5][INFRA] Bump previousSparkVersion to 3.5.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/12 18:07:50 UTC, 8 replies.
- Re: [PR] [SPARK-48836] Integrate SQL schema with state schema/metadata [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/07/12 18:18:07 UTC, 26 replies.
- [PR] [SPARK-48886][SS] Add version info to changelog v2 to allow for easier evolution [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/07/12 20:48:44 UTC, 8 replies.
- [PR] [SPARK-48887][K8S] Enable `spark.kubernetes.executor.checkAllContainers` by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/12 20:51:12 UTC, 4 replies.
- Re: [PR] [SPARK-47764][FOLLOW-UP] Change to use ShuffleDriverComponents.removeShuffle to remove shuffle properly [spark] - posted by "abellina (via GitHub)" <gi...@apache.org> on 2024/07/12 21:22:56 UTC, 10 replies.
- [PR] [SPARK-48888] Remove snapshot creation based on changelog ops size [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/07/12 22:15:17 UTC, 0 replies.
- Re: [PR] [SPARK-48888][SS] Remove snapshot creation based on changelog ops size [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/07/12 22:16:08 UTC, 2 replies.
- [PR] [SPARK-48889][SS] testStream to unload state stores before finishing [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2024/07/12 22:29:01 UTC, 4 replies.
- [PR] [SPARK-48890][CORE][SS] Add Structured Streaming related fields to log4j ThreadContext [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/07/13 00:04:06 UTC, 8 replies.
- Re: [PR] [SPARK-47703][SQL] Modify the simpleString of DataSourceV2ScanRelation to distinguish it from DataSourceV2Relation [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/13 00:21:08 UTC, 1 replies.
- Re: [PR] [SPARK-47688][CORE] Support `three` methods of the log `concatenation` in the `structured logging framework` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/13 00:21:10 UTC, 1 replies.
- [PR] [SPARK-48883][ML][R][FOLLOW-UP] Avoid repartition when writing out the SparkR metadata [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/13 03:19:53 UTC, 0 replies.
- Re: [PR] [SPARK-21195][CORE] Dynamically register metrics from sources as they are reported [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/14 00:23:20 UTC, 2 replies.
- Re: [PR] [SPARK-27950][DSTREAM] Configurable dynamodb url so kinesis-asl works with localstack [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/14 00:23:23 UTC, 1 replies.
- [PR] [SPARK-48892][ML] Avoid per-row param read in `Tokenizer` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/14 11:50:56 UTC, 3 replies.
- [PR] [SPARK-48893][SQL][DOCS] Add some examples for `linearRegression` built-in functions [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/14 16:16:13 UTC, 3 replies.
- [PR] [SPARK-48894][TESTS] Upgrade `docker-java` to 3.4.0 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/14 16:24:00 UTC, 2 replies.
- [PR] [SPARK-44728][PYTHON][DOCS][FOLLOWUP] Add a missing param doc in python api `partitioning` functions docs. [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/14 16:53:42 UTC, 0 replies.
- [PR] [SPARK-XXXX]Adding `column` and `functions` packages. [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/07/14 21:16:09 UTC, 0 replies.
- [PR] [SPARK-48895][R][INFRA] Use R 4.4.1 in `windows` R GitHub Action job [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/14 21:18:04 UTC, 3 replies.
- Re: [PR] [SPARK-48714][SPARK-48794][FOLLOW-UP][PYTHON][DOCS] Add `mergeInto` to API reference [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/14 23:31:15 UTC, 1 replies.
- [PR] [SPARK-48896][ML][MLLIB] Avoid repartition when writing out the metadata [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/14 23:45:25 UTC, 11 replies.
- Re: [PR] [SPARK-47702][CORE] Remove Shuffle service endpoint from the locations list when RDD block is removed form a node. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/15 00:21:55 UTC, 3 replies.
- Re: [PR] [SPARK-48873][SQL] Use UnsafeRow in JSON parser. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/15 02:51:48 UTC, 10 replies.
- [PR] [SPARK-48791][CORE][3.4] Fix perf regression caused by the accumulators registration overhead using CopyOnWriteArrayList [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2024/07/15 03:50:58 UTC, 4 replies.
- [PR] [DO-NOT-MERGE][SQL] Reduce the number of shuffles in SQL in local mode [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/15 05:10:41 UTC, 9 replies.
- Re: [PR] [SPARK-48505][CORE] Simplify the implementation of `Utils#isG1GC` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/15 05:24:46 UTC, 7 replies.
- Re: [PR] [SPARK-43861][CORE] Do not delete inprogress log [spark] - posted by "bluzy (via GitHub)" <gi...@apache.org> on 2024/07/15 05:46:53 UTC, 0 replies.
- [PR] [MINOR][CORE] Fix compilation warning `adaptation of an empty argument list by inserting () is deprecated` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/15 05:55:04 UTC, 9 replies.
- [PR] [SPARK-48881][SQL] Some dynamic partitions can be compensated to specific partition values [spark] - posted by "fusheng-rd (via GitHub)" <gi...@apache.org> on 2024/07/15 08:58:22 UTC, 10 replies.
- Re: [PR] [MINOR][SQL][TESTS] Fix compilation warning `adaptation of an empty argument list by inserting () is deprecated` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/15 09:11:27 UTC, 2 replies.
- [PR] [SPARK-47172][DOCS][FOLLOWUP] Fix spark.network.crypto.ciphersince version field on security page [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/15 10:28:26 UTC, 7 replies.
- [PR] [WIP][Draft] Assign name for error _LEGACY_ERROR_TEMP_2232 [spark] - posted by "junyuc25 (via GitHub)" <gi...@apache.org> on 2024/07/15 10:39:02 UTC, 0 replies.
- [PR] [SPARK-48897][PYTHON][CONNECT] Make `from_xml` support StructType schema [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/15 11:40:17 UTC, 4 replies.
- [PR] [WIP][SPARK-48353][SQL] Introduction of error handling mechanism in SQL Scripting [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2024/07/15 12:19:31 UTC, 0 replies.
- Re: [PR] [SC-170296] GROUP BY with MapType nested inside complex type [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/07/15 12:47:58 UTC, 15 replies.
- [PR] [SPARK-48899][K8S] Fix `ENV` key value format in K8s Dockerfiles [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/15 16:42:21 UTC, 7 replies.
- [PR] Sql integration schema [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/07/15 19:33:39 UTC, 1 replies.
- [PR] [SPARK-48891] Refactor StateSchemaCompatibilityChecker to unify all state schema formats [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/07/15 20:29:26 UTC, 0 replies.
- [PR] [SPARK-48861][SQL] Enable shuffle file removal/skipMigration for all SQL executions [spark] - posted by "abellina (via GitHub)" <gi...@apache.org> on 2024/07/15 20:35:11 UTC, 4 replies.
- [PR] [SPARK-48900] Add `reason` field for `cancelJobGroup` and `cancelJobsWithTag` [spark] - posted by "mingkangli-db (via GitHub)" <gi...@apache.org> on 2024/07/15 23:09:09 UTC, 13 replies.
- [PR] [SPARK-48902][BUILD] Upgrade `commons-codec` to 1.17.1 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/15 23:36:29 UTC, 1 replies.
- Re: [PR] [SPARK-45155][CONNECT] Add API Docs for Spark Connect JVM/Scala Client [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/16 00:05:24 UTC, 1 replies.
- Re: [PR] [SPARK-47602][CORE][K8S][FOLLOWUP] Improve structure logging for isExecutorIdleTimedOut [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/16 00:20:57 UTC, 1 replies.
- [PR] [SPARK-48903][SS] Set the RocksDB last snapshot version correctly on remote load [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/07/16 00:27:42 UTC, 8 replies.
- Re: [PR] [SPARK-47172][DOCS][FOLLOWUP] Fix spark.network.crypto.cipher since version field on security page [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/16 02:33:49 UTC, 0 replies.
- [PR] [SPARK-48906][SQL] Introduce `SHOW COLLATIONS LIKE ...` syntax to show all collations [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/16 03:17:49 UTC, 18 replies.
- Re: [PR] [SPARK-42307] Assign name for error _LEGACY_ERROR_TEMP_2232 [spark] - posted by "junyuc25 (via GitHub)" <gi...@apache.org> on 2024/07/16 03:34:16 UTC, 0 replies.
- Re: [PR] [SPARK-48846][PYTHON][DOCS][FOLLOWUP] Add a missing param doc in python api `partitioning` functions docs. [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/16 05:14:49 UTC, 4 replies.
- Re: [PR] [SPARK-45190][SPARK-48897][PYTHON][CONNECT] Make `from_xml` support StructType schema [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/16 05:21:09 UTC, 1 replies.
- [PR] [SPARK-48907][SQL] Fix the value `explicitTypes` in `COLLATION_MISMATCH.EXPLICIT` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/16 08:34:33 UTC, 4 replies.
- Re: [PR] [SPARK-48761][SQL] Introduce clusterBy DataFrameWriter API for Scala [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/07/16 08:56:56 UTC, 19 replies.
- [PR] [SPARK-48909][ML][MLlib] Uses SparkSession over SparkContext when writing metadata [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/16 09:57:43 UTC, 0 replies.
- [PR] [SPARK-48910] Use HashSet to avoid linear searches in PreprocessTableCreation [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/07/16 10:30:21 UTC, 3 replies.
- [PR] [SPARK-48510] Fix for UDAF `toColumn` API when running tests in Maevn [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/07/16 11:24:52 UTC, 0 replies.
- [PR] [ONLY TEST][SQL] Improve TPCDSCollationQueryTestSuite [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/16 11:48:13 UTC, 4 replies.
- [PR] [SPARK-36680][SQL][FOLLOWUP] Files with options should be put into resolveDataSource function [spark] - posted by "logze (via GitHub)" <gi...@apache.org> on 2024/07/16 12:37:11 UTC, 10 replies.
- [PR] [SPARK-47307][DOCS][FOLLOWUP] Add a migration guide for the behavior change of base64 function [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/07/16 13:10:41 UTC, 6 replies.
- Re: [PR] [SPARK-48510] Fix for UDAF `toColumn` API when running tests in Maven [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/16 15:55:01 UTC, 1 replies.
- Re: [PR] [SPARK-48909][ML][MLLIB] Uses SparkSession over SparkContext when writing metadata [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/16 16:00:58 UTC, 0 replies.
- [PR] [WIP][SPARK-48911] Improve collation support testing for various expressions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/07/16 16:39:35 UTC, 0 replies.
- [PR] add possibility to set log filename & disable spark log rotation [spark] - posted by "Tocard (via GitHub)" <gi...@apache.org> on 2024/07/16 18:08:19 UTC, 3 replies.
- Re: [PR] Corrected row index usage when exploding packed arrays in vectorized reader [spark] - posted by "djspiewak (via GitHub)" <gi...@apache.org> on 2024/07/16 19:36:06 UTC, 0 replies.
- [PR] [WIP] [SPARK-48900] Add `reason` field for all internal calls for job/stage cancellation [spark] - posted by "mingkangli-db (via GitHub)" <gi...@apache.org> on 2024/07/16 19:37:27 UTC, 1 replies.
- [PR] [SPARK-48914][SQL] Add OFFSET operator as an option in the subquery generator [spark] - posted by "averyqi-db (via GitHub)" <gi...@apache.org> on 2024/07/16 20:39:11 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-42204][CORE] Add option to disable redundant logging of TaskMetrics internal accumulators in event logs [spark] - posted by "rednaxelafx (via GitHub)" <gi...@apache.org> on 2024/07/16 20:46:11 UTC, 0 replies.
- [PR] [WIP][SPARK-48901][SQL] Introduce clusterBy DataStreamWriter API for Scala [spark] - posted by "chirag-s-db (via GitHub)" <gi...@apache.org> on 2024/07/16 22:33:05 UTC, 0 replies.
- [PR] [SPARK-48917][BUILD] Upgrade tink to 1.14.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/16 23:22:56 UTC, 4 replies.
- Re: [PR] [SPARK-47649][SQL] Make the parameter `inputs` of the function `[csv|parquet|orc|json|text|xml](paths: String*)` non empty [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/17 00:21:11 UTC, 1 replies.
- Re: [PR] [ONLY TEST][SPARK-48917][BUILD] Upgrade tink to 1.14.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/17 01:00:53 UTC, 2 replies.
- Re: [PR] [SPARK-48510][CONNECT][FOLLOW-UP] Fix for UDAF `toColumn` API when running tests in Maven [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/07/17 01:39:00 UTC, 2 replies.
- [PR] [SPARK-48919][CONNECT] Move connect code generation and dependency management to a separate project [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/07/17 01:49:32 UTC, 24 replies.
- [PR] [SPARK-48920][BUILD][3.5] Upgrade ORC to 1.9.4 [spark] - posted by "williamhyun (via GitHub)" <gi...@apache.org> on 2024/07/17 02:13:21 UTC, 4 replies.
- [PR] [SPARK-48921][SQL] ScalaUDF in subquery should run through analyzer [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2024/07/17 02:32:17 UTC, 24 replies.
- [PR] [SPARK-48922][SQL] Optimize complex type insertion performance [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/07/17 03:09:09 UTC, 0 replies.
- [PR] [MINOR][SQL] Fix CollationFactorySuite [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/17 03:31:12 UTC, 2 replies.
- Re: [PR] [SPARK-48396] Support configuring max cores can be used for SQL [spark] - posted by "yabola (via GitHub)" <gi...@apache.org> on 2024/07/17 03:32:59 UTC, 0 replies.
- Re: [PR] [SPARK-48923][SQL][TESTS] Fix the incorrect logic of `CollationFactorySuite` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/17 03:38:00 UTC, 4 replies.
- [PR] add possibility to set log filename & disable spark log rotation #47373 [spark] - posted by "Tocard (via GitHub)" <gi...@apache.org> on 2024/07/17 07:04:21 UTC, 3 replies.
- Re: [PR] [SPARK-48910][SQL] Use HashSet to avoid linear searches in PreprocessTableCreation [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/17 08:29:16 UTC, 3 replies.
- Re: [PR] [SPARK-48910][SQL] Use HashSet/HashMap to avoid linear searches in PreprocessTableCreation [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/07/17 11:55:26 UTC, 18 replies.
- [PR] [SPARK-48924][PS] Add a pandas-like `make_interval` helper function [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/17 12:07:36 UTC, 6 replies.
- [PR] [SPARK-48915][SQL][TESTS] Add some covered predicates(!=, <=, >, >=) in test cases of `GeneratedSubquerySuite` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/17 12:37:26 UTC, 0 replies.
- Re: [PR] [SPARK-48915][SQL][TESTS] Add some uncovered predicates(!=, <=, >, >=) in test cases of `GeneratedSubquerySuite` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/17 14:15:58 UTC, 10 replies.
- [PR] manual while loop [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/07/17 15:24:34 UTC, 0 replies.
- [PR] [SPARK-48503] Allow grouping on expressions in scalar subqueries, if they are bound to outer rows [spark] - posted by "agubichev (via GitHub)" <gi...@apache.org> on 2024/07/17 15:35:52 UTC, 1 replies.
- Re: [PR] [SPARK-48510][CONNECT][FOLLOW-UP-MK2] Fix for UDAF `toColumn` API when running tests in Maven [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/07/17 15:46:07 UTC, 5 replies.
- [PR] [SPARK-48926][SQL][TESTES] Use `checkError` method to optimize exception check logic related to `UNRESOLVED_COLUMN` error classes [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/17 16:02:27 UTC, 0 replies.
- [PR] [SPARK-48927][CORE] Show the total number of cached RDDs in `StoragePage` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/17 16:44:43 UTC, 0 replies.
- [PR] [SPARK-48928] Log Warning for Calling .unpersist() on Locally Checkpointed RDDs [spark] - posted by "mingkangli-db (via GitHub)" <gi...@apache.org> on 2024/07/17 18:01:19 UTC, 9 replies.
- Re: [PR] [SPARK-48927][CORE] Show the number of cached RDDs in `StoragePage` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/17 18:15:21 UTC, 4 replies.
- Re: [PR] [MINOR][DOCS] Fix values argument docstring at DataFrame.melt and unpivot [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/07/17 18:28:44 UTC, 1 replies.
- [PR] [SPARK-48930][CORE] Redact `awsAccessKeyId` by including `accesskey` pattern [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/17 19:33:08 UTC, 7 replies.
- [PR] [SPARK-48931][SS] Reduce Cloud Store List API cost for state store maintenance task [spark] - posted by "riyaverm-db (via GitHub)" <gi...@apache.org> on 2024/07/17 21:49:06 UTC, 20 replies.
- [PR] migrate file appender [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2024/07/17 22:40:44 UTC, 0 replies.
- [PR] [SPARK-48758][Core] Race condition between executor registration and heartbeat [spark] - posted by "miaoever (via GitHub)" <gi...@apache.org> on 2024/07/17 23:14:34 UTC, 1 replies.
- [PR] [SPARK-48932][BUILD] Upgrade `commons-lang3` to 3.15.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/18 00:06:32 UTC, 3 replies.
- Re: [PR] [SPARK-48926][SQL][TESTS] Use `checkError` method to optimize exception check logic related to `UNRESOLVED_COLUMN` error classes [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/18 00:36:19 UTC, 2 replies.
- Re: [PR] [SPARK-48623][CORE] Migrate FileAppender logs to structured logging [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/18 00:55:22 UTC, 2 replies.
- Re: [PR] [SPARK-48921][SQL] ScalaUDF encoders in subquery should be resolved for MergeInto [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2024/07/18 01:11:55 UTC, 17 replies.
- [PR] [SPARK-48933][BUILD] Upgrade `protobuf-java` to `3.25.3` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/18 01:17:00 UTC, 2 replies.
- [PR] [SPARK-48934][SS] Python datetime types converted incorrectly for setting timeout in applyInPandasWithState [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2024/07/18 02:33:33 UTC, 6 replies.
- [PR] [SPARK-48915][SQL][TESTS][FOLLOWUP] Add some uncovered predicates(!=, <, <=, >, >=) for correlation in `GeneratedSubquerySuite` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/18 04:11:08 UTC, 3 replies.
- [PR] [MINOR][SQL][TESTS] Enable test case `testOrcAPI` in `JavaDataFrameReaderWriterSuite` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/18 04:58:16 UTC, 2 replies.
- Re: [PR] [SPARK-48922][SQL] Optimize nested data type insertion performance [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/07/18 05:08:26 UTC, 0 replies.
- [PR] [SPARK-48935][SQL] Restrictions on`collatinId` should be added to the constructor of `StringType` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/18 08:39:36 UTC, 9 replies.
- [PR] [SPARK-48936][CONNECT] Makes spark-shell works with Spark connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/18 11:49:15 UTC, 8 replies.
- Re: [PR] [SPARK-48893][SQL][PYTHON][DOCS] Add some examples for `linearRegression` built-in functions [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/18 12:06:19 UTC, 6 replies.
- [PR] [WIP][SPARK-][SQL] SQL API change to support execution of compound statements [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2024/07/18 12:51:16 UTC, 16 replies.
- [PR] [SPARK-48338][SQL] Check variable declarations [spark] - posted by "momcilomrk-db (via GitHub)" <gi...@apache.org> on 2024/07/18 13:55:48 UTC, 24 replies.
- Re: [PR] [SPARK-48901][SPARK-48916][STREAMING][PYTHON] Introduce clusterBy DataStreamWriter API [spark] - posted by "chirag-s-db (via GitHub)" <gi...@apache.org> on 2024/07/18 18:19:02 UTC, 5 replies.
- Re: [PR] [SPARK-42307][SQL] Assign name for error _LEGACY_ERROR_TEMP_2232 [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/07/18 18:30:01 UTC, 5 replies.
- [PR] [SPARK-48929] Fix view internal error and clean up parser exception context [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2024/07/18 19:00:51 UTC, 7 replies.
- Re: [PR] [SPARK-48891][SS] Refactor StateSchemaCompatibilityChecker to unify all state schema formats [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/07/18 20:05:57 UTC, 19 replies.
- [PR] [SPARK-48921][SQL][3.5] ScalaUDF encoders in subquery should be resolved for MergeInto [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2024/07/18 20:11:24 UTC, 8 replies.
- Re: [PR] [SPARK-48914][SQL][TESTS] Add OFFSET operator as an option in the subquery generator [spark] - posted by "andylam-db (via GitHub)" <gi...@apache.org> on 2024/07/18 21:01:23 UTC, 3 replies.
- [PR] Fix Table Markdown in Shredding.md [spark] - posted by "RussellSpitzer (via GitHub)" <gi...@apache.org> on 2024/07/18 22:00:05 UTC, 0 replies.
- [PR] [SPARK-48938][PYTHON] Improve error messages when registering Python UDTFs [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/07/18 23:32:50 UTC, 3 replies.
- Re: [PR] [SPARK-48495][DOCS][FOLLOW-UP] Fix Table Markdown in Shredding.md [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/18 23:32:59 UTC, 1 replies.
- Re: [PR] [SPARK-48900] Add `reason` field for all internal calls for job/stage cancellation [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2024/07/18 23:58:36 UTC, 20 replies.
- [PR] [SPARK-48940][BUILD] Upgrade `Arrow` to 17.0.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/19 00:55:13 UTC, 3 replies.
- Re: [PR] [WIP][SPARK-47758][BUILD] Upgrade commons-collections4 to 4.5.0-M1 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/19 01:10:39 UTC, 1 replies.
- [PR] [SPARK-47307][SQL][FOLLOWUP] Change the default value of `spark.sql.legacy.chunkBase64String.enabled` to true [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/07/19 02:21:23 UTC, 5 replies.
- [PR] [SPARK-48941] PysparkML: Replace RDD read / write API invocation with Dataframe read / write API [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2024/07/19 03:00:04 UTC, 0 replies.
- [PR] [SPARK-48498][SQL][FOLLOWUP] do padding for char-char comparison [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/07/19 03:14:08 UTC, 7 replies.
- Re: [PR] [SPARK-47307][SQL][FOLLOWUP] Promote spark.sql.legacy.chunkBase64String.enabled from a legacy/internal config to a regular/public one [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/07/19 03:20:47 UTC, 9 replies.
- [PR] [SPARK-48934][SS][3.4] Python datetime types converted incorrectly for setting timeout in applyInPandasWithState [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/07/19 04:10:40 UTC, 3 replies.
- [PR] [SPARK-48943][TESTS] Upgrade `h2` to 2.3.230 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/19 06:19:14 UTC, 5 replies.
- [PR] [SPARK-48944][CONNECT] Unify the JSON-format schema handling in Connect Server [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/19 07:25:29 UTC, 5 replies.
- Re: [PR] [SPARK-48941][PYTHON][ML] Replace RDD read / write API invocation with Dataframe read / write API [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/19 07:34:19 UTC, 3 replies.
- [PR] [SPARK-47307][SQL][FOLLOWUP][3.5] Promote spark.sql.legacy.chunkBase64String.enabled from a legacy/internal config to a regular/public one [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/07/19 08:16:12 UTC, 3 replies.
- [PR] [SPARK-48945][PYTHON] Simplify a group of function with `lit` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/19 08:28:07 UTC, 0 replies.
- Re: [PR] [SPARK-47148][SQL] Avoid to materialize AQE ExchangeQueryStageExec on the cancellation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/07/19 09:11:52 UTC, 5 replies.
- [PR] [SPARK-48946][SQL] NPE in redact method when session is null [spark] - posted by "mikoszilard (via GitHub)" <gi...@apache.org> on 2024/07/19 09:17:54 UTC, 3 replies.
- Re: [PR] [SPARK-40708][SQL][WIP] Auto update partition statistics based on write metrics [spark] - posted by "melin (via GitHub)" <gi...@apache.org> on 2024/07/19 09:32:56 UTC, 0 replies.
- [PR] [SPARK-48947][SQL] Use lowercased charset name to decrease cache missing in Charset.forName [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/19 09:43:02 UTC, 2 replies.
- [PR] [WIP] Assign better name for errors _LEGACY_ERROR_TEMP_1172, _LEGACY_ERROR_TEMP_1173, and _LEGACY_ERROR_TEMP_1174 [spark] - posted by "junyuc25 (via GitHub)" <gi...@apache.org> on 2024/07/19 10:06:16 UTC, 0 replies.
- [PR] [WIP][SPARK-48948][SQL] Introduce `SHOW VARIABLES LIKE ... ` SQL syntax to get variables [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/19 11:49:00 UTC, 1 replies.
- [PR] [WIP] POC for handlers inside iterator [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2024/07/19 12:25:54 UTC, 0 replies.
- Re: [PR] [SPARK-31561][SQL] Add QUALIFY clause [spark] - posted by "uplsh580 (via GitHub)" <gi...@apache.org> on 2024/07/19 13:39:43 UTC, 1 replies.
- Re: [PR] [SPARK-47261][SQL] Assign better name for errors _LEGACY_ERROR_TEMP_1172, _LEGACY_ERROR_TEMP_1173, and _LEGACY_ERROR_TEMP_1174 [spark] - posted by "junyuc25 (via GitHub)" <gi...@apache.org> on 2024/07/19 15:19:42 UTC, 1 replies.
- [PR] [SPARK-48939][AVRO] Support reading Avro with recursive schema reference [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2024/07/19 17:14:20 UTC, 16 replies.
- Re: [PR] [SPARK-48943][TESTS] Upgrade `h2` to 2.3.230 and enhance the test coverage of behavior changes of `asin` and `acos` complying Standard SQL [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/19 17:44:12 UTC, 10 replies.
- [PR] [SPARK-48949][SQL] SPJ: Runtime partition filtering [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2024/07/19 21:45:44 UTC, 1 replies.
- Re: [PR] [SPARK-48951]Adding `column` and `functions` packages. [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/07/19 22:16:38 UTC, 1 replies.
- Re: [PR] [SPARK-48753] Upgrade arrow to v16 [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/07/19 22:18:43 UTC, 0 replies.
- Re: [PR] [SPARK-48753] Upgrade arrow to v17 [spark-connect-go] - posted by "ptxmac (via GitHub)" <gi...@apache.org> on 2024/07/19 22:27:58 UTC, 0 replies.
- [PR] [SPARK-48952] Use `BasePluginExtension` in `spark-operator/build.gradle` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/19 23:02:48 UTC, 5 replies.
- [PR] [SPARK-48953] Upgrade Gradle to 8.9 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/19 23:15:57 UTC, 3 replies.
- Re: [PR] [SPARK-47995][PYTHON][INFRA][TESTS] Upgrade `pyarrow` to 16.0.0 in GitHub Action CI [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/19 23:21:36 UTC, 0 replies.
- Re: [PR] [SPARK-47230] [SQL] Push projection through Filter-> Generate [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/20 00:20:30 UTC, 1 replies.
- Re: [PR] [SPARK-47759][CORE] Make the critical path like RpcUtils$.askRpcTimeout less fragile [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/20 00:20:31 UTC, 1 replies.
- Re: [PR] [SPARK-48945][PYTHON] Simplify regex functions with `lit` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/20 00:52:46 UTC, 1 replies.
- [PR] [SPARK-48954] try_mod() replaces try_remainder() [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2024/07/20 01:01:46 UTC, 2 replies.
- [PR] Insert Into Statement improvement [spark] - posted by "costas-db (via GitHub)" <gi...@apache.org> on 2024/07/20 02:37:12 UTC, 1 replies.
- [PR] [MINOR][PYTHON] Fix type hint for `from_utc_timestamp` and `to_utc_timestamp` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/20 06:14:20 UTC, 2 replies.
- [PR] [SPARK-48955][SQL] `ArrayCompact`'s datatype should be `containsNull = false` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/20 08:17:16 UTC, 2 replies.
- Re: [PR] [SPARK-47639] Support codegen for json_tuple. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/21 00:23:13 UTC, 1 replies.
- [PR] [SPARK-48957][SS] Return sub-classified error class on state store load for hdfs and rocksdb provider [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/07/21 20:54:31 UTC, 4 replies.
- Re: [PR] [WIP] Refactor of collation aware string functions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/22 00:22:06 UTC, 1 replies.
- [PR] [SPARK-48958][BUILD] Upgrade `zstd-jni` to 1.5.6-4 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/22 00:24:15 UTC, 5 replies.
- [PR] [SPARK-48959][SQL] Make `NoSuchNamespaceException` extend `NoSuchDatabaseException` to restore the exception handling [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/22 00:59:53 UTC, 4 replies.
- [PR] [SPARK-48936][CONNECT] Makes spark-submit works with Spark connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/22 01:22:10 UTC, 6 replies.
- [PR] [MINOR][TESTS][DOCS] Fix some typos in `LZFBenchmark` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/22 04:26:29 UTC, 0 replies.
- [PR] [SPARK-48961][PYTHON] Make the parameter naming of `PySparkException` consistent with JVM [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/07/22 04:55:06 UTC, 8 replies.
- [PR] [SPARK-48752][FOLLOWUP][PYTHON][DOCS] Use explicit name for line number in log [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/07/22 05:30:07 UTC, 6 replies.
- [PR] [WIP][INFRA] Make dropdown for workflows/benchmark input parameters [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/22 06:42:17 UTC, 0 replies.
- Re: [PR] [MINOR][DOCS] Fix some typos in `LZFBenchmark` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/22 07:07:04 UTC, 1 replies.
- Re: [PR] [SPARK-48962][INFRA] Make the input parameters of `workflows/benchmark` selectable [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/22 07:16:45 UTC, 3 replies.
- Re: [PR] [SPARK-47172][CORE] Add support for AES-GCM for RPC encryption [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/22 07:58:43 UTC, 0 replies.
- Re: [PR] [SPARK-43301][CORE][SHUFFLE] BlockStoreClient getHostLocalDirs RPC supports IOException retry [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/07/22 09:01:28 UTC, 2 replies.
- [PR] [SPARK-44884][Core] Create _SUCCESS marker file for spark write with … [spark] - posted by "anikakelhanka (via GitHub)" <gi...@apache.org> on 2024/07/22 09:14:48 UTC, 0 replies.
- [PR] [SPARK-48963][INFRA] Support JIRA_ACCESS_TOKEN in translate-contributors.py [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/22 10:28:09 UTC, 1 replies.
- [PR] [MINOR] Add more know translations for contributors [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/22 10:51:14 UTC, 0 replies.
- [PR] [WIP][SPARK-48346][SQL] Support for IF ELSE statements in SQL scripts [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2024/07/22 12:09:28 UTC, 1 replies.
- Re: [PR] [SPARK-48911][SQL][TESTS] Improve collation support testing for various expressions [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2024/07/22 12:28:41 UTC, 0 replies.
- [PR] Add interface which prevents DataSourceV2Strategy to do planning for scan nodes [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2024/07/22 12:43:59 UTC, 2 replies.
- Re: [PR] [SPARK-48344][SQL] SQL API change to support execution of compound statements [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2024/07/22 13:44:11 UTC, 18 replies.
- [PR] [WIP][SQL] Optimize string searching under UTF8_LCASE collation [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/07/22 14:22:45 UTC, 0 replies.
- Re: [PR] [SPARK-48963][INFRA] Support `JIRA_ACCESS_TOKEN` in translate-contributors.py [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/22 15:59:17 UTC, 1 replies.
- Re: [PR] [SPARK-20144] Allow reading files in order with spark.sql.files.allowReordering=false [spark] - posted by "tonyye (via GitHub)" <gi...@apache.org> on 2024/07/22 16:53:31 UTC, 1 replies.
- [PR] [wip]Metadata vcf [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/07/22 18:04:36 UTC, 1 replies.
- [PR] [SPARK-48966][SQL] Improve error message with invalid unresolved column reference in UDTF call [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/07/22 19:06:34 UTC, 2 replies.
- [PR] State source value [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/07/22 19:09:48 UTC, 1 replies.
- [PR] New value state [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/07/22 19:21:50 UTC, 1 replies.
- Re: [PR] [MINOR][INFRA] Add more know translations for contributors [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/22 19:26:12 UTC, 1 replies.
- [PR] State data integration [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/07/22 19:34:53 UTC, 0 replies.
- [PR] [SPARK-45787][SQL] Support Catalog.listColumns for clustering columns [spark] - posted by "zedtang (via GitHub)" <gi...@apache.org> on 2024/07/22 19:39:10 UTC, 4 replies.
- [PR] [SPARK-48762] Introduce clusterBy DataFrameWriter API for Python [spark] - posted by "zedtang (via GitHub)" <gi...@apache.org> on 2024/07/22 19:55:44 UTC, 1 replies.
- [PR] [SPARK-48968] Avoid unnecessary task configuration in `spark-operator-api` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/22 21:57:49 UTC, 2 replies.
- [PR] [SPARK-48969] Fix `spark-operator` module to define test framework explicitly [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/22 23:18:43 UTC, 3 replies.
- Re: [PR] [SPARK-48400][CORE]Promote `PrometheusServlet` to `DeveloperApi` [spark] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/07/22 23:35:06 UTC, 0 replies.
- [PR] [SPARK-48971] Ban `org.apache.commons.collections` in favor of `collections4` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/23 00:38:29 UTC, 3 replies.
- [PR] [SPARK-48970] Avoid using SparkSession.getActiveSession in spark ML reader/writer [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2024/07/23 00:39:23 UTC, 0 replies.
- [PR] [SPARK-48972][PYTHON] Unify the literal string handling in functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/23 01:57:41 UTC, 2 replies.
- [PR] [TEST janino] v3.1.12 VS v3.1.9 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/23 03:26:08 UTC, 7 replies.
- Re: [PR] [NEED-REBASE][SPARK-47047] TransformWithState integration with statedata source integration - Value State [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/07/23 04:50:52 UTC, 3 replies.
- [PR] [MINOR][DOC] Fix window function docs [spark] - posted by "wecharyu (via GitHub)" <gi...@apache.org> on 2024/07/23 05:18:12 UTC, 2 replies.
- [PR] [WIP] Use `SparkSession.implicits` instead of `SQLContext.implicits` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/23 05:29:17 UTC, 0 replies.
- Re: [PR] [SPARK-48974][SQL][SS][ML][MLLIB] Use `SparkSession.implicits` instead of `SQLContext.implicits` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/23 05:36:30 UTC, 3 replies.
- [PR] [SPARK-48964][SQL][DOCS] Fix the discrepancy between implementation, comment and documentation of option `recursive.fields.max.depth` in ProtoBuf connector [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/23 06:31:49 UTC, 12 replies.
- [PR] [SPARK-48975][PROTOBUF] Remove unnecessary `ScalaReflectionLock` definition from `protobuf` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/23 08:22:17 UTC, 4 replies.
- [PR] [SPARK-48976][SQL][DOCS] Improve the docs related to `variable` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/23 09:02:15 UTC, 8 replies.
- Re: [PR] [SPARK-48346][SQL] Support for IF ELSE statements in SQL scripts [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/07/23 09:50:41 UTC, 21 replies.
- Re: [PR] [SPARK-48970][PYTHON][ML] Avoid using SparkSession.getActiveSession in spark ML reader/writer [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2024/07/23 11:19:39 UTC, 13 replies.
- [PR] [/SPARK-48980][ML] Avoid per-row param read in `LSH/DCT/NGram/PolynomialExpansion` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/23 12:40:09 UTC, 0 replies.
- Re: [PR] [SPARK-48925] Add interface which prevents DataSourceV2Strategy to do planning for scan nodes [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2024/07/23 12:45:47 UTC, 3 replies.
- Re: [PR] [SPARK-47988][SQL] When the collationId is invalid, throw `COLLATION_INVALID_ID` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/23 13:27:57 UTC, 0 replies.
- [PR] [SPARK-48347][SQL] Support for WHILE statement [spark] - posted by "momcilomrk-db (via GitHub)" <gi...@apache.org> on 2024/07/23 13:38:56 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-48347][SQL] Support for WHILE statement [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2024/07/23 14:13:15 UTC, 10 replies.
- [PR] [SPARK-48981] Fix simpleString method of StringType in pyspark [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/07/23 18:17:00 UTC, 0 replies.
- Re: [PR] [SPARK-48981] Fix simpleString method of StringType in pyspark for collations [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/07/23 20:04:30 UTC, 2 replies.
- Re: [PR] [SPARK-48967][Spark Core][Parser] Improve performance and memory footprint of "INSERT INTO ... VALUES" Statements [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/07/23 20:37:05 UTC, 0 replies.
- [PR] [SPARK-48982] Properly extract Spark Errors from GRPC Request [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/07/23 20:59:45 UTC, 2 replies.
- Re: [PR] [SPARK-48503][SQL] Allow grouping on expressions in scalar subqueries, if they are bound to outer rows [spark] - posted by "andylam-db (via GitHub)" <gi...@apache.org> on 2024/07/23 21:02:37 UTC, 9 replies.
- Re: [PR] [SPARK-48935][SQL] Make `checkEvaluation` directly check the `Collation` expression itself in UT [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/23 23:36:37 UTC, 0 replies.
- [PR] [SPARK-48984]Add Controller Metrics System and Utils [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/07/24 00:22:28 UTC, 11 replies.
- [PR] [SPARK-48985][CONNECT] Connect Compatible Expression Constructors [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/07/24 01:25:08 UTC, 22 replies.
- Re: [PR] [SPARK-48967][SQL] Improve performance and memory footprint of "INSERT INTO ... VALUES" Statements [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/24 01:41:17 UTC, 4 replies.
- [PR] [SPARK-48987][INFRA] Make `curl` retry 3 times in `bin/mvn` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/24 02:03:34 UTC, 4 replies.
- [PR] [SPARK-48986][CONNECT][SQL] Add ColumnNode Intermediate Representation [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/07/24 02:09:22 UTC, 2 replies.
- [PR] [WIP][ML] `DefaultParamsReader/Writer` handle metadata with spark session [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/24 02:54:00 UTC, 7 replies.
- Re: [PR] [SPARK-48637][CORE] On-demand shuffle migration peer refresh during decommission [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/24 04:17:02 UTC, 0 replies.
- [PR] [SPARK-48089][SS][CONNECT][FOLLOWUP] Disable Server Listener failed 3.5 <> 4.0 test [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/07/24 04:46:52 UTC, 0 replies.
- Re: [PR] [SPARK-48935][SQL][TESTS] Make `checkEvaluation` directly check the `Collation` expression itself in UT [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/07/24 06:43:46 UTC, 2 replies.
- [PR] [SPARK-48990][SQL] Unified variable related SQL syntax keywords [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/24 06:46:25 UTC, 14 replies.
- [PR] [SPARK-48567][SS][FOLLOWUP] StreamingQuery.lastProgress should return the actual StreamingQueryProgress [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/07/24 06:47:04 UTC, 3 replies.
- Re: [PR] [SPARK-48980][ML] Avoid per-row param read in `LSH/DCT/NGram/PolynomialExpansion` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/24 08:49:40 UTC, 1 replies.
- [PR] [SPARK-48991][SQL] Move path initialization into try-catch block in FileStreamSink.hasMetadata [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/24 09:32:23 UTC, 3 replies.
- Re: [PR] [SPARK-48988][ML] Make `DefaultParamsReader/Writer` handle metadata with spark session [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/24 10:13:22 UTC, 1 replies.
- [PR] [SPARK-48943][SQL][TESTS] Fix the `h2` filter push-down test case failure with ANSI mode off [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/24 12:40:04 UTC, 0 replies.
- [PR] [MINOR] Allowing the merge tool to use JIRA Token [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/07/24 13:34:27 UTC, 0 replies.
- Re: [PR] [SPARK-48901][SPARK-48916][SS][PYTHON] Introduce clusterBy DataStreamWriter API [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/07/24 13:59:37 UTC, 3 replies.
- Re: [PR] [SPARK-48943][SQL][TESTS][FOLLOWUP] Fix the `h2` filter push-down test case failure with ANSI mode off [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/24 15:12:40 UTC, 6 replies.
- [PR] [SPARK-45891][SQL][PySpark][VARIANT] Add support for interval types in the Variant Spec [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/07/24 20:01:50 UTC, 9 replies.
- Re: [PR] [DO-NOT-MERGE] save some change [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/07/24 22:09:08 UTC, 0 replies.
- [PR] [SPARK-48996][PYTHON] Allow bare literals for __and__ and __or__ of Column [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/07/24 23:03:52 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-47338][SQL] Introduce `UNCLASSIFIED` for default error class [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/07/24 23:59:52 UTC, 1 replies.
- Re: [PR] [SPARK-47835][NETWORK] Remove switch for remoteReadNioBufferConversion [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/25 00:20:50 UTC, 1 replies.
- Re: [PR] [SPARK-47829][SQL] Text Datasource supports Zstd compression codec [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/25 00:20:52 UTC, 1 replies.
- Re: [PR] [SPARK-48089][SS][CONNECT][FOLLOWUP][3.5] Disable Server Listener failed 3.5 <> 4.0 test [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/25 00:38:48 UTC, 1 replies.
- [PR] Implement individual unloads for maintenance thread pool thread failures [spark] - posted by "neilramaswamy (via GitHub)" <gi...@apache.org> on 2024/07/25 00:51:58 UTC, 0 replies.
- Re: [PR] [SPARK-48997][SS] Implement individual unloads for maintenance thread pool thread failures [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/07/25 01:13:35 UTC, 20 replies.
- [PR] [MINOR][DOCS] Update doc `sql/README.md` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/25 01:50:29 UTC, 5 replies.
- [PR] [SPARK-48998][ML] Meta algorithms save/load model with SparkSession [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/25 02:14:20 UTC, 2 replies.
- [PR] Insert into values improvement with heap dump instrumentation [spark] - posted by "costas-db (via GitHub)" <gi...@apache.org> on 2024/07/25 02:50:04 UTC, 1 replies.
- [PR] [SPARK-48999][SS] Divide PythonStreamingDataSourceSimpleSuite [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2024/07/25 03:04:34 UTC, 2 replies.
- Re: [PR] [SPARK-45891][SQL][PYTHON][VARIANT] Add support for interval types in the Variant Spec [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/07/25 03:12:14 UTC, 17 replies.
- [PR] [SPARK-48844][FOLLOWUP][TESTS] Cleanup duplicated data resource files in hive-thriftserver test [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/25 03:19:23 UTC, 4 replies.
- [PR] [SPARK-48989][SQL] Fix the problem of throwing an exception when the `count` parameter of `SUBSTRING_INDEX` is null [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/25 06:09:24 UTC, 0 replies.
- [PR] [WIP][SQL] Fix aggregate behaviour with DISTINCT literals [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/07/25 06:13:41 UTC, 0 replies.
- [PR] [SPARK-48308][CORE][3.5] Unify getting data schema without partition columns in FileSourceStrategy [spark] - posted by "vkorukanti (via GitHub)" <gi...@apache.org> on 2024/07/25 06:44:10 UTC, 6 replies.
- Re: [PR] [SPARK-48829][BUILD] Upgrade `RoaringBitmap` to 1.2.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/25 07:01:58 UTC, 4 replies.
- Re: [PR] [ONLY TEST][HOLD] Upgrade rocksdbjni to 9.4.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/25 07:07:47 UTC, 1 replies.
- [PR] [WIP][SPARK-49002][SQL] Consistently handle invalid location/path values for all database objects [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/25 12:47:43 UTC, 0 replies.
- Re: [PR] [SPARK-32086][YARN]Bug fix for RemoveBroadcast RPC failed after executor is shutdown [spark] - posted by "esnhysythh (via GitHub)" <gi...@apache.org> on 2024/07/25 13:39:39 UTC, 0 replies.
- [PR] [SPARK-49003][SQL][COLLATION] Fix calculating hash value of collated strings [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2024/07/25 15:26:39 UTC, 1 replies.
- [PR] Mima [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/07/25 15:51:42 UTC, 0 replies.
- [PR] [SPARK-49005][K8S][3.5] Use `17-jammy` tag instead of `17` to prevent Pyth… [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/25 16:24:23 UTC, 0 replies.
- [PR] [SPARK-49005][K8S][3.4] Use `17-jammy` tag instead of `17` to prevent Python 3.12 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/25 16:25:58 UTC, 0 replies.
- [PR] [SPARK-49006] Implement purging for OperatorStateMetadataV2 and StateSchemaV3 files [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/07/25 16:34:29 UTC, 6 replies.
- Re: [PR] [SPARK-49005][K8S][3.5] Use `17-jammy` tag instead of `17` to prevent Python 12 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/25 16:38:15 UTC, 8 replies.
- Re: [PR] [SPARK-49005][K8S][3.4] Use `17-jammy` tag instead of `17-jre` to prevent Python 3.12 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/25 16:39:57 UTC, 7 replies.
- Re: [PR] [SPARK-48996][SQL][PYTHON] Allow bare literals for __and__ and __or__ of Column [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/07/25 20:46:05 UTC, 2 replies.
- [PR] [SPARK-49007][CORE] Improve `MasterPage` to support custom title [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/25 20:59:09 UTC, 4 replies.
- [PR] Rebased value state [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/07/25 21:37:03 UTC, 0 replies.
- [PR] [SPARK-49008][PYTHON] Use `ParamSpec` to propagate `func` signature in `transform` [spark] - posted by "nicklamiller (via GitHub)" <gi...@apache.org> on 2024/07/25 21:42:48 UTC, 1 replies.
- [PR] [SPARK-49010] Add unit tests for XML schema inference case sensitivity [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2024/07/26 00:03:12 UTC, 0 replies.
- [PR] [SPARK-49009][SQL][PYTHON] Make Column APIs and functions accept Enums [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/07/26 00:06:03 UTC, 3 replies.
- Re: [PR] [SPARK-47320][SQL] : The behaviour of Datasets involving self joins is inconsistent, unintuitive, with contradictions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/26 00:20:41 UTC, 1 replies.
- Re: [PR] [SPARK-47279][CORE]When the messageLoop encounter a fatal exception, such as oom, exit the JVM to avoid the driver hanging forever [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/26 00:20:43 UTC, 1 replies.
- Re: [PR] [SPARK-49002][SQL] Consistently handle invalid location/path values for all database objects [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/26 08:34:37 UTC, 22 replies.
- [PR] Add bouncyCastle-related test dependencies to the `hive-thrift` module to fix the Maven daily test. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/26 09:33:33 UTC, 0 replies.
- [PR] [SPARK-49013] Change key in collationsMap for Map and Array types in scala [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/07/26 09:51:04 UTC, 3 replies.
- [PR] [SPARK-49014][BUILD] Bump Apache Avro to 1.12.0 [spark] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2024/07/26 09:52:28 UTC, 7 replies.
- [PR] [SPARK-49000][SQL][WIP] Fix "select count(distinct 1) from t" where t is empty table [spark] - posted by "nikolamand-db (via GitHub)" <gi...@apache.org> on 2024/07/26 11:09:33 UTC, 2 replies.
- [PR] [SPARK-49015][CORE] Connect Server should respect `spark.log.structuredLogging.enabled` [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/07/26 11:42:28 UTC, 2 replies.
- [PR] [SPARK-49017] Insert statement fails when multiple parameters are being used [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/07/26 12:52:53 UTC, 0 replies.
- Re: [PR] [SPARK-48989][SQL] Fix error result of throwing an exception when the `count` parameter of `SUBSTRING_INDEX` is null [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/26 12:59:41 UTC, 3 replies.
- Re: [PR] [SPARK-49012][SQL][BUILD] Add bouncycastle-related test dependencies to the `hive-thrift` module to fix the Maven daily test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/26 14:17:43 UTC, 1 replies.
- [PR] Ilicmarkodb/fix string hash [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2024/07/26 14:25:10 UTC, 2 replies.
- [PR] [SPARK-49018] Fix approx_count_distinct not working correctly with collation [spark] - posted by "viktorluc-db (via GitHub)" <gi...@apache.org> on 2024/07/26 14:32:37 UTC, 0 replies.
- [PR] [WIP] Test removing the `hadoop.security.key.provider.path` configuration with global scope. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/26 14:33:19 UTC, 2 replies.
- Re: [PR] [SPARK-49012][SQL][BUILD] Add bouncycastle-related test dependencies to the `hive-thriftserver` module to fix the Maven daily test [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/26 14:41:43 UTC, 8 replies.
- Re: [PR] [SPARK-48989][SQL] Fix error result of throwing an exception when the `count` parameter of `SUBSTRING_INDEX`(with Codegen) is null or string [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/26 14:52:50 UTC, 11 replies.
- Re: [PR] [SPARK-48382] Add `reconciler` to `spark-operator` module [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/26 15:23:37 UTC, 1 replies.
- [PR] [SPARK-48382][FOLLOWUP] Use `final` keyword for the applicable variables [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/26 15:51:18 UTC, 6 replies.
- [PR] [SPARK-49019] Use `try-with-resources` to test `KubernetesClientFactory.buildKubernetesClient` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/26 16:15:33 UTC, 5 replies.
- Re: [PR] [SPARK-49003][SQL] Ilicmarkodb/fix string hash [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2024/07/26 16:16:09 UTC, 5 replies.
- [PR] [WIP][SPARK-49000][SQL] Fix aggregation for distinct literal [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/07/26 16:34:26 UTC, 1 replies.
- [PR] [SPARK-49016][SQL] Queries from raw CSV files are disallowed when the referenced columns only include the internal corrupt record column [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/26 16:50:11 UTC, 3 replies.
- [PR] [SPARK-49020] Avoid `raw` type usage [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/26 17:51:58 UTC, 3 replies.
- [PR] [SPARK-48931][SS][FOLLOWUP] Reduce Cloud Store List API cost for state store maintenance task [spark] - posted by "riyaverm-db (via GitHub)" <gi...@apache.org> on 2024/07/26 20:22:42 UTC, 1 replies.
- [PR] [SPARK-XXXX] Implement validation for the TransformWithStateExec operator using OperatorStateMetadataV2 [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/07/26 23:09:33 UTC, 0 replies.
- Re: [PR] [SPARK-49031] Implement validation for the TransformWithStateExec operator using OperatorStateMetadataV2 [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/07/26 23:14:08 UTC, 29 replies.
- Re: [PR] [DO-NOT-MERGE][SPARK-47047][SS] Add changes to support reading transformWithState value state variables [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/07/26 23:27:11 UTC, 1 replies.
- [PR] [SPARK-49033][CORE] Support server-side environment variable replacement in REST Submission API [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/26 23:52:20 UTC, 1 replies.
- Re: [PR] [SPARK-47870][SQL] Optimize predicate after push extra predicate through join [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/27 00:20:29 UTC, 1 replies.
- [PR] [SPARK-49032] Add schema path in metadata table entry, verify expected version and add operator metadata related test for operator metadata format v2 [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/07/27 00:56:12 UTC, 0 replies.
- Re: [PR] [SPARK-49032][SS] Add schema path in metadata table entry, verify expected version and add operator metadata related test for operator metadata format v2 [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/07/27 00:59:28 UTC, 5 replies.
- Re: [PR] [SPARK-49033][CORE] Support server-side `environmentVariables` replacement in REST Submission API [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/27 02:17:02 UTC, 10 replies.
- [PR] [SPARK-49034][CORE] Support server-side `sparkProperties` replacementin REST Submission API [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/27 04:55:20 UTC, 2 replies.
- Re: [PR] [SPARK-49010][SQL][XML] Add unit tests for XML schema inference case sensitivity [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/27 05:29:22 UTC, 1 replies.
- Re: [PR] [SPARK-49034][CORE] Support server-side `sparkProperties` replacement in REST Submission API [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/27 07:36:50 UTC, 2 replies.
- Re: [PR] [SPARK-47336][SQL][CONNECT] Provide to PySpark a functionality to get estimated size of DataFrame in bytes [spark] - posted by "SemyonSinchenko (via GitHub)" <gi...@apache.org> on 2024/07/27 20:48:29 UTC, 2 replies.
- [PR] [SPARK-49035][PYTHON] Eliminate TypeVar `ColumnOrName_` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/28 09:53:56 UTC, 2 replies.
- Re: [PR] [SPARK-47618][CORE] Use `Magic Committer` for all S3 buckets by default [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/29 00:22:11 UTC, 1 replies.
- [PR] [SPARK-49036] Simplify assertion test code [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/29 03:08:11 UTC, 0 replies.
- Re: [PR] [SPARK-49036] Exclude `JUnitAssertionsShouldIncludeMessage/JUnitTestContainsTooManyAsserts` PMD rules and simplify test code [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/29 03:33:53 UTC, 4 replies.
- Re: [PR] Operator 0.1.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/29 04:08:12 UTC, 0 replies.
- [PR] K8s with pvc fix [spark] - posted by "gantashalavenki (via GitHub)" <gi...@apache.org> on 2024/07/29 04:39:27 UTC, 0 replies.
- Re: [PR] [SPARK-45393][BUILD] Upgrade Hadoop to 3.4.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/29 06:58:04 UTC, 8 replies.
- [PR] [SPARK-48865][SQL][FOLLOWUP] Add failOnError argument to replace TryEval in TryUrlDecode [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/07/29 07:14:04 UTC, 12 replies.
- [PR] [SPARK-49037][SQL][TESTS] Replace `schema()` with `columns()` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/29 07:28:13 UTC, 7 replies.
- Re: [PR] [SPARK-45717][YARN] Avoid use `spark.yarn.user.classpath.first` [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/07/29 08:13:22 UTC, 0 replies.
- [PR] [SPARK-49038][SQL] Fix regression in Spark UI SQL operator metrics calculation to filter out invalid accumulator values correctly [spark] - posted by "virrrat (via GitHub)" <gi...@apache.org> on 2024/07/29 10:48:15 UTC, 12 replies.
- [PR] [SPARK-49040][SQL] Fix doc `sql-ref-syntax-aux-exec-imm.md` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/29 11:48:36 UTC, 3 replies.
- [PR] [SPARK-49041][PYTHON][CONNECT] Raise proper error for `dropDuplicates` when wrong `subset` is given [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/07/29 12:05:09 UTC, 2 replies.
- [PR] [SPARK-49039][UI] Reset checkbox when executor metrics are loaded in the Stages tab [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/07/29 13:03:47 UTC, 0 replies.
- Re: [PR] [SPARK-49003][SQL] Fix interpreted code path hashing to be collation aware [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2024/07/29 13:23:11 UTC, 6 replies.
- [PR] [Do not review] Fix group by on collated string [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2024/07/29 13:25:16 UTC, 0 replies.
- Re: [PR] [SPARK-49016][SQL][DOCS] Remove `CSV` about queries are disallowed when the referenced columns only include the internal corrupt record column in `sql-migration-guide.md` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/07/29 14:08:18 UTC, 2 replies.
- Re: [PR] [SPARK-49000][SQL] Fix aggregate behaviour with DISTINCT literals [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/07/29 14:25:49 UTC, 2 replies.
- Re: [PR] [SPARK-49018][SQL] Fix approx_count_distinct not working correctly with collation [spark] - posted by "nikolamand-db (via GitHub)" <gi...@apache.org> on 2024/07/29 15:15:08 UTC, 17 replies.
- [PR] [SPARK-49043][SQL] Fix interpreted codepath group by on map containing collated strings [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2024/07/29 15:59:12 UTC, 0 replies.
- [PR] [SPARK-49044] ValidateExternalType should return child in error [spark] - posted by "mrk-andreev (via GitHub)" <gi...@apache.org> on 2024/07/29 16:29:34 UTC, 0 replies.
- Re: [PR] [SPARK-48740][SQL] Catch missing window specification error early [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/07/29 19:57:57 UTC, 2 replies.
- [PR] [SPARK-49049][DOCS] Document MasterPage custom title conf and REST API server-side env variable replacements [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/29 20:48:27 UTC, 9 replies.
- Re: [PR] [SPARK-48762][SQL] Introduce clusterBy DataFrameWriter API for Python [spark] - posted by "zedtang (via GitHub)" <gi...@apache.org> on 2024/07/29 21:01:55 UTC, 3 replies.
- [PR] [SPARK-49050] Integrate TransformWithState operator with Virtual Column Families [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/07/29 21:20:02 UTC, 0 replies.
- [PR] [SPARK-49000][SQL][WIP] Fix "select count(distinct 1) from t" where t is empty table by expanding RewriteDistinctAggregates [spark] - posted by "nikolamand-db (via GitHub)" <gi...@apache.org> on 2024/07/29 21:50:40 UTC, 7 replies.
- [PR] [SPARK-48710][PYTHON][FOLLOWUP] PySpark rdd test should not fail on optional dependencies [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/29 22:58:11 UTC, 8 replies.
- [PR] [SPARK-49045] Add docker image build for operator [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/07/29 23:05:22 UTC, 0 replies.
- Re: [PR] [SPARK-47573][K8S] Support custom driver log url [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/30 00:21:11 UTC, 1 replies.
- Re: [PR] [SPARK-47323][K8S] Support custom executor log urls [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/30 00:21:12 UTC, 1 replies.
- Re: [PR] [MINOR][TEST][CONNECT] Discard stdout / stderr of test Spark connect server if not isDebug [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/30 00:21:13 UTC, 1 replies.
- Re: [PR] [SPARK-42199][SQL] Fix issues around Dataset.groupByKey [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/30 00:21:14 UTC, 3 replies.
- Re: [PR] [SPARK-48210][DOC]Modify the description of whether dynamic partition… [spark] - posted by "amogkam (via GitHub)" <gi...@apache.org> on 2024/07/30 00:34:02 UTC, 1 replies.
- [PR] [SPARK-49052] Add SparkOperator main entry point class [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/07/30 00:34:53 UTC, 0 replies.
- [PR] [SPARK-49053][PYTHON][ML] Make model save/load helper functions accept spark session [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/30 01:18:29 UTC, 2 replies.
- [PR] [SPARK-49048] Add support for reading relevant operator metadata at given batch id [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/07/30 01:41:52 UTC, 0 replies.
- Re: [PR] [SPARK-49048][SS] Add support for reading relevant operator metadata at given batch id [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/07/30 01:43:09 UTC, 5 replies.
- Re: [PR] [SPARK-48989][SQL] Fix error result of throwing an exception of `SUBSTRING_INDEX` built-in function with Codegen [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/30 04:23:01 UTC, 5 replies.
- [PR] [SPARK-49054][SQL] Column default value should support current_* functions [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/07/30 04:33:41 UTC, 3 replies.
- [PR] [MINOR][DOCS] Fix typos in `docs/sql-migration-guide.md` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/30 05:34:25 UTC, 2 replies.
- [PR] [SPARK-49056][SQL] ErrorClassesJsonReader cannot handle null properly [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/07/30 05:54:30 UTC, 3 replies.
- [PR] [SPARK-47430][SQL] Rework group by map type [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2024/07/30 06:19:37 UTC, 4 replies.
- Re: [PR] [SPARK-49017][SQL] Insert statement fails when multiple parameters are being used [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/07/30 08:04:47 UTC, 0 replies.
- [PR] [SPARK-49057][SQL] Do not block the AQE loop when submitting query stages [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/07/30 09:46:42 UTC, 7 replies.
- [PR] enhance the metrics in SparkUI with logical plan stats [spark] - posted by "Donvi (via GitHub)" <gi...@apache.org> on 2024/07/30 11:14:17 UTC, 0 replies.
- [PR] [SPARK-49058][SQL] Display more primitive name for the `::` operator [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/30 11:20:27 UTC, 1 replies.
- [PR] [SPARK-49059] Move `SessionHolder.forTesting(...)` to the test package [spark] - posted by "vicennial (via GitHub)" <gi...@apache.org> on 2024/07/30 12:04:03 UTC, 0 replies.
- [PR] [SPARK-48338][SQL] Improve exceptions thrown from parser/interpreter [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2024/07/30 12:41:39 UTC, 29 replies.
- Re: [PR] [WIP] Goldenfile tests [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2024/07/30 12:54:04 UTC, 0 replies.
- Re: [PR] [SPARK-49059][CONNECT] Move `SessionHolder.forTesting(...)` to the test package [spark] - posted by "vicennial (via GitHub)" <gi...@apache.org> on 2024/07/30 15:19:24 UTC, 2 replies.
- [PR] [SPARK-49062][SQL] Migrate XML to File Data Source V2 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/30 18:39:49 UTC, 1 replies.
- Re: [PR] [SPARK-49054][SQL][3.5] Column default value should support current_* functions [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/07/30 20:24:17 UTC, 1 replies.
- [PR] [WIP][SPARK-49064][BUILD] Upgrade Kafka to 3.8.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/31 00:04:48 UTC, 0 replies.
- [PR] [SPARK-TODO][SQL] Rebasing in legacy formatters/parsers must support non JVM default time zones [spark] - posted by "sumeet-db (via GitHub)" <gi...@apache.org> on 2024/07/31 00:58:00 UTC, 0 replies.
- [PR] [MINOR][DOCS] Fix typos in `docs/sql-data-sources-xml.md` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/31 01:35:43 UTC, 0 replies.
- Re: [PR] [SPARK-49002][SQL] Consistently handle invalid locations in WAREHOUSE/SCHEMA/TABLE/PARTITION/DIRECTORY [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/07/31 02:12:45 UTC, 9 replies.
- [PR] [SPARK-49066][SQL][TESTS] Refactor `OrcEncryptionSuite` and make `spark.hadoop.hadoop.security.key.provider.path` effective only within `OrcEncryptionSuite` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/07/31 02:52:15 UTC, 15 replies.
- [PR] [SPARK-49067][SQL] Move utf-8 literal into internal methods of UrlCodec class [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/07/31 02:59:09 UTC, 2 replies.
- Re: [PR] [SPARK-48725][SQL] Integrate CollationAwareUTF8String.lowerCaseCodePoints into string expressions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/07/31 05:13:15 UTC, 1 replies.
- Re: [PR] [SPARK-49064][BUILD] Upgrade Kafka to 3.8.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/31 06:12:22 UTC, 9 replies.
- [PR] [SPARK-49070][SS][SQL] TransformWithStateExec.initialState is rewritten incorrectly to produce invalid query plan [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2024/07/31 06:16:32 UTC, 8 replies.
- [PR] [SPARK-49071][SQL] Cleanup SortArray [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2024/07/31 06:31:59 UTC, 0 replies.
- [PR] [SPARK-49072][DOCS] Fix abnormal display of text content which contains two $ in one line but not non-formula in docs [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/31 07:38:12 UTC, 0 replies.
- Re: [PR] [SPARK-49072][DOCS] Fix abnormal display of text content which contains two $ in one line but non-formula in docs [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/07/31 07:42:52 UTC, 0 replies.
- Re: [PR] [SPARK-49071][SQL] Remove ArraySortLike trait [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2024/07/31 08:09:55 UTC, 0 replies.
- [PR] Multiple spark application can be submitted within the current process [spark] - posted by "scanry (via GitHub)" <gi...@apache.org> on 2024/07/31 08:17:35 UTC, 6 replies.
- Re: [PR] [SPARK-49000][SQL] Fix "select count(distinct 1) from t" where t is empty table by expanding RewriteDistinctAggregates [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/07/31 08:45:36 UTC, 18 replies.
- [PR] [SPARK-44638][SQL][TESTS][3.5] Add test for Char/Varchar in JDBC customSchema option [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/31 09:09:05 UTC, 2 replies.
- [PR] [SPARK-44638][SQL][TESTS] Add test for Char/Varchar in JDBC custom options [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/31 09:09:20 UTC, 5 replies.
- Re: [PR] [SPARK-48977][SQL] Optimize string searching under UTF8_LCASE collation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/07/31 09:15:38 UTC, 1 replies.
- [PR] [SPARK-49073][SQL][DOCS] Improve docs `sql-ref-syntax-qry-select.md` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/31 09:25:08 UTC, 2 replies.
- Re: [PR] inject chukonu [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/07/31 10:29:20 UTC, 1 replies.
- [PR] [SPARK-49047][PYTHON][CONNECT] Truncate the message for logging [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/07/31 10:38:55 UTC, 0 replies.
- Re: [PR] [SPARK-49073][SQL][DOCS] Improve the doc `sql-ref-syntax-qry-select.md` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/07/31 11:59:34 UTC, 3 replies.
- [PR] [MINOR][DOCS] Fix typos in docs/sql-ref-number-pattern.md [spark] - posted by "tomscut (via GitHub)" <gi...@apache.org> on 2024/07/31 12:15:01 UTC, 0 replies.
- Re: [PR] [SPARK-34819][SQL] MapType supports comparable semantics [spark] - posted by "rekbun (via GitHub)" <gi...@apache.org> on 2024/07/31 15:02:00 UTC, 0 replies.
- Re: [PR] [SPARK-42388][SQL] Avoid parquet footer reads twice in vectorized reader [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/31 15:23:12 UTC, 0 replies.
- Re: [PR] [SPARK-44638][SQL][TESTS][3.4] Add test for Char/Varchar in JDBC customSchema option [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/07/31 19:00:49 UTC, 0 replies.
- [PR] [SPARK-49074][SQL] Fix variant with `df.cache()` [spark] - posted by "richardc-db (via GitHub)" <gi...@apache.org> on 2024/07/31 19:53:01 UTC, 1 replies.
- Re: [PR] [SPARK-49050][SS] Integrate TransformWithState operator with Virtual Column Families [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/07/31 22:52:45 UTC, 2 replies.