reviews@spark.apache.org, 2024-06

You are viewing a plain text version of this content. The canonical link for it is here.

- Re: [PR] [SPARK-46710][SQL] Clean up the broadcast data when sql execution ends [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/06/01 00:21:28 UTC, 1 replies.
- Re: [PR] [SPARK-46876]csv line containing delimiter can't be treated as empty line [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/06/01 00:21:30 UTC, 1 replies.
- Re: [PR] [SPARK-46097][SQL] Push down limit 1 through Union and Aggregate [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/06/01 00:21:31 UTC, 0 replies.
- Re: [PR] [SPARK-48491][SQL][TESTS] HiveWindowFunctionQuerySuite needs set configs in beforeAll and unset in afterAll [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2024/06/01 00:27:19 UTC, 0 replies.
- [PR] [SPARK-48498][SQL] Always do char padding in predicates [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/06/01 00:32:46 UTC, 15 replies.
- [PR] [SPARK-48497][PYTHON][DOCS] Add an example for Python data source writer in user guide [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/06/01 00:52:56 UTC, 12 replies.
- Re: [PR] [SPARK-48484][SQL] Fix: V2Write use the same TaskAttemptId for different task attempts [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/06/01 01:26:40 UTC, 6 replies.
- Re: [PR] [SPARK-48476][SQL] Add a new`INVALID_DELIMITER_VALUE.NULL_VALUE` error class to replace NPE [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/06/01 01:45:42 UTC, 0 replies.
- [PR] [SPARK-48499][SQL] Use Math.abs to get Positive Numbers [spark] - posted by "jackylee-ch (via GitHub)" <gi...@apache.org> on 2024/06/01 04:15:27 UTC, 1 replies.
- Re: [PR] [SPARK-48488][CORE] Restore the original logic of methods `log[info|warning|error]` in `SparkSubmit` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/01 05:35:39 UTC, 0 replies.
- Re: [PR] [SPARK-48481][SQL][SS] Do not apply OptimizeOneRowPlan against streaming Dataset [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/06/01 06:00:15 UTC, 5 replies.
- Re: [PR] [SPARK-48487][INFRA] Update License & Notice according to the dependency changes [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/06/01 06:14:56 UTC, 4 replies.
- Re: [PR] [SPARK-48392][CORE][FOLLOWUP] Add `--load-spark-defaults` flag to decide whether to load `spark-defaults.conf` [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2024/06/01 06:38:37 UTC, 6 replies.
- Re: [PR] [SPARK-47172][CORE] Add support for AES-GCM for RPC encryption [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/06/01 08:52:32 UTC, 31 replies.
- Re: [PR] [SPARK-47043][BUILD] add `jackson-core` and `jackson-annotations` dependencies to module `spark-common-utils` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/06/02 00:21:59 UTC, 1 replies.
- Re: [PR] [SPARK-47042][BUILD] add missing explicit dependency 'commons-lang3' to the module 'spark-common-utils' [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/06/02 00:22:00 UTC, 1 replies.
- Re: [PR] [SPARK-48397][SQL] Add data write time metric to FileFormatDataWriter [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2024/06/02 04:19:36 UTC, 0 replies.
- Re: [PR] [SPARK-48220][PYTHON] Allow passing PyArrow Table to createDataFrame() [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/06/02 08:52:11 UTC, 1 replies.
- Re: [PR] [SPARK-48485][CONNECT][SS] Support interruptTag and interruptAll in streaming queries [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/06/02 11:17:23 UTC, 12 replies.
- [PR] [TEST Only] Eliminate ui warnings [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/02 12:23:05 UTC, 2 replies.
- [PR] [WIP][PYTHON] Fix `assertDataFrameEqual` behavior with mixed DataFrame types [spark] - posted by "arminnh (via GitHub)" <gi...@apache.org> on 2024/06/02 14:23:07 UTC, 1 replies.
- [PR] [SPARK-48302][PYTHON] Preserve nulls in map columns in PyArrow Tables [spark] - posted by "ianmcook (via GitHub)" <gi...@apache.org> on 2024/06/02 14:31:30 UTC, 5 replies.
- Re: [PR] [SPARK-48374][PYTHON] Support additional PyArrow Table column types [spark] - posted by "ianmcook (via GitHub)" <gi...@apache.org> on 2024/06/02 14:42:11 UTC, 3 replies.
- Re: [PR] [SPARK-47353][SQL] Enable collation support for the Mode expression using GroupMapReduce [spark] - posted by "GideonPotok (via GitHub)" <gi...@apache.org> on 2024/06/02 15:24:31 UTC, 0 replies.
- [PR] Bump io.airlift:aircompressor from 0.26 to 0.27 [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/06/02 22:30:53 UTC, 2 replies.
- [PR] [SPARK-48503][SQL] Fix invalid scalar subquery with group-by and non-equality that was incorrectly allowed [spark] - posted by "jchen5 (via GitHub)" <gi...@apache.org> on 2024/06/03 00:00:31 UTC, 2 replies.
- Re: [PR] [SPARK-44662] Perf improvement in BroadcastHashJoin queries with stream side join key on non partition columns [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/06/03 00:20:36 UTC, 1 replies.
- Re: [PR] [SPARK-48493][PYTHON] Enhance Python Datasource Reader with direct Arrow Batch support for improved performance [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/06/03 00:22:19 UTC, 1 replies.
- [PR] [SPARK-48204][INFRA][FOLLOW] fix release scripts for the "finalize" step [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/06/03 01:40:20 UTC, 4 replies.
- Re: [PR] [SPARK-48503][SQL] Fix invalid scalar subqueries with group-by on non-equivalent columns that were incorrectly allowed [spark] - posted by "jchen5 (via GitHub)" <gi...@apache.org> on 2024/06/03 01:46:52 UTC, 2 replies.
- Re: [PR] [SPARK-45891] Describe shredding scheme for Variant [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/06/03 01:50:24 UTC, 3 replies.
- Re: [PR] [SPARK-48489][SQL] Throw a better, user-facing error when reading illegal schema from text Data Source [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/06/03 01:51:13 UTC, 1 replies.
- Re: [PR] [SS] Remove TimeMode None from TransformWithState. [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/06/03 01:55:04 UTC, 1 replies.
- Re: [PR] [SPARK-48494][BUILD] Update `airlift:aircompressor` to 0.27 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/06/03 01:57:05 UTC, 1 replies.
- Re: [PR] [SPARK-48496][CORE] Use static regex Pattern instances in JavaUtils.timeStringAs and JavaUtils.byteStringAs [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/06/03 01:58:07 UTC, 1 replies.
- [PR] [SPARK-48504][PYTHON][CONNECT] Parent Window class for Spark Connect and Spark Classic [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/03 01:59:54 UTC, 5 replies.
- Re: [PR] [SPARK-48419][SQL] Foldable propagation replace foldable column shoul… [spark] - posted by "KnightChess (via GitHub)" <gi...@apache.org> on 2024/06/03 02:51:35 UTC, 2 replies.
- Re: [PR] [SPARK-48433][BUILD] Upgrade `checkstyle` to 10.17.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/06/03 03:02:02 UTC, 1 replies.
- Re: [PR] [SPARK-48394][3.5][CORE] Cleanup mapIdToMapIndex on mapoutput unregister [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/06/03 03:21:50 UTC, 2 replies.
- Re: [PR] [SPARK-48505][CORE] Simplify the implementation of `Utils#isG1GC` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/06/03 03:34:29 UTC, 12 replies.
- Re: [PR] [SPARK-48488][CORE] Fix methods `log[info|warning|error]` in `SparkSubmit` [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/06/03 03:53:36 UTC, 1 replies.
- Re: [PR] [SPARK-48383][SS] Throw better error for mismatched partitions in startOffset option in Kafka [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/06/03 03:53:49 UTC, 2 replies.
- Re: [PR] [SPARK-48447][SS] Check state store provider class before invoking the constructor [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/06/03 03:56:56 UTC, 1 replies.
- Re: [PR] [SPARK-47952][CORE][CONNECT] Support retrieving the real SparkConnectService GRPC address and port programmatically when running on Yarn [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/06/03 04:26:56 UTC, 3 replies.
- Re: [PR] [SPARK-48391][CORE]Using addAll instead of add function in fromAccumulatorInfos method of TaskMetrics Class [spark] - posted by "monkeyboy123 (via GitHub)" <gi...@apache.org> on 2024/06/03 04:35:17 UTC, 0 replies.
- [PR] [WIP] Test scala-xml 2.3.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/06/03 05:35:07 UTC, 0 replies.
- [PR] [WIP][BUILD] Test jetty-11.0.21 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/06/03 05:38:19 UTC, 0 replies.
- [PR] [TEST Only][V2] Eliminate ui warnings [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/03 06:53:36 UTC, 0 replies.
- Re: [PR] [SPARK-36680][SQL] Supports Dynamic Table Options for Spark SQL [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2024/06/03 07:16:54 UTC, 11 replies.
- Re: [PR] [PYTHON] Fix `assertDataFrameEqual` behavior with mixed DataFrame types [spark] - posted by "arminnh (via GitHub)" <gi...@apache.org> on 2024/06/03 07:18:45 UTC, 2 replies.
- Re: [PR] [SPARK-47424][SQL] Add getDatabaseCalendar method to the JdbcDialect [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2024/06/03 07:26:44 UTC, 0 replies.
- [PR] [WIP][SQL] UTF8 string validation [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/06/03 07:36:56 UTC, 6 replies.
- [PR] [SPARK-48507][INFRA] Use Hadoop 3.3.6 winutils in `build_sparkr_window` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/03 07:40:13 UTC, 5 replies.
- [PR] [SPARK-48506][CORE] Compression codec short names are case insensitive except for event logging [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/06/03 07:50:15 UTC, 7 replies.
- Re: [PR] (DRAFT) [SPARK-46798] Kafka custom partition location assignment in Spark Structured Streaming (rack awareness) [spark] - posted by "SubhamSinghal (via GitHub)" <gi...@apache.org> on 2024/06/03 08:05:14 UTC, 3 replies.
- Re: [PR] [SPARK-48286] Fix analysis and creation of column with exists default expression [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2024/06/03 09:31:14 UTC, 10 replies.
- Re: [PR] [SPARK-43030][SQL] Deduplicate relations with metadata columns [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/06/03 09:39:39 UTC, 0 replies.
- [PR] [SPARK-48508][CONNECT][PYTHON] Cache user specified schema in `DataFrame.{to, mapInPandas, mapInArrow}` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/03 09:48:04 UTC, 2 replies.
- [PR] [SPARK-48510][2/2] Support UDAF `toColumn` API in Spark Connect [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/06/03 10:13:33 UTC, 5 replies.
- [PR] [SPARK-47933][PYTHON][FOLLOWUP] Correct the error message [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/03 11:30:42 UTC, 3 replies.
- Re: [PR] [SPARK-43301][CORE][SHUFFLE] BlockStoreClient getHostLocalDirs RPC supports IOException retry [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/06/03 13:09:28 UTC, 6 replies.
- Re: [PR] [SS][SPARK-48511] Remove TimeMode None from TransformWithState. [spark] - posted by "sahnib (via GitHub)" <gi...@apache.org> on 2024/06/03 15:05:26 UTC, 4 replies.
- [PR] [SPARK-38862] - allow integration of a secure gateway to SparkSubmissionServer alongside spark.authenticate props [spark] - posted by "JackBuggins (via GitHub)" <gi...@apache.org> on 2024/06/03 17:33:01 UTC, 0 replies.
- Re: [PR] [SPARK-47972][SQL] Restrict CAST expression for collations [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/06/03 18:29:40 UTC, 3 replies.
- Re: [PR] [SPARK-48413][SQL] ALTER COLUMN with collation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/06/03 18:39:08 UTC, 5 replies.
- [PR] [SPARK-48512][PYTHON][TESTS] Refactor Python tests [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2024/06/03 18:47:24 UTC, 3 replies.
- Re: [PR] [SPARK-47977] DateTimeUtils.timestampDiff and DateTimeUtils.timestampAdd should not throw INTERNAL_ERROR exception [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/06/03 18:48:45 UTC, 1 replies.
- Re: [PR] [SPARK-48342][SQL] Introduction of SQL Scripting Parser [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/06/03 19:25:12 UTC, 38 replies.
- Re: [PR] [SPARK-48318][SQL] Enable hash join support for all collations (complex types) [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/06/03 19:44:19 UTC, 3 replies.
- Re: [PR] [SPARK-48482][PYTHON] dropDuplicates and dropDuplicatesWIthinWatermark should accept variable length args [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/06/03 20:42:03 UTC, 2 replies.
- [PR] [SPARK-42944][SS][CONNECT] Reenable ApplyInPandasWithState tests [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/06/03 21:50:49 UTC, 0 replies.
- [PR] [SPARK-48514][BUILD][K8S] Upgrade `kubernetes-client` to 6.13.0 [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2024/06/03 21:54:27 UTC, 2 replies.
- [PR] [SPARK-42944][FOLLOWUP][3.5][SS][CONNECT] Reenable ApplyInPandasWithState tests [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/06/03 22:13:36 UTC, 3 replies.
- Re: [PR] [SPARK-48466][SQL] Create dedicated node for EmptyRelation in AQE [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2024/06/03 23:02:23 UTC, 9 replies.
- [PR] [SPARK-48513][SS] Add error class for state schema compatibility and minor refactoring [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/06/03 23:05:09 UTC, 8 replies.
- [PR] [SPARK-48515][PYTHON][DOCS] Turn on Arrow optimization for Python UDFs by default [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/06/03 23:16:22 UTC, 1 replies.
- Re: [PR] [SPARK-42944][FOLLOWUP][SS][CONNECT] Reenable ApplyInPandasWithState tests [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/06/03 23:45:45 UTC, 9 replies.
- [PR] [SPARK-48518][CORE] Make LZF compression be able to run in parallel [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/06/04 07:09:20 UTC, 8 replies.
- Re: [PR] [MINOR][SQL] Remove outdated `TODO`s from `UnsafeHashedRelation` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/06/04 07:34:16 UTC, 0 replies.
- [PR] [WIP] Use ICU case mappings for upper and lower casing [spark] - posted by "mkaravel (via GitHub)" <gi...@apache.org> on 2024/06/04 07:45:57 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-47194][BUILD] Upgrade log4j to 2.23.1 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/04 07:48:58 UTC, 6 replies.
- Re: [PR] [SPARK-46937][SQL] Improve concurrency performance for FunctionRegistry [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2024/06/04 08:24:39 UTC, 7 replies.
- [PR] [SPARK-47972][SQL][FOLLOWUP] Restrict CAST expression for collations [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/06/04 09:08:06 UTC, 2 replies.
- Re: [PR] [SPARK-48283][SQL] Modify string comparison for UTF8_BINARY_LCASE [spark] - posted by "dbatomic (via GitHub)" <gi...@apache.org> on 2024/06/04 10:12:35 UTC, 12 replies.
- Re: [PR] [SPARK-48403][SQL] Fix Lower & Upper expressions for UTF8_BINARY_LCASE collation [spark] - posted by "dbatomic (via GitHub)" <gi...@apache.org> on 2024/06/04 10:14:04 UTC, 0 replies.
- Re: [PR] [SPARK-48410][SQL] Fix InitCap expression for UTF8_BINARY_LCASE & ICU collations [spark] - posted by "dbatomic (via GitHub)" <gi...@apache.org> on 2024/06/04 10:19:36 UTC, 5 replies.
- [PR] [SPARK-48522][BUILD] Update Stream Library to 2.9.8 and attach its NOTICE [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/06/04 10:52:22 UTC, 6 replies.
- Re: [PR] [SPARK-48519][BUILD] Upgrade jetty to 11.0.21 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/06/04 11:03:16 UTC, 2 replies.
- [PR] [SPARK-48523][DOCS] Add `grpc_max_message_size ` description to `client-connection-string.md` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/04 11:18:36 UTC, 4 replies.
- Re: [PR] [SPARK-22876][YARN] Respect YARN AM failure validity interval [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2024/06/04 12:02:19 UTC, 0 replies.
- Re: [PR] [SPARK-47353][SQL] Enable collation support for the Mode expression [spark] - posted by "GideonPotok (via GitHub)" <gi...@apache.org> on 2024/06/04 12:27:58 UTC, 30 replies.
- Re: [PR] [SPARK-48280][SQL] Add Expression Walker for Testing [spark] - posted by "dbatomic (via GitHub)" <gi...@apache.org> on 2024/06/04 13:08:05 UTC, 20 replies.
- Re: [PR] [SPARK-42252][CORE] Add `spark.shuffle.localDisk.file.output.buffer` and deprecate `spark.shuffle.unsafe.file.output.buffer` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/06/04 13:42:47 UTC, 4 replies.
- [PR] [MINOR][DOCS] Fix a typo in core-migration-guide.md [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/06/04 14:11:43 UTC, 2 replies.
- Re: [PR] [SPARK-48360] [WIP] Simplify conditionals with predicate branches [spark] - posted by "tom-s-powell (via GitHub)" <gi...@apache.org> on 2024/06/04 15:37:38 UTC, 0 replies.
- [PR] [SPARK-48524] Make Not IsNull semantically equal to IsNotNull and vice versa [spark] - posted by "tom-s-powell (via GitHub)" <gi...@apache.org> on 2024/06/04 15:43:42 UTC, 0 replies.
- [PR] [SPARK-48326] Use the official Apache Spark 4.0.0-preview1 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/06/04 16:10:25 UTC, 4 replies.
- [PR] [SPARK-48526] Allow passing custom sink to testStream() [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2024/06/04 16:30:38 UTC, 0 replies.
- [PR] [SPARK-48528] Refine K8s Operator `merge_spark_pr.py` to use `kubernetes-operator-x.y.z` version [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/06/04 16:44:50 UTC, 5 replies.
- [PR] [SPARK-48531][INFRA] Fix `Black` target version to Python 3.9 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/06/04 16:59:33 UTC, 4 replies.
- [PR] [WIP][SQL] Collation support for Char/Varchar [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/06/04 18:22:20 UTC, 0 replies.
- Re: [PR] [DRAFT][SQL] Draft string comparison for UTF8_BINARY_UCASE & UTF8_BINARY_TCASE [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/06/04 20:08:34 UTC, 0 replies.
- Re: [PR] [SPARK-48307][SQL] InlineCTE should keep not-inlined relations in the original WithCTE node [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/06/04 22:04:11 UTC, 1 replies.
- [PR] [SPARK-48307][SQL][FOLLOWUP] Allow outer references in un-referenced CTE relations [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/06/04 22:43:34 UTC, 3 replies.
- Re: [PR] [SPARK-48495][SQL][DOCS] Describe shredding scheme for Variant [spark] - posted by "shaeqahmed (via GitHub)" <gi...@apache.org> on 2024/06/04 23:38:43 UTC, 6 replies.
- Re: [PR] [SPARK-48411][SS][PYTHON] Add E2E test for DropDuplicateWithinWatermark [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/06/05 01:07:53 UTC, 2 replies.
- [PR] [SPARK-48532][BUILD] Upgrade maven plugin to latest version [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/05 01:23:19 UTC, 9 replies.
- [PR] [SPARK-48533][CONNECT][PYTHON][TESTS] Add test for cached schema [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/05 01:56:08 UTC, 2 replies.
- [PR] [SPARK-48374][PYTHON][TESTS][FOLLOW-UP] Explicitly enable ANSI mode for non-ANSI build [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/06/05 02:18:23 UTC, 2 replies.
- Re: [PR] [SPARK-44473][SQL] Overwriting the same partition of a partitioned table multiple times with empty data yields non-idempotent results [spark] - posted by "ychris78 (via GitHub)" <gi...@apache.org> on 2024/06/05 02:59:19 UTC, 0 replies.
- [PR] [SPARK-48505][FOLLOWUP] Further refactor [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/06/05 03:33:09 UTC, 1 replies.
- Re: [PR] [SPARK-48505][CORE][FOLLOWUP] Further refactor `Utils#isG1GC` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/06/05 03:53:20 UTC, 1 replies.
- [PR] [SPARK-47552][CORE][FOLLOWUP] Set spark.hadoop.fs.s3a.connection.establish.timeout to numeric [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/06/05 05:22:46 UTC, 8 replies.
- [PR] [SPARK-48535] Update config docs to indicate possibility of data loss/corruption issue if skip nulls for stream-stream joins config is enabled [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/06/05 06:09:45 UTC, 0 replies.
- Re: [PR] [SPARK-48535][SS] Update config docs to indicate possibility of data loss/corruption issue if skip nulls for stream-stream joins config is enabled [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/06/05 06:10:50 UTC, 2 replies.
- Re: [PR] [SPARK-46947][CORE] Delay memory manager initialization until Driver plugin is loaded [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2024/06/05 07:19:53 UTC, 2 replies.
- [PR] [SPARK-46937][SQL][FOLLOWUP] Properly check registered function replacement [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/06/05 07:22:19 UTC, 4 replies.
- Re: [PR] [SPARK-47258][SQL] Assign names to error classes _LEGACY_ERROR_TEMP_127[0-5] [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/06/05 07:40:57 UTC, 2 replies.
- [PR] [SPARK-48536][PYTHON][CONNECT] Cache user specified schema in applyInPandas and applyInArrow [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/05 07:53:44 UTC, 2 replies.
- [PR] [SPARK-48537][SQL] Support Hive UDAF inherit from `GenericUDAFResolver` and `GenericUDAFResolver2` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/05 08:28:38 UTC, 0 replies.
- [PR] [SPARK-48538][SQL] Avoid HMS memory leak casued by bonecp [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/06/05 10:26:00 UTC, 7 replies.
- Re: [PR] [SPARK-48537][SQL] Support Hive UDAF inherited from `GenericUDAFResolver` or `GenericUDAFResolver2` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/05 11:18:18 UTC, 2 replies.
- [PR] [Only Test] Sentences improve [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/05 12:06:59 UTC, 0 replies.
- [PR] [SPARK-48539][BUILD][TESTS] Upgrade docker-java to 3.3.6 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/06/05 12:29:29 UTC, 2 replies.
- [PR] [SPARK-48540][CORE] Avoid ivy output loading settings to stdout [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/06/05 13:29:24 UTC, 3 replies.
- [PR] [SPARK-48541][CORE] Add new exit code for executors killed by TaskReaper [spark] - posted by "bozhang2820 (via GitHub)" <gi...@apache.org> on 2024/06/05 14:30:44 UTC, 3 replies.
- Re: [PR] [SPARK-47336][SQL][CONNECT] Provide to PySpark a functionality to get estimated size of DataFrame in bytes [spark] - posted by "SemyonSinchenko (via GitHub)" <gi...@apache.org> on 2024/06/05 17:40:25 UTC, 0 replies.
- [PR] Metadata hdfs log [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/06/05 18:37:43 UTC, 1 replies.
- Re: [PR] [SPARK-48286] Fix analysis of column with exists default expression - Add user facing error [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2024/06/05 18:38:48 UTC, 17 replies.
- [PR] [SPARK-48543] Track state row validation failures using explicit error class [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/06/05 20:18:08 UTC, 1 replies.
- [PR] [SPARK-46124][FOLLOWUP][CONNECT][SS] Send all fields in StreamingQueryProgress [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/06/05 22:45:04 UTC, 1 replies.
- Re: [PR] [SPARK-46124][FOLLOWUP][CONNECT][SS] Send missing fields in StreamingQueryProgress to client [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/06/05 23:11:51 UTC, 8 replies.
- [PR] [SPARK-46124][FOLLOWUP][3.5][CONNECT][SS] Send missing fields in StreamingQueryProgress to client [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/06/05 23:16:07 UTC, 1 replies.
- [PR] [SPARK-48546][SQL] Fix ExpressionEncoder after replacing NullPointerExceptions with proper error classes in AssertNotNull expression [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/06/05 23:21:24 UTC, 3 replies.
- [PR] [SPARK-48547][DEPLOY] Add opt-in flag to have SparkSubmit automatically call System.exit after user code main method exits [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2024/06/05 23:21:32 UTC, 4 replies.
- Re: [PR] [SPARK-48543][SS] Track state row validation failures using explicit error class [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/06/05 23:57:41 UTC, 6 replies.
- Re: [PR] [WIP][SPARK-47103][ML] Make the default storage level of intermediate datasets for MLlib configurable [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/06/06 00:19:39 UTC, 1 replies.
- Re: [PR] [SPARK-46639][SQL] Add WindowExec SQLMetrics [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/06/06 00:19:40 UTC, 1 replies.
- Re: [PR] [SPARK-46714][SQL] Overwrite a partition with custom location [spark] - posted by "adrian-wang (via GitHub)" <gi...@apache.org> on 2024/06/06 02:12:59 UTC, 0 replies.
- [PR] [WIP] multi-line CSV schema inference should also throw FAILED_READ_FILE [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/06/06 04:24:34 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-48435][SQL] UNICODE collation should not support binary equality [spark] - posted by "mkaravel (via GitHub)" <gi...@apache.org> on 2024/06/06 05:18:55 UTC, 2 replies.
- [PR] [SPARK-48548][BUILD]Add LICENSE/NOTICE for spark-core with shaded dependencies [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/06/06 06:13:12 UTC, 0 replies.
- Re: [PR] [SPARK-48548][BUILD] Add LICENSE/NOTICE for spark-core with shaded dependencies [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/06/06 06:14:27 UTC, 2 replies.
- Re: [PR] [SPARK-47857][SQL] Utilize `java.sql.RowId.getBytes` API directly for UTF8String [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/06/06 06:39:18 UTC, 0 replies.
- Re: [PR] [SPARK-48435][SQL] UNICODE collation should not support binary equality [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/06/06 07:21:34 UTC, 2 replies.
- Re: [PR] [SPARK-48549][SQL] Restrict the number of parameters for function `sentences` to `1` or `3` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/06 07:45:41 UTC, 1 replies.
- [PR] [SPARK-48550][PS] Directly use the parent Window class [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/06 08:19:46 UTC, 2 replies.
- [PR] [Test Only] [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/06 09:09:37 UTC, 0 replies.
- [PR] [SPARK-48548][SQL] Perf improvement for escapePathName [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/06/06 09:11:42 UTC, 3 replies.
- Re: [PR] [SPARK-48552][SQL] multi-line CSV schema inference should also throw FAILED_READ_FILE [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/06/06 09:26:19 UTC, 5 replies.
- [PR] [SPARK-47933][PYTHON][TESTS][FOLLOW-UP] Enable doctest `pyspark.sql.connect.column` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/06 09:29:58 UTC, 2 replies.
- [PR] [SPARK-48553][PYTHON][CONNECT] Cache more properties [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/06 10:50:14 UTC, 2 replies.
- [PR] [SPARK-48554][INFRA] Use R 4.4.0 in `windows` R GitHub Action job [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/06 11:20:49 UTC, 0 replies.
- [PR] [SPARK-48504][PYTHON][CONNECT][FOLLOW-UP] Code clean up [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/06 11:53:11 UTC, 2 replies.
- [PR] [WIP][SQL] Invalid UTF-8 byte sequence replacement [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/06/06 15:04:41 UTC, 6 replies.
- Re: [PR] [SPARK-47050][SQL] Collect and publish partition level metrics [spark] - posted by "snmvaughan (via GitHub)" <gi...@apache.org> on 2024/06/06 15:09:24 UTC, 0 replies.
- Re: [PR] [SPARK-47050][SQL] Collect and publish partition level metrics for V1 [spark] - posted by "snmvaughan (via GitHub)" <gi...@apache.org> on 2024/06/06 15:25:53 UTC, 0 replies.
- [PR] [SPARK-48556] Fix incorrect error message pointing to UNSUPPORTED_GROUPING_EXPRESSION [spark] - posted by "nikolamand-db (via GitHub)" <gi...@apache.org> on 2024/06/06 16:32:44 UTC, 0 replies.
- Re: [PR] [SPARK-48554][INFRA] Use R 4.4.0 in `windows` R GitHub Action Window job [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/06/06 16:42:15 UTC, 0 replies.
- [PR] [SPARK-48555] Support using Columns as parameters for several functions in pyspark/scala [spark] - posted by "Ronserruya (via GitHub)" <gi...@apache.org> on 2024/06/06 17:05:10 UTC, 0 replies.
- Re: [PR] [SPARK-48555][SQL][PYTHON][CONNECT] Support using Columns as parameters for several functions in pyspark/scala [spark] - posted by "Ronserruya (via GitHub)" <gi...@apache.org> on 2024/06/06 17:07:52 UTC, 11 replies.
- Re: [PR] [SPARK-48526][SS] Allow passing custom sink to testStream() [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/06/06 18:19:43 UTC, 1 replies.
- [PR] [SPARK-48557][SQL] Support scalar subquery with group-by on column equal to constant [spark] - posted by "jchen5 (via GitHub)" <gi...@apache.org> on 2024/06/06 18:41:40 UTC, 7 replies.
- [PR] [MINOR] add export class and fix doc typo for python streaming data source [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2024/06/06 18:48:18 UTC, 0 replies.
- [PR] [SPARK-48558][CORE] Improve accumulator V2 error message [spark] - posted by "parthchandra (via GitHub)" <gi...@apache.org> on 2024/06/06 20:55:55 UTC, 8 replies.
- [PR] [SPARK-46393][SQL][FOLLOWUP] Classify exceptions in JDBCTableCatalog.loadTable [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/06/06 23:16:32 UTC, 6 replies.
- [PR] [WIP] fix python streaming data source connect test [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2024/06/06 23:17:24 UTC, 1 replies.
- [PR] Fetch globalTempDatabase name directly without invoking initializatio… [spark] - posted by "willwwt (via GitHub)" <gi...@apache.org> on 2024/06/06 23:41:47 UTC, 0 replies.
- [PR] [SPARK-37448][SQL] Multiple performance optimizations related to CurrentOrigin.withOrigin [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2024/06/06 23:55:17 UTC, 7 replies.
- Re: [PR] [MINOR][PYTHON] add export class and fix doc typo for python streaming data source [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/06/07 00:10:22 UTC, 1 replies.
- [PR] [SPARK-48560][SS][PYTHON] Make StreamingQueryListener.spark settable [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/06/07 01:15:57 UTC, 7 replies.
- [PR] [TEST Only] test unsafe ut [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/07 02:09:48 UTC, 1 replies.
- Re: [PR] [SPARK-47910][CORE] close stream when DiskBlockObjectWriter closeResources to avoid memory leak [spark] - posted by "JacobZheng0927 (via GitHub)" <gi...@apache.org> on 2024/06/07 02:39:44 UTC, 6 replies.
- [PR] [SPARK-48561][PS][CONNECT] Throw `PandasNotImplementedError` for unsupported plotting functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/07 03:16:34 UTC, 5 replies.
- Re: [PR] [SPARK-48551][SQL] Perf improvement for escapePathName [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/06/07 03:33:02 UTC, 24 replies.
- Re: [PR] [SPARK-48403][SQL] Fix Lower & Upper expressions for UTF8_BINARY_LCASE & ICU collations [spark] - posted by "mkaravel (via GitHub)" <gi...@apache.org> on 2024/06/07 05:47:44 UTC, 3 replies.
- Re: [PR] [SPARK-19335][SPARK-38200][SQL] Add upserts for writing to JDBC [spark] - posted by "harshith-bolar-rapido (via GitHub)" <gi...@apache.org> on 2024/06/07 06:49:33 UTC, 1 replies.
- [PR] [SPARK-46393][SQL][TESTS] Fix UT [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/07 08:10:28 UTC, 4 replies.
- Re: [PR] [SPARK-46393][SQL][FOLLOWUP] Classify exceptions in JDBCTableCatalog.loadTable and Fix UT [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/07 08:44:59 UTC, 11 replies.
- Re: [PR] [SPARK-48559][SQL] Fetch globalTempDatabase name directly without invoking initialization of GlobalaTempViewManager [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/06/07 08:53:27 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-37448][SQL] Multiple performance optimizations related to CurrentOrigin.withOrigin [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2024/06/07 09:15:52 UTC, 1 replies.
- [PR] [SPARK-48563][BUILD] Upgrade `pickle` to 1.5 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/06/07 09:34:53 UTC, 2 replies.
- [PR] [MINOR][PYTHON][TESTS] Move a test out of parity tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/07 10:15:00 UTC, 3 replies.
- [PR] [SPARK-48564][PYTHON][CONNECT] Propagate cached schema in set operations [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/07 10:19:41 UTC, 3 replies.
- [PR] [SPARK-48565][UI] Fix thread dump display in UI [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/06/07 12:05:02 UTC, 4 replies.
- [PR] Cxollationmode [spark] - posted by "GideonPotok (via GitHub)" <gi...@apache.org> on 2024/06/07 16:05:21 UTC, 1 replies.
- Re: [PR] [SPARK-48556][SQL] Fix incorrect error message pointing to UNSUPPORTED_GROUPING_EXPRESSION [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/06/07 18:33:59 UTC, 2 replies.
- [PR] [SPARK-48566][PYTHON] Fix bug where partition indices are incorrect when UDTF analyze() uses both select and partitionColumns [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/06/07 19:20:55 UTC, 6 replies.
- Re: [PR] [SPARK-48511][SS] Remove TimeMode None from TransformWithState. [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/06/07 20:51:36 UTC, 12 replies.
- [PR] [SPARK-48544][SQL] Reduce memory pressure of empty TreeNode BitSets [spark] - posted by "n-young-db (via GitHub)" <gi...@apache.org> on 2024/06/07 22:33:24 UTC, 3 replies.
- Re: [PR] [SPARK-47153][CORE] Guard serialize/deserialize in JavaSerializer with try-with-resource block [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/06/08 00:20:33 UTC, 1 replies.
- Re: [PR] [SPARK-45880][SQL] Make the like `pattern` semantics used in all commands consistent [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/06/08 00:20:35 UTC, 1 replies.
- Re: [PR] [SPARK-48012][SQL] SPJ: Support Transfrom Expressions for One Side Shuffle [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2024/06/08 02:05:59 UTC, 4 replies.
- [PR] [SPARK-48569][SS][CONNECT] Handle edge cases in query.name [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/06/08 03:39:10 UTC, 4 replies.
- [PR] [SPARK-48567][DO-NOT-REVIEW] last progress [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/06/08 03:43:01 UTC, 3 replies.
- Re: [PR] [SPARK-47547][SQL] Fix inaccurate false positive rates when N is large for Bloom Filter [spark] - posted by "batubond007 (via GitHub)" <gi...@apache.org> on 2024/06/08 11:18:29 UTC, 0 replies.
- [PR] [Only Test] Test javadoc [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/08 12:45:26 UTC, 1 replies.
- Re: [PR] [SPARK-48421][SQL] SPJ: Add documentation [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/06/08 20:17:19 UTC, 7 replies.
- Re: [PR] [SPARK-47222][SQL] fileCompressionFactor also applied to the size of the table [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/06/09 00:22:56 UTC, 1 replies.
- [PR] [PYTHON] Fix pyspark.sql.functions.reduce docstring typo [spark] - posted by "kaashif (via GitHub)" <gi...@apache.org> on 2024/06/09 03:35:21 UTC, 1 replies.
- Re: [PR] [SPARK-47188][SQL] Add configuration to determine whether to exclude hive statistics properties [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/06/10 00:20:59 UTC, 1 replies.
- [PR] [WIP][SQL] Rename UTF8_BINARY_LCASE to UTF8_LCASE [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/06/10 05:27:36 UTC, 0 replies.
- Re: [PR] [SPARK-48576][SQL] Rename UTF8_BINARY_LCASE to UTF8_LCASE [spark] - posted by "superdiaodiao (via GitHub)" <gi...@apache.org> on 2024/06/10 08:02:50 UTC, 6 replies.
- [PR] [WIP][SPARK-48311][SQL] Fix nested pythonUDF in groupBy and aggregate Bind… [spark] - posted by "sumitsingh-in (via GitHub)" <gi...@apache.org> on 2024/06/10 08:25:00 UTC, 0 replies.
- [PR] [WIP][SQL] Collation support for Char/Varchar (v2) [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/06/10 09:11:36 UTC, 0 replies.
- Re: [PR] [SPARK-47415][SQL] Add collation support for Levenshtein expression [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/06/10 11:42:24 UTC, 3 replies.
- [PR] check whether RocksDB already loads with the latest snapshot [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2024/06/10 17:20:50 UTC, 1 replies.
- [PR] Corrected row index usage when exploding packed arrays in vectorized reader [spark] - posted by "djspiewak (via GitHub)" <gi...@apache.org> on 2024/06/10 17:59:42 UTC, 1 replies.
- Re: [PR] [SPARK-48567][DO-NOT-REVIEW] Make StreamingQueryProgress and friends subclasses of dict [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/06/10 18:09:36 UTC, 0 replies.
- Re: [PR] [SPARK-48567][SS] StreamingQuery.lastProgress should return the actual StreamingQueryProgress [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/06/10 21:50:45 UTC, 9 replies.
- [PR] [DO-NOT-REVIEW][SPARK-48480][SS][Connect] StreamingQueryListener should not be affected by spark.interrupt() [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/06/10 22:02:21 UTC, 0 replies.
- Re: [PR] [SPARK-48416][SQL] Support related nested WITH expression [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2024/06/10 22:53:49 UTC, 1 replies.
- [PR] [SPARK-47500][PYTHON][CONNECT][FOLLOWUP] Restore error message for `DataFrame.select(None)` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/11 00:48:56 UTC, 2 replies.
- [PR] Bump braces from 3.0.2 to 3.0.3 in /ui-test [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/06/11 02:37:25 UTC, 3 replies.
- [PR] [SPARK-48581][Build] Upgrade dropwizard metrics to 4.2.26 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/06/11 03:38:44 UTC, 0 replies.
- [PR] [SPARK-48582][BUILD] Upgrade `braces` from 3.0.2 to 3.0.3 in ui-test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/06/11 05:02:14 UTC, 4 replies.
- Re: [PR] [SPARK-48577][SQL] Invalid UTF-8 byte sequence replacement [spark] - posted by "mkaravel (via GitHub)" <gi...@apache.org> on 2024/06/11 05:24:27 UTC, 5 replies.
- Re: [PR] [SPARK-48578][SQL] UTF8 string validation [spark] - posted by "mkaravel (via GitHub)" <gi...@apache.org> on 2024/06/11 05:47:39 UTC, 5 replies.
- [PR] Add consistency check and fallback for mapIds in push-merged block meta [spark] - posted by "gaoyajun02 (via GitHub)" <gi...@apache.org> on 2024/06/11 06:56:00 UTC, 0 replies.
- [PR] [SPARK-48583][SQL][TESTS] Replace deprecated `FileUtils#writeStringToFile` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/06/11 07:51:39 UTC, 5 replies.
- [PR] [SPARK-48372][SPARK-45716][PYTHON][FOLLOW-UP] Remove unused helper method [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/11 07:54:18 UTC, 2 replies.
- Re: [PR] [SPARK-46741][SQL] Cache Table with CTE won't work [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2024/06/11 08:15:05 UTC, 0 replies.
- Re: [PR] [SPARK-48580] Add consistency check and fallback for mapIds in push-merged block meta [spark] - posted by "gaoyajun02 (via GitHub)" <gi...@apache.org> on 2024/06/11 08:53:00 UTC, 1 replies.
- [PR] [Only Test] test first [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/11 09:30:02 UTC, 0 replies.
- [PR] [SPARK-48584][SQL]Perf improvement for unescapePathName [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/06/11 11:06:27 UTC, 0 replies.
- Re: [PR] [SPARK-48585][SQL] Make `JdbcDialect.classifyException` throw out the `original` exception [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/11 11:24:54 UTC, 11 replies.
- Re: [PR] [WIP] [PROOF OF CONCEPT] [SPARK] [SQL] Collation Mode [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/06/11 14:56:21 UTC, 17 replies.
- [PR] [SQL] Follow-up PR on renaming UTF8_BINARY_LCASE to UTF8_LCASE [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/06/11 17:33:53 UTC, 1 replies.
- Re: [PR] [SPARK-48576][SQL][FOLLOWUP] Rename UTF8_BINARY_LCASE to UTF8_LCASE [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/06/11 17:37:53 UTC, 1 replies.
- [PR] Revert "[SPARK-46937][SQL] Improve concurrency performance for FunctionRegistry" [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/06/11 17:47:38 UTC, 4 replies.
- [PR] [SPARK-48587][VARIANT] Avoid storage amplification when accessing a sub-Variant [spark] - posted by "cashmand (via GitHub)" <gi...@apache.org> on 2024/06/11 18:03:35 UTC, 2 replies.
- [PR] [WIP] [SPARK-48586] Remove lock contention between maintenance and task [spark] - posted by "riyaverm-db (via GitHub)" <gi...@apache.org> on 2024/06/11 18:32:51 UTC, 1 replies.
- Re: [PR] [WIP] [SPARK-48586] Remove lock contention between maintenance and task threads [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2024/06/11 18:47:24 UTC, 3 replies.
- [PR] [WIP][SPARK-48572] Fix DateSub, DateAdd, WindowTime, TimeWindow and SessionWindow expressions [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/06/11 18:54:06 UTC, 3 replies.
- Re: [PR] [SPARK-24497][SQL] Support recursive SQL [spark] - posted by "jboarman (via GitHub)" <gi...@apache.org> on 2024/06/11 19:44:06 UTC, 0 replies.
- [PR] [SPARK-48588][SS] Add option snapshotStartBatchId and snapshotPartitionId to state data source [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2024/06/11 20:29:35 UTC, 0 replies.
- Re: [PR] [SPARK-47577][CORE][PART1] Migrate logError with variables to structured logging framework [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/06/11 22:07:17 UTC, 5 replies.
- [PR] [SPARK-48590][BUILD] Upgrade netty to `4.1.111.Final` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/11 23:12:29 UTC, 1 replies.
- [PR] [SPARK-48591][PYTHON] Simplify the if-else branches with `F.lit` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/12 00:46:06 UTC, 3 replies.
- [PR] [SPARK-48592][INFRA] Add scala style check for logging message inline variables [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2024/06/12 01:14:26 UTC, 13 replies.
- [PR] [SPARK-48593][PYTHON][CONNECT] Fix the string representation of lambda function [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/12 01:43:02 UTC, 2 replies.
- [PR] [SPARK-48594][PYTHON][CONNECT] Rename `parent` field to `child` in `ColumnAlias` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/12 02:05:57 UTC, 2 replies.
- Re: [PR] [SPARK-48584][SQL] Perf improvement for unescapePathName [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/06/12 02:06:52 UTC, 12 replies.
- [PR] [SPARK-48595][CORE] Cleanup deprecated api usage related to `commons-compress` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/06/12 05:20:40 UTC, 4 replies.
- Re: [PR] [SPARK-46798][Structured Streaming] Kafka custom partition location assignment (rack awareness) [spark] - posted by "SubhamSinghal (via GitHub)" <gi...@apache.org> on 2024/06/12 05:35:44 UTC, 0 replies.
- [PR] [SPARK-47577][SPARK-47579] Correct misleading usage of log key TASK_ID [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/06/12 05:42:06 UTC, 17 replies.
- [PR] [SPARK-48596][SQL] Perf improvement for calculating hex string for long [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/06/12 06:48:13 UTC, 7 replies.
- Re: [PR] [SPARK-48581][BUILD] Upgrade dropwizard metrics to 4.2.26 [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/06/12 07:41:49 UTC, 1 replies.
- [PR] [SPARK-48597][SQL] Introduce a marker for isStreaming property in text representation of logical plan [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/06/12 08:02:54 UTC, 9 replies.
- [PR] [SPARK-48598][PYTHON][CONNECT] Propagate cached schema in dataframe operations [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/12 08:03:13 UTC, 2 replies.
- Re: [PR] [SPARK-48583][SQL][TESTS] Replace deprecated classes and methods of `commons-io` called in Spark [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/06/12 09:57:40 UTC, 4 replies.
- [PR] [SPARK-48601] Give a more user friendly error message when setting a null value for JDBC Option [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2024/06/12 11:07:50 UTC, 11 replies.
- [PR] [SPARK-48602][SQL] Make csv generator support different output style with spark.sql.binaryOutputStyle [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/06/12 12:16:36 UTC, 3 replies.
- [PR] [SPARK-48584][SQL][FOLLOWUP] Improve the unescapePathName. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2024/06/12 12:56:19 UTC, 6 replies.
- [PR] [SPARK-48498][SQL][3.5] Always do char padding in predicates [spark] - posted by "jackylee-ch (via GitHub)" <gi...@apache.org> on 2024/06/12 12:59:00 UTC, 9 replies.
- [PR] [SPARK-48603][TEST] Update *ParquetReadSchemaSuite to cover type widen capability [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/06/12 14:02:32 UTC, 2 replies.
- Re: [PR] [SPARK-48382]Add controller / reconciler module to operator [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/06/12 14:29:11 UTC, 21 replies.
- [PR] [Connect][WIP] Dataset.mergeInto [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/06/12 14:43:58 UTC, 0 replies.
- [PR] [SPARK-48604][SQL] Replace deprecated `new ArrowType.Decimal(precision, scale)` method call [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/06/12 14:54:29 UTC, 8 replies.
- [PR] [SPARK-48605][CORE][UI] UI display driver thread first on the thread dump page [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/06/12 15:18:17 UTC, 7 replies.
- [PR] [SPARK-48606] Upgrade `google-java-format` to 1.22.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/06/12 16:03:29 UTC, 3 replies.
- [PR] [MINOR][DOCS][TESTS] Update repo name and link from `parquet-mr` to `parquet-java` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/06/12 16:22:04 UTC, 5 replies.
- Re: [PR] [SPARK-48589][SQL][SS] Add option snapshotStartBatchId and snapshotPartitionId to state data source [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2024/06/12 20:26:20 UTC, 16 replies.
- [PR] [SPARK-48609][BUILD] Upgrade `scala-xml` to 2.3 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/12 23:34:22 UTC, 0 replies.
- Re: [PR] [SPARK-48585][SQL] Make `built-in` JdbcDialect's method `classifyException` throw out the `original` exception [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/13 01:14:51 UTC, 6 replies.
- [PR] [SPARK-48610][SQL] refactor: use auxiliary idMap instead of OP_ID_TAG [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2024/06/13 02:08:13 UTC, 5 replies.
- [PR] [SPARK-48611][CORE] Log TID for input split in HadoopRDD and NewHadoopRDD [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/06/13 06:28:56 UTC, 5 replies.
- Re: [PR] [WIP][BUILD] Test scala-xml 2.3.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/06/13 06:43:52 UTC, 0 replies.
- Re: [PR] [SPARK-48609][BUILD] Upgrade `scala-xml` to 2.3.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/06/13 06:45:37 UTC, 1 replies.
- [PR] [SPARK-48612] Cleanup deprecated api usage related to commons-pool2 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/06/13 06:47:56 UTC, 0 replies.
- Re: [PR] [SPARK-46575][SQL][FOLLOWUP] Add back `HiveThriftServer2.startWithContext(SQLContext)` method for compatibility [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/06/13 06:49:20 UTC, 0 replies.
- [PR] [SPARK-48614][SQL][SS] Cleanup deprecated api usage related to `kafka-clients` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/06/13 08:07:38 UTC, 1 replies.
- Re: [PR] [SPARK-48280][SQL] Improve collation testing surface area using expression walking [spark] - posted by "dbatomic (via GitHub)" <gi...@apache.org> on 2024/06/13 08:20:28 UTC, 2 replies.
- [PR] [WIP][SQL] fine-grained jdbc error [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/13 08:39:05 UTC, 3 replies.
- [PR] [SPARK-45685][SQL] Add handling for `Stream` where `LazyList.force` is called [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/06/13 08:51:38 UTC, 2 replies.
- [PR] [SPARK-48056][CONNECT][SCALA] Re-execute plan if a SESSION_NOT_FOUND … [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/06/13 09:20:52 UTC, 4 replies.
- Re: [PR] [SPARK-45685][CORE][SQL] Use `LazyList` instead of `Stream` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/06/13 09:24:20 UTC, 1 replies.
- [PR] [SPARK-48615][SQL] Perf improvement for parsing hex string [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/06/13 10:20:44 UTC, 13 replies.
- Re: [PR] [SPARK-48618][SQL] Use the `ErrorCode` and `SQLState` returned in SQLException to make errors more accurate [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/13 11:04:35 UTC, 1 replies.
- Re: [PR] [SPARK-48056][CONNECT][PYTHON] Re-execute plan if a SESSION_NOT_FOUND error is raised and no partial response was received [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/06/13 11:08:30 UTC, 0 replies.
- [PR] [DOC] fix metrics info of shuffleService [spark] - posted by "j7nhai (via GitHub)" <gi...@apache.org> on 2024/06/13 12:26:11 UTC, 0 replies.
- [PR] [SPARK-48619] Fix reference error when grouping by MapType [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2024/06/13 12:57:55 UTC, 11 replies.
- [PR] [SPARK-48620][PYTHON] Fix internal raw data leak in `YearMonthIntervalType` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/13 13:25:16 UTC, 2 replies.
- [PR] [SPARK-48621][SQL] Fix Like simplification in Optimizer for collated strings [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/06/13 13:39:13 UTC, 7 replies.
- [PR] [SPARK-48545][SQL] Create to_avro and from_avro SQL functions to match DataFrame equivalents [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/06/13 16:50:11 UTC, 3 replies.
- [PR] [SPARK-45621] Add feature to evaluate subquery before push down filter Optimizer rule [spark] - posted by "maytasm (via GitHub)" <gi...@apache.org> on 2024/06/13 17:01:18 UTC, 3 replies.
- [PR] [SPARK-48286] Fix column default value check - Add error class [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2024/06/13 19:30:46 UTC, 2 replies.
- [PR] [SPARK-48622][SQL] get SQLConf once when resolving column names [spark] - posted by "andrewxue-db (via GitHub)" <gi...@apache.org> on 2024/06/13 20:01:05 UTC, 2 replies.
- [PR] [DRAFT] Scala Structured Logging Migration [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2024/06/13 20:06:39 UTC, 0 replies.
- Re: [PR] [SPARK-48623][INFRA] Structured Logging Framework Scala Style Migration [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/06/13 23:59:50 UTC, 47 replies.
- Re: [PR] [SPARK-46989][SQL][CONNECT] Improve concurrency performance for SparkSession [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/06/14 00:20:00 UTC, 1 replies.
- Re: [PR] [MINOR][DOCS] Fix metrics info of shuffle service [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/06/14 02:10:02 UTC, 1 replies.
- [PR] [SPARK-48625][BUILD] upgrade `mssql-jdbc` to 12.6.2.jre11 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/06/14 02:47:59 UTC, 0 replies.
- [PR] [SPARK-47597][FOLLOWUP] Streaming: Migrate logInfo with variables to structured logging framework [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/14 03:29:17 UTC, 13 replies.
- Re: [PR] [SPARK-42616][SQL] SparkSQLCLIDriver shall only close started hive sessionState [spark] - posted by "wecharyu (via GitHub)" <gi...@apache.org> on 2024/06/14 03:58:42 UTC, 0 replies.
- Re: [PR] [SPARK-45685][SQL][FOLLOWUP] Add handling for `Stream` where `LazyList.force` is called [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/06/14 04:30:56 UTC, 1 replies.
- Re: [PR] [SPARK-48612][SQL][SS] Cleanup deprecated api usage related to `commons-pool2` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/06/14 04:36:30 UTC, 1 replies.
- [PR] [SPARK-48626][Core] Change the scope of object LogKeys as private in Spark [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/06/14 05:09:45 UTC, 0 replies.
- [PR] [SPARK-48627][SQL] Perf improvement for binary to to HEX_DISCRETE string [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/06/14 05:50:05 UTC, 7 replies.
- Re: [PR] [SPARK-48625][BUILD] Upgrade `mssql-jdbc` to 12.6.2.jre11 [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/06/14 05:54:55 UTC, 1 replies.
- Re: [PR] [SPARK-48626][CORE] Change the scope of object LogKeys as private in Spark [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/06/14 07:08:50 UTC, 1 replies.
- [PR] Revert "[SPARK-48591][PYTHON] Simplify the if-else branches with `F.lit`" [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/14 07:38:14 UTC, 2 replies.
- [PR] [SPARK-48629] Migrate the remaining code to structured logging framework [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/14 08:24:49 UTC, 2 replies.
- Re: [PR] [SPARK-48056][CONNECT][FOLLOW-UP] Scala Client re-execute plan if a SESSION_NOT_FOUND error is raised and no partial response was received [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/14 08:31:51 UTC, 0 replies.
- [PR] [SPARK-48600][SQL] Fix FrameLessOffsetWindowFunction expressions implicit casting [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/06/14 09:11:05 UTC, 8 replies.
- Re: [PR] [WIP][SQL] Data types in complex type creator should respect collation [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/06/14 09:20:23 UTC, 1 replies.
- [PR] [SPARK-48630][INFRA][WIP] Make `merge_spark_pr` properly format revert PR [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/14 09:35:08 UTC, 2 replies.
- [PR] [SPARK-48631][CORE][TEST] Fix test "error during accessing host local dirs for executors" [spark] - posted by "bozhang2820 (via GitHub)" <gi...@apache.org> on 2024/06/14 12:56:30 UTC, 4 replies.
- [PR] [SPARK-48632][INFRA] Remove unused LogKeys [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2024/06/14 14:54:53 UTC, 2 replies.
- [PR] [SPARK-48472][SQL] Enable reflect expressions with collated strings [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2024/06/14 15:44:13 UTC, 10 replies.
- [PR] [SPARK-48633][BUILD] Upgrade `scalacheck` to 1.18.0 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/06/14 16:10:50 UTC, 3 replies.
- [PR] [SPARK-48634][PYTHON][CONNECT] Avoid statically initialize threadpool at ExecutePlanResponseReattach… [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/06/14 18:28:34 UTC, 0 replies.
- Re: [PR] [SPARK-48459][CONNECT][PYTHON] Implement DataFrameQueryContext in Spark Connect [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/06/14 18:36:31 UTC, 40 replies.
- [PR] [SPARK-48635][SQL] Assign classes to join type errors and one left as-of join error [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/06/14 18:51:13 UTC, 0 replies.
- Re: [PR] [SPARK-11150][SQL] Dynamic Partition Pruning [spark] - posted by "chenfengbin2009 (via GitHub)" <gi...@apache.org> on 2024/06/16 02:51:33 UTC, 0 replies.
- Re: [PR] [SPARK-48634][PYTHON][CONNECT] Avoid statically initialize threadpool at ExecutePlanResponseReattachableIterator [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/06/16 07:54:01 UTC, 6 replies.
- [PR] [SPARK-48637][CORE] On-demand shuffle migration peer refresh during decommission [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2024/06/16 13:12:00 UTC, 2 replies.
- [PR] [WIP][SPARK-48638][CONNECT] Add QueryExecution support for DataFrame [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/06/16 20:40:26 UTC, 9 replies.
- [PR] [SPARK-48574][SQL] Fix support for StructTypes with collations [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/06/16 21:39:03 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-47321][INFRA] Upgrade `dawidd6/action-download-artifact` to v4 and `scacap/action-surefire-report` to latest [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/06/17 00:21:25 UTC, 1 replies.
- Re: [PR] [SPARK-47777] fix python streaming data source connect test [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/06/17 00:28:04 UTC, 1 replies.
- Re: [PR] [MINOR][PYTHON][DOCS] Fix pyspark.sql.functions.reduce docstring typo [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/17 01:12:14 UTC, 1 replies.
- [PR] [SPARK-48641][BUILD] Upgrade `curator` to 5.7.0 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/06/17 03:31:18 UTC, 1 replies.
- Re: [PR] [SPARK-48635][SQL] Assign classes to join type errors and as-of join error [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/06/17 03:45:32 UTC, 0 replies.
- [PR] [SPARK-48643] Narrow down default regex of sql options redaction [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/06/17 07:07:27 UTC, 0 replies.
- [PR] [SPARK-48642][CORE] False SparkOutOfMemoryError caused by killing task on spilling [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/06/17 07:20:33 UTC, 4 replies.
- Re: [PR] [SPARK-48572][SQL] Fix DateSub, DateAdd, WindowTime, TimeWindow and SessionWindow expressions [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/06/17 08:22:18 UTC, 2 replies.
- Re: [PR] [SPARK-48620][PYTHON] Fix internal raw data leak in `YearMonthIntervalType` and `CalendarIntervalType` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/17 09:02:34 UTC, 0 replies.
- [PR] [SPARK-48644][SQL] Do a length check and throw COLLECTION_SIZE_LIMIT_EXCEEDED error in Hex.hex [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/06/17 09:53:18 UTC, 15 replies.
- Re: [PR] [SPARK-48578][SQL] add UTF8 string validation related functions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/06/17 13:38:53 UTC, 5 replies.
- Re: [PR] [SPARK-48177][BUILD] Upgrade `Apache Parquet` to 1.14.1 [spark] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2024/06/17 16:22:14 UTC, 11 replies.
- [PR] [SPARK-48645][BUILD] Upgrade Maven to 3.9.8 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/06/17 18:10:33 UTC, 2 replies.
- Re: [PR] [SPARK-48286][SQL][3.5] Fix column default value check - Add error class [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/06/17 18:38:25 UTC, 1 replies.
- [PR] [SPARK-48646][PYTHON] Refine Python data source API docstring and type hints [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/06/17 21:28:33 UTC, 5 replies.
- Re: [PR] [SPARK-48479][SQL] Support creating scalar and table SQL UDFs in parser [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/06/17 22:13:35 UTC, 5 replies.
- Re: [PR] [SPARK-48490][CORE] Unescapes any literals for message of MessageWithContext [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/06/17 22:15:10 UTC, 0 replies.
- Re: [PR] [SPARK-48643][SQL] Narrow down default regex of sql options redaction [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/06/18 02:47:32 UTC, 2 replies.
- [PR] [SPARK-48647][PYTHON][CONNECT] Refine the error message for `YearMonthIntervalType` in `df.collect` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/18 03:36:42 UTC, 2 replies.
- [PR] [SPARK-48648][PYTHON][CONNECT] Make SparkConnectClient.tags properly threadlocal [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/06/18 03:41:49 UTC, 2 replies.
- [PR] [SPARK-48649] Add "ignoreInvalidPartitionPaths" and "spark.sql.files.ignoreInvalidPartitionPaths" configs to allow ignoring invalid partition paths [spark] - posted by "sadikovi (via GitHub)" <gi...@apache.org> on 2024/06/18 05:39:01 UTC, 0 replies.
- Re: [PR] [SPARK-48580][CORE] Add consistency check and fallback for mapIds in push-merged block meta [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/06/18 05:46:48 UTC, 4 replies.
- [PR] [SPARK-47148][SQL][FOLLOWUP] Use broadcast hint to make test more stable [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/06/18 07:11:32 UTC, 3 replies.
- [PR] [SPARK-47986][CONNECT][SCALA] Unable to create a new session when the default session is closed by the server [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/06/18 08:08:00 UTC, 0 replies.
- [PR] [SPARK-48650][PYTHON] Display correct call site from IPython Notebook [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/06/18 08:24:22 UTC, 7 replies.
- Re: [PR] [SPARK-47986][CONNECT][PYTHON] Unable to create a new session when the default session is closed by the server [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/06/18 09:37:37 UTC, 0 replies.
- [PR] [SPARK-48651][DOC] Configuring different JDK for Spark on YARN [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/06/18 10:13:34 UTC, 6 replies.
- Re: [PR] [SPARK-48638][CONNECT] Add QueryExecution support for DataFrame [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/18 10:56:58 UTC, 7 replies.
- [PR] [SPARK-48573][SQL] Upgrade ICU version [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/06/18 11:07:18 UTC, 8 replies.
- [PR] Bump ws from 8.14.2 to 8.17.1 in /ui-test [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/06/18 19:54:21 UTC, 2 replies.
- [PR] [SPARK-48653][PYTHON] Fix invalid Python data source error class references [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/06/18 20:14:43 UTC, 1 replies.
- [PR] [WIP][SQL] Fix CollationFactory API [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/06/18 21:37:22 UTC, 0 replies.
- Re: [PR] [SPARK-48649][SQL] Add "ignoreInvalidPartitionPaths" and "spark.sql.files.ignoreInvalidPartitionPaths" configs to allow ignoring invalid partition paths [spark] - posted by "sadikovi (via GitHub)" <gi...@apache.org> on 2024/06/21 14:22:11 UTC, 2 replies.
- [PR] [SPARK-48655][SQL] SPJ: Add tests for shuffle skipping for aggregate queries [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2024/06/21 14:23:28 UTC, 0 replies.
- Re: [PR] [SPARK-48541][CORE] Add a new exit code for executors killed by TaskReaper [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2024/06/21 14:23:34 UTC, 1 replies.
- [PR] [SPARK-48656][Core] Throw better exception message when CartesianRDD partitions overflow [spark] - posted by "timlee0119 (via GitHub)" <gi...@apache.org> on 2024/06/21 14:24:07 UTC, 0 replies.
- Re: [PR] [SPARK-48601][SQL] Give a more user friendly error message when setting a null value for JDBC Option [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/06/21 14:25:00 UTC, 1 replies.
- Re: [PR] [SPARK-47986][CONNECT][FOLLOW-UP] Unable to create a new session when the default session is closed by the server [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/06/21 14:25:44 UTC, 1 replies.
- Re: [PR] [SPARK-48664] Add Apache Spark 4.0.0-preview1 Dockerfiles [spark-docker] - posted by "Yikun (via GitHub)" <gi...@apache.org> on 2024/06/21 14:26:55 UTC, 0 replies.
- Re: [PR] [SPARK-48656][CORE] Do a length check and throw COLLECTION_SIZE_LIMIT_EXCEEDED error in `CartesianRDD.getPartitions` [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/06/21 14:27:58 UTC, 1 replies.
- [PR] [SPARK-48490][CORE][TESTS][FOLLOWUP] Add some UT to the Windows paths scene [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/21 14:28:26 UTC, 0 replies.
- Re: [PR] [SPARK-48490][CORE][FOLLOWUP] Properly process escape sequences [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/06/21 14:28:39 UTC, 1 replies.
- Re: [PR] [SPARK-48490][CORE][TESTS][FOLLOWUP] Add some UT for the Windows paths scene [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/21 14:28:47 UTC, 0 replies.
- Re: [PR] [SPARK-48664][FOLLOWUP] Update 4.0.0-preview1 [spark-docker] - posted by "Yikun (via GitHub)" <gi...@apache.org> on 2024/06/21 14:29:22 UTC, 3 replies.
- [PR] [SPARK-48680][DOCS] Add char/varchar doc to language specific tables [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/06/21 14:29:58 UTC, 1 replies.
- Re: [PR] [SPARK-48638][CONNECT] Add ExecutionInfo support for DataFrame [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/06/23 06:30:26 UTC, 6 replies.
- [PR] [SPARK-47046][BUILD] Upgrade `mockito` to 5.12.0 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/06/23 15:58:40 UTC, 0 replies.
- Re: [PR] [SPARK-48688][SQL] Return reasonable error when calling SQL to_avro and from_avro functions but Avro is not loaded by default [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/06/23 23:25:00 UTC, 1 replies.
- Re: [PR] [SPARK-47379][TESTS] Improve docker JDBC suite test reliability [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/06/24 00:21:40 UTC, 0 replies.
- Re: [PR] [SPARK-48629] Migrate the residual code to structured logging framework [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/06/24 02:00:21 UTC, 16 replies.
- Re: [PR] [SPARK-48692][BUILD] Upgrade `rocksdbjni` to 9.2.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/06/24 02:24:15 UTC, 3 replies.
- Re: [PR] [SPARK-47681][FOLLOWUP] Fix schema_of_variant for float inputs. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/06/24 02:46:07 UTC, 2 replies.
- [PR] [SPARK-48693][SQL] Simplify and unify toString of Invoke and StaticInvoke [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/06/24 05:30:35 UTC, 1 replies.
- Re: [PR] [SPARK-48686][SQL] Improve performance of ParserUtils.unescapeSQLString [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/06/24 05:43:34 UTC, 1 replies.
- Re: [PR] [SQL][TEST][FOLLOWUP] Re-run collation benchmark (NonASCII) [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/06/24 06:31:26 UTC, 1 replies.
- [PR] [SPARK-48694][CORE]Manage memory used by external cache [spark] - posted by "yma11 (via GitHub)" <gi...@apache.org> on 2024/06/24 07:13:50 UTC, 0 replies.
- Re: [PR] [SPARK-48687][SS] Add change to perform state schema validation and update on driver in planning phase for stateful queries [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/06/24 07:53:59 UTC, 0 replies.
- Re: [PR] [SPARK-48681][SQL] Use ICU in Lower/Upper expressions for UTF8_BINARY strings [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/06/24 08:19:35 UTC, 1 replies.
- Re: [PR] [SPARK-48683][SQL] Fix schema evolution with `df.mergeInto` losing `when` clauses [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/06/24 08:25:01 UTC, 1 replies.
- Re: [PR] [SPARK-48680][SQL][DOCS] Add missing Java APIs and language-specific documentations for char/varchar [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/06/24 08:25:33 UTC, 1 replies.
- Re: [PR] [SPARK-48658][SQL] Encode/Decode functions report coding errors instead of mojibake for unmappable characters [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/06/24 08:31:32 UTC, 6 replies.
- Re: [PR] [SPARK-39041][SQL] Mapping Spark Query ResultSet/Schema to TRowSet/TTableSchema directly [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2024/06/24 08:46:53 UTC, 1 replies.
- Re: [PR] [SPARK-42495][CONNECT] Scala Client add Misc, String, and Date/Time functions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/06/24 09:13:45 UTC, 1 replies.
- Re: [PR] [SPARK-48639][CONNECT][PYTHON] Add Origin to Relation.RelationCommon [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/06/24 10:25:45 UTC, 1 replies.
- Re: [PR] [SPARK-48691][BUILD] Upgrade scalatest related dependencies to the 3.2.19 series [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/06/24 10:29:58 UTC, 3 replies.
- Re: [PR] [SPARK-48670][SQL] Providing suggestion as part of error message when invalid collation name is given [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/06/24 10:32:47 UTC, 5 replies.
- [PR] [SPARK-48695][PYTHON] `TimestampNTZType.fromInternal` not use the deprecated methods [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/06/24 10:58:23 UTC, 3 replies.
- Re: [PR] [SPARK-48697] Fix collation predicate widening [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/06/24 12:04:27 UTC, 1 replies.
- [PR] [SPARK-18523][PySpark] `SparkContext.stop` should catch `ConnectionRefusedError` as well [spark] - posted by "ravwojdyla (via GitHub)" <gi...@apache.org> on 2024/06/24 13:27:48 UTC, 0 replies.
- [PR] [SPARK-39627][SQL][FOLLOWUP] Cleanup deprecated api usage related to `JdbcDialect.compileAggregate` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/06/24 14:24:10 UTC, 0 replies.