reviews@spark.apache.org, 2023-10

You are viewing a plain text version of this content. The canonical link for it is here.

- [GitHub] [spark] mridulm commented on pull request #43004: [SPARK-45134][SHUFFLE] Avoid repeated fallback when failed to fetch remote push-merged block meta - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2023/10/01 01:05:40 UTC, 0 replies.
- [GitHub] [spark] dongjoon-hyun commented on a diff in pull request #43184: [SPARK-44120][PYTHON] Support Python 3.12 - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/01 01:15:30 UTC, 1 replies.
- [GitHub] [spark] dongjoon-hyun opened a new pull request, #43192: [SPARK-45390][PYTHON] Remove distutils usage - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/01 01:45:05 UTC, 0 replies.
- [GitHub] [spark] dongjoon-hyun commented on pull request #43184: [SPARK-44120][PYTHON] Support Python 3.12 - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/01 01:46:29 UTC, 2 replies.
- [GitHub] [spark] HyukjinKwon commented on a diff in pull request #43184: [SPARK-44120][PYTHON] Support Python 3.12 - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/01 03:01:05 UTC, 1 replies.
- [GitHub] [spark] LuciferYang opened a new pull request, #43193: Replace `Class.newInstance()` with `Class.getDeclaredConstructor().newInstance()` - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/01 03:09:32 UTC, 0 replies.
- [GitHub] [spark] mridulm commented on pull request #43166: [SPARK-45378][CORE] Add convertToNettyForSsl to ManagedBuffer - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2023/10/01 04:04:59 UTC, 1 replies.
- [GitHub] [spark] dongjoon-hyun commented on pull request #43192: [SPARK-45390][PYTHON] Remove `distutils` usage - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/01 04:07:38 UTC, 2 replies.
- [GitHub] [spark] mridulm commented on pull request #43193: Replace `Class.newInstance()` with `Class.getDeclaredConstructor().newInstance()` - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2023/10/01 04:31:43 UTC, 1 replies.
- [GitHub] [spark] pan3793 commented on pull request #43191: [SPARK-45389][SQL][HIVE] Correct MetaException matching rule on getting partition metadata - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2023/10/01 05:04:42 UTC, 0 replies.
- [GitHub] [spark] pan3793 commented on a diff in pull request #43189: [SPARK-45388][SQL][HIVE] Eliminate unnecessary reflection invocation in Hive shim classes - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2023/10/01 05:09:36 UTC, 3 replies.
- [GitHub] [spark] pan3793 commented on pull request #43189: [SPARK-45388][SQL][HIVE] Eliminate unnecessary reflection invocation in Hive shim classes - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2023/10/01 05:10:00 UTC, 0 replies.
- [GitHub] [spark] xiongbo-sjtu opened a new pull request, #43194: [SPARK-45283][CORE][TESTS] Make StatusTrackerSuite less fragile - posted by "xiongbo-sjtu (via GitHub)" <gi...@apache.org> on 2023/10/01 05:31:31 UTC, 0 replies.
- [GitHub] [spark] LuciferYang commented on pull request #43193: Replace `Class.newInstance()` with `Class.getDeclaredConstructor().newInstance()` - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/01 06:15:07 UTC, 1 replies.
- [GitHub] [spark] viirya commented on a diff in pull request #43192: [SPARK-45390][PYTHON] Remove `distutils` usage - posted by "viirya (via GitHub)" <gi...@apache.org> on 2023/10/01 06:30:44 UTC, 2 replies.
- [GitHub] [spark] eejbyfeldt commented on a diff in pull request #43188: [SPARK-45386][SQL]: Fix correctness issue with persist using StorageLevel.NONE on Dataset - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2023/10/01 07:08:23 UTC, 0 replies.
- [GitHub] [spark] dongjoon-hyun commented on a diff in pull request #43192: [SPARK-45390][PYTHON] Remove `distutils` usage - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/01 08:30:55 UTC, 2 replies.
- [GitHub] [spark] dongjoon-hyun commented on pull request #43194: [SPARK-45283][CORE][TESTS] Make StatusTrackerSuite less fragile - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/01 09:14:01 UTC, 0 replies.
- [GitHub] [spark] srowen commented on a diff in pull request #43188: [SPARK-45386][SQL]: Fix correctness issue with persist using StorageLevel.NONE on Dataset - posted by "srowen (via GitHub)" <gi...@apache.org> on 2023/10/01 13:34:53 UTC, 0 replies.
- [GitHub] [spark] srowen commented on a diff in pull request #43165: [SPARK-45377][CORE] Handle InputStream in NettyLogger - posted by "srowen (via GitHub)" <gi...@apache.org> on 2023/10/01 13:37:13 UTC, 0 replies.
- [GitHub] [spark] LuciferYang closed pull request #43186: [SPARK-45384][CORE][SQL][SS][DSTREAM][CONNECT] Replace `TraversableOnce` with `IterableOnce` - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/01 13:41:33 UTC, 0 replies.
- [GitHub] [spark] LuciferYang commented on pull request #43186: [SPARK-45384][CORE][SQL][SS][DSTREAM][CONNECT] Replace `TraversableOnce` with `IterableOnce` - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/01 13:41:55 UTC, 0 replies.
- [GitHub] [spark] LuciferYang commented on a diff in pull request #43189: [SPARK-45388][SQL][HIVE] Eliminate unnecessary reflection invocation in Hive shim classes - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/01 14:42:05 UTC, 0 replies.
- [GitHub] [spark] LuciferYang commented on pull request #43194: [SPARK-45283][CORE][TESTS] Make StatusTrackerSuite less fragile - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/01 14:46:05 UTC, 0 replies.
- [GitHub] [spark] LuciferYang commented on a diff in pull request #43194: [SPARK-45283][CORE][TESTS] Make StatusTrackerSuite less fragile - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/01 15:06:12 UTC, 1 replies.
- [GitHub] [spark] LuciferYang commented on a diff in pull request #43187: [SPARK-45385][SQL] Deprecate `spark.sql.parser.escapedStringLiterals` - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/01 15:09:13 UTC, 0 replies.
- [GitHub] [spark] LuciferYang commented on a diff in pull request #43191: [SPARK-45389][SQL][HIVE] Correct MetaException matching rule on getting partition metadata - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/01 15:11:32 UTC, 0 replies.
- [GitHub] [spark] pan3793 commented on a diff in pull request #43191: [SPARK-45389][SQL][HIVE] Correct MetaException matching rule on getting partition metadata - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2023/10/01 15:30:24 UTC, 0 replies.
- [GitHub] [spark] LuciferYang commented on a diff in pull request #43168: [SPARK-45370][PYTHON][TESTS] Fix python test when ansi mode enabled - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/01 16:31:21 UTC, 1 replies.
- [GitHub] [spark] srowen commented on pull request #43190: [MINOR][DOCS] Fix Python code sample for StreamingQueryListener: Reporting Metrics programmatically using Asynchronous APIs - posted by "srowen (via GitHub)" <gi...@apache.org> on 2023/10/01 17:08:14 UTC, 0 replies.
- [GitHub] [spark] dongjoon-hyun closed pull request #43192: [SPARK-45390][PYTHON] Remove `distutils` usage - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/01 17:45:07 UTC, 0 replies.
- [GitHub] [spark] xiongbo-sjtu commented on a diff in pull request #43194: [SPARK-45283][CORE][TESTS] Make StatusTrackerSuite less fragile - posted by "xiongbo-sjtu (via GitHub)" <gi...@apache.org> on 2023/10/01 19:33:14 UTC, 1 replies.
- [GitHub] [spark] xiongbo-sjtu commented on pull request #43194: [SPARK-45283][CORE][TESTS] Make StatusTrackerSuite less fragile - posted by "xiongbo-sjtu (via GitHub)" <gi...@apache.org> on 2023/10/01 19:33:44 UTC, 1 replies.
- [GitHub] [spark] dongjoon-hyun closed pull request #43184: [SPARK-44120][PYTHON] Support Python 3.12 - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/01 19:39:52 UTC, 0 replies.
- [GitHub] [spark] mridulm commented on pull request #43193: [SPARK-45392][CORE][SQL] Replace `Class.newInstance()` with `Class.getDeclaredConstructor().newInstance()` - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2023/10/01 20:10:08 UTC, 0 replies.
- [GitHub] [spark] mridulm commented on a diff in pull request #43194: [SPARK-45283][CORE][TESTS] Make StatusTrackerSuite less fragile - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2023/10/01 20:16:53 UTC, 0 replies.
- [GitHub] [spark] mridulm commented on pull request #43194: [SPARK-45283][CORE][TESTS] Make StatusTrackerSuite less fragile - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2023/10/01 20:37:04 UTC, 1 replies.
- [GitHub] [spark] hasnain-db commented on pull request #43166: [SPARK-45378][CORE] Add convertToNettyForSsl to ManagedBuffer - posted by "hasnain-db (via GitHub)" <gi...@apache.org> on 2023/10/01 20:55:17 UTC, 0 replies.
- [GitHub] [spark] mridulm commented on a diff in pull request #43165: [SPARK-45377][CORE] Handle InputStream in NettyLogger - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2023/10/01 22:11:20 UTC, 0 replies.
- [GitHub] [spark] dongjoon-hyun closed pull request #43187: [SPARK-45385][SQL] Deprecate `spark.sql.parser.escapedStringLiterals` - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/01 23:32:09 UTC, 0 replies.
- [GitHub] [spark] dongjoon-hyun closed pull request #43189: [SPARK-45388][SQL] Eliminate unnecessary reflection invocation in Hive shim classes - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/01 23:34:56 UTC, 0 replies.
- [GitHub] [spark] dongjoon-hyun closed pull request #43171: [SPARK-45338][MLLIB][PYTHON][FOLLOWUP] Use `immutable.ArraySeq.unsafeWrapArray` instead of `array.toSeq` - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/01 23:37:39 UTC, 0 replies.
- [GitHub] [spark] dongjoon-hyun commented on pull request #43171: [SPARK-45338][MLLIB][PYTHON][FOLLOWUP] Use `immutable.ArraySeq.unsafeWrapArray` instead of `array.toSeq` - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/01 23:38:00 UTC, 0 replies.
- [GitHub] [spark] LuciferYang commented on pull request #43193: [SPARK-45392][CORE][SQL] Replace `Class.newInstance()` with `Class.getDeclaredConstructor().newInstance()` - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/01 23:39:48 UTC, 0 replies.
- [GitHub] [spark] LuciferYang commented on pull request #43171: [SPARK-45338][MLLIB][PYTHON][FOLLOWUP] Use `immutable.ArraySeq.unsafeWrapArray` instead of `array.toSeq` - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/01 23:40:43 UTC, 0 replies.
- [GitHub] [spark] LuciferYang commented on pull request #43148: [SPARK-45355][SQL][DOCS] Fix function groups in Scala Doc - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/01 23:53:16 UTC, 0 replies.
- [GitHub] [spark] github-actions[bot] commented on pull request #41072: [SPARK-43393][SQL] Address sequence expression overflow bug. - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/02 00:18:02 UTC, 0 replies.
- [GitHub] [spark] dongjoon-hyun closed pull request #43193: [SPARK-45392][CORE][SQL][SS] Replace `Class.newInstance()` with `Class.getDeclaredConstructor().newInstance()` - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/02 02:00:19 UTC, 0 replies.
- [GitHub] [spark] dongjoon-hyun commented on pull request #43193: [SPARK-45392][CORE][SQL][SS] Replace `Class.newInstance()` with `Class.getDeclaredConstructor().newInstance()` - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/02 02:00:33 UTC, 0 replies.
- [GitHub] [spark] hvanhovell opened a new pull request, #43195: [SPARK-45371][CONNECT] Fix shading issues in the Spark Connect Scala Client - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2023/10/02 04:38:03 UTC, 0 replies.
- [GitHub] [spark] hvanhovell commented on a diff in pull request #43195: [SPARK-45371][CONNECT] Fix shading issues in the Spark Connect Scala Client - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2023/10/02 04:38:49 UTC, 1 replies.
- [GitHub] [spark] wbo4958 commented on pull request #43030: [SPARK-45250][core] Support stage level task resource profile for yarn cluster when dynamic allocation disabled - posted by "wbo4958 (via GitHub)" <gi...@apache.org> on 2023/10/02 04:51:44 UTC, 0 replies.
- Re: [PR] [SPARK-45386][SQL]: Fix correctness issue with persist using StorageLevel.NONE on Dataset [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2023/10/02 08:01:32 UTC, 9 replies.
- Re: [PR] [MINOR][DOCS] Fix Python code sample for StreamingQueryListener: Reporting Metrics programmatically using Asynchronous APIs [spark] - posted by "kasztp (via GitHub)" <gi...@apache.org> on 2023/10/02 08:28:48 UTC, 4 replies.
- Re: [PR] [SPARK-45392][CORE][SQL][SS] Replace `Class.newInstance()` with `Class.getDeclaredConstructor().newInstance()` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/02 08:35:55 UTC, 0 replies.
- Re: [PR] [SPARK-45361][SQL][DOCS] Describe characters unescaping in string literals [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/10/02 09:54:30 UTC, 2 replies.
- Re: [PR] [SPARK-45385][SQL] Deprecate `spark.sql.parser.escapedStringLiterals` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/10/02 10:02:37 UTC, 0 replies.
- Re: [PR] [SPARK-45371][CONNECT] Fix shading issues in the Spark Connect Scala Client [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2023/10/02 13:16:33 UTC, 6 replies.
- Re: [PR] [SPARK-45389][SQL][HIVE] Correct MetaException matching rule on getting partition metadata [spark] - posted by "srowen (via GitHub)" <gi...@apache.org> on 2023/10/02 13:26:11 UTC, 4 replies.
- Re: [PR] [SPARK-45377][CORE] Handle InputStream in NettyLogger [spark] - posted by "srowen (via GitHub)" <gi...@apache.org> on 2023/10/02 13:28:01 UTC, 1 replies.
- Re: [PR] [SPARK-44913][SQL] DS V2 supports push down V2 UDF that has magic method [spark] - posted by "ConeyLiu (via GitHub)" <gi...@apache.org> on 2023/10/02 13:40:50 UTC, 2 replies.
- Re: [PR] [SPARK-36112] [SQL] Support correlated EXISTS and IN subqueries using DecorrelateInnerQuery framework [spark] - posted by "agubichev (via GitHub)" <gi...@apache.org> on 2023/10/02 14:50:35 UTC, 22 replies.
- Re: [PR] [SPARK-45376][CORE] Add netty-tcnative-boringssl-static dependency [spark] - posted by "hasnain-db (via GitHub)" <gi...@apache.org> on 2023/10/02 18:18:15 UTC, 5 replies.
- [PR] [WIP][MINOR][SQL] Fix `sql()` of the `Like` expression [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/10/02 18:48:11 UTC, 0 replies.
- [PR] . [spark] - posted by "garlandz-db (via GitHub)" <gi...@apache.org> on 2023/10/02 21:00:23 UTC, 1 replies.
- Re: [PR] [SPARK-43393][SQL] Address sequence expression overflow bug. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/03 00:17:41 UTC, 0 replies.
- Re: [PR] [SPARK-45355][SQL][DOCS] Fix function groups in Scala Doc [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/03 01:03:51 UTC, 8 replies.
- Re: [PR] [SPARK-45378][CORE] Add convertToNettyForSsl to ManagedBuffer [spark] - posted by "hasnain-db (via GitHub)" <gi...@apache.org> on 2023/10/03 03:53:44 UTC, 2 replies.
- Re: [PR] [SPARK-45250][core] Support stage level task resource profile for yarn cluster when dynamic allocation disabled [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2023/10/03 04:01:06 UTC, 4 replies.
- Re: [PR] [SPARK-45283][CORE][TESTS] Make StatusTrackerSuite less fragile [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2023/10/03 04:07:37 UTC, 8 replies.
- [PR] [SPARK-45396][DOC] Add doc entry for `pyspark.ml.connect` module [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2023/10/03 06:33:12 UTC, 0 replies.
- Re: [PR] [SPARK-45351][CORE] Change `spark.shuffle.service.db.backend` default value to ROCKSDB [spark] - posted by "Hisoka-X (via GitHub)" <gi...@apache.org> on 2023/10/03 07:32:43 UTC, 5 replies.
- [PR] [SPARK-45397][ML][CONNECT] Add vector assembler feature transformer [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2023/10/03 09:53:08 UTC, 11 replies.
- [PR] [SPARK-45385][SQL][TESTS][FOLLOWUP] Improve the test case for deprecate `spark.sql.parser.escapedStringLiterals` [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/03 10:01:20 UTC, 6 replies.
- Re: [PR] [SPARK-34591][MLLIB][WIP] Add decision tree pruning as a parameter [spark] - posted by "ramou2023 (via GitHub)" <gi...@apache.org> on 2023/10/03 11:12:22 UTC, 0 replies.
- Re: [PR] [SPARK-37467][SQL] Consolidate whole stage and non whole stage subexpression elimination [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2023/10/03 12:56:32 UTC, 0 replies.
- [PR] [SPARK-45399][SQL] XML: Add XML Options using newOption [spark] - posted by "sandip-db (via GitHub)" <gi...@apache.org> on 2023/10/03 14:57:11 UTC, 2 replies.
- Re: [PR] [SPARK-45136][CONNECT] Enhance ClosureCleaner with Ammonite support [spark] - posted by "rednaxelafx (via GitHub)" <gi...@apache.org> on 2023/10/03 16:53:10 UTC, 5 replies.
- [PR] [feature] Allow selective disabling of "fallocate" in RocksDB statestore [spark] - posted by "schenksj (via GitHub)" <gi...@apache.org> on 2023/10/03 17:06:56 UTC, 2 replies.
- Re: [PR] Add Support for Scala 2.13 in Spark 3.4.1 [spark-docker] - posted by "galacticgumshoe (via GitHub)" <gi...@apache.org> on 2023/10/03 18:01:41 UTC, 11 replies.
- Re: [PR] [SPARK-44219][SQL] Adds extra per-rule validations for optimization rewrites. [spark] - posted by "YannisSismanis (via GitHub)" <gi...@apache.org> on 2023/10/03 18:59:15 UTC, 9 replies.
- [PR] [WIP][SQL][DOCS] Refer to the unescaping rules from expression descriptions [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/10/03 19:19:52 UTC, 0 replies.
- [PR] [SPARK-45402][SQL][Python] Add UDTF API for 'analyze' to return a buffer to consume on each class creation [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2023/10/03 22:43:18 UTC, 1 replies.
- [PR] [SPARK-45404][CORE] Support `AWS_ENDPOINT_URL` env variable [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/03 23:26:00 UTC, 18 replies.
- Re: [PR] [SPARK-45347][SQL][CONNECT] Include SparkThrowable in FetchErrorDetailsResponse [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/03 23:33:35 UTC, 1 replies.
- Re: [PR] [SPARK-45396][DOCS] Add doc entry for `pyspark.ml.connect` module [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/04 00:27:12 UTC, 3 replies.
- Re: [PR] [SPARK-43620][CONNECT][PS] Fix Pandas APIs depends on unsupported features [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/10/04 00:33:55 UTC, 2 replies.
- [PR] [SPARK-45406][PYTHON][CONNECT] Delete `schema` from DataFrame constructor [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/04 02:32:48 UTC, 3 replies.
- [PR] [MINOR][INFRA] Pin traitlets<=5.10.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/04 03:10:10 UTC, 1 replies.
- Re: [PR] [SPARK-44223][CORE] Remove LevelDB support [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/04 03:14:04 UTC, 0 replies.
- Re: [PR] [SPARK-45402][SQL][PYTHON] Add UDTF API for 'analyze' to return a buffer to consume on each class creation [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/04 03:26:57 UTC, 7 replies.
- [PR] [SPARK-45407][INFRA] Skip Unidoc in SparkR GitHub Action Job [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/04 03:45:10 UTC, 3 replies.
- [PR] [SPARK-45410][INFRA] Add Python GitHub Action Daily Job [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/04 04:50:29 UTC, 13 replies.
- Re: [PR] [SPARK-45409][INFRA] Pin `torch<=2.0.1` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/04 05:30:49 UTC, 4 replies.
- [PR] [SPARK-45396][PYTHON[[DOCS] Add doc entry for `pyspark.ml.connect` module [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/04 06:17:08 UTC, 0 replies.
- Re: [PR] [SPARK-45357][CONNECT][TESTS] Normalize `dataframeId` when comparing `CollectMetrics` in `SparkConnectProtoSuite` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/04 06:23:07 UTC, 8 replies.
- Re: [PR] [SPARK-45396][PYTHON][DOCS] Add doc entry for `pyspark.ml.connect` module [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/04 06:55:51 UTC, 3 replies.
- Re: [PR] [SPARK-45088][PYTHON][CONNECT] Make `getitem` work with duplicated columns [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/04 08:04:27 UTC, 0 replies.
- [PR] Revert "[SPARK-45088][PYTHON][CONNECT] Make `getitem` work with duplicated column" [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/04 08:12:23 UTC, 2 replies.
- Re: [PR] [SPARK-45400][SQL][DOCS] Refer to the unescaping rules from expression descriptions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/10/04 08:22:44 UTC, 9 replies.
- Re: [PR] [SPARK-45398][SQL] Append `ESCAPE` in `sql()` of the `Like` expression [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/10/04 08:33:06 UTC, 1 replies.
- [PR] [SPARK-45345][BUILD] Clean Scala version change leftovers in `release-build.sh` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/04 08:52:58 UTC, 7 replies.
- Re: [PR] [SPARK-45352][SQL] Remove window partition if partition expressions are foldable [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/04 09:45:32 UTC, 12 replies.
- [PR] [SPARK-45386][SQL]: Fix correctness issue with persist using StorageLevel.NONE on Dataset for branch 3.5 [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2023/10/04 10:32:43 UTC, 0 replies.
- [PR] [WIP][SPARK-43656][CONNECT][PS] Enable numpy compat tests for Spark Connect [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/10/04 10:34:45 UTC, 2 replies.
- [PR] [SPARK-45412][PYTHON][CONNECT] Validate the plan and session in `DataFrame.__init__` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/04 11:16:05 UTC, 2 replies.
- [PR] [SPARK-45394][PYTHON][CONNECT] Add retries for artifact API. Improve error handling (follow-up to [SPARK-45093]). [spark] - posted by "cdkrot (via GitHub)" <gi...@apache.org> on 2023/10/04 11:55:15 UTC, 3 replies.
- [PR] [SPARK-45413][CORE] Drop leveldb support for `spark.history.store.hybridStore.diskBackend` [spark] - posted by "Hisoka-X (via GitHub)" <gi...@apache.org> on 2023/10/04 11:59:58 UTC, 5 replies.
- [PR] [SPARK-45268][PYTHON][DOCS][FOLLOWUP] Correct the group of `equal_null` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/04 12:16:23 UTC, 2 replies.
- Re: [PR] [SPARK-44735][SQL] Add warning msg when inserting columns with the same name by row that don't match up [spark] - posted by "Hisoka-X (via GitHub)" <gi...@apache.org> on 2023/10/04 16:15:01 UTC, 9 replies.
- [PR] [SPARK-45416][CONNECT] Sanity check consistency of Arrow results [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2023/10/04 17:31:27 UTC, 4 replies.
- [PR] [SPARK-45408][CORE] Add RPC SSL settings to TransportConf [spark] - posted by "hasnain-db (via GitHub)" <gi...@apache.org> on 2023/10/04 18:20:26 UTC, 14 replies.
- Re: [PR] [SPARK-44366][BUILD] Upgrade antlr4 to 4.13.1 [spark] - posted by "jimsimon-wk (via GitHub)" <gi...@apache.org> on 2023/10/04 18:24:31 UTC, 3 replies.
- Re: [PR] [SPARK-28973][SQL] Add `TimeType` and support `java.time.LocalTime` as its external type. [spark] - posted by "redblackcoder (via GitHub)" <gi...@apache.org> on 2023/10/04 20:43:20 UTC, 0 replies.
- Re: [PR] [SPARK-45396][PYTHON] Add doc entry for `pyspark.ml.connect` module, and adds `Evaluator` to `__all__` at `ml.connect` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/04 23:38:28 UTC, 3 replies.
- Re: [PR] [SPARK-45009][SQL] Decorrelate predicate subqueries in join condition [spark] - posted by "andylam-db (via GitHub)" <gi...@apache.org> on 2023/10/04 23:40:26 UTC, 10 replies.
- Re: [PR] fix gson vulnerabilities test [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/05 00:17:29 UTC, 1 replies.
- Re: [PR] [SPARK-43255][SQL] Replace the error class _LEGACY_ERROR_TEMP_2020 by an internal error [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/05 00:17:32 UTC, 1 replies.
- Re: [PR] [SPARK-44137] Change handling of iterable objects for `on` field in joins [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/05 00:17:34 UTC, 1 replies.
- Re: [PR] [SPARK-44082][SQL] Generate operator does not update reference set properly [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/05 00:17:36 UTC, 1 replies.
- Re: [PR] [SPARK-44025][SQL] Fix CSV Table Read Error with CharType(length) column [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/05 00:17:37 UTC, 1 replies.
- Re: [PR] [SPARK-43657][K8S]: reuse config map for executor when running on k8s-cluster mode [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/05 00:17:39 UTC, 1 replies.
- Re: [PR] [SPARK-42727][CORE] Fix can't executing spark commands in the root directory when local mode is specified [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/05 00:17:41 UTC, 1 replies.
- Re: [PR] [SPARK-42629][DOCS] Update the description of default data source in the document [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/05 00:17:44 UTC, 1 replies.
- Re: [PR] [SPARK-45386][SQL][3.5] Fix correctness issue with persist using StorageLevel.NONE on Dataset [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/05 00:40:38 UTC, 2 replies.
- Re: [PR] [SPARK-45419][SS] Avoid reusing rocksdb sst files in a dfferent rocksdb instance [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2023/10/05 00:40:45 UTC, 5 replies.
- [PR] [SPARK-45167][CONNECT][PYTHON][FOLLOW-UP][3.5] Use lighter threading Rlock [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/05 00:47:39 UTC, 2 replies.
- Re: [PR] [SPARK-45413][CORE] Add warning for prepare drop LevelDB support [spark] - posted by "Hisoka-X (via GitHub)" <gi...@apache.org> on 2023/10/05 00:56:12 UTC, 6 replies.
- Re: [PR] [SPARK-45217][CORE] Support change log level of specific package or class [spark] - posted by "warrenzhu25 (via GitHub)" <gi...@apache.org> on 2023/10/05 01:52:40 UTC, 0 replies.
- [PR] [MINOR][PYTHON] Fix python linter in master [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/05 02:33:03 UTC, 5 replies.
- [PR] [SPARK-XXX] [PYTHON] Fix incorrect doc in pyspark.sql.DataFrame.repartition [spark] - posted by "hongshaoyang (via GitHub)" <gi...@apache.org> on 2023/10/05 02:49:38 UTC, 0 replies.
- [PR] [SPARK-45417][PYTHON] Make InheritableThread inherit the active session [spark] - posted by "clee704 (via GitHub)" <gi...@apache.org> on 2023/10/05 03:52:14 UTC, 5 replies.
- Re: [PR] [PYTHON][DOCS] Fix incorrect doc in pyspark.sql.DataFrame.repartition [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/05 04:00:41 UTC, 1 replies.
- [PR] [SPARK-45401][PYTHON] Add a new method `cleanup` in the UDTF interface [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/10/05 05:15:22 UTC, 4 replies.
- [PR] [SPARK-45420][SQL][PYTHON][CONNECT] Add DataType.fromDDL into PySpark [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/05 05:22:12 UTC, 4 replies.
- Re: [PR] [SPARK-43656][CONNECT][PS] Enable numpy compat tests for Spark Connect [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/10/05 05:40:48 UTC, 0 replies.
- [PR] [SPARK-45421][SQL] Catch AnalysisException over InlineCTE [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2023/10/05 05:48:53 UTC, 4 replies.
- Re: [PR] [SPARK-43656][CONNECT][PS][TESTS] Enable numpy compat tests for Spark Connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/05 07:05:31 UTC, 1 replies.
- [PR] [SPARK-43704][CONNECT][PS] Support `MultiIndex` for `to_series()` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/10/05 10:38:43 UTC, 2 replies.
- [PR] [SPARK-40154][Python][Docs] Correct storage level in Dataframe.cache docstring [spark] - posted by "paulstaab (via GitHub)" <gi...@apache.org> on 2023/10/05 11:31:03 UTC, 3 replies.
- Re: [PR] [TEST ONLY][SQL] Test resolve column references with PLAN_ID [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/10/05 14:49:35 UTC, 0 replies.
- [PR] [SPARK-45423][SQL] Lower `ParquetWriteSupport` log level to debug [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/05 16:28:52 UTC, 3 replies.
- Re: [PR] [SPARK-45231][INFRA] Remove unrecognized and meaningless command about `Ammonite` from the GA testing workflow. [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2023/10/05 17:14:05 UTC, 1 replies.
- [PR] [SPARK-45425] Mapped TINYINT to ShortType for MsSqlServerDialect [spark] - posted by "zeruibao (via GitHub)" <gi...@apache.org> on 2023/10/05 18:49:28 UTC, 19 replies.
- [PR] [MINOR][SQL] Remove Scalac 2.12-specific code in InMemoryFileIndex [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/05 21:23:14 UTC, 0 replies.
- Re: [PR] [SPARK-45425] Mapped TINYINT to ByteType for MsSqlServerDialect [spark] - posted by "zeruibao (via GitHub)" <gi...@apache.org> on 2023/10/05 21:52:09 UTC, 1 replies.
- Re: [PR] [SPARK-45220][PYTHON][DOCS] Refine docstring of DataFrame.join [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/10/05 22:21:42 UTC, 15 replies.
- [PR] should use current plan's output in ScanOperation [spark] - posted by "copperybean (via GitHub)" <gi...@apache.org> on 2023/10/05 22:44:44 UTC, 0 replies.
- Re: [PR] [SPARK-43991][CORE] Use the value of spark.eventLog.compression.codec set by user when write compact file [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/06 00:17:36 UTC, 1 replies.
- [PR] [SPARK-45418] Change current_database() column alias to current_schema() [spark] - posted by "michaelzhan-db (via GitHub)" <gi...@apache.org> on 2023/10/06 01:05:31 UTC, 5 replies.
- [PR] [SPARK-45430] Fix for FramelessOffsetWindowFunction when IGNORE NULLS and offset > rowCount [spark] - posted by "vitaliili-db (via GitHub)" <gi...@apache.org> on 2023/10/06 01:11:26 UTC, 22 replies.
- Re: [PR] [SPARK-45290][INFRA][Launcher]Fix The return status is incorrect in standalone mode. The status of endevent is correct [spark] - posted by "changhuyan (via GitHub)" <gi...@apache.org> on 2023/10/06 01:48:16 UTC, 1 replies.
- [PR] [SPARK-43664][CONNECT][PS] Fix `ps.sql` for remote session [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/10/06 02:10:20 UTC, 11 replies.
- [PR] [SPARK-45427][CORE] Add RPC SSL settings to SSLOptions and SparkTransportConf [spark] - posted by "hasnain-db (via GitHub)" <gi...@apache.org> on 2023/10/06 02:17:37 UTC, 22 replies.
- Re: [PR] [SPARK-45262][SQL][TESTS][DOCS] Improve examples for `LIKE` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/10/06 02:47:34 UTC, 0 replies.
- [PR] [SPARK-45432][CORE] Remove deprecated Hadoop-2 `LocatedFileStatus` constructor [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/06 03:00:33 UTC, 3 replies.
- [PR] [SPARK-45431][DOCS] Document new SSL RPC feature [spark] - posted by "hasnain-db (via GitHub)" <gi...@apache.org> on 2023/10/06 03:04:19 UTC, 8 replies.
- Re: [PR] [MINOR][SQL] Remove Scalac 2.12-specific code in `InMemoryFileIndex` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/06 03:17:59 UTC, 3 replies.
- [PR] Reduce the memory required to start the `LocalCluster` in the `mllib` module test cases. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/06 03:31:01 UTC, 2 replies.
- [PR] [SPARK-45433][SQL] Fix CSV/JSON schema inference when timestamps do not match specified timestampFormat [spark] - posted by "Hisoka-X (via GitHub)" <gi...@apache.org> on 2023/10/06 05:15:00 UTC, 11 replies.
- [PR] [SPARK-45429][CORE] Add helper classes for SSL RPC communication [spark] - posted by "hasnain-db (via GitHub)" <gi...@apache.org> on 2023/10/06 05:31:58 UTC, 23 replies.
- [PR] [SPARK-45424][SQL] Fix TimestampFormatter return optional parse results when only prefix match [spark] - posted by "Hisoka-X (via GitHub)" <gi...@apache.org> on 2023/10/06 05:34:16 UTC, 10 replies.
- [PR] [SPARK-45434][ML][CONNECT] LogisticRegression checks the training labels [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/06 07:54:47 UTC, 3 replies.
- [PR] [SPARK-45435] Document that lazy checkpoint may not be a consistent snapshot [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2023/10/06 10:19:11 UTC, 1 replies.
- [PR] [SPARK-45436][PYTHON][CONNECT] DataFrame methods check same session [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/06 10:22:52 UTC, 1 replies.
- Re: [PR] [SPARK-40513] Switch 3.4.0 default Java to Java17 [spark-docker] - posted by "retrry (via GitHub)" <gi...@apache.org> on 2023/10/06 11:44:53 UTC, 2 replies.
- Re: [PR] [SPARK-45262][SQL][TESTS][DOCS] Improve examples for regexp parameters [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/10/06 13:39:20 UTC, 4 replies.
- Re: [PR] [SPARK-44639][SS] Add option to use the Java tmp dir for local RocksDB state storage [spark] - posted by "srowen (via GitHub)" <gi...@apache.org> on 2023/10/06 15:06:05 UTC, 1 replies.
- [PR] [SPARK-45426][CORE] Add support for a ReloadingX509TrustManager [spark] - posted by "hasnain-db (via GitHub)" <gi...@apache.org> on 2023/10/06 15:53:32 UTC, 10 replies.
- [PR] [SPARK-45439][SQL] Reduce memory usage of LiveStageMetrics.accumIdsToMetricType [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2023/10/06 20:25:03 UTC, 0 replies.
- [PR] [SPARK-45441][PYTHON] Introduce more util functions for PythonWorkerUtils [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2023/10/06 21:12:44 UTC, 2 replies.
- Re: [PR] [SPARK-45425][SQL] Mapped TINYINT to ShortType for MsSqlServerDialect [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2023/10/06 21:53:11 UTC, 1 replies.
- Re: [PR] [SPARK-42775][SQL] Throw exception when ApproximatePercentile result doesn't fit into output decimal type. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/07 00:17:11 UTC, 1 replies.
- [PR] [SPARK-45442][PYTHON][DOCS] Refine docstring of DataFrame.show [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/10/07 00:43:41 UTC, 6 replies.
- [PR] [SPARK-45444][BUILD] Upgrade `commons-io` to 1.24.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/07 01:34:47 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-42309][SQL][FOLLOWUP] Raise exception directly instead of calling `resolveColumnsByPosition` [spark] - posted by "Hisoka-X (via GitHub)" <gi...@apache.org> on 2023/10/07 01:41:21 UTC, 3 replies.
- Re: [PR] [SPARK-45370][PYTHON][TESTS] Fix python test when ansi mode enabled [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/07 02:31:21 UTC, 6 replies.
- [PR] [SPARK-45445][BUILD] Upgrade snappy to 1.1.10.5 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/07 02:48:15 UTC, 3 replies.
- [PR] [SPARK-45446][PYTHON] Fix imports according to PEP8: pyspark.errors and pyspark.ml [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/07 03:10:19 UTC, 2 replies.
- [PR] [SPARK-45448][PYTHON] Fix imports according to PEP8: pyspark.testing, pyspark.mllib, pyspark.resource and pyspark.streaming [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/07 03:17:43 UTC, 2 replies.
- Re: [PR] [SPARK-45369][SQL] Push down limit through generate [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/07 03:24:41 UTC, 0 replies.
- [PR] [SPARK-45450][PYTHON] Fix imports according to PEP8: pyspark.pandas and pyspark (core) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/07 03:42:32 UTC, 6 replies.
- [PR] [SPARK-45449][SQL] Cache Invalidation Issue with JDBC Table [spark] - posted by "lyy-pineapple (via GitHub)" <gi...@apache.org> on 2023/10/07 03:49:24 UTC, 15 replies.
- Re: [PR] [SPARK-44649][SQL] Runtime Filter supports passing equivalent creation side expressions [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/07 04:42:08 UTC, 39 replies.
- [PR] [SPARK-45451][SQL] Make the default storage level of dataset cache configurable [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2023/10/07 06:53:12 UTC, 26 replies.
- Re: [PR] [SPARK-45439][SQL][UI] Reduce memory usage of LiveStageMetrics.accumIdsToMetricType [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/07 06:57:13 UTC, 7 replies.
- [PR] [SPARK-45389][SQL][HIVE][3.5] Correct MetaException matching rule on … [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2023/10/07 07:01:31 UTC, 0 replies.
- Re: [PR] [SPARK-45389][SQL][HIVE][3.5] Correct MetaException matching rule on getting partition metadata [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2023/10/07 07:02:52 UTC, 0 replies.
- [PR] [SPARK-45452][SQL] Improve `InMemoryFileIndex` to use `FileSystem.listFiles` API [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/07 07:11:20 UTC, 14 replies.
- [PR] [SPARK-44913][SQL][FOLLOWUP] DS V2 supports push down V2 UDF that has magic method [spark] - posted by "ConeyLiu (via GitHub)" <gi...@apache.org> on 2023/10/07 07:12:18 UTC, 3 replies.
- Re: [PR] [SPARK-45273][CORE][UI] Support for set the access host in http header [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/07 07:39:55 UTC, 9 replies.
- [PR] [SPARK-45453] [Spark SQL][JDBC] Annotation normalization [spark] - posted by "caicancai (via GitHub)" <gi...@apache.org> on 2023/10/07 09:44:22 UTC, 0 replies.
- [PR] [SPARK-45454][SQL] Set owner of DS v2 table to CURRENT_USER if it is set [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2023/10/07 10:40:52 UTC, 0 replies.
- Re: [PR] [SPARK-45453][SQL] Improve annotation normalization [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/07 11:00:00 UTC, 2 replies.
- Re: [PR] [SPARK-45447][MLLIB][TESTS] Reduce the memory required to start the `LocalClusterSparkContext` in the `mllib` module test cases. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/07 11:53:03 UTC, 10 replies.
- [PR] [SPARK-45455] Improve the rename interface of pgdialect and mysqldialect [spark] - posted by "caicancai (via GitHub)" <gi...@apache.org> on 2023/10/07 12:12:10 UTC, 0 replies.
- Re: [PR] [SPARK-45455][Sql] Improve the rename interface of pgdialect and mysqldialect [spark] - posted by "caicancai (via GitHub)" <gi...@apache.org> on 2023/10/07 12:13:39 UTC, 0 replies.
- [PR] [SPARK-45455][SQL] Improve the rename interface of pgdialect and mysqldialect [spark] - posted by "caicancai (via GitHub)" <gi...@apache.org> on 2023/10/07 12:14:40 UTC, 3 replies.
- [PR] [SPARK-45455] [SQL][JDBC] Improve the rename interface of pgdialect [spark] - posted by "caicancai (via GitHub)" <gi...@apache.org> on 2023/10/07 12:27:45 UTC, 1 replies.
- [PR] [SPARK-45455] [SQL][JDBC] Improve the rename interface of Postgres Dialect [spark] - posted by "caicancai (via GitHub)" <gi...@apache.org> on 2023/10/07 12:30:12 UTC, 2 replies.
- Re: [PR] [SPARK-45455][SQL] Improve the rename interface of Postgres Dialect [spark] - posted by "caicancai (via GitHub)" <gi...@apache.org> on 2023/10/07 13:50:53 UTC, 2 replies.
- [PR] [SPARK-45456][BUILD] Upgrade maven to 3.9.5 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/07 16:37:57 UTC, 2 replies.
- [PR] [SPARK-45331][DOCS][FOLLOWUP] Update `SCALA_VERSION` in `_config.yml` to 2.13.12 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/07 16:41:23 UTC, 3 replies.
- [PR] [SPARK-45457][DOCS] Surface sc.setLocalProperty() value=NULL param meaning [spark] - posted by "khalidmammadov (via GitHub)" <gi...@apache.org> on 2023/10/07 19:50:21 UTC, 1 replies.
- Re: [PR] [SPARK-45389][SQL][3.5] Correct MetaException matching rule on getting partition metadata [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/07 22:26:35 UTC, 0 replies.
- Re: [PR] [SPARK-45239][CONNECT] Reduce default spark.connect.jvmStacktrace.maxSize [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/07 22:30:21 UTC, 0 replies.
- Re: [PR] [SPARK-42915][SQL] Codegen Support for sentences [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/08 00:19:16 UTC, 1 replies.
- [PR] [SPARK-45205[SQL] CommandResultExec rewritten Iterator method to impr… [spark] - posted by "yorksity (via GitHub)" <gi...@apache.org> on 2023/10/08 00:35:58 UTC, 2 replies.
- [PR] [SPARK-45458][SQL] Convert IllegalArgumentException to SparkIllegalArgumentException in bitwiseExpressions and add some UT [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/08 06:30:08 UTC, 0 replies.
- [PR] [SPARK-45455][SQL][JDBC] Improve the rename interface of Postgres Dia… [spark] - posted by "caicancai (via GitHub)" <gi...@apache.org> on 2023/10/08 06:43:45 UTC, 0 replies.
- Re: [PR] [SPARK-45455][SQL][JDBC] Improve the rename interface of Postgresdialet [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/08 06:53:04 UTC, 9 replies.
- Re: [PR] [SPARK-39600][SQL] Enhance pushdown limit through window [spark] - posted by "xianyinxin (via GitHub)" <gi...@apache.org> on 2023/10/08 07:48:13 UTC, 0 replies.
- [PR] [SPARK-45459][SQL][TESTS][DOCS] Remove the last 2 extra spaces in the automatically generated `sql-error-conditions.md` file [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/08 07:50:07 UTC, 8 replies.
- [PR] [SPARK-45460][SQL] Replace `scala.collection.convert.ImplicitConversions` to `scala.jdk.CollectionConverters` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/08 08:36:37 UTC, 3 replies.
- [PR] [SPARK-45455][SQL][JDBC] Improve the rename interface of Postgresdialect [spark] - posted by "caicancai (via GitHub)" <gi...@apache.org> on 2023/10/08 09:42:33 UTC, 6 replies.
- [PR] [MINOR][DOCS] Update `CTAS` with `LOCATION` behavior with Spark 3.2+ [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/08 10:46:02 UTC, 2 replies.
- [PR] [SPARK-45461][CORE][SQL][MLLIB] Introduce a mapper for StorageLevel [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/08 10:52:11 UTC, 10 replies.
- Re: [PR] [SPARK-45338][CORE][SQL] Replace `scala.collection.JavaConverters` to `scala.jdk.CollectionConverters` [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/08 11:05:54 UTC, 0 replies.
- [PR] [SPARK-45462][CORE] Show `Duration` in `ApplicationPage` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/08 11:55:53 UTC, 0 replies.
- [PR] [SPARK-45463][CORE][SHUFFLE] Support reliable store with specified executorId [spark] - posted by "summaryzb (via GitHub)" <gi...@apache.org> on 2023/10/08 14:39:09 UTC, 22 replies.
- Re: [PR] [SPARK-45205[SQL] CommandResultExec to override iterator methods to avoid triggering multiple jobs. [spark] - posted by "yorksity (via GitHub)" <gi...@apache.org> on 2023/10/08 15:04:02 UTC, 2 replies.
- [PR] [SPARK-45389][SQL][3.4] Correct MetaException matching rule on getting partition metadata [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2023/10/08 15:41:15 UTC, 3 replies.
- Re: [PR] [SPARK-45454][SQL] Set the table's default owner to current_user [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/08 16:32:01 UTC, 1 replies.
- Re: [PR] [SPARK-45462][CORE][WEBUI] Show `Duration` in `ApplicationPage` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/08 16:38:13 UTC, 1 replies.
- Re: [PR] [SPARK-45336][TEST] Use Oracle Database 23 Free for integration and testing [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/08 16:56:59 UTC, 10 replies.
- Re: [PR] [SPARK-42746][SQL] Add the LISTAGG() aggregate function [spark] - posted by "khalidmammadov (via GitHub)" <gi...@apache.org> on 2023/10/08 18:32:54 UTC, 56 replies.
- [PR] [SPARK-45452][SQL][FOLLOWUP] Simplify path check logic [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/08 20:36:59 UTC, 15 replies.
- [PR] [SPARK-45465][BUILD][K8S] Upgrade `kubernetes-client` to 6.9.0 for K8s 1.28 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/08 21:07:24 UTC, 4 replies.
- Re: [PR] [SPARK-44527][SQL] Replace ScalarSubquery with null if its maxRows is 0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/08 21:11:27 UTC, 1 replies.
- Re: [PR] [SPARK-45415] Allow selective disabling of "fallocate" in RocksDB statestore [spark] - posted by "schenksj (via GitHub)" <gi...@apache.org> on 2023/10/08 21:41:03 UTC, 6 replies.
- Re: [PR] [SPARK-42716][SQL] DataSourceV2 supports reporting key-grouped partitioning without HasPartitionKey [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/09 00:18:13 UTC, 1 replies.
- Re: [PR] [SPARK-45458][SQL] Convert IllegalArgumentException to SparkIllegalArgumentException in bitwiseExpressions [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/09 01:25:38 UTC, 5 replies.
- Re: [PR] [SPARK-44729][PYTHON][DOCS] Add canonical links to the PySpark docs page [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/09 01:34:03 UTC, 2 replies.
- [PR] [SPARK-44729][PYTHON][DOCS][3.4] Add canonical links to the PySpark docs page [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/09 02:10:03 UTC, 2 replies.
- [PR] [SPARK-44729][PYTHON][DOCS][3.3] Add canonical links to the PySpark docs page [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/09 02:13:21 UTC, 4 replies.
- Re: [PR] [SPARK-45213][SQL] Assign name to the error _LEGACY_ERROR_TEMP_2151 [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2023/10/09 02:24:08 UTC, 4 replies.
- [PR] [SPARK-45412][PYTHON][CONNECT][FOLLOW-UP] Remove unnecessary check [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/09 04:33:14 UTC, 3 replies.
- [PR] [SPARK-45466][ML] `VectorAssembler` should validate the vector values [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/09 04:38:53 UTC, 1 replies.
- [PR] [SPARK-45464][CORE] Fix network-yarn distribution build [spark] - posted by "hasnain-db (via GitHub)" <gi...@apache.org> on 2023/10/09 05:15:42 UTC, 35 replies.
- [PR] [SPARK-45467][CORE] Replace `Proxy.getProxyClass()` with `Proxy.newProxyInstance().getClass` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/09 05:20:26 UTC, 5 replies.
- Re: [PR] [SPARK-45205][SQL] CommandResultExec to override iterator methods to avoid triggering multiple jobs. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/09 06:35:32 UTC, 5 replies.
- Re: [PR] [SPARK-45418][SQL][PYTHON][CONNECT] Change current_database() column alias to current_schema() [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/10/09 07:29:38 UTC, 7 replies.
- Re: [PR] [SPARK-37508][SQL] Add Unicode[encode/decode]() function [spark] - posted by "feiyx (via GitHub)" <gi...@apache.org> on 2023/10/09 08:04:40 UTC, 0 replies.
- [PR] Update Logging.scala [spark] - posted by "akaashhazarika (via GitHub)" <gi...@apache.org> on 2023/10/09 09:35:31 UTC, 0 replies.
- Re: [PR] SPARK-45200 Allow override for log4j2 configuration file while setting up logger. [spark] - posted by "akaashhazarika (via GitHub)" <gi...@apache.org> on 2023/10/09 09:43:54 UTC, 0 replies.
- [PR] SPARK-45200: All log4j2 configuration file override [spark] - posted by "akaashhazarika (via GitHub)" <gi...@apache.org> on 2023/10/09 09:45:18 UTC, 2 replies.
- [PR] [SPARK-45469][CORE][SQL][CONNECT] Replace `toIterator` with `iterator` for `IterableOnce` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/09 11:13:25 UTC, 0 replies.
- [PR] [SPARK-45470][SQL] Avoid paste string value of hive orc compression kind [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/09 12:13:35 UTC, 11 replies.
- Re: [PR] [SPARK-42034] QueryExecutionListener and Observation API do not work with `foreach` / `reduce` / `foreachPartition` action. [spark] - posted by "vidma (via GitHub)" <gi...@apache.org> on 2023/10/09 12:36:05 UTC, 1 replies.
- Re: [PR] [SPARK-42132][SQL] Deduplicate attributes in groupByKey.cogroup [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2023/10/09 13:34:08 UTC, 1 replies.
- Re: [PR] [SPARK-45035][SQL] Fix ignoreCorruptFiles with multiline CSV/JSON will report error [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/10/09 13:53:49 UTC, 8 replies.
- [PR] [SPARK-45468][UI] More transparent proxy handling for HTTP redirects [spark] - posted by "nsuke (via GitHub)" <gi...@apache.org> on 2023/10/09 14:53:58 UTC, 1 replies.
- [PR] [SPARK-45383][SQL] Fix error message for time travel with non-existing table [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/10/09 16:07:09 UTC, 3 replies.
- Re: [PR] [SPARK-45132][SQL] Fix IDENTIFIER for function invocation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/10/09 17:18:24 UTC, 6 replies.
- Re: [PR] [SPARK-44837][SQL] Improve ALTER TABLE ALTER PARTITION column error message [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/10/09 17:28:40 UTC, 6 replies.
- [PR] [SPARK-45472][SS] RocksDB State Store Doesn't Need to Recheck checkpoint path existence [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2023/10/09 18:05:58 UTC, 2 replies.
- [PR] Test XMLSuite on the edge parser [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2023/10/09 18:37:03 UTC, 0 replies.
- Re: [PR] [SPARK-44919][AVRO] Avro connector: convert a union of a single primitive type to a StructType [spark] - posted by "tianhanhu-db (via GitHub)" <gi...@apache.org> on 2023/10/09 18:50:51 UTC, 0 replies.
- Re: [PR] [SPARK-45402][SQL][PYTHON] Add UDTF API for 'eval' and 'terminate' methods to consume previous 'analyze' result [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2023/10/09 21:04:52 UTC, 12 replies.
- [PR] [SPARK-45221][PYTHON][DOCS] Refine docstring of DataFrameReader.parquet [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/10/09 21:17:53 UTC, 10 replies.
- [PR] Minor: Fix incorrect error message for RoundBase [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2023/10/09 22:12:51 UTC, 0 replies.
- Re: [PR] [SPARK-43299][SS][CONNECT] Convert StreamingQueryException in Scala Client [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/09 23:40:46 UTC, 1 replies.
- Re: [PR] [SPARK-41341][CORE] Wait shuffle fetch to finish when decommission executor [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2023/10/10 00:22:35 UTC, 0 replies.
- Re: [PR] [SPARK-45473][SQL] Fix incorrect error message for RoundBase [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2023/10/10 00:28:04 UTC, 9 replies.
- [PR] [SPARK-45474][CORE] Support top-level filtering in MasterPage JSON API [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/10 03:05:57 UTC, 0 replies.
- Re: [PR] [SPARK-45474][CORE][WEBUI] Support top-level filtering in MasterPage JSON API [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/10 03:15:01 UTC, 22 replies.
- [PR] [SPARK-45475][SQL] Uses DataFrame.foreachPartition instead of RDD.foreachPartition in JdbcUtils [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/10 03:22:51 UTC, 6 replies.
- Re: [PR] [SPARK-45466][ML] `VectorAssembler` should validate the vector elements [spark] - posted by "srowen (via GitHub)" <gi...@apache.org> on 2023/10/10 03:26:07 UTC, 4 replies.
- Re: [PR] [SPARK-45476][SQL][FOLLOWUP] Raise exception directly instead of calling `resolveColumnsByPosition` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/10/10 05:33:41 UTC, 3 replies.
- [PR] [SPARK-45477][INFRA] Use `matrix.java/inputs.java` to replace the hardcoded Java version in `test results/unit tests log` naming [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/10 06:10:31 UTC, 2 replies.
- Re: [PR] [SPARK-43664][CONNECT][PS][DOCS] Add note for `ps.sql` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/10/10 06:28:17 UTC, 1 replies.
- Re: [PR] [SPARK-45389][SQL][3.3] Correct MetaException matching rule on getting partition metadata [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2023/10/10 06:42:56 UTC, 2 replies.
- Re: [PR] [SPARK-43664][CONNECT][PS] Raise exception for `ps.sql` with Pandas-on-Spark object on Spark Connect. [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/10/10 08:28:23 UTC, 5 replies.
- [PR] [SPARK-45479][INFRA] Uses the default Python versions in the scheduled builds in other branches [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/10 08:35:30 UTC, 2 replies.
- [PR] [SPARK-45480][SQL][UI] Selectable Spark Plan Node on UI [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/10/10 09:00:38 UTC, 13 replies.
- [PR] [SPARK-45481][SQL] Introduce a mapper for parquet compression codecs [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/10 09:23:11 UTC, 19 replies.
- [PR] [SPARK-45483][CONNECT] Correct the function groups in connect.functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/10 10:07:46 UTC, 6 replies.
- [PR] [SPARK-45484][SQL] Fix the bug that uses incorrect parquet compression codec lz4raw [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/10 12:39:06 UTC, 23 replies.
- [PR] [SPARK-45204][CONNECT] Add optional ExecuteHolder to SparkConnectPlanner [spark] - posted by "dillitz (via GitHub)" <gi...@apache.org> on 2023/10/10 12:42:21 UTC, 8 replies.
- Re: [PR] [SPARK-45204][CONNECT] Extend CommandPlugins to be trackable [spark] - posted by "dillitz (via GitHub)" <gi...@apache.org> on 2023/10/10 12:43:39 UTC, 1 replies.
- Re: [PR] [SPARK-45327][BUILD] Upgrade zstd-jni to 1.5.5-6 [spark] - posted by "srowen (via GitHub)" <gi...@apache.org> on 2023/10/10 15:30:00 UTC, 3 replies.
- [PR] Fix the compilation warning related to `other-pure-statement` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/10 15:52:53 UTC, 1 replies.
- [PR] [SPARK-45486][CONNECT] User agent improvements: Use SPARK_CONNECT_USER_AGENT env variable and include environment specific attributes [spark] - posted by "dillitz (via GitHub)" <gi...@apache.org> on 2023/10/10 16:01:50 UTC, 0 replies.
- [PR] [SPARK-45486][CONNECT] Make add_artifact request idempotent [spark] - posted by "cdkrot (via GitHub)" <gi...@apache.org> on 2023/10/10 16:01:52 UTC, 9 replies.
- [PR] [SPARK-45473][SQL][3.5] Fix incorrect error message for RoundBase [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2023/10/10 16:03:25 UTC, 4 replies.
- [PR] [SPARK-45473][SQL][3.4] Fix incorrect error message for RoundBase [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2023/10/10 16:04:56 UTC, 4 replies.
- [PR] V3.4.1 lyft [spark] - posted by "GladwinLee (via GitHub)" <gi...@apache.org> on 2023/10/10 18:04:19 UTC, 3 replies.
- [PR] [SPARK-45488] XML: Add support for value in 'rowTag' element [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2023/10/10 19:12:00 UTC, 17 replies.
- [PR] Bump org.eclipse.jetty:jetty-http from 9.4.52.v20230823 to 9.4.53.v20231009 [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2023/10/10 21:20:31 UTC, 2 replies.
- [PR] [SPARK-45494][PYTHON] Introduce read/write a byte array util functions for PythonWorkerUtils [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2023/10/10 23:10:51 UTC, 1 replies.
- [PR] [SPARK-45475][SQL][3.5] Uses DataFrame.foreachPartition instead of RDD.foreachPartition in JdbcUtils [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/11 00:01:54 UTC, 2 replies.
- Re: [PR] [SPARK-43828][CORE] Add config to control whether close idle connections [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/11 00:17:53 UTC, 1 replies.
- [PR] [SPARK-45495][core] Support stage level task resource profile for k8s cluster when dynamic allocation disabled [spark] - posted by "wbo4958 (via GitHub)" <gi...@apache.org> on 2023/10/11 00:47:23 UTC, 9 replies.
- Re: [PR] [SPARK-45494][PYTHON] Introduce util functions to read/write a byte array for PythonWorkerUtils [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/10/11 00:58:04 UTC, 1 replies.
- Re: [PR] [SPARK-45310][CORE] Report shuffle block status should respect shuffle service during decommission migration [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2023/10/11 03:14:58 UTC, 3 replies.
- Re: [PR] [SPARK-41952][SQL] Fix Parquet zstd off-heap memory leak as a workaround for PARQUET-2160 [spark] - posted by "yujhe (via GitHub)" <gi...@apache.org> on 2023/10/11 03:46:10 UTC, 6 replies.
- Re: [PR] [SPARK-45494][CORE][PYTHON] Introduce util functions to read/write a byte array for PythonWorkerUtils [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/11 04:07:58 UTC, 0 replies.
- Re: [PR] [SPARK-41730][PYTHON] Set tz to UTC while converting of timestamps to python's datetime [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/10/11 04:29:56 UTC, 1 replies.
- Re: [PR] [SPARK-42881][SQL] Codegen Support for get_json_object [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/10/11 04:34:51 UTC, 6 replies.
- [PR] [SPARK-45497][K8S] Add an symbolic link file `spark-examples.jar` in K8s Docker images [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/11 04:40:52 UTC, 0 replies.
- Re: [PR] [SPARK-45116][SQL] Add some comment for param of JdbcDialect `createTable` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/10/11 04:46:29 UTC, 6 replies.
- Re: [PR] [SPARK-42304][FOLLOWUP][SQL] Add test for `GET_TABLES_BY_TYPE_UNSUPPORTED_BY_HIVE_VERSION` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/10/11 04:48:32 UTC, 2 replies.
- Re: [PR] [SPARK-45497][K8S] Add a symbolic link file `spark-examples.jar` in K8s Docker images [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/11 05:09:38 UTC, 17 replies.
- [PR] [SPARK-45499][CORE][TESTS] Replace `Reference#isEnqueued` with `Reference#refersTo` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/11 06:34:58 UTC, 0 replies.
- Re: [PR] [SPARK-14745] [Streaming] [WIP] CEP support in Spark Streaming [spark] - posted by "smileyboy2019 (via GitHub)" <gi...@apache.org> on 2023/10/11 06:35:13 UTC, 0 replies.
- [PR] [SPARK-45498][CORE] Followup: Ignore task completion from old stage a… [spark] - posted by "mayurdb (via GitHub)" <gi...@apache.org> on 2023/10/11 06:36:43 UTC, 3 replies.
- [PR] Use pattern matching for type checking and conversion [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/11 06:56:59 UTC, 1 replies.
- [PR] [SPARK-45500][CORE][WEBUI] Show the number of abnormally completed drivers in MasterPage [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/11 06:59:25 UTC, 16 replies.
- Re: [PR] [SPARK-45501][CORE][SQL] Use pattern matching for type checking and conversion [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/11 07:10:19 UTC, 3 replies.
- Re: [PR] [SPARK-45469][CORE][SQL][CONNECT][PYTHON] Replace `toIterator` with `iterator` for `IterableOnce` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/11 08:56:01 UTC, 1 replies.
- [PR] Get json object test [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/11 10:48:58 UTC, 1 replies.
- [PR] [SPARK-45484][SQL][3.5] Deprecated the incorrect parquet compression codec lz4raw [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/11 11:25:45 UTC, 12 replies.
- Re: [PR] [SPARK-45397][ML][CONNECT] Add array assembler feature transformer [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2023/10/11 12:00:53 UTC, 0 replies.
- Re: [PR] [SPARK-45022][SQL] Provide context for dataset API errors [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/10/11 12:58:14 UTC, 20 replies.
- [PR] [SPARK-45113][PYTHON][DOCS][FOLLOWUP] Make doctests deterministic [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/11 13:43:26 UTC, 3 replies.
- Re: [PR] [SPARK-45496][CORE][DSTREAM] Fix the compilation warning related to `other-pure-statement` [spark] - posted by "srowen (via GitHub)" <gi...@apache.org> on 2023/10/11 13:47:04 UTC, 2 replies.
- [PR] Fix compilation warnings related to `lint-multiarg-infix/other-nullary-override` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/11 15:08:13 UTC, 1 replies.
- Re: [PR] [SPARK-45499][CORE][TESTS] Replace `Reference#isEnqueued` with `Reference#refersTo(null)` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/11 15:12:01 UTC, 3 replies.
- [PR] Use `java.lang.ref.Cleaner` instead of `finalize` for `NioBufferedFileInputStream` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/11 15:24:18 UTC, 5 replies.
- Re: [PR] [SPARK-44855][CONNECT] Small tweaks to attaching ExecuteGrpcResponseSender to ExecuteResponseObserver [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2023/10/11 19:01:30 UTC, 0 replies.
- [PR] [WIP][SPARK-45022][SQL] Provide context for dataset API errors [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/10/11 19:24:36 UTC, 10 replies.
- [PR] Bump org.apache.zookeeper:zookeeper from 3.5.7 to 3.7.2 in /connector/kafka-0-10-sql [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2023/10/11 21:05:42 UTC, 2 replies.
- [PR] Bump org.apache.zookeeper:zookeeper from 3.5.7 to 3.7.2 in /connector/kafka-0-10 [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2023/10/11 21:06:24 UTC, 2 replies.
- [PR] Bump org.apache.zookeeper:zookeeper from 3.5.7 to 3.7.2 [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2023/10/11 21:07:15 UTC, 2 replies.
- [PR] Bump golang.org/x/net from 0.10.0 to 0.17.0 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2023/10/11 22:32:31 UTC, 3 replies.
- [PR] [SPARK-45503][SS] RocksDB to use LZ4 [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2023/10/11 22:49:25 UTC, 13 replies.
- [PR] [SPARK-45504][SS] Lower CPU Priority Of RocksDB Background Threads [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2023/10/11 23:02:30 UTC, 4 replies.
- Re: [PR] [SPARK-43396][CORE] Add config to control max ratio of decommissioning executors [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/12 00:16:22 UTC, 3 replies.
- Re: [PR] [SPARK-42584][CONNECT] Improve output of Column.explain [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/12 00:16:23 UTC, 1 replies.
- [PR] [SPARK-45505][PYTHON] Refactor analyzeInPython to make it reusable [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/10/12 00:19:49 UTC, 8 replies.
- [PR] [SPARK-45507] Correctness fix for correlated scalar subqueries with COUNT aggregates [spark] - posted by "andylam-db (via GitHub)" <gi...@apache.org> on 2023/10/12 00:45:26 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-45507][SQL] Correctness fix for correlated scalar subqueries with COUNT aggregates [spark] - posted by "andylam-db (via GitHub)" <gi...@apache.org> on 2023/10/12 00:46:29 UTC, 1 replies.
- [PR] [SPARK-45487] Fix SQLSTATEs and temp errors [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2023/10/12 00:55:09 UTC, 2 replies.
- [PR] [SPARK-45433][SQL][3.4] Fix CSV/JSON schema inference when timestamps do not match specified timestampFormat [spark] - posted by "Hisoka-X (via GitHub)" <gi...@apache.org> on 2023/10/12 01:00:55 UTC, 3 replies.
- [PR] [SPARK-45508][CORE] Add "--add-opens=java.base/jdk.internal.ref=ALL-UNNAMED" so Platform can access cleaner on Java 9+ [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2023/10/12 01:50:05 UTC, 1 replies.
- [PR] [SPARK-45499][CORE][TESTS][FOLLOWUP] Use `ReferenceQueue#remove` instead of `ReferenceQueue#poll` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/12 02:22:34 UTC, 7 replies.
- [PR] [SPARK-42881][SQL][FOLLOWUP] Codegen Support for get_json_object [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/12 02:54:09 UTC, 1 replies.
- Re: [PR] [SPARK-42881][SQL][FOLLOWUP] Update the results of JsonBenchmark-jdk21 after get_json_object supports codgen [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/12 03:09:07 UTC, 1 replies.
- Re: [PR] [SPARK-45508][CORE] Add "--add-opens=java.base/jdk.internal.ref=ALL-UNNAMED" so Platform can access Cleaner on Java 9+ [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/12 03:12:49 UTC, 6 replies.
- Re: [PR] [SPARK-45488][SQL] XML: Add support for value in 'rowTag' element [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/12 03:16:37 UTC, 3 replies.
- [PR] [SPARK-45510][SQL] Replace `scala.collection.generic.Growable` to `scala.collection.mutable.Growable` [spark] - posted by "Hisoka-X (via GitHub)" <gi...@apache.org> on 2023/10/12 03:45:07 UTC, 5 replies.
- [PR] [SPARK-45502][BUILD] Upgrade Kafka to 3.6.0 [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2023/10/12 05:08:20 UTC, 11 replies.
- Re: [PR] [SPARK-44262][SQL] Add `dropTable` and `getInsertStatement` to JdbcDialect [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/10/12 06:09:18 UTC, 27 replies.
- [PR] Use Enhanced Switch Expressions [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/12 07:49:13 UTC, 1 replies.
- [PR] [SPARK-44752] XML: Update Spark Docs [spark] - posted by "laglangyue (via GitHub)" <gi...@apache.org> on 2023/10/12 08:50:06 UTC, 0 replies.
- [PR] [SPARK-45513][CORE][SQL][MLLIB][CONNECT] Replace `scala.runtime.Tuple2Zipped` to `scala.collection.LazyZip2` [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/12 09:07:36 UTC, 3 replies.
- Re: [PR] [SPARK-44752][SQL] XML: Update Spark Docs [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/12 10:54:54 UTC, 17 replies.
- [PR] [SPARK-45516] Include QueryContext in SparkThrowable proto message [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2023/10/12 12:16:34 UTC, 3 replies.
- Re: [PR] [SPARK-44751][SQL][FOLLOWUP] Change `xmlExpressions.scala` package name [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2023/10/12 12:42:44 UTC, 11 replies.
- [PR] [SPARK-45521][ML] Avoid re-computation of nnz in `VectorAssembler` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/12 13:35:50 UTC, 2 replies.
- Re: [PR] [SPARK-44307][SQL] Add Bloom filter for left outer join even if the left side table is smaller than broadcast threshold. [spark] - posted by "maheshk114 (via GitHub)" <gi...@apache.org> on 2023/10/12 14:47:08 UTC, 20 replies.
- Re: [PR] [SPARK-45507][SQL] Correctness fix for correlated scalar subqueries with COUNT aggregates [spark] - posted by "jchen5 (via GitHub)" <gi...@apache.org> on 2023/10/12 15:18:27 UTC, 10 replies.
- Re: [PR] [SPARK-45512][CORE][SQL][SS][DSTREAM] Fix compilation warnings related to `other-nullary-override` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/12 15:54:25 UTC, 3 replies.
- Re: [PR] [SPARK-45499][CORE][TESTS][FOLLOWUP] Use `ReferenceQueue#remove` instead of `ReferenceQueue#poll` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/12 17:24:51 UTC, 0 replies.
- [PR] [SPARK-45506][CONNECT] Add ivy URI support to SparkConnect addArtifact [spark] - posted by "vsevolodstep-db (via GitHub)" <gi...@apache.org> on 2023/10/12 19:02:44 UTC, 19 replies.
- Re: [PR] [SPARK-44594][KAFKA] Remove redundant method parameter in kafka connector [spark] - posted by "PhilDakin (via GitHub)" <gi...@apache.org> on 2023/10/12 21:02:23 UTC, 0 replies.
- [PR] [SPARK-45266][PYTHON][FOLLOWUP] Fix to resolve UnresolvedPolymorphicPythonUDTF when the table argument is specified as a named argument [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2023/10/12 23:09:12 UTC, 4 replies.
- Re: [PR] [SPARK-45516][CONNECT] Include QueryContext in SparkThrowable proto message [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/12 23:36:37 UTC, 3 replies.
- [PR] [SPARK-45523][Python] Return useful error message if UDTF returns None for non-nullable column [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2023/10/12 23:48:33 UTC, 6 replies.
- Re: [PR] [SPARK-34612][CORE] Make outputDeterministicLevel a public API [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/13 00:18:15 UTC, 1 replies.
- Re: [PR] upgrade github action [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/13 00:18:17 UTC, 1 replies.
- Re: [PR] [SPARK-45515][CORE][SQL] Use enhanced `switch` expressions to replace the regular `switch` statement [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/13 00:49:32 UTC, 8 replies.
- [PR] [SPARK-45526][PYTHON][DOCS] Refine docstring of readwriter `options` [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/10/13 02:09:20 UTC, 3 replies.
- [PR] [SPARK-45528][PYTHON][DOCS] Improve the example of DataFrameReader/Writer.options to take a dictionary [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/13 02:12:45 UTC, 0 replies.
- [PR] [WIP][SPARK-45531][SQL][DOCS] Add more comments and rename some variable name for InjectRuntimeFilter [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/13 02:59:41 UTC, 3 replies.
- [PR] [SPARK-45524][PYTHON][SQL] Initial support for Python data source read API [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/10/13 03:18:16 UTC, 70 replies.
- Re: [PR] [SPARK-45487] [WIP] Fix SQLSTATEs and temp errors [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2023/10/13 04:39:01 UTC, 0 replies.
- Re: [PR] [SPARK-31357][SQL][WIP] Support DataSource V2 View Catalog [spark] - posted by "melin (via GitHub)" <gi...@apache.org> on 2023/10/13 04:41:06 UTC, 1 replies.
- [PR] [SPARK-45532][DOCS] Restore codetabs for the Protobuf Data Source Guide [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/10/13 04:42:19 UTC, 3 replies.
- Re: [PR] [SPARK-45530][CORE] Use `java.lang.ref.Cleaner` instead of `finalize` for `NioBufferedFileInputStream` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/13 04:43:00 UTC, 5 replies.
- Re: [PR] [SPARK-45526][PYTHON][DOCS] Improve the example of DataFrameReader/Writer.options to take a dictionary [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/13 05:23:06 UTC, 1 replies.
- Re: [PR] [SPARK-45356][INFRA] Optimize the Maven daily test configuration [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/13 06:00:22 UTC, 0 replies.
- [PR] [SPARK-45529][Tests] Decrease flakiness by ignore zero offset(wip) [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2023/10/13 06:09:14 UTC, 1 replies.
- [PR] [SPARK-45514][SQL] Replace `scala.runtime.Tuple3Zipped` to `scala.collection.LazyZip3` [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/13 06:57:25 UTC, 0 replies.
- [PR] Lower the default -Xmx of build/mvn to 3g. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/13 08:00:54 UTC, 0 replies.
- Re: [PR] Lower the default `-Xmx` of `build/mvn` to 3g [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/13 08:07:56 UTC, 0 replies.
- [PR] [SPARK-45535][BUILD] Do not compile tests for snapshots and release build [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/13 08:14:24 UTC, 5 replies.
- Re: [PR] [SPARK-45536][BUILD] Lower the default `-Xmx` of `build/mvn` to 3g [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/13 08:15:46 UTC, 12 replies.
- [PR] [SPARK-45537][CORE]Fix the issue where the last task may get stuck in a multi-profile [spark] - posted by "lyy-pineapple (via GitHub)" <gi...@apache.org> on 2023/10/13 08:28:38 UTC, 7 replies.
- Re: [PR] [WIP][SPARK-44752][SQL] XML: Update Spark Docs [spark] - posted by "laglangyue (via GitHub)" <gi...@apache.org> on 2023/10/13 08:32:27 UTC, 7 replies.
- [PR] [SPARK-45538][PYTHON][CONNECT]pyspark connect overwrite_partitions bug [spark] - posted by "xieshuaihu (via GitHub)" <gi...@apache.org> on 2023/10/13 09:14:02 UTC, 3 replies.
- [PR] [WIP] Add support for java 17 and explicit Python versions from 3.5.0 [spark-docker] - posted by "vakarisbk (via GitHub)" <gi...@apache.org> on 2023/10/13 13:39:05 UTC, 0 replies.
- Re: [PR] [WIP] Add support for java 17 and explicit Python versions from spark 3.5.0 onwards [spark-docker] - posted by "Yikun (via GitHub)" <gi...@apache.org> on 2023/10/13 14:42:18 UTC, 7 replies.
- [PR] [SPARK-45517][CONNECT] Expand more exception constructors to support error framework parameters [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2023/10/13 17:15:14 UTC, 7 replies.
- [PR] [SPARK-44733][PYTHON][DOCS] Add Python to Spark type conversion page to PySpark docs. [spark] - posted by "PhilDakin (via GitHub)" <gi...@apache.org> on 2023/10/13 21:26:35 UTC, 18 replies.
- Re: [PR] Move SparkThrowableSuite to spark-common-utils [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/14 00:17:08 UTC, 1 replies.
- Re: [PR] [MINOR] Eliminate maven build warnings: Using platform locale (en actually) to format date/time, i.e. build is platform dependent! [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/14 00:17:09 UTC, 1 replies.
- Re: [PR] [SPARK-44210][CONNECT][SQL][PYTHON] Strengthen type checking and better comply with Connect specifications for `levenshtein` function [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/14 00:17:12 UTC, 2 replies.
- Re: [PR] [SPARK-43879][CONNECT] Decouple handle command and send response on server side [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/14 00:17:14 UTC, 1 replies.
- [PR] [SPARK-45539] Add assert and log to indicate watermark definition is required for streaming aggregation queries in append mode [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2023/10/14 01:21:13 UTC, 0 replies.
- Re: [PR] [SPARK-45539][SS] Add assert and log to indicate watermark definition is required for streaming aggregation queries in append mode [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2023/10/14 01:23:30 UTC, 6 replies.
- [PR] [SPARK-455315] Use java.lang.ref.Cleaner instead of finalize for RemoteBlockPushResolver [spark] - posted by "zhaomin1423 (via GitHub)" <gi...@apache.org> on 2023/10/14 01:59:47 UTC, 0 replies.
- Re: [PR] [SPARK-45534] Use java.lang.ref.Cleaner instead of finalize for RemoteBlockPushResolver [spark] - posted by "zhaomin1423 (via GitHub)" <gi...@apache.org> on 2023/10/14 02:03:12 UTC, 7 replies.
- Re: [PR] [SPARK-45514][SQL][MLLIB] Replace `scala.runtime.Tuple3Zipped` to `scala.collection.LazyZip3` [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/14 02:43:17 UTC, 3 replies.
- [PR] Revert "[SPARK-45536][BUILD] Lower the default `-Xmx` of `build/mvn` to 3g" [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/14 02:53:59 UTC, 4 replies.
- [PR] [SPARK-44662] Perf improvement in BroadcastHashJoin queries with stream side join key on non partition columns [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2023/10/14 03:15:39 UTC, 0 replies.
- [PR] [MINOR][CORE] Add `@Deprecated` for `SparkLauncher#DEPRECATED_CHILD_CONNECTION_TIMEOUT` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/14 03:56:43 UTC, 2 replies.
- Re: [PR] [SPARK-45531][SQL][DOCS] Add more comments and rename some variable name for InjectRuntimeFilter [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/14 04:35:21 UTC, 4 replies.
- [PR] [SPARK-42669][CONNECT] Short circuit local relation RPCs [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/14 05:35:23 UTC, 1 replies.
- [PR] [SPARK-45540][BUILD] Upgrade jetty to 9.4.53.v20231009 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/14 13:05:33 UTC, 2 replies.
- [PR] [SPARK-45491] Add missing SQLSTATES 2/2 [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2023/10/14 22:35:59 UTC, 2 replies.
- Re: [PR] [SPARK-44318][BUILD] Remove useless dependencies - javax.ws.rs-api [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/15 00:19:21 UTC, 1 replies.
- Re: [PR] [SPARK-24497][SQL] Support recursive SQL [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/15 00:19:23 UTC, 1 replies.
- [PR] [SPARK-45542][CORE] Replace `setSafeMode(HdfsConstants.SafeModeAction, boolean)` with `setSafeMode(SafeModeAction, boolean)` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/15 10:18:00 UTC, 5 replies.
- Re: [PR] [SPARK-45529][SS][TESTS] Decrease flakiness by ignore zero offset(wip) [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/15 10:48:18 UTC, 2 replies.
- Re: [PR] [SPARK-44594][SS] Remove redundant method parameter in kafka connector [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/15 23:51:40 UTC, 2 replies.
- [PR] [SPARK-45546][BUILD] Do not compile docs for snapshots deploy [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/16 00:14:16 UTC, 0 replies.
- Re: [PR] [SPARK-44330][SQL] Use PartitionEvaluator API in BroadcastNestedLoopJoinExec & BroadcastHashJoinExec [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/16 00:18:31 UTC, 1 replies.
- Re: [PR] [SPARK-43491][SQL] In expression should act as same as EqualTo when elements in IN expression have same DataType. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/16 00:18:34 UTC, 1 replies.
- Re: [PR] [SPARK-33393][SQL] Support SHOW TABLE EXTENDED in v2 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/16 00:18:36 UTC, 70 replies.
- Re: [PR] [SPARK-45546][BUILD][INFRA] Do not compile docs for snapshots deploy [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/16 00:25:27 UTC, 1 replies.
- [PR] Revert "[SPARK-45502][BUILD] Upgrade Kafka to 3.6.0" [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/16 01:01:14 UTC, 7 replies.
- Re: [PR] [SPARK-45534][CORE] Use java.lang.ref.Cleaner instead of finalize for RemoteBlockPushResolver [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/16 01:40:05 UTC, 45 replies.
- [PR] [SPARK-45547][ML] Validate Vectors with built-in function [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/16 02:50:34 UTC, 10 replies.
- [PR] [SPARK-44619][INFRA][3.5] Free up disk space for container jobs [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/16 03:28:57 UTC, 9 replies.
- Re: [PR] [SPARK-45485][CONNECT] User agent improvements: Use SPARK_CONNECT_USER_AGENT env variable and include environment specific attributes [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/16 07:59:59 UTC, 9 replies.
- [PR] [DO-NOT-MERGE][PYTHON] Simple Pythonic catalog reference [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/16 08:59:36 UTC, 0 replies.
- [PR] [SPARK-45549][CORE] Remove unused `numExistingExecutors` in `CoarseGrainedSchedulerBackend` [spark] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2023/10/16 10:58:05 UTC, 5 replies.
- [PR] [SPARK-45550][PS] Remove deprecated APIs from Pandas API on Spark [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/10/16 11:14:52 UTC, 3 replies.
- Re: [PR] [SPARK-45035][SQL] Fix ignoreCorruptFiles/ignoreMissingFiles with multiline CSV/JSON will report error [spark] - posted by "Hisoka-X (via GitHub)" <gi...@apache.org> on 2023/10/16 12:04:36 UTC, 26 replies.
- Re: [PR] [SPARK-39420][SQL] Support `ANALYZE TABLE` on Datasource V2 tables [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/10/16 13:07:52 UTC, 8 replies.
- Re: [PR] [SPARK-43035][Connect] Add error class in Spark Connect server's ErrorInfo [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/10/16 14:24:40 UTC, 1 replies.
- [PR] [WIP][SPARK-45543][SQL] WindowGroupLimit causes bug if window expressions exists non-rank function. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/16 15:07:16 UTC, 0 replies.
- [PR] [SPARK-45541][CORE] Add SSLFactory [spark] - posted by "hasnain-db (via GitHub)" <gi...@apache.org> on 2023/10/16 15:53:55 UTC, 19 replies.
- [PR] [SPARK-45545][CORE] Pass SSLOptions wherever we create a SparkTransportConf [spark] - posted by "hasnain-db (via GitHub)" <gi...@apache.org> on 2023/10/16 15:54:02 UTC, 19 replies.
- Re: [PR] [SPARK-45507][SQL] Correctness fix for nested correlated scalar subqueries with COUNT aggregates [spark] - posted by "jchen5 (via GitHub)" <gi...@apache.org> on 2023/10/16 20:32:42 UTC, 10 replies.
- [PR] [SPARK-45562][SQL] XML: Make 'rowTag' a required option [spark] - posted by "sandip-db (via GitHub)" <gi...@apache.org> on 2023/10/16 22:22:45 UTC, 9 replies.
- [PR] [SPARK-45561] Add proper conversions for SMALLINT and TINYINT in MySQLDialect [spark] - posted by "michaelzhan-db (via GitHub)" <gi...@apache.org> on 2023/10/16 22:27:21 UTC, 0 replies.
- Re: [PR] [SPARK-42942][SQL] Support coalesce table cache stage partitions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/17 00:17:59 UTC, 1 replies.
- [PR] [SPARK-45564][SQL] Simplify 'DataFrameStatFunctions.bloomFilter' function with 'BloomFilterAggregate' expression [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/17 00:22:04 UTC, 0 replies.
- Re: [PR] [SPARK-45283][CORE][TESTS][3.5] Make StatusTrackerSuite less fragile [spark] - posted by "smileyboy2019 (via GitHub)" <gi...@apache.org> on 2023/10/17 02:22:50 UTC, 2 replies.
- Re: [PR] [SPARK-45564][SQL] Simplify 'DataFrameStatFunctions.bloomFilter' with 'BloomFilterAggregate' expression [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/17 02:31:03 UTC, 3 replies.
- Re: [PR] [SPARK-45561] Add proper conversions for TINYINT in MySQLDialect and MsSqlServerDialect [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/17 02:36:29 UTC, 5 replies.
- [PR] [SPARK-45565][UI] Unnecessary JSON.stringify and JSON.parse loop for task list on stage detail [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/10/17 03:12:39 UTC, 2 replies.
- Re: [PR] [SPARK-45546][BUILD][INFRA] Skip compile docs for snapshots deploy [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/17 03:24:56 UTC, 4 replies.
- [PR] [SPARK-45558][SS] Introduce a metadata file for streaming stateful operator [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2023/10/17 04:05:47 UTC, 10 replies.
- [PR] [SPARK-45568][TESTS] Fix flaky WholeStageCodegenSparkSubmitSuite [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/10/17 05:54:14 UTC, 6 replies.
- [PR] [SPARK-45567][CONNECT] Remove redundant if in org.apache.spark.sql.connect.execution.ExecuteGrpcResponseSender#run [spark] - posted by "zhaomin1423 (via GitHub)" <gi...@apache.org> on 2023/10/17 06:40:50 UTC, 5 replies.
- Re: [PR] [SPARK-45543][SQL] WindowGroupLimit causes bug if the other window functions haven't the same window frame as the rank-like functions [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/17 06:41:48 UTC, 7 replies.
- Re: [PR] Add support for java 17 from spark 3.5.0 [spark-docker] - posted by "vakarisbk (via GitHub)" <gi...@apache.org> on 2023/10/17 06:52:24 UTC, 16 replies.
- [PR] [SPARK-45569][SQL] Assign name to the error _LEGACY_ERROR_TEMP_2152 [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2023/10/17 08:13:25 UTC, 7 replies.
- [PR] SPARK-45478: Codegen sum(decimal_column / 2) computes div twice [spark] - posted by "houzhizhen (via GitHub)" <gi...@apache.org> on 2023/10/17 08:44:14 UTC, 0 replies.
- [PR] [SPARK-45566][PS] Support Pandas-like testing utils for Pandas API on Spark [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/10/17 09:27:28 UTC, 3 replies.
- Re: [PR] [SPARK-45546][BUILD][INFRA] Make `publish-snapshot` support `package` first then `deploy` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/17 09:50:52 UTC, 14 replies.
- [PR] [SPARK-45572][PS][DOCS] Enable doctest of Frame.transpose [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/17 11:43:11 UTC, 3 replies.
- [PR] [SPARK-44667][INFRA][FOLLOWUP] Uninstall large ML libraries in `sparkr` and `lint` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/17 12:06:46 UTC, 0 replies.
- [PR] [MINOR][DOCS] Fix one typo [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/17 12:19:15 UTC, 2 replies.
- [PR] [MINOR][SQL] Remove signature from Hive thriftserver exception [spark] - posted by "srowen (via GitHub)" <gi...@apache.org> on 2023/10/17 13:37:34 UTC, 5 replies.
- [PR] [SPARK-45575][SQL] Support time travel options for df read API [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/10/17 15:29:47 UTC, 26 replies.
- [PR] [SPARK-45576][CORE] Remove unnecessary debug logs in ReloadingX509TrustManagerSuite [spark] - posted by "hasnain-db (via GitHub)" <gi...@apache.org> on 2023/10/17 16:37:34 UTC, 5 replies.
- [PR] [SPARK-38723][CORE][STREAMING][TESTS] Add test for streaming query resume race condition. [spark] - posted by "PhilDakin (via GitHub)" <gi...@apache.org> on 2023/10/17 18:12:11 UTC, 1 replies.
- [PR] [SPARK-45578][CORE] Remove `InaccessibleObjectException` usage by using `trySetAccessible` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/17 19:50:33 UTC, 3 replies.
- [PR] [SPARK-45577][PYTHON] Fix UserDefinedPythonTableFunctionAnalyzeRunner to pass folded values from named arguments [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2023/10/17 19:56:14 UTC, 4 replies.
- [PR] [SPARK-45009][SQL][FOLLOW UP] Turn off decorrelation in join conditions for AQE InSubquery test [spark] - posted by "andylam-db (via GitHub)" <gi...@apache.org> on 2023/10/17 20:21:25 UTC, 3 replies.
- Re: [PR] [SPARK-42768][SQL] Enable cached plan apply AQE by default [spark] - posted by "revans2 (via GitHub)" <gi...@apache.org> on 2023/10/17 21:10:53 UTC, 2 replies.
- [PR] [SPARK-45579][CORE] Catch errors for FallbackStorage.copy [spark] - posted by "ukby1234 (via GitHub)" <gi...@apache.org> on 2023/10/17 21:34:12 UTC, 20 replies.
- [PR] [SPART-45581] mandatory SQLSTATEs [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2023/10/18 00:01:07 UTC, 0 replies.
- Re: [PR] [SPARK-45581] [WIP] mandatory SQLSTATEs [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2023/10/18 00:05:25 UTC, 0 replies.
- [PR] [MINOR][DOCS] Update the docs for spark.sql.optimizer.canChangeCachedPlanOutputPartitioning configuration [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/18 00:07:36 UTC, 2 replies.
- Re: [PR] [SPARK-43171][K8S] Support custom Unix username in Pod [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/18 00:17:55 UTC, 1 replies.
- Re: [PR] [SPARK-42359][SQL] Support row skipping when reading CSV files [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/18 00:17:58 UTC, 1 replies.
- [PR] [SPARK-45581] Make SQLSTATE mandatory. [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2023/10/18 00:25:45 UTC, 4 replies.
- [PR] [SPARK-45582] Ensure that store instance is not used after calling commit within output mode streaming aggregation [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2023/10/18 01:17:18 UTC, 0 replies.
- Re: [PR] [SPARK-45582][SS] Ensure that store instance is not used after calling commit within output mode streaming aggregation [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2023/10/18 01:18:49 UTC, 7 replies.
- [PR] [SPARK-45569][SQL] Assign name to the error _LEGACY_ERROR_TEMP_2153 [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2023/10/18 02:15:50 UTC, 6 replies.
- [PR] [SPARK-45546][BUILD][FOLLOW-UP] Remove snapshot repo mistakenly added [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/18 02:19:20 UTC, 2 replies.
- [PR] [SPARK-45562][SQL][FOLLOW-UP] XML: Make 'rowTag' option check case insensitive [spark] - posted by "sandip-db (via GitHub)" <gi...@apache.org> on 2023/10/18 02:35:44 UTC, 4 replies.
- Re: [PR] [SPARK-45561] Add proper conversions for TINYINT in MySQLDialect [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/18 02:44:23 UTC, 6 replies.
- [PR] [MINOR][INFRA] Skip if JIRA ID is an empty string [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/18 02:52:26 UTC, 4 replies.
- [PR] [SPARK-45500][CORE][WEBUI][FOLLOWUP] Show RELAUNCHING drivers too [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/18 03:04:44 UTC, 0 replies.
- Re: [PR] [SPARK-45500][CORE][WEBUI][FOLLOWUP] Show `RELAUNCHING` drivers too [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/18 03:06:00 UTC, 3 replies.
- Re: [PR] [SPARK-44667][INFRA][FOLLOWUP] Uninstall large ML libraries in `sparkr` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/18 03:38:03 UTC, 4 replies.
- [PR] [SPARK-45584][SQL] Fix subquery execution failure with TakeOrderedAndProjectExec [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/10/18 04:03:37 UTC, 7 replies.
- [PR] [SPARK-45586][SQL] Reduce compiler latency for plans with large expression trees [spark] - posted by "kelvinjian-db (via GitHub)" <gi...@apache.org> on 2023/10/18 04:27:15 UTC, 6 replies.
- [PR] [SPARK-45585][TEST] Fix time format and redirection issues in SparkSubmit tests [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/10/18 04:43:30 UTC, 2 replies.
- [PR] [SPARK-45587][INFRA] Skip Unidoc in `build` GitHub Action jobs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/18 05:10:11 UTC, 0 replies.
- [PR] [SPARK-45576][CORE][FOLLOWUP] Remove unused imports to fix Java linter errors [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/18 05:12:34 UTC, 7 replies.
- [PR] [SPARK-45588]Minor Scaladoc improvement for StreamingForeachBatchHelper [spark] - posted by "rangadi (via GitHub)" <gi...@apache.org> on 2023/10/18 05:54:12 UTC, 3 replies.
- Re: [PR] [SPARK-45587][INFRA] Skip UNIDOC and MIMA in `build` GitHub Action job [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/18 05:54:18 UTC, 5 replies.
- [PR] [SPIP-IN-PROGRESS][DO-NOT-MERGE][SPARK-45511][SS] State Data Source - Reader [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2023/10/18 06:07:01 UTC, 18 replies.
- [PR] [SPARK-45553][PS] Deprecate `assertPandasOnSparkEqual` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/10/18 06:42:19 UTC, 11 replies.
- [PR] [SPARK-45589][PYSPARK][DOCS] Supplementary exception class [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/18 06:45:45 UTC, 3 replies.
- [PR] [SPARK-45410][INFRA][FOLLOW-UP] Rename "Python - PyPy3.8 (master)" to "Build / Python-only (master, PyPy 3.8)" [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/18 07:20:31 UTC, 6 replies.
- [PR] [SPARK-45353][SPARK-45196][PYTHON][DOCS][FOLLOW-UP] Fix doctests of array and create_map compatible with ANSI mode [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/18 07:53:00 UTC, 8 replies.
- [PR] [SPARK-45574][SQL] Add :: syntax as a shorthand for casting [spark] - posted by "mitkedb (via GitHub)" <gi...@apache.org> on 2023/10/18 07:57:37 UTC, 23 replies.
- [PR] [SPARK-45591][BUILD] Upgrade ASM to 9.6 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/18 08:29:16 UTC, 3 replies.
- [PR] Test moving mllib to a separate test group. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/18 10:50:58 UTC, 0 replies.
- [PR] [SPARK-45552][PS] Introduce flexible parameters to `assertDataFrameEqual` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/10/18 11:29:22 UTC, 6 replies.
- [PR] Fix typos [spark] - posted by "shuoer86 (via GitHub)" <gi...@apache.org> on 2023/10/18 13:25:59 UTC, 4 replies.
- Re: [PR] [SPARK-45589][PYTHON][DOCS] Supplementary exception class [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/18 13:47:09 UTC, 4 replies.
- [PR] [SPARK-45592][SQL][WIP] Correctness issue in AQE with InMemoryTableScanExec [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2023/10/18 13:58:16 UTC, 14 replies.
- [PR] [SPARK-45593][BUILD] Building a runnable distribution from master code running spark-sql raise error "java.lang.ClassNotFoundException: org.sparkproject.guava.util.concurrent.internal.InternalFutureFailureAccess" [spark] - posted by "Yikf (via GitHub)" <gi...@apache.org> on 2023/10/18 15:11:52 UTC, 1 replies.
- Re: [PR] [SPARK-45593][BUILD] Building a runnable distribution from master code running spark-sql raise error [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/18 15:15:05 UTC, 12 replies.
- [PR] [SPARK-45594][SQL] Auto repartition before writing data into partitioned or bucket table [spark] - posted by "wankunde (via GitHub)" <gi...@apache.org> on 2023/10/18 15:15:43 UTC, 0 replies.
- [PR] [SPARK-45595] Expose SQLSTATE in error message [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2023/10/18 16:45:26 UTC, 29 replies.
- [PR] [SPARK 45596][CONNECT] Use java.lang.ref.Cleaner instead of org.apache.spark.sql.connect.client.util.Cleaner [spark] - posted by "zhaomin1423 (via GitHub)" <gi...@apache.org> on 2023/10/18 18:19:25 UTC, 0 replies.
- [PR] [CONNECT] fix typo in org.apache.spark.sql.connect.client.ArtifactManager [spark] - posted by "zhaomin1423 (via GitHub)" <gi...@apache.org> on 2023/10/18 18:24:17 UTC, 0 replies.
- Re: [PR] [SPARK-45523][Python] Return useful error message if UDTF returns None for any non-nullable column [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/10/18 20:18:19 UTC, 11 replies.
- [PR] Update HintErrorLogger.scala to fix typo in the error message [spark] - posted by "CerebralMastication (via GitHub)" <gi...@apache.org> on 2023/10/18 20:23:29 UTC, 0 replies.
- [PR] Typo fixed yyy to yyyy [spark] - posted by "metecanakar (via GitHub)" <gi...@apache.org> on 2023/10/18 20:41:22 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-45230][SQL] Plan sorter for Aggregate after SMJ [spark] - posted by "singhpk234 (via GitHub)" <gi...@apache.org> on 2023/10/18 21:21:40 UTC, 0 replies.
- [PR] [SPARK-44635][CORE] Refresh shuffle locations when decommission happens [spark] - posted by "ukby1234 (via GitHub)" <gi...@apache.org> on 2023/10/18 23:08:54 UTC, 3 replies.
- Re: [PR] [SPARK-44347][BUILD] Upgrade janino to 3.1.10 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/19 00:17:40 UTC, 1 replies.
- Re: [PR] [SPARK-43829][CONNECT] Improve SparkConnectPlanner by reuse Dataset and avoid construct new Dataset [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/19 00:17:43 UTC, 3 replies.
- Re: [PR] [SPARK-45588][PROTOBUF][CONNECT][MINOR] Scaladoc improvement for StreamingForeachBatchHelper [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2023/10/19 01:43:52 UTC, 3 replies.
- Re: [PR] [SPARK-45543][SQL] `InferWindowGroupLimit` causes bug if the other window functions haven't the same window frame as the rank-like functions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/10/19 02:21:36 UTC, 2 replies.
- [PR] [SPARK-45555][PYTHON] Returning a debuggable object for failed assertion [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/10/19 03:10:54 UTC, 15 replies.
- Re: [PR] [SPARK-45596][CONNECT] Use java.lang.ref.Cleaner instead of org.apache.spark.sql.connect.client.util.Cleaner [spark] - posted by "zhaomin1423 (via GitHub)" <gi...@apache.org> on 2023/10/19 03:12:03 UTC, 16 replies.
- [PR] [SPARK-45602][CORE][SQL][YARN][K8S] Replace `s.c.MapOps.filterKeys` with `s.c.MapOps.view.filterKeys` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/19 03:48:52 UTC, 0 replies.
- [PR] [SPARK-45392][SQL][FOLLOWUP] Restore the original exception from data source [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/10/19 04:45:00 UTC, 3 replies.
- [PR] [SPARK-45603][INFRA] merge_spark_pr shall notify us about GITHUB_OAUTH_KEY expiry [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/10/19 05:05:30 UTC, 4 replies.
- Re: [PR] [MINOR][SQL] Update HintErrorLogger.scala to fix typo in the error message [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/19 05:09:21 UTC, 0 replies.
- Re: [PR] [MINOR][CONNECT] Fix a typo in org.apache.spark.sql.connect.client.ArtifactManager [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/19 05:10:00 UTC, 1 replies.
- Re: [PR] [SPARK-45366][SQL] Remove productHash from TreeNode [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/19 07:48:59 UTC, 4 replies.
- [PR] [SPARK-45605][CORE][SQL][SS][CONNECT][MLLIB][EXAMPLES] Replace `s.c.MapOps.mapValues` with `s.c.MapOps.view.mapValues` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/19 07:55:21 UTC, 1 replies.
- [PR] [WIP][SPARK-45606][SQL] Release restrictions on multi-layer runtime filter [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/19 08:05:12 UTC, 0 replies.
- [PR] [SPARK-45554][PYTHON] Introduce flexible parameter to assertSchemaEqual [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/10/19 08:08:35 UTC, 0 replies.
- [PR] [SPARK-45604] Add LogicalType checking on INT64 -> DateTime conversion on Parquet Vectorized Reader [spark] - posted by "majdyz (via GitHub)" <gi...@apache.org> on 2023/10/19 08:09:43 UTC, 3 replies.
- [PR] [WIP] [SPARK-45604] Prevent SEGFAULT on OffHeapColumnVector by providing explicit memory boundary check [spark] - posted by "majdyz (via GitHub)" <gi...@apache.org> on 2023/10/19 08:31:26 UTC, 0 replies.
- [PR] [SPARK-45607][SQL] Collapse repartition operators with a project [spark] - posted by "wankunde (via GitHub)" <gi...@apache.org> on 2023/10/19 08:49:08 UTC, 0 replies.
- [PR] [SPARK-45428][PYTHON][DOCS] Add Matomo analytics to pyspark docs pages [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/19 09:04:08 UTC, 6 replies.
- [PR] [SPARK-45562][SQL][FOLLOWUP] Restore test case not require `rowTag` option. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/19 10:55:43 UTC, 8 replies.
- Re: [PR] [MINOR][PYTHON][DOCS] Typo fixed yyy to yyyy at date_format function [spark] - posted by "metecanakar (via GitHub)" <gi...@apache.org> on 2023/10/19 12:13:44 UTC, 1 replies.
- Re: [PR] [SPARK-45554][PYTHON] Introduce flexible parameter to `assertSchemaEqual` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/10/19 13:33:29 UTC, 6 replies.
- [PR] [SPARK-45368]Remove scala2.12 compatibility logic for DoubleType, Flo… [spark] - posted by "laglangyue (via GitHub)" <gi...@apache.org> on 2023/10/19 15:52:02 UTC, 0 replies.
- Re: [PR] [SPARK-45368]Remove scala2.12 compatibility logic for DoubleType, FloatType, Decimal [spark] - posted by "laglangyue (via GitHub)" <gi...@apache.org> on 2023/10/19 16:02:01 UTC, 2 replies.
- [PR] [SPARK-45609][CONNECT] Include SqlState in SparkThrowable proto message [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2023/10/19 16:29:04 UTC, 7 replies.
- [PR] [DO-NOT-MERGE][DSTREAM] Fatal error (e.g. OOM) during generating streaming jobs should fail the streaming context [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2023/10/19 22:32:21 UTC, 4 replies.
- Re: [PR] [SPARK-45611][PYTHON][DOCS] Typo fixed yyy to yyyy at date_format function [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/20 00:11:19 UTC, 4 replies.
- Re: [PR] Use pandas ExtensionDtype for integral Series with nulls [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/20 00:17:43 UTC, 1 replies.
- [PR] [SPARK-45553][3.5][PS] Correct warning messages [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/10/20 00:47:01 UTC, 3 replies.
- [PR] [SPARK-45612][CORE] Allow cached RDDs to migrate to fallback storage during decommission [spark] - posted by "ukby1234 (via GitHub)" <gi...@apache.org> on 2023/10/20 00:53:20 UTC, 0 replies.
- [PR] SPARK-45613: Expose DeterministicLevel as a DeveloperApi [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2023/10/20 01:58:20 UTC, 1 replies.
- Re: [PR] [SPARK-45606][SQL] Release restrictions on multi-layer runtime filter [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/20 03:23:07 UTC, 4 replies.
- Re: [PR] [SPARK-44635][CORE] Handle shuffle fetch failures in decommissions [spark] - posted by "ukby1234 (via GitHub)" <gi...@apache.org> on 2023/10/20 04:30:16 UTC, 4 replies.
- [PR] [SPARK-44753][PYSPARK] XML: pyspark sql xml reader writer [spark] - posted by "sandip-db (via GitHub)" <gi...@apache.org> on 2023/10/20 05:25:25 UTC, 0 replies.
- Re: [PR] [SPARK-44753][PYTHON] XML: pyspark sql xml reader writer [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/20 05:35:56 UTC, 0 replies.
- Re: [PR] [SPARK-44837][SQL] Change ALTER TABLE ALTER PARTITION column error message [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/10/20 05:54:58 UTC, 1 replies.
- Re: [PR] [SPARK-45613][CORE] Expose DeterministicLevel as a DeveloperApi [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/20 06:22:15 UTC, 2 replies.
- Re: [PR] [SPARK-45604][SQL] Add LogicalType checking on INT64 -> DateTime conversion on Parquet Vectorized Reader [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/10/20 06:28:49 UTC, 3 replies.
- [PR] [SPARK-39910][SQL] Delegate path qualification to filesystem during DataSource file path globbing [spark] - posted by "tigrulya-exe (via GitHub)" <gi...@apache.org> on 2023/10/20 09:28:24 UTC, 7 replies.
- [PR] [SPARK-45484][SQL][FOLLOWUP][DOCS] Update the document of parquet compression codec [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/20 09:47:54 UTC, 4 replies.
- [PR] [SPARK-45509][SQL] Fix df column reference behavior for Spark Connect [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/10/20 12:22:37 UTC, 13 replies.
- Re: [PR] [MINOR] Fix typos [spark] - posted by "shuoer86 (via GitHub)" <gi...@apache.org> on 2023/10/20 12:36:57 UTC, 2 replies.
- Re: [PR] [SPARK-45602][CORE][SQL][SS][YARN][K8S] Replace `s.c.MapOps.filterKeys` with `s.c.MapOps.view.filterKeys` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/20 15:02:05 UTC, 1 replies.
- Re: [PR] [SPARK-30848][SQL] Remove productHash from TreeNode [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/20 16:07:12 UTC, 0 replies.
- Re: [PR] [SPARK-45368][SQL] Remove scala2.12 compatibility logic for DoubleType, FloatType, Decimal [spark] - posted by "laglangyue (via GitHub)" <gi...@apache.org> on 2023/10/20 16:47:52 UTC, 20 replies.
- [PR] [SPARK-45616][CORE] Avoid ParVector, which does not propagate ThreadLocals or SparkSession [spark] - posted by "ankurdave (via GitHub)" <gi...@apache.org> on 2023/10/20 17:51:18 UTC, 4 replies.
- [PR] [SPARK-XXXXX][BUILD] Upgrade Apache Commons Crypto 1.2.0 [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2023/10/20 20:10:16 UTC, 0 replies.
- [PR] [SPARK-XXXXX][CORE] Remove BaseErrorHandler [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2023/10/20 20:33:00 UTC, 2 replies.
- Re: [PR] [SPARK-45618][CORE] Remove BaseErrorHandler [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2023/10/20 20:41:46 UTC, 11 replies.
- Re: [PR] [SPARK-45617][BUILD] Upgrade Apache Commons Crypto 1.2.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/20 21:25:22 UTC, 17 replies.
- [PR] [SPARK-45619][CONNECT][PYTHON] Apply the observed metrics to Observation object [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2023/10/20 21:43:56 UTC, 5 replies.
- [PR] [SPARK-45620][PYTHON] Fix user-facing APIs related to Python UDTF to use camelCase [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2023/10/20 22:36:17 UTC, 12 replies.
- Re: [PR] [SPARK-43778][SQL]Reassign expression IDs in the scalar subquery input [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/21 00:17:03 UTC, 1 replies.
- [PR] [SPARK-45621] Add feature to evaluate subquery before push down filter Optimizer rule [spark] - posted by "maytasm (via GitHub)" <gi...@apache.org> on 2023/10/21 06:21:48 UTC, 6 replies.
- [PR] [SPARK-45610] Fix the compilation warning "Auto-application to `()` is deprecated" and turn it into a compilation error. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/21 06:31:20 UTC, 0 replies.
- Re: [PR] [SPARK-45610][BUILD][CORE][SQL][SS][CONNECT][GRAPHX][DSTREAM][ML][MLLIB][K8S][YARN][SHELL][PYTHON][R][AVRO][UI][EXAMPLES] Fix the compilation warning "Auto-application to `()` is deprecated" and turn it into a compilation error [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/21 06:52:44 UTC, 6 replies.
- [PR] [SPARK-40820][PYTHON] Creating StructType from Json [spark] - posted by "anthonywainer (via GitHub)" <gi...@apache.org> on 2023/10/21 20:58:42 UTC, 0 replies.
- Re: [PR] [SPARK-43238][CORE] Support only decommission idle workers in standalone [spark] - posted by "warrenzhu25 (via GitHub)" <gi...@apache.org> on 2023/10/22 00:29:25 UTC, 2 replies.
- [PR] [SPARK-41954][CORE] Add isDecommissioned in ExecutorDeadException [spark] - posted by "warrenzhu25 (via GitHub)" <gi...@apache.org> on 2023/10/22 04:09:39 UTC, 0 replies.
- [PR] [SPARK-45622][BUILD] java -target should use java.version instead of 17 [spark] - posted by "warrenzhu25 (via GitHub)" <gi...@apache.org> on 2023/10/22 04:14:35 UTC, 1 replies.
- [PR] [SPARK-45624][CORE][TESTS] Use `AccessibleObject#canAccess` instead of `AccessibleObject#isAccessible` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/22 09:35:27 UTC, 5 replies.
- [PR] [SPARK-45625][BUILD] Upgrade log4j to 2.21.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/22 12:12:54 UTC, 2 replies.
- [PR] [SPARK-45626][SQL] Fix variable name of error-class & assign names to the error class _LEGACY_ERROR_TEMP_1055 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/22 13:30:49 UTC, 3 replies.
- Re: [PR] [SPARK-40820][PYTHON&SCALA] Creating StructType from Json [spark] - posted by "anthonywainer (via GitHub)" <gi...@apache.org> on 2023/10/22 15:43:54 UTC, 0 replies.
- Re: [PR] [SPARK-44407][BUILD] Add a new Scala checkstyle rule to prohibit using `enum` as a variable or function name [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/22 17:44:08 UTC, 0 replies.
- Re: [PR] [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort stage when committed file not consistent with task status [spark] - posted by "mstebelev (via GitHub)" <gi...@apache.org> on 2023/10/22 22:15:57 UTC, 7 replies.
- Re: [PR] [SPARK-44427][SQL] Use PartitionEvaluator API in MapElementsExec, MapGroupsExec, MapPartitionsExec [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/23 00:18:06 UTC, 2 replies.
- Re: [PR] [SPARK-44406][CONNECT] Make `SparkSession.sql` work properly with dropped temp view [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/23 00:18:08 UTC, 1 replies.
- Re: [PR] [SPARK-40820][PYTHON][SQL] Creating StructType from Json [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/23 01:30:47 UTC, 6 replies.
- Re: [PR] [SPARK-44753][PYTHON][CONNECT] XML: pyspark sql xml reader writer [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/23 01:32:07 UTC, 1 replies.
- [PR] [SPARK-45628][ML] Improve `vector_to_array` for `.mllib.linalg.SparseVector` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/23 02:08:00 UTC, 2 replies.
- [PR] [SPARK-45614][SQL] Assign names to error _LEGACY_ERROR_TEMP_215[6,7,8] [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2023/10/23 02:24:49 UTC, 10 replies.
- Re: [PR] [SPARK-45626][SQL] Fix variable name of error-class & convert _LEGACY_ERROR_TEMP_1055 to REQUIRES_SINGLE_PART_NAMESPACE [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/23 03:26:48 UTC, 3 replies.
- Re: [PR] [SPARK-45623][INFRA] Move `mllib` and `mllib-local` to separate test group [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/23 04:37:53 UTC, 5 replies.
- [PR] [SPARK-45630][CORE][SQL][YARN] Replace `s.c.mutable.MapOps#retain` with `s.c.mutable.MapOps#filterInPlace` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/23 06:11:47 UTC, 0 replies.
- [PR] [SPARK-45631][SS][PYSPARK] Remove @abstractmethod from onQueryIdle in PySpark StreamingQueryListener [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2023/10/23 06:31:15 UTC, 3 replies.
- [PR] [SPARK-45632][SQL] Table cache should avoid unnecessary ColumnarToRow when enable AQE [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2023/10/23 07:49:43 UTC, 5 replies.
- [PR] Revert "[SPARK-45620][PYTHON] Fix user-facing APIs related to Python UDTF to use camelCase" [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/23 08:15:42 UTC, 2 replies.
- Re: [PR] [SPARK-45630][CORE][SQL][SS][YARN] Replace `mutable.MapOps#retain` with `mutable.MapOps#filterInPlace` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/23 08:21:46 UTC, 2 replies.
- [PR] [SPARK-45633][PYTHON][SQL][TESTS] Make SQL test group depend on `analyze_udtf` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/23 08:36:57 UTC, 1 replies.
- [PR] [SPARK-45627][BUILD] Fix `symbol literal is deprecated` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/23 09:27:27 UTC, 3 replies.
- Re: [PR] [SPARK-45633][PYTHON][SQL][TESTS] Make SQL test group depend on `analyze_udtf.py` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/23 10:10:14 UTC, 1 replies.
- [PR] [SPARK-45634][PS] Remove `DataFrame.get_dtype_counts` from Pandas API on Spark [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/10/23 10:38:00 UTC, 2 replies.
- [PR] [SPARK-45635][PYTHON][TESTS] Cleanup unused import for PySpark testing [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/10/23 11:00:34 UTC, 2 replies.
- Re: [PR] [SPARK-45592][SQL] Correctness issue in AQE with InMemoryTableScanExec [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2023/10/23 11:20:20 UTC, 20 replies.
- [PR] [SPARK-45636][BUILD] Upgrade jersey to 2.41 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/23 15:06:23 UTC, 4 replies.
- [PR] [SPARK-xxxx][Avro] Improve test coverage of decimal conversion [spark] - posted by "yananxin-db (via GitHub)" <gi...@apache.org> on 2023/10/23 17:47:53 UTC, 0 replies.
- Re: [PR] [SPARK-44443][SQL] Use PartitionEvaluator API in CoGroupExec, DeserializeToObjectExec, ExternalRDDScanExec [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/24 00:17:51 UTC, 2 replies.
- [PR] [SPARK-45523][Python] Refactor the null-checking to have shortcuts [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2023/10/24 00:24:49 UTC, 4 replies.
- [PR] [SPARK-45640][SQL][TESTS] Fix flaky ProtobufCatalystDataConversionSuite [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/24 02:17:54 UTC, 18 replies.
- [PR] [SPARK-45527][core] Use fraction to do the resource calculation [spark] - posted by "wbo4958 (via GitHub)" <gi...@apache.org> on 2023/10/24 02:22:30 UTC, 14 replies.
- [PR] [SPARK-45641][UI] Display the application start time of an app follow… [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/10/24 02:45:38 UTC, 0 replies.
- [PR] [INFRA]Uses the default `ORACLE_DOCKER_IMAGE_NAME` in the scheduled builds in other branches [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/24 02:59:32 UTC, 0 replies.
- [PR] [SPARK-45336][TEST][3.5] Use Oracle Database 23 Free for integration and testing [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/24 03:02:43 UTC, 2 replies.
- [PR] [SPARK-45336][TEST][3.4] Use Oracle Database 23 Free for integration and testing [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/24 03:06:28 UTC, 5 replies.
- Re: [PR] [INFRA]Uses different `ORACLE_DOCKER_IMAGE_NAME` in the scheduled builds in other branches [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/24 03:39:28 UTC, 1 replies.
- [PR] [SPARK-45643][CORE][SQL] Replace `s.c.mutable.MapOps#transform` with `s.c.mutable.MapOps#mapValuesInPlace` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/24 03:58:52 UTC, 4 replies.
- [PR] [WIP][INFRA] Add `sql/api` and `common/utils` to `modules.py` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/24 04:10:26 UTC, 0 replies.
- [PR] [SPARK-45533][CORE]Use j.l.r.Cleaner instead of finalize for RocksDBIterator [spark] - posted by "zhaomin1423 (via GitHub)" <gi...@apache.org> on 2023/10/24 04:20:43 UTC, 33 replies.
- Re: [PR] [SPARK-45638][SQL][Avro] Improve test coverage of decimal conversion [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/10/24 04:47:26 UTC, 1 replies.
- [PR] [SPARK-44790][SQL] XML: to_xml implementation and bindings for python, connect and SQL [spark] - posted by "sandip-db (via GitHub)" <gi...@apache.org> on 2023/10/24 04:52:50 UTC, 6 replies.
- [PR] [SPARK-44032][BUILD] Remove `threeten-extra` exclusion in `enforceBytecodeVersion` rule [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/24 05:47:21 UTC, 4 replies.
- Re: [PR] [SPARK-45641][UI] Display the application start time on AllJobsPage [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/10/24 05:50:51 UTC, 3 replies.
- Re: [PR] [SPARK-45561][SQL] Add proper conversions for TINYINT in MySQLDialect [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/10/24 06:38:51 UTC, 2 replies.
- [PR] [SPARK-45642][CORE][SQL] Fix `FileSystem.isFile & FileSystem.isDirectory is deprecated` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/24 06:41:10 UTC, 17 replies.
- Re: [PR] [SPARK-38723][SQL][STREAMING][TESTS] Add test for streaming query resume race condition. [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/10/24 06:42:56 UTC, 0 replies.
- Re: [PR] [SPARK-45626][SQL] Convert _LEGACY_ERROR_TEMP_1055 to REQUIRES_SINGLE_PART_NAMESPACE [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/24 07:27:22 UTC, 2 replies.
- [PR] [SPARK-45646][SQL] Remove hardcoding time variables prior to Hive 2.0 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2023/10/24 07:56:08 UTC, 5 replies.
- Re: [PR] [SPARK-26052] Add type comments to exposed Prometheus metrics [spark] - posted by "VincentRoest (via GitHub)" <gi...@apache.org> on 2023/10/24 09:32:36 UTC, 0 replies.
- [PR] [SPARK-45649][SQL] Unify the prepare framework for `OffsetWindowFunctionFrame` [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/24 11:39:34 UTC, 14 replies.
- [PR] [SPARK-45452][SQL][FOLLOWUP] Do not fail too early if FileSystem does not implement getSchema [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/10/24 13:34:52 UTC, 2 replies.
- [PR] [Don't merge or review] Test k8s changes [spark] - posted by "junyuc25 (via GitHub)" <gi...@apache.org> on 2023/10/24 14:11:51 UTC, 4 replies.
- [PR] [Don't merge or review][WIP] Test k8s changes [spark] - posted by "junyuc25 (via GitHub)" <gi...@apache.org> on 2023/10/24 14:25:27 UTC, 0 replies.
- [PR] [SPARK-44405][SQL]Reduce code duplication in group-based DELETE and MERGE tests [spark] - posted by "zhaomin1423 (via GitHub)" <gi...@apache.org> on 2023/10/24 16:04:41 UTC, 0 replies.
- [PR] [SPARK-45651][Build] Publish snapshot manually [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2023/10/24 16:14:59 UTC, 3 replies.
- [PR] [SPARK-45651][Build] Log memory usage of publish snapshot workflow [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2023/10/24 16:36:40 UTC, 16 replies.
- [PR] Ranger spark integration [spark] - posted by "laguilarlyft (via GitHub)" <gi...@apache.org> on 2023/10/24 18:49:12 UTC, 1 replies.
- Re: [PR] [SPARK-45503][SS] Add Conf to Set RocksDB Compression [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2023/10/24 18:59:36 UTC, 2 replies.
- Re: [PR] [SPARK-45653] Refractor XmlSuite to allow other test suites to easily extend and override [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2023/10/24 19:08:34 UTC, 0 replies.
- [PR] Ranger spark integration v3.4 lyft [spark] - posted by "laguilarlyft (via GitHub)" <gi...@apache.org> on 2023/10/24 20:18:08 UTC, 1 replies.
- [PR] [SPARK-45654][PYTHON] Add Python data source write API [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/10/24 20:59:33 UTC, 3 replies.
- [PR] [SPARK-45655] Mark CurrentBatchTimestamp as deterministic. [spark] - posted by "sahnib (via GitHub)" <gi...@apache.org> on 2023/10/24 22:05:51 UTC, 0 replies.
- Re: [PR] [SPARK-45651][BUILD] Publish snapshot manually [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/24 23:58:21 UTC, 1 replies.
- Re: [PR] [SPARK-45655][SS] Mark CurrentBatchTimestamp as deterministic [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2023/10/25 00:02:08 UTC, 2 replies.
- [PR] [WIP] [spark] - posted by "zeruibao (via GitHub)" <gi...@apache.org> on 2023/10/25 00:02:22 UTC, 1 replies.
- Re: [PR] [SPARK-45648][INFRA] Add `sql/api` and `common/utils` to `modules.py` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/25 00:14:24 UTC, 1 replies.
- [PR] [SPARK-45656][SQL] Fix observation when named observations with the same name on different datasets [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2023/10/25 00:29:06 UTC, 2 replies.
- [PR] [SPARK-45588][SPARK-45640][SQL][TESTS][3.4] Fix flaky ProtobufCatalystDataConversionSuite [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/25 02:24:59 UTC, 2 replies.
- [PR] [SPARK-45588][SPARK-45640][SQL][TESTS][3.5] Fix flaky ProtobufCatalystDataConversionSuite [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/25 02:30:12 UTC, 2 replies.
- [PR] [SPARK-45659][CORE][SQL][SS] Add `since` field to Java API marked as `@Deprecated`. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/25 06:08:29 UTC, 0 replies.
- Re: [PR] [SPARK-45659][SQL][SS] Add `since` field to Java API marked as `@Deprecated`. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/25 06:16:07 UTC, 5 replies.
- Re: [PR] [SPARK-45533][CORE] Use j.l.r.Cleaner instead of finalize for RocksDBIterator [spark] - posted by "zhaomin1423 (via GitHub)" <gi...@apache.org> on 2023/10/25 06:52:55 UTC, 8 replies.
- [PR] [SPARK-45661][SQL][PYTHON] Add toNullable in StructType, MapType and ArrayType [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/25 06:56:55 UTC, 2 replies.
- [PR] [SPARK-45660] Re-use Literal objects in ComputeCurrentTime rule [spark] - posted by "olaky (via GitHub)" <gi...@apache.org> on 2023/10/25 07:17:15 UTC, 6 replies.
- [PR] ExternalSorter#mergeSort complexity should be linear if data is already sorted [spark] - posted by "faucct (via GitHub)" <gi...@apache.org> on 2023/10/25 08:28:59 UTC, 0 replies.
- [PR] [WIP][SPARK-45629]Fix `Implicit definition should have explicit type` [spark] - posted by "laglangyue (via GitHub)" <gi...@apache.org> on 2023/10/25 09:11:16 UTC, 3 replies.
- [PR] [SPARK-45663][CORE][MLLIB] Replace `IterableOnceOps#aggregate` with `IterableOnceOps#foldLeft` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/25 09:16:01 UTC, 2 replies.
- [PR] [SPARK-45664][SQL] Introduce a mapper for orc compression codecs [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/25 09:27:46 UTC, 4 replies.
- [PR] [SPARK-44407][BUILD][TESTS] Clean up the compilation warnings related to `it will become a keyword in Scala 3` and prohibit the use of these keywords as variable names. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/25 09:30:02 UTC, 0 replies.
- Re: [PR] [SPARK-45209][CORE][UI] Flame Graph Support For Executor Thread Dump Page [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/25 10:30:29 UTC, 1 replies.
- [PR] [SPARK-43380][SQL] Fix slowdown in Avro read [spark] - posted by "zeruibao (via GitHub)" <gi...@apache.org> on 2023/10/25 16:59:42 UTC, 22 replies.
- Re: [PR] [SPARK-29615][SQL]Add a new insertInto method with byName parameter in DataFrameWriter. [spark] - posted by "combinatorist (via GitHub)" <gi...@apache.org> on 2023/10/25 18:34:45 UTC, 1 replies.
- [PR] SPARK-45652: SPJ: Handle empty input partitions after dynamic filtering [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2023/10/25 21:51:51 UTC, 0 replies.
- [PR] Bump google.golang.org/grpc from 1.54.0 to 1.56.3 [spark-connect-go] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2023/10/25 22:37:33 UTC, 0 replies.
- Re: [PR] Update BindingParquetOutputCommitter.scala [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/26 00:17:18 UTC, 1 replies.
- Re: [PR] [SPARK-44440][SS] Use thread pool to perform maintenance activity for hdfs/rocksdb state store providers [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/26 00:17:19 UTC, 1 replies.
- Re: [PR] [SPARK-19335][SPARK-38200][SQL] Add upserts for writing to JDBC [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/26 02:16:29 UTC, 6 replies.
- Re: [PR] [SPARK-45665][INFRA]Uses different `ORACLE_DOCKER_IMAGE_NAME` in the scheduled builds in other branches [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/26 02:24:23 UTC, 1 replies.
- Re: [PR] [SPARK-45665][INFRA] Uses different `ORACLE_DOCKER_IMAGE_NAME` in the scheduled builds in other branches [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/26 03:22:53 UTC, 5 replies.
- Re: [PR] [SPARK-45533][CORE] Use j.l.r.Cleaner instead of finalize for RocksDBIterator/LevelDBIterator [spark] - posted by "zhaomin1423 (via GitHub)" <gi...@apache.org> on 2023/10/26 03:30:29 UTC, 45 replies.
- [PR] [SPARK-45667][CORE][SQL][CONNECT] Clean up the deprecated API usage related to `IterableOnceExtensionMethods`. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/26 03:36:06 UTC, 3 replies.
- [PR] SPARK-45668 Improve the assert message in RollingEventLogFilesFileReader [spark] - posted by "shuyouZZ (via GitHub)" <gi...@apache.org> on 2023/10/26 03:36:28 UTC, 0 replies.
- [PR] [SPARK-45669][CORE] Ensure the continuity of rolling log index [spark] - posted by "shuyouZZ (via GitHub)" <gi...@apache.org> on 2023/10/26 03:42:14 UTC, 2 replies.
- Re: [PR] [SPARK-44405][SQL][TESTS] Reduce code duplication in group-based DELETE and MERGE tests [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/26 03:51:48 UTC, 1 replies.
- [PR] [SPARK-43923][CONNECT][FOLLOWUP] Correct the message abbreviation [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/26 04:03:01 UTC, 6 replies.
- [PR] [SPARK-45670][CORE] SparkSubmit does not support `--total-executor-cores` when deploying on K8s [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2023/10/26 04:16:32 UTC, 8 replies.
- Re: [PR] [SPARK-45511][SS] State Data Source - Reader [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2023/10/26 05:05:08 UTC, 18 replies.
- Re: [PR] [SPARK-44407][BUILD][TESTS] Clean up the compilation warnings related to `it will become a keyword in Scala 3` and prohibit use these keywords as variable name [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/26 05:18:34 UTC, 1 replies.
- Re: [PR] [SPARK-38723][SS][TESTS] Add test for streaming query resume race condition [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2023/10/26 05:23:32 UTC, 2 replies.
- [PR] [SPARK-45674][CONNECT][PYTHON] Improve error message for `SparkContext` on Spark Connect. [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/10/26 06:13:08 UTC, 3 replies.
- Re: [PR] [SPARK-40559][PYTHON] Add applyInArrow to groupBy and cogroup [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/26 07:12:12 UTC, 13 replies.
- [PR] [SPARK-45651][Build][Follow-up] Reduce mvn -Xmx option to 2g in publish_snapshot workflow [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2023/10/26 09:54:31 UTC, 0 replies.
- Re: [PR] [SPARK-45651][BUILD][FOLLOWUP] Reduce mvn -Xmx option to 2g in publish_snapshot workflow [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2023/10/26 10:03:26 UTC, 37 replies.
- Re: [PR] [SPARK-45652][SQL] SPJ: Handle empty input partitions after dynamic filtering [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2023/10/26 15:53:00 UTC, 1 replies.
- [PR] [SPARK-45652][SQL][3.4] SPJ: Handle empty input partitions after dynamic filtering [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2023/10/26 16:04:23 UTC, 4 replies.
- [PR] [SPARK-45652][SQL][3.5] SPJ: Handle empty input partitions after dynamic filtering [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2023/10/26 16:16:16 UTC, 2 replies.
- [PR] [SPARK-45544][CORE] Integrate SSL support into TransportContext [spark] - posted by "hasnain-db (via GitHub)" <gi...@apache.org> on 2023/10/26 16:34:37 UTC, 21 replies.
- Re: [PR] [SPARK-45674][CONNECT][PYTHON] Improve error message for JVM-dependent attributes on Spark Connect. [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/10/26 16:55:18 UTC, 5 replies.
- [PR] [SPARK-45677] Better error logging for Observation API [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2023/10/26 17:51:34 UTC, 3 replies.
- [PR] SPARK-45678]Cover BufferReleasingInputStream.available under tryOrFetchFailedException [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2023/10/26 21:00:32 UTC, 0 replies.
- [PR] [SPARK-45679][Connect] Add proto for clusterBy [spark] - posted by "zhenlineo (via GitHub)" <gi...@apache.org> on 2023/10/26 21:30:56 UTC, 3 replies.
- [PR] [WIP][SPARK-45680][CONNECT] Release session [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2023/10/26 23:05:35 UTC, 0 replies.
- Re: [PR] [SPARK-44362][SQL] Use PartitionEvaluator API in AggregateInPandasExec and AttachDistributedSequenceExec [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/27 00:17:22 UTC, 1 replies.
- Re: [PR] [SPARK-44447][SQL] Use PartitionEvaluator API in FlatMapGroupsInPandasExec, FlatMapCoGroupsInPandasExec [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/27 00:17:24 UTC, 1 replies.
- Re: [PR] [SPARK-44414][SQL] Fixed matching check for CharType/VarcharType [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/27 00:17:28 UTC, 1 replies.
- Re: [PR] [SPARK-32268][SQL][FOLLOWUP] Filter creation side size threshold judgment should prun column in injectBloomFilter [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/27 00:17:29 UTC, 1 replies.
- Re: [PR] [SPARK-44386][SQL] Use PartitionEvaluator API in HashAggregateExec, ObjectHashAggregateExec, SortAggregateExec [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/27 00:17:31 UTC, 1 replies.
- Re: [PR] [SPARK-44385][SQL] Use PartitionEvaluator API in MergingSessionsExec & UpdatingSessionsExec [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/27 00:17:33 UTC, 2 replies.
- Re: [PR] [SPARK-45555][PYTHON] Includes a debuggable object for failed assertion [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/10/27 00:52:06 UTC, 5 replies.
- Re: [PR] [SPARK-45679][CONNECT] Add proto for clusterBy [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/27 01:47:06 UTC, 1 replies.
- Re: [PR] [SPARK-45678][CORE] Cover BufferReleasingInputStream.available under tryOrFetchFailedException [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2023/10/27 01:54:21 UTC, 1 replies.
- [PR] [SPARK-45681][UI] Clone a js version of UIUtils.errorMessageCell for consistent error rendering on UI [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/10/27 02:13:03 UTC, 4 replies.
- [PR] [SPARK-45670][CORE][3.3] SparkSubmit does not support `--total-executor-cores` when deploying on K8s [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2023/10/27 02:29:58 UTC, 2 replies.
- [PR] [SPARK-45670][CORE][3.4] SparkSubmit does not support --total-executor-cores when deploying on K8s [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2023/10/27 02:30:38 UTC, 0 replies.
- [PR] [SPARK-45670][CORE][3.5] SparkSubmit does not support --total-executor-cores when deploying on K8s [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2023/10/27 02:30:39 UTC, 0 replies.
- [PR] [SPARK-45698] Clean up the deprecated API usage related to `Buffer` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/27 05:49:42 UTC, 0 replies.
- Re: [PR] [SPARK-45678][CORE] Cover BufferReleasingInputStream.available/reset under tryOrFetchFailedException [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2023/10/27 05:58:58 UTC, 5 replies.
- Re: [PR] [SPARK-45670][CORE][3.4] SparkSubmit does not support `--total-executor-cores` when deploying on K8s [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/27 06:25:41 UTC, 1 replies.
- Re: [PR] [SPARK-45670][CORE][3.5] SparkSubmit does not support `--total-executor-cores` when deploying on K8s [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/27 06:26:18 UTC, 1 replies.
- [PR] [SPARK-45328][DOCS][FOLLOWUP] Update docs for Hive metastore supported versions [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2023/10/27 08:22:50 UTC, 3 replies.
- [PR] [SPARK-45706][PYTHON][DOCS] Makes entire Binder build fails fast during setting up [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/27 08:50:22 UTC, 3 replies.
- [PR] [SPARK-45705][TESTS] Fix flaky test: Status of a failed DDL/DML with no jobs should be FAILED [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/10/27 08:50:33 UTC, 4 replies.
- [PR] [SPARK][CORE] Fix method tryCompleteWith in trait Promise is deprecated [spark] - posted by "zhaomin1423 (via GitHub)" <gi...@apache.org> on 2023/10/27 09:46:26 UTC, 2 replies.
- Re: [PR] [SPARK-45698][CORE][SQL][SS] Clean up the deprecated API usage related to `Buffer` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/10/27 09:58:56 UTC, 2 replies.
- Re: [PR] [SPARK-45696][CORE] Fix method tryCompleteWith in trait Promise is deprecated [spark] - posted by "zhaomin1423 (via GitHub)" <gi...@apache.org> on 2023/10/27 10:00:47 UTC, 4 replies.
- [PR] [SPARK-43380][SQL][FOLLOWUP] Deprecate toSqlType(avroSchema: Schema, …useStableIdForUnionType: Boolean): SchemaType [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/27 10:08:05 UTC, 3 replies.
- [PR] 3.2.0 kylin 4.6.16.0.1 hotfix 1027 [spark] - posted by "Mrhs121 (via GitHub)" <gi...@apache.org> on 2023/10/27 10:22:51 UTC, 1 replies.
- [PR] [BUILD] Retry mvn deploy [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2023/10/27 11:18:17 UTC, 0 replies.
- [PR] [SPARK-45707][SQL] Simplify `DataFrameStatFunctions. countMinSketch` with `CountMinSketchAgg` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/27 11:33:15 UTC, 0 replies.
- Re: [PR] [SPARK-45708][BUILD] Retry mvn deploy [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2023/10/27 11:53:08 UTC, 0 replies.
- Re: [PR] [SPARK-45707][SQL] Simplify `DataFrameStatFunctions.countMinSketch` with `CountMinSketchAgg` [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/27 11:59:10 UTC, 6 replies.
- [PR] [SPARK-45709][BUILD] Deploy packages when all packages are built [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2023/10/27 12:05:00 UTC, 1 replies.
- [PR] [SPARK-45711][SQL] Introduce a mapper for avro compression codecs [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/27 12:48:25 UTC, 6 replies.
- [PR] [SPARK-45685][CORE][SQL] Use `LazyList` instead of `Stream` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/27 14:56:47 UTC, 4 replies.
- [PR] [SPARK-45684][SQL][MLLIB] Clean up the deprecated API usage related to `SeqOps` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/27 15:54:38 UTC, 1 replies.
- [PR] [SPARK-38723][SS][TEST][FOLLOWUP] Deflake the newly added test in QueryExecutionErrorsSuite [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2023/10/27 18:50:55 UTC, 7 replies.
- [PR] [SPARK-45713][PYTHON] Support registering Python data sources [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/10/28 00:05:56 UTC, 15 replies.
- Re: [PR] [WIP][DO NOT REVIEW] Testing stuff [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/28 00:16:43 UTC, 1 replies.
- [PR] [SPARK-45710][SQL] Assign names to error _LEGACY_ERROR_TEMP_21[59,60,61,62] [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2023/10/28 03:40:21 UTC, 1 replies.
- [PR] [SPARK-45692][CORE][SQL][CONNECT][MLLIB] Clean up the deprecated API usage related to `Iterator/Iterable/IterableOps` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/28 09:28:26 UTC, 2 replies.
- [PR] [SPARK-45690][CORE][SQL] Clean up deprecated type use of `BufferedIterator/CanBuildFrom/Traversable` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/28 09:49:20 UTC, 2 replies.
- [PR] QueryPlanningTracker::measurePhase typo refactor [spark] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2023/10/28 09:51:33 UTC, 0 replies.
- Re: [PR] [SPARK-45715][CORE] QueryPlanningTracker::measurePhase typo refactor [spark] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2023/10/28 09:54:50 UTC, 0 replies.
- Re: [PR] [SPARK-45715][CORE] QueryPlanningTracker::measurePhase minor refactor [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/28 10:14:25 UTC, 5 replies.
- [PR] [SPARK-45481][SQL][FOLLOWUP] Add `lowerCaseName` for `ParquetCompressionCodec`. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/28 11:44:28 UTC, 3 replies.
- [PR] [SPARK-45716][PySpark][Connect] Add StructType.treeString to Python [spark] - posted by "khalidmammadov (via GitHub)" <gi...@apache.org> on 2023/10/28 18:28:41 UTC, 2 replies.
- Re: [PR] [DO NOT MERGE] Maintenance Thread Pool change with working StateStoreSuite [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/29 00:18:57 UTC, 1 replies.
- Re: [PR] [SPARK-44305][SQL] Dynamically choose whether to broadcast hadoop conf [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/29 00:18:59 UTC, 1 replies.
- Re: [PR] [SPARK-45605][CORE][SQL][SS][CONNECT][MLLIB][GRAPHX][DSTREAM][PROTOBUF][EXAMPLES] Replace `s.c.MapOps.mapValues` with `s.c.MapOps.view.mapValues` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/29 11:03:36 UTC, 2 replies.
- [PR] [SPARK-45682][CORE][SQL][MLLIB] Fix "method + in class Byte/Short/Char/Long/Double/Int is deprecated" [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/29 12:32:52 UTC, 0 replies.
- [PR] [SPARK-45691][CORE][SQL][TESTS] Clean up the deprecated API usage related to `RightProjection/LeftProjection/Either` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/29 12:44:02 UTC, 1 replies.
- [PR] [SPARK-45701][CORE][SQL][K8S] Clean up the deprecated API usage related to `SetOps` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/29 13:10:49 UTC, 0 replies.
- Re: [PR] [SPARK-45701][CORE][SQL][K8S] Clean up the deprecated API usage related to `mutable.SetOps` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/29 13:24:28 UTC, 6 replies.
- [PR] [SPARK-45689][SQL] Clean up the deprecated API usage related to `StringContext/StringOps` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/29 13:30:03 UTC, 2 replies.
- Re: [PR] [SPARK-39931][PYTHON][WIP] Improve applyInPandas performance for very small groups [spark] - posted by "sergun (via GitHub)" <gi...@apache.org> on 2023/10/29 15:32:02 UTC, 0 replies.
- Re: [PR] [SPARK-44639][SS][YARN] Use Java tmp dir for local RocksDB state storage on Yarn [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2023/10/29 21:35:44 UTC, 0 replies.
- Re: [PR] [SPARK-44473] Overwriting the same partition of a partitioned table multiple times with empty data yields non-idempotent results [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/30 00:18:12 UTC, 1 replies.
- Re: [PR] [SPARK-44301][SQL] Add Benchmark Suite for TPCH [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/30 00:18:15 UTC, 1 replies.
- Re: [PR] [SPARK-45352][SQL] Eliminate foldable window partitions [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2023/10/30 01:59:56 UTC, 4 replies.
- [PR] Update plugin for SBOM generation to 2.7.10 [spark] - posted by "VinodAnandan (via GitHub)" <gi...@apache.org> on 2023/10/30 02:20:46 UTC, 0 replies.
- Re: [PR] [SPARK-45689][SPARK-45690][SPARK-45691][CORE][SQL] Clean up the deprecated API usage related to `StringContext/StringOps/RightProjection/LeftProjection/Either` and type use of `BufferedIterator/CanBuildFrom/Traversable` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/30 02:55:06 UTC, 2 replies.
- Re: [PR] [SPARK-45684][SQL][SS][ML] Clean up the deprecated API usage related to `SeqOps` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/30 02:59:45 UTC, 0 replies.
- Re: [PR] [SPARK-45701][SPARK-45684][SPARK-45692][CORE][SQL][SS][ML][K8S] Clean up the deprecated API usage related to `mutable.SetOps/c.SeqOps/Iterator/Iterable/IterableOps` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/30 04:34:20 UTC, 5 replies.
- Re: [PR] [WIP][SPARK-44098][INFRA] Introduce python breaking change detection [spark] - posted by "StardustDL (via GitHub)" <gi...@apache.org> on 2023/10/30 05:01:07 UTC, 5 replies.
- Re: [PR] [SPARK-45682][CORE][SQL][ML][MLLIB][GRAPHX][YARN][DSTREAM][UI][EXAMPLES] Fix "method + in class Byte/Short/Char/Long/Double/Int is deprecated" [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/30 05:38:00 UTC, 2 replies.
- [PR] [SPARK-45688][SPARK-45693][CORE] Clean up the deprecated API usage related to `MapOps` & Fix `method += in trait Growable is deprecated` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/30 06:22:36 UTC, 0 replies.
- [PR] [SPARK-45717][YARN] Avoid use `spark.yarn.user.classpath.first` [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2023/10/30 06:38:01 UTC, 0 replies.
- Re: [PR] [SPARK-45655][SS] Mark `CurrentBatchTimestamp` as deterministic [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2023/10/30 07:18:20 UTC, 1 replies.
- [PR] [SPARK-45683][CORE] Fix `method any2stringadd in object Predef is deprecated` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/30 07:56:04 UTC, 2 replies.
- [PR] [SPARK-45718][PS] Remove remaining deprecated Pandas features from Spark 3.4.0 [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/10/30 09:04:52 UTC, 2 replies.
- [PR] [SPARK-45700][SPARK-45702][SPARK-45703] Fix the compile warning suppression rule added in SPARK-35496 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/30 09:38:41 UTC, 2 replies.
- [PR] [SPARK-45723][PYTHON][CONNECT] Catalog methods avoid pandas conversion [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/10/30 10:33:05 UTC, 4 replies.
- [PR] [SPARK-45724][SQL] Add a separate LogAppender for tests that need to print `RuleExecutor.dumpTimeSpent()` to avoid truncation of Metrics [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/30 13:08:24 UTC, 0 replies.
- Re: [PR] [SPARK-45724][SQL][TESTS] Add a separate LogAppender for tests that need to print `RuleExecutor.dumpTimeSpent()` to avoid truncation of Metrics [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/30 13:59:43 UTC, 3 replies.
- Re: [PR] [SPARK-45245][PYTHON][CONNECT] PythonWorkerFactory: Timeout if worker does not connect back. [spark] - posted by "rangadi (via GitHub)" <gi...@apache.org> on 2023/10/30 14:04:07 UTC, 3 replies.
- Re: [PR] [SPARK-45680][CONNECT] Release session [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2023/10/30 14:13:37 UTC, 5 replies.
- [PR] [SPARK-45725][SQL] Remove the non-default IN subquery runtime filter [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/10/30 15:04:37 UTC, 8 replies.
- [PR] [SPARK-45726][CONNECT] Make Dataset.collectResult private [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2023/10/30 16:27:06 UTC, 9 replies.
- [PR] Fix PySpark testing guide links [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2023/10/30 17:20:42 UTC, 0 replies.
- [PR] [SPARK-45727] Remove unused map in watermark propagation simulation [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2023/10/30 18:55:22 UTC, 0 replies.
- Re: [PR] [SPARK-45727][SS] Remove unused map in watermark propagation simulation [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2023/10/30 18:55:58 UTC, 2 replies.
- [PR] [SPARK-45728][BUILD][K8S] Upgrade `kubernetes-client` to 6.9.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/30 19:00:44 UTC, 7 replies.
- Re: [PR] [SPARK-45729][PYTHON][DOCS] Fix PySpark testing guide links [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/10/30 21:44:40 UTC, 4 replies.
- [PR] [SPARK-45732][BUILD] Upgrade commons-text to 1.11.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/31 00:59:10 UTC, 2 replies.
- [PR] [SPARK-45733][CONNECT][PYTHON] Support multiple retry policies [spark] - posted by "cdkrot (via GitHub)" <gi...@apache.org> on 2023/10/31 01:38:26 UTC, 1 replies.
- Re: [PR] [SPARK-45327][BUILD] Upgrade zstd-jni to 1.5.5-7 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/31 02:07:39 UTC, 0 replies.
- [PR] [BUILD] Test Commons io 2.15.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/31 02:21:09 UTC, 0 replies.
- [PR] [SPARK-45704][BUILD] Fix `legacy-binding` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/31 03:24:45 UTC, 2 replies.
- [PR] [SPARK-45242][SQL][FOLLOWUP] Do not canonicalize DataFrame ID in CollectMetrics [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2023/10/31 03:38:31 UTC, 3 replies.
- [PR] [SPARK-45735][PYTHON][CONNECT][TESTS] Reenable CatalogTests without Spark Connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/31 03:47:09 UTC, 4 replies.
- [PR] [SPARK-45730][CORE] Make ReloadingX509TrustManagerSuite less flaky [spark] - posted by "hasnain-db (via GitHub)" <gi...@apache.org> on 2023/10/31 04:30:30 UTC, 1 replies.
- [PR] [SPARK-45736][EXAMPLE] Use \s+ as separator when testing kafka source and network source [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2023/10/31 07:09:36 UTC, 1 replies.
- [PR] fix SparkThrowableSuite for GA [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/31 08:10:07 UTC, 0 replies.
- Re: [PR] [SPARK-45713][PYTHON][FOLLOWUP] Fix SparkThrowableSuite for GA [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/31 08:21:01 UTC, 6 replies.
- [PR] [SPARK-45737][SQL] Remove unnecessary `.toArray[InternalRow]` in `SparkPlan#executeTake` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/31 08:53:41 UTC, 2 replies.
- [PR] [SPARK-45739][PYTHON] Catch IOException instead of EOFException alone for faulthandler [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/31 11:35:26 UTC, 6 replies.
- [PR] [SPARK-45738][CONNECT]fix status conflict in ExecuteEventsManager and… [spark] - posted by "xieshuaihu (via GitHub)" <gi...@apache.org> on 2023/10/31 11:43:32 UTC, 0 replies.
- [PR] [SPARK-45740][SQL] Relax the node prefix of SparkPlanGraphCluster [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2023/10/31 11:58:13 UTC, 0 replies.
- [PR] [SPARK-45697][BUILD] Fix `Unicode escapes in triple quoted strings are deprecated` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/10/31 11:59:43 UTC, 4 replies.
- [PR] [SPARK-45481][SPARK-45664][SPARK-45711][SQL][FOLLOWUP] Avoid magic strings copy from parquet|orc|avro compression codes [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/31 12:30:03 UTC, 2 replies.
- Re: [PR] [SPARK-41533][CONNECT] Proper Error Handling for Spark Connect Server / Client [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2023/10/31 14:29:02 UTC, 0 replies.
- Re: [PR] [SPARK-45700][SPARK-45702][SPARK-45703][BUILD][CORE][SQL][MLLIB] Fix the compile warning suppression rule added in SPARK-35496 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/31 15:54:36 UTC, 1 replies.
- [PR] [SPARK-45741][BUILD] Upgrade Netty to 4.1.100.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/31 17:18:48 UTC, 4 replies.
- Re: [PR] [SPARK-45719][K8S] Upgrade AWS SDK to v2 for Kubernetes integration tests module [spark] - posted by "steveloughran (via GitHub)" <gi...@apache.org> on 2023/10/31 17:40:06 UTC, 0 replies.
- [PR] [SPARK-43380][SQL][Follow-up] Fix slowdown in Avro read [spark] - posted by "zeruibao (via GitHub)" <gi...@apache.org> on 2023/10/31 18:45:54 UTC, 3 replies.
- [PR] [SPARK-45742][CORE][CONNECT][MLLIB] Introduce an implicit function for Scala Array to wrap into `immutable.ArraySeq`. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/31 18:51:24 UTC, 0 replies.
- Re: [PR] [SPARK-45242][SQL][FOLLOWUP] Canonicalize DataFrame ID in CollectMetrics [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2023/10/31 19:03:05 UTC, 0 replies.
- [PR] [SPARK-45743][BUILD] Upgrade dropwizard metrics 4.2.21 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/10/31 19:36:18 UTC, 1 replies.
- [PR] [SPARK-45744][CORE] Switch `spark.history.store.serializer` to use `PROTOBUF` by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/10/31 19:52:21 UTC, 3 replies.
- [PR] Fix the variable name in the docs - testing_pyspark.ipynb [spark] - posted by "huciaa (via GitHub)" <gi...@apache.org> on 2023/10/31 20:45:25 UTC, 0 replies.
- Re: [PR] [MINOR][DOCS]Fix the variable name in the docs - testing_pyspark.ipynb [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/10/31 22:34:10 UTC, 3 replies.
- [PR] [SPARK-45746][Python] Return specific error messages if UDTF 'analyze' method accepts or returns wrong values [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2023/10/31 23:10:10 UTC, 1 replies.