reviews@spark.apache.org, 2024-05

You are viewing a plain text version of this content. The canonical link for it is here.

- Re: [PR] [SPARK-46894][PYTHON] Move PySpark error conditions into standalone JSON file [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/01 00:54:58 UTC, 6 replies.
- Re: [PR] [SPARK-48062][PYTHON][TESTS] Add pyspark test for SimpleDataSourceStreamingReader [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/01 00:58:03 UTC, 3 replies.
- Re: [PR] [SPARK-48028][TESTS] Regenerate benchmark results after turning ANSI on [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/01 01:00:28 UTC, 3 replies.
- Re: [PR] [WIP][SPARK-48058][PYTHON][CONNECT] `UserDefinedFunction.returnType` parse the DDL string [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/01 01:02:16 UTC, 0 replies.
- [PR] [SPARK-48067][SQL] Fix variant default columns [spark] - posted by "richardc-db (via GitHub)" <gi...@apache.org> on 2024/05/01 02:02:01 UTC, 21 replies.
- Re: [PR] [SPARK-48054][PYTHON][CONNECT][INFRA] Backward compatibility test for Spark Connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/01 03:02:35 UTC, 9 replies.
- Re: [PR] [SPARK-48035][SQL] Fix try_add/try_multiply being semantic equal to add/multiply [spark] - posted by "db-scnakandala (via GitHub)" <gi...@apache.org> on 2024/05/01 03:45:44 UTC, 5 replies.
- [PR] [SPARK-48016][SQL][TESTS][FOLLOWUP] Update Java 21 golden file [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/01 03:50:50 UTC, 4 replies.
- Re: [PR] [SPARK-48062][PYTHON][SS][TESTS] Add pyspark test for SimpleDataSourceStreamingReader [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2024/05/01 04:30:31 UTC, 7 replies.
- Re: [PR] [SPARK-45891][SQL][FOLLOW-UP] Added length check to the is_variant_null expression [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/01 04:58:53 UTC, 6 replies.
- Re: [PR] [WIP][SPARK-48031] view evolution [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2024/05/01 05:03:14 UTC, 0 replies.
- Re: [PR] [SPARK-48047][SQL] Reduce memory pressure of empty TreeNode tags [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/01 05:07:25 UTC, 3 replies.
- Re: [PR] [SPARK-47764][FOLLOW-UP][WIP] Change to use ShuffleDriverComponents.removeShuffle to remove shuffle properly [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/01 05:08:53 UTC, 2 replies.
- Re: [PR] [SPARK-46009][SQL][FOLLOWUP] Remove unused PERCENTILE_CONT and PERCENTILE_DISC in g4 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/01 05:09:58 UTC, 4 replies.
- [PR] [SPARK-48068][PYTHON] Fix `mypy` failure in Python 3.10 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/01 06:00:20 UTC, 1 replies.
- [PR] [SPARK-48069][INFRA] Handle PEP-632 by checking `ModuleNotFoundError` on `setuptools` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/01 06:13:53 UTC, 0 replies.
- Re: [PR] [SPARK-48037][CORE] Fix SortShuffleWriter lacks shuffle write related metrics resulting in potentially inaccurate data [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/05/01 06:33:57 UTC, 20 replies.
- Re: [PR] [SPARK-48068][PYTHON] Fix `mypy` failure in Python 3.10 and 3.11 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/01 06:34:19 UTC, 5 replies.
- Re: [PR] [SPARK-48069][INFRA] Handle `PEP-632` by checking `ModuleNotFoundError` on `setuptools` in Python 3.12 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/01 06:52:16 UTC, 1 replies.
- [PR] [SPARK-48070][TESTS] Support AdaptiveQueryExecSuite to skip check results [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/05/01 06:56:53 UTC, 0 replies.
- [PR] [SPARK-48071][INFRA] Use Python 3.10 in `Python Linter` step [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/01 07:24:01 UTC, 1 replies.
- Re: [PR] [SPARK-44264][PYTHON][ML] FunctionPickler Class [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/01 07:46:16 UTC, 2 replies.
- Re: [PR] [SPARK-43406][SQL] enable spark sql to drop multiple partitions in on… [spark] - posted by "zviklausner (via GitHub)" <gi...@apache.org> on 2024/05/01 08:36:44 UTC, 1 replies.
- [PR] [SPARK-48072][SQL] Improve SQLQuerySuite test output [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/05/01 09:26:32 UTC, 0 replies.
- Re: [PR] [SPARK-47545][CONNECT] Dataset `observe` support for the Scala client [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/05/01 09:51:59 UTC, 3 replies.
- [PR] [MINOR][SQL][DOCS] Correct comments for UnresolvedRelation [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2024/05/01 11:07:51 UTC, 4 replies.
- Re: [PR] [SPARK-48049][BUILD] Upgrade Scala to 2.13.14 [spark] - posted by "SethTisue (via GitHub)" <gi...@apache.org> on 2024/05/01 14:24:39 UTC, 36 replies.
- Re: [PR] [SPARK-48040][CONNECT][WIP]Spark connect supports scheduler pool [spark] - posted by "xieshuaihu (via GitHub)" <gi...@apache.org> on 2024/05/01 14:41:49 UTC, 1 replies.
- [PR] [SPARK-47263][SQL] Rename the error class _LEGACY_ERROR_TEMP_13[44-46… [spark] - posted by "PaysonXu (via GitHub)" <gi...@apache.org> on 2024/05/01 15:17:14 UTC, 1 replies.
- [PR] [MINOR] Fix the grammar of some comments on renaming error classes [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2024/05/01 15:50:57 UTC, 2 replies.
- Re: [PR] [SPARK-48031] view evolution [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2024/05/01 16:04:07 UTC, 18 replies.
- Re: [PR] [SPARK-48068][PYTHON] `mypy` should have `--python-executable` parameter [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/01 17:12:12 UTC, 6 replies.
- Re: [PR] [SPARK-47578][CORE] Spark Core: Migrate logWarning with variables to structured logging framework [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/05/01 17:32:08 UTC, 5 replies.
- [PR] [SPARK-48074][Core] Improve the readability of JSON loggings [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/05/01 17:45:01 UTC, 7 replies.
- Re: [PR] [SPARK-48016][SQL] Fix a bug in try_divide function when with decimals [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/01 18:15:55 UTC, 2 replies.
- Re: [PR] [SPARK-48072][SQL][TESTS] Improve SQLQuerySuite test output [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/01 18:37:25 UTC, 1 replies.
- [PR] [SPARK-48016][SQL][3.5] Fix a bug in try_divide function when with decimals [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/05/01 18:40:32 UTC, 5 replies.
- Re: [PR] [SPARK-48070][SQL][TESTS] Support `AdaptiveQueryExecSuite.runAdaptiveAndVerifyResult` to skip check results [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/01 19:37:29 UTC, 1 replies.
- [PR] [SPARK-48075] [SS] Add type checking for PySpark avro functions [spark] - posted by "fanyue-xia (via GitHub)" <gi...@apache.org> on 2024/05/01 20:15:31 UTC, 3 replies.
- [PR] [SPARK-48065][SQL] SPJ: allowJoinKeysSubsetOfPartitionKeys is too strict [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2024/05/01 20:51:50 UTC, 5 replies.
- Re: [PR] [SPARK-48071][INFRA][PYTHON] Use Python 3.10 in `Python Linter` step [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/01 21:02:03 UTC, 0 replies.
- Re: [PR] [SPARK-47920][DOCS][SS][PYTHON] Add doc for python streaming data source API [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/05/01 21:59:36 UTC, 15 replies.
- Re: [PR] [SPARK-48048][CONNECT] Added client side listener support for Scala [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/05/01 22:10:47 UTC, 1 replies.
- Re: [PR] [SPARK-47934] [CORE] Ensure trailing slashes in `HistoryServer` URL redirections [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/01 22:16:06 UTC, 1 replies.
- Re: [PR] [SPARK-47911][SQL] Introduces a universal BinaryFormatter to make binary output consistent [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/01 22:33:17 UTC, 2 replies.
- Re: [PR] [SPARK-48017] Add Spark application submission worker for operator [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/01 22:54:15 UTC, 44 replies.
- Re: [PR] [SPARK-47954][K8S] Support creating ingress entry for external UI access [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/01 23:26:01 UTC, 1 replies.
- [PR] [SPARK-48076][K8S] Promote `KubernetesVolumeUtils` to `DeveloperApi` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/01 23:49:48 UTC, 6 replies.
- Re: [PR] [SPARK-48064][SQL] Update error messages for routine related error classes [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/05/02 00:28:25 UTC, 2 replies.
- [PR] [SPARK-48077][K8S] Promote `KubernetesClientUtils` to `DeveloperApi` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/02 00:38:56 UTC, 6 replies.
- [PR] [SPARK-46894][PYTHON][FOLLOW-UP] Includes `error-conditions.json` into PyPI package [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/02 00:43:07 UTC, 9 replies.
- Re: [PR] [SPARK-48057][PYTHON][CONNECT][TESTS] Enable `GroupedApplyInPandasTests.test_grouped_with_empty_partition` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/02 01:22:12 UTC, 0 replies.
- [PR] [SPARK-48078][K8S] Promote `o.a.s.d.k8s.Constants` to `DeveloperApi` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/02 01:23:47 UTC, 4 replies.
- [PR] [SPARK-48079][BUILD] Upgrade maven-install/deploy-plugin to 3.1.2 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/02 02:00:33 UTC, 1 replies.
- [PR] [SPARK-47683][PYTHON][BUILD][FOLLOW-UP] Exclude `lib/py4j*zip` in `pyspark-connect` package [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/02 02:04:32 UTC, 1 replies.
- Re: [PR] [SPARK-48058][SPARK-43727][PYTHON][CONNECT] `UserDefinedFunction.returnType` parse the DDL string [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/02 02:06:42 UTC, 3 replies.
- Re: [PR] [SPARK-48059][CORE] Implement the structured log framework on the java side [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/02 02:31:25 UTC, 10 replies.
- [PR] [SPARK-48080][K8S] Promote `*MainAppResource` and `NonJVMResource` to `DeveloperApi` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/02 03:00:10 UTC, 3 replies.
- Re: [PR] [SPARK-48056][CONNECT][PYTHON] Re-execute plan if a SESSION_NOT_FOUND error is raised and no partial response was received [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/05/02 06:48:52 UTC, 7 replies.
- Re: [PR] [SPARK-47241][SQL] Fix rule order issues for ExtractGenerator [spark] - posted by "rajatrj20 (via GitHub)" <gi...@apache.org> on 2024/05/02 07:05:17 UTC, 1 replies.
- [PR] [SPARK-48081] Fix ClassCastException in NTile.checkInputDataTypes() when data type is mismatched [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2024/05/02 08:04:02 UTC, 0 replies.
- Re: [PR] [SPARK-43861][CORE] Do not delete inprogress log [spark] - posted by "bluzy (via GitHub)" <gi...@apache.org> on 2024/05/02 08:06:36 UTC, 1 replies.
- Re: [PR] [SPARK-45988][SPARK-45989][PYTHON] Fix typehints to handle `list` GenericAlias in Python 3.11+ [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/02 08:44:58 UTC, 2 replies.
- [PR] [SPARK-48088][PYTHON][CONNECT][TESTS][3.5] Skip tests that fail in 3.5 client <> 4.0 server [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/02 10:41:57 UTC, 5 replies.
- Re: [PR] [SPARK-48072][SQL][TESTS] Improve SQLQuerySuite test output - use `===` instead of `sameElements` for Arrays [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/02 14:18:16 UTC, 0 replies.
- Re: [PR] [SPARK-48081] Fix ClassCastException in NTile.checkInputDataTypes() when argument is non-foldable or of wrong type [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/02 14:22:29 UTC, 4 replies.
- [PR] [Test] exclude scala.collection.Seq at java side [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/02 14:23:53 UTC, 0 replies.
- [PR] [SPARK-48081][SQL][3.5] Fix ClassCastException in NTile.checkInputDataTypes() when argument is non-foldable or of wrong type [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2024/05/02 16:36:07 UTC, 2 replies.
- [PR] [SPARK-48081][SQL][3.4] Fix ClassCastException in NTile.checkInputDataTypes() when argument is non-foldable or of wrong type [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2024/05/02 16:40:00 UTC, 2 replies.
- [PR] [SPARK-47681][FOLLOWUP] Fix variant decimal handling. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/05/02 18:47:19 UTC, 5 replies.
- [PR] [SPARK-48089] Backport Client Side StreamingQueryListener to 3.5 [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/05/02 18:57:55 UTC, 0 replies.
- Re: [PR] [SPARK-36705][FOLLOW-UP] Support the case when user's classes need to register for Kryo serialization [spark] - posted by "romibuzi (via GitHub)" <gi...@apache.org> on 2024/05/02 19:46:14 UTC, 0 replies.
- [PR] [SPARK-48093][SS][CONNECT][4.0] Add server side config handler for 3.5 client requesting Server side StreamingQueryListener [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/05/02 19:51:24 UTC, 0 replies.
- [PR] [DO-NOT-REVIEW] [SPARK-48093][SS][CONNECT][3.5] Add config to switch between client side and server side StreamingQueryListener [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/05/02 19:56:21 UTC, 2 replies.
- Re: [PR] [SPARK-48089][SS][CONNECT][3.5] Backport Client Side StreamingQueryListener to 3.5 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/02 19:56:35 UTC, 2 replies.
- [PR] [SPARK-48095][INFRA] Run `build_non_ansi.yml` once per day [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/02 20:17:16 UTC, 4 replies.
- [PR] [SPARK-48096][INFRA] Run `build_maven_java21_macos14.yml` every two days [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/02 20:52:12 UTC, 3 replies.
- Re: [PR] [SPARK-47578][CORE] Migrate logWarning with variables to structured logging framework [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/05/02 21:03:55 UTC, 6 replies.
- [PR] [SPARK-48097][INFRA] Limit GHA job execution time to up to 3 hours in `build_and_test.yml` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/02 21:05:20 UTC, 3 replies.
- [PR] [SPARK-43046][FOLLOWUP][SS][CONNECT] Remove not used line in deduplicateWithinWatermark [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/05/02 21:33:41 UTC, 3 replies.
- [PR] [SPARK-48098][INFRA] Enable `NOLINT_ON_COMPILE` for all except `lint` job [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/02 21:37:14 UTC, 13 replies.
- [PR] [SPARK-48099][INFRA] Run `maven-build` test only on `Java 21 on MacOS14 (Apple Silicon)` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/02 22:01:48 UTC, 4 replies.
- [PR] [SPARK-48100] Fix issues in skipping nested structure fields not selected in schema [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2024/05/02 22:17:48 UTC, 0 replies.
- Re: [PR] [DO-NOT-REVIEW] [SPARK-48093][SS][CONNECT][4.0] Add server side config handler for 3.5 client requesting Server side StreamingQueryListener [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/05/02 23:00:28 UTC, 0 replies.
- [PR] [SPARK-47671][Core] Enable structured logging in log4j2.properties.template and update docs [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/05/02 23:04:07 UTC, 5 replies.
- Re: [PR] [WIP][SQL] Avoid parquet footer reads twice [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/03 00:19:00 UTC, 1 replies.
- Re: [PR] [SPARK-46738][CONNECT][PYTHON] Make the display of `cast` in `Regular Spark` and `Spark Connect` consistent [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/03 00:19:01 UTC, 1 replies.
- Re: [PR] [SPARK-46714][SQL] Overwrite a partition with custom location [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/03 00:19:02 UTC, 4 replies.
- Re: [PR] [SPARK-42669][CONNECT] Short circuit local relation RPCs [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/03 00:19:03 UTC, 1 replies.
- [PR] [SPARK-48102] Track duration for acquiring source/sink metrics while reporting streaming query progress [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/05/03 00:29:21 UTC, 0 replies.
- Re: [PR] [SPARK-48102][SS] Track duration for acquiring source/sink metrics while reporting streaming query progress [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/05/03 00:31:27 UTC, 2 replies.
- Re: [PR] [SPARK-48048][CONNECT][SS] Added client side listener support for Scala [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/03 01:07:33 UTC, 1 replies.
- [PR] Fix the race condition between state store unload and snapshotting [spark] - posted by "huanliwang-db (via GitHub)" <gi...@apache.org> on 2024/05/03 01:32:52 UTC, 0 replies.
- Re: [PR] [SPARK-47681][SQL][FOLLOWUP] Fix variant decimal handling. [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/03 03:04:31 UTC, 8 replies.
- [PR] [SPARK-48104][INFRA] Run `publish_snapshot.yml` once per day [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/03 03:09:35 UTC, 3 replies.
- [PR] [SPARK-48106][INFRA] Use `Python 3.11` in `pyspark` tests of `build_and_test.yml` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/03 03:24:09 UTC, 4 replies.
- [PR] [SPARK-48107][PYTHON] Exclude tests from Python distribution [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2024/05/03 03:55:26 UTC, 5 replies.
- [PR] [SPARK-48108][INFRA] Skip `tpcds-1g` and `docker-integration-tests` tests from `RocksDB UI-Backend` job [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/03 03:55:47 UTC, 4 replies.
- [PR] [SPARK-48109][INFRA] Enable `k8s-integration-tests` only for `kubernetes` module change [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/03 04:05:25 UTC, 4 replies.
- Re: [PR] [SPARK-48105] Fix the race condition between state store unloading and snapshotting [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/05/03 05:35:13 UTC, 11 replies.
- [PR] [SPARK-48103][K8S] Promote `KubernetesDriverBuilder` to `DeveloperApi` [spark] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/05/03 05:43:33 UTC, 2 replies.
- Re: [PR] [SPARK-47960][SS] Allow chaining other stateful operators after transformWIthState operator. [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/05/03 06:12:31 UTC, 22 replies.
- [PR] [SPARK-48088][PYTHON][CONNECT][TESTS] Prepare backward compatibility test 4.0 <> above [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/03 06:46:53 UTC, 1 replies.
- [PR] [MINOR][INFRA] Clean up the worker heatup that are unnecessary [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/03 06:49:46 UTC, 2 replies.
- [PR] [SPARK-48110][INFRA] Remove all Maven compilation build [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/03 07:03:55 UTC, 3 replies.
- [PR] [SPARK-48111][INFRA] Disable Docker integration test and TPC-DS in commit builder [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/03 07:13:15 UTC, 3 replies.
- [PR] [SPARK-47240][CORE][PART1] Migrate logInfo with variables to structured logging framework [spark] - posted by "zeotuan (via GitHub)" <gi...@apache.org> on 2024/05/03 09:12:21 UTC, 17 replies.
- [PR] [SPARK-48112][CONNECT] Expose session in SparkConnectPlanner to plugins [spark] - posted by "tomvanbussel (via GitHub)" <gi...@apache.org> on 2024/05/03 09:20:34 UTC, 6 replies.
- [PR] [SPARK-48113][CONNECT] Allow Plugins to integrate with Spark Connect [spark] - posted by "tomvanbussel (via GitHub)" <gi...@apache.org> on 2024/05/03 10:39:26 UTC, 6 replies.
- [PR] [SPARK-48114][CORE] Precompile template regex to avoid unnecessary work [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/05/03 12:40:15 UTC, 1 replies.
- [PR] [SPARK-48115][INFRA] Remove `Python 3.11` from `build_python.yml` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/03 15:31:28 UTC, 4 replies.
- Re: [PR] [SPARK-47787][BUILD][3.5] Upgrade `commons-compress` to 1.26.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/03 15:42:46 UTC, 0 replies.
- [PR] [SPARK-48116][INFRA] Move `pyspark-pandas*` tests to Daily Python CIs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/03 16:29:11 UTC, 0 replies.
- [PR] [SPARK-47336][SQL][CONNECT] Provide to PySpark a functionality to get estimated size of DataFrame in bytes [spark] - posted by "SemyonSinchenko (via GitHub)" <gi...@apache.org> on 2024/05/03 17:42:21 UTC, 10 replies.
- Re: [PR] Operator 0.1.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/03 20:31:38 UTC, 1 replies.
- [PR] [SPARK-48118][SQL] Support `SPARK_SQL_LEGACY_CREATE_HIVE_TABLE` env variable [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/03 20:48:46 UTC, 5 replies.
- [PR] [SPARK-47547][SQL] Fix inaccurate false positive rates when N is larg… [spark] - posted by "batubond007 (via GitHub)" <gi...@apache.org> on 2024/05/03 21:00:01 UTC, 0 replies.
- Re: [PR] [SPARK-48105][SS] Fix the race condition between state store unloading and snapshotting [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/05/03 21:17:07 UTC, 16 replies.
- [PR] [SPARK-48119][K8S] Promote ` KubernetesDriverSpec` to `DeveloperApi` [spark] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/05/03 21:51:42 UTC, 0 replies.
- Re: [PR] [SPARK-48119][K8S] Promote `KubernetesDriverSpec` to `DeveloperApi` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/03 22:03:01 UTC, 1 replies.
- [PR] [SPARK-48120] Enable autolink to SPARK jira issue [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/03 22:06:25 UTC, 3 replies.
- [PR] [SPARK-48019][FOLLOWUP] Set nulls correctly for primitive arrays [spark] - posted by "gene-db (via GitHub)" <gi...@apache.org> on 2024/05/03 22:06:36 UTC, 1 replies.
- Re: [PR] [SPARK-48116][INFRA] Run `pyspark-pandas*` only in PR builder and Daily Python CIs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/03 22:22:14 UTC, 10 replies.
- Re: [PR] [SPARK-48019][SQL][FOLLOWUP] Set nulls correctly for primitive arrays [spark] - posted by "gene-db (via GitHub)" <gi...@apache.org> on 2024/05/03 22:34:19 UTC, 2 replies.
- [PR] Promote `KubernetesDriverConf` to `DeveloperApi` [spark] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/05/03 22:36:43 UTC, 1 replies.
- [PR] [SPARK-47097][CONNECT][TESTS][FOLLOWUP] Increase timeout to 1 minute for `interrupt tag` test [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/03 22:37:44 UTC, 1 replies.
- Re: [PR] [SPARK-48019][SQL][FOLLOWUP] Use primitive arrays over object arrays when nulls exist [spark] - posted by "gene-db (via GitHub)" <gi...@apache.org> on 2024/05/03 22:49:30 UTC, 2 replies.
- Re: [PR] [SPARK-48121][K8S] Promote `KubernetesDriverConf` to `DeveloperApi` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/03 22:55:38 UTC, 4 replies.
- [PR] [SPARK-48123][Core] Provide a constant table schema for querying structured logs [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/05/03 23:12:16 UTC, 9 replies.
- Re: [PR] [SPARK-47097][CONNECT][TESTS][FOLLOWUP] Increase timeout to `1 minute` for `interrupt tag` test [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/03 23:54:13 UTC, 2 replies.
- Re: [PR] [SPARK-47484][SQL] Allow trailing comma in column definition list [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2024/05/04 00:08:09 UTC, 2 replies.
- Re: [PR] [SPARK-46813][CORE] Don't set the executor id to "driver" when SparkContext is created by the executor side [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/04 00:18:35 UTC, 1 replies.
- [PR] [SPARK-48127][INFRA] Fix `dev/scalastyle` to check `hadoop-cloud` and `jvm-profiler` modules [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/04 01:13:05 UTC, 7 replies.
- Re: [PR] [SPARK-47594] Connector module: Migrate logInfo with variables to structured logging framework [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/04 01:20:35 UTC, 2 replies.
- [PR] [SPARK-48056][PYTHON][CONNECT][FOLLOW-UP] Use `assertEqual` instead of `assertEquals` for Python 3.12 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/04 01:53:51 UTC, 4 replies.
- [PR] [SPARK-47969][PYTHON][TESTS][FOLLOWUP] Make Test `test_creation_index` deterministic - followup [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/04 01:55:46 UTC, 0 replies.
- Re: [PR] [SPARK-47969][PYTHON][TESTS][FOLLOWUP] Make Test `test_creation_index` deterministic [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/04 03:42:35 UTC, 1 replies.
- [PR] [SPARK-48116][INFRA][FOLLOWUP] Fix `if` statement to check repository [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/04 04:26:07 UTC, 3 replies.
- [PR] [SPARK-48116][INFRA] Simplify the build with fixing the if condition [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/04 04:58:46 UTC, 2 replies.
- Re: [PR] [SPARK-48116][INFRA][FOLLOWUP] Simplify the build with fixing the if condition [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/04 05:03:42 UTC, 3 replies.
- [PR] [SPARK-48116][INFRA][FOLLOW-UP] Simplify the build with fixing the if condition [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/04 05:12:59 UTC, 2 replies.
- [PR] [SPARK-48128][SQL] For BitwiseCount / bit_count expression, fix codegen syntax error for boolean type inputs [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2024/05/04 05:53:33 UTC, 2 replies.
- Re: [PR] [SPARK-48116][INFRA][FOLLOW-UP] Deduplicate pyspark.pandas skipping logic [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/04 05:59:50 UTC, 4 replies.
- [PR] [SPARK-48124][Core] Disable structured logging for Interpreters by default [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/05/04 07:36:01 UTC, 1 replies.
- [PR] [SPARK-48129][PYSPARK] Provide a constant table schema in PySpark for querying structured logs [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/05/04 07:42:44 UTC, 1 replies.
- Re: [PR] [SPARK-48129][PYTHON] Provide a constant table schema in PySpark for querying structured logs [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/04 11:18:31 UTC, 4 replies.
- [PR] [SPARK-46009][SQL][FOLLOWUP] Remove unused golden file. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2024/05/04 15:00:25 UTC, 2 replies.
- Re: [PR] [SPARK-48124][CORE] Disable structured logging for Interpreters by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/04 18:48:13 UTC, 2 replies.
- Re: [PR] [SPARK-47976][Python] Add Python UDTF DataFrame API to return result of 'analyze' method as output table [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/05/04 21:46:49 UTC, 4 replies.
- [PR] [SPARK-48131][Core] Unify MDC key `mdc.taskName` and `task_name` [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/05/04 22:00:03 UTC, 13 replies.
- [PR] [SPARK-48124][CORE] Disable structured logging for Connect-Repl by default [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/04 23:16:06 UTC, 5 replies.
- Re: [PR] [SPARK-46705][SS] Make RocksDB State Store Compaction Less Likely to fall behind [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/05 00:20:37 UTC, 1 replies.
- Re: [PR] [SPARK-42307][SQL][BUILD][DOCS] Adding in a better name for `_LEGACY_ERROR_TEMP_2232` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/05 00:20:38 UTC, 1 replies.
- [PR] [SPARK-48132][INFRA] Run `k8s-integration-tests` in PR builder and Daily CIs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/05 02:18:27 UTC, 0 replies.
- Re: [PR] [SPARK-48132][INFRA] Run `k8s-integration-tests` only in PR builder and Daily CIs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/05 03:53:58 UTC, 3 replies.
- [PR] [SPARK-48133][INFRA] Run `sparkr` only in PR builders and Daily CIs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/05 06:05:17 UTC, 9 replies.
- [PR] [SPARK-48134][CORE] Spark core (java side): Migrate `error/warn/info` with variables to structured logging framework [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/05 12:55:11 UTC, 20 replies.
- Re: [PR] [SPARK-48006][SQL]add SortOrder for window function which has no orde… [spark] - posted by "guixiaowen (via GitHub)" <gi...@apache.org> on 2024/05/05 13:22:51 UTC, 2 replies.
- [PR] [SPARK-48045][PYTHON] Pandas API groupby with multi-agg-relabel ignores as_index=False [spark] - posted by "sinaiamonkar-sai (via GitHub)" <gi...@apache.org> on 2024/05/05 16:17:05 UTC, 9 replies.
- Re: [PR] [SPARK-42093][SQL] Move JavaTypeInference to AgnosticEncoders [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2024/05/05 19:57:30 UTC, 6 replies.
- [PR] [SPARK-48135][INFRA] Run `but` and `ui` only in PR builders and Java 21 Daily CI [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/05 20:29:31 UTC, 0 replies.
- Re: [PR] [SPARK-47547][SQL] Fix inaccurate false positive rates when N is large for Bloom Filter [spark] - posted by "batubond007 (via GitHub)" <gi...@apache.org> on 2024/05/05 20:42:14 UTC, 0 replies.
- Re: [PR] [SPARK-48135][INFRA] Run `buf` and `ui` only in PR builders and Java 21 Daily CI [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/05 22:30:56 UTC, 2 replies.
- Re: [PR] [SPARK-46848] XML: Enhance XML bad record handling with partial results support [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/06 00:19:43 UTC, 1 replies.
- [PR] [SPARK-48136][INFRA][CONNECT] Always upload Spark Connect log files in scheduled build for Spark Connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/06 00:33:59 UTC, 2 replies.
- Re: [PR] [SPARK-47777][PYTHON][SS][TESTS] Add spark connect test for python streaming data source [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/06 00:37:59 UTC, 10 replies.
- [PR] [SPARK-48054][INFRA][FOLLOW-UP] Rename SPARK_SKIP_JVM_REQUIRED_TESTS to SPARK_SKIP_CONNECT_COMPAT_TESTS [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/06 00:43:58 UTC, 2 replies.
- [PR] [SPARK-48137][INFRA] Run `yarn` test only in PR builders and Maven Daily CIs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/06 02:27:42 UTC, 0 replies.
- Re: [PR] [SPARK-48137][INFRA] Run `yarn` test only in PR builders and Daily CIs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/06 02:59:52 UTC, 6 replies.
- [PR] [SPARK-48138][CONNECT][TESTS] Disable a flaky `SparkSessionE2ESuite.interrupt tag` test [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/06 03:24:53 UTC, 8 replies.
- Re: [PR] [SPARK-48027][SQL] InjectRuntimeFilter for multi-level join should check child join type [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2024/05/06 07:14:12 UTC, 6 replies.
- [PR] [MINOR][DOCS] Make a `dataframe.join` doctest deterministic [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/06 07:29:56 UTC, 1 replies.
- [PR] [SPARK-48141][TEST] Update the Oracle docker image version used for test and integration to use Oracle Database 23ai Free [spark] - posted by "LucaCanali (via GitHub)" <gi...@apache.org> on 2024/05/06 08:45:24 UTC, 9 replies.
- Re: [PR] [SPARK-48142][PYTHON][CONNECT][TESTS] Enable `CogroupedApplyInPandasTests.test_wrong_args` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/06 09:37:05 UTC, 4 replies.
- [PR] [SPARK-48143][SQL] Use lightweight exceptions for control-flow between UnivocityParser and FailureSafeParser [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/05/06 13:12:25 UTC, 27 replies.
- [PR] Fix canPlanAsBroadcastHashJoin to respect shuffle join hints [spark] - posted by "fred-db (via GitHub)" <gi...@apache.org> on 2024/05/06 13:56:49 UTC, 0 replies.
- [PR] [Only test] make spark-profiler publish snapshot [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/06 14:22:22 UTC, 0 replies.
- [PR] Add collation support to `mode` [spark] - posted by "GideonPotok (via GitHub)" <gi...@apache.org> on 2024/05/06 15:36:49 UTC, 1 replies.
- [PR] SPARK-47353: Enable collation support for the Mode expression in Spark. [spark] - posted by "GideonPotok (via GitHub)" <gi...@apache.org> on 2024/05/06 15:40:46 UTC, 1 replies.
- Re: [PR] [SPARK-45220][FOLLOWUP][DOCS][TESTS] Make a `dataframe.join` doctest deterministic [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/06 17:18:10 UTC, 2 replies.
- Re: [PR] [SPARK-47672][SQL] Avoid double eval from filter pushDown [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2024/05/06 17:56:46 UTC, 3 replies.
- Re: [PR] [SPARK-47018][BUILD] Upgrade built-in Hive to 2.3.10 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/06 18:26:41 UTC, 1 replies.
- [PR] [SPARK-48145][CORE] Remove logDebug and logTrace with MDC in JAVA structured logging framework [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/05/06 18:52:16 UTC, 9 replies.
- [PR] [SPARK-48147][SS][CONNECT] Remove client side listeners when local Spark session is deleted [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/05/06 19:21:20 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-47194][BUILD] Upgrade log4j to 2.23.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/06 19:32:38 UTC, 1 replies.
- [PR] [SPARK-48149][INFRA] Serialize `build_python.yml` to run a single Python version per cron schedule [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/06 21:25:43 UTC, 7 replies.
- [PR] [SPARK-48148][CORE] JSON objects should not be modified when read as STRING [spark] - posted by "eric-maynard (via GitHub)" <gi...@apache.org> on 2024/05/06 22:21:04 UTC, 16 replies.
- [PR] [SPARK-48150][SQL] try_parse_json output should be declared as nullable [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2024/05/06 22:39:06 UTC, 6 replies.
- Re: [PR] [WIP] [SPARK-46884] Spark Connect - ExecutePlanRequest new property - job description [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/07 00:19:13 UTC, 1 replies.
- [PR] [SPARK-48151][INFRA] `build_and_test.yml` should use `Volcano` 1.7.0 for `branch-3.4/3.5` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/07 00:43:11 UTC, 3 replies.
- [PR] [SPARK-48088][PYTHON][CONNECT][TESTS][FOLLOW-UP][3.5] Skips another that that requires JVM access [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/07 01:27:03 UTC, 2 replies.
- Re: [PR] [SPARK-48152][BUILD] Make the module `spark-profiler` as a part of Spark release [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/07 01:35:04 UTC, 3 replies.
- [PR] [SPARK-48153][INFRA] Run `build` job of `build_and_test.yml` only if needed [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/07 01:56:17 UTC, 5 replies.
- Re: [PR] [SPARK-48152][BUILD] Publish the module `spark-profiler` to `maven central repository` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/07 02:04:46 UTC, 13 replies.
- [PR] SPARK-48035][SQL][FOLLOWUP] Fix try_add/try_multiply being semantic equal to add/multiply [spark] - posted by "db-scnakandala (via GitHub)" <gi...@apache.org> on 2024/05/07 02:24:30 UTC, 1 replies.
- [PR] [SPARK-48035][SQL][FOLLOWUP] Fix try_add/try_multiply being semantic equal to add/multiply [spark] - posted by "db-scnakandala (via GitHub)" <gi...@apache.org> on 2024/05/07 02:33:23 UTC, 3 replies.
- Re: [PR] [SPARK-47353][SQL] Enable collation support for the Mode expression [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/07 02:39:06 UTC, 0 replies.
- [PR] [SPARK-48105][SS][3.5] Fix the race condition between state store unloading and snapshotting [spark] - posted by "huanliwang-db (via GitHub)" <gi...@apache.org> on 2024/05/07 02:57:20 UTC, 6 replies.
- [PR] Make some corrections in the docstring of pyspark DataStreamReader methods [spark] - posted by "chloeh13q (via GitHub)" <gi...@apache.org> on 2024/05/07 02:57:57 UTC, 2 replies.
- [PR] [DO-NOT-MERGE][SPARK-48090][SS][TESTS] Reenable StreamingParityTests.test_stream_exception [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/07 03:01:45 UTC, 1 replies.
- [PR] [SPARK-48154][PYTHON][CONNECT][TESTS] Enable `PandasUDFGroupedAggParityTests.test_manual` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/07 03:37:14 UTC, 4 replies.
- [PR] [SPARK-48083] [SPARK-48084] Enable spark ml test [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2024/05/07 03:39:27 UTC, 0 replies.
- Re: [PR] [SPARK-48083][SPARK-48084][ML][TESTS] Remove JIRAs for reenabling ML compatibility tests [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/07 03:41:33 UTC, 0 replies.
- [PR] [MINOR][CONNECT][TESTS] Improve test failure error message in StreamingParityTests [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/07 03:49:15 UTC, 2 replies.
- Re: [PR] [SPARK-48083][SPARK-48084][ML][TESTS] Remove JIRA comments for reenabling ML compatibility tests [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2024/05/07 03:49:40 UTC, 3 replies.
- [PR] [WIP][SQL] Eliminate unnecessary COLLATE expressions in query analysis [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/07 03:54:07 UTC, 0 replies.
- [PR] [WIP][SQL] Add collation support for hash expressions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/07 03:55:38 UTC, 0 replies.
- [PR] [WIP][SQL] Format expressions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/07 03:56:48 UTC, 0 replies.
- [PR] [WIP][SQL] Add collation support for variant expressions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/07 03:58:17 UTC, 0 replies.
- [PR] [SPARK-48163][CONNECT][TESTS] Disable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/07 04:13:56 UTC, 9 replies.
- [PR] [SPARK-48090][SS][PYTHON][TESTS] Shorten the traceback in the test checking error message in UDF [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/07 05:30:21 UTC, 3 replies.
- [PR] [SPARK-48165][BUILD] Update `ap-loader` to 3.0-9 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/07 06:38:15 UTC, 3 replies.
- [PR] Avoid using BadRecordException as user-facing error in VariantExpressionEvalUtils [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/05/07 06:42:11 UTC, 0 replies.
- [PR] [SPARK-48058][SPARK-43727][PYTHON][CONNECT][TESTS][FOLLOWUP] Code clean up [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/07 07:11:49 UTC, 2 replies.
- [PR] [SPARK-48167][CONNECT][TESTS] Skip known behaviour change by SPARK-46122 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/07 07:13:38 UTC, 3 replies.
- [PR] [SPARK-48086][PYTHON][TESTS] Remove obsolete comment [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/07 07:17:50 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-48156][SQL] Eliminate unnecessary COLLATE expressions in query analysis [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/05/07 07:58:20 UTC, 1 replies.
- [PR] [DO-NOT-MERGE] Test in different versions [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/07 08:08:34 UTC, 12 replies.
- Re: [PR] [SPARK-48166][SQL] Avoid using BadRecordException as user-facing error in VariantExpressionEvalUtils [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/07 08:13:24 UTC, 1 replies.
- Re: [PR] [SPARK-47365][PYTHON] Add _toArrow() DataFrame method to PySpark [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/05/07 08:56:50 UTC, 2 replies.
- Re: [PR] [SPARK-47267][SQL] Add collation support for hash expressions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/07 09:13:04 UTC, 1 replies.
- [PR] [SPARK-41547] Re-eneable tests for Spark Connect functions [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/05/07 09:28:11 UTC, 0 replies.
- Re: [PR] [SPARK-48086][PYTHON][TESTS][3.5] Remove obsolete comment [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/07 09:50:32 UTC, 1 replies.
- [PR] [SPARK-48170][PYTHON][CONNECT][TESTS] Enable `ArrowPythonUDFParityTests.test_err_return_type` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/07 09:56:11 UTC, 3 replies.
- [PR] [SPARK-41794] Add `try_remainder` function and re-enable column tests [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/05/07 10:22:20 UTC, 1 replies.
- [PR] [SPARK-47986][CONNECT][PYTHON] Unable to create a new session when the default session is closed by the server [spark] - posted by "nija-at (via GitHub)" <gi...@apache.org> on 2024/05/07 11:14:10 UTC, 5 replies.
- Re: [PR] [SPARK-48000][SQL] Enable hash join support for non-binary collations [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/07 11:36:56 UTC, 12 replies.
- Re: [PR] [SPARK-47365][PYTHON] Add toArrowTable() DataFrame method to PySpark [spark] - posted by "ianmcook (via GitHub)" <gi...@apache.org> on 2024/05/07 11:41:15 UTC, 23 replies.
- [PR] [SPARK-48171][CORE] Clean up the use of deprecated constructors of `o.rocksdb.Logger` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/05/07 11:57:03 UTC, 3 replies.
- [PR] [SPARK-48172][SQL] Fix escaping issue for mysql [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/05/07 12:06:16 UTC, 2 replies.
- [PR] [SPARK-48169][SQL] Use lazy BadRecordException cause in all parsers and remove the old constructor, which was meant for the migration [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/05/07 12:41:44 UTC, 2 replies.
- Re: [PR] [SPARK-46841][SQL] Add collation support for ICU locales and collation specifiers [spark] - posted by "dbatomic (via GitHub)" <gi...@apache.org> on 2024/05/07 12:50:26 UTC, 96 replies.
- [PR] [SPARK-48173][SQL] CheckAnalsis should see the entire query plan [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/07 12:56:50 UTC, 0 replies.
- [PR] [SPARK-48168][SQL] Add bitwise shifting operators support [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/07 13:10:32 UTC, 27 replies.
- Re: [PR] [WIP][SPARK-47353][SQL] Enable collation support for the Mode expression [spark] - posted by "GideonPotok (via GitHub)" <gi...@apache.org> on 2024/05/07 13:19:39 UTC, 33 replies.
- [PR] [SPARK-48174][INFRA] Merge `connect` back to the original test pipeline [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/07 14:54:14 UTC, 7 replies.
- Re: [PR] [SPARK-47297][SQL] Add collation support for format expressions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/07 14:59:59 UTC, 1 replies.
- Re: [PR] [SPARK-48173][SQL] CheckAnalysis should see the entire query plan [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/07 15:02:29 UTC, 1 replies.
- Re: [PR] [SPARK-46395][CORE] Assign Spark configs to groups for use in documentation [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2024/05/07 15:11:42 UTC, 3 replies.
- [PR] [3.5][SPARK-48173][SQL] CheckAnalysis should see the entire query plan [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/07 15:13:55 UTC, 2 replies.
- Re: [PR] [SPARK-41547][CONNECT][TESTS] Re-eneable Spark Connect function tests with ANSI mode [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/07 16:14:12 UTC, 0 replies.
- [PR] [SPARK-48146] Handle case of aggregate function in With expression child [spark] - posted by "kelvinjian-db (via GitHub)" <gi...@apache.org> on 2024/05/07 16:39:52 UTC, 0 replies.
- [PR] [DO-NOT-REVIEW][SPARK-48089][SS][CONNECT] Fix Streaming 3.5 <> 4.0 compatibility test [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/05/07 17:00:11 UTC, 4 replies.
- Re: [PR] [SPARK-47307][SQL] Add a config to optionally chunk base64 strings [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/07 17:29:08 UTC, 0 replies.
- Re: [PR] [SPARK-41794][SQL] Add `try_remainder` function and re-enable column tests [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/07 17:38:53 UTC, 16 replies.
- Re: [PR] [SPARK-48146][SQL] Handle case of aggregate function in With expression child [spark] - posted by "kelvinjian-db (via GitHub)" <gi...@apache.org> on 2024/05/07 17:56:23 UTC, 0 replies.
- [PR] [SPARK-48167][PYTHON][TESTS][FOLLOWUP] Reformat test_readwriter.py to fix Python Linter error [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/07 19:42:38 UTC, 0 replies.
- Re: [PR] [SPARK-48167][PYTHON][TESTS][FOLLOWUP][3.5] Reformat test_readwriter.py to fix Python Linter error [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/07 19:45:37 UTC, 5 replies.
- [PR] [SPARK-48131][CORE][FOLLOWUP] Add a new configuration for the MDC key of Task Name [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/05/07 19:59:06 UTC, 5 replies.
- [PR] [SPARK-48177][BUILD]: Bump Apache Parquet to 1.14.0 [spark] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2024/05/07 20:28:19 UTC, 0 replies.
- [PR] [SPARK-XXX][INFRA][3.5] Pin `nbsphinx` to `0.9.3' [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/07 20:48:56 UTC, 0 replies.
- Re: [PR] [SPARK-48177][BUILD] Upgrade `Apache Parquet` to 1.14.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/07 20:55:09 UTC, 6 replies.
- [PR] [SPARK-48178][INFRA] Run `build/scala-211/java-11-17` jobs of `branch-3.5` only if needed [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/07 21:19:34 UTC, 0 replies.
- Re: [PR] [SPARK-48179][INFRA][3.5] Pin `nbsphinx` to `0.9.3` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/07 22:16:57 UTC, 3 replies.
- Re: [PR] [SPARK-48173][SQL][3.5] CheckAnalysis should see the entire query plan [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/07 22:25:40 UTC, 1 replies.
- Re: [PR] [SPARK-48178][INFRA][3.5] Run `build/scala-213/java-11-17` jobs of `branch-3.5` only if needed [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/07 22:53:00 UTC, 3 replies.
- Re: [PR] [SPARK-48152][BUILD] Make `spark-profiler` as a part of release and publish to maven central repo [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/07 23:13:12 UTC, 5 replies.
- [PR] [SPARK-48182][SQL] SQL (java side): Migrate `error/warn/info` with variables to structured logging framework [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/07 23:23:44 UTC, 19 replies.
- [PR] [SPARK-48180][SQL] Improve error when UDTF call with TABLE arg forgets parentheses around multiple PARTITION/ORDER BY exprs [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/05/07 23:25:31 UTC, 9 replies.
- Re: [PR] [SPARK-48100][SQL] Fix issues in skipping nested structure fields not selected in schema [spark] - posted by "sandip-db (via GitHub)" <gi...@apache.org> on 2024/05/07 23:29:21 UTC, 3 replies.
- [PR] [SPARK-48126][Core] Make `spark.log.structuredLogging.enabled` effective [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/05/07 23:30:55 UTC, 4 replies.
- Re: [PR] [SPARK-47960][SS] Allow chaining other stateful operators after transformWithState operator. [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/05/08 00:20:10 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-24815] [CORE] Trigger Interval based DRA for Structured Streaming [spark] - posted by "pkotikalapudi (via GitHub)" <gi...@apache.org> on 2024/05/08 01:56:07 UTC, 4 replies.
- [PR] [MINOR][PYTHON][TESTS] Remove the doc in error message tests to allow other PyArrow versions in tests [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/08 02:08:53 UTC, 2 replies.
- [PR] [SPARK-48149][INFRA][FOLLOWUP] Use single quotation mark [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/08 02:26:11 UTC, 5 replies.
- [PR] [SPARK-48183][PYTHON][DOCS] Update error contribution guide to respect new error class file [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/05/08 02:39:11 UTC, 2 replies.
- [PR] [SPARK-48184][PYTHON][CONNECT] Always set the seed of `Dataframe.sample` in Client side [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/08 03:24:26 UTC, 8 replies.
- [PR] [SPARK-48185][SQL] Fix 'symbolic reference class is not accessible: class sun.util.calendar.ZoneInfo' [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/08 03:58:54 UTC, 6 replies.
- Re: [PR] [SPARK-47914][SQL] Do not display the splits parameter in Range [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/08 04:04:45 UTC, 1 replies.
- [PR] [WIP][SQL] Add support for AbstractMapType [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/08 04:07:55 UTC, 0 replies.
- [PR] [SPARK-48037][CORE][3.5] Fix SortShuffleWriter lacks shuffle write related metrics resulting in potentially inaccurate data [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/05/08 04:11:47 UTC, 3 replies.
- [PR] [WIP][SQL] Add collation support for URL expressions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/08 04:18:20 UTC, 0 replies.
- [PR] [WIP][SQL] Misc expressions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/08 04:34:38 UTC, 0 replies.
- [PR] [WIP][SQL] Add collation support for JSON expressions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/08 04:43:50 UTC, 0 replies.
- [PR] [SPARK-48187][INFRA] Run `docs` only in PR builders and Java 21 Daily CI [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/08 05:58:59 UTC, 1 replies.
- [PR] [SPARK-48037][CORE][3.4] Fix SortShuffleWriter lacks shuffle write related metrics resulting in potentially inaccurate data [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/05/08 06:18:04 UTC, 8 replies.
- [PR] [SPARK-48188][SQL] Consistently use normalized plan for cache [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/08 06:20:15 UTC, 2 replies.
- Re: [PR] [SPARK-48187][INFRA] Run `docs` only in PR builders and `build_non_ansi` Daily CI [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/08 07:02:49 UTC, 0 replies.
- [PR] [SPARK-48190][PYTHON][PS][TESTS] Introduce a helper function to drop metadata [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/08 07:30:10 UTC, 2 replies.
- [PR] [MINOR][INFRA] Rename NON-ANSI tp Non-ANSI, and Public Snapshot to Public snapshot [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/08 07:37:23 UTC, 0 replies.
- Re: [PR] [SPARK-47424][SQL] Add getDatabaseCalendar method to the JdbcDialect [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/08 07:40:50 UTC, 21 replies.
- [PR] [SPARK-47018][BUILD][SQL][HIVE] Bump built-in Hive to 2.3.10 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/05/08 07:49:23 UTC, 15 replies.
- [PR] [SPARK-48191][SQL] Support UTF-32 for string encode and decode [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/05/08 07:54:30 UTC, 2 replies.
- [PR] [SPARK-48192][INFRA] Enable TPC-DS tests in forked repository [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/08 08:09:55 UTC, 4 replies.
- Re: [PR] [MINOR][INFRA] Rename builds to have consistent names [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/08 08:15:23 UTC, 1 replies.
- [PR] [SPARK-48193][INFRA] Make `maven-deploy-plugin` retry 3 times [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/08 08:19:39 UTC, 3 replies.
- Re: [PR] [SPARK-48175][SQL][PYTHON] Store collation information in metadata and not in type for SER/DE [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/05/08 09:35:00 UTC, 54 replies.
- Re: [PR] [SPARK-47409][SQL] Add support for collation for StringTrim type of functions/expressions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/08 09:46:39 UTC, 0 replies.
- Re: [PR] [SPARK-48161][SQL] Add collation support for JSON expressions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/08 09:57:29 UTC, 2 replies.
- [PR] [SPARK-47965][SQL][FOLLOW-UP] Uses `null` as its default value for `OptionalConfigEntry` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/08 10:09:30 UTC, 2 replies.
- [PR] [SPARK-48087][PYTHON][TESTS][3.5] Remove obsolete comment about UDTF test [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/08 10:25:36 UTC, 3 replies.
- Re: [PR] [SPARK-38230][SQL] InsertIntoHadoopFsRelationCommand unnecessarily fetches details of partitions [spark] - posted by "zhouyifan279 (via GitHub)" <gi...@apache.org> on 2024/05/08 11:30:05 UTC, 2 replies.
- [PR] [SPARK-47972][SQL] Restrict CAST expression for collations [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/05/08 12:54:13 UTC, 9 replies.
- Re: [PR] [SPARK-46741][SQL] Cache Table with CTE won't work [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2024/05/08 13:02:14 UTC, 3 replies.
- [PR] [SPARK-48197][SQL] Avoid assert error for invalid lambda function [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/08 13:03:10 UTC, 7 replies.
- [PR] [SPARK-48198][BUILD] Upgrade jackson to 2.17.1 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/08 13:57:19 UTC, 2 replies.
- Re: [PR] [SPARK-48144][SQL] Fix `canPlanAsBroadcastHashJoin` to respect shuffle join hints [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/08 14:33:21 UTC, 10 replies.
- Re: [PR] [SPARK-48008][WIP] Support UDAFs in Spark Connect [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/05/08 15:10:53 UTC, 22 replies.
- Re: [PR] [SPARK-47421][SQL] Add collation support for URL expressions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/08 15:42:03 UTC, 3 replies.
- Re: [PR] [SPARK-48162][SQL] Add collation support for MISC expressions [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/08 16:06:57 UTC, 3 replies.
- Re: [PR] [SPARK-48186][SQL] Add support for AbstractMapType [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/08 16:07:42 UTC, 3 replies.
- [PR] [SPARK-48200][INFRA] Split `build_python.yml` into per-version cron jobs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/08 16:20:26 UTC, 8 replies.
- [PR] [SPARK-48169][SPARK-48143][SQL] Revert BadRecordException optimizations [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/05/08 17:18:06 UTC, 4 replies.
- [PR] [SPARK-48202][INFRA] Spin off `pyspark` tests from `build_branch35.yml` Daily CI [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/08 17:20:11 UTC, 5 replies.
- Re: [PR] [SPARK-48201][PYTHON] Make some corrections in the docstring of pyspark DataStreamReader methods [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/05/08 17:54:06 UTC, 1 replies.
- Re: [PR] [SPARK-47793][SS][PYTHON] Implement SimpleDataSourceStreamReader for python streaming data source [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2024/05/08 18:55:57 UTC, 2 replies.
- [PR] [SPARK-48203][INFRA] Spin off `pyspark` tests from `build_branch34.yml` Daily CI [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/08 19:06:49 UTC, 5 replies.
- [PR] [MINOR][TEST] fix flaky test for Python data source exactly once. [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2024/05/08 19:09:39 UTC, 0 replies.
- Re: [PR] [SPARK-47793][TEST][FOLLOWUP] Fix flaky test for Python data source exactly once. [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/08 19:14:12 UTC, 8 replies.
- [PR] [SPARK-48116][INFRA][3.5] Run `pyspark-pandas*` only in PR builder and Daily Python CIs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/08 19:51:09 UTC, 4 replies.
- [PR] [SPARK-48116][INFRA][3.4] Run `pyspark-pandas*` only in PR builder and Daily Python CIs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/08 19:57:34 UTC, 4 replies.
- [PR] [SPARK-48204][INFRA] Fix release script for Spark 4.0+ [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/08 20:29:44 UTC, 5 replies.
- [PR] Fix previous reader checks in Vectorized DELTA_BYTE_ARRAY decoder [spark] - posted by "yutsareva (via GitHub)" <gi...@apache.org> on 2024/05/08 21:01:23 UTC, 2 replies.
- [PR] [SPARK-47803][FOLLOWUP] Check nulls when casting nested type to variant. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/05/08 21:20:36 UTC, 3 replies.
- Re: [PR] [SPARK-48201][DOCS][PYTHON] Make some corrections in the docstring of pyspark DataStreamReader methods [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/05/08 21:40:39 UTC, 5 replies.
- Re: [PR] [SPARK-47672][SQL] Avoid double eval from filter pushDown w/ projection pushdown [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2024/05/08 21:40:59 UTC, 1 replies.
- [PR] [SPARK-48205][MINOR] Remove the private[sql] modifier for Python data sources [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/05/08 21:46:41 UTC, 0 replies.
- Re: [PR] [SPARK-48205][PYTHON] Remove the private[sql] modifier for Python data sources [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/05/08 21:49:26 UTC, 6 replies.
- [PR] Spark 47353 2 experimental [spark] - posted by "GideonPotok (via GitHub)" <gi...@apache.org> on 2024/05/08 21:51:35 UTC, 0 replies.
- Re: [PR] [SPARK-45862][PYTHON][DOCS] Add user guide for basic dataframe operations [spark] - posted by "srchilukoori (via GitHub)" <gi...@apache.org> on 2024/05/08 22:07:58 UTC, 2 replies.
- [PR] [SPARK-48207][INFRA][3.4] Run build/scala-213/java-11-17 jobs of `branch-3.4` only if needed [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/08 22:38:50 UTC, 1 replies.
- Re: [PR] [SPARK-48207][INFRA][3.4] Run `build/scala-213/java-11-17` jobs of `branch-3.4` only if needed [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/08 23:19:22 UTC, 2 replies.
- [PR] [Draft] Add debugging operator to identify skew in datasets inline [spark] - posted by "robreeves (via GitHub)" <gi...@apache.org> on 2024/05/08 23:25:03 UTC, 0 replies.
- Re: [PR] [SPARK-48172][SQL] Fix escaping issues in JDBC Dialects [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/08 23:40:53 UTC, 17 replies.
- Re: [PR] [SPARK-46885][SQL] Push down filters through `TypedFilter` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/09 00:19:03 UTC, 1 replies.
- Re: [PR] [SPARK-44609][K8S] Remove executor pod from PodsAllocator if it was removed from scheduler backend [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/09 00:19:04 UTC, 1 replies.
- [PR] [SPARK-48208] Skip providing memory usage metrics from RocksDB if bounded memory usage is enabled [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/05/09 00:58:11 UTC, 0 replies.
- Re: [PR] [SPARK-48208][SS] Skip providing memory usage metrics from RocksDB if bounded memory usage is enabled [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/05/09 00:59:06 UTC, 5 replies.
- [PR] [SPARK-48206][SQL] Add tests for window rewrites with RewriteWithExpression [spark] - posted by "kelvinjian-db (via GitHub)" <gi...@apache.org> on 2024/05/09 01:41:53 UTC, 2 replies.
- [PR] [SPARK-48209][CORE] Common (java side): Migrate `error/warn/info` with variables to structured logging framework [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/09 02:54:35 UTC, 26 replies.
- Re: [PR] [SPARK-48146][SQL] Fix aggregate function in With expression child assertion [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/09 03:06:07 UTC, 7 replies.
- [PR] [SPARK-47579][CORE][PART2] Migrate logInfo with variables to structured logging framework [spark] - posted by "zeotuan (via GitHub)" <gi...@apache.org> on 2024/05/09 03:15:47 UTC, 11 replies.
- [PR] [SPARK-47186][TESTS][FOLLOWUP] Correct the name of spark.test.docker.connectionTimeout [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/09 03:37:49 UTC, 3 replies.
- [PR] [SPARK-48210][doc]Modify the description of whether dynamic partition… [spark] - posted by "guixiaowen (via GitHub)" <gi...@apache.org> on 2024/05/09 03:58:29 UTC, 1 replies.
- Re: [PR] [SPARK-47354][SQL] Add collation support for variant expressions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/09 04:22:25 UTC, 2 replies.
- [PR] [SPARK-48211][SQL] DB2: Read SMALLINT as ShortType [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/09 05:00:32 UTC, 6 replies.
- [PR] [SPARK-48212][PYTHON][CONNECT][TESTS] Fully enable `PandasUDFParityTests.test_udf_wrong_arg` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/09 07:12:36 UTC, 5 replies.
- [PR] [SPARK-48213][SQL] Do not push down predicate if non-cheap expression exceed reused limit [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2024/05/09 08:05:17 UTC, 8 replies.
- Re: [PR] [SPARK-47365][PYTHON] Add toArrow() DataFrame method to PySpark [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/09 08:24:45 UTC, 3 replies.
- [PR] [MINOR] Add `spark-ganglia-lgpl` to `lint-java` & `spark-ganglia-lgpl` and `jvm-profiler` to `sbt-checkstyle` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/09 09:16:05 UTC, 0 replies.
- [PR] [SPARK-48214][INFRA] Ban import `org.slf4j.Logger` & `org.slf4j.LoggerFactory` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/09 09:27:42 UTC, 13 replies.
- [PR] [WIP] Add collation support for input file block [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/09 09:29:47 UTC, 0 replies.
- [PR] [WIP] Add collation support for CSV expressions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/09 09:30:56 UTC, 0 replies.
- Re: [PR] [SPARK-36691][PYTHON] PythonRunner failed should pass error message to ApplicationMaster too [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2024/05/09 10:02:15 UTC, 5 replies.
- [PR] [SPARK-48216][TESTS] Remove overrides DockerJDBCIntegrationSuite.connectionTimeout to make related tests configurable [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/09 10:08:20 UTC, 1 replies.
- [PR] [SPARK-48218][SHUFFLE] TransportClientFactory.createClient may NPE cause FetchFailedException [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/05/09 10:54:45 UTC, 8 replies.
- [PR] [WIP] Add collation support for XML expressions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/09 11:22:41 UTC, 0 replies.
- [PR] [WIP] Add collation support for XPATH expressions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/09 11:28:44 UTC, 0 replies.
- Re: [PR] [SPARK-47415][SQL] Collation support: Levenshtein [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/05/09 12:39:26 UTC, 10 replies.
- [PR] [SPARK-48219][core] StreamReader Charset fix with UTF8 [spark] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/05/09 13:05:30 UTC, 0 replies.
- Re: [PR] [SPARK-48031][SQL] Support view schema evolution [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/09 13:40:25 UTC, 49 replies.
- Re: [PR] [SPARK-24497][SQL] Support recursive SQL [spark] - posted by "jeremyjh (via GitHub)" <gi...@apache.org> on 2024/05/09 14:59:20 UTC, 0 replies.
- Re: [PR] [SPARK-47409][SQL] Add support for collation for StringTrim type of functions/expressions (for UTF8_BINARY & LCASE) [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/09 15:04:59 UTC, 1 replies.
- [PR] [SPARK-48176][SQL] Adjust name of FIELD_ALREADY_EXISTS error condition [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2024/05/09 15:13:45 UTC, 2 replies.
- [PR] [WIP][SPARK-48221][SQL] Alter string search logic for UTF8_BINARY_LCASE collation [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/09 15:31:45 UTC, 22 replies.
- Re: [PR] [SPARK-46626][DOCS] Bump jekyll to 4.3.3 to enable support for Ruby 3.3.0 [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/09 16:55:05 UTC, 9 replies.
- [PR] Sync Ruby Bundler to 2.4.22 and refresh Gem lock file [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2024/05/09 17:23:24 UTC, 0 replies.
- Re: [PR] [SPARK-48222][DOCS] Sync Ruby Bundler to 2.4.22 and refresh Gem lock file [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/09 17:31:02 UTC, 3 replies.
- Re: [PR] [SPARK-47018][BUILD][SQL] Bump built-in Hive to 2.3.10 [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2024/05/09 17:58:15 UTC, 12 replies.
- Re: [PR] [SPARK-48222][INFRA][DOCS] Sync Ruby Bundler to 2.4.22 and refresh Gem lock file [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/09 18:08:05 UTC, 11 replies.
- [PR] [SPARK-48089][SS][CONNECT] Fix 3.5 <> 4.0 StreamingQueryListener compatibility test [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/05/09 19:07:26 UTC, 3 replies.
- Re: [PR] [SPARK-48218][CORE] TransportClientFactory.createClient may NPE cause FetchFailedException [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/09 19:47:15 UTC, 5 replies.
- [PR] [SPARK-48197][SQL][TESTS][FOLLOWUP][3.5] Regenerate golden files [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/09 20:15:48 UTC, 8 replies.
- [PR] [SPARK-47172] Add support for AES-GCM for RPC encryption [spark] - posted by "sweisdb (via GitHub)" <gi...@apache.org> on 2024/05/09 20:33:42 UTC, 0 replies.
- [PR] [SPARK-48224] Disallow map keys from being of variant type [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/05/09 20:36:16 UTC, 1 replies.
- Re: [PR] [SPARK-44507][SQL][CONNECT] Move AnalysisException to sql/api [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/09 20:36:38 UTC, 0 replies.
- Re: [PR] [SPARK-47172][CORE] Add support for AES-GCM for RPC encryption [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/09 21:02:46 UTC, 13 replies.
- [PR] [SPARK-48225][BUILD] Upgrade `sbt` to 1.10.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/09 21:49:12 UTC, 7 replies.
- Re: [PR] [SPARK-48226][BUILD] Add `spark-ganglia-lgpl` to `lint-java` & `spark-ganglia-lgpl` and `jvm-profiler` to `sbt-checkstyle` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/09 23:04:09 UTC, 2 replies.
- [PR] [SPARK-48227][PYTHON][DOC] Document the requirement of seed in protos [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/09 23:37:25 UTC, 4 replies.
- Re: [PR] [WIP] docs: restructure the docs index page [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/10 00:19:21 UTC, 1 replies.
- Re: [PR] [SPARK-45708][BUILD] Retry mvn deploy [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/10 00:19:23 UTC, 1 replies.
- Re: [PR] [SPARK-46108][SQL] keepInnerXmlAsRaw option for Built-in XML Data Source [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/10 00:19:23 UTC, 1 replies.
- Re: [PR] [SPARK-48219][CORE] StreamReader Charset fix with UTF8 [spark] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/05/10 01:55:19 UTC, 16 replies.
- Re: [PR] [SPARK-47119][BUILD] Add `hive-jackson-provided` profile [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/05/10 02:01:14 UTC, 1 replies.
- Re: [PR] [SPARK-46632][SQL] Fix subexpression elimination when equivalent ternary expressions have different children [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2024/05/10 02:15:11 UTC, 0 replies.
- Re: [PR] [SPARK-27900][CORE][K8s] Add `spark.driver.killOnOOMError` flag in cluster mode [spark] - posted by "dimon222 (via GitHub)" <gi...@apache.org> on 2024/05/10 03:29:59 UTC, 1 replies.
- Re: [PR] [SPARK-47995][PYTHON][INFRA][TESTS] Upgrade `pyarrow` to 16.0.0 in GitHub Action CI [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/10 03:33:07 UTC, 0 replies.
- Re: [PR] [SPARK-47834][SQL][CONNECT] Mark deprecated functions with `@deprecated` in `SQLImplicits` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/10 03:47:39 UTC, 2 replies.
- [PR] [SPARK-48228][PYTHON][CONNECT] Implement the missing function validation in ApplyInXXX [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/10 03:48:30 UTC, 5 replies.
- Re: [PR] [MINOR][BUILD] Remove duplicate configuration of maven-compiler-plugin [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/10 03:51:01 UTC, 2 replies.
- Re: [PR] [SPARK-47847][CORE] Deprecate spark.network.remoteReadNioBufferConversion [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/10 03:59:57 UTC, 2 replies.
- Re: [PR] [SPARK-47441][YARN] Do not add log link for unmanaged AM in Spark UI [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/10 04:08:28 UTC, 3 replies.
- Re: [PR] [DRAFT][BUILD] Test upgrading built-in Hive to 2.3.10 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/10 04:31:55 UTC, 0 replies.
- Re: [PR] [SPARK-48224][SQL] Disallow map keys from being of variant type [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/10 04:47:10 UTC, 0 replies.
- Re: [PR] [SPARK-48210][DOC]Modify the description of whether dynamic partition… [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/10 04:59:06 UTC, 4 replies.
- [PR] [SPARK-48230][BUILD] Remove unused jodd-core [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/05/10 05:43:28 UTC, 0 replies.
- Re: [PR] [SPARK-47847][CORE] Deprecate `spark.network.remoteReadNioBufferConversion` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/10 05:54:49 UTC, 2 replies.
- Re: [PR] [SPARK-48158][SQL] Add collation support for XML expressions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/10 06:02:40 UTC, 1 replies.
- [PR] [SPARK-48231][BUILD] Remove unused CodeHaus Jackson dependencies [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/05/10 06:23:35 UTC, 19 replies.
- [PR] [SPARK-48232][PYTHON][TESTS] Fix 'pyspark.sql.tests.connect.test_connect_session' in Python 3.12 build [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/10 07:41:07 UTC, 3 replies.
- [PR] [SPARK-44811][BUILD] Upgrade Guava to 32+ [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/05/10 08:05:24 UTC, 2 replies.
- Re: [PR] [SPARK-48230][BUILD] Remove unused `jodd-core` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/10 08:09:06 UTC, 4 replies.
- [PR] [SPARK-48155][SQL] AQEPropagateEmptyRelation for join should check if remain child is just BroadcastQueryStageExec [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2024/05/10 08:50:31 UTC, 11 replies.
- [PR] [SPARK-48228][PYTHON][CONNECT][FOLLOWUP] Also apply `_validate_pandas_udf` in MapInXXX [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/10 09:39:32 UTC, 2 replies.
- [PR] Directly pass join instead of all arguments to getBroadcastBuildSide and getShuffleHashJoinBuildSide [spark] - posted by "fred-db (via GitHub)" <gi...@apache.org> on 2024/05/10 11:32:43 UTC, 0 replies.
- Re: [PR] [SPARK-48234] Fix previous reader checks in Vectorized DELTA_BYTE_ARRAY decoder [spark] - posted by "yutsareva (via GitHub)" <gi...@apache.org> on 2024/05/10 12:33:26 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-30538][SQL] Control spark sql output small file by merge small partition [spark] - posted by "SubhamSinghal (via GitHub)" <gi...@apache.org> on 2024/05/10 12:39:12 UTC, 0 replies.
- [PR] [WIP][SPARK-47353][SQL] Enable collation support for the Mode expression using GroupMapReduce [spark] - posted by "GideonPotok (via GitHub)" <gi...@apache.org> on 2024/05/10 13:33:39 UTC, 37 replies.
- [PR] [SPARK-47599][MLLIB] MLLib: Migrate logWarn with variables to structured logging framework [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/10 14:01:37 UTC, 10 replies.
- Re: [PR] [SPARK-48235][SQL] Directly pass join instead of all arguments to getBroadcastBuildSide and getShuffleHashJoinBuildSide [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/10 14:45:34 UTC, 0 replies.
- Re: [PR] [SPARK-46937][SQL] Improve concurrency performance for FunctionRegistry [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/10 15:28:07 UTC, 3 replies.
- Re: [PR] [SPARK-47716][SQL] Avoid view name conflict in SQLQueryTestSuite semantic sort test case [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/10 16:23:30 UTC, 10 replies.
- Re: [PR] [SPARK-44811][BUILD] Upgrade Guava to 33.1.0-jre [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/05/10 16:49:00 UTC, 16 replies.
- Re: [PR] [SPARK-45717][YARN] Avoid use `spark.yarn.user.classpath.first` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/10 16:53:03 UTC, 5 replies.
- Re: [PR] [SPARK-48206][SQL][TESTS] Add tests for window rewrites with RewriteWithExpression [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/10 17:34:42 UTC, 3 replies.
- Re: [PR] [SPARK-47118][BUILD][CORE][SQL][UI] Migrate from Jetty 10 to Jetty 11 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/05/10 18:01:23 UTC, 5 replies.
- Re: [PR] [SPARK-48229][SQL] Add collation support for inputFile expressions [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2024/05/10 20:17:22 UTC, 14 replies.
- [PR] [SPARK-48236][BUILD] Add `commons-lang:commons-lang:2.6` back to support legacy Hive UDF jars [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/10 21:27:48 UTC, 6 replies.
- [PR] [SPARK-48220][PYTHON] Allow passing PyArrow Table to createDataFrame() [spark] - posted by "ianmcook (via GitHub)" <gi...@apache.org> on 2024/05/10 22:12:08 UTC, 80 replies.
- [PR] [SPARK-48205][FOLLOWUP] Add missing tags for the dataSource API [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/05/10 23:16:51 UTC, 1 replies.
- Re: [PR] [SPARK-48205][SQL][FOLLOWUP] Add missing tags for the dataSource API [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/10 23:31:52 UTC, 1 replies.
- Re: [PR] [SPARK-46912] Use worker JAVA_HOME and SPARK_HOME instead of from submitter [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/11 00:18:57 UTC, 1 replies.
- [PR] [MINOR] After executing `test-dependencies.sh`, the dir `dev/pr-deps` should be deleted [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/11 00:33:07 UTC, 2 replies.
- [PR] [TEST Only] test sbt 1.10.0 performance without local maven repo cache [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/11 02:24:06 UTC, 9 replies.
- Re: [PR] [SPARK-48237][BUILD] After executing `test-dependencies.sh`, the dir `dev/pr-deps` should be deleted [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/11 02:42:12 UTC, 0 replies.
- Re: [PR] [SPARK-48237][BUILD] Clean up `dev/pr-deps` at the end of `test-dependencies.sh` script [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/11 02:54:34 UTC, 0 replies.
- [PR] [Only Test] test jaxb-runtime [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/11 03:27:49 UTC, 1 replies.
- [PR] [SPARK-48239][INFRA] Update the release docker image to follow what we use in Github Action jobs [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/11 06:08:42 UTC, 3 replies.
- Re: [PR] [SPARK-44050][K8S]add retry config when creating Kubernetes resources. [spark] - posted by "imtzer (via GitHub)" <gi...@apache.org> on 2024/05/11 06:51:13 UTC, 5 replies.
- [PR] [SPARK-48240][DOCS] Replace `Local[..]` with `"Local[...]"` in the docs [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/11 07:26:24 UTC, 3 replies.
- [PR] [SPARK-48027][SQL][FOLLOWUP] Add comments for the other code branch [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2024/05/11 07:40:32 UTC, 6 replies.
- [PR] [SPARK-48241][SQL] CSV parsing failure with char/varchar type columns [spark] - posted by "liujiayi771 (via GitHub)" <gi...@apache.org> on 2024/05/11 07:51:50 UTC, 6 replies.
- [PR] [SPARK-48242][BUILD] Upgrade extra-enforcer-rules to 1.8.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/11 08:54:02 UTC, 6 replies.
- [PR] [SPARK-48243][SQL][HIVE] Support push down char and varchar predicates to Hive Metastore [spark] - posted by "wecharyu (via GitHub)" <gi...@apache.org> on 2024/05/11 10:35:42 UTC, 0 replies.
- [PR] [Only TEST] test jaxb-runtime 2.3.9 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/11 11:14:38 UTC, 0 replies.
- Re: [PR] [SPARK-19426][SQL] Custom coalescer for Dataset [spark] - posted by "SubhamSinghal (via GitHub)" <gi...@apache.org> on 2024/05/11 19:40:23 UTC, 3 replies.
- Re: [PR] [Don't Review, Only test] retryable test [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/12 00:21:27 UTC, 1 replies.
- Re: [PR] [SPARK-46891][SQL] Allow injecting LogicalPlan Statistics visitor. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/12 00:21:28 UTC, 1 replies.
- [PR] [SPARK-19426][SQL][WIP] Custom coalescer for Dataset [spark] - posted by "SubhamSinghal (via GitHub)" <gi...@apache.org> on 2024/05/12 14:36:17 UTC, 0 replies.
- [PR] [SPARK-48245][SQL] Fix typo in BadRecordException class doc [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/05/12 16:46:33 UTC, 2 replies.
- [PR] [SPARK-47429][SQL] Rename error class to condition [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2024/05/12 20:55:50 UTC, 1 replies.
- Re: [PR] [SPARK-42727][CORE] Fix can't executing spark commands in the root directory when local mode is specified [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/13 00:20:21 UTC, 1 replies.
- Re: [PR] [SPARK-46707][SQL][FOLLOWUP] Push down throwable predicate through aggregates [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/13 00:20:22 UTC, 6 replies.
- [PR] [MINOR][PYTHON][TESTS] Move test `test_named_arguments_negative` to `test_arrow_python_udf` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/13 01:13:49 UTC, 2 replies.
- [PR] [SPARK-47993][PYTHON][FOLLOW-UP] Update migration guide about Python 3.8 dropped. [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/13 01:31:53 UTC, 2 replies.
- [PR] [SPARK-48246][BUILD] Add a new ScalaStyle Rule `RedundantIfChecker` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/13 02:05:25 UTC, 3 replies.
- [PR] [SPARK-48247][PYTHON] Use all values in a python dict when inferring MapType schema [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/13 02:33:17 UTC, 0 replies.
- [PR] [SPARK-48248][PYTHON] Fix nested array to respect legacy conf of inferArrayTypeFromFirstElement [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/13 02:44:20 UTC, 2 replies.
- [PR] [SPARK-47681][FOLLOWUP] Fix schema_of_variant(decimal). [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/05/13 02:51:47 UTC, 3 replies.
- [PR] [SPARK-48250][PYTHON][CONNECT][TESTS] Enable array inference tests at test_parity_types.py [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/13 03:10:23 UTC, 9 replies.
- Re: [PR] [SPARK-45522][BUILD][CORE][SQL][UI] Migrate from Jetty 9 to Jetty 10 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/05/13 04:10:49 UTC, 3 replies.
- Re: [PR] [WIP][SQL] Refactor the implementation of `SparkDateTimeUtils#toJavaDate` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/05/13 05:41:58 UTC, 0 replies.
- [PR] [SPARK-48251][BUILD] Disable `maven local cache` on GA's step `MIMA test` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/13 07:29:08 UTC, 9 replies.
- Re: [PR] [WIP][SPARK-47353][SQL] Enable collation support for the Mode expression using a scala TreeMap (RB Tree) [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/13 08:00:20 UTC, 2 replies.
- [PR] [SPARK-48252][SQL] Update CommonExpressionRef when necessary [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/13 08:06:18 UTC, 8 replies.
- [PR] [SPARK-48253][PS][SQL] Support default mode for Pandas API on Spark [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/05/13 08:39:50 UTC, 10 replies.
- [PR] [SPARK-48227][PYTHON][DOC][FOLLOWUP] Fix two typos [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/13 09:04:25 UTC, 2 replies.
- [PR] [SPARK-48254][BUILD] Enhance Guava version extraction rule in `dev/test-dependencies.sh` [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/05/13 09:06:02 UTC, 3 replies.
- Re: [PR] [SPARK-47910][CORE] close stream when DiskBlockObjectWriter closeResources to avoid memory leak [spark] - posted by "JacobZheng0927 (via GitHub)" <gi...@apache.org> on 2024/05/13 09:07:24 UTC, 3 replies.
- [PR] [SPARK-48255][BUILD] Guava should not respect `hadoop.deps.scope` [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/05/13 09:19:11 UTC, 1 replies.
- [PR] [SPARK-48256][BUILD] Add a rule to check file headers for the java side, and fix inconsistent files [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/13 09:20:31 UTC, 2 replies.
- [PR] [SPARK-48257][BUILD] Polish POM for Hive dependencies [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/05/13 09:50:47 UTC, 4 replies.
- [PR] [SPARK-48259][CONNECT][TESTS] Add 3 missing methods in dsl [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/13 10:54:17 UTC, 5 replies.
- Re: [PR] [WIP][SPARK-48000][SQL] Enable hash join support for non-binary collations [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/13 10:59:52 UTC, 2 replies.
- [PR] [SPARK-48260][SQL] Disable output committer coordination in one test of ParquetIOSuite [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/13 11:25:25 UTC, 20 replies.
- [PR] [SPARK-48215] Extending support for collated strings on date_format expression [spark] - posted by "nebojsa-db (via GitHub)" <gi...@apache.org> on 2024/05/13 14:25:21 UTC, 8 replies.
- Re: [PR] [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort stage when committed file not consistent with task status [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2024/05/13 15:23:34 UTC, 7 replies.
- Re: [PR] [SPARK-33752][SQL][3.1] Avoid the getSimpleMessage of AnalysisException adds semicolon repeatedly [spark] - posted by "bibhu107 (via GitHub)" <gi...@apache.org> on 2024/05/13 18:19:28 UTC, 0 replies.
- Re: [PR] [SPARK-48233][SQL][STREAMING] Tests for non-stateful streaming on columns with collations [spark] - posted by "jose-torres (via GitHub)" <gi...@apache.org> on 2024/05/13 19:52:06 UTC, 4 replies.
- Re: [PR] [SPARK-44953][CORE] Log a warning when shuffle tracking is enabled along side another DA supported mechanism [spark] - posted by "asfgit (via GitHub)" <gi...@apache.org> on 2024/05/13 20:36:12 UTC, 1 replies.
- [PR] [SPARK-48264][BUILD] Upgrade `datasketches-java` to 6.0.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/14 01:12:12 UTC, 3 replies.
- Re: [PR] [SPARK-47301][SQL][TESTS] Fix flaky ParquetIOSuite [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/14 01:29:44 UTC, 2 replies.
- [PR] [Only Test] Test label profiler [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/14 01:44:56 UTC, 0 replies.
- [PR] [SPARK-48241][SQL][3.5] CSV parsing failure with char/varchar type columns [spark] - posted by "liujiayi771 (via GitHub)" <gi...@apache.org> on 2024/05/14 01:47:29 UTC, 3 replies.
- [PR] [SPARK-41794][FOLLOWUP] Add `try_remainder` to python API references [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/14 02:26:45 UTC, 2 replies.
- [PR] [SPARK-48266][CONNECT] Move package object `org.apache.spark.sql.connect.dsl` to test directory [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/05/14 02:30:34 UTC, 6 replies.
- [PR] [SPARK-48265][SQL] Infer window group limit batch should do constant folding [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2024/05/14 02:32:08 UTC, 4 replies.
- [PR] [SPARK-48267][SS] Regression e2e test with SPARK-47305 [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/05/14 03:56:05 UTC, 7 replies.
- [PR] [[SPARK-48258][PYTHON][CONNECT] Checkpoint and localCheckpoint in Spark Connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/14 04:13:28 UTC, 0 replies.
- [PR] [DO-NOT-MERGE][SPARK-48268][CORE] Add a configuration for SparkContext.setCheckpointDir [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/14 05:09:14 UTC, 1 replies.
- Re: [PR] [SPARK-48157][SQL] Add collation support for CSV expressions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/14 06:11:12 UTC, 1 replies.
- Re: [PR] [SPARK-48215][SQL] Extending support for collated strings on date_format expression [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/14 06:51:11 UTC, 10 replies.
- [PR] [SPARK-48269][DOCS][TESTS] DB2: Document Mapping Spark SQL Data Types from DB2 and add tests [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/14 07:34:47 UTC, 3 replies.
- [PR] [WIP][SPARK-48270][SQL] Improve the OptimizeRepartition with Repartition [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2024/05/14 08:24:05 UTC, 0 replies.
- Re: [PR] [DO-NOT-MERGE][SPARK-48258][PYTHON][CONNECT] Checkpoint and localCheckpoint in Spark Connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/14 08:35:11 UTC, 15 replies.
- [PR] [SPARK-48263] Collate function not working when default collation config set [spark] - posted by "nebojsa-db (via GitHub)" <gi...@apache.org> on 2024/05/14 08:48:58 UTC, 3 replies.
- [PR] [SPARK-48271][SQL] Support char/varchar in RowEncoder [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/14 09:28:33 UTC, 8 replies.
- Re: [PR] [SPARK-48263] Collate function support for non UTF8_BINARY strings [spark] - posted by "nebojsa-db (via GitHub)" <gi...@apache.org> on 2024/05/14 09:36:25 UTC, 5 replies.
- [PR] [SPARK-48272][SQL][PYTHON][CONNECT] Add function `timestamp_diff` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/14 10:54:32 UTC, 4 replies.
- [PR] [SPARK-47301][SQL][TESTS] Remove workaround for ParquetIOSuite [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/14 11:13:06 UTC, 1 replies.
- [PR] Collation Expr walker [spark] - posted by "dbatomic (via GitHub)" <gi...@apache.org> on 2024/05/14 13:00:21 UTC, 0 replies.
- [PR] [Only Test] Test unidocGenjavadocVersion 0.19 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/14 13:10:38 UTC, 0 replies.
- [PR] [SPARK-48273] Fix late rewrite of PlanWithUnresolvedIdentifier [spark] - posted by "nikolamand-db (via GitHub)" <gi...@apache.org> on 2024/05/14 13:34:44 UTC, 0 replies.
- Re: [PR] [SPARK-48233][SQL][STREAMING] Tests for streaming on columns with non-default collations [spark] - posted by "dbatomic (via GitHub)" <gi...@apache.org> on 2024/05/14 14:32:33 UTC, 2 replies.
- Re: [PR] [SPARK-47301][SQL][TESTS][FOLLOWUP] Remove workaround for ParquetIOSuite [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/14 15:37:30 UTC, 1 replies.
- Re: [PR] [SPARK-46350][SS] Fix state removal for stream-stream join with one watermark and one time-interval condition [spark] - posted by "sahnib (via GitHub)" <gi...@apache.org> on 2024/05/14 16:54:59 UTC, 0 replies.
- Re: [PR] [SPARK-48247][PYTHON] Use all values in a dict when inferring MapType schema [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/05/14 17:57:19 UTC, 5 replies.
- [PR] [WIP] Fix UTF8String indexOf behaviour for empty string search [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/14 18:57:11 UTC, 0 replies.
- Re: [PR] [SPARK-48274][BUILD] Upgrade GenJavadoc to `0.19` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/14 23:06:54 UTC, 2 replies.
- [PR] Fix GA LONGTEXT issue [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/14 23:53:45 UTC, 1 replies.
- Re: [PR] [SPARK-46956][SQL] Improve the error prompt when `SaveMode` is null in API `DataFrameWriter.mode` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/15 00:19:23 UTC, 1 replies.
- [PR] [SPARK-48276][PYTHON][CONNECT] Add the missing `__repr__` method for `SQLExpression` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/15 00:29:03 UTC, 2 replies.
- [PR] [SPARK-48277] Improve error message for ErrorClassesJsonReader.getErrorMessage [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2024/05/15 01:31:07 UTC, 5 replies.
- [PR] [SPARK-48278][PYTHON][CONNECT] Refine the string representation of `Cast` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/15 02:52:56 UTC, 2 replies.
- [PR] [SPARK-48271][SQL] Turn match error in RowEncoder into UNSUPPORTED_DATA_TYPE_FOR_ENCODER [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/15 03:25:29 UTC, 3 replies.
- Re: [PR] [SPARK-48270][SQL] Improve the OptimizeRepartition with Repartition [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2024/05/15 04:45:13 UTC, 4 replies.
- Re: [PR] [SPARK-48233][SS][TESTS] Tests for streaming on columns with non-default collations [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/05/15 05:42:06 UTC, 2 replies.
- [PR] [SPARK-48279][BUILD] Upgrade ORC to 2.0.1 [spark] - posted by "williamhyun (via GitHub)" <gi...@apache.org> on 2024/05/15 05:56:13 UTC, 1 replies.
- Re: [PR] [SPARK-48160][SQL] Add collation support for XPATH expressions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/15 06:24:29 UTC, 1 replies.
- [PR] [SPARK-48172][SQL] Fix reverted PR [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/05/15 06:28:04 UTC, 0 replies.
- [PR] [WIP][SPARK-48281][SQL] Alter string search logic for UTF8_BINARY_LCASE collation (StringInStr, SubStringIndex) [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/15 06:47:22 UTC, 0 replies.
- [PR] [SPARK-46759][AVRO] Fix configuration name for spark.sql.avro.xz.level [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/15 07:16:28 UTC, 1 replies.
- [PR] [MINOR] Fix typo for XmlFunctionsSuite [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/15 08:18:22 UTC, 1 replies.
- [PR] [SPARK-48285][SQL][DOCS] Update docs for size function and sizeOfNull configuration [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/15 08:23:29 UTC, 3 replies.
- [PR] Test `scala-maven-plugin` 4.9.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/05/15 08:41:12 UTC, 0 replies.
- Re: [PR] [SPARK-46759][AVRO][FOLLOWUP] Fix configuration name for spark.sql.avro.xz.level [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/15 08:49:03 UTC, 1 replies.
- [PR] [SPARK-48286] Fix analysis of default expression in struct field to column conversion method [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2024/05/15 09:28:21 UTC, 2 replies.
- [PR] [SPARK-48287][PS][CONNECT] Apply the builtin `timestamp_diff` method [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/15 09:40:36 UTC, 2 replies.
- [PR] [SPARK-48288] Add source data type for connector cast expression [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2024/05/15 11:57:49 UTC, 9 replies.
- [PR] [WIP][SPARK-47353][SQL] Enable collation support for the Mode expression using GroupMapReduce [V2] [spark] - posted by "GideonPotok (via GitHub)" <gi...@apache.org> on 2024/05/15 13:42:13 UTC, 0 replies.
- [PR] [SPARK-48289][DOCKER][TEST] Clean up Oracle JDBC tests by skipping redundant SYSTEM password reset [spark] - posted by "LucaCanali (via GitHub)" <gi...@apache.org> on 2024/05/15 13:50:54 UTC, 7 replies.
- Re: [PR] [SPARK-48172][SQL] Fix escaping issues in JDBCDialects [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/15 14:14:41 UTC, 5 replies.
- [PR] [WIP][SPARK-48000][SQL] Enable hash join support for all collations (StringType) [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/15 14:46:40 UTC, 8 replies.
- Re: [PR] [SPARK-48268][CORE] Add a configuration for SparkContext.setCheckpointDir [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/15 16:49:46 UTC, 11 replies.
- [PR] [SPARK-48291][Core] Rename Java Logger as SparkLogger [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/05/15 18:20:34 UTC, 5 replies.
- [PR] [SPARK-48293][SS] Add test for when ForeachBatchUserFuncException wraps interrupted exception due to query stop [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2024/05/15 18:44:47 UTC, 2 replies.
- [PR] [SPARK-48295][PS] Turn on `compute.ops_on_diff_frames` by default [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/16 00:07:12 UTC, 5 replies.
- Re: [PR] [SPARK-42789][SQL] Rewrite multiple GetJsonObject that consumes same JSON to single JsonTuple [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/16 00:19:03 UTC, 2 replies.
- Re: [PR] [WIP][Spark 44646] Reduce usage of log4j core [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/16 00:19:04 UTC, 1 replies.
- Re: [PR] [SPARK-46090][SQL] Support plan fragment level SQL configs in AQE [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2024/05/16 01:22:59 UTC, 6 replies.
- Re: [PR] [SPARK-48296][SQL] Codegen Support for `to_xml` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/16 02:29:41 UTC, 9 replies.
- [PR] [SPARK-48297][SQL] Fix a regression TRANSFORM clause with char/varchar [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/16 03:08:49 UTC, 4 replies.
- [PR] [WIP][SPARK-48298][Core] Add TCP mode to StatsD sink [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2024/05/16 03:25:41 UTC, 0 replies.
- Re: [PR] [SPARK-36783][SQL] ScanOperation should not push Filter through nondeterministic Project [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/05/16 04:20:14 UTC, 2 replies.
- Re: [PR] [SPARK-48298][Core] Add TCP mode to StatsD sink [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2024/05/16 04:47:22 UTC, 5 replies.
- [PR] [SPARK-47607] Add documentation for Structured logging framework [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/05/16 05:26:24 UTC, 4 replies.
- Re: [PR] [SPARK-48299][BUILD] Upgrade `scala-maven-plugin` to 4.9.1 [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/16 05:41:50 UTC, 2 replies.
- [PR] [Only Test] Test without local maven cache [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/16 05:55:20 UTC, 0 replies.
- [PR] inject chukonu [spark] - posted by "fanzi2009 (via GitHub)" <gi...@apache.org> on 2024/05/16 06:17:55 UTC, 0 replies.
- [PR] [SPARK-48301][SQL] Rename `CREATE_FUNC_WITH_IF_NOT_EXISTS_AND_REPLACE` to `CREATE_ROUTINE_WITH_IF_NOT_EXISTS_AND_REPLACE` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/16 06:46:10 UTC, 7 replies.
- [PR] [SPARK-48300][SQL] Codegen Support for `from_xml` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/16 06:46:42 UTC, 6 replies.
- [PR] [SPARK-48036][DOCS][FOLLOWUP] Update sql-ref-ansi-compliance.md [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/16 06:50:21 UTC, 3 replies.
- [PR] [SPARK-48238][BUILD][YARN] Replace AmIpFilter with re-implemented YarnAMIpFilter [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/05/16 07:37:37 UTC, 11 replies.
- [PR] [SPARK-48303][CORE] Reorganize `LogKey` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/16 08:26:20 UTC, 0 replies.
- [PR] [WIP][SQL] Add collation support for CurrentLike expressions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/16 08:30:02 UTC, 0 replies.
- [PR] [SPARK-48031][SQL][FOLLOW-UP] Use ANSI-enabled cast in view lookup test [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/16 08:31:11 UTC, 4 replies.
- [PR] [SPARK-48291][CORE][FOLLOWUP] Rename Java *LoggerSuite* as *SparkLoggerSuite* [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/16 08:37:05 UTC, 3 replies.
- [PR] [SPARK-48306][SQL] Improve UDT in error message [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/16 10:09:49 UTC, 2 replies.
- [PR] [SPARK-48307][SQL] InlineCTE should keep not-inlined relations in the original WithCTE node [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/16 11:50:35 UTC, 5 replies.
- [PR] [SPARK-48159][SQL] Extending support for collated strings on datetime expressions [spark] - posted by "nebojsa-db (via GitHub)" <gi...@apache.org> on 2024/05/16 11:54:49 UTC, 17 replies.
- [PR] [SPARK-48308][Core] Unify getting data schema without partition columns in FileSourceStrategy [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2024/05/16 12:47:24 UTC, 2 replies.
- Re: [PR] [SPARK-48305][SQL] Add collation support for CurrentLike expressions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/16 13:25:15 UTC, 6 replies.
- [PR] [SPARK-48309][YARN]Stop am retry, in situations where some errors and… [spark] - posted by "guixiaowen (via GitHub)" <gi...@apache.org> on 2024/05/16 14:56:50 UTC, 0 replies.
- [PR] [SPARK-48310] Cached properties must return copies [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/05/16 15:04:40 UTC, 0 replies.
- [PR] [SQL][SPARK-48312] Improve Alias.removeNonInheritableMetadata performance [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/05/16 15:32:20 UTC, 3 replies.
- Re: [PR] [WIP][SPARK-48221][SQL] Alter string search logic for UTF8_BINARY_LCASE collation (Contains, StartsWith, EndsWith, StringLocate) [spark] - posted by "mkaravel (via GitHub)" <gi...@apache.org> on 2024/05/16 17:14:47 UTC, 6 replies.
- Re: [PR] [WIP][SPARK-48281][SQL] Alter string search logic for UTF8_BINARY_LCASE collation (StringInStr, SubstringIndex) [spark] - posted by "mkaravel (via GitHub)" <gi...@apache.org> on 2024/05/16 17:32:28 UTC, 1 replies.
- [PR] [SPARK-48294] Handle lowercase in nestedTypeMissingElementTypeError [spark] - posted by "michaelzhan-db (via GitHub)" <gi...@apache.org> on 2024/05/16 17:59:58 UTC, 0 replies.
- [PR] Python ds preview [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2024/05/16 20:02:25 UTC, 1 replies.
- [PR] Bump rexml from 3.2.6 to 3.2.8 in /docs [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/05/16 21:44:11 UTC, 2 replies.
- Re: [PR] [SPARK-48294][SQL] Handle lowercase in nestedTypeMissingElementTypeError [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/05/16 21:58:03 UTC, 2 replies.
- [PR] [SPARK-43815] Wrap NPE with AnalysisException in csv options [spark] - posted by "michaelzhan-db (via GitHub)" <gi...@apache.org> on 2024/05/16 22:29:37 UTC, 0 replies.
- [PR] [SPARK-48314] Don't double cache files for FileStreamSource using Trigger.AvailableNow [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2024/05/17 00:35:57 UTC, 1 replies.
- Re: [PR] [SPARK-48303][CORE] Reorganize `LogKeys` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/17 01:22:05 UTC, 2 replies.
- Re: [PR] [SPARK-43815][SQL] Wrap NPE with AnalysisException in CSV options [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/17 01:25:44 UTC, 1 replies.
- Re: [PR] [SPARK-48310][PYTHON][CONNECT] Cached properties must return copies [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/17 01:28:30 UTC, 1 replies.
- [PR] [SPARK-48301][SQL][FOLLOWUP] Update the error message [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/17 01:42:37 UTC, 2 replies.
- [PR] [SPARK-48316][PS][CONNECT][TESTS] Enable SparkFrameMethodsParityTests.test_coalesce and test_repartition [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/17 01:46:04 UTC, 1 replies.
- [PR] [SPARK-41625][PYTHON][CONNECT][TESTS] Enable `DataFrameObservationParityTests.test_observe_str` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/17 01:54:25 UTC, 0 replies.
- [PR] [MINOR][PYTHON][TESTS] Call `test_apply_schema_to_dict_and_rows` in `test_apply_schema_to_row` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/17 02:00:35 UTC, 2 replies.
- [PR] [SPARK-48317][PYTHON][CONNECT][TESTS] Enable `test_udtf_with_analyze_using_archive` and `test_udtf_with_analyze_using_file` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/17 02:16:23 UTC, 2 replies.
- Re: [PR] [SPARK-48258][PYTHON][CONNECT] Checkpoint and localCheckpoint in Spark Connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/17 02:33:03 UTC, 12 replies.
- Re: [PR] [SPARK-48316][PS][CONNECT][TESTS] Fix comments for SparkFrameMethodsParityTests.test_coalesce and test_repartition [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/17 03:09:38 UTC, 1 replies.
- Re: [PR] [SPARK-47952][CORE][CONNECT] Support retrieving the real SparkConnectService GRPC address and port programmatically when running on Yarn [spark] - posted by "TakawaAkirayo (via GitHub)" <gi...@apache.org> on 2024/05/17 03:48:56 UTC, 0 replies.
- Re: [PR] [SPARK-41625][PYTHON][CONNECT][TESTS][FOLLOW-UP] Enable `DataFrameObservationParityTests.test_observe_str` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/17 03:57:46 UTC, 1 replies.
- Re: [PR] [SPARK-48312][SQL] Improve Alias.removeNonInheritableMetadata performance [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/17 04:59:06 UTC, 2 replies.
- [PR] [SPARK-48319][PYTHON][CONNECT][TESTS] Test `assert_true` and `raise_error` with the same error class as Spark Classic [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/17 05:51:46 UTC, 2 replies.
- Re: [PR] [SPARK-48000][SQL] Enable hash join support for all collations (StringType) [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/17 07:04:38 UTC, 20 replies.
- [PR] [SPARK-48320][CORE][DOCS] Add external third-party ecosystem access guide to the doc [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/17 07:28:52 UTC, 24 replies.
- Re: [PR] [SPARK-47482] Add HiveDialect to sql module [spark] - posted by "daragu (via GitHub)" <gi...@apache.org> on 2024/05/17 08:15:08 UTC, 0 replies.
- [PR] [SPARK-48321][CONNECT][TESTS] Avoid using deprecated methods in dsl [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/17 08:40:20 UTC, 2 replies.
- [PR] [SPARK-48322][SQL][CONNECT][PYTHON] Drop internal metadata in `DataFrame.schema` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/17 09:22:24 UTC, 0 replies.
- [PR] [SPARK-48323][SQL] DB2: Map BooleanType to BOOLEAN instead of CHAR(1) [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/17 10:12:44 UTC, 6 replies.
- [PR] [SPARK-47818][CONNECT][FOLLOW-UP] Introduce plan cache in SparkConnectPlanner to improve performance of Analyze requests [spark] - posted by "xi-db (via GitHub)" <gi...@apache.org> on 2024/05/17 11:23:13 UTC, 2 replies.
- [PR] [SPARK-48324][SQL] Codegen Support for `hll_sketch_estimate` and `hll_union` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/17 12:21:15 UTC, 1 replies.
- Re: [PR] [SPARK-47353][SQL] Enable collation support for the Mode expression using GroupMapReduce [V2] [spark] - posted by "GideonPotok (via GitHub)" <gi...@apache.org> on 2024/05/17 12:39:27 UTC, 24 replies.
- [PR] [WIP][SQL] Enable hash aggregation support for all collations (StringType) [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/17 13:04:42 UTC, 0 replies.
- [PR] [SPARK-48325][CORE] Always specify messages in ExecutorRunner.killProcess [spark] - posted by "bozhang2820 (via GitHub)" <gi...@apache.org> on 2024/05/17 13:37:29 UTC, 5 replies.
- [PR] [WIP] JDBC Connectors predicate pushdown testing [spark] - posted by "stefanbuk-db (via GitHub)" <gi...@apache.org> on 2024/05/17 14:10:02 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-47227][FOLLOW][DOCS] Building Extensions [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2024/05/17 14:50:40 UTC, 0 replies.
- [PR] [SPARK-48294][SQL][3.5] Handle lowercase in nestedTypeMissingElementTypeError [spark] - posted by "michaelzhan-db (via GitHub)" <gi...@apache.org> on 2024/05/17 16:00:13 UTC, 2 replies.
- [PR] [WIP] [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/05/17 18:17:31 UTC, 0 replies.
- [PR] [WIP] OperatorStateMetadata [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/05/17 18:32:28 UTC, 1 replies.
- [PR] [SPARK-48328][BUILD] Upgrade `Arrow` to 16.1.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/17 22:56:11 UTC, 2 replies.
- [PR] Writing OperatorStateMetadata for the TransformWithState operator [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/05/17 23:58:23 UTC, 1 replies.
- Re: [PR] assorted copy edits to migration instructions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/18 00:19:25 UTC, 2 replies.
- Re: [PR] [SPARK-43829][CONNECT] Improve SparkConnectPlanner by reuse Dataset and avoid construct new Dataset [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/18 00:19:26 UTC, 1 replies.
- [PR] test maven [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/18 01:36:18 UTC, 3 replies.
- Re: [PR] [SPARK-48238][BUILD][YARN] Replace YARN AmIpFilter with a forked implementation [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/05/18 04:14:56 UTC, 10 replies.
- [PR] [SPARK-44838][SQL][FOLLOW-UP] Fix the test for raise_error by using default type for strings [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/18 09:43:42 UTC, 15 replies.
- [PR] [SPARK-48329][SQL] Turn on `spark.sql.sources.v2.bucketing.pushPartValues.enabled` by default [spark] - posted by "superdiaodiao (via GitHub)" <gi...@apache.org> on 2024/05/18 11:25:27 UTC, 1 replies.
- [PR] [SPARK-48330][SS][PYTHON] Fix the python streaming data source timeout issue for large trigger interval [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2024/05/18 19:52:01 UTC, 12 replies.
- [PR] [SPARK-48031] Decompose viewSchemaMode config, add SHOW CREATE TABLE support [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2024/05/18 20:51:16 UTC, 6 replies.
- Re: [PR] [SPARK-46971][SQL] When the `compression` is null, a `NullPointException` should not be thrown [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/19 00:21:25 UTC, 1 replies.
- Re: [PR] [SPARK-46617][SQL] Create-table-if-not-exists should not silently overwrite existing data-files [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/19 00:21:26 UTC, 1 replies.
- [PR] [SPARK-48332][BUILD][TESTS] Upgrade `jdbc` related test dependencies [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/19 02:51:05 UTC, 2 replies.
- Re: [PR] [SPARK-45579][CORE] Catch errors for FallbackStorage.copy [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/20 00:19:59 UTC, 1 replies.
- [PR] [SPARK-48333][PYTHON][CONNECT][TESTS] Test `test_sorting_functions_with_column` with same `Column` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/20 01:39:43 UTC, 2 replies.
- Re: [PR] [SPARK-44924][SS] Add config for FileStreamSource cached files [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/05/20 01:50:36 UTC, 1 replies.
- Re: [PR] [SPARK-48314][SQL] Don't double cache files for FileStreamSource using Trigger.AvailableNow [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/05/20 01:55:15 UTC, 0 replies.
- [PR] [ONLY TEST] Test mariadb 3.x [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/20 03:22:45 UTC, 2 replies.
- [PR] [MINOR][PYTHON][TESTS] Remove unnecessary hack imports [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/20 04:20:25 UTC, 2 replies.
- [PR] [SPARK-48335][PYTHON][CONNECT] Make `_parse_datatype_string` compatible with Spark Connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/20 05:52:43 UTC, 2 replies.
- Re: [PR] [SPARK-47353][SQL] Enable collation support for the Mode expression using GroupMapReduce [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/20 05:54:38 UTC, 6 replies.
- [PR] [SPARK-48336][PS][CONNECT] Implement `ps.sql` in Spark Connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/20 05:56:03 UTC, 4 replies.
- [PR] [WIP][SQL] Data types in complex type creator should respect collation [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/20 06:21:11 UTC, 0 replies.
- Re: [PR] [SPARK-48322][SPARK-42965][SQL][CONNECT][PYTHON] Drop internal metadata in `DataFrame.schema` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/20 06:52:50 UTC, 10 replies.
- [PR] [MINOR][PYTHON][TESTS] Test `test_mixed_udf_and_sql` with parent `Colum` class [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/20 07:07:51 UTC, 2 replies.
- [PR] [WIP][SQL] Add AbstractMapType type casting and fix RaiseError parameter map to work with collated strings [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/20 07:53:54 UTC, 0 replies.
- [PR] [SPARK-48337][SQL] Fix precision loss for JDBC TIME values [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/20 08:04:49 UTC, 5 replies.
- Re: [PR] [SPARK-35198][CONNECT][CORE][PYTHON][SQL] Add support for calling debugCodegen from Python & Java [spark] - posted by "juanvisoler (via GitHub)" <gi...@apache.org> on 2024/05/20 09:14:10 UTC, 0 replies.
- [PR] correct the doc error in configuration page (fix rest to reset) [spark] - posted by "Justontheway (via GitHub)" <gi...@apache.org> on 2024/05/20 09:50:06 UTC, 0 replies.
- [PR] [SPARK-48339] Revert conversion of collated strings to regular strings when writing to HMS [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/05/20 10:00:22 UTC, 0 replies.
- [PR] SQL Batch Lang Parser [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2024/05/20 10:34:32 UTC, 6 replies.
- [PR] [SPARK-48340][PYSPARK] Support TimestampNTZ infer schema miss prefer_timestamp_ntz [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2024/05/20 10:41:12 UTC, 1 replies.
- [PR] [CONNECT] Allow plugins to use QueryTest in their tests [spark] - posted by "tomvanbussel (via GitHub)" <gi...@apache.org> on 2024/05/20 11:00:17 UTC, 2 replies.
- [PR] [SPARK-48352][SQL]set max file counter through spark conf [spark] - posted by "guixiaowen (via GitHub)" <gi...@apache.org> on 2024/05/20 13:30:55 UTC, 2 replies.
- [PR] [SPARK-48351] JDBC Connectors - Add cast suite and fix found issue [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2024/05/20 13:42:20 UTC, 4 replies.
- Re: [PR] [SPARK-48354][SQL] JDBC Connectors predicate pushdown testing [spark] - posted by "milastdbx (via GitHub)" <gi...@apache.org> on 2024/05/20 14:33:04 UTC, 11 replies.
- [PR] [WIP] Don't review: E2e [spark] - posted by "GideonPotok (via GitHub)" <gi...@apache.org> on 2024/05/20 15:02:07 UTC, 3 replies.
- [PR] [SPARK-48360] Simplify conditionals with predicate branches [spark] - posted by "tom-s-powell (via GitHub)" <gi...@apache.org> on 2024/05/20 15:11:09 UTC, 0 replies.
- Re: [PR] [SPARK-48342] SQL Batch Lang Parser [spark] - posted by "dbatomic (via GitHub)" <gi...@apache.org> on 2024/05/20 15:29:03 UTC, 11 replies.
- [PR] [WIP][SPARK-48359][SQL] Built-in functions for Zstd compression and decompression [spark] - posted by "xi-db (via GitHub)" <gi...@apache.org> on 2024/05/20 15:39:35 UTC, 0 replies.
- [PR] [SPARK-48329][SQL] SPJ: Default spark.sql.sources.v2.bucketing.pushPartValues.enabled to true [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2024/05/20 18:42:10 UTC, 9 replies.
- Re: [PR] [SPARK-48300][SQL] Codegen Support for `from_xml` & remove some redundant codes [spark] - posted by "sandip-db (via GitHub)" <gi...@apache.org> on 2024/05/20 19:09:50 UTC, 2 replies.
- Re: [PR] [SPARK-43815][SQL] Wrap NPE with AnalysisException in CSV, XML, and JSON options [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/05/20 19:58:49 UTC, 5 replies.
- Re: [PR] [WIP] Propagate column family information from executors to driver via Accumulator [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/05/20 21:30:57 UTC, 0 replies.
- Re: [PR] [SPARK-48286] Fix analysis and creation of column with exists default expression [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/20 23:04:54 UTC, 7 replies.
- [PR] [SPARK-48363][SQL] Cleanup some redundant codes in `from_xml` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/20 23:46:32 UTC, 3 replies.
- Re: [PR] [SPARK-45744][CORE] Switch `spark.history.store.serializer` to use `PROTOBUF` by default [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/21 00:19:44 UTC, 2 replies.
- Re: [PR] [SPARK-48340][PYTHON] Support TimestampNTZ infer schema miss prefer_timestamp_ntz [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/21 00:54:40 UTC, 4 replies.
- Re: [PR] [MINOR][DOCS] correct the doc error in configuration page (fix rest to reset) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/21 00:55:50 UTC, 2 replies.
- Re: [PR] [SPARK-47233][CONNECT][SS][2/2] Client & Server logic for Client side streaming query listener [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/21 02:37:01 UTC, 0 replies.
- [PR] [MINOR][TESTS] Rename test_union to test_eqnullsafe at ColumnTestsMixin [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/21 04:35:21 UTC, 2 replies.
- Re: [PR] [SPARK-48359][SQL] Built-in functions for Zstd compression and decompression [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/21 04:50:43 UTC, 2 replies.
- [PR] [SPARK-48366][CORE][SQL][CONNECT] Simplify code statements related to `filter` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/05/21 06:29:44 UTC, 0 replies.
- [PR] [SPARK-48365][DOCS] DB2: Document Mapping Spark SQL Data Types to DB2 [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/21 06:38:29 UTC, 3 replies.
- [PR] [SPARK-47008][CORE] Added Hadoops fileSystems hasPathCapability check to avoid FileNotFoundException(s) when using S3 Express One Zone Storage. [spark] - posted by "leovegas (via GitHub)" <gi...@apache.org> on 2024/05/21 07:02:34 UTC, 35 replies.
- Re: [PR] [SPARK-48341][CONNECT] Allow plugins to use QueryTest in their tests [spark] - posted by "tomvanbussel (via GitHub)" <gi...@apache.org> on 2024/05/21 07:17:17 UTC, 2 replies.
- [PR] [SPARK-48367][CONNECT] Fix lint-scala for scalafmt to detect files to format properly [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/21 07:25:18 UTC, 7 replies.
- Re: [PR] [SPARK-48281][SQL] Alter string search logic for UTF8_BINARY_LCASE collation (StringInStr, SubstringIndex) [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/21 07:36:46 UTC, 4 replies.
- [PR] [SPARK-48369][SQL][PYTHON][CONNECT] Add function `timestamp_add` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/21 09:16:35 UTC, 2 replies.
- [PR] [SPARK-48031] Grandfather legacy views to SCHEMA BINDING [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2024/05/21 09:37:47 UTC, 2 replies.
- [PR] [WIP][SPARK-48282][SQL] Alter string search logic for UTF8_BINARY_LCASE collation (StringReplace, FindInSet) [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/21 09:41:03 UTC, 0 replies.
- [PR] [SPARK-48370][CONNECT] Checkpoint and localCheckpoint in Scala Spark Connect client [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/21 10:48:51 UTC, 14 replies.
- [PR] [SPARK-48367][BUILD] Replace keywords that identify `lint-scala` detection results [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/21 11:12:53 UTC, 1 replies.
- Re: [PR] [SPARK-48339][SQL] Revert conversion of collated strings to regular strings when writing to HMS [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/05/21 11:54:56 UTC, 0 replies.
- [PR] [SPARK-48372][PYTHON] Implement `StructType.treeString` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/21 12:38:14 UTC, 1 replies.
- [PR] [SPARK-47515][SPARK-47406][SQL][FOLLOWUP] Add legacy config spark.sql.legacy.mysql.timestampNTZMapping.enabled [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/21 12:53:17 UTC, 4 replies.
- [PR] [SPARK-48373][PYTHON] Allow schema parameter of createDataFrame() to be length-1 list or tuple of StructType [spark] - posted by "ianmcook (via GitHub)" <gi...@apache.org> on 2024/05/21 13:11:20 UTC, 3 replies.
- [PR] [SPARK-48374][PYTHON] Support additional PyArrow Table column types [spark] - posted by "ianmcook (via GitHub)" <gi...@apache.org> on 2024/05/21 13:36:32 UTC, 1 replies.
- Re: [PR] [SPARK-48314][SS] Don't double cache files for FileStreamSource using Trigger.AvailableNow [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2024/05/21 15:12:44 UTC, 2 replies.
- [PR] [SPARK-48379] Cancel previous builds on a PR when new commit is pushed [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/05/21 16:06:58 UTC, 0 replies.
- Re: [PR] [SPARK-48329][SQL] Enable `spark.sql.sources.v2.bucketing.pushPartValues.enabled` by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/21 17:00:24 UTC, 5 replies.
- [PR] [SPARK-48381][K8S][DOCS] Update `YuniKorn` docs with v1.5.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/21 17:25:05 UTC, 5 replies.
- [PR] SPARK-48380: SerDeUtil.javaToPython to support batchSize parameter [spark] - posted by "zshao9 (via GitHub)" <gi...@apache.org> on 2024/05/21 18:57:14 UTC, 6 replies.
- Re: [PR] [SPARK-47050][SQL] Collect and publish partition level metrics for V1 [spark] - posted by "snmvaughan (via GitHub)" <gi...@apache.org> on 2024/05/21 20:01:53 UTC, 0 replies.
- [PR] [SPARK-48383] In KafkaOffsetReader, partition mismatch should not be an assertion [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2024/05/21 22:56:54 UTC, 1 replies.
- [PR] [MINOR][TESTS] Fix `DslLogicalPlan.as` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/22 01:12:54 UTC, 2 replies.
- [PR] [SPARK-48258][PYTHON][CONNECT][FOLLOW-UP] Bind relation ID to the plan instead of DataFrame [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/22 01:25:10 UTC, 7 replies.
- [PR] [SPARK-48384][BUILD] Exclude `io.netty:netty-tcnative-boringssl-static` from `zookeeper` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/22 01:39:09 UTC, 7 replies.
- Re: [PR] [SQL] Bind JDBC dialect to JDBCRDD at construction [spark] - posted by "johnnywalker (via GitHub)" <gi...@apache.org> on 2024/05/22 01:48:33 UTC, 0 replies.
- [PR] [SPARK-48292[CORE] Revert [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort stage when committed file not consistent with task status [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2024/05/22 02:59:15 UTC, 9 replies.
- Re: [PR] [SPARK-48320][CORE][DOCS] Add external third-party ecosystem access guide to the `scala/java` doc [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/22 03:18:34 UTC, 9 replies.
- Re: [PR] [SPARK-48367][CONNECT][FOLLOWUP] Replace keywords that identify `lint-scala` detection results [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/22 03:28:07 UTC, 1 replies.
- [PR] [SPARK-48380][Core][WIP]: SerDeUtil.javaToPython to support batchSize parameter [spark] - posted by "zshao9 (via GitHub)" <gi...@apache.org> on 2024/05/22 03:50:50 UTC, 5 replies.
- Re: [PR] [SPARK-48221][SQL] Alter string search logic for UTF8_BINARY_LCASE collation (Contains, StartsWith, EndsWith, StringLocate) [spark] - posted by "mkaravel (via GitHub)" <gi...@apache.org> on 2024/05/22 04:02:57 UTC, 18 replies.
- [PR] [MINOR][TESTS] Replace JVM assert with JUnit Assert in tests [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/22 06:42:27 UTC, 4 replies.
- [PR] fix bug : https://issues.apache.org/jira/browse/SPARK-44473 [spark] - posted by "ychris78 (via GitHub)" <gi...@apache.org> on 2024/05/22 07:06:30 UTC, 0 replies.
- Re: [PR] [SPARK-48372][SPARK-45716][PYTHON] Implement `StructType.treeString` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/22 07:31:40 UTC, 1 replies.
- Re: [PR] [SPARK-48379][INFRA] Cancel previous builds on a PR when new commit is pushed [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/05/22 07:54:18 UTC, 14 replies.
- Re: [PR] [SPARK-44473][SQL] Overwriting the same partition of a partitioned table multiple times with empty data yields non-idempotent results [spark] - posted by "ychris78 (via GitHub)" <gi...@apache.org> on 2024/05/22 08:02:10 UTC, 0 replies.
- [PR] [WIP][SQL] Modify lowerCase, upperCase and titleCase implementations for UTF8_BINARY_LCASE [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/22 08:04:28 UTC, 0 replies.
- [PR] [SPARK-48387][SQL] Postgres: Map TimestampType to TIMESTAMP WITH TIME ZONE [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/22 08:54:24 UTC, 4 replies.
- Re: [PR] [SPARK-48385][SQL] Migrate the jdbc driver of mariadb from `2.x` to `3.x` [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/22 08:59:10 UTC, 15 replies.
- [PR] [WIP] dummy PR [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/05/22 10:12:01 UTC, 0 replies.
- [PR] [SPARK-48389][INFRA] Remove obsolete workflow cancel_duplicate_workflow_runs [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/22 10:28:19 UTC, 2 replies.
- Re: [PR] [SPARK-48273][SQL] Fix late rewrite of PlanWithUnresolvedIdentifier [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/22 11:31:11 UTC, 9 replies.
- [PR] [Only Test] MySQL & Postgre Docker Images [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/22 11:58:39 UTC, 0 replies.
- Re: [PR] [SPARK-48364][SQL] Add AbstractMapType type casting and fix RaiseError parameter map to work with collated strings [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/22 12:18:09 UTC, 3 replies.
- [PR] Using addAll instead of add function in fromAccumulatorInfos method of TaskMetrics Class [spark] - posted by "monkeyboy123 (via GitHub)" <gi...@apache.org> on 2024/05/22 13:28:49 UTC, 0 replies.
- Re: [PR] [SPARK-48008] Support UDAFs in Spark Connect [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/05/22 14:27:12 UTC, 6 replies.
- [PR] [SPARK-43043][FOLLOW-UP] Cleanup mapIdToMapIndex on mapoutput unregister [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2024/05/22 14:54:04 UTC, 3 replies.
- Re: [PR] [SPARK-48386][TESTS] Replace JVM assert with JUnit Assert in tests [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/22 18:08:23 UTC, 6 replies.
- [PR] [SPARK-36680][SQL] Supports Dynamic Table Options for Spark SQL [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2024/05/22 20:55:45 UTC, 8 replies.
- [PR] [SPARK-45009][SQL][FOLLOW UP] Add error class and tests for decorrelation of predicate subqueries in join condition which reference both join child [spark] - posted by "andylam-db (via GitHub)" <gi...@apache.org> on 2024/05/22 21:54:14 UTC, 11 replies.
- [PR] [WIP][SPARK-48392][CORE] Also load `spark-defaults.conf` when provided `--properties-file` [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2024/05/22 22:38:42 UTC, 0 replies.
- [PR] [SPARK-48393][PYTHON] Move a group of constants to `pyspark.util` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/22 23:58:21 UTC, 2 replies.
- Re: [PR] [SS][WIP] Serialization using case classes/primitives/POJO based on Avro for Arbitrary State API v2. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/23 00:19:24 UTC, 1 replies.
- Re: [PR] [SPARK-48394][CORE] Cleanup mapIdToMapIndex on mapoutput unregister [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2024/05/23 02:23:00 UTC, 10 replies.
- Re: [PR] [SPARK-48391][CORE]Using addAll instead of add function in fromAccumulatorInfos method of TaskMetrics Class [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/05/23 03:09:39 UTC, 18 replies.
- [PR] [SPARK-48395][PYTHON] Fix `StructType.treeString` for parameterized types [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/23 03:26:48 UTC, 3 replies.
- [PR] [SPARK-48370][SPARK-48258][CONNECT][PYTHON][FOLLOW-UP] Refactor local and eager required fields in CheckpointCommand [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/23 03:29:32 UTC, 2 replies.
- [PR] [SPARK-48396] Support configuring limit control for SQL to use maximum cores [spark] - posted by "yabola (via GitHub)" <gi...@apache.org> on 2024/05/23 06:18:27 UTC, 0 replies.
- [PR] [WIP][SPARK-48397][SQL] Add data write time metric to FileFormatDataWriter [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2024/05/23 06:27:51 UTC, 1 replies.
- Re: [PR] [SPARK-48309][YARN]Stop am retry, in situations where some errors and retries may not be successful [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/05/23 06:37:44 UTC, 8 replies.
- [PR] [SPARK-48382]Add controller / reconciler module to operator [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/05/23 06:38:15 UTC, 12 replies.
- Re: [PR] [SPARK-48041][SQL] Avoid call conf.resolver repeated in TableOutputResolver [spark] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/05/23 06:56:01 UTC, 0 replies.
- [PR] [SPARK-48399][SQL] Teradata: ByteType should map to BYTEINT instead of BYTE(binary) [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/23 07:28:21 UTC, 4 replies.
- [PR] Promote `PrometheusServlet` to `DeveloperApi` [spark] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/05/23 07:49:03 UTC, 1 replies.
- Re: [PR] [SPARK-48103]Promote `PrometheusServlet` to `DeveloperApi` [spark] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/05/23 08:44:23 UTC, 0 replies.
- [PR] [MINOR][TESTS] Add a helper function for `spark.table` in dsl [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/23 11:46:24 UTC, 2 replies.
- [PR] Test protobuf-java 3.25.3 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/05/23 13:37:46 UTC, 3 replies.
- [PR] [DRAFT][SQL] Draft string comparison for UTF8_BINARY_UCASE & UTF8_BINARY_TCASE [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/23 15:41:15 UTC, 0 replies.
- Re: [PR] [SPARK-48397][SQL] Add data write time metric to FileFormatDataWriter [spark] - posted by "jiwen624 (via GitHub)" <gi...@apache.org> on 2024/05/23 15:44:27 UTC, 0 replies.
- Re: [PR] [SPARK-48400][CORE]Promote `PrometheusServlet` to `DeveloperApi` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/05/23 16:09:44 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-47353][SQL][Prototype of alternative algorithm] Enable collation support for the Mode expression using multiple experimental approaches [spark] - posted by "GideonPotok (via GitHub)" <gi...@apache.org> on 2024/05/23 16:57:25 UTC, 0 replies.
- [PR] [SPARK-48403][SQL] Fix Lower, Upper, InitCap expressions for UTF8_BINARY_LCASE collation [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/23 18:01:42 UTC, 0 replies.
- [PR] [SPARK-41049][SQL][FOLLOW-UP] MapConcat is stateful expression [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2024/05/23 18:03:53 UTC, 6 replies.
- [PR] [WIP][SPARK-48318][SQL] Enable hash join support for all collations (complex types) [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/23 18:17:38 UTC, 0 replies.
- [PR] Spark 47353 3 PROTOTYPE [spark] - posted by "GideonPotok (via GitHub)" <gi...@apache.org> on 2024/05/23 19:36:26 UTC, 1 replies.
- Re: [PR] [SPARK-48380][CORE][WIP]: SerDeUtil.javaToPython to support batchSize parameter [spark] - posted by "zshao9 (via GitHub)" <gi...@apache.org> on 2024/05/23 19:46:52 UTC, 3 replies.
- [PR] [SPARK-47579][CORE][PART3] Migrate logInfo with variables to structured logging framework [spark] - posted by "zeotuan (via GitHub)" <gi...@apache.org> on 2024/05/23 22:42:12 UTC, 2 replies.
- Re: [PR] [SPARK-48342][SQL] Introduction of SQL Scripting Parser [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/05/23 22:42:22 UTC, 14 replies.
- Re: [PR] [SPARK-31561][SQL] Add QUALIFY clause [spark] - posted by "jboarman (via GitHub)" <gi...@apache.org> on 2024/05/23 22:50:13 UTC, 0 replies.
- Re: [PR] [SPARK-48282][SQL] Alter string search logic for UTF8_BINARY_LCASE collation (StringReplace, FindInSet) [spark] - posted by "mkaravel (via GitHub)" <gi...@apache.org> on 2024/05/24 00:36:17 UTC, 12 replies.
- [PR] [SPARK-48405][BUILD] Upgrade `commons-compress` to 1.26.2 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/24 01:45:27 UTC, 3 replies.
- [PR] [SPARK-48370][CONNECT][FOLLOW-UP] Use JDK's Cleaner instead [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/24 02:32:26 UTC, 8 replies.
- Re: [PR] [SPARK-48283][SQL] Modify string comparison for UTF8_BINARY_LCASE [spark] - posted by "mkaravel (via GitHub)" <gi...@apache.org> on 2024/05/24 03:06:45 UTC, 4 replies.
- [PR] [SPARK-48406][BUILD] Upgrade commons-cli to 1.8.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/05/24 03:08:33 UTC, 3 replies.
- Re: [PR] [WIP][SPARK-48403][SQL] Fix Lower, Upper, InitCap expressions for UTF8_BINARY_LCASE collation [spark] - posted by "mkaravel (via GitHub)" <gi...@apache.org> on 2024/05/24 03:13:41 UTC, 4 replies.
- [PR] [SPARK-48407][SQL][DOCS] Teradata: Document Type Conversion rules between Spark SQL and teradata [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/24 03:51:26 UTC, 2 replies.
- [PR] [SPARK-48408][SQL] Simplify `date_format` & `from_unixtime` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/24 05:57:18 UTC, 0 replies.
- [PR] [SPARK-46090][SQL][FOLLOWUP] Add DeveloperApi import [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2024/05/24 06:52:00 UTC, 2 replies.
- [PR] [SPARK-47257][SQL] Assign names to error classes _LEGACY_ERROR_TEMP_105[3-4] and _LEGACY_ERROR_TEMP_1113 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/05/24 07:17:34 UTC, 15 replies.
- Re: [PR] [WIP][SPARK-48403][SQL] Fix Lower & Upper expressions for UTF8_BINARY_LCASE collation [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/24 07:30:09 UTC, 2 replies.
- [PR] [WIP][SPARK-48410][SQL] Fix InitCap expression for UTF8_BINARY_LCASE & ICU collations [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/24 07:45:44 UTC, 0 replies.
- [PR] [SPARK-48412][PYTHON] Refactor data type json parse [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/24 08:04:36 UTC, 6 replies.
- [PR] [SPARK-48413] ALTER COLUMN with collation [spark] - posted by "nikolamand-db (via GitHub)" <gi...@apache.org> on 2024/05/24 08:09:14 UTC, 0 replies.
- [PR] [SPARK-47579][SQL][FOLLOWUP] Restore the print format of spark sql shell [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/24 08:19:59 UTC, 1 replies.
- Re: [PR] [SPARK-48409][BUILD][TESTS] Upgrade MySQL & Postgres & Mariadb docker image version [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/24 08:34:43 UTC, 5 replies.
- [PR] [MINOR][CORE] Remove an outdated TODO from UnsafeHashedRelation [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/05/24 08:56:47 UTC, 1 replies.
- Re: [PR] [SPARK-48396] Support configuring max cores can be used for SQL [spark] - posted by "yabola (via GitHub)" <gi...@apache.org> on 2024/05/24 09:17:55 UTC, 0 replies.
- Re: [PR] [MINOR][SQL] Remove an outdated `TODO` from UnsafeHashedRelation [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/24 09:18:55 UTC, 1 replies.
- Re: [PR] [SPARK-48413][SQL] ALTER COLUMN with collation [spark] - posted by "olaky (via GitHub)" <gi...@apache.org> on 2024/05/24 09:33:47 UTC, 11 replies.
- Re: [PR] [MINOR][SQL] Remove outdated `TODO`s from `UnsafeHashedRelation` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/05/24 09:35:58 UTC, 3 replies.
- [PR] [SPARK-48414][PYTHON] Fix breaking change in python's `fromJson` [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/05/24 10:35:49 UTC, 1 replies.
- [PR] [SPARK-48415][PYTHON] Refactor `TypeName` to support parameterized datatypes [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/24 12:08:32 UTC, 8 replies.
- Re: [PR] [SPARK-47579][SQL][FOLLOWUP] Restore the `--help` print format of spark sql shell [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/05/24 16:42:45 UTC, 1 replies.
- [PR] [SPARK-47579][CORE][PART3] Spark core: Migrate logInfo with variables to structured logging framework [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/05/24 17:05:55 UTC, 6 replies.
- [PR] [SPARK-48411][SS][PYTHON] Add E2E test for DropDuplicateWithinWatermark [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2024/05/24 17:53:13 UTC, 9 replies.
- [PR] [SPARK-48416][SQL] Support related nested WITH expression [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2024/05/25 00:02:53 UTC, 2 replies.
- Re: [PR] [SPARK-47041] PushDownUtils should support not only FileScanBuilder but any SupportsPushDownCatalystFilters [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/25 00:18:56 UTC, 1 replies.
- Re: [PR] Collations proof of concept [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/25 00:18:57 UTC, 1 replies.
- [PR] [SPARK-48419][SQL] Foldable propagation replace foldable column shoul… [spark] - posted by "KnightChess (via GitHub)" <gi...@apache.org> on 2024/05/25 01:21:08 UTC, 7 replies.
- [PR] [SPARK-48239][INFRA][FOLLOWUP] install the missing `jq` library [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/25 03:31:34 UTC, 4 replies.
- [PR] [SPARK-48420][BUILD] Upgrade netty to `4.1.110.Final` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/25 04:01:53 UTC, 3 replies.
- [PR] [SPARK-48421][SQL] SPJ: Add documentation [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2024/05/25 06:58:25 UTC, 2 replies.
- Re: [PR] [SPARK-48320][CORE][DOCS] Add structured logging guide to the scala and java doc [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/05/25 16:42:48 UTC, 1 replies.
- Re: [PR] [SPARK-47053][INFRA] Bump python libraries (pandas, pyarrow) in Docker image for release script [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/26 00:21:27 UTC, 1 replies.
- Re: [PR] [SPARK-46395][DOCS] Assign Spark configs to groups for use in documentation [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/26 00:21:29 UTC, 2 replies.
- [PR] [MINOR][K8S] Fix KubernetesSuite [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/26 12:08:33 UTC, 0 replies.
- Re: [PR] [SPARK-47579][CORE][PART3][FOLLOWUP] Fix KubernetesSuite [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/26 12:29:18 UTC, 3 replies.
- [PR] [SPARK-48394][3.5][CORE] Cleanup mapIdToMapIndex on mapoutput unregister [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2024/05/26 14:31:54 UTC, 10 replies.
- [PR] [MINOR][CORE][TESTS] Make SparkLoggerSuiteBase code more concise [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/26 23:37:04 UTC, 3 replies.
- [PR] [SPARK-48424][INFRA] Make dev/is-changed.py to return true it it fails [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/26 23:58:45 UTC, 2 replies.
- [PR] [SPARK-48340][PYTHON][FOLLOWUP] Support TimestampNTZ infer schema miss prefer_timestamp_ntz [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2024/05/27 02:50:54 UTC, 7 replies.
- Re: [PR] [SPARK-47579][CORE][PART4] Migrate logInfo with variables to structured logging framework [spark] - posted by "zeotuan (via GitHub)" <gi...@apache.org> on 2024/05/27 03:09:42 UTC, 12 replies.
- [PR] [SPARK-48425][PYTHON][BUILD] Replaces pyspark-connect to pyspark_connect for its output name [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/27 03:32:58 UTC, 2 replies.
- [PR] [MINOR][INFRA] Make pure Python build compatible with other setuptools versions [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/27 03:41:27 UTC, 2 replies.
- [PR] [SPARK-48168][SQL][FOLLOWUP] Fix bitwise shifting operator precedence [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/27 03:56:45 UTC, 0 replies.
- [PR] [SPARK-48427][BUILD] Upgrade `scala-parser-combinators` to 2.4 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/05/27 05:30:47 UTC, 2 replies.
- Re: [PR] [SPARK-45857][SQL] Enforce the error classes in sub-classes of `AnalysisException` [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/05/27 05:58:09 UTC, 0 replies.
- Re: [PR] [SPARK-48168][SQL][FOLLOWUP] Fix bitwise shifting operator's precedence [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/27 06:17:39 UTC, 3 replies.
- [PR] [Only Test] sbt-coursier [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/27 07:22:34 UTC, 1 replies.
- [PR] SPARK-48428: Fix IllegalStateException in NestedColumnAliasing [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2024/05/27 08:42:36 UTC, 1 replies.
- [PR] [SPARK-48426][SQL][DOCS] Add Documentation for SQL Operator Precedence [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/27 09:32:10 UTC, 7 replies.
- Re: [PR] [SPARK-39743][SQL] Unable to set zstd compression level while writing… [spark] - posted by "tongwaiazuma (via GitHub)" <gi...@apache.org> on 2024/05/27 09:39:43 UTC, 1 replies.
- [PR] [SPARK-48430] Fix map value extraction when map contains collated strings [spark] - posted by "nikolamand-db (via GitHub)" <gi...@apache.org> on 2024/05/27 14:05:18 UTC, 0 replies.
- [PR] [SPARK-48432][SQL] Avoid unboxing integers in UnivocityParser [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/05/27 14:58:49 UTC, 2 replies.
- [PR] [SPARK-48431] Do not forward predicates on collated columns to file readers [spark] - posted by "olaky (via GitHub)" <gi...@apache.org> on 2024/05/27 15:06:26 UTC, 1 replies.
- [PR] [WIP][SQL] Fix StringTranslate behaviour for non-UTF8_BINARY collations [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/27 20:33:35 UTC, 0 replies.
- [PR] [WIP][SQL] Fix StringTrim behaviour for non-UTF8_BINARY collations [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/27 20:45:40 UTC, 3 replies.
- Re: [PR] [SPARK-48410][SQL] Fix InitCap expression for UTF8_BINARY_LCASE & ICU collations [spark] - posted by "mkaravel (via GitHub)" <gi...@apache.org> on 2024/05/27 23:16:25 UTC, 5 replies.
- [PR] [SPARK-48433][BUILD] Upgrade `checkstyle` to 10.17.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/27 23:39:11 UTC, 0 replies.
- [PR] [SPARK-48434][PYTHON][CONNECT] Make `printSchema` use the cached schema [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/28 01:57:00 UTC, 3 replies.
- [PR] Regenerate the golden file for 'int8.sql' for Java 21 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/05/28 03:53:41 UTC, 0 replies.
- Re: [PR] [SPARK-48168][SQL][TESTS][FOLLOWUP] Regenerate the golden file for `int8.sql` for Java 21 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/05/28 04:08:44 UTC, 4 replies.
- [PR] Test grpc 1.64.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/05/28 05:34:43 UTC, 3 replies.
- Re: [PR] [SPARK-41049][SQL][FOLLOW-UP] Mark map related expressions as stateful expressions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/28 05:39:54 UTC, 5 replies.
- [PR] [SPARK-48168][SQL][FOLLOWUP] Match expression strings of shift operators & functions with user inputs [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/28 05:57:08 UTC, 2 replies.
- [PR] [SPARK-48425][INFRA][FOLLOWUP] copy spark connect release tarballs [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/28 06:42:18 UTC, 3 replies.
- Re: [PR] [SPARK-48431][SQL] Do not forward predicates on collated columns to file readers [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/28 07:07:13 UTC, 6 replies.
- [PR] [SPARK-47258][SQL] Assign names to error classes _LEGACY_ERROR_TEMP_127[0-5] [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/05/28 07:14:02 UTC, 7 replies.
- [PR] [SPARK-48425][INFRA][FOLLOWUP] Do not copy the base spark folder [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/28 07:47:27 UTC, 2 replies.
- [PR] [WIP][SPARK-48435][SQL] UNICODE collation should not support binary equality [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/28 08:28:26 UTC, 5 replies.
- [PR] [SPARK-48436][SQL][TESTS] Use `c.m.c.j.Driver` instead of `c.m.j.Driver` in `MySQLNamespaceSuite` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/28 09:22:36 UTC, 3 replies.
- [PR] [SPARK-48437][SQL] Improve IsolatedClientLoader [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/28 11:38:00 UTC, 3 replies.
- [PR] [SPARK-48438][PS][CONNECT] Directly use the parent column class [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/28 11:43:08 UTC, 3 replies.
- [PR] [SPARK-47361][SQL] Derby: Calculate suitable precision and scale for DECIMAL type [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/28 12:46:02 UTC, 3 replies.
- Re: [PR] [SPARK-48008][1/2] Support UDAFs in Spark Connect [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/05/28 15:04:04 UTC, 8 replies.
- Re: [PR] [SPARK-48392][CORE] Also load `spark-defaults.conf` when provided `--properties-file` [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2024/05/28 15:06:28 UTC, 25 replies.
- Re: [PR] [SPARK-23015][WINDOWS] Fix bug in Windows where starting multiple Spark instances within the same second causes a failure [spark] - posted by "Rafnel (via GitHub)" <gi...@apache.org> on 2024/05/28 15:40:37 UTC, 2 replies.
- [PR] [SPARK-47260][SQL] Assign name to error class _LEGACY_ERROR_TEMP_3250 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/05/28 16:39:48 UTC, 3 replies.
- Re: [PR] [SPARK-48430][SQL] Fix map value extraction when map contains collated strings [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/28 16:53:02 UTC, 2 replies.
- Re: [PR] [SPARK-48383][SS] In KafkaOffsetReader, partition mismatch should not be an assertion [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2024/05/28 17:19:50 UTC, 0 replies.
- [PR] [SPARK-48444] Use withSQLConf in tests: Refactor SQLQuerySuite [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2024/05/28 20:39:47 UTC, 1 replies.
- [PR] [SPARK-48442] [PYSPARK] Add parenthesis to awaitTermination [spark] - posted by "riyaverm-db (via GitHub)" <gi...@apache.org> on 2024/05/28 21:16:44 UTC, 0 replies.
- [PR] [SPARK-48445][SQL] Don't inline UDFs with expensive children [spark] - posted by "kelvinjian-db (via GitHub)" <gi...@apache.org> on 2024/05/28 22:05:24 UTC, 5 replies.
- Re: [PR] [WIP] [SPARK-48442] [PYSPARK] Add parenthesis to awaitTermination [spark] - posted by "riyaverm-db (via GitHub)" <gi...@apache.org> on 2024/05/28 22:32:16 UTC, 0 replies.
- Re: [PR] [SPARK-47037] ] Fix AliasAwareOutputExpression outputPartitioning [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/29 00:20:23 UTC, 1 replies.
- Re: [PR] [SPARK-48292][CORE] Revert [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort stage when committed file not consistent with task status [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2024/05/29 02:00:51 UTC, 3 replies.
- [PR] [SPARK-48449][SQL] Using `getPropertyInfo` instead of `reflection` to obtain `JAAS application name` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/29 02:43:38 UTC, 1 replies.
- Re: [PR] [SPARK-48444][SQL][TESTS] Use withSQLConf in tests: Refactor SQLQuerySuite [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/29 03:47:29 UTC, 11 replies.
- Re: [PR] [SPARK-48426][SQL][DOCS] Add documentation for SQL operator precedence [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/29 04:09:19 UTC, 3 replies.
- [PR] [SPARK-48392][CORE][FOLLOWUP] Add info to 4.0 migration guide [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2024/05/29 05:12:50 UTC, 20 replies.
- [PR] [WIP] Simplify the implementation of `Utils#isG1GC` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/05/29 06:23:30 UTC, 2 replies.
- [PR] [MINOR][PS] Fallback code clean up [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/29 08:29:49 UTC, 3 replies.
- [PR] [SPARK-48454][PS] Directly use the parent dataframe class [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/29 09:02:02 UTC, 3 replies.
- [PR] [SQL][TESTS] Replace integrationtest deprecated [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/29 09:30:36 UTC, 0 replies.
- [PR] [MINOR][DOCS] Fix usage doc for mod [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/29 09:36:50 UTC, 2 replies.
- [PR] [WIP][SPARK-47415][SQL] Add collation support for Levenshtein expression [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/29 09:47:03 UTC, 0 replies.
- [PR] [SPARK-48459][CONNECT][PYTHON] Implement DataFrameQueryContext in Spark Connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/29 11:02:33 UTC, 4 replies.
- [PR] Revert "[SPARK-48322][SPARK-42965][SQL][CONNECT][PYTHON] Drop internal metadata in `DataFrame.schema`" [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/29 12:42:55 UTC, 1 replies.
- [PR] [SPARK-48447][SS] Check state store provider class before invoking the constructor [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2024/05/29 17:25:33 UTC, 13 replies.
- Re: [PR] [SPARK-47977] DateTimeUtils.timestampDiff and DateTimeUtils.timestampAdd should not throw INTERNAL_ERROR exception [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/05/29 17:36:39 UTC, 3 replies.
- [PR] [SPARK-48462][SQL][Tests] Use withSQLConf in tests: Refactor HiveQuerySuite and HiveTableScanSuite [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2024/05/29 17:47:34 UTC, 3 replies.
- [PR] [SPARK-48461][SQL] Replace NullPointerExceptions with error class in AssertNotNull expression [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/05/29 18:19:39 UTC, 7 replies.
- [PR] [SPARK-48273][SQL][FOLLOWUP] Explicitly create non-Hive table in identifier-clause.sql [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/29 18:46:30 UTC, 4 replies.
- [PR] [3.5][SPARK-41049][SQL][FOLLOW-UP] stateful expressions test uses different pretty name [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2024/05/29 19:19:50 UTC, 2 replies.
- [PR] [SPARK-48464][SQL][Tests] Use withSQLConf in tests: Refactor SQLConfSuite and StatisticsSuite [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2024/05/29 19:47:04 UTC, 0 replies.
- [PR] [SPARK-48446][SS][DOC] Update SS doc of dropDuplicates to use the right syntax [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2024/05/29 20:18:55 UTC, 0 replies.
- Re: [PR] [SPARK-48318][SQL] Enable hash join support for all collations (complex types) [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/29 20:33:33 UTC, 10 replies.
- Re: [PR] [SPARK-48446][SS][DOCS] Update SS doc of dropDuplicates to use the right syntax [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2024/05/29 21:31:14 UTC, 6 replies.
- Re: [PR] [SPARK-48442][PYTHON][TESTS] Add parenthesis to awaitTermination [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/29 23:22:21 UTC, 1 replies.
- [PR] [SPARK-48467][BUILD] Upgrade Maven to 3.9.7 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/29 23:23:20 UTC, 3 replies.
- Re: [PR] [SPARK-48469][SQL][TESTS] Replace `deprecated` method in `integrationtest` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/29 23:35:24 UTC, 2 replies.
- Re: [PR] [SPARK-48012][SQL] SPJ: Support Transfrom Expressions for One Side Shuffle [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2024/05/29 23:40:45 UTC, 4 replies.
- [PR] [SPARK-48468] Add LogicalQueryStage interface in catalyst [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2024/05/29 23:46:08 UTC, 2 replies.
- Re: [PR] [SPARK-48464][SQL][TESTS] Use withSQLConf in tests: Refactor SQLConfSuite and StatisticsSuite [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2024/05/30 00:12:45 UTC, 2 replies.
- Re: [PR] [SPARK-41049][SQL][FOLLOW-UP][3.5] stateful expressions test uses different pretty name [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/30 00:15:12 UTC, 1 replies.
- [PR] [SPARK-48273][SQL][FOLLOWUP] Update golden file [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/30 03:47:06 UTC, 2 replies.
- [PR] [WIP][SPARK-48280][SQL] Add Expression Walker for Testing [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/05/30 07:25:49 UTC, 0 replies.
- [PR] [SPARK-48471][CORE] Improve documentation and usage guide for history server [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/30 07:38:09 UTC, 6 replies.
- [PR] [WIP][SPARK-48172][SQL] Fix escaping issues in JDBCDialects [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/05/30 07:56:25 UTC, 7 replies.
- [PR] Revert "[SPARK-48415][PYTHON] Refactor TypeName to support parameterized datatypes" [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/05/30 08:19:48 UTC, 2 replies.
- [PR] [SPARK-43301][CORE][SHUFFLE] BlockStoreClient getHostLocalDirs RPC supports IOException retry [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/05/30 10:02:15 UTC, 1 replies.
- [PR] [SPARK-42252][CORE] Add `spark.shuffle.localDisk.file.output.buffer` and deprecate `spark.shuffle.unsafe.file.output.buffer` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/05/30 11:42:00 UTC, 2 replies.
- [PR] [FOLLOWUP][SPARK-48172][SQL] Fix escaping issues in JDBCDialects [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/05/30 13:03:51 UTC, 2 replies.
- [PR] [SPARK-48474][CORE] Fix the class name of the log in `SparkSubmitArguments` & `SparkSubmit` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/30 13:56:16 UTC, 3 replies.
- [PR] [SPARK-48475][PYTHON] Optimize _get_jvm_function in PySpark. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/05/30 14:56:56 UTC, 5 replies.
- [PR] [PARK-48476] fix NPE error message for null delmiter csv [spark] - posted by "milastdbx (via GitHub)" <gi...@apache.org> on 2024/05/30 15:25:19 UTC, 0 replies.
- Re: [PR] [WIP][SQL] Enable hash join support for non-binary collations [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/30 17:08:03 UTC, 0 replies.
- [PR] [SPARK][SQL][MINOR] Fix: V2Write use the same TaskAttemptId for different task attempts [spark] - posted by "jackylee-ch (via GitHub)" <gi...@apache.org> on 2024/05/30 17:09:20 UTC, 8 replies.
- [PR] [SPARK-48477][SQL][TESTS] Use withSQLConf in tests: Refactor CollationSuite, CoalesceShufflePartitionsSuite, SQLExecutionSuite, HivePlanTest. [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2024/05/30 17:46:35 UTC, 0 replies.
- [PR] [SPARK-48468] Add LogicalQueryStage interface in catalyst _2 [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2024/05/30 18:24:17 UTC, 1 replies.
- Re: [PR] [SPARK-48477][SQL][TESTS] Use withSQLConf in tests: Refactor CollationSuite, CoalesceShufflePartitionsSuite, SQLExecutionSuite [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2024/05/30 20:46:55 UTC, 2 replies.
- [PR] [SPARK-48465] Avoid no-op empty relation propagation [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2024/05/30 21:38:11 UTC, 1 replies.
- [PR] [SPARK-47578][R] Migrate RPackageUtils with variables to structured logging framework [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/05/30 21:59:26 UTC, 5 replies.
- [PR] [SPARK-48479][SQL] Support creating SQL functions in parser [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/05/30 23:31:29 UTC, 0 replies.
- Re: [PR] [SPARK-46710][SQL] Clean up the broadcast data when sql execution ends [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/31 00:19:23 UTC, 0 replies.
- Re: [PR] [SPARK-46097][SQL] Push down limit 1 through Union and Aggregate [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/31 00:19:24 UTC, 0 replies.
- Re: [PR] [SPARK-48465][SQL] Avoid no-op empty relation propagation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/05/31 00:59:40 UTC, 2 replies.
- Re: [PR] [SPARK-47496][SQL] Java SPI Support for dynamic JDBC dialect registering [spark] - posted by "smileyboy2019 (via GitHub)" <gi...@apache.org> on 2024/05/31 02:20:35 UTC, 0 replies.
- Re: [PR] [SPARK-48476] fix NPE error message for null delmiter csv [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/31 02:51:01 UTC, 0 replies.
- [PR] [SPARK-48482][PYTHON] dropDuplicates and dropDuplicatesWIthinWatermark should accept variable length args [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/05/31 03:34:10 UTC, 2 replies.
- Re: [PR] [SPARK-48484][SQL] Fix: V2Write use the same TaskAttemptId for different task attempts [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/05/31 05:04:19 UTC, 9 replies.
- Re: [PR] [SPARK-48172][SQL][FOLLOWUP] Fix escaping issues in JDBCDialects [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/05/31 05:16:26 UTC, 2 replies.
- Re: [PR] [SPARK-48392][CORE][FOLLOWUP] Add `--extra-properties-files` flag to decide whether to load `spark-defaults.conf` [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2024/05/31 06:05:10 UTC, 7 replies.
- Re: [PR] [SPARK-38506][SQL] Push partial aggregation through join [spark] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2024/05/31 07:08:46 UTC, 0 replies.
- [PR] [SPARK-48476][SQL] Add a new`INVALID_DELIMITER_VALUE.NULL_VALUE` error class to replace NPE [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/05/31 07:32:11 UTC, 2 replies.
- [PR] [WIP][SPARK-48485][CONNECT][SS] Support interruptTag and interruptAll in streaming queries [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/05/31 07:49:50 UTC, 1 replies.
- [PR] [SPARK-48481][SQL][SS] Do not apply OptimizeOneRowPlan against streaming Dataset [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/05/31 09:07:02 UTC, 3 replies.
- Re: [PR] [SPARK-48476][SQL] fix NPE error message for null delmiter csv [spark] - posted by "milastdbx (via GitHub)" <gi...@apache.org> on 2024/05/31 09:07:34 UTC, 2 replies.
- [PR] [SPARK-48487][INFRA] Update License & Notice according to the dependency changes [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/05/31 10:04:29 UTC, 2 replies.
- [PR] [SPARK-48488][CORE] Restore the original logic of methods `log[info|warning|error]` in `SparkSubmit` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/31 12:02:24 UTC, 3 replies.
- Re: [PR] [SPARK-47690][SQL] Enable hash aggregation support for all collations (StringType) [spark] - posted by "dbatomic (via GitHub)" <gi...@apache.org> on 2024/05/31 12:37:17 UTC, 8 replies.
- [PR] [SPARK-48489][SQL] Throw a better, user-facing error when reading illegal schema from text Data Source [spark] - posted by "stefanbuk-db (via GitHub)" <gi...@apache.org> on 2024/05/31 12:43:11 UTC, 0 replies.
- Re: [PR] [SPARK-45373][SQL] Minimize partitions fetch call to HiveMetaStoreLayer [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/05/31 13:24:58 UTC, 0 replies.
- Re: [PR] [DRAFT][SQL] Hash aggregate support for strings with collation [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/05/31 13:57:36 UTC, 0 replies.
- [PR] [SPARK-48490][CORE] Unescapes any literals for message of MessageWithContext [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/05/31 14:44:56 UTC, 6 replies.
- [PR] Remove TimeMode None from TransformWithState. [spark] - posted by "sahnib (via GitHub)" <gi...@apache.org> on 2024/05/31 19:34:16 UTC, 0 replies.
- [PR] [SPARK-48493][PYTHON] Enhance Python Datasource Reader with direct Arrow Batch support for improved performance [spark] - posted by "LucaCanali (via GitHub)" <gi...@apache.org> on 2024/05/31 20:13:19 UTC, 0 replies.
- [PR] [SPARK-48494][BUILD] Update `airlift:aircompressor` to 0.27 [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2024/05/31 20:37:40 UTC, 0 replies.
- [PR] [SPARK-48491][SQL][TESTS] HiveWindowFunctionQuerySuite needs set configs in beforeAll and unset in afterAll [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2024/05/31 21:47:28 UTC, 0 replies.
- [PR] [SPARK-48496][CORE] [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2024/05/31 21:55:30 UTC, 0 replies.
- [PR] [SPARK-48466] Create dedicated node for EmptyRelation in AQE [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2024/05/31 22:04:38 UTC, 0 replies.
- [PR] [SPARK-45891] Describe shredding scheme for Variant [spark] - posted by "cashmand (via GitHub)" <gi...@apache.org> on 2024/05/31 22:04:43 UTC, 0 replies.