reviews@spark.apache.org, 2024-04

You are viewing a plain text version of this content. The canonical link for it is here.

- Re: [PR] [SPARK-46812][CONNECT][PYTHON] Make mapInPandas / mapInArrow support ResourceProfile [spark] - posted by "wbo4958 (via GitHub)" <gi...@apache.org> on 2024/04/01 00:30:59 UTC, 5 replies.
- Re: [PR] [SPARK-47646][SQL] Make try_to_number return NULL for malformed input [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/01 01:11:37 UTC, 1 replies.
- Re: [PR] [SPARK-47646][SQL][FOLLOWUP][3.4] Replace non-existing try_to_number function with TryToNumber [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/01 01:11:54 UTC, 0 replies.
- Re: [PR] [SPARK-47458][CORE] Fix the problem with calculating the maximum concurrent tasks for the barrier stage [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2024/04/01 02:39:38 UTC, 2 replies.
- Re: [PR] [SPARK-47141][CORE] Support enabling migration of shuffle data directly to external storage using config parameter. [spark] - posted by "maheshk114 (via GitHub)" <gi...@apache.org> on 2024/04/01 03:27:09 UTC, 4 replies.
- [PR] [SPARK-47662][SQL] Add User Document for Mapping Spark SQL Data Types to MySQL [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/01 04:03:32 UTC, 0 replies.
- Re: [PR] [SPARK-47662][SQL][DOCS] Add User Document for Mapping Spark SQL Data Types to MySQL [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/01 04:19:16 UTC, 2 replies.
- Re: [PR] [SPARK-47645][BUILD][CORE][SQL][YARN] Make Spark build with `-release` instead of `-target` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/01 04:27:37 UTC, 7 replies.
- [PR] [SPARK-47664][PYTHON][CONNECT] Validate the column name with cached schema [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/01 05:17:15 UTC, 4 replies.
- Re: [PR] [SPARK-45022][SQL] Provide context for dataset API errors [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/04/01 06:36:47 UTC, 1 replies.
- [PR] [SPARK-47665][SQL] Use SMALLINT to Write ShortType to MYSQL [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/01 06:42:02 UTC, 3 replies.
- Re: [PR] [SPARK-47654][INFRA] Structured logging framework: support log concatenation [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/04/01 07:15:00 UTC, 1 replies.
- Re: [PR] [SPARK-47431][SQL][FOLLOWUP] Do not access SQLConf in Literal.apply [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/01 07:18:26 UTC, 1 replies.
- Re: [PR] [SPARK-47634][SQL] Add legacy support for disabling map key normalization [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/01 07:22:54 UTC, 6 replies.
- Re: [PR] [SPARK-47210][SQL] Addition of implicit casting without indeterminate support [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/04/01 07:24:59 UTC, 56 replies.
- Re: [PR] [SPARK-47649][SQL] Make the parameter `inputs` of the function `[csv|parquet|orc|json|text|xml](paths: String*)` non empty [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/01 07:27:04 UTC, 16 replies.
- Re: [PR] [SPARK-47551][SQL] Add variant_get expression. [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/01 07:29:04 UTC, 11 replies.
- Re: [PR] [SPARK-47566][SQL] Support SUBSTRING_INDEX function to work with collated strings [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2024/04/01 07:35:09 UTC, 9 replies.
- Re: [PR] [SPARK-45593][BUILD][3.5] Correct relocation connect guava dependency [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/04/01 07:35:48 UTC, 1 replies.
- Re: [PR] [SPARK-47569][SQL] Disallow comparing variant. [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/01 07:41:15 UTC, 1 replies.
- Re: [PR] [SPARK-47639] Support codegen for json_tuple. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/04/01 07:47:59 UTC, 13 replies.
- Re: [PR] [SPARK-44021][SQL] Add spark.sql.files.maxPartitionNum [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/04/01 08:03:27 UTC, 0 replies.
- Re: [PR] [SPARK-47081][CONNECT] Support Query Execution Progress [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/01 08:14:51 UTC, 37 replies.
- [PR] [SPARK-47666][SQL] Fix NPE when reading mysql bit array as LongType [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/01 08:28:37 UTC, 4 replies.
- [PR] [SPARK-47567][SQL] Support LOCATE function to work with collated strings [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2024/04/01 10:04:42 UTC, 32 replies.
- [PR] [SPARK-47666][SQL][3.5] Fix NPE when reading mysql bit array as LongType [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/01 10:22:50 UTC, 3 replies.
- [PR] [SPARK-47666][SQL][3.4] Fix NPE when reading mysql bit array as LongType [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/01 10:27:21 UTC, 4 replies.
- Re: [PR] [SPARK-47411][SQL][COLLATION] String function support: instr & find_in_set [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/04/01 10:56:26 UTC, 3 replies.
- [PR] [SPARK-47663][CORE][TESTS] add end to end test for task limiting according to different cpu and gpu configurations [spark] - posted by "wbo4958 (via GitHub)" <gi...@apache.org> on 2024/04/01 11:58:55 UTC, 7 replies.
- [PR] [WIP] improve StaticInvoke [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/01 12:06:19 UTC, 0 replies.
- [PR] [SPARK-47669][SQL][CONNECT][PYTHON] Add `try_cast` function in DataFrame APIs [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/01 12:07:21 UTC, 4 replies.
- Re: [PR] [SPARK-47476][SQL] Support REPLACE function to work with collated strings [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/04/01 12:12:57 UTC, 16 replies.
- Re: [PR] [SPARK-47409][SQL] Add support for collation for StringTrim type of functions/expressions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/04/01 13:05:51 UTC, 68 replies.
- Re: [PR] [SPARK-46840][SQL][TESTS] Add `CollationBenchmark` [spark] - posted by "GideonPotok (via GitHub)" <gi...@apache.org> on 2024/04/01 13:27:30 UTC, 7 replies.
- Re: [PR] [SPARK-47574][INFRA] Introduce Structured Logging Framework [spark] - posted by "tgravescs (via GitHub)" <gi...@apache.org> on 2024/04/01 13:34:13 UTC, 1 replies.
- Re: [PR] [SPARK-47575][INFRA] Implement logWarning API in structured logging framework [spark] - posted by "tgravescs (via GitHub)" <gi...@apache.org> on 2024/04/01 13:51:00 UTC, 3 replies.
- Re: [PR] [SPARK-46810][DOCS] Align error class terminology with SQL standard [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2024/04/01 14:23:53 UTC, 12 replies.
- Re: [PR] [WIP][SPARK-24815] [CORE] Trigger Interval based DRA for Structured Streaming [spark] - posted by "tgravescs (via GitHub)" <gi...@apache.org> on 2024/04/01 14:32:38 UTC, 18 replies.
- [PR] [WIP] Do not wrap query execution error during data writing [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/01 15:52:37 UTC, 0 replies.
- Re: [PR] [SPARK-47653][SS] Add support for negative numeric types and range scan key encoder [spark] - posted by "sahnib (via GitHub)" <gi...@apache.org> on 2024/04/01 17:06:25 UTC, 18 replies.
- Re: [PR] [SPARK-47659][CORE][TESTS] Improve `*LoggingSuite*` [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/04/01 17:16:33 UTC, 1 replies.
- Re: [PR] [SPARK-47558][SS] State TTL support for ValueState [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/04/01 17:46:15 UTC, 100 replies.
- [PR] [SPARK-47674][CORE] Enable `spark.metrics.appStatusSource.enabled` by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/01 17:59:47 UTC, 3 replies.
- Re: [PR] [SPARK-47655][SS] Integrate timer with Initial State handling for state-v2 [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/04/01 18:21:04 UTC, 5 replies.
- Re: [PR] [SPARK-47643][SS][PYTHON] Add pyspark test for python streaming source [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2024/04/01 18:55:11 UTC, 3 replies.
- Re: [PR] [SPARK-47413][SQL] [WIP - DONT REVIEW] - add support to substr for collations [spark] - posted by "GideonPotok (via GitHub)" <gi...@apache.org> on 2024/04/01 20:36:44 UTC, 6 replies.
- [PR] [SPARK-47675][BUILD][K8S] Remove `aws.java.sdk.v2.version` property in `pom.xml` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/01 20:40:14 UTC, 0 replies.
- Re: [PR] [SPARK-47318][CORE] Adds HKDF round to AuthEngine key derivation to follow standard KEX practices [spark] - posted by "sweisdb (via GitHub)" <gi...@apache.org> on 2024/04/01 21:34:14 UTC, 32 replies.
- Re: [PR] [WIP][SPARK-47556] Add unique hash to Application ID [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/01 22:01:32 UTC, 1 replies.
- Re: [PR] [SPARK-47675][K8S][TESTS] Use AWS SDK v2 `2.23.19` in K8s IT [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/01 22:10:16 UTC, 4 replies.
- [PR] [SPARK-47676][BUILD] Clean up the removed `VersionsSuite` references [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/01 22:49:22 UTC, 4 replies.
- [PR] [SPARK-45265][SQL] Supporting Hive 4.0 Metastore [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/01 23:05:29 UTC, 8 replies.
- [PR] [SPARK-47672][SQL] Avoid double eval from filter pushDown [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2024/04/02 00:00:53 UTC, 4 replies.
- [PR] [SHUFFLE] [SPARK-47678] Check `spark.shuffle.readHostLocalDisk` when reading shuffle blocks [spark] - posted by "hiboyang (via GitHub)" <gi...@apache.org> on 2024/04/02 00:42:59 UTC, 0 replies.
- [PR] [SPARK-47679][SQL] Use `HiveConf.getConfVars` or Hive conf names directly [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/02 01:11:10 UTC, 5 replies.
- [PR] [SPARK-47680][SQL] Add variant_explode expression. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/04/02 02:29:25 UTC, 13 replies.
- [PR] [SPARK-47680][SQL] Add variant_schema expression. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/04/02 02:34:26 UTC, 0 replies.
- [PR] [SPARK-47682][SQL] Support cast from variant. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/04/02 02:43:10 UTC, 7 replies.
- [PR] [SPARK-47602][CORE] Resource managers: Migrate logError with variables to structured logging framework [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/02 03:16:41 UTC, 28 replies.
- [PR] [SPARK-47664][PYTHON][CONNECT][TESTS][FOLLOW-UP] Add more tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/02 03:45:34 UTC, 2 replies.
- [PR] [SPARK-47684][SQL] Postgres: Map length unspecified bpchar to StringType [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/02 04:57:10 UTC, 15 replies.
- Re: [PR] [SPARK-47669][SQL][CONNECT][PYTHON] Add `Column.try_cast` [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/04/02 05:02:24 UTC, 7 replies.
- [PR] [SPARK-47685][SQL] Restore the support for `Stream` type in `Dataset#groupBy` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/04/02 05:44:14 UTC, 6 replies.
- [PR] [SPARK-47686][SQL][TESTS] Use `=!=` instead of `!==` in `JoinHintSuite` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/04/02 05:54:24 UTC, 7 replies.
- Re: [PR] [SPARK-47689][SQL] Do not wrap query execution error during data writing [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/02 07:13:27 UTC, 2 replies.
- [PR] [SPARK-47688][CORE] Support concatenation `normal variables` and `MDC` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/02 07:36:04 UTC, 1 replies.
- [PR] [SPARK-47687][SQL] When creating a table through ThriftServer, set the table owner to the connected user [spark] - posted by "isnker (via GitHub)" <gi...@apache.org> on 2024/04/02 07:40:03 UTC, 0 replies.
- Re: [PR] [SPARK-47545][CONNECT] Dataset `observe` support for the Scala client [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/04/02 08:41:57 UTC, 37 replies.
- [PR] [SPARK-47691][SQL] Postgres: Support multi dimensional array on the write side [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/02 10:05:55 UTC, 3 replies.
- [PR] [SPARK-47693][SQL] Add optimization for lowercase comparison of UTF8String used in UTF8_BINARY_LCASE collation [spark] - posted by "nikolamand-db (via GitHub)" <gi...@apache.org> on 2024/04/02 10:32:02 UTC, 20 replies.
- Re: [PR] [SPARK-47688][CORE] Support `three` types of the log `concatenation` in the `structured logging framework` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/02 11:40:21 UTC, 2 replies.
- [PR] [WIP] Refactor the implementation of `SparkDateTimeUtils#toJavaDate` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/04/02 11:50:20 UTC, 0 replies.
- Re: [PR] [WIP][SQL] Refactor the implementation of `SparkDateTimeUtils#toJavaDate` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/04/02 11:58:13 UTC, 1 replies.
- [PR] [MINOR] fix PostgresIntegrationSuite [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/02 11:58:46 UTC, 0 replies.
- Re: [PR] [MINOR] Fix PostgresIntegrationSuite [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/02 12:03:46 UTC, 1 replies.
- Re: [PR] [SPARK-47684][SQL][FOLLOWUP] Fix PostgresIntegrationSuite [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/02 12:31:52 UTC, 2 replies.
- [PR] [SPARK-47692][SQL] Addition of priority flag to StringType [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/04/02 12:33:04 UTC, 23 replies.
- Re: [PR] [SPARK-47274][PYTHON][SQL] Provide more useful context for PySpark DataFrame API errors [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/04/02 13:01:44 UTC, 77 replies.
- [PR] [SPARK-47359][SQL] Support TRANSLATE function to work with collated strings [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2024/04/02 14:47:57 UTC, 19 replies.
- Re: [PR] [SPARK-23015][WINDOWS] Fix bug in Windows where starting multiple Spark instances within the same second causes a failure [spark] - posted by "Rafnel (via GitHub)" <gi...@apache.org> on 2024/04/02 16:22:00 UTC, 3 replies.
- Re: [PR] [SPARK-47688][CORE] Support `three` methods of the log `concatenation` in the `structured logging framework` [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/04/02 16:26:26 UTC, 4 replies.
- [PR] [SPARK-47695][BUILD] Update AWS SDK v2 to 2.24.6 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/02 16:58:57 UTC, 0 replies.
- Re: [PR] [SPARK-47678][CORE] Check `spark.shuffle.readHostLocalDisk` when reading shuffle blocks [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2024/04/02 17:38:36 UTC, 5 replies.
- [PR] [SPARK-47696][SQL] try_to_timestamp should handle SparkUpgradeException [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/04/02 18:00:33 UTC, 10 replies.
- Re: [PR] [SPARK-47695][BUILD] Upgrade AWS SDK v2 to 2.24.6 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/02 18:04:43 UTC, 1 replies.
- Re: [PR] [SPARK-47289][SQL] Allow extensions to log extended information in explain plan [spark] - posted by "parthchandra (via GitHub)" <gi...@apache.org> on 2024/04/02 18:21:59 UTC, 22 replies.
- Re: [PR] [SPARK-47094][SQL] SPJ : Dynamically rebalance number of buckets when they are not equal [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2024/04/02 18:23:41 UTC, 4 replies.
- [PR] [SPARK-47697][INFRA] Add Scala style check for invalid MDC usage [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/04/02 18:25:15 UTC, 8 replies.
- Re: [PR] [SPARK-47148][SQL] Avoid to materialize AQE ExchangeQueryStageExec on the cancellation [spark] - posted by "erenavsarogullari (via GitHub)" <gi...@apache.org> on 2024/04/02 18:39:16 UTC, 14 replies.
- Re: [PR] [SPARK-47541][SQL] Collated strings in complex types supporting operations reverse, array_join, concat, map [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/04/02 19:46:46 UTC, 8 replies.
- [PR] [SPARK-47699][BUILD] Upgrade `gcs-connector` to 2.2.21 and add a note for 3.0.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/02 19:57:15 UTC, 3 replies.
- [PR] [SPARK-47700][SQL] Fix formatting of error messages with treeNode [spark] - posted by "jchen5 (via GitHub)" <gi...@apache.org> on 2024/04/02 20:25:23 UTC, 3 replies.
- [PR] [SPARK-47366] Add VariantVal for PySpark [spark] - posted by "gene-db (via GitHub)" <gi...@apache.org> on 2024/04/02 21:37:16 UTC, 0 replies.
- [PR] Operator 1.0.0-alpha [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/04/02 23:02:57 UTC, 73 replies.
- Re: [PR] [SPARK-47366][PYTHON] Add VariantVal for PySpark [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/03 00:14:06 UTC, 11 replies.
- Re: [PR] [WIP][SPARK-41811][PYTHON][CONNECT] Implement `SQLStringFormatter` with `WithRelations` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/03 00:45:10 UTC, 4 replies.
- Re: [PR] [SPARK-47683][PYTHON][BUILD] Decouple PySpark core API to pyspark.core package [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/03 00:54:02 UTC, 7 replies.
- Re: [PR] [SPARK-47681][SQL] Add schema_of_variant expression. [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/03 01:43:10 UTC, 11 replies.
- [PR] [SPARK-47701][SQL][TESTS] Postgres: Add test for complex types [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/03 03:19:01 UTC, 0 replies.
- [PR] [SPARK-47454][PYTHON][TESTS][FOLLOWUP] Skip `test_create_dataframe_from_pandas_with_day_time_interval` if pandas is not avaiable [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/03 03:24:27 UTC, 2 replies.
- Re: [PR] [SPARK-47628][SQL] Fix Postgres bit array issue 'Cannot cast to boolean' [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/03 03:40:41 UTC, 4 replies.
- [PR] [SPARK-47703][SQL] Modify the simpleString of DataSourceV2ScanRelation to distinguish it from DataSourceV2Relation [spark] - posted by "Zouxxyy (via GitHub)" <gi...@apache.org> on 2024/04/03 03:47:55 UTC, 4 replies.
- [PR] [SPARK-45733][PYTHON][TESTS][FOLLOWUP] Skip `pyspark.sql.tests.connect.client.test_client` if not should_test_connect [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/03 03:53:49 UTC, 4 replies.
- Re: [PR] [SPARK-47701][SQL][TESTS] Postgres: Add test for Composite and Range types [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/03 03:54:02 UTC, 2 replies.
- Re: [PR] [MINOR][DOCS] Update tags inside configuration.md tables [spark]

 - posted by "vadim (via GitHub)" <gi...@apache.org> on 2024/04/03 04:15:38 UTC, 1 replies.

- [PR] [WIP][SQL][CONNECT] Fix a self-join case [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/03 04:34:39 UTC, 1 replies.

- [PR] [SPARK-47452][INFRA][FOLLOWUP] Enforce to install `six` to Python 3.10 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/03 05:19:18 UTC, 0 replies.

- Re: [PR] [SPARK-47553][SS] Add Java support for transformWithState operator APIs [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/04/03 05:23:16 UTC, 5 replies.

- Re: [PR] [SPARK-47452][INFRA][FOLLOWUP] Enforce to install `six` to `Python 3.10` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/03 05:36:17 UTC, 2 replies.

- [PR] [SPARK-47704][SQL] JSON parsing fails with "java.lang.ClassCastException" when spark.sql.json.enablePartialResults is enabled [spark] - posted by "sadikovi (via GitHub)" <gi...@apache.org> on 2024/04/03 06:11:42 UTC, 4 replies.

- [PR] [SPARK-47577][Core][PART1] Migrate logError with variables to structured logging framework [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/04/03 06:11:56 UTC, 1 replies.

- [PR] [SPARK-43362][SQL][FOLLOWUP] Special handling of JSON type for MySQL … [spark] - posted by "beryllw (via GitHub)" <gi...@apache.org> on 2024/04/03 06:39:15 UTC, 3 replies.

- Re: [PR] [SPARK-47577][CORE][PART1] Migrate logError with variables to structured logging framework [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/04/03 06:48:06 UTC, 15 replies.

- Re: [PR] [MINOR][DOCS] replace `-formatted code with  tags inside configuration.md tables [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/03 07:09:20 UTC, 1 replies.

- [PR] [SPARK-47702][CORE] Remove Shuffle service endpoint from the locations list when RDD block is removed form a node. [spark] - posted by "maheshk114 (via GitHub)" <gi...@apache.org> on 2024/04/03 07:12:32 UTC, 1 replies.

- [PR] [SPARK-47598][CORE] MLLib: Migrate logError with variables to structured logging framework [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/03 07:19:46 UTC, 18 replies.

- [PR] [SPARK-47706][BUILD] Bump json4s 4.0.7 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/04/03 07:20:07 UTC, 35 replies.

- [PR] [SPARK-47230] [SQL] Push projection through Filter-> Generate [spark] - posted by "theHarpers (via GitHub)" <gi...@apache.org> on 2024/04/03 07:38:53 UTC, 5 replies.

- Re: [PR] [SPARK-47707][SQL] Special handling of JSON type for MySQL Connector/J 5.x [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/03 08:21:05 UTC, 2 replies.

- [PR] [SPARK-47708][CONNECT] Do not log gRPC exception to stderr in PySpark [spark] - posted by "nemanja-boric-databricks (via GitHub)" <gi...@apache.org> on 2024/04/03 08:22:17 UTC, 2 replies.

- [PR] Fix CVE 2018 17190 [spark] - posted by "amita-seal (via GitHub)" <gi...@apache.org> on 2024/04/03 08:44:07 UTC, 1 replies.

- [PR] [SPARK-47694][CONNECT] Make max message size configurable on the client side [spark] - posted by "dillitz (via GitHub)" <gi...@apache.org> on 2024/04/03 09:15:28 UTC, 1 replies.

- [PR] [SPARK-47709][BUILD] Upgrade tink to 1.13.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/04/03 09:21:25 UTC, 2 replies.

- [PR] [WIP] more accurate file path in TASK_WRITE_FAILED error [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/03 09:23:36 UTC, 0 replies.

- [PR] [SPARK-47710][SQL][DOCS] Postgres: Document Mapping Spark SQL Data Types from PostgreSQL [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/03 09:36:18 UTC, 1 replies.

- Re: [PR] [SPARK-47411][SQL] Support INSTR & FIND_IN_SET functions to work with collated strings [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/04/03 09:38:03 UTC, 54 replies.

- [PR] [WIP][SQL][CONNECT] Fix a self-join case with depth [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/03 09:41:38 UTC, 2 replies.

- [PR] [SPARK-47711][BUILD][TESTS] Parameterize JDBC Driver versions for docker integration tests [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/03 10:09:43 UTC, 1 replies.

- [PR] [SPARK-44050][K8S]add retry config when creating Kubernetes resources. [spark] - posted by "liangyouze (via GitHub)" <gi...@apache.org> on 2024/04/03 10:37:23 UTC, 7 replies.

- [PR] [SPARK-47602][CORE][K8S][FOLLOWUP] Improve structure logging for isExecutorIdleTimedOut [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/04/03 10:50:37 UTC, 18 replies.

- [PR] [SPARK-47712][CONNECT] Allow connect plugins to create and process Datasets [spark] - posted by "tomvanbussel (via GitHub)" <gi...@apache.org> on 2024/04/03 11:41:47 UTC, 6 replies.

- [PR] [SPARK-47580][SQL] SQL catalyst: Migrate logError with variables to structured logging framework [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/04/03 12:02:17 UTC, 17 replies.

- Re: [PR] [SPARK-47713][SQL][CONNECT] Fix a self-join failure [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/03 12:17:00 UTC, 14 replies.

- [PR] Revert: [SPARK-47040][CONNECT] Allow Spark Connect Server Script to wait [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/04/03 12:45:29 UTC, 21 replies.

- [PR] [SPARK-47714][SQL] Set spark.sql.legacy.timeParserPolicy to CORRECTED by default [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/03 12:46:34 UTC, 5 replies.

- [PR] [SPARK-47715][BUILD][STS] Upgrade hive-service-rpc 4.0.0 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/04/03 13:41:00 UTC, 2 replies.

- [PR] [SPARK-47716][SQL] Deflake SQLQueryTestSuite semantic sort test case [spark] - posted by "jchen5 (via GitHub)" <gi...@apache.org> on 2024/04/03 14:10:03 UTC, 1 replies.

- [PR] [SPARK-47297][SQL] Add collations support to split regex expression [spark] - posted by "nikolamand-db (via GitHub)" <gi...@apache.org> on 2024/04/03 14:39:45 UTC, 30 replies.

- [PR] [SPARK-47705][INFRA] Sort LogKey alphabetically and build a test to ensure it [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/04/03 18:29:56 UTC, 5 replies.

- Re: [PR] [SPARK-47716][SQL] Avoid view name conflict in SQLQueryTestSuite semantic sort test case [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/04/03 18:31:15 UTC, 4 replies.

- [PR] [SPARK-47720][CORE] Update `spark.speculation.multiplier` to 3 and `spark.speculation.quantile` to 0.9 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/03 18:32:40 UTC, 5 replies.

- [PR] [SPARK-47719] change spark.sql.legacy.timeParserPolicy default to CORRECTED [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2024/04/03 18:45:59 UTC, 1 replies.

- [PR] [SPARK-47610][CONNECT][FOLLOWUP] Add -Dio.netty.tryReflectionSetAccessible=true for spark-connect-scala-client [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/04/03 18:46:18 UTC, 2 replies.

- [PR] Metrics state v2 [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/04/03 20:00:01 UTC, 0 replies.

- [PR] [SPARK-47721][DOC] Guidelines for the Structured Logging Framework [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/04/03 20:06:10 UTC, 5 replies.

- Re: [PR] [SPARK-47050][SQL] Collect and publish partition level metrics [spark] - posted by "snmvaughan (via GitHub)" <gi...@apache.org> on 2024/04/03 20:52:46 UTC, 4 replies.

- [PR] [SPARK-47722] Wait until RocksDB background work finish before closing [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/04/03 21:06:23 UTC, 1 replies.

- [PR] [SPARK-47705][INFRA][FOLLOWUP] Sort LogKey alphabetically and build a test to ensure it [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/03 23:21:43 UTC, 4 replies.

- Re: [PR] [SPARK-47722][SS] Wait until RocksDB background work finish before closing [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/03 23:45:19 UTC, 1 replies.

- Re: [PR] [SPARK-47719][SQL] Change spark.sql.legacy.timeParserPolicy default to CORRECTED [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/03 23:50:26 UTC, 10 replies.

- [PR] [SPARK-47310] Add microbenchmark for merge operations for multiple values in value portion of state store [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/04/03 23:50:36 UTC, 0 replies.

- [PR] commit [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/04/03 23:59:20 UTC, 0 replies.

- Re: [PR] [SPARK-47582][SQL] Migrate Catalyst logInfo with variables to structured logging framework [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/04/04 00:00:07 UTC, 15 replies.

- Re: [PR] [SPARK-45893][HIVE] Support drop multiple partitions in batch for hive [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/04/04 00:19:18 UTC, 1 replies.

- [PR] [SPARK-47723][CORE][TESTS] Introduce a tool that can sort alphabetically enumeration field in `LogEntry` automatically [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/04 02:21:31 UTC, 14 replies.

- [PR] [SPARK-47724][PYTHON][TESTS] Add an environment variable for testing remote pure Python library [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/04 02:28:47 UTC, 2 replies.

- [PR] [SPARK-46812][PYTHON][TESTS][FOLLOWUP] Skip `pandas`-required tests if pandas is not available [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/04 03:05:09 UTC, 3 replies.

- Re: [PR] [SPARK-44050][K8S][3.3] add retry config when creating Kubernetes resources. [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/04 03:13:39 UTC, 1 replies.

- [PR] [DO-NOT-MERGE][SPARK-47725][INFRA] Set up the CI for pyspark-connect package [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/04 03:17:23 UTC, 19 replies.

- [PR] [SPARK-47511][SQL][FOLLOWUP] Rename the config REPLACE_NULLIF_USING_WITH_EXPR to be more general [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/04 06:11:53 UTC, 9 replies.

- [PR] [SPARK-47726][DOC] Document push-based shuffle metrics [spark] - posted by "LucaCanali (via GitHub)" <gi...@apache.org> on 2024/04/04 07:03:11 UTC, 6 replies.

- [PR] [SPARK-47727][PYTHON] Make SparkConf to root level to for both SparkSession and SparkContext [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/04 07:19:06 UTC, 10 replies.

- [PR] [SPARK-47728][DOC] Document G1 Concurrent GC metrics [spark] - posted by "LucaCanali (via GitHub)" <gi...@apache.org> on 2024/04/04 07:20:03 UTC, 1 replies.

- [PR] [SPARK-47729][PYTHON][TESTS] Get the proper default port for pyspark-connect testcases [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/04 07:25:47 UTC, 1 replies.

- [PR] [SPARK-47586][SQL] Hive module: Migrate logError with variables to structured logging framework [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/04/04 07:31:23 UTC, 29 replies.

- [PR] [SPARK-47593][CORE] Connector module: Migrate logWarn with variables to structured logging framework [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/04 08:23:12 UTC, 10 replies.

- Re: [PR] [SPARK-47689][SQL][FOLLOWUP] More accurate file path in TASK_WRITE_FAILED error [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/04 09:19:51 UTC, 2 replies.

- Re: [PR] [SPARK-47657][SQL] Implement collation filter push down support per file source [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/04 09:44:31 UTC, 7 replies.

- Re: [PR] [SPARK-47001][SQL] Pushdown verification in optimizer [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/04 10:13:59 UTC, 8 replies.

- Re: [PR] [SPARK-47565][PYTHON] PySpark worker pool crash resilience [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/04 11:15:42 UTC, 1 replies.

- [PR] Revert "[SPARK-47708][CONNECT] Do not log gRPC exception to stderr in PySpark [spark] - posted by "nemanja-boric-databricks (via GitHub)" <gi...@apache.org> on 2024/04/04 11:54:05 UTC, 3 replies.

- Re: [PR] Add Support for Scala 2.13 in Spark 3.4.1 [spark-docker] - posted by "galacticgumshoe (via GitHub)" <gi...@apache.org> on 2024/04/04 13:23:45 UTC, 0 replies.

- Re: [PR] [SPARK-47617][SQL] Add TPC-DS testing infrastructure for collations [spark] - posted by "nikolamand-db (via GitHub)" <gi...@apache.org> on 2024/04/04 15:38:59 UTC, 18 replies.

- Re: [PR] [SPARK-46395][CORE] Assign Spark configs to groups for use in documentation [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2024/04/04 16:11:28 UTC, 3 replies.

- Re: [PR] [SPARK-26875][SS] Add an option on FileStreamSource to include modified files [spark] - posted by "murali9704 (via GitHub)" <gi...@apache.org> on 2024/04/04 16:35:37 UTC, 3 replies.

- [PR] [SPARK-46812][PYTHON][TESTS][FOLLOWUP] Check should_test_connect and pyarrow to skip tests [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/04 16:40:17 UTC, 7 replies.

- [PR] [SPARK-47568][SS] Fix race condition between maintenance thread and load/commit for snapshot files [spark] - posted by "sahnib (via GitHub)" <gi...@apache.org> on 2024/04/04 16:53:11 UTC, 1 replies.

- Re: [PR] [SPARK-47568][SS] Fix race condition between maintenance thread and load/commit for snapshot files. [spark] - posted by "sahnib (via GitHub)" <gi...@apache.org> on 2024/04/04 16:53:59 UTC, 0 replies.

- Re: [PR] [SPARK-27950][DSTREAM] Configurable dynamodb url so kinesis-asl works with localstack [spark] - posted by "murrelljenna (via GitHub)" <gi...@apache.org> on 2024/04/04 17:11:20 UTC, 2 replies.

- Re: [PR] [SPARK-39420][SQL] Support `ANALYZE TABLE` on Datasource V2 tables [spark] - posted by "felipepessoto (via GitHub)" <gi...@apache.org> on 2024/04/04 17:35:48 UTC, 0 replies.

- Re: [PR] [SPARK-47592][CORE] Connector module: Migrate logError with variables to structured logging framework [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/04/04 18:00:20 UTC, 9 replies.

- Re: [PR] [SPARK-47543][CONNECT][PYTHON] Inferring `dict` as `MapType` from Pandas DataFrame to allow DataFrame creation [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/04/04 18:12:26 UTC, 3 replies.

- Re: [PR] [SPARK-47574][CORE] Introduce Structured Logging Framework [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/04/04 19:48:31 UTC, 3 replies.

- [PR] Add license, and update license check rules for gradle projects. [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/04/04 21:09:50 UTC, 2 replies.

- Re: [PR] [SPARK-47310][SS] Add microbenchmark for merge operations for multiple values in value portion of state store [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/04/04 21:35:36 UTC, 0 replies.

- [PR] [SPARK-47081][CONNECT][FOLLOW-UP] Add the `shell` module into PyPI package [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/04 23:47:27 UTC, 5 replies.

- [PR] [SPARK-21195][CORE] Dynamically register metrics from sources as they are reported [spark] - posted by "robert3005 (via GitHub)" <gi...@apache.org> on 2024/04/04 23:49:22 UTC, 0 replies.

- [PR] [SPARK-47733][SS] Add operational metrics for TWS operators [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/04/04 23:49:35 UTC, 0 replies.

- [PR] [SPARK-47734][PYTHON][TESTS] Fix flaky DataFrame.writeStream doctest by stopping streaming query [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2024/04/05 00:03:08 UTC, 6 replies.

- Re: [PR] [SPARK-47568][SS][3.5] Fix race condition between maintenance thread and load/commit for snapshot files [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/05 01:50:31 UTC, 2 replies.

- [PR] [SPARK-47724][PYTHON][TESTS][FOLLOW-UP] Make testing script to inherits SPARK_CONNECT_TESTING_REMOTE env [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/05 02:14:12 UTC, 1 replies.

- [PR] [SPARK-47735][PYTHON][TESTS] Make pyspark.testing.connectutils compatible with pyspark-connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/05 02:20:07 UTC, 2 replies.

- [PR] [DO-NOT-REVEW][SPARK-47718] temp view loses wm [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/04/05 02:23:02 UTC, 3 replies.

- [PR] [SPARK-47081][CONNECT][TESTS][FOLLOW-UP] Skip the flaky doctests for now [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/05 04:18:02 UTC, 2 replies.

- [PR] [SPARK-47577][CORE][PART2] Migrate logError with variables to structured logging framework  [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/04/05 04:54:51 UTC, 17 replies.

- [PR] Add support for AbstractArrayType(StringTypeCollated) [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/04/05 07:11:35 UTC, 2 replies.

- [PR] [SPARK-47737][PYTHON] Bump PyArrow to 15.0.2 [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/04/05 09:22:47 UTC, 3 replies.

- [PR] [WIP][SPARK-47738][BUILD] Upgrade Kafka to 3.7.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/05 11:49:20 UTC, 0 replies.

- [PR] [SPARK-46632][SQL] EquivalentExpressions addExprTree should allow all type of expressions [spark] - posted by "planga82 (via GitHub)" <gi...@apache.org> on 2024/04/05 13:54:47 UTC, 4 replies.

- [PR] Register logical avro type [spark] - posted by "milastdbx (via GitHub)" <gi...@apache.org> on 2024/04/05 14:23:01 UTC, 0 replies.

- [PR] Added stack overflow handling in exec immediate [spark] - posted by "milastdbx (via GitHub)" <gi...@apache.org> on 2024/04/05 15:09:42 UTC, 0 replies.

- Re: [PR] [SPARK-44393][BUILD] Upgrade `H2` from 2.1.214 to 2.2.220 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/05 15:28:31 UTC, 0 replies.

- Re: [PR] [SPARK-44441][BUILD] Upgrade `bcprov-jdk15on` and `bcpkix-jdk15on` to 1.70 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/05 15:31:16 UTC, 0 replies.

- Re: [PR] [SPARK-46411][BUILD] Change to use `bcprov/bcpkix-jdk18on` for UT [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/05 16:06:30 UTC, 2 replies.

- [PR] [SPARK-46411][BUILD][3.5][FOLLOWUP] Fix pom.xml file in common/network-common module [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/05 16:13:58 UTC, 2 replies.

- [PR] [SPARK-47111][SQL][TESTS][3.5] Upgrade `PostgreSQL` JDBC driver to 42.7.2 and docker image to 16.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/05 18:08:07 UTC, 2 replies.

- Re: [PR] [SPARK-47741] Added stack overflow handling in exec immediate [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2024/04/05 18:13:18 UTC, 0 replies.

- Re: [PR] [SPARK-46411][BUILD][3.4] Change to use `bcprov/bcpkix-jdk18on` for UT [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/05 18:54:43 UTC, 1 replies.

- [PR] [SPARK-47111][SQL][TESTS][3.4] Upgrade `PostgreSQL` JDBC driver to 42.7.2 and docker image to 16.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/05 19:03:45 UTC, 2 replies.

- Re: [PR] [SPARK-47111][SQL][TESTS] Upgrade `PostgreSQL` JDBC driver to 42.7.2 and docker image to 16.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/05 19:47:27 UTC, 0 replies.

- Re: [PR] [SPARK-45445][BUILD] Upgrade snappy to 1.1.10.5 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/05 20:02:24 UTC, 0 replies.

- [PR] [SPARK-45445][BUILD][3.5] Upgrade snappy to 1.1.10.5 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/05 20:05:01 UTC, 4 replies.

- [PR] [SPARK-45445][BUILD][3.4] Upgrade snappy to 1.1.10.5 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/05 20:11:16 UTC, 4 replies.

- Re: [PR] [SPARK-47310][SS] Add micro-benchmark for merge operations for multiple values in value portion of state store [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/04/05 20:56:55 UTC, 1 replies.

- [PR] [SPARK-47743][Core] Use milliseconds as the time unit in logging [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/04/05 22:00:31 UTC, 5 replies.

- [PR] [SPARK-47581][INFRA] SQL catalyst: Migrate logWarning with variables to structured logging framework [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/04/05 23:31:44 UTC, 1 replies.

- [PR] [SPARK-47746] Implement ordinal-based range encoding in the RocksDBStateEncoder [spark] - posted by "neilramaswamy (via GitHub)" <gi...@apache.org> on 2024/04/06 00:08:22 UTC, 4 replies.

- [PR] [SPARK-47744] Add support for negative-valued bytes in range encoder [spark] - posted by "neilramaswamy (via GitHub)" <gi...@apache.org> on 2024/04/06 00:36:49 UTC, 2 replies.

- [PR] [SPARK-47081][CONNECT][FOLLOW] Improving the usability of the Progress Handler [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/04/06 05:48:35 UTC, 4 replies.

- Re: [PR] [SPARK-47738][BUILD] Upgrade Kafka to 3.7.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/06 08:53:24 UTC, 2 replies.

- Re: [PR] [SPARK-47739][SQL] Register logical avro type [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/06 18:05:56 UTC, 13 replies.

- [PR] [SPARK-47734][PYTHON][TESTS][3.4] Fix flaky DataFrame.writeStream doctest by stopping streaming query [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2024/04/06 18:28:10 UTC, 3 replies.

- Re: [PR] [SPARK-47745] Add License to Spark Operator repository [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/06 20:29:15 UTC, 10 replies.

- [PR] [WIP][SPARK-47748][BUILD] Upgrade `zstd-jni` to 1.5.6-2 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/06 23:27:37 UTC, 0 replies.

- [PR] [SPARK-47595][CORE] Streaming: Migrate logError with variables to structured logging framework [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/07 01:21:32 UTC, 2 replies.

- [PR] [SPARK-47750][DOCS][SQL] Postgres: Document Mapping Spark SQL Data Types to PostgreSQL [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/07 03:31:53 UTC, 3 replies.

- Re: [PR] [SPARK-47737][PYTHON] Bump PyArrow to 10.0.0 [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/04/07 03:39:09 UTC, 4 replies.

- [PR] [SPARK-46722][CONNECT][SS][TESTS][FOLLOW-UP] Drop the tables after tests finished [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/07 06:10:12 UTC, 4 replies.

- [PR] [SPARK-47751][PYTHON] Make pyspark.worker_utils compatible with pyspark-connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/07 06:15:06 UTC, 0 replies.

- [PR] [SPARK-47752][PS][CONNECT] Make pyspark.pandas compatible with pyspark-connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/07 06:18:41 UTC, 5 replies.

- Re: [PR] [SPARK-37018][SQL] Spark SQL should support create function with Aggregator [spark] - posted by "IceMimosa (via GitHub)" <gi...@apache.org> on 2024/04/07 06:22:37 UTC, 0 replies.

- [PR] [SPARK-47753][PYTHON][TESTS] Make pyspark.testing compatible with pyspark-connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/07 06:22:43 UTC, 0 replies.

- Re: [PR] [SPARK-47413][SQL] [WIP - DONT REVIEW] - add support to substr/left/right for collations   [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/04/07 07:47:56 UTC, 2 replies.

- Re: [PR] [SPARK-47737][PYTHON] Bump PyArrow to 10.0.1 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/07 07:49:26 UTC, 3 replies.

- [PR] [SPARK-47754][SQL] Postgres: Support reading multidimensional arrays [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/07 08:47:07 UTC, 6 replies.

- Re: [PR] [SPARK-47751][PYTHON][CONNECT] Make pyspark.worker_utils compatible with pyspark-connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/07 09:11:03 UTC, 1 replies.

- [PR] [SPARK-47755][CONNECT] Pivot should fail when the number of distinct values is too large [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/07 09:26:29 UTC, 2 replies.

- Re: [PR] [SPARK-47753][PYTHON][CONNECT][TESTS] Make pyspark.testing compatible with pyspark-connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/07 09:34:22 UTC, 2 replies.

- Re: [PR] [SPARK-47299][PYTHON][DOCS] Use the same `versions.json` in the dropdown of different versions of PySpark documents [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/04/07 22:13:34 UTC, 3 replies.

- [PR] [MINOR][TESTS] Deduplicate test cases `test_parse_datatype_string` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/07 23:57:53 UTC, 3 replies.

- Re: [PR] [DO-NOT-REVIEW][DRAFT] Spark 45637 multiple state test [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/04/08 00:19:08 UTC, 1 replies.

- [PR] [MINOR][PYTHON][SS][TESTS] Drop the tables after being used at `test_streaming_foreach_batch` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/08 00:19:52 UTC, 3 replies.

- [PR] [WIP][SPARK-47758][BUILD] Upgrade commons-collections4 to 4.5.0-M1 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/08 03:08:45 UTC, 4 replies.

- [PR] [MINOR][PYTHON][CONNECT][TESTS] Enable `MapInPandasParityTests.test_dataframes_with_incompatible_types` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/08 03:13:54 UTC, 2 replies.

- [PR] [SPARK-47590][SQL] Hive-thriftserver: Migrate logWarn with variables to structured logging framework [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/04/08 03:49:00 UTC, 19 replies.

- Re: [PR] [SPARK-45959][SQL] Improving performance when addition of 1 column at a time causes increase in the LogicalPlan tree depth [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/08 04:30:19 UTC, 7 replies.

- Re: [PR] [SPARK-47504][SQL] Resolve AbstractDataType simpleStrings for StringTypeCollated [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/08 06:30:24 UTC, 3 replies.

- [PR] [SPARK-47762][PYTHON][CONNECT] Add pyspark.sql.connect.protobuf into setup.py [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/08 07:58:52 UTC, 3 replies.

- [PR] [SPARK-47761][SQL] Oracle: Support reading AnsiIntervalTypes [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/08 08:14:19 UTC, 10 replies.

- Re: [PR] [SPARK-47748][BUILD] Upgrade `zstd-jni` to 1.5.6-2 [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/08 08:16:46 UTC, 1 replies.

- [PR] [SPARK-47591][SQL] Hive-thriftserver: Migrate logInfo with variables to structured logging framework [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/04/08 08:34:33 UTC, 14 replies.

- [PR] [SPARK-47587][SQL] Hive module: Migrate logWarn with variables to structured logging framework [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/08 08:35:40 UTC, 3 replies.

- [PR] [MINOR][TESTS] Make `check_invalid_args` reusable in parity test [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/08 08:42:48 UTC, 3 replies.

- Re: [PR] [SPARK-47725][INFRA] Set up the CI for pyspark-connect package [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/08 11:44:26 UTC, 2 replies.

- [PR] [DRAFT][SPARK-47692][SQL] Hash aggregate support for strings with collation [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/04/08 11:51:52 UTC, 3 replies.

- [PR] [SPARK-47764][CORE][SQL] Cleanup shuffle dependencies based on ShuffleCleanupMode [spark] - posted by "bozhang2820 (via GitHub)" <gi...@apache.org> on 2024/04/08 13:10:34 UTC, 21 replies.

- Re: [PR] [SPARK-47741] Added stack overflow handling in parser [spark] - posted by "milastdbx (via GitHub)" <gi...@apache.org> on 2024/04/08 16:36:02 UTC, 9 replies.

- [PR] [SPARK-47767]Show offset value in TakeOrderedAndProjectExec [spark] - posted by "guixiaowen (via GitHub)" <gi...@apache.org> on 2024/04/08 16:39:26 UTC, 0 replies.

- Re: [PR] [SPARK-46894][PYTHON] Move PySpark error conditions into standalone JSON file [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2024/04/08 17:53:30 UTC, 8 replies.

- [PR] [WIP] ListStateTTL implementation [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/04/08 18:05:19 UTC, 0 replies.

- [PR] [SPARK-47417][SPARK-47418][SPARk-47420] Add collation support to multiple string functions [spark] - posted by "nikolamand-db (via GitHub)" <gi...@apache.org> on 2024/04/08 18:17:46 UTC, 0 replies.

- Re: [PR] [SPARK-47371] [SQL] XML: Ignore row tags found in CDATA [spark] - posted by "sandip-db (via GitHub)" <gi...@apache.org> on 2024/04/08 18:50:50 UTC, 5 replies.

- [PR] [SPARK-47769][SQL] Add schema_of_variant_agg expression. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/04/08 19:46:00 UTC, 5 replies.

- Re: [PR] [SPARK-47581][CORE] SQL catalyst: Migrate logWarning with variables to structured logging framework [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/04/08 20:47:07 UTC, 12 replies.

- [PR] [SPARK-47609][SQL] Making CacheLookup more optimal to minimize cache miss  [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2024/04/08 21:49:15 UTC, 3 replies.

- [PR] [SPARK-47589][CORE] Hive-thriftserver: Migrate logError with variables to structured logging framework [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/04/08 22:13:17 UTC, 1 replies.

- Re: [PR] [SPARK-47589][HIVE-THRIFTSERVER] Migrate logError with variables to structured logging framework [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/08 22:18:13 UTC, 1 replies.

- Re: [PR] [SPARK-47589][SQL]Hive-Thriftserver: Migrate logError with variables to structured logging framework [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/04/08 22:20:45 UTC, 7 replies.

- [PR] [SPARK-47733] Add custom metrics for transformWithState operator part of query progress [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/04/09 00:07:17 UTC, 0 replies.

- Re: [PR] [DOCS][MINOR] Fix typos [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/04/09 00:18:51 UTC, 1 replies.

- [PR] [SPARK-47770][INFRA] Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return false instead of failing [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/09 00:21:29 UTC, 1 replies.

- Re: [PR] [SPARK-47767][SQL] Show offset value in TakeOrderedAndProjectExec [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/09 02:27:50 UTC, 14 replies.

- [PR] [SPARK-47771][PYTHON][TESTS] Make `max_by, min_by` doctests deterministic [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/09 02:29:24 UTC, 2 replies.

- [PR] [SPARK-47772][PYTHON][TESTS] Fix the doctest of `mode` function [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/09 02:38:03 UTC, 2 replies.

- [PR] [DO-NOT-MERGE] Run Pandas API on Spark and ML tests for pyspark-connect package [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/09 02:39:33 UTC, 1 replies.

- Re: [PR] [SPARK-47770][INFRA] Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return `false` instead of failing [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/09 02:43:15 UTC, 4 replies.

- [PR] [SPARK-47759][CORE] Fix an issue where JavaUtils.timeStringAs fails to parse a legitimate time string [spark] - posted by "xiongbo-sjtu (via GitHub)" <gi...@apache.org> on 2024/04/09 04:08:35 UTC, 1 replies.

- [PR] [MINOR][BUILD] Remove redundant json4s-jackson exclusions in sql/api POM [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/04/09 05:08:29 UTC, 0 replies.

- [PR] [SPARK-47774][INFRA] Remove redundant rules from `MimaExcludes` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/09 05:27:17 UTC, 5 replies.

- [PR] [SPARK-47775][SQL] Support remaining scalar types in the variant spec. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/04/09 05:39:26 UTC, 8 replies.

- [PR] [SPARK-47765][SQL] Add SET COLLATION to parser rules [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/04/09 06:07:33 UTC, 18 replies.

- Re: [PR] [SPARK-47595][STREAMING] Streaming: Migrate logError with variables to structured logging framework [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/09 06:10:24 UTC, 3 replies.

- [PR] [SPARK-47240][GRAPHX] Graphx: Migrate logs with variables to structured logging framework [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/04/09 06:10:51 UTC, 0 replies.

- Re: [PR] [SPARK-47736][SQL] Add support for AbstractArrayType [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/04/09 06:17:53 UTC, 10 replies.

- [PR] [SPARK-47774][INFRA][3.5] Remove redundant rules from `MimaExcludes` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/09 06:35:33 UTC, 4 replies.

- [PR] [SPARK-47774][INFRA][3.4] Remove redundant rules from `MimaExcludes` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/09 06:49:57 UTC, 4 replies.

- [PR] [SPARK-47777][PYTHON][SS] add spark connect test for python streaming data source [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2024/04/09 07:06:55 UTC, 2 replies.

- Re: [PR] [SPARK-47463][SQL] Use V2Predicate to wrap If expr when building v2 expressions [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/04/09 07:09:35 UTC, 11 replies.

- [PR] [SPARK-47776][SS] Disallow binary inequality collation be used in key schema of stateful operator [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/04/09 07:37:22 UTC, 9 replies.

- [PR] [SPARK-47779][PS][TEST] Add a helper function to sort PS Frame/Series [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/09 08:46:49 UTC, 0 replies.

- Re: [PR] [SPARK-47779][PS][TESTS] Add a helper function to sort PS Frame/Series [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/09 09:07:40 UTC, 1 replies.

- [PR] [DO-NOT-MERGE] Run Pandas API on Spark for pyspark-connect package [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/09 09:19:49 UTC, 2 replies.

- [PR] [SPARK-47780][SQL] Make catalyst-generated classes stable and uniquely named [spark] - posted by "vjovanov (via GitHub)" <gi...@apache.org> on 2024/04/09 09:27:51 UTC, 0 replies.

- [PR] [SPARK-47781][SQL] Handle negative scale and truncate exceed scale first for JDBC data sources [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/09 10:15:04 UTC, 4 replies.

- [PR] [SPARK-47603][CORE] Resource managers: Migrate logWarn with variables to structured logging framework [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/09 11:34:04 UTC, 0 replies.

- [PR] [SPARK-47581][CORE][FOLLOWUP] Fix GA failure [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/09 12:08:34 UTC, 11 replies.

- [PR] [MINOR][PS][TESTS] Make `test_compare` deterministic [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/09 12:24:53 UTC, 2 replies.

- Re: [PR] [SPARK-47601][GRAPHX] Graphx: Migrate logs with variables to structured logging framework [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/04/09 12:38:21 UTC, 3 replies.

- Re: [PR] [SPARK-47782][BUILD] Remove redundant json4s-jackson definition in sql/api POM [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/09 15:23:18 UTC, 0 replies.

- [PR] [SS] Merge TTLMode and TimeoutMode into a single TimeMode. [spark] - posted by "sahnib (via GitHub)" <gi...@apache.org> on 2024/04/09 15:38:13 UTC, 0 replies.

- Re: [PR] [SPARK-47673][SS] Implementing TTL for ListState [spark] - posted by "sahnib (via GitHub)" <gi...@apache.org> on 2024/04/09 15:53:32 UTC, 36 replies.

- Re: [PR] [SPARK-47784][SS] Merge TTLMode and TimeoutMode into a single TimeMode. [spark] - posted by "sahnib (via GitHub)" <gi...@apache.org> on 2024/04/09 16:23:43 UTC, 13 replies.

- Re: [PR] [SPARK-47413][SQL] - add support to substr/left/right for collations   [spark] - posted by "GideonPotok (via GitHub)" <gi...@apache.org> on 2024/04/09 16:25:57 UTC, 12 replies.

- [PR] [SPARK-47783] Add soem missing SQLSTATEs an clean up the XX000 to use… [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2024/04/09 16:31:32 UTC, 0 replies.

- [PR] [SPARK-47785][BUILD][TESTS] Upgrade `bouncycastle` to 1.78 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/09 16:34:52 UTC, 4 replies.

- Re: [PR] [SPARK-47777][PYTHON][SS][TESTS] Add spark connect test for python streaming data source [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2024/04/09 17:56:20 UTC, 3 replies.

- [PR] [SPARK-47415][SQL] Collation support: Levenshtein [spark] - posted by "nikolamand-db (via GitHub)" <gi...@apache.org> on 2024/04/09 18:02:43 UTC, 13 replies.

- Re: [PR] [SPARK-47783] Add some missing SQLSTATEs an clean up the YY000 to use… [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/04/09 18:49:07 UTC, 1 replies.

- [PR] [SPARK-47109][BUILD][3.5] Upgrade `commons-compress` to 1.26.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/09 20:55:54 UTC, 1 replies.

- [PR] [SPARK-47109][BUILD][3.4] Upgrade `commons-compress` to 1.26.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/09 21:11:56 UTC, 1 replies.

- [PR] [SPARK-47787][BUILD] Upgrade `commons-compress` to 1.26.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/09 21:16:16 UTC, 3 replies.

- [PR] [SPARK-47787][BUILD][3.5] Upgrade `commons-compress` to 1.26.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/09 21:51:20 UTC, 2 replies.

- [PR] Ms ttl [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/04/09 22:03:08 UTC, 1 replies.

- Re: [PR] [SPARK-47733][SS] Add custom metrics for transformWithState operator part of query progress [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/04/09 22:56:38 UTC, 8 replies.

- [PR] [SPARK-47581][CORE] SQL core: Migrate logError with variables to structured logging framework [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/04/09 23:19:46 UTC, 1 replies.

- [PR] [SPARK-47786] SELECT DISTINCT (*) should not become SELECT DISTINCT struct(*) (revert to previous behavior) [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2024/04/10 00:14:05 UTC, 2 replies.

- [PR] [SPARK-47788] [Structured Streaming] Ensure the same hash partitioning for streaming stateful ops [spark] - posted by "fanyue-xia (via GitHub)" <gi...@apache.org> on 2024/04/10 00:23:03 UTC, 10 replies.

- Re: [PR] [SPARK-47781][SQL] Handle negative scale for JDBC data sources [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/10 02:39:09 UTC, 0 replies.

- Re: [PR] [SPARK-47182][BUILD] Exclude `commons-(io|lang3)` transitive dependencies from `commons-compress` and `avro*` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/10 03:22:29 UTC, 1 replies.

- Re: [PR] [SPARK-47759][CORE] Make the critical path like RpcUtils$.askRpcTimeout less fragile [spark] - posted by "xiongbo-sjtu (via GitHub)" <gi...@apache.org> on 2024/04/10 03:33:16 UTC, 0 replies.

- Re: [PR] [SPARK-47083][BUILD] Upgrade `commons-codec` to 1.16.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/10 03:35:27 UTC, 0 replies.

- Re: [PR] [SPARK-41811][PYTHON][CONNECT] Implement `SQLStringFormatter` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/10 03:45:28 UTC, 1 replies.

- [PR] [SPARK-47656][BUILD][3.5] Upgrade `commons-io` to 2.16.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/10 05:20:22 UTC, 1 replies.

- Re: [PR] [SPARK-47781][SQL] Handle negative scale decimals for JDBC data sources [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/10 05:27:06 UTC, 1 replies.

- [PR] [SPARK-47790][BUILD] Upgrade `commons-io` to 2.16.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/10 05:28:54 UTC, 2 replies.

- [PR] [SPARK-47790][BUILD][3.5] Upgrade `commons-io` to 2.16.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/10 05:32:32 UTC, 3 replies.

- [PR] [SPARK-47792][CORE] Make the value of MDC can support `null` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/10 06:04:03 UTC, 1 replies.

- [PR] [SPARK-47791][SQL] Truncate exceed decimals with scale first instead of precision from JDBC datasource [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/10 06:53:49 UTC, 2 replies.

- [PR] [SPARK-47793][SS][PYTHON] Implement SimpleDataSourceStreamReader for python streaming data source [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2024/04/10 07:04:11 UTC, 67 replies.

- [PR] [DRAFT][SPARK-47410][SQL] refactor UTF8String and CollationFactory [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/04/10 07:07:18 UTC, 8 replies.

- [PR] [SPARK-47797] Skip deleting pod from k8s if the pod does not exists [spark] - posted by "leesf (via GitHub)" <gi...@apache.org> on 2024/04/10 09:12:06 UTC, 2 replies.

- [PR] [MINOR][PYTHON][TESTS]  Enable `test_udf_cache` parity test [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/10 09:15:59 UTC, 3 replies.

- [PR] [SPARK-47798][SQL] Enrich the error message for the reading failures of decimal values [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/10 09:32:05 UTC, 3 replies.

- Re: [PR] [SPARK-47797][K8S] Skip deleting pod from k8s if the pod does not exists [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/10 09:36:47 UTC, 2 replies.

- [PR] [SPARK-47795][DOC] Supplement the doc of job schedule for K8S [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2024/04/10 09:39:29 UTC, 6 replies.

- Re: [PR] [SPARK-47253][CORE] Allow LiveEventBus to stop without the completely draining of event queue [spark] - posted by "TakawaAkirayo (via GitHub)" <gi...@apache.org> on 2024/04/10 11:15:13 UTC, 11 replies.

- [PR] [SPARK-47799][BUILD] Preserve parameter information when using SBT package jar [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/04/10 12:28:03 UTC, 2 replies.

- Re: [PR] [SPARK-47795][DOCS] Supplement the doc of job schedule for K8S [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/10 12:28:14 UTC, 5 replies.

- [PR] [SPARK-47781][SPARK-47791][SPARK-47798][DOCS][FOLLOWUP] Update the decimal mapping remarks with JDBC data sources [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/10 13:17:59 UTC, 2 replies.

- Re: [PR] [SPARK-47410][SQL] refactor UTF8String and CollationFactory [spark] - posted by "dbatomic (via GitHub)" <gi...@apache.org> on 2024/04/10 13:21:09 UTC, 5 replies.

- [PR] [SPARK-47800] Create new method for identifier to tableIdentifier conversion [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2024/04/10 14:02:38 UTC, 0 replies.

- [PR] make readme easier to follow [spark-connect-go] - posted by "MrPowers (via GitHub)" <gi...@apache.org> on 2024/04/10 15:11:17 UTC, 3 replies.

- [PR] Spark collation 47413 3 [spark] - posted by "GideonPotok (via GitHub)" <gi...@apache.org> on 2024/04/10 16:31:39 UTC, 1 replies.

- [PR] [SPARK-47802] Revert (*) from meaning struct(*) back to meaning * [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2024/04/10 19:52:06 UTC, 1 replies.

- [PR] [SPARK-47174][CONNECT][SS][1/2] Server side SparkConnectListenerBusListener for Client side streaming query listener [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/04/10 21:05:58 UTC, 2 replies.

- [PR] [SPARK-47803][SQL] Support cast to variant. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/04/10 22:27:58 UTC, 8 replies.

- [PR] [SPARK-47804] Add Dataframe cache debug log [spark] - posted by "anchovYu (via GitHub)" <gi...@apache.org> on 2024/04/10 23:24:06 UTC, 9 replies.

- [PR] [SPARK-47805][SS] Implementing TTL for MapState [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/04/10 23:29:15 UTC, 47 replies.

- [PR] [SPARK-47725][INFRA][FOLLOW-UP] Do not run scheduled job in forked repository [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/10 23:45:15 UTC, 2 replies.

- Re: [PR] [SPARK-41811][PYTHON][CONNECT] Implement `SQLStringFormatter` with `WithRelations` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/11 00:05:22 UTC, 3 replies.

- Re: [PR] [MINOR] Make readme easier to follow [spark-connect-go] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/11 00:05:41 UTC, 1 replies.

- Re: [PR] [SPARK-47366][SQL][PYTHON] Add VariantVal for PySpark [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/11 00:15:54 UTC, 6 replies.

- Re: [PR] [SPARK-47410][SQL] Refactor UTF8String and CollationFactory [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/11 00:38:50 UTC, 19 replies.

- Re: [PR] [SPARK-47802][SQL] Revert (*) from meaning struct(*) back to meaning * [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/11 01:13:01 UTC, 1 replies.

- Re: [PR] [SPARK-47800][SQL] Create new method for identifier to tableIdentifier conversion [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/11 01:22:39 UTC, 9 replies.

- Re: [PR] [WIP][SPARK-47587][SQL] Hive module: Migrate logWarn with variables to structured logging framework [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/11 01:57:03 UTC, 1 replies.

- [PR] [MINOR][DOCS] Clarify relation between grouping API and `spark.sql.execution.arrow.maxRecordsPerBatch` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/11 02:05:02 UTC, 3 replies.

- [PR] [MINOR][DOCS] Make the link of spark properties with YARN more accurate [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2024/04/11 02:43:59 UTC, 2 replies.

- [PR] [SPARK-47807][PYTHON][ML] Make pyspark.ml compatible witbh pyspark-connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/11 03:12:44 UTC, 1 replies.

- [PR] [SPARK-47808][PYTHON][ML][TESTS] Make pyspark.ml.connect tests running without optional dependencies [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/11 03:25:27 UTC, 3 replies.

- [PR] [SPARK-47809][SQL][TEST] `checkExceptionInExpression` should check error for each codegen mode [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/11 03:37:37 UTC, 2 replies.

- [PR] [SPARK-46812][CONNECT][FOLLOW-UP] Make `handleCreateResourceProfileCommand` private [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/11 04:07:04 UTC, 3 replies.

- Re: [PR] [SPARK-47792][CORE] Make the value of MDC can support `null` & cannot be `MessageWithContext` [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/04/11 04:45:58 UTC, 13 replies.

- Re: [PR] [DO-NOT-MERGE] Run ML tests for pyspark-connect package [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/11 06:29:17 UTC, 0 replies.

- Re: [PR] [SPARK-47795][KUBERNETES][DOCS] Supplement the doc of job schedule for K8S [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/11 07:15:45 UTC, 1 replies.

- [PR] [SPARK-47810] Replace equivalent expression to <=> in join condition [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2024/04/11 07:17:55 UTC, 0 replies.

- [PR] [WIP][MINOR] Remove the KinesisTestUtils from `main` to `test` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/11 07:41:25 UTC, 0 replies.

- Re: [PR] [SPARK-47807][PYTHON][ML] Make pyspark.ml compatible with pyspark-connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/11 08:10:22 UTC, 1 replies.

- Re: [PR] [SPARK-47811][PYTHON][CONNECT][TESTS] Run ML tests for pyspark-connect package [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/11 08:21:05 UTC, 2 replies.

- [PR] [SPARK-47812][CONNECT] Support Serialization of SparkSession for ForEachBatch worker [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/04/11 08:28:45 UTC, 23 replies.

- Re: [PR] [MINOR][DSTREAM] Remove the KinesisTestUtils from `main` to `test` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/11 08:36:13 UTC, 2 replies.

- Re: [PR] [SPARK-47799][BUILD] Add `-g` to javac compile parameters when using SBT package jar [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/04/11 09:57:41 UTC, 3 replies.

- [PR] [SPARK-47360] Collation support: Overlay, FormatString, Length, BitLength, OctetLength, SoundEx, Luhncheck [spark] - posted by "nikolamand-db (via GitHub)" <gi...@apache.org> on 2024/04/11 10:01:29 UTC, 0 replies.

- [PR] [SPARK-47625][SQL] Addition of Indeterminate Collation Support [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/04/11 10:29:54 UTC, 0 replies.

- [PR] [SPARK-47815][CONNECT] Unify the user agent with json [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/11 10:34:45 UTC, 5 replies.

- Re: [PR] [SPARK-47814][DSTREAM][TESTS] Remove the KinesisTestUtils from `main` to `test` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/11 10:36:45 UTC, 1 replies.

- Re: [PR] [SPARK-47814][DSTREAM][TESTS] Move `KinesisTestUtils` from `main` to `test` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/11 10:49:24 UTC, 1 replies.

- [PR] [SPARK-47813][SQL] Replace getArrayDimension with updateExtraColumnMeta [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/11 11:16:31 UTC, 5 replies.

- Re: [PR] [SPARK-47809][SQL] `checkExceptionInExpression` should check error for each codegen mode [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/11 11:19:02 UTC, 1 replies.

- [PR] [SPARK-47816][CONNECT][DOCS] Document the lazy evaluation of views in `spark.{sql, table}` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/11 11:30:16 UTC, 11 replies.

- [PR] [SPARK-47357][SQL] Add support for Upper, Lower, InitCap (all collations) [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/04/11 12:29:11 UTC, 8 replies.

- Re: [PR] [SPARK-47463][SQL] Use V2Predicate to wrap expression with return type of boolean [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/11 12:40:47 UTC, 17 replies.

- Re: [PR] [SPARK-47417][SQL] Collation support: Ascii, Chr, Base64, UnBase64, Decode, StringDecode, Encode, ToBinary, FormatNumber, Sentences [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/04/11 12:58:16 UTC, 10 replies.

- [PR] Update `pandas` to 2.2.2 [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2024/04/11 13:34:54 UTC, 0 replies.

- Re: [PR] [SPARK-47817][PYTHON][PS][BUILD] Update `pandas` to 2.2.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/11 14:47:44 UTC, 0 replies.

- Re: [PR] [SPARK-47795][K8S][DOCS] Supplement the doc of job schedule for K8S [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/11 15:26:23 UTC, 5 replies.

- Re: [PR] [SPARK-47814][DSTREAM][TESTS] Move `KinesisTestUtils` & `WriteInputFormatTestDataGenerator` from `main` to `test` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/11 15:28:08 UTC, 0 replies.

- [PR] [SPARK-47820][INFRA] Run `ANSI` SQL CI twice per day [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/11 16:52:52 UTC, 5 replies.

- [PR] Implement is_variant_null expression [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/04/11 17:48:02 UTC, 0 replies.

- [PR] [WIP][SPARK-47818] Introduce plan cache in SparkConnectPlanner to improve performance of Analyze requests [spark] - posted by "xi-db (via GitHub)" <gi...@apache.org> on 2024/04/11 17:51:09 UTC, 1 replies.

- [PR] [SPARK-44444][SQL] Enabled ANSI mode by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/11 17:58:57 UTC, 17 replies.

- [PR] [SPARK-47318] Backporting SPARK-47318 fix to v3.5.0 [spark] - posted by "sweisdb (via GitHub)" <gi...@apache.org> on 2024/04/11 18:12:36 UTC, 2 replies.

- [PR] [SPARK-47318] Backporting SPARK-47318 fix to v3.4.0 [spark] - posted by "sweisdb (via GitHub)" <gi...@apache.org> on 2024/04/11 18:26:54 UTC, 1 replies.

- [PR] [FOLLOWUP][SPARK-47541] Fix ANSI tests [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/04/11 19:38:31 UTC, 2 replies.

- [PR] [SPARK-47822] Prohibit Hash Functions from hashing the Variant Data Type. [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/04/11 21:18:27 UTC, 0 replies.

- Re: [PR] [SPARK-47541][SQL][FOLLOWUP] Fix ANSI tests [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/11 22:01:19 UTC, 0 replies.

- Re: [PR] [SPARK-47814][DSTREAM] Move `KinesisTestUtils` & `WriteInputFormatTestDataGenerator` from `main` to `test` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/11 22:06:14 UTC, 8 replies.

- Re: [PR] [SPARK-47318][CORE][3.4] Adds HKDF round to AuthEngine key derivation to follow standard KEX practices [spark] - posted by "sweisdb (via GitHub)" <gi...@apache.org> on 2024/04/11 22:20:15 UTC, 5 replies.

- Re: [PR] [SPARK-47318][CORE][3.5] Adds HKDF round to AuthEngine key derivation to follow standard KEX practices [spark] - posted by "sweisdb (via GitHub)" <gi...@apache.org> on 2024/04/11 22:21:00 UTC, 11 replies.

- Re: [PR] [SPARK-47822][SQL] Prohibit Hash Expressions from hashing the Variant Data Type [spark] - posted by "gene-db (via GitHub)" <gi...@apache.org> on 2024/04/11 22:30:58 UTC, 14 replies.

- Re: [PR] [SPARK-47821][SQL] Implement is_variant_null expression [spark] - posted by "gene-db (via GitHub)" <gi...@apache.org> on 2024/04/11 22:37:32 UTC, 10 replies.

- [PR] [SPARK-47824] Fix nondeterminism in pyspark.pandas.series.asof [spark] - posted by "markj-db (via GitHub)" <gi...@apache.org> on 2024/04/11 23:24:19 UTC, 0 replies.

- [PR] [SPARK-47825][DSTREAMS][3.5] Make `KinesisTestUtils` & `WriteInputFormatTestDataGenerator` deprecated [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/11 23:44:19 UTC, 28 replies.

- Re: [PR] [WIP][SPARK-47733][SS] Add operational metrics for TWS operators [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/04/11 23:59:51 UTC, 1 replies.

- [PR] [MINOR][PS] Use expression instead of a string column in Series.asof [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/12 00:09:12 UTC, 2 replies.

- Re: [PR] [SPARK-46477][SQL] Add bucket info to SD in toHivePartition [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/04/12 00:18:34 UTC, 1 replies.

- Re: [PR] [SPARK-39800][SQL][WIP] DataSourceV2: View Support [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/04/12 00:18:35 UTC, 1 replies.

- Re: [PR] [SPARK-47824][PS] Fix nondeterminism in pyspark.pandas.series.asof [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/12 00:37:08 UTC, 1 replies.

- Re: [PR] [SPARK-47603][KUBERNETES][YARN] Resource managers: Migrate logWarn with variables to structured logging framework [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/12 01:04:35 UTC, 12 replies.

- Re: [PR] [SPARK-47541][SQL][FOLLOWUP] Fix `AnsiTypeCoercion` to handle ArrayType [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/12 01:09:57 UTC, 1 replies.

- [PR] [SPARK-47827][PYTHON] Missing warnings for deprecated features [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/04/12 01:47:35 UTC, 3 replies.

- [PR] [WIP][SPARK-47594] Connector module: Migrate logInfo with variables to structured logging framework [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/12 03:12:36 UTC, 2 replies.

- [PR] [SPARK-47828][CONNECT][PYTHON] `DataFrameWriterV2.overwrite` fails with invalid plan [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/12 05:33:17 UTC, 5 replies.

- [PR] [MINOR][BUILD] Remove duplicate configuration of maven-compiler-plugin [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2024/04/12 06:34:00 UTC, 2 replies.

- [PR] [SPARK-43861][CORE] Do not delete inprogress log [spark] - posted by "bluzy (via GitHub)" <gi...@apache.org> on 2024/04/12 07:09:31 UTC, 6 replies.

- [PR] [SPARK-47829] Text Datasource supports Zstd compression codec [spark] - posted by "XorSum (via GitHub)" <gi...@apache.org> on 2024/04/12 07:34:41 UTC, 5 replies.

- [PR] [SPARK-47819] Use asynchronous callback for execution cleanup [spark] - posted by "xi-db (via GitHub)" <gi...@apache.org> on 2024/04/12 08:51:09 UTC, 0 replies.

- Re: [PR] [SPARK-47818][CONNECT] Introduce plan cache in SparkConnectPlanner to improve performance of Analyze requests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/12 09:02:10 UTC, 2 replies.

- Re: [PR] [SPARK-47831][PS][CONNECT][TESTS] Run Pandas API on Spark for pyspark-connect package [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/12 09:39:12 UTC, 1 replies.

- Re: [PR] [SPARK-47819][CONNECT] Use asynchronous callback for execution cleanup [spark] - posted by "vicennial (via GitHub)" <gi...@apache.org> on 2024/04/12 09:41:02 UTC, 2 replies.

- [PR] [SPARK-47833][SQL][CORE] Supply caller stackstrace for checkAndGlobPathIfNecessary AnalysisException [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/04/12 10:04:50 UTC, 14 replies.

- [PR] [SPARK-47834][SQL][CONNECT] Mark deprecated functions with `@deprecated` in `SQLImplicits` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/04/12 10:15:14 UTC, 0 replies.

- Re: [PR] [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/04/12 10:19:20 UTC, 0 replies.

- [PR] [SPARK-47835][SHUFFLE] Remove switch for remoteReadNioBufferConversion [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/04/12 13:04:30 UTC, 0 replies.

- [PR] Refactor of collation aware string functions [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/04/12 13:19:43 UTC, 0 replies.

- Re: [PR] [SPARK-29336][SQL] Fix the implementation of QuantileSummaries.merge (guarantee that the relativeError will be respected) [spark] - posted by "tanelk (via GitHub)" <gi...@apache.org> on 2024/04/12 13:22:49 UTC, 0 replies.

- Re: [PR] [WIP][SPARK-47818][CONNECT] Introduce plan cache in SparkConnectPlanner to improve performance of Analyze requests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/12 13:24:01 UTC, 5 replies.

- [PR] [MINOR][PYTHON] Enable parity test `test_different_group_key_cardinality` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/12 14:41:44 UTC, 2 replies.

- Re: [PR] [SPARK-46935][DOCS] Consolidate error documentation [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2024/04/12 16:37:23 UTC, 8 replies.

- [PR] [BACKPORT][SPARK-42369][CORE] Fix constructor for java.nio.DirectByteBuffer (#39909) [spark] - posted by "ayinresh (via GitHub)" <gi...@apache.org> on 2024/04/12 19:29:02 UTC, 1 replies.

- [PR] [SPARK-47839][SQL] Fix aggregate bug in RewriteWithExpression [spark] - posted by "kelvinjian-db (via GitHub)" <gi...@apache.org> on 2024/04/12 23:43:40 UTC, 17 replies.

- [PR] [SPARK-47840][SS] Disable foldable propagation across Streaming Aggregate/Join nodes [spark] - posted by "sahnib (via GitHub)" <gi...@apache.org> on 2024/04/12 23:50:54 UTC, 11 replies.

- Re: [PR] [SPARK-46566][SQL] Session level config was not loaded when isolation is enable. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/04/13 00:16:32 UTC, 1 replies.

- Re: [PR] [WIP][SPARK-46549][INFRA] Cache the Python dependencies for SQL tests [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/04/13 00:16:33 UTC, 1 replies.

- Re: [PR] [SPARK-46574][BUILD] Upgrade maven plugin to latest version [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/04/13 00:16:36 UTC, 5 replies.

- [PR] [WIP][SPARK-47757][SPARK-47756][CONNECT][PYTHON][TESTS] Make testing Spark Connect server having pyspark.core [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/13 01:26:55 UTC, 2 replies.

- [PR] Spark 47233 client side listener 2 [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/04/13 02:15:44 UTC, 0 replies.

- [PR] [WIP] Upgrade postgresql driver [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/13 05:29:03 UTC, 0 replies.

- [PR] [SPARK-47413][SQL] - add support to substr/left/right for collations   [Post-Refactor] [spark] - posted by "GideonPotok (via GitHub)" <gi...@apache.org> on 2024/04/13 07:41:45 UTC, 32 replies.

- Re: [PR] [SPARK-46594][DOCS] The description of `spark.yarn.shuffle.server.recovery.disabled` should be in chapter `Configuring the External Shuffle Service` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/04/14 00:22:05 UTC, 1 replies.

- Re: [PR] [SPARK-46589][CONNECT] Handle a non-existent error class [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/04/14 00:22:06 UTC, 1 replies.

- Re: [PR] [Don't Merge] upgrade sbt 1.9.8 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/04/14 00:22:09 UTC, 1 replies.

- Re: [PR] [SPARK-41954][CORE] Add isDecommissioned in ExecutorDeadException [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/04/14 00:22:11 UTC, 1 replies.

- Re: [PR] [SPARK-47841][BUILD] Upgrade `postgresql` to 42.7.3 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/14 00:36:22 UTC, 1 replies.

- [PR] do not review [spark] - posted by "GideonPotok (via GitHub)" <gi...@apache.org> on 2024/04/14 10:31:12 UTC, 0 replies.

- Re: [PR] [SPARK-47835][NETWORK] Remove switch for remoteReadNioBufferConversion [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/04/14 10:37:15 UTC, 1 replies.

- [PR] [SPARK-47844][BUILD] Upgrade ORC to 1.8.7 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/14 13:03:56 UTC, 1 replies.

- [PR] [WIP] Maven Plugins test only [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/14 13:34:15 UTC, 0 replies.

- Re: [PR] [SPARK-47844][BUILD][3.4] Upgrade ORC to 1.8.7 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/14 18:50:11 UTC, 2 replies.

- Re: [PR] [SPARK-47829][SQL] Text Datasource supports Zstd compression codec [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/14 19:01:14 UTC, 1 replies.

- [PR] [SPARK-47826][SQL][PYTHON][FOLLOW-UP] Do not use list[...] that is invalid type syntax for Python 3.8 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/15 00:20:22 UTC, 4 replies.

- [PR] [SPARK-47845][SQL][PYTHON][CONNECT] Support column type in split function for scala and python [spark] - posted by "CTCC1 (via GitHub)" <gi...@apache.org> on 2024/04/15 01:04:36 UTC, 0 replies.

- Re: [PR] [SPARK-47788][SS] Ensure the same hash partitioning for streaming stateful ops [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/04/15 01:47:01 UTC, 12 replies.

- Re: [PR] [SPARK-47757][SPARK-47756][CONNECT][PYTHON][TESTS] Make testing Spark Connect server having pyspark.core [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/15 01:54:29 UTC, 3 replies.

- [PR] From json variant [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/04/15 02:04:46 UTC, 0 replies.

- Re: [PR] [SPARK-47846][SQL] Add support for Variant type in from_json expression [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/15 02:07:46 UTC, 3 replies.

- Re: [PR] [SPARK-47810][SQL] Replace equivalent expression to <=> in join condition [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2024/04/15 02:42:42 UTC, 10 replies.

- Re: [PR] [SPARK-47845][SQL][PYTHON][CONNECT] Support Column type in split function for scala and python [spark] - posted by "CTCC1 (via GitHub)" <gi...@apache.org> on 2024/04/15 03:04:50 UTC, 20 replies.

- [PR] [SPARK-47847][CORE] Deprecate spark.network.remoteReadNioBufferConversion [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/04/15 03:18:31 UTC, 5 replies.

- [PR] [SPARK-47848][SS] Fix thread safety issue around access to loadedMaps in close function for hdfs store provider [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/04/15 03:45:29 UTC, 4 replies.

- [PR] [SPARK-47849][PYTHON][CONNECT] Change release script to release pyspark-connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/15 03:57:39 UTC, 2 replies.

- [PR] [SPARK-47828][CONNECT][PYTHON][3.5] DataFrameWriterV2.overwrite fails with invalid plan [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/15 04:30:32 UTC, 2 replies.

- [PR] [SPARK-47828][CONNECT][PYTHON][3.4] DataFrameWriterV2.overwrite fails with invalid plan [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/15 04:33:45 UTC, 5 replies.

- [PR] [SPARK-47850][SQL][HIVE] Support converting insert for unpartitioned Hive table [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/04/15 04:47:14 UTC, 4 replies.

- [PR] [SPARK-47852][PYTHON] Support `DataFrameQueryContext` for reverse operations [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/04/15 06:31:45 UTC, 2 replies.

- [PR] [SPARK-47851][CONNECT][DOCS]Document pyspark-connect package [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/15 06:43:35 UTC, 0 replies.

- [PR] [WIP][SPARK-47760][SPARK-47763][CONNECT][TESTS] Reeanble Avro and Protobuf function doctests [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/15 06:58:53 UTC, 2 replies.

- Re: [PR] [SPARK-47851][CONNECT][DOCS] Document pyspark-connect package [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/15 07:07:44 UTC, 1 replies.

- [PR] [SPARK-47855][CONNECT] Warn `spark.sql.execution.arrow.pyspark.fallback.enabled` in Connect [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/15 07:27:49 UTC, 0 replies.

- Re: [PR] [SPARK-47850][SQL] Support `spark.sql.hive.convertInsertingUnpartitionedTable` [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/04/15 08:03:57 UTC, 9 replies.

- [PR] [WIP][SPARK-47584][SQL] SQL core: Migrate logWarn with variables to structured logging framework [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/15 08:12:56 UTC, 5 replies.

- [PR] [SQL] Fix test output [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/04/15 08:21:34 UTC, 0 replies.

- Re: [PR] [SPARK-47594] Connector module: Migrate logInfo with variables to structured logging framework [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/15 09:06:45 UTC, 11 replies.

- [PR] [SPARK-47856][SQL] Oracle: Document Mapping Spark SQL Data Types from Oracle [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/15 09:53:06 UTC, 0 replies.

- Re: [PR] [SPARK-47412][SQL] Add Collation Support for LPad/RPad. [spark] - posted by "GideonPotok (via GitHub)" <gi...@apache.org> on 2024/04/15 10:09:20 UTC, 48 replies.

- [PR] [SPARK-47081][CONNECT][FOLLOW] Unflake Progress Execution [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/04/15 10:22:38 UTC, 2 replies.

- Re: [PR] [SPARK-47420][SQL] Fix test output [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/04/15 10:41:55 UTC, 3 replies.

- [PR] [SPARK-47356][SQL] Add support for ConcatWs & Elt (all collations) [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/04/15 10:46:07 UTC, 2 replies.

- [PR] [SPARK-47857][SQL] Utilize java.sql.RowId.getBytes API directly for UTF8String [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/15 11:47:34 UTC, 0 replies.

- [PR] [SPARK-47858][PYTHON][SQL] Refactoring the structure for DataFrame error context [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/04/15 11:51:44 UTC, 6 replies.

- [PR] [WIP][SPARK-47819][CONNECT][3.5] Use asynchronous callback for execution cleanup [spark] - posted by "xi-db (via GitHub)" <gi...@apache.org> on 2024/04/15 12:36:26 UTC, 2 replies.

- Re: [PR] [WIP][SPARK-47858][PYTHON][SQL] Refactoring the structure for DataFrame error context [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/15 15:00:20 UTC, 4 replies.

- Re: [PR] [SPARK-47138] Implementing Processing Time StateTTL for Value State [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/04/15 16:18:36 UTC, 0 replies.

- Re: [PR] [SPARK-47857][SQL] Utilize `java.sql.RowId.getBytes` API directly for UTF8String [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/15 16:21:29 UTC, 4 replies.

- Re: [PR] [SPARK-46350][SS] Fix state removal for stream-stream join with one watermark and one time-interval condition [spark] - posted by "neilramaswamy (via GitHub)" <gi...@apache.org> on 2024/04/15 17:51:21 UTC, 8 replies.

- [PR] [SPARK-47838] Upgrade rocksdbjni to 8.11.4 [spark] - posted by "neilramaswamy (via GitHub)" <gi...@apache.org> on 2024/04/15 18:00:54 UTC, 0 replies.

- Re: [PR] [SPARK-47838][BUILD] Upgrade rocksdbjni to 8.11.4 [spark] - posted by "neilramaswamy (via GitHub)" <gi...@apache.org> on 2024/04/15 18:07:55 UTC, 11 replies.

- Re: [PR] [SPARK-47856][SQL] Document Mapping Spark SQL Data Types from Oracle and add tests [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/15 18:23:56 UTC, 1 replies.

- [PR] [SPARK-47860][BUILD][K8S] Upgrade `kubernetes-client` to 6.12.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/15 20:48:24 UTC, 4 replies.

- [PR] [SPARK-47861][BUILD] Upgrade `slf4j` to 2.0.13 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/15 20:57:00 UTC, 4 replies.

- [PR] [SPARK-47862][PYTHON][CONNECT]Fix generation of proto files [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/04/15 21:17:46 UTC, 6 replies.

- Re: [PR] [SPARK-47855][CONNECT] Add `spark.sql.execution.arrow.pyspark.fallback.enabled` in the unsupported list [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/15 23:40:42 UTC, 2 replies.

- [PR] [SPARK-46335][BUILD][3.5] Upgrade Maven to 3.9.6 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/16 00:15:21 UTC, 2 replies.

- Re: [PR] [SPARK-43394][BUILD] Upgrade maven to 3.8.8 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/16 00:29:27 UTC, 0 replies.

- [PR] [SPARK-47866][SQL][TESTS] Deflaky `PythonForeachWriterSuite` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/16 01:10:48 UTC, 0 replies.

- Re: [PR] [WIP][SPARK-47858][SPARK-47852][PYTHON][SQL] Refactoring the structure for DataFrame error context [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/04/16 02:05:01 UTC, 6 replies.

- [PR] [SPARK-47867][SQL] Support variant in JSON scan. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/04/16 02:17:19 UTC, 5 replies.

- Re: [PR] [SPARK-47866][SQL][TESTS] Use explicit GC in `PythonForeachWriterSuite` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/16 03:05:43 UTC, 3 replies.

- Re: [PR] [SPARK-47233][CONNECT][SS][2/2] Client & Server logic for Client side streaming query listener [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/16 03:17:39 UTC, 1 replies.

- [PR] [DO-NOT-REVIEW] Speed up test_parity_listener [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/04/16 04:09:48 UTC, 0 replies.

- Re: [PR] [SPARK-47858][SPARK-47852][PYTHON][SQL] Refactoring the structure for DataFrame error context [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/04/16 05:18:57 UTC, 26 replies.

- [PR] [SPARK-45387][SQL]Optimize hive patition filter when the comparision dataType not match [spark] - posted by "lastbus (via GitHub)" <gi...@apache.org> on 2024/04/16 06:58:01 UTC, 0 replies.

- [PR] [SPARK-47463][SQL][3.5] Use V2Predicate to wrap expression with return type of boolean [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/04/16 07:23:40 UTC, 3 replies.

- [PR] [SPARK-47868][CONNECT] Fix recursion limit error in SparkConnectPlanner and SparkSession [spark] - posted by "tomvanbussel (via GitHub)" <gi...@apache.org> on 2024/04/16 07:38:39 UTC, 8 replies.

- [PR] [SPARK-47416][SQL] Add new functions to CollationBenchmark [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/04/16 07:55:30 UTC, 19 replies.

- [PR] [DRAFT][SPARK-47414][SQL] Lowercase collation support for regexp expressions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/04/16 08:00:49 UTC, 7 replies.

- [PR] [SPARK-47596][DSTREAMS] Streaming: Migrate logWarn with variables to structured logging framework [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/16 08:51:55 UTC, 5 replies.

- [PR] [SPARK-47871][SQL] Oracle: Map TimestampType to TIMESTAMP WITH LOCAL TIME ZONE [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/16 10:21:47 UTC, 4 replies.

- [PR] Vladimirg db/fix test output [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/04/16 11:15:16 UTC, 1 replies.

- [PR] [SPARK-47418][SQL] Add hand-crafted implementations for lowercase uni… [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/04/16 11:37:38 UTC, 1 replies.

- [PR] [SPARK-47873][SQL] Write collated strings to Hive using the regular string type [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/04/16 11:44:39 UTC, 0 replies.

- [PR] Test 1234 [spark] - posted by "guixiaowen (via GitHub)" <gi...@apache.org> on 2024/04/16 12:07:55 UTC, 1 replies.

- [PR] [SPARK-47870][SQL] Optimize predicate after push extra predicate through join [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2024/04/16 12:35:59 UTC, 2 replies.

- Re: [PR] [SPARK-33822][SQL] Use the `CastSupport.cast` method in HashJoin [spark] - posted by "LeonidVasilyev (via GitHub)" <gi...@apache.org> on 2024/04/16 13:23:08 UTC, 1 replies.

- Re: [PR] [SPARK-38098][PYTHON] Add support for ArrayType of nested StructType to arrow-based conversion [spark] - posted by "LucaCanali (via GitHub)" <gi...@apache.org> on 2024/04/16 14:32:08 UTC, 0 replies.

- Re: [PR] [SPARK-47760][SPARK-47763][CONNECT][TESTS] Reeanble Avro and Protobuf function doctests [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/04/16 17:17:31 UTC, 2 replies.

- Re: [PR] [SPARK-47627][SQL] Add SQL MERGE syntax to enable schema evolution [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/04/16 17:53:08 UTC, 4 replies.

- [PR] [SPARK-47588][CORE] Hive module: Migrate logInfo with variables to structured logging framework [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/04/16 20:30:34 UTC, 8 replies.

- Re: [PR] [SPARK-47618][CORE] Use `Magic Committer` for all S3 buckets by default [spark] - posted by "steveloughran (via GitHub)" <gi...@apache.org> on 2024/04/16 20:48:46 UTC, 4 replies.

- Re: [PR] [SHUFFLE] [WIP] Prototype: store shuffle file on external storage like S3 [spark] - posted by "steveloughran (via GitHub)" <gi...@apache.org> on 2024/04/16 20:54:57 UTC, 1 replies.

- Re: [PR] [SPARK-47838][BUILD] Upgrade `rocksdbjni` to 8.11.4 [spark] - posted by "neilramaswamy (via GitHub)" <gi...@apache.org> on 2024/04/16 21:44:13 UTC, 3 replies.

- [PR] [SPARK-47875][CORE] Remove `spark.deploy.recoverySerializer` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/16 22:06:39 UTC, 6 replies.

- [PR] [SPARK-47876][PYTHON][DOCS] Improve docstring of mapInArrow [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/04/16 22:17:02 UTC, 4 replies.

- Re: [PR] [SPARK-47877][SS][CONNECT] Speed up test_parity_listener [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/04/16 22:51:11 UTC, 2 replies.

- [PR] [SPARK-46375][DOCS] Add user guide for Python data source API [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/04/16 23:31:40 UTC, 5 replies.

- [PR] [WIP][SPARK-47763][CONNECT][TESTS] Enable local-cluster tests with pyspark-connect package [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/17 00:49:36 UTC, 0 replies.

- [PR] [SPARK-47879][SQL] Oracle: Use VARCHAR2 instead of VARCHAR for VarcharType mapping [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/17 02:54:47 UTC, 3 replies.

- [PR] [SPARK-47880][SQL] Oracle: Document Mapping Spark SQL Data Types to Oracle [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/17 03:26:43 UTC, 3 replies.

- Re: [PR] [SPARK-47880][SQL][DOCS] Oracle: Document Mapping Spark SQL Data Types to Oracle [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/17 03:58:30 UTC, 2 replies.

- [PR] [SPARK-47882][SQL] createTableColumnTypes need to be mapped to database types instead of using directly [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/17 05:00:05 UTC, 6 replies.

- [PR] [SPARK-46812][CONNECT][PYTHON][FOLLOW-UP] Add pyspark.pyspark.sql.connect.resource into PyPi packaging [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/17 05:42:02 UTC, 2 replies.

- [PR] [SPARK-43025][SQL] Eliminate Union if filters have the same child plan [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2024/04/17 06:46:28 UTC, 0 replies.

- [PR] [SPARK-47883][SQL] Make `CollectTailExec.doExecute` lazy [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/17 06:46:49 UTC, 9 replies.

- [PR] [SPARK-47864][PYTHON][DOCS] Enhance "Installation" page to cover all installable options [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/04/17 07:09:15 UTC, 38 replies.

- [PR] [SPARK-47863][SQL] Fix startsWith & endsWith collation-aware implementation for ICU [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/04/17 07:31:01 UTC, 10 replies.

- Re: [PR] [SPARK-47584][SQL] SQL core: Migrate logWarn with variables to structured logging framework [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/17 07:32:42 UTC, 2 replies.

- Re: [PR] [SPARK-44444][SQL] Use ANSI SQL mode by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/17 08:20:10 UTC, 2 replies.

- [PR] [WIP][SPARK-47818][CONNECT][FOLLOW-UP] Introduce plan cache in SparkConnectPlanner to improve performance of Analyze requests [spark] - posted by "xi-db (via GitHub)" <gi...@apache.org> on 2024/04/17 08:22:26 UTC, 1 replies.

- [PR] [SPARK-47884][INFRA] Switch ANSI SQL CI job to NON-ANSI SQL CI job [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/17 08:24:54 UTC, 5 replies.

- [PR] [SPARK-47885][PYTHON][CONNECT] Make pyspark.resource compatible with pyspark-connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/17 08:50:55 UTC, 2 replies.

- [PR] [SPARK-47883][SQL] Make CollectTailExec.doExecute lazy with RowQueue [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/17 09:11:04 UTC, 2 replies.

- Re: [PR] [SPARK-47360][SQL] Collation support: Overlay, FormatString, Length, BitLength, OctetLength, SoundEx, Luhncheck [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/04/17 09:13:16 UTC, 15 replies.

- [PR] [SPARK-47886][SQL][DOCS][TESTS] Postgres: Add tests and doc for Postgres special numeric values [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/17 09:25:38 UTC, 1 replies.

- [PR] [FOLLOWUP][SPARK-47765] Disable SET COLLATION when collations are disabled [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/04/17 09:36:33 UTC, 0 replies.

- Re: [PR] [SPARK-47873][SQL] Write collated strings to Hive metastore using the regular string type [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/17 10:10:42 UTC, 28 replies.

- [PR] [SPARK-47352][SQL] Fix Upper, Lower, InitCap collation awareness [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/04/17 10:44:00 UTC, 6 replies.

- [PR] [SPARK-46810][DOCS][FOLLOWUP] Make file links clickable [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/17 11:58:49 UTC, 0 replies.

- Re: [PR] [SPARK-46810][DOCS][FOLLOWUP] Make some reference file links clickable [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/17 12:03:21 UTC, 6 replies.

- Re: [PR] [SPARK-47763][CONNECT][TESTS] Enable local-cluster tests with pyspark-connect package [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/17 12:16:42 UTC, 1 replies.

- Re: [PR] [SPARK-47818][CONNECT][FOLLOW-UP] Introduce plan cache in SparkConnectPlanner to improve performance of Analyze requests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/17 12:21:38 UTC, 4 replies.

- [PR] [SPARK-47887][CONNECT] Remove unused import `spark/connect/common.proto` from `spark/connect/relations.proto` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/04/17 12:51:28 UTC, 4 replies.

- Re: [PR] [SPARK-47765][SQL][FOLLOWUP] Disable SET COLLATION when collations are disabled [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/17 14:17:38 UTC, 1 replies.

- [PR] [SPARK-47889] Setup gradle as build tool for operator repository [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/04/17 19:51:19 UTC, 18 replies.

- [PR] [SPARK-47867][FOLLOWUP] Fix variant parsing in JacksonParser. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/04/17 21:00:47 UTC, 2 replies.

- Re: [PR] [SPARK-47418][SQL] Add hand-crafted implementations for lowercase unicode-aware contains, startsWith and endsWith and optimize UTF8_BINARY_LCASE [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/04/17 21:05:42 UTC, 36 replies.

- [PR] [SPARK-47891][PYTHON][DOCS] Improve docstring of mapInPandas [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/04/17 21:14:23 UTC, 5 replies.

- [PR] [SPARK-47803][FOLLOWUP] Fix cast binary/decimal to variant. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/04/17 21:49:39 UTC, 2 replies.

- [PR] [WIP] [SPARK-47893][BUILD] Upgrade ASM to 9.7 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/17 23:40:17 UTC, 2 replies.

- [PR] [SPARK-47894][CORE][WEBUI] Add `Environment` page to Master UI [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/18 00:05:58 UTC, 2 replies.

- Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/04/18 00:18:45 UTC, 1 replies.

- [PR] [WIP] test netty 4.1.109.Final [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/18 00:26:02 UTC, 1 replies.

- [PR] [SPARK-47895][SQL] group by all should be idempotent [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/18 05:45:43 UTC, 4 replies.

- Re: [PR] [SPARK-47896][BUILD] Upgrade netty to `4.1.109.Final` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/18 05:57:44 UTC, 1 replies.

- [PR] [SPARK-47897][SQL] Fix ExpressionSet performance regression in scala 2.12 [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/04/18 07:38:41 UTC, 1 replies.

- Re: [PR] [SPARK-47883][SQL] Make `CollectTailExec.doExecute` lazy with RowQueue [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/04/18 07:56:34 UTC, 4 replies.

- [PR] [SPARK-47898][SQL] Port HIVE-12270: Add DBTokenStore support to HS2 delegation token [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/18 08:00:31 UTC, 3 replies.

- Re: [PR] [WIP][SPARK-47596][DSTREAMS] Streaming: Migrate logWarn with variables to structured logging framework [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/18 08:57:08 UTC, 2 replies.

- [PR] [SPARK-47900] Fix check for implicit collation [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/04/18 09:05:28 UTC, 0 replies.

- [PR] [MINOR] Fix Python Liner [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/18 09:22:17 UTC, 0 replies.

- Re: [PR] [SPARK-47858][SPARK-47852][PYTHON][SQL][FOLLOWUP] Fix Python Liner [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/18 09:30:49 UTC, 3 replies.

- [PR] [SPARK-47816][CONNECT][DOCS][FOLLOWUP] refine the description [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/18 10:08:23 UTC, 2 replies.

- [PR] [MINOR][TESTS] Replace CONFIG_DIM1 with CONFIG_DIM2 in timestamp tests [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/18 11:18:29 UTC, 2 replies.

- Re: [PR] [SPARK-47897][SQL][3.5] Fix ExpressionSet performance regression in scala 2.12 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/18 14:47:04 UTC, 9 replies.

- Re: [PR] [SPARK-47893][BUILD] Upgrade ASM to 9.7 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/18 14:48:17 UTC, 0 replies.

- Re: [PR] [SPARK-25769][SPARK-34636][SPARK-34626][SQL] sql method in UnresolvedAttribute, AttributeReference and Alias don't quote qualified names properly. [spark] - posted by "IgorBerman (via GitHub)" <gi...@apache.org> on 2024/04/18 15:06:09 UTC, 0 replies.

- [PR] [SPARK-47902][SQL]Making Compute Current Time* expressions foldable [spark] - posted by "dbatomic (via GitHub)" <gi...@apache.org> on 2024/04/18 15:56:00 UTC, 6 replies.

- Re: [PR] [SPARK-47413][SQL] - add support to substr/left/right for collations [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/04/18 16:04:58 UTC, 7 replies.

- [PR] [AUTO][SC-162831][SPARK-47371][SQL][FOLLOWUP] XML: Stop ignoring CDATA within row tags [spark] - posted by "yhosny (via GitHub)" <gi...@apache.org> on 2024/04/18 16:30:17 UTC, 0 replies.

- [PR] [SPARK-47889][FOLLOWUP] Add `gradlew` to .licenserc.yaml [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/18 16:32:19 UTC, 0 replies.

- Re: [PR] [SPARK-47889][FOLLOWUP] Add `gradlew` to `.licenserc.yaml` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/18 16:34:05 UTC, 2 replies.

- [PR] [SPARK-47903][PySpark] Add support for remaining scalar types in the PySpark Variant library [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/04/18 20:29:53 UTC, 5 replies.

- [PR] [SPARK-47890][CONNECT][PYTHON] Add variant functions to Scala and Python. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/04/18 21:51:22 UTC, 19 replies.

- [PR] [SPARK-44461][FOLLOWUP][SS][CONNECT] Remove unneeded TODOs [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/04/18 21:59:35 UTC, 3 replies.

- [PR] [WIP] Testing that error is propagated to user upon deserialization [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/04/18 22:14:05 UTC, 8 replies.

- [PR] [SPARK-47904][SQL] Preserve case in Avro schema when using enableStableIdentifiersForUnionType [spark] - posted by "sadikovi (via GitHub)" <gi...@apache.org> on 2024/04/18 22:45:31 UTC, 8 replies.

- Re: [PR] [SPARK-47903][PYTHON] Add support for remaining scalar types in the PySpark Variant library [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/19 00:08:32 UTC, 7 replies.

- Re: [PR] [SPARK-47371][SQL][FOLLOWUP] XML: Stop ignoring CDATA within row tags [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/19 00:10:44 UTC, 1 replies.

- Re: [PR] Operator 0.1.0 [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/04/19 00:33:58 UTC, 10 replies.

- [PR] [SPARK-47901][BUILD] Upgrade common-text 1.12.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/04/19 03:50:55 UTC, 2 replies.

- [PR] [SPARK-47906][PYTHON][DOCS] Fix docstring and type hint of `hll_union_agg` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/19 04:29:21 UTC, 3 replies.

- [PR] [SPARK-47909][PYTHON][CONNECT] Parent DataFrame class for Spark Connect and Spark Classic [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/19 05:45:15 UTC, 20 replies.

- [PR] [WIP][SPARK-47604][CORE] Resource managers: Migrate logInfo with variables to structured logging framework [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/19 05:57:02 UTC, 11 replies.

- [PR] SPARK-47910; close stream when DiskBlockObjectWriter closeResources to avoid memory leak [spark] - posted by "JacobZheng0927 (via GitHub)" <gi...@apache.org> on 2024/04/19 06:46:16 UTC, 0 replies.

- [PR] [SPARK-47912][SQL] Infer serde class from format classes [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/04/19 07:44:36 UTC, 7 replies.

- [PR] [SPARK-47911][SQL] Introduces a universal BinaryFormatter to make binary output consistent [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/19 07:48:05 UTC, 2 replies.

- [PR] [WIP] Move `src/test/java/test/*` to `src/test/java/*` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/19 08:17:08 UTC, 0 replies.

- [PR] Fix subexpression elimination when equivalent ternary expressions have different children [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2024/04/19 08:35:44 UTC, 0 replies.

- [PR] [SPARK-47914][SQL] Do not display the splits parameter in Rang [spark] - posted by "guixiaowen (via GitHub)" <gi...@apache.org> on 2024/04/19 08:54:32 UTC, 3 replies.

- Re: [PR] [SPARK-46632][SQL] Fix subexpression elimination when equivalent ternary expressions have different children [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2024/04/19 09:20:17 UTC, 2 replies.

- [PR] [SPARK-47915][BUILD][K8S] Upgrade `kubernetes-client` to 6.12.1 [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2024/04/19 10:17:10 UTC, 2 replies.

- Re: [PR] [SPARK-47414][SQL] Lowercase collation support for regexp expressions [spark] - posted by "nikolamand-db (via GitHub)" <gi...@apache.org> on 2024/04/19 13:07:49 UTC, 12 replies.

- Re: [PR] [WIP][SPARK-47913][CORE][SQL][DSTREAMS][TESTS] Move `src/test/java/test/*` to `src/test/java/*` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/19 14:38:23 UTC, 0 replies.

- Re: [PR] [SPARK-47900] Fix check for implicit (UTF8_BINARY) collation [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/04/19 16:28:45 UTC, 3 replies.

- [PR] [WIP][SPARK-47907] Put bang under a config [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2024/04/19 17:21:45 UTC, 0 replies.

- [PR] [SPARK-47920] add doc for python streaming data source API [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2024/04/19 20:09:48 UTC, 2 replies.

- [PR] [SPARK-47921][CONNECT] Fix ExecuteJobTag creation in ExecuteHolder [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/04/19 20:53:46 UTC, 7 replies.

- [PR] Try parse json [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/04/19 21:34:41 UTC, 0 replies.

- [PR] [SPARK-47923][R] Upgrade the minimum version of `arrow` R package to 10.0.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/19 23:11:23 UTC, 2 replies.

- [PR] [WIP][SPARK-47672][SQL] Avoid double eval from filter pushDown w/ projection pushdown [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2024/04/20 00:14:55 UTC, 0 replies.

- Re: [PR] [SPARK-45709][BUILD] Deploy packages when all packages are built [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/04/20 00:18:32 UTC, 1 replies.

- Re: [PR] [SPARK-19335][SPARK-38200][SQL] Add upserts for writing to JDBC [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/04/20 00:18:33 UTC, 1 replies.

- Re: [PR] [SPARK-47922][SQL] Implement the try_parse_json expression [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/04/20 00:18:52 UTC, 4 replies.

- [PR] [SPARK-47924][CORE] Add a DEBUG log to `DiskStore.moveFileToBlock` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/20 00:29:06 UTC, 2 replies.

- [PR] [SPARK-47925][SQL][TESTS] Mark `BloomFilterAggregateQuerySuite` as `ExtendedSQLTest` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/20 00:54:04 UTC, 2 replies.

- [PR] [WIP] Only test rocksdbjni 9.x [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/20 01:10:29 UTC, 4 replies.

- Re: [PR] [SPARK-47907] Put bang under a config [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2024/04/20 02:00:06 UTC, 15 replies.

- [PR] [WIP] test java toUpperCase & toLowerCase [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/20 04:26:14 UTC, 2 replies.

- Re: [PR] [MINOR] Improve SparkPi example [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/04/20 12:29:36 UTC, 3 replies.

- Re: [PR] [SPARK-47573][K8S] Support custom driver log url [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/04/20 16:27:12 UTC, 0 replies.

- Re: [PR] [SPARK-47323][K8S] Support custom executor log urls [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/04/20 16:27:18 UTC, 0 replies.

- Re: [PR] [WIP][SPARK-46620][PS][CONNECT] Implement `Frame.asfreq` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/04/21 00:20:37 UTC, 1 replies.

- [PR] [MINOR][DOCS] Change `SPARK_ANSI_SQL_MODE`in PlanStabilitySuite documentation [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/21 06:58:50 UTC, 2 replies.

- Re: [PR] [DO-NOT-MERGE] Test Apache Hive 2.3.10 RC0 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/04/21 09:27:07 UTC, 8 replies.

- [PR] [SPARK-47730][K8S] Support APP_ID and EXECUTOR_ID placeholders in labels [spark] - posted by "jshmchenxi (via GitHub)" <gi...@apache.org> on 2024/04/21 12:50:10 UTC, 1 replies.

- Re: [PR] [SPARK-41469][CORE] Avoid unnecessary task rerun on decommissioned executor lost if shuffle data migrated [spark] - posted by "parthshyara (via GitHub)" <gi...@apache.org> on 2024/04/21 19:04:39 UTC, 1 replies.

- [PR] [SPARK-47928][SQL][TEST] Speed up test "Add jar support Ivy URI in SQL" [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/04/21 19:15:04 UTC, 8 replies.

- [PR] [SPARK-47600][CORE] MLLib: Migrate logInfo with variables to structured logging framework [spark] - posted by "zeotuan (via GitHub)" <gi...@apache.org> on 2024/04/21 23:01:15 UTC, 12 replies.

- [PR] [SPARK-47929]Setup Static Analysis for Operator [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/04/21 23:46:32 UTC, 11 replies.

- Re: [PR] [SPARK-47910][CORE] close stream when DiskBlockObjectWriter closeResources to avoid memory leak [spark] - posted by "JacobZheng0927 (via GitHub)" <gi...@apache.org> on 2024/04/22 02:08:18 UTC, 6 replies.

- [PR] [SPARK-47930][BUILD] Upgrade RoaringBitmap to 1.0.6 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/22 02:20:20 UTC, 7 replies.

- Re: [PR] [SPARK-47730][K8S] Support `APP_ID` and `EXECUTOR_ID` placeholders in labels [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/22 02:40:34 UTC, 8 replies.

- [PR] [SPARK-47931][SQL] Remove unused and leaked threadlocal/session sessionHive [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/22 03:54:36 UTC, 11 replies.

- Re: [PR] [SPARK-47018][BUILD] Upgrade built-in Hive to 2.3.10 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/22 03:56:54 UTC, 12 replies.

- Re: [PR] [SPARK-47633][SQL] Include right-side plan output in `LateralJoin#allAttributes` for more consistent canonicalization [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/22 04:45:59 UTC, 3 replies.

- [PR] [SPARK-47932][SQL][TEST] Avoid using legacy commons-lang [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/04/22 05:01:46 UTC, 4 replies.

- [PR] [SPARK-47933][PYTHON] Parent Column class for Spark Connect and Spark Classic [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/22 05:11:36 UTC, 7 replies.

- Re: [PR] [SPARK-47932][SQL][TESTS] Avoid using legacy commons-lang [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/04/22 06:48:18 UTC, 1 replies.

- [PR] [SPARK-47927][SQL]: Correct nullability attribute in udf decoder [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2024/04/22 06:59:31 UTC, 0 replies.

- [PR] [SPARK-47934] [CORE]  Ensure consistent trailing slashes in URL redirections [spark] - posted by "huangzhir (via GitHub)" <gi...@apache.org> on 2024/04/22 07:37:24 UTC, 0 replies.

- [PR] [WIP][SPARK-47350][SQL] Add collation support for SplitPart string expression [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/04/22 07:55:40 UTC, 0 replies.

- [PR] [SPARK-47935][INFRA][PYTHON] Pin `pandas==2.0.3` for `pypy3.8` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/22 08:28:21 UTC, 2 replies.

- [PR] [SPARK-44170][BUILD][FOLLOWUP] Clean up POM exclusion [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/04/22 08:59:46 UTC, 4 replies.

- Re: [PR] [WIP][SPARK-47936][BUILD] Improve `toUpperCase` & `toLowerCase` with `Locale.ROOT` rules [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/22 09:14:21 UTC, 8 replies.

- [PR] [WIP] remove outdated import [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/22 09:31:03 UTC, 0 replies.

- [PR] [SPARK-44305][SQL] Dynamically choose whether to broadcast hadoop conf [spark] - posted by "7mming7 (via GitHub)" <gi...@apache.org> on 2024/04/22 09:32:19 UTC, 3 replies.

- [PR] [SPARK-47937][PYTHON][DOCS] Fix docstring of `hll_sketch_agg` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/22 09:35:16 UTC, 11 replies.

- Re: [PR] [SPARK-44170][BUILD][FOLLOWUP] Align JUnit5 dependency's version and clean up exclusions [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/04/22 10:19:13 UTC, 8 replies.

- [PR] [SPARK-47938][SQL] MsSQLServer: Cannot find data type BYTE error [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/22 10:53:04 UTC, 5 replies.

- Re: [PR] [SPARK-47604][CORE] Resource managers: Migrate logInfo with variables to structured logging framework [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/22 11:55:41 UTC, 8 replies.

- [PR] [WIP][SPARK-47350][SQL] Add collation support for StringToMap & Mask string expressions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/04/22 12:04:34 UTC, 0 replies.

- Re: [PR] [SPARK-47411][SQL] Support StringInstr & FindInSet functions to work with collated strings [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/22 12:45:22 UTC, 1 replies.

- [PR] [WIP][SPARK-XXXXX][SQL] Enable hash join support for non-binary collations [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/04/22 13:44:21 UTC, 0 replies.

- Re: [PR] [SS] Allow chaining other stateful operators after transformWIthState operator. [spark] - posted by "sahnib (via GitHub)" <gi...@apache.org> on 2024/04/22 16:22:56 UTC, 7 replies.

- [PR] [SPARK-47940][BUILD][TESTS] Upgrade `guava` dependency to `33.1.0-jre` in Docker IT [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/22 17:31:58 UTC, 6 replies.

- Re: [PR] [SPARK-47941] [SS] [Connect] Propagate ForeachBatch worker initialization errors to users for PySpark [spark] - posted by "rangadi (via GitHub)" <gi...@apache.org> on 2024/04/22 18:16:37 UTC, 9 replies.

- [PR] [SPARK-47942][K8S][DOCS] Drop K8s v1.26 Support [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/22 20:52:06 UTC, 4 replies.

- Re: [PR] [SPARK-47907][SQL] Put bang under a config [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/04/22 20:53:22 UTC, 0 replies.

- [PR] [SPARK-47904][SQL][3.5] Preserve case in Avro schema when using enableStableIdentifiersForUnionType [spark] - posted by "sadikovi (via GitHub)" <gi...@apache.org> on 2024/04/22 21:41:39 UTC, 3 replies.

- Re: [PR] [WIP][MINOR] Remove unnecessary `imports` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/22 23:31:12 UTC, 1 replies.

- [PR] [CONNECT] Use v1 as spark connect go library starting version [spark-connect-go] - posted by "hiboyang (via GitHub)" <gi...@apache.org> on 2024/04/22 23:33:55 UTC, 14 replies.

- [PR] [SPARK-47903][PYTHON][FOLLOW-UP] Removed changes relating to try_parse_json [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/04/23 00:10:25 UTC, 3 replies.

- Re: [PR] [MINOR] Remove unnecessary `imports` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/23 00:36:39 UTC, 2 replies.

- [PR] [SPARK-47909][CONNECT][PYTHON][TESTS][FOLLOW-UP] Move `pyspark.classic` references [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/23 01:30:37 UTC, 2 replies.

- [PR] [SPARK-47944][BUILD] Upgrade icu4j to 75.1 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/23 02:17:48 UTC, 1 replies.

- Re: [PR] [SPARK-47936][BUILD] Improve `toUpperCase` & `toLowerCase` with `Locale.ROOT` rules [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/04/23 02:57:56 UTC, 3 replies.

- Re: [PR] [SPARK-47482] Add HiveDialect to sql module [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2024/04/23 03:37:39 UTC, 1 replies.

- [PR] [SPARK-47945][SQL] MsSQLServer: Document Mapping Spark SQL Data Types from Microsoft SQL Server and add tests [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/23 04:25:54 UTC, 8 replies.

- [PR] [SPARK-47943] Add Operator CI Task for Java Build and Test [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/04/23 04:51:14 UTC, 0 replies.

- Re: [PR] [SPARK-47929] Setup Static Analysis for Operator [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/23 05:42:29 UTC, 0 replies.

- Re: [PR] [SPARK-47943] Add `GitHub Action` CI for Java Build and Test [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/23 05:44:22 UTC, 1 replies.

- [PR] [SPARK-47864][FOLLOWUP][PYTHON][DOCS] Fix minor typo: "MLLib" -> "MLlib" [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/04/23 06:19:44 UTC, 3 replies.

- Re: [PR] [SPARK-47351][SQL] Add collation support for StringToMap & Mask string expressions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/23 06:20:37 UTC, 14 replies.

- [PR] [SPARK-47948][PYTHON] Bump Pandas to 2.0.0. [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/04/23 06:44:51 UTC, 0 replies.

- [PR] [SPARK-47949][SQL][DOCKER][TESTS] MsSQLServer: Bump up mssql docker image version to 2022-CU12-GDR1-ubuntu-22.04 [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/23 06:53:08 UTC, 3 replies.

- Re: [PR] [SPARK-47692][SQL] Fix default StringType meaning in implicit casting [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/23 06:54:04 UTC, 4 replies.

- [PR] [SPARK-47950] Add Java API Module for Spark Operator [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/04/23 07:05:10 UTC, 94 replies.

- [PR] [SPARK-47953][DOCS] MsSQLServer: Document Mapping Spark SQL Data Types to Microsoft SQL Server [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/23 07:34:47 UTC, 2 replies.

- [PR] [MINOR][DOCS] [MINOR][DOCS] Add `docs/_generated/` to .gitignore [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/23 07:50:31 UTC, 0 replies.

- [PR] [MINOR][DOCS] Fix type hint of 3 functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/23 08:15:23 UTC, 2 replies.

- [PR] [SPARK-46841] Add collation support for ICU locales and collation specifiers [spark] - posted by "nikolamand-db (via GitHub)" <gi...@apache.org> on 2024/04/23 08:28:58 UTC, 3 replies.

- [PR] [SPARK-47952][CORE][CONNECT] Support retrieving the real SparkConnectService GRPC address and port programmatically when running on Yarn [spark] - posted by "TakawaAkirayo (via GitHub)" <gi...@apache.org> on 2024/04/23 10:35:33 UTC, 13 replies.

- [PR] [SPARK-47955][SQL] Improve `DeduplicateRelations` performance [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2024/04/23 11:34:56 UTC, 16 replies.

- [PR] [SPARK-47954][K8S] Support creating ingress entry for external UI access [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/04/23 13:02:27 UTC, 37 replies.

- [PR] [SPARK-47956][SQL][MINOR] Sanity check for unresolved LCA reference [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/23 13:29:23 UTC, 0 replies.

- [PR] [WIP] Relax the type of MDC#key. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/04/23 13:57:08 UTC, 0 replies.

- Re: [PR] [MINOR][DOCS] Add `docs/_generated/` to .gitignore [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/23 14:41:43 UTC, 4 replies.

- Re: [PR] [SPARK-47948][PYTHON] Upgrade the minimum `Pandas` version to 2.0.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/23 14:47:03 UTC, 2 replies.

- Re: [PR] [WIP] Relax the type of `MDC#key` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/04/23 14:55:37 UTC, 2 replies.

- Re: [PR] [SPARK-47956][SQL] Sanity check for unresolved LCA reference [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/23 15:44:53 UTC, 1 replies.

- [PR] [SPARK-47958][TESTS] Change LocalSchedulerBackend to notify scheduler of executor on start [spark] - posted by "davintjong-db (via GitHub)" <gi...@apache.org> on 2024/04/23 16:05:52 UTC, 2 replies.

- [PR] [SPARK-47050][SQL] Collect and publish partition level metrics for V1 [spark] - posted by "snmvaughan (via GitHub)" <gi...@apache.org> on 2024/04/23 16:28:32 UTC, 9 replies.

- Re: [PR] [SPARK-47960][SS] Allow chaining other stateful operators after transformWIthState operator. [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/04/23 17:26:11 UTC, 23 replies.

- Re: [PR] [SPARK-47365][PYTHON] Add _toArrow() DataFrame method to PySpark [spark] - posted by "ianmcook (via GitHub)" <gi...@apache.org> on 2024/04/23 18:31:42 UTC, 1 replies.

- [PR] [DO-NOT-REVIEW] PySpark Dataframe doc test improvement [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/04/23 18:40:03 UTC, 0 replies.

- [PR] [SPARK-47633][SQL][3.5] Include right-side plan output in `LateralJoin#allAttributes` for more consistent canonicalization [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2024/04/23 19:50:19 UTC, 2 replies.

- [PR] [WIP] Ensure that ForeachBatch can use libraries imported externally [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/04/23 20:14:21 UTC, 1 replies.

- [PR] [SPARK-47597][STREAMING] Streaming: Migrate logInfo with variables to structured logging framework [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/04/23 21:47:38 UTC, 11 replies.

- Re: [PR] [SPARK-47583][CORE] SQL core: Migrate logError with variables to structured logging framework [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/04/23 22:14:31 UTC, 3 replies.

- Re: [PR] [REFERENCE][DO-NOT-MERGE] Implementation of python streaminng data source [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2024/04/23 23:22:25 UTC, 0 replies.

- [PR] [SPARK-47963][CORE][TESTS] Add an external LogKey usage case in UT [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/24 00:04:45 UTC, 6 replies.

- Re: [PR] [SPARK-45302][PYTHON] Remove PID communication between Python workers when no demon is used [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/24 00:45:19 UTC, 0 replies.

- [PR] [SPARK-47964][PYTHON][CONNECT] Hide SQLContext and HiveContext in pyspark-connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/24 00:57:36 UTC, 4 replies.

- [PR] Revert "[SPARK-45302][PYTHON] Remove PID communication between Pythonworkers when no demon is used" [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/24 01:03:36 UTC, 2 replies.

- [PR] [SPARK-47771][PYTHON][DOCS][TESTS][FOLLOWUP] Make `max_by, min_by` doctests deterministic [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/24 01:28:26 UTC, 2 replies.

- [PR] [SPARK-47965][CORE] Avoid orNull in TypedConfigBuilder [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/24 02:09:28 UTC, 0 replies.

- [PR] [SPARK-47933][PYTHON][CONNECT][FOLLOW-UP] Add a check of `__name__` at `_with_origin` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/24 02:47:43 UTC, 2 replies.

- [PR] [SPARK-47966][SQL] Remove ExperimentalMethods related code [spark] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2024/04/24 03:27:51 UTC, 3 replies.

- [PR] [MINOR][PYTHON][TESTS] Make `test_creation_index` deterministic [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/24 04:47:52 UTC, 0 replies.

- Re: [PR] [SPARK-47969][PYTHON][TESTS] Make `test_creation_index` deterministic [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/24 06:09:15 UTC, 2 replies.

- Re: [PR] [SPARK-47965][CORE] Avoid orNull in TypedConfigBuilder and OptionalConfigEntry [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/24 06:13:58 UTC, 3 replies.

- [PR] [SPARK-47967][SQL] Make JdbcUtils.makeGetter handle reading time type as NTZ correctly [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/24 06:37:53 UTC, 0 replies.

- Re: [PR] [SPARK-40193][SQL] Merge subquery plans with different filters [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2024/04/24 06:37:56 UTC, 4 replies.

- [PR] [SPARK-47971][PYTHON][CONNECT][TESTS] Reenable `PandasUDFGroupedAggParityTests. test_grouped_with_empty_partition` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/24 06:57:14 UTC, 1 replies.

- Re: [PR] [SPARK-47963][CORE] Make the external Spark ecosystem can use structured logging mechanisms [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/24 07:16:16 UTC, 31 replies.

- [PR] [SPARK-47973][CORE] Log call site in SparkContext.stop() and later in SparkContext.assertNotStopped() [spark] - posted by "bozhang2820 (via GitHub)" <gi...@apache.org> on 2024/04/24 08:39:35 UTC, 2 replies.

- Re: [PR] [SPARK-47971][PYTHON][CONNECT][TESTS] Reenable `PandasUDFGroupedAggParityTests.test_grouped_with_empty_partition` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/24 08:56:37 UTC, 1 replies.

- Re: [PR] [SPARK-47962][PYTHON][DOCS] PySpark Dataframe doc test improvement [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/24 09:21:35 UTC, 2 replies.

- [PR] [SPARK-47974][BUILD] Remove `install_scala` from `build/mvn` [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/04/24 10:35:32 UTC, 2 replies.

- [PR] [WIP][SPARK-47975][SQL] Add Collation Support for trim/ltrim/rtrim [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/24 11:37:42 UTC, 3 replies.

- Re: [PR] [SPARK-47819][CONNECT][3.5] Use asynchronous callback for execution cleanup [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/04/24 13:09:24 UTC, 0 replies.

- Re: [PR] [SPARK-47967][SQL] Make `JdbcUtils.makeGetter` handle reading time type as NTZ correctly [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/24 15:35:07 UTC, 2 replies.

- Re: [PR] [SPARK-46841][SQL] Add collation support for ICU locales and collation specifiers [spark] - posted by "nikolamand-db (via GitHub)" <gi...@apache.org> on 2024/04/24 15:55:57 UTC, 5 replies.

- [PR] [SPARK-46122][SQL] Disable spark.sql.legacy.createHiveTableByDefault by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/24 16:59:22 UTC, 0 replies.

- [PR] Update sql-ref-syntax-qry-select-setops.md [spark] - posted by "Legumolas (via GitHub)" <gi...@apache.org> on 2024/04/24 17:00:39 UTC, 2 replies.

- [PR] [SPARK-47939][SQL] Implement a new Analyzer rule to move ParameterizedQuery inside ExplainCommand and DescribeQueryCommand [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/04/24 19:34:03 UTC, 6 replies.

- Re: [PR] [CONNECT] [SPARK-47842] Use v1 as spark connect go library starting version [spark-connect-go] - posted by "hiboyang (via GitHub)" <gi...@apache.org> on 2024/04/24 21:50:09 UTC, 3 replies.

- [PR] [SPARK-47977] DateTimeUtils.timestampDiff and DateTimeUtils.timestampAdd should not throw INTERNAL_ERROR exception [spark] - posted by "vitaliili-db (via GitHub)" <gi...@apache.org> on 2024/04/24 21:54:30 UTC, 2 replies.

- [PR] [SPARK-47979][SQL][TESTS] Use Hive tables explicitly for Hive table capability tests [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/24 22:54:54 UTC, 7 replies.

- Re: [PR] [SPARK-42846][SQL] Integrate _LEGACY_ERROR_TEMP_2011 into UNEXPECTED_DATA_TYPE [spark] - posted by "HiuKwok (via GitHub)" <gi...@apache.org> on 2024/04/25 00:16:31 UTC, 0 replies.

- [PR] [SPARK-47580][SQL] SQL catalyst: eliminate unnamed variables in error logs [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/04/25 00:49:20 UTC, 8 replies.

- [PR] [SPARK-47980][SQL][TESTS] Reactivate test 'Empty float/double array columns raise EOFException' [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/25 02:37:22 UTC, 2 replies.

- Re: [PR] [SPARK-46122][SQL] Set `spark.sql.legacy.createHiveTableByDefault` to `false` by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/25 03:15:14 UTC, 5 replies.

- [PR] [SPARK-47531][BUILD] Upgrade `Arrow` to 16.0.0 [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/04/25 04:36:05 UTC, 0 replies.

- Re: [PR] [SPARK-47981][BUILD] Upgrade `Arrow` to 16.0.0 [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/25 05:29:11 UTC, 7 replies.

- [PR] [SPARK-47858][PYTHON][FOLLOWUP] Excluding Python magic methods from error context target [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/04/25 05:51:12 UTC, 6 replies.

- [PR] [SPARK-47982][BUILD] Update code style's plugins to latest version [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/25 05:53:29 UTC, 0 replies.

- [PR] [SPARK-47983][SQL] Demote spark.sql.pyspark.legacy.inferArrayTypeFromFirstElement.enabled to internal [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/25 06:13:10 UTC, 2 replies.

- Re: [PR] [SPARK-47982][BUILD] Update some code style's plugins to latest version [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/25 06:14:14 UTC, 5 replies.

- [PR] [SPARK-47984][MLLIB][SQL] Change `MetricsAggregate/V2Aggregator#serialize/deserialize` to call `SparkSerDeUtils#serialize/deserialize` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/04/25 06:43:58 UTC, 5 replies.

- Re: [PR] [SPARK-47984][ML][SQL] Change `MetricsAggregate/V2Aggregator#serialize/deserialize` to call `SparkSerDeUtils#serialize/deserialize` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/04/25 06:56:55 UTC, 4 replies.

- [PR] [SPARK-47985][PYTHON] Simplify functions with `lit` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/25 07:27:48 UTC, 2 replies.

- [PR] [SPARK-47987][PYTHON][CONNECT][TESTS] Reenable `ArrowParityTests.test_createDataFrame_empty_partition` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/25 08:11:21 UTC, 1 replies.

- [PR] [SPARK-47986][CONNECT][PYTHON] Unable to create a new session when the default session is closed by the server [spark] - posted by "nija-at (via GitHub)" <gi...@apache.org> on 2024/04/25 08:13:14 UTC, 5 replies.

- [PR] [SPARK-47988][SQL] When the collationId is invalid, throw `COLLATION_INVALID_ID` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/25 09:03:29 UTC, 6 replies.

- [PR] [SPARK-47361][SQL] MsSQLServer: Fix the scope of spark.sql.legacy.mssqlserver.numericMapping.enabled [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/25 09:25:07 UTC, 0 replies.

- [PR] [SPARK-45425][DOCS][FOLLOWUP] Add a migration guide for TINYINT type mapping change [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/25 09:34:43 UTC, 1 replies.

- Re: [PR] [SPARK-47987][PYTHON][CONNECT][TESTS] Enable `ArrowParityTests.test_createDataFrame_empty_partition` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/25 10:43:21 UTC, 5 replies.

- [PR] [SPARK-47990][BUILD] Upgrade `zstd-jni` to 1.5.6-3 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/25 10:56:46 UTC, 4 replies.

- [PR] [SPARK-47991][SQL][TEST] Arrange the test cases for window frames and window functions. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2024/04/25 11:34:04 UTC, 13 replies.

- [PR] Fix mathExpressions that use StringType [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/04/25 11:48:16 UTC, 2 replies.

- [PR] [SPARK-47993][PYTHON] Drop Python 3.8 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/25 11:58:36 UTC, 7 replies.

- [PR] [SPARK-47933][CONNECT][PYTHON][FOLLOW-UP] Avoid referencing _to_seq in `pyspark-connect` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/25 12:08:10 UTC, 2 replies.

- Re: [PR] [SPARK-47350][SQL] Add collation support for SplitPart string expression [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/04/25 13:35:54 UTC, 2 replies.

- Re: [PR] [SPARK-47989][SQL] MsSQLServer: Fix the scope of spark.sql.legacy.mssqlserver.numericMapping.enabled [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/25 15:18:24 UTC, 2 replies.

- [PR] [SPARK-47355][SQL] Use wildcard imports in CollationTypeCasts [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/04/25 15:26:24 UTC, 2 replies.

- [PR] [SPARK-47994][SQL] Fix bug with CASE WHEN column filter push down in SQLServer [spark] - posted by "stefanbuk-db (via GitHub)" <gi...@apache.org> on 2024/04/25 16:04:16 UTC, 9 replies.

- Re: [PR] [SPARK-47842][CONNECT] Use v1 as spark connect go library starting version [spark-connect-go] - posted by "hiboyang (via GitHub)" <gi...@apache.org> on 2024/04/25 17:11:26 UTC, 3 replies.

- [PR] [SPARK-47995][PYTHON][INFRA][TESTS] Upgrade `pyarrow` to 16.0.0 in GitHub Action CI [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/25 17:23:03 UTC, 1 replies.

- [PR] [SPARK-47999] Improve logging around snapshot creation and adding/removing entries from state cache map [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/04/25 21:13:59 UTC, 9 replies.

- [PR] [WIP][SPARK-47976][Python] Add built-in SQL function to call Python UDTF 'analyze' method and return output schema [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/04/25 21:17:07 UTC, 0 replies.

- Re: [PR] [SPARK-44953][CORE] Log a warning when shuffle tracking is enabled along side another DA supported mechanism [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2024/04/25 23:46:21 UTC, 2 replies.

- Re: [PR] [SPARK-44571][SQL] Eliminate the Join by combine multiple Aggregates [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/04/26 00:18:58 UTC, 2 replies.

- [PR] [SPARK-45225][SQL][FOLLOW-UP] XML: Fix nested XSD file path resolution [spark] - posted by "sandip-db (via GitHub)" <gi...@apache.org> on 2024/04/26 03:57:11 UTC, 2 replies.

- Re: [PR] [SPARK-47978][CONNECT] Use v1 as spark connect go library starting version [spark-connect-go] - posted by "hiboyang (via GitHub)" <gi...@apache.org> on 2024/04/26 04:21:27 UTC, 0 replies.

- [PR] [SPARK-47440][SQL][FOLLOWUP] Reenable predicate pushdown for syntax with boolean comparison in MsSqlServer [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/26 06:24:31 UTC, 5 replies.

- [PR] [SPARK-48002][PYTHON][SS] Add test for observed metrics in PySpark StreamingQueryListener [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/04/26 06:43:58 UTC, 3 replies.

- Re: [PR] [SPARK-47999][SS] Improve logging around snapshot creation and adding/removing entries from state cache map in HDFS backed state store provider [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/04/26 06:45:42 UTC, 0 replies.

- [PR] [SPARK-48001][CORE] Remove unused `private implicit def arrayToArrayWritable` from `SparkContext` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/04/26 06:49:36 UTC, 3 replies.

- [PR] [SPARK-47968][SQL] MsSQLServer: Map datatimeoffset to TimestampType [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/26 07:30:09 UTC, 3 replies.

- [PR] [SPARK-48004][SQL] Add WriteFilesExecBase trait for v1 write [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2024/04/26 08:19:55 UTC, 4 replies.

- Re: [PR] [SPARK-47927][SQL]: Fix nullability attribute in UDF decoder [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2024/04/26 08:27:32 UTC, 3 replies.

- [PR] [WIP][SPARK-48003][SQL] Add collation support for hll sketch aggregate [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/04/26 09:11:05 UTC, 1 replies.

- [PR] [SPARK-48005][PS][CONNECT][TESTS] Enable `DefaultIndexParityTests. test_index_distributed_sequence_cleanup` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/26 09:15:17 UTC, 0 replies.

- [PR] [SPARK-48006][SQL]add SortOrder for window function which has no orde… [spark] - posted by "guixiaowen (via GitHub)" <gi...@apache.org> on 2024/04/26 09:57:54 UTC, 0 replies.

- Re: [PR] [SPARK-47914][SQL] Do not display the splits parameter in Range [spark] - posted by "guixiaowen (via GitHub)" <gi...@apache.org> on 2024/04/26 10:06:38 UTC, 0 replies.

- [PR] [SPARK-48007][BUILD] MsSQLServer: upgrade mssql.jdbc.version to 12.6.1.jre11 [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/26 10:31:04 UTC, 1 replies.

- Re: [PR] [SPARK-47408][SQL] Fix mathExpressions that use StringType [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/26 11:37:16 UTC, 3 replies.

- [PR] [SPARK-48008][WIP] Support UDAFs in Spark Connect [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/04/26 11:38:04 UTC, 0 replies.

- [PR] [Only Test] [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/26 12:27:15 UTC, 0 replies.

- [PR] [Draft] - Testing of Streaming and Collations [spark] - posted by "dbatomic (via GitHub)" <gi...@apache.org> on 2024/04/26 14:48:51 UTC, 0 replies.

- Re: [PR] [SPARK-48007][BUILD][TESTS] Upgrade `mssql.jdbc` to `12.6.1.jre11` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/26 15:09:03 UTC, 2 replies.

- [PR] [SPARK-48010][SQL] Avoid repeated calls to conf.resolver in resolveExpression [spark] - posted by "nikhilsheoran-db (via GitHub)" <gi...@apache.org> on 2024/04/26 16:52:11 UTC, 2 replies.

- Re: [PR] [SPARK-48005][PS][CONNECT][TESTS] Enable `DefaultIndexParityTests.test_index_distributed_sequence_cleanup` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/26 16:59:00 UTC, 1 replies.

- [PR] [SPARK-48011][Core] Store LogKey name as a value to avoid generating new string instances [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/04/26 18:04:53 UTC, 5 replies.

- [PR] [SPARK-48014][SQL] Change the makeFromJava error in EvaluatePython to a user-facing error [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/04/26 20:37:57 UTC, 3 replies.

- [PR] [SPARK-48015] Update `build.gradle` to fix deprecation warnings [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/26 21:46:00 UTC, 3 replies.

- [PR] [SPARK-48016][SQL] Binary Arithmetic operators should include the evalMode when makeCopy [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/04/26 22:55:08 UTC, 3 replies.

- [PR] [Only test] test jersey 3.1.6 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/27 00:01:01 UTC, 0 replies.

- [PR] [SPARK-48018][SS] Fix null groupId causing missing param error when throwing KafkaException.couldNotReadOffsetRange [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2024/04/27 00:17:48 UTC, 2 replies.

- [PR] [SPARK-48017]Add Spark application submission worker for operator [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/04/27 00:34:13 UTC, 2 replies.

- [PR] [SPARK-48012][SQL] SPJ: Support Transfrom Expressions for One Side Shuffle [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2024/04/27 06:08:56 UTC, 2 replies.

- Re: [PR] [SPARK-47516][INFRA] Move `remove unused installation package logic` from `each test job` to `create the docker image` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/27 06:30:02 UTC, 1 replies.

- [PR] [SPARK-48020][INFRA][PYTHON] Pin 'pandas==2.2.2' [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/27 06:37:00 UTC, 4 replies.

- Re: [PR] [SPARK-48021][ML][BUILD] Add `--add-modules=jdk.incubator.vector` to `JavaModuleOptions` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/27 14:16:54 UTC, 9 replies.

- Re: [PR] [Don't review, only for test][SPARK-48022][BUILD] Upgrade `jersey` to `3.1.6` [spark] - posted by "HiuKwok (via GitHub)" <gi...@apache.org> on 2024/04/27 21:32:29 UTC, 1 replies.

- Re: [PR] [SPARK-46744][SPARK-SHELL][SQL][CONNECT][PYTHON][R] Display clear `exit command` for all spark terminal [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/04/28 00:21:09 UTC, 1 replies.

- Re: [PR] [SPARK-44635][CORE] Handle shuffle fetch failures in decommissions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/04/28 00:21:11 UTC, 1 replies.

- [PR] [SPARK-48024][PYTHON][CONNECT][TESTS] Enable `UDFParityTests.test_udf_timestamp_ntz` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/28 00:51:53 UTC, 2 replies.

- [PR] [Only for check Docker Image] Check installed packages on ubuntu 22.04 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/28 02:01:33 UTC, 0 replies.

- [PR] [SPARK-48021][ML][BUILD][FOLLOWUP] add `--add-modules=jdk.incubator.vector` to maven compile args [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/28 02:56:26 UTC, 6 replies.

- Re: [PR] [SPARK-48019] Fix incorrect behavior in ColumnVector/ColumnarArray with dictionary and nulls [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/28 03:06:35 UTC, 1 replies.

- [PR] [SPARK-47292][SS] safeMapToJValue should consider null typed values  [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/04/28 04:00:38 UTC, 4 replies.

- [PR] [SPARK-48025][SQL][TESTS] Fix org.apache.spark.sql.execution.benchmark.DateTimeBenchmark [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/28 07:17:35 UTC, 7 replies.

- [PR] [SPARK-47933][CONNECT][PYTHON][FOLLOW-UP] Remove `pyspark.sql.classic` reference in `pyspark.ml.stat` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/28 08:51:07 UTC, 3 replies.

- [PR] [SPARK-48027][SQL] InjectRuntimeFilter for multi-level join should check child join type [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2024/04/28 10:37:56 UTC, 12 replies.

- [PR] [SPARK-47585][SQL] SQL core: Migrate logInfo with variables to structured logging framework [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/28 11:45:02 UTC, 37 replies.

- [PR] [SPARK-48030][SQL]SPJ: cache rowOrdering and structType for InternalRowComparableWrapper [spark] - posted by "advancedxy (via GitHub)" <gi...@apache.org> on 2024/04/28 12:35:25 UTC, 7 replies.

- [PR] [WIP][SPARK-48028][TESTS] Regenerate benchmark results after turning ANSI on [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/28 13:28:15 UTC, 9 replies.

- [PR] [WIP][SPARK-48031] view evolution [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2024/04/28 18:02:57 UTC, 0 replies.

- [PR] [SPARK-48032][BUILD] Upgrade `commons-codec` to 1.17.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/28 23:30:43 UTC, 2 replies.

- Re: [PR] [TEST ONLY][SQL] Test resolve column references with PLAN_ID [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/04/29 00:19:27 UTC, 1 replies.

- Re: [PR] [SPARK-48029][INFRA] Update the packages name removed in building the spark docker image [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/29 00:20:02 UTC, 2 replies.

- [PR] [SPARK-48033][VARIANT] Fix `RuntimeReplaceable` expressions being used in default columns [spark] - posted by "richardc-db (via GitHub)" <gi...@apache.org> on 2024/04/29 00:48:29 UTC, 0 replies.

- [PR] [SPARK-48034][TESTS] NullPointerException in MapStatusesSerDeserBenchmark [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/29 02:10:07 UTC, 7 replies.

- [PR] [SPARK-48036][DOCS] Update `sql-ref-ansi-compliance.md` and `sql-ref-identifier.md` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/29 03:01:12 UTC, 10 replies.

- [PR] [SPARK-46009][SQL][FOLLOWUP] Remove unused PERCENTILE_CONT and PERCENTILE_DISC in g4 [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2024/04/29 03:48:17 UTC, 0 replies.

- [PR] [SPARK-48037][CORE] Fix SortShuffleWriter lacks shuffle write related metrics resulting in potentially inaccurate data [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/04/29 04:34:47 UTC, 3 replies.

- [PR] [MINOR][DOCS] Remove space in the middle of configuration name in Arrow-optimized Python UDF page [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/29 04:56:14 UTC, 2 replies.

- [PR] [SPARK-48002][PYTHON][SS][TESTS] Adds sleep before event testing after query termination [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/29 06:51:04 UTC, 3 replies.

- [PR] [SPARK-48038][K8S] Promote driverServiceName to KubernetesDriverConf [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/04/29 08:01:14 UTC, 2 replies.

- [PR] [SPARK-48039][PYTHON][CONNECT] Update the error class for `group.apply` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/29 09:16:49 UTC, 3 replies.

- [PR] Spark connect supports scheduler pool [spark] - posted by "xieshuaihu (via GitHub)" <gi...@apache.org> on 2024/04/29 09:48:28 UTC, 0 replies.

- [PR] [SPARK-48041][SQL] Avoid repeated calls to conf.resolver in Analyzer [spark] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/04/29 10:03:00 UTC, 3 replies.

- Re: [PR] [SPARK-48040][CONNECT]Spark connect supports scheduler pool [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/29 10:04:04 UTC, 9 replies.

- [PR] [DRAFT] New delta schema [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/04/29 10:13:18 UTC, 0 replies.

- Re: [PR] [SPARK-48041][SQL] Avoid repeated calls to conf.resolver in TableOutputResolver [spark] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/04/29 10:28:46 UTC, 0 replies.

- Re: [PR] [DRAFT] Store collation information in metadata and not in type for SER/DE [spark] - posted by "olaky (via GitHub)" <gi...@apache.org> on 2024/04/29 10:28:52 UTC, 0 replies.

- [PR] [SPARK-48044][PYTHON][CONNECT] Cache `DataFrame.isStreaming` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/29 11:20:30 UTC, 3 replies.

- Re: [PR] [SPARK-48041][SQL] Avoid call conf.resolver repeated in TableOutputResolver [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/29 11:46:56 UTC, 3 replies.

- [PR] [SPARK-48042][SQL] Don't use a copy of timestamp formatter with a new override zone for each value [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/29 13:54:29 UTC, 2 replies.

- Re: [PR] [SPARK-48003][SQL] Add collation support for hll sketch aggregate [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/29 14:06:42 UTC, 2 replies.

- [PR] [SPARK-47693][TESTS][FOLLOWUP] Reduce CollationBenchmarks time [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/29 15:22:12 UTC, 4 replies.

- [PR] [SPARK-48046][K8S] Remove `clock` parameter from `DriverServiceFeatureStep` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/29 15:39:11 UTC, 4 replies.

- Re: [PR] [SPARK-47976][Python] Add Python UDTF DataFrame API to return result of 'analyze' method as output table [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/04/29 16:40:58 UTC, 2 replies.

- Re: [PR] [SPARK-48042][SQL] Use a timestamp formatter with timezone at class level instead of making copies at method level [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/04/29 17:05:20 UTC, 3 replies.

- [PR] [SPARK-48047][SQL] Reduce memory pressure of empty TreeNode tags [spark] - posted by "n-young-db (via GitHub)" <gi...@apache.org> on 2024/04/29 18:25:15 UTC, 12 replies.

- [PR] [SPARK-48016][SQL] Fix a bug in try_divide function when with decimals [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/04/29 19:08:59 UTC, 7 replies.

- Re: [PR] [SPARK-24497][SQL] Support recursive SQL [spark] - posted by "SvenRelijveld1995 (via GitHub)" <gi...@apache.org> on 2024/04/29 19:27:49 UTC, 0 replies.

- [PR] [SPARK-48048] Added client side listener support for Scala [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2024/04/29 20:17:08 UTC, 2 replies.

- [PR] [WIP][SPARK-48049][BUILD] Upgrade Scala to 2.13.14 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/29 23:33:49 UTC, 3 replies.

- Re: [PR] [SPARK-48016][SQL][3.4] Fix a bug in try_divide function when with decimals [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/30 00:08:58 UTC, 3 replies.

- Re: [PR] [SPARK-48033][SQL] Fix `RuntimeReplaceable` expressions being used in default columns [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/30 00:28:28 UTC, 2 replies.

- [PR] [SPARK-47129][CONNECT][SQL][3.4] Make ResolveRelations cache connect plan properly [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/30 01:43:35 UTC, 3 replies.

- [PR] [SPARK-47129][CONNECT][SQL][3.5] Make ResolveRelations cache connect plan properly [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/30 01:44:37 UTC, 5 replies.

- Re: [PR] [SPARK-48040][CONNECT][WIP]Spark connect supports scheduler pool [spark] - posted by "xieshuaihu (via GitHub)" <gi...@apache.org> on 2024/04/30 01:48:34 UTC, 3 replies.

- [PR] [SPARK-47650][SS] Log logical plan at query start [spark] - posted by "fanyue-xia (via GitHub)" <gi...@apache.org> on 2024/04/30 01:58:08 UTC, 0 replies.

- [PR] [SPARK-48051][SQL] Add golden table variant tests written by different engines [spark] - posted by "richardc-db (via GitHub)" <gi...@apache.org> on 2024/04/30 03:05:14 UTC, 0 replies.

- [PR] [SPARK-48052][PYTHON][CONNECT] Recover `pyspark-connect` CI by parent classes [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/30 04:14:18 UTC, 2 replies.

- Re: [PR] [SPARK-48030][SQL] SPJ: cache rowOrdering and structType for InternalRowComparableWrapper [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2024/04/30 04:26:38 UTC, 2 replies.

- [PR] [SPARK-48053][PYTHON][CONNECT] SparkSession.createDataFrame should warn for unsupported options [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/30 04:28:36 UTC, 2 replies.

- [PR] [SPARK-48055][PYTHON][CONNECT][TESTS] Enable `PandasUDFScalarParityTests.{test_vectorized_udf_empty_partition, test_vectorized_udf_struct_with_empty_partition}` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/30 05:00:54 UTC, 3 replies.

- Re: [PR] [SPARK-48017] Add Spark application submission worker for operator [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/04/30 05:02:39 UTC, 2 replies.

- [PR] [WIP][SPARK-48056][CONNECT][PYTHON] Reset original request if a SESSION_NOT_FOUND error is raised and no partial response was received [spark] - posted by "nija-at (via GitHub)" <gi...@apache.org> on 2024/04/30 05:06:51 UTC, 0 replies.

- [PR] [SPARK-48054][PYTHON][CONNECT][INFRA] Backward compatibility test for Spark Connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/04/30 06:30:48 UTC, 16 replies.

- Re: [PR] [SPARK-48056][CONNECT][PYTHON] Re-execute plan if a SESSION_NOT_FOUND error is raised and no partial response was received [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/04/30 08:30:26 UTC, 3 replies.

- Re: [PR] [SPARK-47566][SQL] Support SubstringIndex function to work with collated strings [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/04/30 09:18:24 UTC, 4 replies.

- [PR] [SPARK-48057][PYTHON][CONNECT][TESTS] Enable `GroupedApplyInPandasTests. test_grouped_with_empty_partition` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/30 10:29:15 UTC, 0 replies.

- [PR] [WIP][SPARK-48058][PYTHON][CONNECT] `UserDefinedFunction.returnType` parse the DDL string [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/04/30 10:44:28 UTC, 2 replies.

- [PR] [SPARK-48059][CORE] Implement the structured log framework on the java side [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/04/30 11:45:22 UTC, 5 replies.

- [PR] [SPARK-47764][FOLLOW-UP][WIP] Change to use ShuffleDriverComponents.removeShuffle to remove shuffle properly [spark] - posted by "bozhang2820 (via GitHub)" <gi...@apache.org> on 2024/04/30 12:36:36 UTC, 0 replies.

- Re: [PR] [SPARK-48050][SS] Log logical plan at query start [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/04/30 12:48:23 UTC, 2 replies.

- [PR] [SPARK-47788][SS][TESTS][FOLLOWUP] Make `StreamingQueryHashPartitionVerifySuite` independent from SparkConf change [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/30 16:00:15 UTC, 1 replies.

- [PR] [SPARK-48060][SS][TESTS] Fix StreamingQueryHashPartitionVerifySuite to update golden files correctly [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/30 16:34:23 UTC, 0 replies.

- [PR] [SPARK-48061][SQL][TESTS] Parameterize max limits of `spark.sql.test.randomDataGenerator` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/30 16:48:42 UTC, 3 replies.

- Re: [PR] [SPARK-48028][TESTS] Regenerate benchmark results after turning ANSI on [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/30 17:21:51 UTC, 13 replies.

- [PR] [SPARK-48062] add pyspark test for SimpleDataSourceStreamingReader [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2024/04/30 17:50:52 UTC, 1 replies.

- [PR] [SPARK-48035] Fix try_add/try_multiply being semantic equal to add/multiply [spark] - posted by "db-scnakandala (via GitHub)" <gi...@apache.org> on 2024/04/30 18:19:33 UTC, 0 replies.

- Re: [PR] [SPARK-48057][PYTHON][CONNECT][TESTS] Enable `GroupedApplyInPandasTests.test_grouped_with_empty_partition` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/30 19:19:23 UTC, 0 replies.

- Re: [PR] [SPARK-48060][SS][TESTS] Fix `StreamingQueryHashPartitionVerifySuite` to update golden files correctly [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/30 19:41:17 UTC, 2 replies.

- [PR] [SPARK-48063][CORE] Enable `spark.stage.ignoreDecommissionFetchFailure` by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/04/30 20:18:43 UTC, 4 replies.

- [PR] [SPARK-47578][CORE] Spark Core: Migrate logWarning with variables to structured logging framework [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/04/30 20:34:24 UTC, 43 replies.

- [PR] [SPARK-48064][SQL] Update error messages for routine related error classes [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/04/30 20:58:30 UTC, 1 replies.

- [PR] [SPARK-45891][FOLLOW-UP] Added length check to the is_variant_null expression [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/04/30 22:07:22 UTC, 0 replies.