reviews@spark.apache.org, 2024-10

You are viewing a plain text version of this content. The canonical link for it is here.

- Re: [PR] [SPARK-49889][PYTHON] Add argument `trim` for functions`trim/ltrim/rtrim` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/10/08 14:44:08 UTC, 2 replies.
- [PR] [SPARK-49542] Partition transform exception evaluate error [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2024/10/08 15:24:36 UTC, 0 replies.
- [PR] fix: Row FieldNames() memory allocation [spark-connect-go] - posted by "paulheg (via GitHub)" <gi...@apache.org> on 2024/10/08 15:32:28 UTC, 7 replies.
- Re: [PR] [SPARK-49903][BUILD] Upgrade `Parquet` to 1.14.3 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/08 15:39:33 UTC, 1 replies.
- Re: [PR] [SPARK-49901][BUILD] Upgrade dropwizard metrics to 4.2.28 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/08 15:42:27 UTC, 0 replies.
- Re: [PR] [SPARK-49723][SQL] Add Variant metrics to the JSON File Scan node [spark] - posted by "gene-db (via GitHub)" <gi...@apache.org> on 2024/10/08 16:11:59 UTC, 6 replies.
- Re: [PR] [SPARK-49259][SS]Size based partition creation during kafka read [spark] - posted by "SubhamSinghal (via GitHub)" <gi...@apache.org> on 2024/10/08 16:34:12 UTC, 5 replies.
- Re: [PR] [SPARK-49857][SQL] Add storageLevel to Dataset localCheckpoint API [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2024/10/08 16:40:05 UTC, 5 replies.
- Re: [PR] Revert "[SPARK-49808][SQL] Fix a deadlock in subquery execution due o lazy vals" [spark] - posted by "tedyu (via GitHub)" <gi...@apache.org> on 2024/10/08 17:29:04 UTC, 0 replies.
- Re: [PR] [SPARK-49821][SS][PYTHON] Implement MapState and TTL support for TransformWithStateInPandas [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/10/08 17:43:34 UTC, 16 replies.
- Re: [PR] [SPARK-49661][SQL] Implement trim collation hashing and comparison. [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/10/08 17:47:09 UTC, 49 replies.
- Re: [PR] [SPARK-47336][SQL][CONNECT] Provide to PySpark a functionality to get estimated size of DataFrame in bytes [spark] - posted by "SemyonSinchenko (via GitHub)" <gi...@apache.org> on 2024/10/08 18:27:47 UTC, 1 replies.
- Re: [PR] [SPARK-49854][SQL] Clone artifact manager during session clone [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/10/08 19:29:46 UTC, 23 replies.
- [I] Add test for Row type [spark-connect-go] - posted by "Elbehery (via GitHub)" <gi...@apache.org> on 2024/10/08 19:32:57 UTC, 1 replies.
- [PR] fix: add unit tests to Row [spark-connect-go] - posted by "Elbehery (via GitHub)" <gi...@apache.org> on 2024/10/08 20:27:45 UTC, 5 replies.
- Re: [PR] [SPARK-49549][SQL] Assign a name to the error conditions _LEGACY_ERROR_TEMP_3055, 3146 [spark] - posted by "mrk-andreev (via GitHub)" <gi...@apache.org> on 2024/10/08 20:28:36 UTC, 12 replies.
- Re: [PR] [SPARK-49411][SS] Communicate State Store Checkpoint ID between driver and stateful operators [spark] - posted by "brkyvz (via GitHub)" <gi...@apache.org> on 2024/10/08 22:39:47 UTC, 13 replies.
- Re: [PR] [SPARK-49564][SQL] Add SQL pipe syntax for set operations [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/10/08 23:26:34 UTC, 2 replies.
- Re: [PR] [SPARK-49863][SQL] Fix NormalizeFloatingNumbers to preserve nullability of nested structs [spark] - posted by "nikhilsheoran-db (via GitHub)" <gi...@apache.org> on 2024/10/09 00:58:39 UTC, 2 replies.
- Re: [PR] [SPARK-49906][SQL] Introduce and use CONFLICTING_DIRECTORY_STRUCTURES error for PartitioningUtils [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/09 01:12:00 UTC, 1 replies.
- Re: [PR] [SPARK-49569][CONNECT][SQL] Add shims to support SparkContext and RDD [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/10/09 01:23:40 UTC, 2 replies.
- Re: [PR] [SPARK-49895][SQL] Improve error when encountering trailing comma in SELECT clause [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/09 01:30:42 UTC, 2 replies.
- Re: [PR] [SPARK-49022][CONNECT][SQL][FOLLOW-UP] Parse unresolved identifier to keep the behavior same [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/09 02:34:57 UTC, 2 replies.
- [PR] [MINOR][PYTHON][TESTS] Reduce the python worker error log of `test_toDF_with_schema_string` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/09 03:10:01 UTC, 2 replies.
- Re: [PR] [SPARK-49506][SQL] Optimize ArrayBinarySearch for foldable array [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/09 03:35:39 UTC, 21 replies.
- [PR] [MINOR][SQL] Improved broadcast timeout message prompt [spark] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2024/10/09 03:50:31 UTC, 2 replies.
- [PR] [SPARK-49711][SQL] Remove ExperimentalMethods [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/10/09 04:06:20 UTC, 3 replies.
- Re: [PR] [SPARK-49816][SQL] Should only update out-going-ref-count for referenced outer CTE relation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/10/09 05:18:52 UTC, 3 replies.
- Re: [PR] [SPARK-49491][SQL] Replace AnyRefMap with HashMap [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/09 06:02:54 UTC, 2 replies.
- Re: [PR] [SPARK-49782][SQL] ResolveDataFrameDropColumns rule resolves UnresolvedAttribute with child output [spark] - posted by "LantaoJin (via GitHub)" <gi...@apache.org> on 2024/10/09 06:31:17 UTC, 2 replies.
- Re: [PR] [SPARK-48652][SQL] Fix casting issue in Spark SQL when comparing string column to integer value [spark] - posted by "abhiips07 (via GitHub)" <gi...@apache.org> on 2024/10/09 06:53:04 UTC, 1 replies.
- Re: [PR] [SPARK-49908][SQL] Assign proper error condition for _LEGACY_ERROR_TEMP_0044 [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/09 07:34:54 UTC, 4 replies.
- Re: [PR] [SPARK-49904][SQL] Assign proper error condition for _LEGACY_ERROR_TEMP_2140 [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/09 07:35:31 UTC, 5 replies.
- Re: [PR] [SPARK-37178][ML] Add Target Encoding to ml.feature [spark] - posted by "rebo16v (via GitHub)" <gi...@apache.org> on 2024/10/09 07:40:14 UTC, 39 replies.
- Re: [PR] [SPARK-49909][SQL] Fix the pretty name of some expressions [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/09 08:04:27 UTC, 7 replies.
- Re: [PR] [SPARK-49542][SQL] Partition transform exception evaluate error [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/09 08:17:52 UTC, 3 replies.
- Re: [PR] [SPARK-49902][SQL] Catch underlying runtime errors in RegExpReplace [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/09 08:26:03 UTC, 20 replies.
- [PR] [SPARK-49808][SQL] Fix a deadlock in subquery execution due to lazy vals [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/09 08:32:52 UTC, 24 replies.
- Re: [PR] [SPARK-49891][SQL] Assign proper error condition for _LEGACY_ERROR_TEMP_2271 [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/09 08:32:58 UTC, 3 replies.
- Re: [PR] [SPARK-49873][SQL] Assign proper error class for _LEGACY_ERROR_TEMP_1325 [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/09 08:38:18 UTC, 4 replies.
- [PR] [SPARK-43838][SQL][FOLLOWUP] Replace `HashSet` with `HashMap` to improve performance of `DeduplicateRelations` [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2024/10/09 09:04:28 UTC, 2 replies.
- [PR] [SPARK-49909][SQL][3.5] Fix the pretty name of some expressions [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/09 09:27:15 UTC, 3 replies.
- [PR] add option function to spark read [spark-connect-go] - posted by "amkarkhi (via GitHub)" <gi...@apache.org> on 2024/10/09 10:48:52 UTC, 5 replies.
- [PR] BTC [spark] - posted by "09306677806 (via GitHub)" <gi...@apache.org> on 2024/10/09 11:04:11 UTC, 1 replies.
- [PR] [WIP][SPARK-49915][SQL] Handle zeros and ones in ReorderAssociativeOperator [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/10/09 11:30:53 UTC, 1 replies.
- Re: [PR] [SPARK-49418][CONNECT][SQL] Shared Session Thread Locals [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/10/09 12:55:27 UTC, 1 replies.
- Re: [PR] [SPARK-49892][SQL] Assign proper error class for _LEGACY_ERROR_TEMP_1136 [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/09 13:34:19 UTC, 4 replies.
- Re: [PR] [SPARK-49856][SQL] Refactor the compileExpression of JdbcDialect for simplify the subclass. [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/10/09 13:52:12 UTC, 1 replies.
- [PR] [SPARK-49909][SQL][3.4] Fix the pretty name of some expressions [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/09 14:16:55 UTC, 2 replies.
- [PR] [SPARK-49916][SQL] Throw appropriate Exception for type mismatch between ColumnType and data type in some rows [spark] - posted by "RaleSapic (via GitHub)" <gi...@apache.org> on 2024/10/09 14:17:57 UTC, 9 replies.
- [PR] [SPARK-49615] Make spark ML dataset column selection conforming with `spark.sql.caseSensitive` config [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2024/10/09 14:20:57 UTC, 4 replies.
- Re: [PR] [SPARK-42838][SQL] Assign a name to the error class _LEGACY_ERROR_TEMP_2000 [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/09 14:25:30 UTC, 2 replies.
- [PR] [SPARK-49569][BUILD][FOLLOWUP] Add maven dep: scala-compiler [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/10/09 14:57:03 UTC, 1 replies.
- [PR] [SPARK-49917][SQL] Enable hash join rewrite rule for collated strings [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/10/09 15:26:51 UTC, 4 replies.
- Re: [PR] [SPARK-49569][BUILD][FOLLOWUP] Adds `scala-library` maven dependency to the `spark-connect-shims` module to fix Maven build errors [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/10/09 15:30:34 UTC, 6 replies.
- [PR] [WIP] Avrfo [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/10/09 16:59:29 UTC, 0 replies.
- [PR] Add column.getItem to Columns [spark-connect-go] - posted by "magpierre (via GitHub)" <gi...@apache.org> on 2024/10/09 17:42:43 UTC, 0 replies.
- Re: [PR] [SPARK-49748][CORE] Add `getCondition` and deprecate `getErrorClass` in `SparkThrowable` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/09 17:44:14 UTC, 2 replies.
- [PR] [CORE] Use read-only access to conf in `SparkContext` where appropriate [spark] - posted by "pmenon (via GitHub)" <gi...@apache.org> on 2024/10/09 18:38:07 UTC, 0 replies.
- [PR] Test Maven Build [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/10/09 18:56:02 UTC, 2 replies.
- Re: [PR] [SPARK-49461][SS] Persistent Checkpoint ID to commit logs and read it back [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2024/10/09 22:37:06 UTC, 11 replies.
- Re: [PR] [SPARK-48739][SQL] Disable writing collated data to file formats that don't support them in non managed tables [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/10 00:23:39 UTC, 1 replies.
- Re: [PR] [SPARK-48696][SQL][CONNECT] Also truncate the schema row for show function [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/10 00:23:40 UTC, 1 replies.
- Re: [PR] [SPARK-48694][CORE]Manage memory used by external cache [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/10 00:23:41 UTC, 1 replies.
- Re: [PR] [SPARK-48669][K8S] K8s resource name prefix follows `DNS Subdomain Names` rule [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/10 00:23:42 UTC, 1 replies.
- Re: [PR] [SPARK-48667][PYTHON] Arrow python UDFS didn't support UDT as outputType [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/10 00:23:43 UTC, 1 replies.
- Re: [PR] [SPARK-40193][SQL] Merge subquery plans with different filters [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/10 00:23:44 UTC, 0 replies.
- Re: [PR] [SPARK-49905][SQL][SS] Use different ShuffleOrigin for the shuffle required from stateful operators [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/10/10 00:51:28 UTC, 1 replies.
- Re: [PR] [SPARK-49829][SS] Revise the optimization on adding input to state store in stream-stream join (correctness fix) [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/10/10 01:20:54 UTC, 14 replies.
- Re: [PR] [SPARK-49918][CORE] Use read-only access to conf in `SparkContext` where appropriate [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/10/10 01:27:44 UTC, 1 replies.
- Re: [PR] [SPARK-48714][PYTHON] Implement `DataFrame.mergeInto` in PySpark [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/10 02:11:15 UTC, 1 replies.
- [PR] [SPARK-48714][PYTHON][FOLLOW-UP] Skip tests if test class is not available [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/10 02:23:09 UTC, 2 replies.
- Re: [PR] [SPARK-49569][BUILD][FOLLOWUP] Exclude `spark-connect-shims` from `sql/core` module [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/10/10 03:11:21 UTC, 11 replies.
- Re: [PR] [SPARK-49615] Bugfix: Make ML column schema validation conforms with spark config `spark.sql.caseSensitive`. [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/10/10 04:09:29 UTC, 4 replies.
- [PR] [SPARK-45497][FOLLOWUP][3.5] Simplify symbolic link creation of spark-examples.jar [spark-docker] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/10/10 05:28:18 UTC, 4 replies.
- [PR] Test k8s it with no code change [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/10/10 06:01:10 UTC, 0 replies.
- Re: [PR] Test k8s it without code change [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/10/10 06:02:10 UTC, 1 replies.
- [PR] [TEST] Install R for ubuntu 24.04 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/10 06:34:48 UTC, 0 replies.
- [PR] [SPARK-49919][SQL] Add special limits support for return content as JSON dataset [spark] - posted by "LantaoJin (via GitHub)" <gi...@apache.org> on 2024/10/10 07:06:11 UTC, 1 replies.
- Re: [PR] [SPARK-49766][SQL] Codegen Support for `json_array_length` (by `Invoke` & `RuntimeReplaceable`) [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/10 07:32:30 UTC, 7 replies.
- Re: [PR] [SPARK-49920][INFRA][TESTS] Install `R` for `ubuntu 24.04` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/10 07:50:27 UTC, 11 replies.
- [PR] [SPARK-49921][CORE] Add task write data time to SQL tab's graph node [spark] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2024/10/10 09:44:01 UTC, 0 replies.
- [PR] [SPARK-49922][BUILD] Upgrade `sbt-assembly` to `2.3.0` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/10 11:24:15 UTC, 1 replies.
- Re: [PR] [SPARK-49756][SQL] Postgres dialect supports pushdown datetime functions. [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/10/10 11:55:59 UTC, 2 replies.
- [PR] [SPARK-49924][SQL] Fix `containsNull` of `ArrayCompact` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/10 12:15:37 UTC, 3 replies.
- Re: [PR] [SPARK-37019][SQL] Add codegen support to array higher-order functions [spark] - posted by "chris-twiner (via GitHub)" <gi...@apache.org> on 2024/10/10 12:40:18 UTC, 0 replies.
- [PR] Doc: Fix required java versions for spark 3.5 [spark] - posted by "dvorst (via GitHub)" <gi...@apache.org> on 2024/10/10 12:54:04 UTC, 2 replies.
- Re: [PR] [SPARK-49920][INFRA] Install `R` for `ubuntu 24.04` when GA run `k8s-integration-tests` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/10/10 12:55:08 UTC, 2 replies.
- [PR] [SPARK-49925][SQL] Add tests for order by with collated strings [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2024/10/10 13:43:30 UTC, 8 replies.
- Re: [PR] [SPARK-49249][SPARK-49122] Artifact isolation in Spark Classic [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/10/10 16:03:10 UTC, 19 replies.
- [PR] [SPARK-49558][SQL] Add SQL pipe syntax for LIMIT/OFFSET and ORDER/SORT/CLUSTER/DISTRIBUTE BY [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/10/10 16:47:10 UTC, 34 replies.
- Re: [PR] [SPARK-49547][SQL][PYTHON] Support returning iterator of RecordBatches in applyInArrow [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2024/10/10 19:56:24 UTC, 0 replies.
- [PR] Add dataframe PrintSchema and schema.TreeString [spark-connect-go] - posted by "magpierre (via GitHub)" <gi...@apache.org> on 2024/10/10 22:18:29 UTC, 8 replies.
- Re: [PR] [SPARK-19846][SQL] Add a flag to disable constraint propagation [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2024/10/10 22:46:42 UTC, 0 replies.
- [PR] [SPARK-49927][SS] pyspark.sql.tests.streaming.test_streaming_listener to wait longer [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2024/10/10 23:30:42 UTC, 8 replies.
- Re: [PR] [DO-NOT-MERGE] Structured logging style [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/11 00:23:42 UTC, 1 replies.
- Re: [PR] [DO-NOT-MERGE][DRAFT] Extract shared DataFrameSuite for Spark Connect [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/11 00:23:43 UTC, 1 replies.
- Re: [PR] [SPARK-48750][SQL] AQEPropagateEmptyRelation convert broadcast query stage plan to empty relation causing error [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/11 00:23:45 UTC, 1 replies.
- Re: [PR] [SPARK-49792][PS][BUILD] Upgrade to numpy 2 for building and testing Spark branches [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/10/11 00:39:53 UTC, 8 replies.
- Re: [PR] [SPARK-49924][SQL] Keep `containsNull` after `ArrayCompact` replacement [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/10/11 00:40:40 UTC, 3 replies.
- [PR] [SPARK-49928][PYTHON][TESTS] Refactor plot-related unit tests [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/10/11 01:55:50 UTC, 9 replies.
- Re: [PR] [SPARK-48155][FOLLOWUP][SQL] AQEPropagateEmptyRelation for left anti join should check if remain child is just BroadcastQueryStageExec [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2024/10/11 02:10:56 UTC, 14 replies.
- Re: [PR] [SPARK-49915][SQL] Handle zeros and ones in ReorderAssociativeOperator [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/10/11 02:19:25 UTC, 13 replies.
- Re: [PR] [SPARK-48881][SQL] Some dynamic partitions can be compensated to specific partition values [spark] - posted by "fusheng-rd (via GitHub)" <gi...@apache.org> on 2024/10/11 02:52:47 UTC, 0 replies.
- [PR] [SPARK-49748][CORE][FOLLOWUP] Add `getCondition` and deprecate `getErrorClass` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/11 03:01:09 UTC, 0 replies.
- Re: [PR] [SPARK-49748][CORE][FOLLOWUP] Add `getCondition` and deprecate `getErrorClass` in `QueryCompilationErrorsSuite` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/11 03:27:56 UTC, 5 replies.
- [PR] [SPARK-48567][PYTHON][TESTS][FOLLOW-UP] Make the query scope higher so finally can access to it [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/11 03:28:32 UTC, 3 replies.
- [PR] [SPARK-49930] Ensure that socket updates are flushed on exception from the python worker [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/10/11 04:48:03 UTC, 1 replies.
- Re: [PR] [SPARK-48922][SQL] Optimize nested data type insertion performance [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/10/11 05:55:27 UTC, 1 replies.
- [PR] [SPARK-49927][SS][PYTHON][TESTS][FOLLOW-UP] Fixes `q.lastProgress.batchId` to `q.lastProgress.progress.batchId` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/11 06:47:41 UTC, 2 replies.
- [PR] [SPARK-49932][CORE] Strictly close the resources used in `JsonUtils#toJsonString` to avoid memory leak [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/11 07:22:02 UTC, 0 replies.
- Re: [PR] [SPARK-49932][CORE] Strictly close the resources used in `JsonUtils#toJsonString` to avoid memory leaks [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/10/11 07:39:20 UTC, 1 replies.
- Re: [PR] [DRAFT] Fix surrogate pair handling in string expressions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/10/11 08:36:23 UTC, 0 replies.
- [PR] Fix make-distribution result [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/10/11 09:23:03 UTC, 4 replies.
- Re: [PR] [SPARK-49932][CORE] Use `tryWithResource` release `JsonUtils#toJsonString` resources to avoid memory leaks [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/11 09:32:20 UTC, 7 replies.
- [PR] [MINOR][PYTHON] Minor refine `LiteralExpression` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/11 13:45:20 UTC, 2 replies.
- [PR] [SPARK-49934][SQL] Add implicit cast for accessing collated map with literal [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/10/11 16:15:43 UTC, 3 replies.
- Re: [PR] [SPARK-48344][SQL] SQL API change to support execution of compound statements [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2024/10/11 19:49:02 UTC, 0 replies.
- Re: [PR] [SPARK-49601][SS][PYTHON] Support Initial State Handling for TransformWithStateInPandas [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2024/10/11 22:37:51 UTC, 6 replies.
- [PR] [SPARK-49927][SS] pyspark.sql.tests.streaming.test_streaming_listener to wait for longer [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2024/10/11 22:47:17 UTC, 0 replies.
- [PR] Add UnwrapUdt function [spark-connect-go] - posted by "magpierre (via GitHub)" <gi...@apache.org> on 2024/10/11 22:56:51 UTC, 7 replies.
- Re: [PR] [SPARK-49927][SS][PYTHON][TESTS] pyspark.sql.tests.streaming.test_streaming_listener to wait for longer [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2024/10/11 23:22:49 UTC, 7 replies.
- Re: [PR] [SPARK-49930][SS] Ensure that socket updates are flushed on exception from the python worker [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/12 00:12:03 UTC, 1 replies.
- Re: [PR] [SPARK-39901][CORE][SQL] Redesign `ignoreCorruptFiles` to make it more accurate by adding a new config `spark.files.ignoreCorruptFiles.errorClasses` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/12 00:23:10 UTC, 0 replies.
- Re: [PR] [SPARK-47780][SQL] Make catalyst-generated classes stable and uniquely named [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/12 00:23:11 UTC, 2 replies.
- Re: [PR] [SPARK-46741][SQL] Cache Table with CTE won't work [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/12 00:23:12 UTC, 1 replies.
- [PR] [MINOR] Fix code style in RuleIdCollection.scala [spark] - posted by "exmy (via GitHub)" <gi...@apache.org> on 2024/10/12 02:08:58 UTC, 0 replies.
- Re: [PR] [SPARK-49935][BUILD] Exclude `spark-connect-shims` from `assembly` module [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/10/12 03:07:14 UTC, 4 replies.
- [PR] [SPARK-49937][INFRA] Ban call the method `SparkThrowable#getErrorClass` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/12 05:37:52 UTC, 8 replies.
- Re: [PR] [SPARK-49936][BUILD] Upgrade `datasketches-java` to 6.1.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/10/12 05:42:17 UTC, 2 replies.
- [PR] [SPARK-49938][K8S] Prefer to use Hadoop configMap when specified [spark] - posted by "zgzzbws (via GitHub)" <gi...@apache.org> on 2024/10/12 08:08:50 UTC, 1 replies.
- [PR] [SPARK-49939][SQL] Codegen Support for json_object_keys (by Invoke & RuntimeReplaceable) [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/12 08:17:23 UTC, 10 replies.
- [PR] [WIP][SPARK-49816][SQL][FOLLOW-UP] Fix conflicting CTE ids [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2024/10/12 08:53:04 UTC, 3 replies.
- [PR] [SPARK-49940][CONNECT]Make 'limit n' in spark connect use executeCollect [spark] - posted by "xieshuaihu (via GitHub)" <gi...@apache.org> on 2024/10/12 09:19:12 UTC, 2 replies.
- [PR] [WIP] Rename errorClass to condition in errors of the JSON format [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/12 12:53:06 UTC, 0 replies.
- Re: [I] Add Support for Additional DataFrame Functionality [spark-connect-go] - posted by "imvtsl (via GitHub)" <gi...@apache.org> on 2024/10/12 13:56:46 UTC, 1 replies.
- Re: [PR] [SPARK-49941][CORE] Rename errorClass to condition in errors of the JSON format [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/12 19:21:03 UTC, 0 replies.
- [PR] [MINOR][CORE] Fix the regenerate command in SparkThrowableSuite [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/12 19:32:16 UTC, 0 replies.
- [PR] [WIP] Rename `errorClass` to `condition` in `JdbcDialect.classifyException` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/12 20:09:01 UTC, 1 replies.
- [PR] BTC:Update build_python_3.13.ymlBTC [spark] - posted by "09306677806 (via GitHub)" <gi...@apache.org> on 2024/10/12 20:22:53 UTC, 2 replies.
- [PR] BTC.Deposit to the resource owner's wallet Update security.shahrzadmahro [spark] - posted by "09306677806 (via GitHub)" <gi...@apache.org> on 2024/10/12 20:33:58 UTC, 2 replies.
- [PR] [SQL] Fix session level collation [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/10/12 21:28:51 UTC, 2 replies.
- Re: [PR] [SPARK-46937][SQL] Improve concurrency performance for FunctionRegistry [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/13 00:26:09 UTC, 0 replies.
- [PR] [SPARK-49943][PS] Remove `timestamp_ntz_to_long` from `PythonSQLUtils` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/13 02:11:00 UTC, 2 replies.
- [PR] [SPARK-49944][DOCS] Fix broken main.js import and fix image links for streaming documentation [spark] - posted by "neilramaswamy (via GitHub)" <gi...@apache.org> on 2024/10/13 05:02:48 UTC, 15 replies.
- [PR] [PS][CONNECT] Add alias for `distributed_id` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/13 11:44:40 UTC, 0 replies.
- [PR] [WIP] Require errorClass in SparkException [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/13 12:03:25 UTC, 0 replies.
- [PR] Call skipChildren for nested object [spark] - posted by "tedyu (via GitHub)" <gi...@apache.org> on 2024/10/13 13:05:13 UTC, 6 replies.
- [PR] [SPARK-49946][CORE] Require an error class in `SparkOutOfMemoryError` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/13 16:58:57 UTC, 3 replies.
- [PR] [SQL] Refactor CollationSupport [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/10/13 23:01:57 UTC, 1 replies.
- [PR] [SPARK-49947][SQL][TESTS] Upgrade `MsSql` docker image version [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/14 02:26:19 UTC, 4 replies.
- [PR] [SPARK-49948][PS][CONNECT] Add parameter "precision" to pandas on Spark box plot [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/10/14 03:37:50 UTC, 7 replies.
- [PR] Removes the compile time dependency on the OkHttp http client [spark] - posted by "navinvishy (via GitHub)" <gi...@apache.org> on 2024/10/14 03:41:35 UTC, 1 replies.
- [PR] [WIP][SPARK-49929][PYTHON][CONNECT] Support box plots [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/10/14 03:41:58 UTC, 1 replies.
- [PR] [SPARK-49949][PS] Avoid unnecessary analyze task in `attach_sequence_column` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/14 03:49:04 UTC, 3 replies.
- Re: [PR] [SPARK-49848][PYTHON][CONNECT] API compatibility check for Catalog [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/14 03:53:36 UTC, 12 replies.
- [PR] [SPARK-49951][SQL] Assign proper error condition for _LEGACY_ERROR_TEMP_(1099|3085) [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/14 04:56:14 UTC, 6 replies.
- Re: [PR] [SPARK-37687][K8S] Removes the compile time dependency on the OkHttp http client [spark] - posted by "navinvishy (via GitHub)" <gi...@apache.org> on 2024/10/14 05:29:50 UTC, 12 replies.
- [PR] [SPARK-49864][SQL][FOLLOW-UP] Fix default suggestion for binary arithmetic overflow [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/10/14 06:09:15 UTC, 7 replies.
- Re: [PR] [SPARK-49941][CORE] Rename `errorClass` to `condition` in errors of the JSON format [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/14 06:47:13 UTC, 3 replies.
- [PR] [SPARK-49952][SQL] Assign proper error condition for _LEGACY_ERROR_TEMP_1142 [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/14 07:15:19 UTC, 3 replies.
- Re: [PR] [MINOR][CORE] Fix the regenerate command in `SparkThrowableSuite` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/14 07:23:57 UTC, 1 replies.
- [PR] [SPARK-49954][SQL] Codegen Support for `SchemaOfJson` (by Invoke & RuntimeReplaceable) [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/14 08:45:15 UTC, 0 replies.
- Re: [PR] [SPARK-49876][CONNECT] Get rid of global locks from Spark Connect Service [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/10/14 08:52:35 UTC, 2 replies.
- [PR] [SPARK-49955][SQL] null value does not mean corrupted file when parsing JSON string RDD [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/10/14 08:59:52 UTC, 10 replies.
- Re: [PR] [SPARK-49942][SQL] Rename `errorClass` to `condition` in `JdbcDialect.classifyException` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/14 09:02:11 UTC, 4 replies.
- Re: [PR] [WIP][SQL] Handle invalid UTF-8 strings in StringReplace [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/10/14 09:02:43 UTC, 0 replies.
- [PR] [SPARK-49957][SQL] Scala and Python APIs for string validation functions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/10/14 09:35:15 UTC, 0 replies.
- Re: [PR] [WIP][SQL] Scala, Python, and R APIs for string validation functions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/10/14 09:36:11 UTC, 0 replies.
- Re: [PR] [SPARK-49957][SQL] Scala API for string validation functions [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/14 09:56:21 UTC, 10 replies.
- Re: [PR] [SPARK-40732][SQL][TESTS] Make `(SQL|ThriftServer)QueryTestSuite` pass except Pandas UDF tests in Java 21 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/10/14 10:56:38 UTC, 2 replies.
- [PR] [SPARK-49958][SQL] Python API for string validation functions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/10/14 10:58:21 UTC, 1 replies.
- [PR] [SPARK-49956] Disabled collations with collect_set expression [spark] - posted by "vladanvasi-db (via GitHub)" <gi...@apache.org> on 2024/10/14 11:33:47 UTC, 2 replies.
- [PR] [WIP][SPARK-49923][core]add AVA_OPTION_PURE_MODE configuration item to ensure security when the JavaOptions configuration is not required. [spark] - posted by "cliffchen12 (via GitHub)" <gi...@apache.org> on 2024/10/14 13:21:40 UTC, 2 replies.
- [PR] [SPARK-49959] Fix ColumnarArray.copy() to read nulls from the correct offset [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/10/14 16:19:03 UTC, 4 replies.
- [PR] [SPARK-49962][SQL] Simplify AbstractStringTypes class hierarchy [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/10/14 17:27:11 UTC, 12 replies.
- Re: [PR] [SPARK-49953][CORE] Require `errorClass` in `SparkException` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/14 19:45:16 UTC, 7 replies.
- [PR] Query level failure test [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/10/14 20:47:46 UTC, 1 replies.
- Re: [PR] [SPARK-47118][BUILD][CORE][SQL][UI] Migrate from Jetty 10 to Jetty 11 [spark] - posted by "hiufung-kwok (via GitHub)" <gi...@apache.org> on 2024/10/14 20:56:12 UTC, 0 replies.
- [PR] SPAKR-49964: Remove ws-rs-api package [spark] - posted by "hiufung-kwok (via GitHub)" <gi...@apache.org> on 2024/10/14 21:09:29 UTC, 0 replies.
- [PR] Bump org.eclipse.jetty:jetty-server from 11.0.23 to 11.0.24 [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/10/14 21:09:57 UTC, 2 replies.
- [PR] Bump org.eclipse.jetty:jetty-http from 11.0.23 to 12.0.12 [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/10/14 21:12:37 UTC, 2 replies.
- [PR] Add config support [spark-connect-go] - posted by "magpierre (via GitHub)" <gi...@apache.org> on 2024/10/14 21:25:53 UTC, 8 replies.
- [PR] [SPARK-49451][FOLLOW-UP] Improve duplicate key exception test [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/10/14 21:49:53 UTC, 0 replies.
- Re: [PR] [DRAFT] Add thread info to all state store operation logs [spark] - posted by "huanliwang-db (via GitHub)" <gi...@apache.org> on 2024/10/14 23:10:48 UTC, 0 replies.
- Re: [PR] [DO-NOT-REVIEW] [SPARK-49883][SS] State Store Checkpoint Structure V2 Integration with RocksDB and RocksDBFileManager [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2024/10/14 23:52:07 UTC, 6 replies.
- [PR] [SPARK-49965][BUILD] Upgrade ASM to 9.7.1 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/15 00:24:08 UTC, 3 replies.
- Re: [PR] [SPARK-49929][PYTHON][CONNECT] Support box plots [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/10/15 00:31:14 UTC, 2 replies.
- [PR] [SPARK-49966][SQL] Codegen Support for JsonToStructs(`from_json`) [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/15 02:52:02 UTC, 10 replies.
- Re: [PR] [SPARK-49964][Core] Remove ws-rs-api package [spark] - posted by "hiufung-kwok (via GitHub)" <gi...@apache.org> on 2024/10/15 02:59:37 UTC, 2 replies.
- [PR] [SPARK-49967][SQL] Codegen Support for `StructsToJson`(`to_json`) [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/15 03:13:28 UTC, 6 replies.
- [PR] [SPARK-49969][BUILD] Simplify dependency management in YARN module [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/10/15 04:41:13 UTC, 4 replies.
- [PR] [SPARK-49970][SQL] Assign proper error condition for _LEGACY_ERROR_TEMP_2069 [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/15 05:00:32 UTC, 4 replies.
- [PR] [][] Fix the split function with limit being cut off incorrectly [spark] - posted by "DenineLu (via GitHub)" <gi...@apache.org> on 2024/10/15 05:13:06 UTC, 0 replies.
- Re: [PR] [SPARK-49451][SQL][FOLLOW-UP] Improve duplicate key exception test [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/15 06:12:08 UTC, 1 replies.
- Re: [PR] [SPARK-49968][SQL] The split function produces incorrect results with an empty regex and a limit [spark] - posted by "TongWei1105 (via GitHub)" <gi...@apache.org> on 2024/10/15 06:13:50 UTC, 18 replies.
- Re: [PR] [SPARK-49513][SS] Add Support for timer in transformWithStateInPandas API [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/10/15 06:34:23 UTC, 24 replies.
- Re: [PR] [SPARK-46798][Structured Streaming] Kafka custom partition location assignment (rack awareness) [spark] - posted by "unbalanced (via GitHub)" <gi...@apache.org> on 2024/10/15 06:43:36 UTC, 2 replies.
- [PR] [SPARK-49971][SQL] Assign proper error condition for _LEGACY_ERROR_TEMP_1097 [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/15 06:53:08 UTC, 5 replies.
- [PR] Fix semantic of support binary equality [spark] - posted by "jovanpavl-db (via GitHub)" <gi...@apache.org> on 2024/10/15 08:28:21 UTC, 12 replies.
- Re: [PR] [DOCS]Fix specified java versions for spark 3.5 in `python/docs/source/getting_started/install.rst` [spark] - posted by "dvorst (via GitHub)" <gi...@apache.org> on 2024/10/15 08:32:45 UTC, 0 replies.
- [PR] [SPARK-49954][SQL] Codegen Support for SchemaOfJson (by Invoke & RuntimeReplaceable) [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/15 08:49:08 UTC, 7 replies.
- [PR] [SPARK-49973][INFRA]Upgrade python to 3.11 for non-python tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/15 09:22:13 UTC, 2 replies.
- [PR] [SPARK-49974][SQL] Move resolveRelations(...) out of the Analyzer.scala [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/10/15 09:54:11 UTC, 2 replies.
- Re: [PR] [SPARK-49827][SQL] Fetching all partitions from hive metastore in batches [spark] - posted by "Madhukar525722 (via GitHub)" <gi...@apache.org> on 2024/10/15 11:01:40 UTC, 0 replies.
- [PR] [SPARK-49975][SQL] Disallow LEGACY storeAssignmentPolicy with DataFrameWriterV2 API [spark] - posted by "manuzhang (via GitHub)" <gi...@apache.org> on 2024/10/15 12:22:46 UTC, 6 replies.
- [PR] [SPARK-49960][SQL] Provide extension point for custom AgnosticEncoder serde [spark] - posted by "chris-twiner (via GitHub)" <gi...@apache.org> on 2024/10/15 13:09:50 UTC, 12 replies.
- [PR] [SPARK-49961][SQL] Correct transform type signature for both Scala and Java [spark] - posted by "chris-twiner (via GitHub)" <gi...@apache.org> on 2024/10/15 14:26:28 UTC, 9 replies.
- [PR] [SPARK-49976] [SQL] Disable lambda functions from being clauses in CASE WHEN expressions [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2024/10/15 15:19:27 UTC, 0 replies.
- Re: [PR] [SPARK-49976] [SQL] Disallow lambda functions from being clauses in CASE WHEN expressions [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2024/10/15 15:29:24 UTC, 12 replies.
- [PR] [SPARK-49977] Use stack-based iterative computation to avoid creating many Scala List objects for deep expression trees [spark] - posted by "utkarsh39 (via GitHub)" <gi...@apache.org> on 2024/10/15 16:00:40 UTC, 2 replies.
- [PR] Move sparkR deprecation warning to package attach time [spark] - posted by "tinglongliao-db (via GitHub)" <gi...@apache.org> on 2024/10/15 18:11:19 UTC, 0 replies.
- Re: [PR] [SPARK-49959][SQL] Fix ColumnarArray.copy() to read nulls from the correct offset [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/15 18:21:20 UTC, 1 replies.
- Re: [PR] [SPARK-49550][BUILD] Upgrade Hadoop to 3.4.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/15 18:27:20 UTC, 3 replies.
- Re: [PR] [SPARK-49911][SQL] Fix semantic of support binary equality [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/15 18:33:57 UTC, 1 replies.
- Re: [PR] [SPARK-48994][FOLLOW-UP] Remove support for interval types in Variant [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/10/15 20:46:26 UTC, 0 replies.
- Re: [PR] [SPARK-49964][BUILD] Remove `ws-rs-api` package [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/15 22:23:29 UTC, 0 replies.
- Re: [PR] [SPARK-49792][PYTHON][BUILD] Upgrade to numpy 2 for building and testing Spark branches [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/15 22:28:36 UTC, 2 replies.
- Re: [PR] [SPARK-49978][R]Move sparkR deprecation warning to package attach time [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/15 22:36:24 UTC, 4 replies.
- [PR] [SPARK-49980][CORE][SQL] Fix potential file stream leaks caused by interruption in canceled tasks [spark] - posted by "davintjong-db (via GitHub)" <gi...@apache.org> on 2024/10/15 22:37:56 UTC, 7 replies.
- [PR] [SPARK-49979] Fix AQE hanging issue when collecting twice on a failed plan [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2024/10/15 23:03:58 UTC, 0 replies.
- [PR] [SPARK-49981][CORE][TESTS] Fix `AsyncRDDActionsSuite.FutureAction result, timeout` test case to be robust [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/15 23:14:20 UTC, 3 replies.
- [PR] [SPARK-49982][SQL] Fix negative caching in InMemoryRelation [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2024/10/15 23:47:51 UTC, 5 replies.
- [PR] [SPARK-49983][CORE][TESTS] Fix `BarrierTaskContextSuite.successively sync with allGather and barrier` test case to be robust [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/15 23:52:16 UTC, 3 replies.
- Re: [PR] [SPARK-49954][SQL] Codegen Support for `SchemaOfJson` (by Invoke & RuntimeReplaceable) - Java Version [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/16 00:03:31 UTC, 0 replies.
- [PR] [SPARK-49984][CORE] Fix duplicate JVM options [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2024/10/16 01:25:08 UTC, 3 replies.
- [PR] [SPARK-49986][INFRA] Restore `scipy` installation in dockerfile [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/16 02:06:19 UTC, 6 replies.
- [PR] [SPARK-49987][SQL] Fix the error prompt when `seedExpression` is non-foldable in `randstr` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/16 02:39:52 UTC, 8 replies.
- Re: [PR] [SPARK-49979][SQL] Fix AQE hanging issue when collecting twice on a failed plan [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/10/16 03:18:01 UTC, 4 replies.
- [PR] [SPARK-49988][BUILD] Remove unused Hadoop dependency management [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/10/16 03:19:10 UTC, 11 replies.
- Re: [PR] [SPARK-49802][SS] Add support for read change feed for map and list types used in stateful processors [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/10/16 06:31:26 UTC, 5 replies.
- [PR] [WIP][SPARK-49530][PYTHON][CONNECT] Support kde/density plots [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/10/16 07:00:33 UTC, 2 replies.
- Re: [PR] [SPARK-49846][SS] Add numUpdatedStateRows and numRemovedStateRows metrics for use with transformWithState operator [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/10/16 07:19:13 UTC, 15 replies.
- [PR] [SPARK-49990][SQL] Improve performance of `randStr` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/16 08:05:56 UTC, 13 replies.
- [PR] [SPARK-49991][SQL] Make HadoopMapReduceCommitProtocol respect 'mapreduce.output.basename' to generate file names [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/10/16 08:46:03 UTC, 7 replies.
- Re: [PR] [SPARK-49507][SQL] Fix Expected only partition pruning predicates exception [spark] - posted by "TongWei1105 (via GitHub)" <gi...@apache.org> on 2024/10/16 09:06:33 UTC, 0 replies.
- [PR] [WIP][DO-NOT-MERGE-YET] Expand implicit collation mismatch error [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/10/16 11:42:02 UTC, 0 replies.
- Re: [PR] [SPARK-49992][SQL] Session level collation should not impact DDL queries [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/10/16 12:51:11 UTC, 23 replies.
- [PR] [SPARK-49643][SQL] Merge _LEGACY_ERROR_TEMP_2042 into ARITHMETIC_OVERFLOW [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/10/16 13:41:33 UTC, 6 replies.
- [PR] Feature/spark 47008 add has path capability check [spark] - posted by "leovegas (via GitHub)" <gi...@apache.org> on 2024/10/16 14:14:01 UTC, 0 replies.
- [PR] [SPARK-49057][SQL][FOLLOWUP] Handle _LEGACY_ERROR_TEMP_2235 case [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/16 14:47:45 UTC, 0 replies.
- Re: [PR] [SPARK-49057][SQL] Do not block the AQE loop when submitting query stages [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/16 14:55:47 UTC, 0 replies.
- [PR] [WIP][SPARK-49993][SQL] Improve error messages for Conv, Sum and Average [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/10/16 15:10:01 UTC, 7 replies.
- Re: [PR] [SPARK-49057][SQL][TESTS][FOLLOWUP] Handle `_LEGACY_ERROR_TEMP_2235` case [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/16 15:16:54 UTC, 0 replies.
- Re: [PR] [SPARK-49057][SQL][TESTS][FOLLOWUP] Handle `_LEGACY_ERROR_TEMP_2235` error case [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/10/16 15:26:34 UTC, 6 replies.
- [PR] [WIP][SPARK-49638][SQL] Improve error messages for ParseUrl #49638 [spark] - posted by "jovanm-db (via GitHub)" <gi...@apache.org> on 2024/10/16 15:30:03 UTC, 3 replies.
- [PR] [SPARK-49490][SQL] Add benchmarks for initCap [spark] - posted by "mrk-andreev (via GitHub)" <gi...@apache.org> on 2024/10/16 16:59:51 UTC, 11 replies.
- Re: [PR] [SPARK-45497][FOLLOWUP] Simplify symbolic link creation of spark-examples.jar [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/16 17:27:26 UTC, 0 replies.
- [PR] [MINOR] DO NOT MERGE [spark] - posted by "kazuyukitanimura (via GitHub)" <gi...@apache.org> on 2024/10/16 19:12:50 UTC, 1 replies.
- [PR] [SPARK-49995][SQL] Add named argument support to more TVFs [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/10/16 21:23:35 UTC, 8 replies.
- Re: [PR] [SPARK-49638][SQL] Improve error messages for ParseUrl [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/16 21:46:01 UTC, 3 replies.
- Re: [PR] [SPARK-49770][SS][RocksDB Hardening] Improve RocksDB SST file mapping management, and fix issue with reloading same version with existing snapshot [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2024/10/16 23:01:22 UTC, 14 replies.
- [PR] [SPARK-49996][SQL][TESTS] Upgrade `mysql-connector-j` to 9.1.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/17 00:13:15 UTC, 2 replies.
- [PR] [SPARK-48155][SQL][3.5] AQEPropagateEmptyRelation for join should check if remain child is just BroadcastQueryStageExec [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2024/10/17 01:22:21 UTC, 2 replies.
- [PR] [SPARK-48155][SQL][3.4] AQEPropagateEmptyRelation for join should check if remain child is just BroadcastQueryStageExec [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2024/10/17 01:23:53 UTC, 2 replies.
- Re: [PR] [SPARK-47008][CORE] Added Hadoops fileSystems hasPathCapability check to avoid FileNotFoundException(s) when using S3 Express One Zone Storage [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/17 01:34:54 UTC, 0 replies.
- [PR] [Only For Test] Test StaticInvoke cast [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/17 01:48:38 UTC, 3 replies.
- Re: [PR] [SPARK-49945][PS][CONNECT] Add alias for `distributed_id` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/17 02:28:46 UTC, 1 replies.
- [PR] [SPARK-49997][SQL] Integrate `_LEGACY_ERROR_TEMP_2165` into `MALFORMED_RECORD_IN_PARSING` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/17 02:30:37 UTC, 2 replies.
- [PR] [SPARK-49966][SQL] Use `Invoke` to implement `JsonToStructs`(`from_json`) [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/17 02:57:40 UTC, 14 replies.
- Re: [PR] [SPARK-49530][PYTHON][CONNECT] Support kde/density plots [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/10/17 03:22:56 UTC, 5 replies.
- Re: [PR] [SPARK-49977][SQL] Use stack-based iterative computation to avoid creating many Scala List objects for deep expression trees [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/10/17 04:26:37 UTC, 1 replies.
- [PR] [SPARK-49998][SQL] Integrate `_LEGACY_ERROR_TEMP_1252` into `EXPECT_TABLE_NOT_VIEW` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/17 04:53:23 UTC, 1 replies.
- [PR] [SPARK-50002][PYTHON][CONNECT] API compatibility check for I/O [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/17 05:29:20 UTC, 1 replies.
- [PR] [SPARK-50003][PYTHON][DOCS] Add pie plot doc examples and correct area plot parameter type hints [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/10/17 05:53:30 UTC, 3 replies.
- [PR] [SPARK-50001][PYTHON][PS][CONNECT] Adjust "precision" to be part of kwargs for box plots [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/10/17 06:12:25 UTC, 8 replies.
- [PR] Migrate to arrow-go [spark-connect-go] - posted by "haoxins (via GitHub)" <gi...@apache.org> on 2024/10/17 06:35:10 UTC, 6 replies.
- [PR] [SPARK-50004][SQL] Integrate `_LEGACY_ERROR_TEMP_3327` into `FIELD_NOT_FOUND` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/17 07:23:24 UTC, 3 replies.
- [PR] [SPARK-49495][INFRA][FOLLOW-UP] Disable GitHub Pages workflow in forked repository [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/17 07:42:18 UTC, 2 replies.
- Re: [PR] [SPARK-49923][core]add AVA_OPTION_PURE_MODE configuration item to ensure security when the JavaOptions configuration is not required. [spark] - posted by "cliffchen12 (via GitHub)" <gi...@apache.org> on 2024/10/17 07:49:27 UTC, 0 replies.
- [PR] [SPARK-50008][PS][CONNECT] Avoid unnecessary operations in `attach_distributed_sequence_column` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/17 09:01:27 UTC, 2 replies.
- [PR] [SPARK-50007][SQL][SS] Provide default values for metrics on observe API when physical node is lost in executed plan [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/10/17 09:02:49 UTC, 10 replies.
- [PR] [SPARK-50009][INFRA] Exclude pandas/resource/testing from `pyspark-core` module [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/17 09:56:17 UTC, 2 replies.
- Re: [PR] [SPARK-49958][PYTHON] Python API for string validation functions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/10/17 10:22:06 UTC, 4 replies.
- [PR] [PYTHON][CONNECT] Switch to use logger instead of warnings module in client [spark] - posted by "nija-at (via GitHub)" <gi...@apache.org> on 2024/10/17 12:07:01 UTC, 0 replies.
- [PR] [SPARK-50011][INFRA] Add a separate docker file for doc build [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/17 12:44:50 UTC, 13 replies.
- [PR] [SPARK-49665][SQL] Trim collation support for string functions [spark] - posted by "jovanpavl-db (via GitHub)" <gi...@apache.org> on 2024/10/17 14:09:45 UTC, 49 replies.
- Re: [PR] [WIP][SPARK-49665][SQL] Trim collation support for string functions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/10/17 14:25:20 UTC, 2 replies.
- Re: [PR] [SPARK-46957][CORE] Decommission migrated shuffle files should be able to cleanup from executor [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/17 15:17:45 UTC, 2 replies.
- Re: [PR] [SPARK-49249][SPARK-49320] Add new tag-related APIs in Connect back to Spark Core [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/17 15:24:06 UTC, 3 replies.
- Re: [PR] [SPARK-50010][SQL] Expand implicit collation mismatch error [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/17 16:01:33 UTC, 9 replies.
- [PR] [SPARK-50014][INFRA] Use `grpcio*` 1.67.0 in Python 3.13 image [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/17 17:23:05 UTC, 5 replies.
- [PR] Add a hint to logical.Aggregate() node [spark] - posted by "agubichev (via GitHub)" <gi...@apache.org> on 2024/10/17 17:35:02 UTC, 2 replies.
- [PR] [SPARK-50015][BUILD] Upgrade `grpcio*` to 1.67.0 and `grpc-java` to 1.67.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/17 17:39:27 UTC, 3 replies.
- [PR] [SPARK-50016][SQL] Improve implicit collation mismatch error [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/10/17 18:01:28 UTC, 0 replies.
- [PR] [SPARK-48773][FOLLOW-UP] spark.session.set should not fail when setting `spark.default.parallelism` [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2024/10/17 18:06:53 UTC, 0 replies.
- Re: [PR] [SPARK-48773][FOLLOW-UP] spark.conf.set should not fail when setting `spark.default.parallelism` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/10/17 18:18:43 UTC, 3 replies.
- Re: [PR] [SPARK-49701] Use JDK for Spark 3.5+ Docker image [spark-docker] - posted by "anish97IND (via GitHub)" <gi...@apache.org> on 2024/10/17 20:09:07 UTC, 1 replies.
- [PR] [SPARK-50018][SQL] Make AbstractStringType serializable [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/10/17 21:00:00 UTC, 2 replies.
- [PR] [SPARK-50019][INFRA] Install BASIC_PIP_PKGS except `pyarrow` in Python 3.13 image [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/17 21:01:52 UTC, 6 replies.
- Re: [PR] [SPARK-47094][SQL] SPJ : fix bucket reducer function [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2024/10/17 21:18:39 UTC, 7 replies.
- [PR] [WIP][SPARK-49562][SQL] Add SQL pipe syntax for aggregation [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/10/17 22:10:51 UTC, 0 replies.
- Re: [PR] [SPARK-33902][SQL] Throw error for CREATE TABLE LIKE in V2 tables [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/18 00:23:55 UTC, 1 replies.
- Re: [PR] [SPARK-48839][SQL] Inject Runtime Filter for multi-level join with function condition [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/18 00:23:56 UTC, 1 replies.
- Re: [PR] [SPARK-48809][PYTHON][DOCS] Reimplemented `spark version drop down` of the `PySpark doc site` and fix bug [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/18 00:23:56 UTC, 2 replies.
- Re: [PR] [SPARK-48722][K8S] Patch executor pod without optimistic locking [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/18 00:23:57 UTC, 1 replies.
- Re: [PR] [SPARK-48711][PYTHON] `SparkContext.stop` should catch `ConnectionRefusedError` as well [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/18 00:23:58 UTC, 1 replies.
- Re: [PR] [SPARK-48243][SQL][HIVE] Support push down char and varchar predicates to Hive Metastore [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/18 00:23:59 UTC, 1 replies.
- [PR] Revert "[SPARK-49909][SQL] Fix the pretty name of some expressions" [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/18 01:49:11 UTC, 6 replies.
- Re: [PR] [SPARK-49829][SS] Fix the bug on the optimization on adding input to state store in stream-stream join [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/10/18 01:53:11 UTC, 7 replies.
- [PR] Revert "[SPARK-49909][SQL][3.5] Fix the pretty name of some expressions" [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/18 02:44:40 UTC, 3 replies.
- [PR] Revert "[SPARK-49909][SQL][3.4] Fix the pretty name of some expressions" [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/18 02:47:22 UTC, 3 replies.
- Re: [PR] [SPARK-46090][SQL] Support plan fragment level SQL configs in AQE [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/10/18 02:51:33 UTC, 0 replies.
- [PR] [SPARK-50011][INFRA][FOLLOW-UP] Refresh the image cache job [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/18 03:58:01 UTC, 11 replies.
- Re: [PR] [MINOR][INFRA] Do not upload docker build record [spark] - posted by "Yikun (via GitHub)" <gi...@apache.org> on 2024/10/18 04:02:00 UTC, 0 replies.
- [PR] [SPARK-50021][CORE][UI] Fix ApplicationPage to hide UI link when UI is disabled [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/18 04:17:52 UTC, 0 replies.
- Re: [PR] [SPARK-50021][CORE][UI] Fix `ApplicationPage` to hide App UI link when UI is disabled [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/18 04:38:37 UTC, 0 replies.
- Re: [PR] [SPARK-50021][CORE][UI] Fix `ApplicationPage` to hide App UI links when UI is disabled [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/18 04:56:07 UTC, 3 replies.
- [PR] [SPARK-50022][CORE][UI] Fix MasterPage to hide App UI links when UI is disabled [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/18 04:59:33 UTC, 0 replies.
- Re: [PR] [SPARK-50022][CORE][UI] Fix `MasterPage` to hide App UI links when UI is disabled [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/18 05:09:37 UTC, 4 replies.
- [PR] [SPARK-50023][PYTHON][CONNECT] API compatibility check for Functions [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/18 07:13:39 UTC, 4 replies.
- [PR] [MINOR] Run `./build/mvn scalafmt:format` to fix CI [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/18 07:19:27 UTC, 0 replies.
- [PR] [MINOR] Restore the scala format [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/18 07:20:09 UTC, 1 replies.
- Re: [PR] [SPARK-49558][SQL][FOLLOW-UP] Run `./build/mvn scalafmt:format` to fix CI [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/18 07:20:51 UTC, 2 replies.
- [PR] [SPARK-50025][SQL] Integrate `_LEGACY_ERROR_TEMP_1253` into `EXPECT_VIEW_NOT_TABLE` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/18 07:34:56 UTC, 2 replies.
- Re: [PR] [SPARK-50024][PYTHON][CONNECT] Switch to use logger instead of warnings module in client [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/18 07:40:44 UTC, 4 replies.
- Re: [PR] [SPARK-50016][SQL] Improve explicit collation mismatch error [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/18 08:40:42 UTC, 1 replies.
- [PR] [SPARK-50026][SQL] Fix Identity Column metadata get [spark] - posted by "zhipengmao-db (via GitHub)" <gi...@apache.org> on 2024/10/18 09:10:41 UTC, 2 replies.
- [PR] [SPARK-50030][PYTHON][CONNECT] API compatibility check for Window [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/18 09:18:33 UTC, 2 replies.
- [PR] [SPARK-50029][SQL] Make `StaticInvoke` compatible with the method that return `Any` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/18 09:29:43 UTC, 5 replies.
- [PR] [SPARK-50027][SQL] Move Identity Column SQL parsing code to DataTypeAstBuilder [spark] - posted by "zhipengmao-db (via GitHub)" <gi...@apache.org> on 2024/10/18 09:50:30 UTC, 3 replies.
- [PR] [WIP][SPARK-50028] Replace global locks in Spark Connect server listener with fine-grained locks [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/10/18 11:53:56 UTC, 0 replies.
- [PR] init commit. [spark] - posted by "jovanpavl-db (via GitHub)" <gi...@apache.org> on 2024/10/18 13:24:32 UTC, 0 replies.
- [PR] [SPARK-50032][SQL] Allow use of fully qualified collation name [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2024/10/18 14:26:54 UTC, 14 replies.
- [PR] [SPARK-50021][CORE][UI][3.5] Fix `ApplicationPage` to hide App UI links when UI is disabled [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/18 15:31:59 UTC, 3 replies.
- [PR] [SPARK-50021][CORE][UI][3.4] Fix `ApplicationPage` to hide App UI links when UI is disabled [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/18 15:38:26 UTC, 3 replies.
- [PR] [SPARK-50022][CORE][UI][3.5] Fix MasterPage to hide App UI links when UI is disabled [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/18 16:19:59 UTC, 0 replies.
- [PR] [SPARK-50022][CORE][UI][3.4] Fix MasterPage to hide App UI links when UI is disabled [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/18 16:25:48 UTC, 0 replies.
- Re: [PR] [SPARK-50033] Add a hint to logical.Aggregate() node [spark] - posted by "agubichev (via GitHub)" <gi...@apache.org> on 2024/10/18 17:13:02 UTC, 0 replies.
- [PR] [SPARK-50034] Fix Misreporting of Fatal Errors as Uncaught Exceptions in `SparkUncaughtExceptionHandler` [spark] - posted by "mingkangli-db (via GitHub)" <gi...@apache.org> on 2024/10/18 18:12:21 UTC, 2 replies.
- Re: [PR] [SPARK-50017] Support Avro encoding for TransformWithState operator - ValueState [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/10/18 20:27:41 UTC, 20 replies.
- Re: [PR] [SPARK-50022][CORE][UI][3.5] Fix `MasterPage` to hide App UI links when UI is disabled [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/18 21:15:37 UTC, 2 replies.
- Re: [PR] [SPARK-50022][CORE][UI][3.4] Fix `MasterPage` to hide App UI links when UI is disabled [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/18 21:15:48 UTC, 4 replies.
- [PR] [SPARK-50036][Core][PySpark] Include SPARK_LOG_SCHEMA in the context of REPL shell [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/10/18 23:12:12 UTC, 6 replies.
- [PR] [SPARK-50035] Add support for explicit handleExpiredTimer function part of the stateful processor [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/10/19 00:50:42 UTC, 1 replies.
- Re: [PR] [SPARK-49923][core]Add a configuration item for disabling the setting of javaOptions. [spark] - posted by "srowen (via GitHub)" <gi...@apache.org> on 2024/10/19 02:05:19 UTC, 0 replies.
- [PR] [SPARK-50005][SQL] Enhance method verifyNotReadPath to identify subqueries hidden in the filter conditions. [spark] - posted by "xunxunmimi5577 (via GitHub)" <gi...@apache.org> on 2024/10/19 04:43:59 UTC, 10 replies.
- [PR] [MINOR][DOCS] Add Development Version of docs in README.md [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/19 08:40:55 UTC, 3 replies.
- [PR] [SPARK-50037][SQL]Refactor AttributeSeq.resolve(...) [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/10/19 12:34:22 UTC, 0 replies.
- [PR] Fix some typos [spark] - posted by "KazMiddelhoek (via GitHub)" <gi...@apache.org> on 2024/10/19 14:50:28 UTC, 0 replies.
- Re: [PR] [WIP][SQL] Table with catalog name [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/20 00:26:45 UTC, 1 replies.
- Re: [PR] [SPARK-48828][DOCS] Update documentation to add `column` as alias of `col` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/20 00:26:46 UTC, 1 replies.
- [PR] [SPARK-49552][CONNECT][FOLLOW-UP] Make 'randstr' and 'uniform' deterministic in Scala Client [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/20 03:23:25 UTC, 3 replies.
- [PR] [SPARK-50038][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_0008`: `MERGE_WITHOUT_WHEN` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/20 05:26:51 UTC, 2 replies.
- [PR] [SPARK-50039][CONNECT][PYTHON] API compatibility check for Grouping [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/20 05:50:44 UTC, 2 replies.
- [PR] [SPARK-50040][PYTHON][TESTS] Make pysaprk-connect tests passing without optional dependencies [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/20 06:25:56 UTC, 3 replies.
- [PR] [MINOR][TESTS] Fix appname from `sql.protobuf.functions` to `sql.connect.protobuf.functions` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/20 06:39:08 UTC, 3 replies.
- [PR] [MINOR][DOCS][PYTHON] Clarify that profilers show the accumulated results [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/20 06:55:43 UTC, 2 replies.
- [PR] [SPARK-50041][PYTHON] Show a proper error message when memory_profiler not found [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/20 07:01:45 UTC, 6 replies.
- [PR] [SPARK-50042][PYTHON] Upgrade numpy for python linter [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/20 07:51:05 UTC, 1 replies.
- Re: [PR] [SPARK-50042][PYTHON] Upgrade numpy 2 for python linter [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/20 07:55:50 UTC, 3 replies.
- [PR] [SPARK-50043] Build should be stopped when Antrun script fails [spark] - posted by "packyan (via GitHub)" <gi...@apache.org> on 2024/10/20 11:06:47 UTC, 0 replies.
- Re: [PR] [SPARK-49730][SQL] classify syntax errors for pgsql, mysql, sqlserver and h2 [spark] - posted by "ivanjevtic-db (via GitHub)" <gi...@apache.org> on 2024/10/20 11:13:06 UTC, 6 replies.
- Re: [PR] [SPARK-50036][CORE][PYTHON] Include SPARK_LOG_SCHEMA in the context of REPL shell [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/10/20 12:52:18 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-49708][BUILD] Upgrade `RoaringBitmap` to `1.3.0` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/10/20 12:54:15 UTC, 0 replies.
- Re: [PR] [SPARK-49774][BUILD] Upgrade guava to 33.3.1-jre [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/10/20 13:02:38 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-49707][BUILD] Upgrade rocksdbjni to 9.6.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/10/20 13:08:45 UTC, 3 replies.
- [PR] [SPARK-50044][PYTHON] Refine the docstring of multiple math functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/20 13:24:54 UTC, 2 replies.
- [PR] [SPARK-50045] Spark supports executor HostNetwork on k8s mode [spark] - posted by "zzzzming95 (via GitHub)" <gi...@apache.org> on 2024/10/20 14:45:58 UTC, 0 replies.
- Re: [PR] [SPARK-50031][SQL] Add TryParseUrl alternative [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/20 17:06:08 UTC, 3 replies.
- Re: [PR] [WIP][SQL] JDBCTableCatalog with catalog name [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/21 00:25:20 UTC, 1 replies.
- Re: [PR] [SPARK-48756][CONNECT][PYTHON]Support for `df.debug()` in Connect Mode [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/21 00:25:23 UTC, 1 replies.
- Re: [PR] [SPARK-49708][BUILD] Upgrade `RoaringBitmap` to `1.3.0` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/21 01:23:08 UTC, 3 replies.
- [PR] [SPARK-50047][BUILD] Upgrade jersey to 3.0.16 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/10/21 01:42:52 UTC, 2 replies.
- [PR] [SPARK-50046][SS] Use stable order of EventTimeWatermark node to calculate watermark [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/10/21 02:19:39 UTC, 15 replies.
- [PR] [SPARK-49850][CONNECT][PYTHON] API compatibility check for Avro [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/21 03:30:34 UTC, 2 replies.
- [PR] [SPARK-50048][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_2114`: `UNRECOGNIZED_STATISTIC` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/21 03:54:01 UTC, 2 replies.
- [PR] [SPARK-50049][SQL] Support custom driver metrics in writing to v2 table [spark] - posted by "manuzhang (via GitHub)" <gi...@apache.org> on 2024/10/21 04:45:09 UTC, 2 replies.
- Re: [PR] [SPARK-50037][SQL] Refactor AttributeSeq.resolve(...) [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/10/21 04:51:36 UTC, 1 replies.
- [PR] [SPARK-50052][PYTHON] Make `NumpyArrayConverter` support empty str ndarray [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/21 05:27:56 UTC, 1 replies.
- [PR] [SPARK-50052][PYTHON] Make NumpyArrayConverter support empty str ndarray [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/21 05:29:02 UTC, 6 replies.
- Re: [PR] [SPARK-50035][SS] Add support for explicit handleExpiredTimer function part of the stateful processor [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/10/21 05:30:06 UTC, 3 replies.
- Re: [PR] [SPARK-50034][CORE] Fix Misreporting of Fatal Errors as Uncaught Exceptions in `SparkUncaughtExceptionHandler` [spark] - posted by "zeal-thinker (via GitHub)" <gi...@apache.org> on 2024/10/21 05:46:47 UTC, 22 replies.
- [PR] [SPARK-49851][CONNECT][PYTHON] API compatibility check for Protobuf [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/21 05:55:09 UTC, 2 replies.
- [PR] [SPARK-50053][SQL] Turn `_LEGACY_ERROR_TEMP_2104` into `INTERNAL_ERROR` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/21 06:25:32 UTC, 2 replies.
- [PR] [WIP][SPARK-50054][PYTHON][CONNECT] Support histogram plots [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/10/21 07:38:47 UTC, 0 replies.
- [PR] [SPARK-50056][SQL] Codegen Support for ParseUrl (by Invoke & RuntimeReplaceable) [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/21 09:12:31 UTC, 0 replies.
- [PR] [SPARK-50055][SQL] Add TryConv and TryMakeInterval alternatives [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/10/21 09:57:30 UTC, 1 replies.
- [PR] [SPARK-49849][CONNECT][PYTHON] API compatibility check for Structured Streaming Query Management [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/21 10:41:37 UTC, 2 replies.
- [PR] [SPARK-48413][SQL][FOLLOW-UP] Fix ALTER COLUMN with collation [spark] - posted by "jovanm-db (via GitHub)" <gi...@apache.org> on 2024/10/21 12:06:04 UTC, 6 replies.
- [PR] [SPARK-50057][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_1049`: `INVALID_ATTRIBUTE_NAME_SYNTAX` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/21 13:04:18 UTC, 4 replies.
- [PR] [SPARK-50058][SQL] Factor out plan normalization functions to later use those in single-pass Analyzer testing [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/10/21 13:14:38 UTC, 2 replies.
- [PR] [SPARK-50060][Collations] Fixed behavior of set operators when dealing with conflicting collations [spark] - posted by "vladanvasi-db (via GitHub)" <gi...@apache.org> on 2024/10/21 16:02:26 UTC, 0 replies.
- [PR] [SPARK-50061][SQL] Enable analyze table for collated columns [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2024/10/21 16:54:50 UTC, 3 replies.
- [PR] [SPARK-50064][PYTHON][TESTS] Make pysaprk-ml-connect tests passing without optional dependencies [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/21 23:41:01 UTC, 4 replies.
- [PR] [SPARK-50065][SQL][TESTS] Upgrade `MySQL` & `Mariadb` docker image version [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/22 02:09:34 UTC, 2 replies.
- Re: [PR] [SPARK-50054][PYTHON][CONNECT] Support histogram plots [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/10/22 02:25:20 UTC, 4 replies.
- [PR] [SPARK-50051][PYTHON][CONNECT] Make `lit` works with empty numpy ndarray [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/22 03:00:13 UTC, 2 replies.
- [PR] Revert "[SPARK-50007][SQL][SS] Provide default values for metrics on observe API when physical node is lost in executed plan" [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/10/22 03:18:46 UTC, 3 replies.
- Re: [PR] [SPARK-49562][SQL] Add SQL pipe syntax for aggregation [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/10/22 03:48:36 UTC, 24 replies.
- [PR] [SPARK-50050][PYTHON][CONNECT] Make `lit` accept `str` and `bool` type numpy ndarray [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/22 04:00:55 UTC, 3 replies.
- [PR] [SPARK-50051][PYTHON][FOLLOW-UP] Fix type check for Numpy 1.x [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/22 05:39:43 UTC, 0 replies.
- [PR] [SPARK-50059][CONNECT][PYTHON] API compatibility check for Structured Streaming I/O [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/22 06:05:46 UTC, 2 replies.
- [PR] [SPARK-50066][SQL] Codegen Support for `SchemaOfXml` (by Invoke & RuntimeReplaceable) [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/22 07:19:25 UTC, 0 replies.
- Re: [PR] [SPARK-50051][PYTHON][FOLLOW-UP] Fix data type check for Numpy 1.x [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/22 07:58:52 UTC, 1 replies.
- [PR] [SPARK-50067][SQL] Codegen Support for SchemaOfCsv(by Invoke & RuntimeReplaceable) [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/22 08:42:50 UTC, 6 replies.
- [PR] refactor [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2024/10/22 08:49:02 UTC, 0 replies.
- [PR] [SPARK-50069][SQL] Integrate `_LEGACY_ERROR_TEMP_0028` into `UNSUPPORTED_FROM_TO_EXPRESSION` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/22 09:55:40 UTC, 5 replies.
- [PR] [WIP][SPARK-50062][SQL] Support collations by `InSet` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/22 11:22:50 UTC, 0 replies.
- [PR] [SPARK-50070][SQL] Integrate `_LEGACY_ERROR_TEMP_0039` into `UNSUPPORTED_SQL_STATEMENT` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/22 11:32:58 UTC, 2 replies.
- Re: [PR] [SPARK-50060][SQL] Fixed behavior of set operators when dealing with conflicting collations [spark] - posted by "vladanvasi-db (via GitHub)" <gi...@apache.org> on 2024/10/22 12:09:27 UTC, 23 replies.
- Re: [PR] [SPARK-50031][SQL] Add the `TryParseUrl` expression [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/22 13:02:41 UTC, 4 replies.
- [PR] https://09306677>06/ORG0x858badb062fcec1fbf5898151e3b45b1f1b30088# Ap… [spark] - posted by "09306677806 (via GitHub)" <gi...@apache.org> on 2024/10/22 14:26:17 UTC, 1 replies.
- Re: [PR] [SPARK-50068] Refactor `TypeCoercion` and `AnsiTypeCoercion` to separate single node transformations [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/10/22 17:32:56 UTC, 2 replies.
- [PR] [WIP] Support Avro encoding for TransformWithState operator - ListState [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/10/22 18:02:05 UTC, 1 replies.
- Re: [PR] [SPARK-49985][SQL] Remove support for interval types in Variant [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/10/22 18:27:10 UTC, 2 replies.
- [PR] [SPARK-50075][SQL][PYTHON][CONNECT] Add DataFrame APIs for table-valued functions [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/10/22 19:04:08 UTC, 15 replies.
- [PR] List State Avro [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/10/22 19:16:20 UTC, 1 replies.
- Re: [PR] [SPARK-50062][SQL] Support collations by `InSet` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/22 19:17:22 UTC, 25 replies.
- [PR] [SPARK-50077][SQL] Introduce a new pattern object for LogicalRelation to help avoiding default pattern (full parameters) [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/10/22 22:31:19 UTC, 1 replies.
- [PR] [SPARK-50064][PYTHON][TESTS][FOLLOW-UP] Make pysaprk-ml tests passing without optional dependencies [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/23 00:36:29 UTC, 2 replies.
- [PR] [SPARK-50078][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_0038`: `DUPLICATED_CTE_NAMES` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/23 01:22:20 UTC, 2 replies.
- [PR] [SPARK-48912][SQL][TESTS] Improve collation support testing for various collations [spark] - posted by "dejankrak-db (via GitHub)" <gi...@apache.org> on 2024/10/23 01:37:36 UTC, 30 replies.
- [PR] [SPARK-50080][SQL][TESTS] Add benchmark cases for parquet adaptive bloom filter in BloomFilterBenchmark [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/10/23 02:24:33 UTC, 4 replies.
- [PR] [SPARK-50081][SQL] Codegen Support for `XPath...`(by Invoke & RuntimeReplaceable) [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/23 03:23:49 UTC, 0 replies.
- Re: [PR] [SPARK-46679][SQL] Fix for SparkUnsupportedOperationException Not found an encoder of the type T, when using Parameterized class [spark] - posted by "squito (via GitHub)" <gi...@apache.org> on 2024/10/23 03:33:30 UTC, 4 replies.
- [PR] [SPARK-50082][CORE] Remove some unnecessary Jersey-related warning logs [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/10/23 05:02:38 UTC, 3 replies.
- [PR] [SPARK-50079][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_2013`: `NEGATIVE_VALUES_IN_FREQUENCY_EXPRESSION` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/23 05:56:06 UTC, 6 replies.
- [PR] [MINOR][PYTHON][DOCS] Fix the type hint for `extract`, `date_part` and `datepart` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/23 07:03:18 UTC, 2 replies.
- [PR] [SPARK-50083][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_1231`: `INVALID_PARTITION_COLUMN_KEY` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/23 07:09:22 UTC, 1 replies.
- [PR] [SPARK-50085][PYTHON] Make `lit(ndarray)` with np.int8 respect the numpy datatype [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/23 08:01:00 UTC, 2 replies.
- Re: [PR] [SPARK-50081][SQL] Codegen Support for `XPath*`(by Invoke & RuntimeReplaceable) [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/23 08:35:20 UTC, 7 replies.
- [PR] [SPARK-49638] Remove the ANSI config suggestion in INVALID_URL [spark] - posted by "jovanm-db (via GitHub)" <gi...@apache.org> on 2024/10/23 08:48:10 UTC, 0 replies.
- [PR] [SPARK-50086][PYTHON][DOCS] Refine the docstring of multiple datetime functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/23 08:48:41 UTC, 2 replies.
- [PR] Spark35 [spark] - posted by "ejblanco (via GitHub)" <gi...@apache.org> on 2024/10/23 08:52:46 UTC, 1 replies.
- Re: [PR] [SPARK-50077][SQL] Introduce a new pattern object for LogicalRelation to help avoiding default full params pattern [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/10/23 09:21:27 UTC, 9 replies.
- [PR] [SPARK-50088] [SQL] Refactor UnresolvedStarBase.expand(...) [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2024/10/23 09:48:43 UTC, 0 replies.
- Re: [PR] [SPARK-49902][SQL] Catch underlying runtime errors in `RegExpReplace` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/23 09:55:20 UTC, 1 replies.
- Re: [PR] [SPARK-50068][SQL] Refactor `TypeCoercion` and `AnsiTypeCoercion` to separate single node transformations [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/23 10:19:14 UTC, 21 replies.
- Re: [PR] [SPARK-50088][SQL] Refactor `UnresolvedStarBase.expand` [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/10/23 12:16:41 UTC, 3 replies.
- [PR] [SPARK-50084][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_3168`: `MISSING_TIMEOUT_CONFIGURATION` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/23 13:34:24 UTC, 2 replies.
- [PR] [SPARK-50087] Robust handling of boolean expressions in CASE WHEN for MsSqlServer and future connectors [spark] - posted by "andrej-db (via GitHub)" <gi...@apache.org> on 2024/10/23 14:17:10 UTC, 43 replies.
- Re: [PR] [SPARK-49638][SQL] Remove the ANSI config suggestion in INVALID_URL [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/23 14:31:39 UTC, 1 replies.
- [PR] [SPARK-48139] Try stabilising multi-thread tests in CI [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/10/23 15:18:35 UTC, 0 replies.
- [PR] [SPARK-50090] Refactor ResolveBinaryArithmetic to separate single-node transformation [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2024/10/23 15:38:56 UTC, 2 replies.
- [PR] [WIP][SPARK-50071]Add try_make_timestamp(_ltz and _ntz) and related tests [spark] - posted by "markonik-db (via GitHub)" <gi...@apache.org> on 2024/10/23 16:34:29 UTC, 6 replies.
- [PR] [SPARK-50092][SQL] Fix PostgreSQL connector behaviour for multidimensional arrays [spark] - posted by "PetarVasiljevic-DB (via GitHub)" <gi...@apache.org> on 2024/10/23 17:41:44 UTC, 36 replies.
- [PR] [SPARK-50093][SQL] Collations that use ICU should have the version of the used ICU library [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/10/23 18:02:04 UTC, 11 replies.
- [PR] [SPARK-50091][SQL] Handle case of aggregates in left-hand operand of IN-subquery [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2024/10/23 19:22:11 UTC, 0 replies.
- [PR] [SPARK-49999][PYTHON][CONNECT] Support optional "column" parameter in box, kde and hist plots [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/10/24 02:08:12 UTC, 10 replies.
- [PR] Tws avro ms [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/10/24 02:11:18 UTC, 1 replies.
- [PR] [SPARK-50095][CONNECT][TESTS] Enable `ProtoToParsedPlanTestSuite` to run successfully in IDE [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/24 02:12:35 UTC, 3 replies.
- [PR] [SPARK-50096][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_2150`: `TUPLE_SIZE_EXCEEDS_LIMIT` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/24 03:06:20 UTC, 5 replies.
- Re: [PR] [SPARK-50083][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_1231`: `PARTITIONS_NOT_FOUND` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/24 03:20:50 UTC, 0 replies.
- [PR] Rename test_report.yml to test_report.yml.Shahrzad mahro [spark] - posted by "09306677806 (via GitHub)" <gi...@apache.org> on 2024/10/24 04:34:15 UTC, 1 replies.
- [PR] [SPARK-50097][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_1248`: `ALTER_TABLE_SERDE_FOR_DATASOURCE_TABLE` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/24 04:50:08 UTC, 2 replies.
- [PR] [SPARK-50094][PYTHON][CONNECT] Better error message when using memory profiler on editors with no line numbers [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/10/24 06:00:45 UTC, 3 replies.
- Re: [PR] [SPARK-25313][SQL]Fix regression in FileFormatWriter output names [spark] - posted by "xyiswinner (via GitHub)" <gi...@apache.org> on 2024/10/24 07:20:23 UTC, 3 replies.
- [PR] Clean up unavailable `SQL/Hive console settings` from SparkBuild.scala [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/10/24 07:52:52 UTC, 0 replies.
- [PR] [SQL][TEST] Optimize from_json + to_json [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/24 09:22:09 UTC, 0 replies.
- Re: [PR] [SPARK-49695][SQL] Postgres fix xor push-down [spark] - posted by "milastdbx (via GitHub)" <gi...@apache.org> on 2024/10/24 09:25:03 UTC, 5 replies.
- Re: [PR] [SPARK-49899][PYTHON][SS] Support deleteIfExists for TransformWithStateInPandas [spark] - posted by "Pshak-20000 (via GitHub)" <gi...@apache.org> on 2024/10/24 11:50:41 UTC, 11 replies.
- Re: [PR] [SPARK-46461][BUILD] Clean up unavailable `SQL/Hive console settings` from SparkBuild.scala [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/10/24 13:26:48 UTC, 3 replies.
- Re: [PR] [SPARK-50060][SQL] Disabled conversion between different collated types in TypeCoercion and AnsiTypeCoercion [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/10/24 14:03:00 UTC, 7 replies.
- [PR] [SPARK-50031][SQL][FOLLOW-UP] Add missing golden files for TryParseUrl [spark] - posted by "jovanm-db (via GitHub)" <gi...@apache.org> on 2024/10/24 14:30:27 UTC, 0 replies.
- [PR] [SPARK-50098][PYTHON] Upgrade the minimum version of `googleapis-common-protos` to 1.65.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/24 14:56:15 UTC, 2 replies.
- [PR] [SPARK-50099][K8S][DOCS] Update `YuniKorn` docs with v1.6.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/24 15:29:31 UTC, 0 replies.
- Re: [PR] [SPARK-31010][SQL][ML][FOLLOW-UP] Throw exception when use untyped UDF by default [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/10/24 15:39:12 UTC, 0 replies.
- [PR] [DRAFT] New collation precedence [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/10/24 16:57:08 UTC, 1 replies.
- Re: [PR] [SPARK-50099][K8S][DOCS] Update `YuniKorn` docs with `1.6.0` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/24 17:19:31 UTC, 4 replies.
- [PR] [SPARK-50101][SQL] Fix collated behavior of StringToMap expression [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2024/10/24 17:31:59 UTC, 10 replies.
- Re: [PR] [MINOR] bump go version to 1.22 [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/10/24 19:38:09 UTC, 1 replies.
- [PR] [SPARK-50098][PYTHON][FOLLOWUP] Update `_minimum_googleapis_common_protos_version` in `setup.py` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/24 20:11:12 UTC, 6 replies.
- [PR] [SPARK-50106][PYTHON] Upgrade `protobuf` Python package to 5.28.3 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/24 20:24:02 UTC, 7 replies.
- [PR] [DOCS] Add note on compatibility with Confluent Schema Registry in Avro Source Data Guide [spark] - posted by "jenswaage (via GitHub)" <gi...@apache.org> on 2024/10/24 20:30:20 UTC, 0 replies.
- [PR] [SPARK-50107][SQL][BUILD] Upgrade `protobuf-java` to 4.28.3 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/24 21:18:44 UTC, 14 replies.
- Re: [PR] [SPARK-50017] Support Avro encoding for TransformWithState operator - ValueState, ListState [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/10/24 22:13:22 UTC, 28 replies.
- [PR] [SPARK-50108][INFRA][PYTHON][TESTS] Upgrade PyPy CI to 3.10 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/24 22:22:48 UTC, 6 replies.
- Re: [PR] [SPARK-49883][SS] State Store Checkpoint Structure V2 Integration with RocksDB and RocksDBFileManager [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2024/10/24 22:34:34 UTC, 1 replies.
- Re: [PR] [DO-NOT-MERGE][SQL] Reduce the number of shuffles in SQL in local mode [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/25 00:24:26 UTC, 1 replies.
- [PR] [SPARK-50109][PYTHON][DOCS] Refine the docstring for more date functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/25 01:08:56 UTC, 4 replies.
- [PR] [SPARK-49563][SQL] Add SQL pipe syntax for the WINDOW operator [spark] - posted by "Angryrou (via GitHub)" <gi...@apache.org> on 2024/10/25 02:12:51 UTC, 14 replies.
- Re: [PR] [SPARK-48139][CONNECT][TESTS] Try stabilising multi-thread tests in CI [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/25 03:30:35 UTC, 11 replies.
- [PR] [SPARK-50112] Allowing the TransformWithState operator to use Avro encoding [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/10/25 03:55:22 UTC, 13 replies.
- [PR] [SPARK-50113][CONNECT][PYTHON][TESTS] Compatibility check should respect `ONLY_SUPPORTED_WITH_SPARK_CONNECT` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/25 04:53:27 UTC, 5 replies.
- [PR] [SPARK-50015][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_1125`: `MISSING_DATABASE_FOR_V1_SESSION_CATALOG` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/25 06:29:56 UTC, 3 replies.
- [PR] [SPARK-50110][SQL] Fix `from_csv`: parse fails when data contains spaces before and after [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/25 07:01:35 UTC, 8 replies.
- Re: [PR] [SPARK-50031][SQL][FOLLOW-UP] Add tests for `try_parse_url` in the connect module [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/25 07:26:10 UTC, 1 replies.
- Re: [PR] [SPARK-50083][SQL] Integrate `_LEGACY_ERROR_TEMP_1231` into `PARTITIONS_NOT_FOUND` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/25 07:42:55 UTC, 1 replies.
- [PR] Change to using a plugin to generate `StateMessage.java` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/10/25 08:56:25 UTC, 0 replies.
- Re: [PR] [BUILD][SS] Change to using `maven/sbt` plugin to generate `StateMessage.java` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/10/25 09:14:24 UTC, 0 replies.
- [PR] [SPARK-50016][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_2067`: `UNSUPPORTED_PARTITION_TRANSFORM` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/25 10:32:27 UTC, 3 replies.
- [PR] [SPARK-49637] Changed error message for INVALID_FRACTION_OF_SECOND [spark] - posted by "markonik-db (via GitHub)" <gi...@apache.org> on 2024/10/25 10:34:33 UTC, 10 replies.
- [PR] [MINOR[TESTS] Move BitmapExpressionUtilsSuite & ExpressionImplUtilsSuite from java to scala test sources folder [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/10/25 11:16:49 UTC, 1 replies.
- Re: [PR] [SPARK-50117][BUILD][SS] Change to using `maven/sbt` plugin to generate `StateMessage.java` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/10/25 13:09:04 UTC, 21 replies.
- [PR] [SPARK-50119] Add user facing error for lambda functions outside of higher order functions [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2024/10/25 13:51:12 UTC, 2 replies.
- [PR] [SPARK-50121][INFRA] Add `Python 3.9` to the Daily Python GitHub Action job [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/25 14:18:02 UTC, 0 replies.
- Re: [PR] [SPARK-50121][INFRA] Add `Python 3.9` Daily Python GitHub Action job [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/25 14:19:54 UTC, 4 replies.
- Re: [PR] [SPARK-50071] Add try_make_timestamp(_ltz and _ntz) and related tests [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/25 15:03:42 UTC, 2 replies.
- [PR] Add new error class - Data source does not support DML operation [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2024/10/25 15:56:15 UTC, 14 replies.
- Re: [PR] [SPARK-50123][TESTS] Move BitmapExpressionUtilsSuite & ExpressionImplUtilsSuite from java to scala test sources folder [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/10/25 15:59:11 UTC, 3 replies.
- [PR] [SPARK-50124][SQL] LIMIT/OFFSET should preserve data ordering [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/10/25 16:46:14 UTC, 26 replies.
- [PR] [TYPING] Add type overloads for inplace dataframe operations [spark] - posted by "tigerhawkvok (via GitHub)" <gi...@apache.org> on 2024/10/25 16:54:04 UTC, 1 replies.
- Re: [PR] [SPARK-50125] Add new error class - Data source does not support DML operation [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2024/10/25 18:12:19 UTC, 7 replies.
- [PR] [DRAFT] New collation prec separate [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/10/25 20:04:08 UTC, 0 replies.
- [PR] [WIP][SPARK-50130][SQL][PYTHON] Add DataFrame APIs for subqueries [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/10/25 23:29:49 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-50130][SQL][PYTHON] Add DataFrame APIs for scalar and exists subqueries [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/10/25 23:46:44 UTC, 1 replies.
- Re: [PR] [SPARK-48396] Support configuring max cores can be used for SQL [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/26 00:23:41 UTC, 1 replies.
- [PR] [SPARK-50118][CONNET] Reset isolated state cache when tasks are running [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/26 06:39:55 UTC, 1 replies.
- [PR] [SPARK-50135][BUILD] Upgrade ZooKeeper to 3.9.3 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/26 09:02:35 UTC, 3 replies.
- [PR] [SPARK-50136][BUILD] Upgrade `curator` to 5.7.1 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/26 09:16:35 UTC, 2 replies.
- [PR] [SPARK-50137][HIVE] Avoid fallback to Hive-incompatible ways when tab… [spark] - posted by "wecharyu (via GitHub)" <gi...@apache.org> on 2024/10/26 16:46:08 UTC, 0 replies.
- Re: [PR] [SPARK-48861][SQL] Enable shuffle file removal/skipMigration for all SQL executions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/27 00:26:34 UTC, 1 replies.
- Re: [PR] [ONLY TEST][SQL] Improve TPCDSCollationQueryTestSuite [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/27 00:26:34 UTC, 1 replies.
- Re: [PR] [MINOR][DOCS] Fix values argument docstring at DataFrame.melt and unpivot [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/27 00:26:36 UTC, 1 replies.
- [PR] Publish 3.4.4 to docker registry [spark-docker] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/27 02:40:17 UTC, 5 replies.
- Re: [PR] [SPARK-50071][SQL][PYTHON] Add try_make_timestamp(_ltz and _ntz) and related tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/27 05:59:25 UTC, 7 replies.
- [PR] [SPARK-50138][PYTHON][DOCS][TESTS] Refine docstring for basic functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/27 07:56:26 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-49707][BUILD] Upgrade rocksdbjni to 9.7.3 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/27 13:01:24 UTC, 0 replies.
- Re: [PR] [SPARK-48879][SQL] Expand the charset list with Chinese Standard Charsets [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/28 00:25:55 UTC, 1 replies.
- [PR] [SPARK-50100][INFRA] Remove `branch-3.4`-related CIs and comments [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/28 01:19:55 UTC, 3 replies.
- [PR] [SPARK-50140][BUILD] Upgrade `zstd-jni` to 1.5.6-7 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/28 01:58:03 UTC, 12 replies.
- [PR] [SPARK-50141][PYTHON] Make `lpad` and `rpad` accept Column type arguments [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/28 03:04:43 UTC, 2 replies.
- [PR] [SPARK-50143][BUILD] Fix `protobuf` module Maven compilation [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/28 03:52:18 UTC, 12 replies.
- [PR] [SPARK-50145][BUILD] Upgrade Jetty to 11.0.24 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/28 05:42:03 UTC, 9 replies.
- [PR] Test fix sql core shade rule [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/10/28 06:03:05 UTC, 1 replies.
- Re: [PR] [SPARK-26695][SQL] data source v2 API refactor - continuous read [spark] - posted by "zhztheplayer (via GitHub)" <gi...@apache.org> on 2024/10/28 06:24:34 UTC, 0 replies.
- [PR] [SPARK-50144][SS] Address the limitation of metrics calculation with DSv1 streaming sources [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/10/28 06:32:04 UTC, 9 replies.
- [PR] [WIP][SPARK-50146][PYTHON][CONNECT] Configurable schema validation when creating DataFrames from Arrow tables [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/10/28 06:51:35 UTC, 0 replies.
- [PR] [SPARK-50147][PYTHON] Refine docstring for trigonometric functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/28 07:10:42 UTC, 0 replies.
- [PR] Add Sample functionality in DataFrame. [spark-connect-go] - posted by "imvtsl (via GitHub)" <gi...@apache.org> on 2024/10/28 08:14:22 UTC, 1 replies.
- Re: [PR] [SPARK-50028][CONNECT] Replace global locks in Spark Connect server listener with fine-grained locks [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/10/28 08:42:14 UTC, 1 replies.
- [I] Add docker file for spark connect server. [spark-connect-go] - posted by "imvtsl (via GitHub)" <gi...@apache.org> on 2024/10/28 08:44:45 UTC, 0 replies.
- [PR] [SPARK-50148][SQL] Make `StaticInvoke` compatible with the method that declare throw exception [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/28 09:14:06 UTC, 8 replies.
- Re: [PR] [SPARK-49707][BUILD] Upgrade rocksdbjni to 9.7.3 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/28 11:56:41 UTC, 4 replies.
- [I] `types.Row.FieldNames()` not in order [spark-connect-go] - posted by "paulheg (via GitHub)" <gi...@apache.org> on 2024/10/28 13:08:14 UTC, 0 replies.
- Re: [PR] [SPARK-49993][SQL] Improve error messages for Sum and Average [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/28 15:11:41 UTC, 1 replies.
- [PR] Bump rexml from 3.2.6 to 3.3.9 in /docs [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/10/28 15:58:12 UTC, 2 replies.
- Re: [PR] [SPARK-50147][PYTHON][DOCS][TESTS] Refine docstring for trigonometric functions [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/28 17:47:19 UTC, 3 replies.
- [PR] [WIP] Added Logistic Matrix Factorization(LMF) and Item2Vec models [spark] - posted by "ezamyatin (via GitHub)" <gi...@apache.org> on 2024/10/28 18:02:06 UTC, 0 replies.
- [PR] [SPARK-50149][INFRA] Update INFRA docker image to use `jammy-20240911.1` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/28 18:44:02 UTC, 4 replies.
- [PR] [SPARK-49297][CORE][TESTS] Fix race condition in BlockManagerDecommissionIntegrationSuite [spark] - posted by "attilapiros (via GitHub)" <gi...@apache.org> on 2024/10/28 18:54:19 UTC, 4 replies.
- [PR] [SPARK-50150][BUILD][3.5] Upgrade Jetty to 9.4.56.v20240826 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/28 18:55:22 UTC, 6 replies.
- [PR] [SPARK-50151][SS][RocksDB Hardening] - Fix new file mapping version advancement and ineffective file reuse bug [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2024/10/28 19:46:05 UTC, 0 replies.
- Re: [PR] [SPARK-49676][SS][PYTHON] Add Support for Chaining of Operators in transformWithStateInPandas API [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/10/28 20:44:44 UTC, 6 replies.
- [PR] Initial state reader integration [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/10/28 23:48:28 UTC, 0 replies.
- Re: [PR] [SPARK-50152][SS] Support handleInitialState with state data source reader [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/10/29 00:13:54 UTC, 13 replies.
- [PR] [SPARK-50102][SQL][CONNECT] Add shims need for missing public SQL methods. [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/10/29 02:47:06 UTC, 0 replies.
- [PR] [SPARK-50153][SQL] Add `name` to `RuleExecutor` to make printing `QueryExecutionMetrics`'s logs clearer [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/29 03:19:09 UTC, 1 replies.
- Re: [PR] [MINOR][BUILD] Skip `deepspeed` in requirements on MacOS [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/29 04:57:38 UTC, 0 replies.
- [PR] [SPARK-50154][SQL] Assign appropriate error condition for `_LEGACY_ERROR_TEMP_0043`: `INVALID_RESET_COMMAND_FORMAT` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/29 05:08:52 UTC, 0 replies.
- Re: [PR] [SPARK-47094][SQL][TEST][FOLLOWUP] SPJ : fix bucket reducer function [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2024/10/29 05:23:04 UTC, 4 replies.
- [PR] [SPARK-50155][INFRA] Move Scala and Java files to their default folders [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/29 08:19:43 UTC, 0 replies.
- [PR] [SPARK-50156][SQL] Integrate `_LEGACY_ERROR_TEMP_2113` into `UNRECOGNIZED_STATISTIC` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/10/29 08:26:10 UTC, 1 replies.
- Re: [PR] [SPARK-49663][SQL] Enable RTRIM suggestions in collation expressions [spark] - posted by "jovanpavl-db (via GitHub)" <gi...@apache.org> on 2024/10/29 09:31:34 UTC, 3 replies.
- [PR] [SPARK-50157][SQL] Using SQLConf provided by SparkSession first. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2024/10/29 10:43:06 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-50011][INFRA] Add a separate docker file for doc build [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/29 11:05:19 UTC, 0 replies.
- [PR] [SPARK-50159][PYTHON][DOCS][TESTS] Refine docstrings for aggregation functions - part 1 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/29 11:38:49 UTC, 2 replies.
- Re: [PR] [SPARK-49637][SQL] Changed error message for INVALID_FRACTION_OF_SECOND [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/29 13:36:59 UTC, 1 replies.
- Re: [PR] [SPARK-50155][INFRA] Move `scala` and `java` files to their default folders [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/29 14:02:13 UTC, 4 replies.
- [PR] [SPARK-50160][SQL][KAFKA] KafkaWriteTask: allow customizing record timestamp [spark] - posted by "schulzp (via GitHub)" <gi...@apache.org> on 2024/10/29 14:50:23 UTC, 0 replies.
- [PR] [SPARK-50161][BUILD] Upgrade Kafka to 3.8.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/29 15:18:53 UTC, 4 replies.
- [PR] [SPARK-50163] Fix the RocksDB extra release due to the completion listener [spark] - posted by "liviazhu-db (via GitHub)" <gi...@apache.org> on 2024/10/29 21:59:18 UTC, 0 replies.
- [PR] [SPARK-50165][BUILD] Upgrade jackson to 2.18.1 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/30 01:34:58 UTC, 3 replies.
- [PR] [SPARK-49766][SQL][FOLLOWUP] Remove redundant whether is null check [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/30 02:25:35 UTC, 0 replies.
- [PR] [SPARK-50155][3.5] Move scala and java files to their default folders [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/30 02:45:21 UTC, 3 replies.
- [PR] [SPARK-50167][PYTHON][CONNECT] Improve PySpark plotting error messages and imports [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/10/30 03:14:30 UTC, 6 replies.
- [PR] [SPARK-50169][SQL] Improve performance of RegExpReplace [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/30 03:28:10 UTC, 1 replies.
- [PR] [SPARK-50170][PYTHON] Move `_invoke_internal_function_over_columns` to `pyspark.sql.utils` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/30 05:08:10 UTC, 4 replies.
- [PR] [SPARK-50172][BUILD] Upgrade scala-maven-plugin to 4.9.2 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/10/30 05:38:20 UTC, 4 replies.
- Re: [PR] [SPARK-50163] Fix the RocksDB extra acquireLock release due to the completion listener [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/10/30 05:48:30 UTC, 30 replies.
- [PR] [SPARK-50171][PYTHON] Make numpy optional for KDE plot [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/30 06:03:18 UTC, 3 replies.
- Re: [PR] [SPARK-49766][SPARK-49939][SPARK-49967][SPARK-49966][SQL][FOLLOWUP] Remove redundant whether is null check [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/30 06:10:36 UTC, 5 replies.
- [PR] [SPARK-50173][PS][SQL] Make `ddof` in pandas expressions accept all IntegralType [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/30 08:40:49 UTC, 0 replies.
- Re: [PR] [SPARK-50137][HIVE] Avoid fallback to Hive-incompatible ways when table creation fails by thrift exception [spark] - posted by "wecharyu (via GitHub)" <gi...@apache.org> on 2024/10/30 08:54:42 UTC, 0 replies.
- [PR] [SPARK-50174][SQL] Factor out `UnresolvedCatalogRelation` resolution [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/10/30 09:43:32 UTC, 5 replies.
- Re: [PR] [SPARK-50175][SQL] Change collation precedence calculation [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/10/30 11:53:25 UTC, 1 replies.
- Re: [PR] [SPARK-50166][SQL][BUILD] Fix shade and relocation rule of `sql/core` module [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/10/30 12:57:50 UTC, 6 replies.
- Re: [PR] [SPARK-48284][SQL] Fix UTF8String indexOf behaviour for empty string search [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/30 14:29:17 UTC, 1 replies.
- Re: [PR] [SPARK-50055][SQL] Add TryMakeInterval alternative [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/30 14:45:17 UTC, 0 replies.
- Re: [PR] [SPARK-50169][SQL] Improve performance of `RegExpReplace` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/30 15:59:17 UTC, 13 replies.
- [PR] [SPARK-50177][BUILD] Upgrade `Arrow` to 18.0.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/30 16:47:12 UTC, 4 replies.
- [PR] [SPARK-50178][INFRA] Use `PyArrow>=18.0.0` for Python 3.13 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/30 17:00:26 UTC, 8 replies.
- Re: [PR] [SPARK-50173][PS][SQL] Make pandas expressions accept more datatypes [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/30 17:55:40 UTC, 2 replies.
- [PR] [SPARK-50162] Add tests for loading snapshot with given version for transformWithState operator state and state data source reader [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/10/30 19:28:40 UTC, 0 replies.
- Re: [PR] [SPARK-50162][SS] Add tests for loading snapshot with given version for transformWithState operator state and state data source reader [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/10/30 19:30:18 UTC, 2 replies.
- [PR] [SPARK-50179][CORE] Make `spark.app.name` property optional in REST API [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/30 19:32:02 UTC, 5 replies.
- [PR] [SPARK-50181][INFRA] Remove unused `pr_public_classes.sh` and `pr_merge_ability.sh` scripts [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/30 21:49:16 UTC, 1 replies.
- [PR] [SPARK-50181][INFRA][DOCS] Remove outdated `run-tests-jenkins`-related stuff [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/30 22:11:09 UTC, 1 replies.
- [PR] [SPARK-50182][EXAMPLE] Add `submit-sql.sh` REST API example [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/31 00:04:16 UTC, 6 replies.
- Re: [PR] [SPARK-44884][Core] Create _SUCCESS marker file for spark write with … [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/10/31 00:24:34 UTC, 0 replies.
- Re: [PR] [SPARK-50181][INFRA][DOCS] Remove `run-tests-jenkins`-related stuff [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/31 03:24:31 UTC, 1 replies.
- [PR] [SPARK-50183][PYTHON] Unify the internal functions for Pandas API and PySpark Plotting [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/31 03:30:45 UTC, 4 replies.
- [PR] changing files [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/10/31 03:45:23 UTC, 1 replies.
- [PR] [SQL][TESTS]Make test case 'SPARK-48997: maintenance threads with exceptions unload only themselves' use a self-cleaning `rootLocation` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/10/31 03:50:15 UTC, 0 replies.
- [PR] [SPARK-50185][EXAMPLE][TESTS] Unify script file naming pattern by replacing `_` with `-` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/31 04:00:23 UTC, 0 replies.
- Re: [PR] [SPARK-50185][EXAMPLE][TESTS] Unify `*.sh` file naming patterns by replacing `_` with `-` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/31 04:11:55 UTC, 6 replies.
- [PR] [SPARK-50187][INFRA] Use latest Python dependencies for the build of Python client 3.5 <> 4.0 server [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/31 07:35:44 UTC, 3 replies.
- Re: [PR] [SPARK-50146][PYTHON][CONNECT] Configurable schema validation when creating DataFrames from Arrow tables [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/10/31 08:07:54 UTC, 0 replies.
- [PR] Update example symbolic link creation in Dockerfile.template [spark-docker] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/10/31 10:32:35 UTC, 2 replies.
- Re: [PR] [SPARK-48000][SQL] Enable hash join support for all collations (StringType) [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/10/31 10:36:44 UTC, 0 replies.
- [PR] [SPARK-50188][CONNECT] When the connect client starts, print the server's webUrl [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/31 11:08:51 UTC, 1 replies.
- [PR] [SPARK-50189][SQL] Upgrade ICU4J to `76.1` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/10/31 11:34:35 UTC, 5 replies.
- [PR] [SPARK-50190][PYTHON] Remove direct dependency of Numpy from Histogram [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/10/31 11:52:56 UTC, 2 replies.
- [PR] [SPARK-50192][K8S] Simplify symbolic link creation of `spark-examples.jar` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/31 15:24:09 UTC, 4 replies.
- [PR] [SQL] Add SQL pipe syntax for the FROM operator [spark] - posted by "jiashenC (via GitHub)" <gi...@apache.org> on 2024/10/31 15:53:53 UTC, 0 replies.
- [PR] [SPARK-50176][CONNECT][3.5] Disallow reattaching after the session is closed [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/10/31 17:01:17 UTC, 2 replies.
- [PR] [SPARK-50193] Fix exception handling for validating time modes [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/10/31 19:16:02 UTC, 0 replies.
- Re: [PR] [SPARK-50193][SS] Fix exception handling for validating time modes [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/10/31 19:17:12 UTC, 0 replies.
- [PR] Test [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/10/31 19:37:22 UTC, 1 replies.
- [PR] [SPARK-50128] Add stateful processor handle APIs using implicit encoders in Scala [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/10/31 20:21:22 UTC, 0 replies.
- [PR] [SPARK-50195][CORE] Fix `StandaloneRestServer` to propagate `spark.app.name` to `SparkSubmit` properly [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/10/31 21:53:04 UTC, 2 replies.
- Re: [PR] [SS] [SPARK-50163] Fix the RocksDB extra acquireLock release due to the completion listener [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2024/10/31 22:40:09 UTC, 1 replies.
- Re: [PR] [SPARK-50151][SS][RocksDB Hardening] - Fix ineffective file reuse bug in the new file management change [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/10/31 23:03:21 UTC, 0 replies.
- [PR] [SPARK-50196][CONNECT] Fix Python error context to use a proper context [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2024/10/31 23:18:36 UTC, 0 replies.
- Re: [PR] [SPARK-50033][SQL] Add a hint to logical.Aggregate() node [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/10/31 23:24:28 UTC, 0 replies.