reviews@spark.apache.org, 2023-12

You are viewing a plain text version of this content. The canonical link for it is here.

- Re: [PR] [SPARK-46189][PS][SQL] Perform comparisons and arithmetic between same types in various Pandas aggregate functions to avoid interpreted mode errors [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2023/12/01 00:08:03 UTC, 2 replies.
- Re: [PR] [SPARK-45093][CONNECT][PYTHON] Properly support error handling and conversion for AddArtifactHandler [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/01 00:10:21 UTC, 15 replies.
- [PR] [SPARK-46191][CORE] Improve `FileSystemPersistenceEngine.persist` error msg in case of the existing file [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/01 00:17:24 UTC, 4 replies.
- Re: [PR] [SPARK-46181][PYTHON][INFRA] Split scheduled Python build [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/01 00:19:18 UTC, 2 replies.
- Re: [PR] [Don't merge & review] Upgrade rocksdbjni 20231121 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/01 00:19:22 UTC, 5 replies.
- Re: [PR] [SPARK-43288][SQL] Support Create Table Like on DataSourceV2 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/01 00:21:07 UTC, 1 replies.
- Re: [PR] [WIP] AWS sdk upgrade [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/01 00:21:08 UTC, 0 replies.
- Re: [PR] [SPARK-44864] Align streaming statistics link format with other page links [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/01 00:21:09 UTC, 0 replies.
- Re: [PR] [SPARK-44811][BUILD] Upgrade Guava to 32+ [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/01 00:21:10 UTC, 2 replies.
- Re: [PR] [SPARK-44793][SQL] Fixing pipelineTime metric for WholeStageCodegen [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/01 00:21:12 UTC, 0 replies.
- Re: [PR] [SPARK-44773][SQL] Code-gen CodegenFallback expression in WholeStageCodegen if possible [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/01 00:21:12 UTC, 1 replies.
- Re: [PR] [SPARK-42551][SQL] Support more subexpression elimination cases [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/01 00:21:14 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-43403][UI] Ensure old SparkUI in HistoryServer has been detached before loading new one [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/01 00:21:16 UTC, 3 replies.
- Re: [PR] [SPARK-43232][SQL] Improve ObjectHashAggregateExec performance for high cardinality [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/01 00:21:18 UTC, 1 replies.
- [PR] [SPARK-46181][INFRA][FOLLOW-UP] Use a proper JSON syntax to pass PYTHON_TO_TEST [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/01 00:31:51 UTC, 4 replies.
- Re: [PR] [MINOR][DOCS] Fix the result file description of CoalescedRDDBenchmark [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/01 00:39:25 UTC, 2 replies.
- Re: [PR] EXECUTE IMMEDIATE SQL support [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/01 00:40:44 UTC, 3 replies.
- Re: [PR] [SPARK-46135][PYTHON][DOCS] Fix table format error in ipynb docs [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/01 00:42:43 UTC, 1 replies.
- Re: [PR] [SPARK-46179][SQL] Add CrossDbmsQueryTestSuites, which allows generating golden files with Postgres/other DBMS [spark] - posted by "andylam-db (via GitHub)" <gi...@apache.org> on 2023/12/01 00:55:25 UTC, 9 replies.
- Re: [PR] [SPARK-46185] Add official image Dockerfile for Apache Spark 3.4.2 [spark-docker] - posted by "Yikun (via GitHub)" <gi...@apache.org> on 2023/12/01 01:24:01 UTC, 2 replies.
- Re: [PR] [SPARK-46055][SQL][FOLLOWUP] Respect code style for scala and reduce the stack depth. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/12/01 01:40:04 UTC, 0 replies.
- Re: [PR] [SPARK-46184][CORE][SQL][CONNECT][MLLIB] Reduce stack depth by replace Option.isDefined with Option.isEmpty [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/12/01 01:50:16 UTC, 4 replies.
- Re: [PR] [SPARK-46055][SQL][FOLLOWUP] Respect code style for scala. [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/01 02:04:05 UTC, 3 replies.
- Re: [PR] [SPARK-45888][SS] Apply error class framework to State (Metadata) Data Source [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2023/12/01 02:35:03 UTC, 13 replies.
- Re: [PR] [SPARK-46187][SQL] Align codegen and non-codegen implementation of `StringDecode` [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/12/01 03:40:23 UTC, 5 replies.
- Re: [PR] [SPARK-45605][CORE][SQL][SS][CONNECT][MLLIB][GRAPHX][DSTREAM][PROTOBUF][EXAMPLES] Replace `s.c.MapOps.mapValues` with `s.c.MapOps.view.mapValues` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/01 03:46:53 UTC, 2 replies.
- [PR] [SPARK-46193][CORE][TESTS] Add `PersistenceEngineBenchmark` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/01 03:48:44 UTC, 6 replies.
- Re: [PR] [SPARK-45629][CORE][SQL][CONNECT][ML][STREAMING][BUILD][EXAMPLES]Fix `Implicit definition should have explicit type` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/01 03:52:00 UTC, 1 replies.
- Re: [PR] [SPARK-46043][SQL] Support create table using DSv2 sources [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/12/01 04:36:49 UTC, 14 replies.
- [PR] [SPARK-46194][BUILD] Clean up the TODO comments left in SPARK-33775 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/01 05:51:09 UTC, 0 replies.
- Re: [PR] [SPARK-46029][SQL][3.3] Escape the single quote, _ and % for DS V2 pushdown [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/12/01 06:58:12 UTC, 2 replies.
- [PR] [SPARK-46196][PYTHON][DOCS] Add missing function descriptions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/01 07:09:19 UTC, 1 replies.
- [PR] [SPARK-46197][INFRA] Upgrade `memory-profiler>=0.61.0` for Python 3.12 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/01 07:14:21 UTC, 6 replies.
- Re: [PR] [SPARK-46194][BUILD] Remove TODO comments left in SPARK-33775 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/01 07:56:40 UTC, 0 replies.
- Re: [PR] [SPARK-46090][SQL] Support plan fragment level SQL configs in AQE [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/01 08:08:57 UTC, 22 replies.
- [PR] [SPARK-46199][PYTHON][DOCS] Add PyPi link icon to PySpark doc header [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/01 08:16:08 UTC, 3 replies.
- Re: [PR] [SPARK-46196][PYTHON][DOCS] Add missing `toDegrees/toRadians/atan2/approxCountDistinct` function descriptions [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/01 08:19:42 UTC, 1 replies.
- Re: [PR] [SPARK-46108][SQL] keepInnerXmlAsRaw option for Built-in XML Data Source [spark] - posted by "ufuksungu (via GitHub)" <gi...@apache.org> on 2023/12/01 08:43:06 UTC, 0 replies.
- Re: [PR] [SPARK-38473][CORE][COMMON][DOCS][SQL] Use error classes in org.apache.spark.scheduler [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/01 09:44:20 UTC, 7 replies.
- [PR] [SPARK-46200][INFRA] re-org the testing dockerfile [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/01 09:55:50 UTC, 2 replies.
- [PR] [SPARK-46201][PYTHON][DOCS] Correct the typing of `schema_of_{csv, json, xml}` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/01 10:08:01 UTC, 3 replies.
- Re: [PR] [SPARK-46009][SQL][CONNECT] Merge the parse rule of PercentileCont and PercentileDisc into functionCall [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/12/01 11:15:20 UTC, 17 replies.
- Re: [PR] [SPARK-45649][SQL] Unify the prepare framework for OffsetWindowFunctionFrame [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/12/01 13:35:16 UTC, 27 replies.
- [PR] [SPARK-46202][CONNECT] Expose new ArtifactManager API to support in-memory artifacts and sub-directory structure [spark] - posted by "vicennial (via GitHub)" <gi...@apache.org> on 2023/12/01 13:50:44 UTC, 3 replies.
- Re: [PR] [SPARK-46092][SQL] Don't push down Parquet row group filters that overflow [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2023/12/01 13:51:17 UTC, 5 replies.
- [PR] [SPARK-46173] Skipping trimAll call during date parsing [spark] - posted by "dbatomic (via GitHub)" <gi...@apache.org> on 2023/12/01 14:39:35 UTC, 6 replies.
- Re: [PR] [SPARK-42349][PYTHON] Support pandas cogroup with multiple df [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2023/12/01 15:10:47 UTC, 0 replies.
- Re: [PR] [SPARK-39931][PYTHON][WIP] Improve applyInPandas performance for very small groups [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2023/12/01 15:12:52 UTC, 0 replies.
- Re: [PR] [SPARK-40559][PYTHON] Add applyInArrow to groupBy and cogroup [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2023/12/01 15:25:04 UTC, 7 replies.
- Re: [PR] [SPARK-46052][CORE] Remove function TaskScheduler.killAllTaskAttempts [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2023/12/01 16:19:54 UTC, 19 replies.
- [PR] [SPARK-46203][SQL][HIVE] Support get partitions by names in partition filter [spark] - posted by "wecharyu (via GitHub)" <gi...@apache.org> on 2023/12/01 17:09:23 UTC, 1 replies.
- [PR] [WIP][SPARK-46204][KUBERNETES] Switching the Kubernetes dev integration test script to use Java 17 instead of Java 8 [spark] - posted by "hannahkamundson (via GitHub)" <gi...@apache.org> on 2023/12/01 19:30:34 UTC, 0 replies.
- Re: [PR] [SPARK-46040][SQL][Python] Update UDTF API for 'analyze' partitioning/ordering columns to support general expressions [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2023/12/01 19:40:08 UTC, 7 replies.
- Re: [PR] [SPARK-46204][K8S] Switching the Kubernetes dev integration test script to use Java 17 instead of Java 8 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/01 19:56:49 UTC, 0 replies.
- Re: [PR] [SPARK-46204][K8S] Fix `dev-run-integration-tests.sh` to use 17 for `JAVA_VERSION` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/01 20:21:50 UTC, 2 replies.
- Re: [PR] [SPARK-39911][SQL] Optimize global Sort to RepartitionByExpression [spark] - posted by "maytasm (via GitHub)" <gi...@apache.org> on 2023/12/01 20:52:50 UTC, 7 replies.
- Re: [PR] [SPARK-45527][CORE] Use fraction to do the resource calculation [spark] - posted by "tgravescs (via GitHub)" <gi...@apache.org> on 2023/12/01 22:03:32 UTC, 5 replies.
- [PR] [SPARK-46205][CORE] Improve `PersistenceEngine` performance with `KryoSerializer` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/01 22:55:10 UTC, 14 replies.
- Re: [PR] [SPARK-46182][CORE] Track the lastTaskRunningTime using the exact task finished event [spark] - posted by "jiangxb1987 (via GitHub)" <gi...@apache.org> on 2023/12/02 00:12:59 UTC, 0 replies.
- Re: [PR] [SPARK-43536][CORE] Fixing statsd sink reporter [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/02 00:17:59 UTC, 1 replies.
- [PR] [SPARK-46206][PS] Use a narrower scope exception for SQL processor [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/02 01:48:40 UTC, 7 replies.
- [PR] [SPARK-46209] Add java 11 only yml for version before 3.5 [spark-docker] - posted by "Yikun (via GitHub)" <gi...@apache.org> on 2023/12/02 02:24:19 UTC, 4 replies.
- [PR] [SPARK-46208][PS][DOCS] Use specific Pandas version for API specifications. [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/02 02:28:19 UTC, 7 replies.
- [PR] [MINOR] Add since tag for reportDriverMetrics in Scan [spark] - posted by "Zouxxyy (via GitHub)" <gi...@apache.org> on 2023/12/02 03:11:16 UTC, 0 replies.
- [PR] [SPARK-46210][K8S][DOCS] Update YuniKorn docs with v1.4 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/02 03:34:21 UTC, 0 replies.
- [PR] [SPARK-46205][CORE][TESTS][FOLLOWUP] Simplify PersistenceEngineBenchmark [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/02 04:02:29 UTC, 4 replies.
- [PR] [SPARK-46207][SQL] Support MergeInto in DataFrameWriterV2 [spark] - posted by "huaxingao (via GitHub)" <gi...@apache.org> on 2023/12/02 04:05:55 UTC, 92 replies.
- [PR] [SPARK-40609][SQL] Unwrap cast in the join condition to unlock bucketed read [spark] - posted by "wankunde (via GitHub)" <gi...@apache.org> on 2023/12/02 06:08:21 UTC, 2 replies.
- [PR] [SPARK-41532][CONNECT][FOLLOWUP] Expose `SessionNotSameException` as PySpark exceptions [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/02 09:15:42 UTC, 0 replies.
- [PR] [SPARK-46212][CORE][SQL][SS][CONNECT][MLLIB][GRAPHX][DSTREAM][PROTOBUF][EXAMPLES] Replace `s.c.MapOps#view.mapValues` with `s.c.mutable.MapOps.map/s.c.MapOps.map/s.c.immutable.MapOps#transform` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/02 10:30:03 UTC, 0 replies.
- Re: [PR] [SPARK-46212][CORE][SQL][SS][CONNECT][MLLIB][GRAPHX][DSTREAM][PROTOBUF][EXAMPLES] Replace `s.c.MapOps#view.mapValues` with `s.c.MapOps#map/s.c.immutable.MapOps#transform` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/02 11:05:42 UTC, 0 replies.
- Re: [PR] [SPARK-45943][SQL] Move DetermineTableStats to resolution rules [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/02 11:42:23 UTC, 2 replies.
- [PR] [SPARK-46213][PYTHON] Introduce `PySparkImportError` for error framework [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/02 12:34:44 UTC, 12 replies.
- [PR] [SPARK-46214][BUILD] Upgrade commons-io to 2.15.1 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/02 12:40:52 UTC, 4 replies.
- [PR] [SPARK-45975][TESTS][3.5] Reset storeAssignmentPolicy to original [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/02 12:59:01 UTC, 1 replies.
- Re: [PR] [SPARK-46210][K8S][DOCS] Update `YuniKorn` docs with v1.4 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/02 17:47:20 UTC, 5 replies.
- Re: [PR] [SPARK-45975][SQL][TESTS][3.5] Reset storeAssignmentPolicy to original [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/02 19:06:56 UTC, 5 replies.
- Re: [PR] [SPARK-41532][CONNECT][PYTHON][FOLLOWUP] Expose `SessionNotSameException` as PySpark exceptions [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/02 19:40:55 UTC, 1 replies.
- Re: [PR] [MINOR][DOCS] Add `since` tag for `Scan.reportDriverMetrics` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/02 19:43:59 UTC, 0 replies.
- [PR] [SPARK-46215][CORE] Improve `FileSystemPersistenceEngine` to allow non-exist parents [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/02 22:28:55 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-44943][SQL] Fix overflow detection logic in conv [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/03 00:20:19 UTC, 1 replies.
- Re: [PR] [SPARK-43521][SQL] Add `CREATE TABLE LIKE FILE` statement [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/03 00:20:20 UTC, 1 replies.
- Re: [PR] [SPARK-46215][CORE] Improve `FileSystemPersistenceEngine` to allow nonexistent parents [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/03 01:57:13 UTC, 21 replies.
- [PR] [SPARK-43228][SQL] Join keys also match PartitioningCollection in CoalesceBucketsInJoin [spark] - posted by "wankunde (via GitHub)" <gi...@apache.org> on 2023/12/03 02:03:28 UTC, 2 replies.
- Re: [PR] [SPARK-46208][PS][DOCS] Adding a link for latest Pandas API specifications. [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/03 02:14:08 UTC, 4 replies.
- [PR] [SPARK-46216][CORE] Improve `FileSystemPersistenceEngine` to support compressions [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/03 03:51:45 UTC, 10 replies.
- Re: [PR] [SPARK-46069][SQL] Support unwrap timestamp type to date type [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2023/12/03 04:26:52 UTC, 17 replies.
- Re: [PR] [SPARK-46212][CORE][SQL][SS][CONNECT][MLLIB][GRAPHX][DSTREAM][PROTOBUF][EXAMPLES] Use other functions to simplify the code pattern of `s.c.MapOps#view.mapValues` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/03 05:39:30 UTC, 2 replies.
- Re: [PR] [SPARK-45786][SQL][3.3] Fix inaccurate Decimal multiplication and division results [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/03 05:48:28 UTC, 3 replies.
- [PR] [SPARK-46217][CORE][TESTS] Include `Driver/App` data in `PersistenceEngineBenchmark` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/03 08:40:48 UTC, 5 replies.
- [PR] [WIP][SQL] Restrict charsets in `decode()` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/03 09:15:04 UTC, 0 replies.
- [PR] [SPARK-46218][BUILD] Upgrade commons-cli to 1.6.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/03 09:21:45 UTC, 1 replies.
- [PR] [SPARK-46219][SQL] Unwrap cast in join predicates [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2023/12/03 09:56:45 UTC, 8 replies.
- [PR] [SPARK-46069][SQL][FOLLOWUP] Support unwrap timestamp type to date type [spark] - posted by "wankunde (via GitHub)" <gi...@apache.org> on 2023/12/03 15:31:27 UTC, 1 replies.
- Re: [PR] [SPARK-45807][SQL] Add createOrReplaceView(..) / replaceView(..) to ViewCatalog [spark] - posted by "jzhuge (via GitHub)" <gi...@apache.org> on 2023/12/03 18:37:35 UTC, 8 replies.
- [PR] [SPARK][PS][DOC] Change `to_spark_io` to `spark.to_spark_io` in `quickstart_ps.ipynb` [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2023/12/03 19:51:35 UTC, 0 replies.
- Re: [PR] [SPARK-46221][PS][DOCS] Change `to_spark_io` to `spark.to_spark_io` in `quickstart_ps.ipynb` [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2023/12/03 19:59:21 UTC, 5 replies.
- [PR] [SPARK-46222][PYTHON][TESTS] Test invalid error class (pyspark.errors.utils) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/03 23:52:56 UTC, 4 replies.
- [PR] [SPARK-46223][PS] Test SparkPandasNotImplementedError with cleaning up unused code [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/04 00:10:59 UTC, 2 replies.
- Re: [PR] [SPARK-21195][CORE] Dynamically register metrics from sources as they are reported [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/04 00:19:30 UTC, 3 replies.
- Re: [PR] [SPARK-35198][CONNECT][CORE][PYTHON][SQL] Add support for calling debugCodegen from Python & Java [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/04 00:19:35 UTC, 1 replies.
- [PR] [SPARK-46224][PYTHON][MLLIB][TESTS] Test string representation of TestResult (pyspark.mllib.stat.test) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/04 00:24:58 UTC, 2 replies.
- Re: [PR] [SPARK-46069][SQL][FOLLOWUP] Make sure the cast expression is date type when unwrap timestamp type to date type [spark] - posted by "wankunde (via GitHub)" <gi...@apache.org> on 2023/12/04 01:29:46 UTC, 5 replies.
- [PR] [SPARK-40559][PYTHON][DOCS][FOLLOW-UP] Fix the docstring and document both applyInArrows [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/04 01:30:20 UTC, 3 replies.
- Re: [PR] [SPARK-23015][WINDOWS] Mitigate bug in Windows where starting multiple Spark instances within the same second causes a failure [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/04 01:38:42 UTC, 0 replies.
- Re: [PR] [SPARK-46220][SQL] Restrict charsets in `decode()` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/04 01:42:33 UTC, 1 replies.
- [PR] [SPARK-46048][PYTHON][CONNECT][FOLLOWUP] Correct the string representation [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/04 01:57:56 UTC, 3 replies.
- [PR] [SPARK-40559][PYTHON] Fix linter for `getfullargspec` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/04 02:13:43 UTC, 0 replies.
- Re: [PR] [SPARK-40559][PYTHON][FOLLOW-UP] Fix linter for `getfullargspec` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/04 02:15:26 UTC, 1 replies.
- [PR] [SPARK-46227][SQL] Move `withSQLConf` from SQLHelper trait to `SQLConfHelper` trait [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2023/12/04 02:19:59 UTC, 1 replies.
- [PR] [SPARK-46226][PYTHON] Migrate all remaining `RuntimeError`s into PySpark error framework. [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/04 02:26:57 UTC, 0 replies.
- [PR] [SPARK-TBD] Forbid Recursive Error handling [spark] - posted by "cdkrot (via GitHub)" <gi...@apache.org> on 2023/12/04 02:43:50 UTC, 1 replies.
- [PR] [SPARK-46228][SQL] Insert window group limit node for cumulative aggregation with limit [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2023/12/04 02:45:38 UTC, 45 replies.
- [PR] [WIP][SPARK-46229][PYTHON][CONNECT] Add applyInArrow to groupBy and cogroup in Spark Connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/04 02:50:41 UTC, 1 replies.
- [PR] [SPARK-46230][PYTHON] Migrate `RetriesExceeded` and `RetryException` into PySpark error. [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/04 02:53:26 UTC, 5 replies.
- [PR] [SPARK-46231][PYTHON] Migrate all remaining `NotImplementedError` & `TypeError` into PySpark error framework [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/04 03:02:07 UTC, 1 replies.
- Re: [PR] [SPARK-TBD][PYTHON][CONNECT] Forbid Recursive Error handling [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/04 03:15:18 UTC, 9 replies.
- Re: [PR] [SPARK-32246][BUILD][INFRA] Add new Github Action to run Kinesis tests [spark] - posted by "junyuc25 (via GitHub)" <gi...@apache.org> on 2023/12/04 03:29:08 UTC, 3 replies.
- Re: [PR] [SPARK-46227][SQL] Move `withSQLConf` from `SQLHelper` to `SQLConfHelper` [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/12/04 03:34:45 UTC, 5 replies.
- Re: [PR] [SPARK-45602][CORE][SQL][SS][YARN][K8S] Replace `s.c.MapOps.filterKeys` with `s.c.MapOps.view.filterKeys` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/04 03:55:27 UTC, 3 replies.
- [PR] [SPARK-46232][PYTHON] Migrate all remaining ValueError into PySpark error framework. [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/04 05:13:47 UTC, 2 replies.
- Re: [PR] [SPARK-46050][SQL]: Allow additional rules for the Substitution batch [spark] - posted by "jzhuge (via GitHub)" <gi...@apache.org> on 2023/12/04 05:34:05 UTC, 2 replies.
- [PR] [SPARK-46233][PYTHON] Migrate all remaining `AttributeError` into PySpark error framework [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/04 06:05:27 UTC, 1 replies.
- Re: [PR] [SPARK-46182][CORE] Track `lastTaskFinishTime` using the exact task finished event [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/04 06:08:28 UTC, 2 replies.
- [PR] [SPARK-46234][PYTHON] Introduce `PySparkKeyError` for PySpark error framework [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/04 06:20:08 UTC, 3 replies.
- Re: [PR] [SPARK-46230][PYTHON] Migrate `RetriesExceeded` into PySpark error. [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/04 06:27:09 UTC, 0 replies.
- Re: [PR] [SPARK-37518][SQL] Inject an early scan pushdown rule [spark] - posted by "advancedxy (via GitHub)" <gi...@apache.org> on 2023/12/04 06:45:59 UTC, 0 replies.
- [PR] [SPARK-46236][PYTHON][DOCS] Using brighter color for docs h3 title for better visibility [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/04 06:50:20 UTC, 2 replies.
- Re: [PR] [SPARK-46229][PYTHON][CONNECT] Add applyInArrow to groupBy and cogroup in Spark Connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/04 07:23:50 UTC, 2 replies.
- [PR] [SPARK-46237][SQL][TESTS] Fix test failed of `HiveDDLSuite` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/04 08:26:59 UTC, 2 replies.
- [PR] [SPARK-46092][SQL][3.5] Don't push down Parquet row group filters that overflow [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2023/12/04 08:48:33 UTC, 2 replies.
- [PR] [SPARK-46092][SQL][3.4] Don't push down Parquet row group filters that overflow [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2023/12/04 08:48:40 UTC, 2 replies.
- [PR] [SPARK-46092][SQL][3.3] Don't push down Parquet row group filters that overflow [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2023/12/04 08:48:47 UTC, 2 replies.
- Re: [PR] [SPARK-46173][SQL] Skipping trimAll call during date parsing [spark] - posted by "dbatomic (via GitHub)" <gi...@apache.org> on 2023/12/04 09:04:40 UTC, 33 replies.
- [PR] [WIP][SQL][DOCS] Describe arguments of `decode()` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/04 09:35:35 UTC, 0 replies.
- [PR] [SPARK-46239][CORE] Hide the version information of Spark Jetty [spark] - posted by "chenyu-opensource (via GitHub)" <gi...@apache.org> on 2023/12/04 09:36:16 UTC, 2 replies.
- Re: [PR] [SPARK-46186][CONNECT] Fix illegal state transition when ExecuteThreadRunner interrupted before started [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2023/12/04 09:40:58 UTC, 3 replies.
- Re: [PR] [SPARK-46075][CONNECT] Improvements to SparkConnectSessionManager [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2023/12/04 09:41:03 UTC, 5 replies.
- Re: [PR] [SPARK-46241][PYTHON][CONNECT] Forbid Recursive Error handling [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2023/12/04 10:17:51 UTC, 3 replies.
- Re: [PR] [SPARK-32246][BUILD][INFRA] Enable Kinesis tests in Githuh Actions [spark] - posted by "junyuc25 (via GitHub)" <gi...@apache.org> on 2023/12/04 10:24:15 UTC, 1 replies.
- Re: [PR] [SPARK-46237][SQL][TESTS] Make `HiveDDLSuite` independently testable [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/04 10:26:12 UTC, 4 replies.
- [PR] [SPARK-46244][SQL] INSERT/UPDATE * in MERGE should follow the same semantic of INSERT BY NAME [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/12/04 11:20:48 UTC, 3 replies.
- Re: [PR] [SPARK-46243][SQL][DOCS] Describe arguments of `decode()` [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/12/04 12:06:40 UTC, 6 replies.
- [PR] [SPARK-46245][CORE][SQL][YARN][K8S] Replcace `s.c.MapOps.view.filterKeys` with `s.c.MapOps.filter` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/04 12:57:25 UTC, 0 replies.
- Re: [PR] [SPARK-46245][CORE][SQL][SS][YARN][K8S][UI] Replcace `s.c.MapOps.view.filterKeys` with `s.c.MapOps.filter` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/04 13:05:10 UTC, 6 replies.
- Re: [PR] [SPARK-46137] update janino to version 3.1.11 [spark] - posted by "igreenfield (via GitHub)" <gi...@apache.org> on 2023/12/04 15:21:00 UTC, 0 replies.
- Re: [PR] [SPARK-45701][SPARK-45684][SPARK-45692][CORE][SQL][SS][ML][K8S] Clean up the deprecated API usage related to `mutable.SetOps/c.SeqOps/Iterator/Iterable/IterableOps` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/12/04 16:28:26 UTC, 5 replies.
- Re: [PR] [SPARK-46246] EXECUTE IMMEDIATE SQL support [spark] - posted by "milastdbx (via GitHub)" <gi...@apache.org> on 2023/12/04 17:47:21 UTC, 62 replies.
- [PR] [SPARK-45684][SQL][TESTS][FOLLOWUP] Use `++` instead of `s.c.SeqOps#concat` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/04 17:52:04 UTC, 0 replies.
- Re: [PR] [SPARK-45684][SQL][SS][TESTS][FOLLOWUP] Use `++` instead of `s.c.SeqOps#concat` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/04 17:52:52 UTC, 3 replies.
- [PR] [SPARK-46225][CONNECT] Collapse withColumns calls [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2023/12/04 17:58:01 UTC, 16 replies.
- Re: [PR] [SPARK-39800][SQL][WIP] DataSourceV2: View Support [spark] - posted by "jzhuge (via GitHub)" <gi...@apache.org> on 2023/12/04 18:19:23 UTC, 9 replies.
- Re: [PR] [SPARK-46094] Add support for code profiling executors [spark] - posted by "parthchandra (via GitHub)" <gi...@apache.org> on 2023/12/04 18:24:26 UTC, 2 replies.
- [PR] [SPARK-46248]XML: Support for ignoreCorruptFiles and ignoreMissingFiles options [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2023/12/04 18:46:51 UTC, 4 replies.
- [PR] [SPARK-45940][FOLLOWUP][TESTS] Only test Python data source when Python and PySpark environments are available [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/12/04 18:53:21 UTC, 2 replies.
- Re: [PR] [SPARK-45741][BUILD] Upgrade Netty to 4.1.100.Final [spark] - posted by "ulysseskan (via GitHub)" <gi...@apache.org> on 2023/12/04 19:10:19 UTC, 1 replies.
- Re: [PR] [SPARK-32246][BUILD][INFRA] Enable `streaming-kinesis-asl` tests in Github Action CI [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/04 20:44:31 UTC, 3 replies.
- [PR] [SPARK-46249] Require instance lock for acquiring RocksDB metrics to prevent race with background operations [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2023/12/04 21:15:35 UTC, 0 replies.
- Re: [PR] [SPARK-46249][SS] Require instance lock for acquiring RocksDB metrics to prevent race with background operations [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2023/12/04 21:16:43 UTC, 7 replies.
- [PR] [SPARK-46250][CONNECT][SS] Deflake test_parity_listener [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2023/12/04 22:32:02 UTC, 2 replies.
- Re: [PR] [SPARK-46239][CORE] Hide `Jetty` info [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/04 22:41:35 UTC, 3 replies.
- [PR] [SPARK-46252][PYTHON][TESTS] Improve test coverage of memory_profiler.py [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2023/12/04 23:30:47 UTC, 2 replies.
- Re: [PR] [SPARK-46241][PYTHON][CONNECT] Fix error handling routine so it wouldn't fall into infinite recursion [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/04 23:43:13 UTC, 3 replies.
- [PR] [SPARK-46229][PYTHON][CONNECT][FOLLOW-UP] Remove unnecessary Python version check lower than 3.8 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/04 23:46:34 UTC, 5 replies.
- [PR] [SPARK-46254][PYTHON] Remove stale Python 3.8/3.7 version checking [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/05 01:20:47 UTC, 4 replies.
- [PR] [SPARK-46253][PYTHON] Plan Python data source read using MapInArrow [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/12/05 01:44:33 UTC, 7 replies.
- [PR] [SPARK-46255][PYTHON][CONNECT] Support complex type -> string conversion [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/05 01:58:10 UTC, 3 replies.
- Re: [PR] [SPARK-46248][SQL] XML: Support for ignoreCorruptFiles and ignoreMissingFiles options [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2023/12/05 02:07:11 UTC, 11 replies.
- [PR] [SPARK-46256][CORE] Parallel Compression Support for ZSTD [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/12/05 03:20:15 UTC, 32 replies.
- [PR] [SPARK-46258][CORE] Add RocksDBPersistenceEngine [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/05 03:29:57 UTC, 0 replies.
- [PR] [SPARK-46257][BUILD] Upgrade Derby to 10.16.1.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/05 03:31:20 UTC, 4 replies.
- [PR] [SPARK-46259][PYTHON][DOCS] Add an appropriate link for error class usage documentation. [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/05 03:33:44 UTC, 5 replies.
- Re: [PR] [SPARK-46258][CORE] Add `RocksDBPersistenceEngine` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/05 04:57:22 UTC, 30 replies.
- [PR] [SPARK-46260][PYTHON] `DataFrame.withColumnsRenamed` should respect the dict ordering [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/05 04:58:22 UTC, 6 replies.
- Re: [PR] [SPARK-46260][PYTHON][SQL] `DataFrame.withColumnsRenamed` should respect the dict ordering [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/05 05:14:33 UTC, 8 replies.
- [PR] [SPARK-46262][PS] Enable test for `np.left_shift` for Pandas-on-Spark object. [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/05 06:21:28 UTC, 3 replies.
- [PR] [SPARK-46263][CORE][SQL][MLLIB] Clean up unnecessary `SeqOps.view` and `ArrayOps.view` conversions. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/05 07:08:24 UTC, 0 replies.
- Re: [PR] [SPARK-46263][SQL][SS][ML][MLLIB][UI] Clean up unnecessary `SeqOps.view` and `ArrayOps.view` conversions. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/05 07:13:03 UTC, 0 replies.
- [PR] [SPARK-46264][PS][CONNECT][TESTS] Re-organize the resampling tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/05 08:29:25 UTC, 4 replies.
- Re: [PR] [SPARK-46263][SQL][SS][ML][MLLIB][UI] Clean up unnecessary `SeqOps.view` and `ArrayOps.view` conversions [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/05 09:35:27 UTC, 14 replies.
- [PR] [SPARK-46265] Assertions in AddArtifact RPC make the connect client incompatible with older clusters [spark] - posted by "nija-at (via GitHub)" <gi...@apache.org> on 2023/12/05 09:37:03 UTC, 0 replies.
- [PR] [SPARK-46266][PS][CONNECT][TESTS] Re-organize `NumOpsTests` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/05 10:39:11 UTC, 4 replies.
- [PR] [SPARK-45515][CORE][SQL][FOLLOWUP] Use enhanced switch expressions to replace the regular switch statement [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/12/05 10:42:00 UTC, 20 replies.
- [PR] [SPARK-45796][SQL] Support MODE() WITHIN GROUP (ORDER BY col) [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/12/05 10:43:37 UTC, 36 replies.
- Re: [PR] [SPARK-46265][CONNECT] Assertions in AddArtifact RPC make the connect client incompatible with older clusters [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2023/12/05 10:55:47 UTC, 2 replies.
- [PR] [SPARK-46268][PS][CONNECT][TESTS] Re-organize `StatsTests` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/05 11:21:02 UTC, 3 replies.
- [PR] [SPARK-46269][PS] Enable more NumPy function tests [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/05 11:38:33 UTC, 1 replies.
- [PR] [WIP][SPARK-46270][SQL][CORE] Use java14 instanceof expressions to replace the java8 instanceof statement. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/12/05 12:34:49 UTC, 0 replies.
- [PR] [MINOR][PS][TESTS] code cleanup: remove unused properties in `pyspark.pandas.tests.groupby.*` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/05 12:49:54 UTC, 0 replies.
- Re: [PR] [SPARK-44977][SPARK-46257][BUILD] Upgrade Derby to 10.16.1.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/05 13:02:48 UTC, 0 replies.
- Re: [PR] [SPARK-44977][SPARK-46257][BUILD][CORE][SQL] Upgrade Derby to 10.16.1.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/05 13:04:59 UTC, 6 replies.
- Re: [PR] [WIP][SPARK-46270][SQL][CORE][SS] Use java14 instanceof expressions to replace the java8 instanceof statement. [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/05 16:07:14 UTC, 1 replies.
- [PR] [SPARK-46186][FOLLOWUP] Remove flakiness of test in ReattachableExecuteSuite [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2023/12/05 16:14:18 UTC, 2 replies.
- Re: [PR] [SPARK-46269][PS] Enable more NumPy compatibility function tests [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/05 16:33:57 UTC, 1 replies.
- Re: [PR] [SPARK-46263][SQL][SS][ML][MLLIB][UI] Clean up `SeqOps.view` and `ArrayOps.view` conversions [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/05 16:40:00 UTC, 7 replies.
- Re: [PR] [SPARK-46186][CONNECT][TESTS][FOLLOWUP] Remove flakiness of `ReattachableExecuteSuite` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/05 16:51:55 UTC, 2 replies.
- Re: [PR] [SPARK-46271][PS][TESTS] Remove unused properties in `pyspark.pandas.tests.groupby.*` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/05 18:17:28 UTC, 2 replies.
- Re: [PR] [SPARK-34234][SQL] Remove TreeNodeException that didn't work [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/05 18:41:17 UTC, 1 replies.
- [PR] [SPARK-46272][SQL][TESTS] Support CTAS using DSv2 sources [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/12/05 20:19:58 UTC, 1 replies.
- Re: [PR] [SPARK-46272][SQL] Support CTAS using DSv2 sources [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/12/05 22:00:16 UTC, 17 replies.
- [PR] [SPARK-46274][SQL] Fix Range operator computeStats() to check long validity before converting [spark] - posted by "n-young-db (via GitHub)" <gi...@apache.org> on 2023/12/05 22:08:07 UTC, 4 replies.
- [PR] [SPARK-46276][PYTHON][TESTS] Improve test coverage of pyspark utils [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2023/12/05 22:57:38 UTC, 2 replies.
- [PR] [SPARK-45580][SQL] Handle case where a nested subquery becomes an existence join [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2023/12/05 23:34:54 UTC, 6 replies.
- [PR] [SPARK-46277][PYSPARK] Validate startup urls with the config being set [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2023/12/05 23:38:43 UTC, 0 replies.
- Re: [PR] [SPARK-46058][CORE] Add separate flag for privateKeyPassword [spark] - posted by "hasnain-db (via GitHub)" <gi...@apache.org> on 2023/12/05 23:39:44 UTC, 5 replies.
- Re: [PR] [SPARK-46044][PYTHON][TESTS] Improve test coverage of udf.py [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/05 23:58:20 UTC, 1 replies.
- Re: [PR] [SPARK-46226][PYTHON] Migrate all remaining `RuntimeError` into PySpark error framework. [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/06 01:09:22 UTC, 2 replies.
- [PR] Support write partition values to data files in FileFormatWritter [spark] - posted by "lzlfred (via GitHub)" <gi...@apache.org> on 2023/12/06 01:17:35 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-46270][SQL][CORE][SS] Use java16 instanceof expressions to replace the java8 instanceof statement. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/12/06 01:52:18 UTC, 0 replies.
- Re: [PR] [SPARK-46270][SQL][CORE][SS] Use java16 instanceof expressions to replace the java8 instanceof statement. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/12/06 01:54:23 UTC, 7 replies.
- [PR] [WIP][SPARK-46278][CONNECT][PS][TESTS] Re-organize `GroupByTests` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/06 03:08:52 UTC, 1 replies.
- Re: [PR] [SPARK-44307][SQL] Add Bloom filter for left outer join even if the left side table is smaller than broadcast threshold. [spark] - posted by "maheshk114 (via GitHub)" <gi...@apache.org> on 2023/12/06 05:18:11 UTC, 1 replies.
- Re: [PR] [SPARK-45687][CORE][SQL][ML][MLLIB][KUBERNETES][EXAMPLES][CONNECT][STRUCTURED STREAMING] Fix `Passing an explicit array value to a Scala varargs method is deprecated` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/12/06 05:46:29 UTC, 7 replies.
- [PR] [SPARK-46240][SQL] Support inject executed plan prep rules in SparkSessionExtensions [spark] - posted by "jiang13021 (via GitHub)" <gi...@apache.org> on 2023/12/06 06:25:55 UTC, 8 replies.
- [PR] [SPARK-46280][PS][TESTS] Move test_parity_frame_resample and test_parity_series_resample to `pyspark.pandas.tests.connect.resample` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/06 06:28:04 UTC, 4 replies.
- Re: [PR] [SPARK-46278][CONNECT][PS][TESTS] Re-organize `GroupByTests` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/06 06:29:04 UTC, 1 replies.
- [PR] [SPARK-46281][PS][TESTS] Remove unused code in `pyspark.pandas.tests.computation.*` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/06 06:33:19 UTC, 3 replies.
- Re: [PR] [SPARK-23607][CORE] Use HDFS extended attributes to store application summary information in SHS [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2023/12/06 07:00:45 UTC, 0 replies.
- [PR] [SPARK-46282][PYTHON][DOCS] Create a Standalone Page for DataFrame API in PySpark Documentation [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/06 07:09:20 UTC, 9 replies.
- [PR] [SPARK-46232][PYTHON][FOLLOWUP] Migrate `ValueError` into `PySparkValueError` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/06 07:31:00 UTC, 1 replies.
- [PR] [SPARK-46112][BUILD][PYTHON] Implement lint check for PySpark custom errors [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/06 07:47:21 UTC, 16 replies.
- Re: [PR] [WIP][SPARK-46112][BUILD][PYTHON] Implement lint check for PySpark custom errors [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/06 07:50:07 UTC, 2 replies.
- Re: [PR] [SPARK-45597][PYTHON][SQL] Support creating table using a Python data source in SQL [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/06 08:11:51 UTC, 3 replies.
- Re: [PR] [SPARK-46279][SQL] Support write partition values to data files in FileFormatWritter [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/06 08:23:28 UTC, 1 replies.
- [PR] [SPARK-46283][INFRA] Remove `streaming-kinesis-asl` module from `MODULES_TO_TEST` for branch-3.x daily tests [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/06 08:41:42 UTC, 10 replies.
- [PR] [SPARK-46284][PYTHON][CONNECT] Add `session_user` function to Python [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/06 08:58:19 UTC, 3 replies.
- [PR] [SPARK-46285][SQL] Add foreachWithSubqueries [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2023/12/06 10:28:31 UTC, 10 replies.
- [PR] [SPARK-46286][DOCS] Document spark.io.compression.zstd.bufferPool.enabled [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/12/06 10:44:31 UTC, 0 replies.
- [PR] try fix maven test [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/06 11:12:38 UTC, 0 replies.
- [PR] [SPARK-46287][PYTHON][CONNECT] `DataFrame.isEmpty` should work with all datatypes [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/06 12:46:57 UTC, 5 replies.
- [PR] [SPARK-TBD] Forbid recursive error handling 2 [spark] - posted by "cdkrot (via GitHub)" <gi...@apache.org> on 2023/12/06 12:49:19 UTC, 20 replies.
- [PR] [SPARK-45720] Upgrade AWS SDK to v2 for Spark Kinesis connector module [spark] - posted by "junyuc25 (via GitHub)" <gi...@apache.org> on 2023/12/06 13:22:23 UTC, 0 replies.
- [PR] [SPARK-46288][PS][TESTS] Remove unused code in `pyspark.pandas.tests.frame.*` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/06 13:32:54 UTC, 2 replies.
- [PR] [SPARK-46273][SQL] Support INSERT INTO/OVERWRITE using DSv2 sources [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/12/06 18:36:54 UTC, 4 replies.
- Re: [PR] [SPARK-46286][DOCS] Document `spark.io.compression.zstd.bufferPool.enabled` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/06 18:46:39 UTC, 2 replies.
- Re: [PR] [SPARK-46230][PYTHON] Migrate `RetriesExceeded` into PySpark error [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/06 19:00:52 UTC, 2 replies.
- [PR] [SPARK-46275] Protobuf: Return null in permissive mode when deserialization fails. [spark] - posted by "rangadi (via GitHub)" <gi...@apache.org> on 2023/12/06 19:04:01 UTC, 14 replies.
- [PR] [SPARK-45580][SQL][3.5] Handle case where a nested subquery becomes an existence join [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2023/12/06 20:37:43 UTC, 3 replies.
- Re: [PR] [WIP][SPARK-45720] Upgrade AWS SDK to v2 for Spark Kinesis connector module [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/06 20:56:52 UTC, 9 replies.
- [PR] [SPARK-46290][PYTHON] Change saveMode to a boolean flag for DataSourceWriter [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/12/06 22:25:56 UTC, 2 replies.
- [PR] [SPARK-46231][PYTHON][FOLLOWUP] Cleanup duplicated test [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/06 22:50:49 UTC, 2 replies.
- [PR] [SPARK-46292][CORE][UI] Show a summary of workers in MasterPage [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/06 23:16:49 UTC, 3 replies.
- [PR] [SPARK-45580][SQL][3.4] Handle case where a nested subquery becomes an existence join [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2023/12/06 23:49:04 UTC, 2 replies.
- [PR] [MINOR][PYTHON][DOCS] Rename "Koalas" > "Pandas-on-Spark" for testing util doc [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/06 23:51:23 UTC, 2 replies.
- [PR] [SPARK-46293][CONNECT][DOCS][PYTHON] Add protobuf to required dependency for Spark Connect [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/07 00:14:13 UTC, 0 replies.
- Re: [PR] [SPARK-46293][CONNECT][DOCS][PYTHON] Add `protobuf` to required dependency for Spark Connect [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/07 00:16:01 UTC, 9 replies.
- Re: [PR] [SPARK-46277][PYTHON] Validate startup urls with the config being set [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2023/12/07 00:16:57 UTC, 2 replies.
- Re: [PR] [SPARK-44976] Preserve full principal user name on executor side [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/07 00:18:56 UTC, 6 replies.
- [PR] [WIP][SPARK-46294][SQL] Clean up semantics of init vs zero value [spark] - posted by "davintjong-db (via GitHub)" <gi...@apache.org> on 2023/12/07 00:34:53 UTC, 0 replies.
- [PR] [SPARK-45580][SQL][3.3] Handle case where a nested subquery becomes an existence join [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2023/12/07 00:49:33 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-46293][CONNECT][DOCS][PYTHON] Add `protobuf` to required dependency for Spark Connect [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/07 01:11:17 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-46282][PYTHON][DOCS] Create a Standalone Page for DataFrame API in PySpark Documentation [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/07 02:00:07 UTC, 1 replies.
- [PR] [SPARK-46296[PYTHON][TESTS] Test captured errors of TestResult (pyspark.errors.exceptions) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/07 02:42:19 UTC, 2 replies.
- [PR] [SPARK-46297][PYTHON][INFRA] Exclude generated files from the code coverage report [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/07 02:49:58 UTC, 2 replies.
- [PR] [SPARK-46298][PYTHON] Test catalog error cases (pyspark.sql.catalog) with minor cleanups [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/07 03:10:55 UTC, 0 replies.
- [PR] [SPARK-46299][DOCS] Make `spark.deploy.recovery*` up-to-date [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/07 03:12:45 UTC, 0 replies.
- Re: [PR] [SPARK-46298][PYTHON][CONNECT] Match deprecation warning, test case, and error of Catalog.createExternalTable [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/07 03:13:17 UTC, 2 replies.
- Re: [PR] [SPARK-46299][DOCS] Make `spark.deploy.recovery*` docs up-to-date [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/07 03:18:03 UTC, 2 replies.
- [PR] [SPARK-46300][PYTHON][CONNECT] Match minor behaviour matching in Column with full test coverage [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/07 03:53:21 UTC, 2 replies.
- Re: [PR] [SPARK-46296][PYTHON][TESTS] Test missing test coverage for captured errors (pyspark.errors.exceptions) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/07 04:32:19 UTC, 1 replies.
- [PR] [SPARK-46301][CORE] Support `spark.worker.(initial|max)RegistrationRetries` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/07 04:32:42 UTC, 13 replies.
- [PR] Make `streaming-kafka-0-10` and `sql-kafka-0-10` test with the same zookeeper version as the project [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/07 07:05:17 UTC, 0 replies.
- Re: [PR] [WIP] Make `streaming-kafka-0-10` and `sql-kafka-0-10` test with the same zookeeper version as the project [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/07 07:05:36 UTC, 1 replies.
- Re: [PR] [Don't merge & review] [SPARK-46302][BUILD] Fix maven daily testing [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/07 07:24:20 UTC, 2 replies.
- [PR] [SPARK-46260][CONNECT] `DataFrame.withColumnsRenamed` should keep the dict/map ordering [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/07 07:26:20 UTC, 0 replies.
- [PR] [SPARK-46303][PS][TESTS] Remove unused code in `pyspark.pandas.tests.series.* ` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/07 07:52:12 UTC, 3 replies.
- [PR] [SPARK-45597][PYTHON][SQL] Support creating table using a Python data source in SQL (single Python wrapper) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/07 07:54:00 UTC, 1 replies.
- [PR] [MINOR] rename DePt to DEPT [spark] - posted by "caicancai (via GitHub)" <gi...@apache.org> on 2023/12/07 08:07:49 UTC, 7 replies.
- Re: [PR] [SPARK-46096][BUILD] Upgrade `sbt` to 1.9.7 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/07 08:11:33 UTC, 2 replies.
- [PR] [SPARK-46304][INFRA] Upgrade setup-java action to v4 and setup-python to v5 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/07 09:03:27 UTC, 3 replies.
- Re: [PR] [WIP][SPARK-46293][CONNECT][DOCS][PYTHON] Remove `protobuf` from required package. [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/07 09:44:04 UTC, 0 replies.
- [PR] [SPARK-46306][PS] Fix `LocIndexer` to work properly when the key is missing [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/07 11:20:31 UTC, 6 replies.
- Re: [PR] [SPARK-46305][BUILD][SS] Remove the special Zookeeper version in the `streaming-kafka-0-10` and `sql-kafka-0-10` modules [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/07 11:35:39 UTC, 0 replies.
- [PR] [SPARK-46307][PS][TESTS] Enable `fill_value` tests for `GroupByTests.test_shift` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/07 11:51:28 UTC, 1 replies.
- Re: [PR] [SPARK-43427][PROTOBUF] spark protobuf: allow upcasting unsigned integer types [spark] - posted by "justaparth (via GitHub)" <gi...@apache.org> on 2023/12/07 11:53:01 UTC, 5 replies.
- [PR] [WIP][SPARK-40353][PS][TESTS] Re-enable the `read_excel` tests [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/07 12:00:38 UTC, 3 replies.
- Re: [PR] [SPARK-46308] Forbid recursive error handling by adding recursion guards [spark] - posted by "cdkrot (via GitHub)" <gi...@apache.org> on 2023/12/07 12:08:53 UTC, 3 replies.
- Re: [PR] [SPARK-46261][CONNECT] `DataFrame.withColumnsRenamed` should keep the dict/map ordering [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/07 12:33:09 UTC, 2 replies.
- [PR] [SPARK-46309][PS][TESTS] Remove unused code in `pyspark.pandas.tests.indexes.* ` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/07 12:35:37 UTC, 2 replies.
- Re: [PR] [SPARK-46305][BUILD][SS] Remove Zookeeper `3.5.7` test dependency from the `streaming-kafka-0-10` and `sql-kafka-0-10` modules [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/07 16:54:05 UTC, 0 replies.
- [PR] Add jars from default session state into isolated session state for spark connect clients [spark] - posted by "fhalde (via GitHub)" <gi...@apache.org> on 2023/12/07 18:08:58 UTC, 0 replies.
- Re: [PR] [SPARK-46293][CONNECT][PYTHON] Use `protobuf` transitive dependency [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/07 18:28:04 UTC, 3 replies.
- Re: [PR] [SPARK-45597][PYTHON][SQL] Support creating table using a Python data source in SQL (single wrapper) [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/12/07 18:59:18 UTC, 7 replies.
- [PR] [SPARK-46311][CORE] Log the final state of drivers during `Master.removeDriver` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/07 21:55:29 UTC, 3 replies.
- [PR] [SPARK-46312][CORE] Use `lower_camel_case` in `store_types.proto` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/07 23:25:33 UTC, 11 replies.
- [PR] [SPARK-46313][CORE] Log Spark HA recovery duration [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/07 23:45:03 UTC, 0 replies.
- Re: [PR] [SPARK-45556][UI] Allow web page respond customized status code and message through WebApplicationException [spark] - posted by "kuwii (via GitHub)" <gi...@apache.org> on 2023/12/08 00:13:52 UTC, 0 replies.
- Re: [PR] [SPARK-46313][CORE] Log `Spark HA` recovery duration [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/12/08 01:52:59 UTC, 4 replies.
- [PR] [SPARK-46315][PYTHON][TESTS] Test invalid key for spark.conf.get (pyspark.sql.conf) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/08 02:50:02 UTC, 3 replies.
- [PR] [SPARK-46316][CORE] Enable `buf-lint-action` on `core` module [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/08 03:38:46 UTC, 14 replies.
- [PR] [SPARK-46317][PYTHON][CONNECT] Match minor behaviour matching in SparkSession with full test coverage [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/08 03:59:14 UTC, 8 replies.
- [PR] [SPARK-46318][PYTHON][INFRA] Exclude ported pyspark.loose_version from the code coverage report [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/08 04:10:58 UTC, 2 replies.
- [PR] [SPARK-46320][CORE] Support `spark.master.rest.host` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/08 05:35:28 UTC, 3 replies.
- [PR] [SPARK-46321][PS][TESTS] Re-ennable `IndexesTests.test_asof` that was skipped due to Pandas bug [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/08 05:47:59 UTC, 2 replies.
- [PR] [SPARK-46322][PYTHON][DOCS] Replace external link with internal link for error documentation [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/08 06:27:12 UTC, 4 replies.
- [PR] [SPARK-46323][PYTHON] Fix the output name of pyspark.sql.functions.now [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/08 06:32:35 UTC, 5 replies.
- [PR] [SPARK-46324][SQL] Fix the output name of pyspark.sql.functions.user and session_user [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/08 07:03:28 UTC, 0 replies.
- [PR] [SPARK-46325][CONNECT] Remove unnecessary override functions when constructing `WrappedCloseableIterator` in `ResponseValidator#wrapIterator` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/08 07:23:14 UTC, 1 replies.
- [PR] [SPARK-46326][PYTHON][TESTS] Test missing cases for functions (pyspark.sql.functions) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/08 07:36:51 UTC, 2 replies.
- [PR] [SPARK-46327][PS][CONNECT][TESTS] Reorganize `SeriesStringTests` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/08 08:08:01 UTC, 2 replies.
- Re: [PR] [SPARK-46324][SQL][PYTHON] Fix the output name of pyspark.sql.functions.user and session_user [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/08 08:14:37 UTC, 4 replies.
- [PR] [SPARK-46328] Allocate capacity by columns size for array list of TColumns in TRowSet generation [spark] - posted by "bowenliang123 (via GitHub)" <gi...@apache.org> on 2023/12/08 08:24:07 UTC, 0 replies.
- Re: [PR] [SPARK-46328][SQL] Allocate capacity of array list of TColumns by columns size in TRowSet generation [spark] - posted by "bowenliang123 (via GitHub)" <gi...@apache.org> on 2023/12/08 08:47:05 UTC, 1 replies.
- [PR] [WIP][SQL] Migrate `CatalogNotFoundException` to the error class `CATALOG_NOT_FOUND` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/08 09:35:32 UTC, 0 replies.
- Re: [PR] [SPARK-39176][PYSPARK] Fixed a problem with pyspark serializing pre-1970 datetime in windows [spark] - posted by "dingsl-giser (via GitHub)" <gi...@apache.org> on 2023/12/08 09:50:53 UTC, 1 replies.
- [PR] [SPARK-46330] Loading of Spark UI blocks for a long time when HybridStore enabled [spark] - posted by "zhouyifan279 (via GitHub)" <gi...@apache.org> on 2023/12/08 11:07:59 UTC, 3 replies.
- Re: [PR] [SPARK-46202][CONNECT] Expose new ArtifactManager APIs to support custom target directories [spark] - posted by "vicennial (via GitHub)" <gi...@apache.org> on 2023/12/08 11:28:28 UTC, 6 replies.
- [PR] [SPARK-46331][SQL] Removing CodegenFallback from subset of DateTime expressions and version() expression [spark] - posted by "dbatomic (via GitHub)" <gi...@apache.org> on 2023/12/08 12:19:02 UTC, 18 replies.
- Re: [PR] [SPARK-46228][SQL] Insert window group limit node for limit outside of window [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2023/12/08 14:06:30 UTC, 14 replies.
- [PR] [MINOR][DOCS] Fix documentation for spark.sql.legacy.doLooseUpcast in SQL migration guide [spark] - posted by "amytsai-stripe (via GitHub)" <gi...@apache.org> on 2023/12/08 16:34:21 UTC, 2 replies.
- [PR] [WIP][SQL] Replace `IllegalStateException` by `SparkException.internalError` in catalyst [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/08 17:36:10 UTC, 0 replies.
- [PR] [SPARK-46132][CORE] Support key password for JKS keys for RPC SSL [spark] - posted by "hasnain-db (via GitHub)" <gi...@apache.org> on 2023/12/08 18:07:10 UTC, 6 replies.
- Re: [PR] [SPARK-46332][SQL] Migrate `CatalogNotFoundException` to the error class `CATALOG_NOT_FOUND` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/08 18:49:29 UTC, 1 replies.
- Re: [PR] [SPARK-38211][SQL][DOCS] Add SQL migration guide on restoring loose upcast from string to other types [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/08 19:12:28 UTC, 0 replies.
- [PR] [SPARK-46275][3.4][Chrry-pick] Protobuf: Return null in permissive mode when deserialization fails [spark] - posted by "rangadi (via GitHub)" <gi...@apache.org> on 2023/12/08 19:18:51 UTC, 0 replies.
- Re: [PR] [SPARK-46275][3.4] Protobuf: Return null in permissive mode when deserialization fails [spark] - posted by "rangadi (via GitHub)" <gi...@apache.org> on 2023/12/08 19:57:08 UTC, 2 replies.
- [PR] [SPARK-46334][PS] Upgrade `Pandas` to 2.1.4 [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2023/12/08 21:32:39 UTC, 0 replies.
- Re: [PR] [SPARK-46334][INFRA][PS] Upgrade `Pandas` to 2.1.4 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/08 22:37:42 UTC, 2 replies.
- [PR] [SPARK-46335][BUILD] Upgrade Maven to 3.9.6 for MNG-7913 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/08 23:51:05 UTC, 4 replies.
- Re: [PR] [SPARK-44998] Do not retry when FileNotFoundException occurs [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/09 00:18:45 UTC, 1 replies.
- Re: [PR] [SPARK-41006][K8S] Generate new ConfigMap names for each run [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/09 00:18:47 UTC, 1 replies.
- Re: [PR] [SPARK-42789][SQL] Rewrite multiple GetJsonObjects to a JsonTuple if their json expressions are the same [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/09 00:18:49 UTC, 1 replies.
- [PR] [SPARK-46337][SQL][CONNECT][PYTHON] Make `CTESubstitution` retain the `PLAN_ID_TAG` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/09 03:02:02 UTC, 3 replies.
- [PR] [WIP][Used for discussion and decision-making] Improve the java text block with java15 feature. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/12/09 04:04:21 UTC, 3 replies.
- [PR] [SPARK-46338][PS][TESTS] Re-enable the `get_item` test for `BasicIndexingTests` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/09 05:40:37 UTC, 1 replies.
- [PR] [SPARK-46339][SS] Directory with batch number name should not be treated as metadata log [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2023/12/09 05:59:11 UTC, 8 replies.
- Re: [PR] [MINOR][DOCS] Fix documentation for `spark.sql.legacy.doLooseUpcast` in SQL migration guide [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/09 09:23:18 UTC, 3 replies.
- Re: [PR] [WIP][SPARK-46333][SQL] Replace `IllegalStateException` by `SparkException.internalError` in catalyst [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/09 09:31:24 UTC, 0 replies.
- Re: [PR] [SPARK-46333][SQL] Replace `IllegalStateException` by `SparkException.internalError` in catalyst [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/09 09:33:10 UTC, 0 replies.
- [PR] [SPARK-46340][PS][CONNECT][TESTS] Reorganize `EWMTests` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/09 10:46:14 UTC, 2 replies.
- [PR] [SPARK-46341][PS][TESTS] Move `SeriesInterpolateTests` to `pyspark.pandas.tests.series.*` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/09 11:21:56 UTC, 0 replies.
- [PR] [WIP][SQL] Replace `IllegalStateException` by `SparkException.internalError` in sql/core [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/09 11:26:34 UTC, 0 replies.
- [PR] [DOCS][MINOR] Fix typos [spark] - posted by "agrueneberg (via GitHub)" <gi...@apache.org> on 2023/12/09 14:32:40 UTC, 1 replies.
- [PR] [WIP][SQL] Require an error class in `AnalysisException` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/09 15:56:23 UTC, 0 replies.
- [PR] [SPARK-46344][CORE] Warn properly when a driver exists successfully but master is disconnected [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/09 23:06:32 UTC, 5 replies.
- Re: [PR] [SPARK-44632][CORE] DiskBlockManager should check and be able to handle stale directories [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/10 00:20:54 UTC, 1 replies.
- [PR] [SPARK-46345][PS][TESTS] Reorganize `DiffFramesParityCovCorrWithTests` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/10 01:29:29 UTC, 4 replies.
- [PR] [SPARK-46346][CORE] Fix Master to update worker from `UNKNOWN` to `ALIVE` on `RegisterWorker` msg [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/10 01:30:16 UTC, 0 replies.
- Re: [PR] [SPARK-46341][PS][TESTS] Reorganize `SeriesInterpolateTests` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/10 01:35:31 UTC, 1 replies.
- Re: [PR] [SPARK-46346][CORE] Fix Master to update a worker from `UNKNOWN` to `ALIVE` on `RegisterWorker` msg [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/10 01:39:48 UTC, 13 replies.
- [PR] [SPARK-46347][PS][TESTS] Reorganize `RollingTests ` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/10 01:52:20 UTC, 4 replies.
- [PR] [SPARK-46348][CORE] Support `spark.deploy.recoveryTimeout` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/10 03:24:36 UTC, 4 replies.
- [PR] [WIP] Prevent nested SortOrder instances in SortOrder expressions [spark] - posted by "hhdri (via GitHub)" <gi...@apache.org> on 2023/12/10 03:25:01 UTC, 0 replies.
- Re: [PR] [SPARK-34888][SS] Introduce UpdatingSessionIterator adjusting session window on elements [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/10 08:44:09 UTC, 3 replies.
- Re: [PR] [SPARK-46342][SQL] Replace `IllegalStateException` by `SparkException.internalError` in sql [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/10 11:18:53 UTC, 3 replies.
- Re: [PR] [SPARK-24497][SQL] Support recursive SQL [spark] - posted by "KamilKandzia (via GitHub)" <gi...@apache.org> on 2023/12/10 12:09:00 UTC, 2 replies.
- [PR] [SPARK-46353][CORE] Refactor to improve `RegisterWorker` unit test [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/10 21:26:32 UTC, 0 replies.
- Re: [PR] [SPARK-46353][CORE] Refactor to improve `RegisterWorker` unit test coverage [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/10 21:31:17 UTC, 9 replies.
- Re: [PR] [SPARK-46285][SQL] Add `foreachWithSubqueries` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/10 22:00:24 UTC, 1 replies.
- Re: [PR] [SPARK-45969][DOCS] Document configuration change of executor failure tracker [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/10 22:03:45 UTC, 0 replies.
- Re: [PR] [SPARK-45642][CORE][SQL] Fix `FileSystem.isFile & FileSystem.isDirectory is deprecated` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/10 22:11:27 UTC, 0 replies.
- [PR] [SPARK-46215][CORE][FOLLOWUP] Handle symbolic links [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/10 23:58:37 UTC, 3 replies.
- Re: [PR] [SPARK-45019][BUILD] Make workflow scala213 on container & clean env [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/11 00:19:43 UTC, 1 replies.
- [PR] [SPARK-46354] [SQL] Increase the limit on the number of write dynamic partitions [spark] - posted by "dh20 (via GitHub)" <gi...@apache.org> on 2023/12/11 01:45:17 UTC, 1 replies.
- [PR] [SPARK-46355][SQL] XML: Close InputStreamReader on read completion [spark] - posted by "sandip-db (via GitHub)" <gi...@apache.org> on 2023/12/11 02:14:33 UTC, 7 replies.
- [PR] [SPARK-46356][BUILD] Upgrade `sbt-assembly` to 2.1.5 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/11 02:34:14 UTC, 1 replies.
- [PR] [SPARK-46354] [SQL] Increase the limit on the number of dynamic partitions written to 'InsertIntoHadoopFsRelationCommand' [spark] - posted by "dh20 (via GitHub)" <gi...@apache.org> on 2023/12/11 02:55:13 UTC, 1 replies.
- [PR] [SPARK-46357] Replace incorrect documentation use of setConf with conf.set [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2023/12/11 05:02:30 UTC, 5 replies.
- [PR] [SPARK-46358][CONNECT] Minor refactor of `ResponseValidator#verifyResponse` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/11 05:59:06 UTC, 1 replies.
- [PR] [SPARK-46360][PYTHON] Enhance error message debugging with new `getMessage` API [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/11 07:13:15 UTC, 6 replies.
- Re: [PR] [SPARK-46358][CONNECT] Simplify the condition check in the `ResponseValidator#verifyResponse` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/11 07:18:00 UTC, 4 replies.
- Re: [PR] [SPARK-46302][BUILD] Fix maven daily testing [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/11 07:33:57 UTC, 18 replies.
- [PR] clean .rat-excludes [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/11 09:24:14 UTC, 0 replies.
- [PR] [SPARK-46361][WIP][PYTHON][CORE] Spark chunk read api [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2023/12/11 09:53:38 UTC, 0 replies.
- [PR] [SPARK-46341][PS][TESTS][FOLLOWUP] Sort indices before dataframe comparison [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/11 10:41:57 UTC, 3 replies.
- [PR] Branch 3.4 [spark] - posted by "somi-biswas (via GitHub)" <gi...@apache.org> on 2023/12/11 13:07:46 UTC, 1 replies.
- [PR] [SPARK-46364][SQL] Push calculation from Aggregate through Expand [spark] - posted by "wankunde (via GitHub)" <gi...@apache.org> on 2023/12/11 13:58:00 UTC, 0 replies.
- [PR] [SPARK-46366][SQL] Use WITH expression in BETWEEN to avoid duplicating expressions [spark] - posted by "dbatomic (via GitHub)" <gi...@apache.org> on 2023/12/11 15:46:04 UTC, 1 replies.
- [PR] [SPARK-46366][SQL] Use WITH expression in BETWEEN to avoid duplicate expressions [spark] - posted by "dbatomic (via GitHub)" <gi...@apache.org> on 2023/12/11 16:37:53 UTC, 20 replies.
- Re: [PR] [SPARK-46356][BUILD] Upgrade `sbt-assembly` to 2.1.5, `sbt-checkstyle-plugin` to 4.0.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/11 16:49:48 UTC, 1 replies.
- Re: [PR] [SPARK-44001][PROTOBUF] Add option to allow unwrapping protobuf well known wrapper types [spark] - posted by "rangadi (via GitHub)" <gi...@apache.org> on 2023/12/11 18:46:40 UTC, 5 replies.
- Re: [PR] [SPARK-45816][SQL] Return `NULL` when overflowing during casting from timestamp to integers [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/12/11 19:34:05 UTC, 2 replies.
- Re: [PR] [SPARK-46351][SQL] Require an error class in `AnalysisException` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/11 20:09:43 UTC, 14 replies.
- [PR] Assign SQL configs to groups for use in documentation [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2023/12/11 21:16:22 UTC, 6 replies.
- [PR] [SPARK-46369][CORE] Remove `kill` link from `RELAUNCHING` drivers in `MasterPage` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/11 21:20:10 UTC, 5 replies.
- [PR] [SPARK-46370][SQL] Fix bug when querying from table after changing column defaults [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2023/12/11 21:54:15 UTC, 11 replies.
- [PR] [WIP][SPARK-46179][SQL] Add CrossDbmsQueryTestSuites, which allows generating golden files with Postgres/other DBMS [spark] - posted by "andylam-db (via GitHub)" <gi...@apache.org> on 2023/12/11 22:25:30 UTC, 0 replies.
- [PR] [WIP] [SPARK-38668] Spkit [spark] - posted by "asmitalim (via GitHub)" <gi...@apache.org> on 2023/12/11 22:45:05 UTC, 0 replies.
- Re: [PR] [WIP] [SPARK-38668] Split out watcher pod [spark] - posted by "asmitalim (via GitHub)" <gi...@apache.org> on 2023/12/11 22:47:18 UTC, 0 replies.
- [PR] [SPARK-45597][PYTHON][SQL] Support creating table using a Python data source in SQL (DSv2 exec) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/11 23:20:52 UTC, 30 replies.
- [PR] [SPARK-43299][FOLLOWUP][CONNECT][SS] Followup on StreamingQueryExceptions [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2023/12/12 00:02:13 UTC, 4 replies.
- Re: [PR] [SPARK-46361][WIP][PYTHON][CORE] Spark dataset chunk read api [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2023/12/12 00:51:08 UTC, 0 replies.
- Re: [PR] [SPARK-46371][BUILD] Clean up outdated items in `.rat-excludes` [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/12/12 06:01:32 UTC, 13 replies.
- [PR] [SPARK-46376][SQL][TESTS] Simplify the code to generate the Spark tarball `filename` in the `HiveExternalCatalogVersionsSuite`. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/12 06:57:11 UTC, 2 replies.
- [PR] [SPARK-46360][PYTHON][FOLLOWUP][DOCS] Add `getMessage` to API reference [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/12 07:29:15 UTC, 2 replies.
- [PR] [SPARK-46377][INFRA] Upgrade labeler action to v5 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/12 07:33:18 UTC, 11 replies.
- [PR] [SPARK-46378][SQL] Still remove Sort after converting Aggregate to Project [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/12/12 07:50:21 UTC, 8 replies.
- Re: [PR] [SPARK-46361][PYTHON][CORE] Spark dataset chunk read api [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2023/12/12 08:04:00 UTC, 56 replies.
- [PR] [WIP][MINOR][SQL] Convert `UnresolvedException` to an internal error [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/12 09:09:59 UTC, 0 replies.
- [PR] [SPARK-45502][BUILD] Upgrade Kafka to 3.6.1 [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2023/12/12 09:20:07 UTC, 4 replies.
- [PR] [SPARK-46379][PS][TESTS] Reorganize `FrameInterpolateTests` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/12 11:10:26 UTC, 3 replies.
- Re: [PR] [SPARK-46363][CORE][SQL] Improve the java text block with java15 feature. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/12 11:42:14 UTC, 4 replies.
- Re: [PR] [MINOR][SQL] Convert `UnresolvedException` to an internal error [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/12 12:51:08 UTC, 4 replies.
- [PR] [WIP][SQL] Migrate sub-classes of `AnalysisException` to error classes [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/12 13:03:50 UTC, 0 replies.
- [PR] [SPARK-46380][SQL]Replace current time/date prior to evaluating inline table expressions. [spark] - posted by "dbatomic (via GitHub)" <gi...@apache.org> on 2023/12/12 13:57:04 UTC, 36 replies.
- [PR] expand groupby() parameter [spark] - posted by "huanccwang (via GitHub)" <gi...@apache.org> on 2023/12/12 15:18:15 UTC, 3 replies.
- Re: [PR] [SPARK-46094] Support Executor JVM Profiling [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/12 18:05:39 UTC, 30 replies.
- Re: [PR] [SPARK-46381][SQL] Migrate sub-classes of `AnalysisException` to error classes [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/12 18:18:38 UTC, 11 replies.
- [PR] [SPARK-46382] XML: Capture values interspersed between elements [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2023/12/12 19:04:48 UTC, 0 replies.
- [PR] wat [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2023/12/12 20:05:40 UTC, 0 replies.
- Re: [PR] [DO-NOT-REVIEW] Streaming UI without numRemovedRow change [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2023/12/12 20:08:21 UTC, 4 replies.
- [PR] [DO-NOT-MERGE] working on 3.5 [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2023/12/12 21:36:14 UTC, 1 replies.
- [PR] [SPARK-46383] Reduce Driver Heap Usage by Reducing the Lifespan of `TaskInfo.accumulables()` [spark] - posted by "utkarsh39 (via GitHub)" <gi...@apache.org> on 2023/12/12 21:51:50 UTC, 32 replies.
- [PR] [SPARK-46385][PYSPARK][TESTS] Test aggregate functions for groups (pyspark.sql.group) [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2023/12/12 23:58:17 UTC, 0 replies.
- [PR] [SPARK-46350][SS] Fix state removal for stream-stream join with one watermark and one time-interval condition [spark] - posted by "neilramaswamy (via GitHub)" <gi...@apache.org> on 2023/12/13 00:57:22 UTC, 2 replies.
- [PR] [SPARK-46386][PYSPARK][TESTS] Improve and test assertions of observation (pyspark.sql.observation) [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2023/12/13 01:13:12 UTC, 0 replies.
- [PR] [SPARK-46387][PS][DOCS] Add an information of `isocalendar` into migration guide [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/12/13 01:38:27 UTC, 2 replies.
- [PR] [SPARK-46388][SQL] HiveAnalysis misses the pattern guard of `query.resolved` [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/12/13 03:24:09 UTC, 3 replies.
- Re: [PR] [SPARK-43742][SQL] Refactor default column value resolution [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/12/13 03:27:25 UTC, 0 replies.
- [PR] [SPARK-46389][CORE] Manually close the `RocksDB/LevelDB` instance when `checkVersion` throw Exception [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/13 05:45:18 UTC, 6 replies.
- [PR] [WIP] Fix spark.catalog.listDatabases() issues on schemas with special characters [spark] - posted by "anchovYu (via GitHub)" <gi...@apache.org> on 2023/12/13 06:17:57 UTC, 0 replies.
- [PR] [SPARK-46153][SQL] XML: Add TimestampNTZType support [spark] - posted by "sandip-db (via GitHub)" <gi...@apache.org> on 2023/12/13 07:48:10 UTC, 2 replies.
- [PR] [SPARK-45807][SQL] Improve ViewCatalog API [spark] - posted by "nastra (via GitHub)" <gi...@apache.org> on 2023/12/13 08:58:28 UTC, 10 replies.
- [PR] Aman [spark] - posted by "BigdatabyAmanulla (via GitHub)" <gi...@apache.org> on 2023/12/13 09:53:14 UTC, 0 replies.
- [PR] [SPARK-46391][PS][TESTS] Reorganize `ExpandingParityTests` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/13 10:28:19 UTC, 4 replies.
- Re: [PR] [SPARK-45894][SQL] hive table level setting hadoop.mapred.max.split.size [spark] - posted by "guixiaowen (via GitHub)" <gi...@apache.org> on 2023/12/13 11:09:34 UTC, 0 replies.
- Re: [PR] [SPARK-45856] Move ArtifactManager from Spark Connect into SparkSession (sql/core) [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/13 11:28:04 UTC, 1 replies.
- Re: [PR] [SPARK-43299][SS][CONNECT] Convert StreamingQueryException in Scala Client [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/13 11:29:14 UTC, 2 replies.
- [PR] [SPARK-46392][SQL] Push down Cast expression [spark] - posted by "monkeyboy123 (via GitHub)" <gi...@apache.org> on 2023/12/13 12:04:11 UTC, 0 replies.
- [PR] [SPARK-45798][CONNECT] Followup: add serverSessionId to SessionHolderInfo [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2023/12/13 15:24:34 UTC, 3 replies.
- [PR] [WIP][SQL] Classify exceptions in the JDBC table catalog [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/13 16:31:26 UTC, 0 replies.
- [PR] [WIP][SPARK-42332][SQL] Changing the require to a SparkException in ComplexTypeMergingExpression [spark] - posted by "hannahkamundson (via GitHub)" <gi...@apache.org> on 2023/12/13 17:15:49 UTC, 0 replies.
- Re: [PR] [SPARK-42332][SQL] Changing the require to a SparkException in ComplexTypeMergingExpression [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/13 18:13:05 UTC, 4 replies.
- Re: [PR] [SPARK-46394][SQL] Fix spark.catalog.listDatabases() issues on schemas with special characters when `spark.sql.legacy.keepCommandOutputSchema` set to true [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/12/13 20:09:39 UTC, 6 replies.
- Re: [PR] [SPARK-46385][PYTHON][TESTS] Test aggregate functions for groups (pyspark.sql.group) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/13 20:23:24 UTC, 1 replies.
- Re: [PR] [SPARK-46393][SQL] Classify exceptions in the JDBC table catalog [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2023/12/13 20:29:28 UTC, 7 replies.
- [PR] [WIP][SPARK-42307][SQL] Adding in a better name for `_LEGACY_ERROR_TEMP_2232` [spark] - posted by "hannahkamundson (via GitHub)" <gi...@apache.org> on 2023/12/13 20:41:58 UTC, 0 replies.
- [PR] [SPARK-46396][SQL] Timestamp inference should not throw exception [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2023/12/13 22:05:38 UTC, 3 replies.
- [PR] [SPARK-46398][PYSPARK][TESTS] Test rangeBetween window function (pyspark.sql.window) [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2023/12/13 23:50:01 UTC, 0 replies.
- [PR] [SPARK-46399][Core] Add exit status to the Application End event for the use of Spark Listener [spark] - posted by "rezasafi (via GitHub)" <gi...@apache.org> on 2023/12/14 00:12:36 UTC, 11 replies.
- Re: [PR] [SPARK-45861][PYTHON][DOCS] Add user guide for dataframe creation [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2023/12/14 01:52:52 UTC, 2 replies.
- [PR] [SPARK-46379][PS][TESTS][FOLLOWUPS] Deduplicate `test_interpolate_error` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/14 02:06:52 UTC, 3 replies.
- Re: [PR] [SPARK-45862][PYTHON][DOCS] Add user guide for basic dataframe operations [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2023/12/14 02:09:05 UTC, 3 replies.
- [PR] [MINOR][DOCS] Correct the usage example of dataset in Java. [spark] - posted by "Aiden-Dong (via GitHub)" <gi...@apache.org> on 2023/12/14 02:38:01 UTC, 0 replies.
- [PR] [SPARK-46400][CORE][SQL] When there are corrupted files in the local maven repo, retry to skip this cache [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/14 03:01:53 UTC, 0 replies.
- [PR] Revert "[SPARK-46377][INFRA] Upgrade labeler action to v5" [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/14 03:26:18 UTC, 1 replies.
- [PR] [MINOR][CORE] Add `@tailrec` to `HadoopFSUtils#shouldFilterOutPath` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/14 03:30:39 UTC, 1 replies.
- [PR] [WIP] [SPARK-46384][SS][UI] Fix Operation Duration Stack Chart on Structured Streaming Page [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/12/14 03:51:52 UTC, 3 replies.
- Re: [PR] [SPARK-46032][CORE] Add jars from default session state into isolated session state for spark connect sessions [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2023/12/14 04:37:41 UTC, 3 replies.
- Re: [PR] [SPARK-46294][SQL] Clean up semantics of init vs zero value [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/12/14 04:54:55 UTC, 5 replies.
- [PR] [SPARK-46401][CORE] Use `!isEmpty()` on RoaringBitmap instead of `getCardinality() > 0` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/14 04:57:59 UTC, 0 replies.
- Re: [PR] [SPARK-46401][CORE] Use `!isEmpty()` on RoaringBitmap instead of `getCardinality() > 0` in `RemoteBlockPushResolver` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/14 05:12:16 UTC, 0 replies.
- Re: [PR] [SPARK-46401][CORE] Use `!isEmpty()` on `RoaringBitmap` instead of `getCardinality() > 0` in `RemoteBlockPushResolver` [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2023/12/14 05:51:01 UTC, 3 replies.
- Re: [PR] [SPARK-46392][SQL] Push down Cast expression in DSv2 [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2023/12/14 06:48:00 UTC, 7 replies.
- Re: [PR] [WIP][SPARK-46051][INFRA] Cache python deps for linter and documentation [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2023/12/14 07:13:47 UTC, 5 replies.
- Re: [PR] [SPARK-42307][SQL] Adding in a better name for `_LEGACY_ERROR_TEMP_2232` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/14 07:19:48 UTC, 9 replies.
- [PR] [SPARK-46043][SQL][FOLLOWUP] Remove the catalog and identifier check in DataSourceV2Relation [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/12/14 07:25:23 UTC, 3 replies.
- [PR] [SPARK-46402][PYTHON] Add getMessageParameters and getQueryContext support [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/14 07:28:23 UTC, 13 replies.
- Re: [PR] [SPARK-45593][BUILD] Building a runnable distribution from master code running spark-sql raise error [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/14 07:43:34 UTC, 2 replies.
- Re: [PR] [SPARK-46384][SS][UI] Fix Operation Duration Stack Chart on Structured Streaming Page [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/12/14 08:35:27 UTC, 0 replies.
- [PR] [SPARK-46403][SQL] Decode parquet binary with getBytesUnsafe method [spark] - posted by "wankunde (via GitHub)" <gi...@apache.org> on 2023/12/14 08:36:35 UTC, 6 replies.
- Re: [PR] [SPARK-46400][CORE][SQL] When there are corrupted files in the local maven repo, skip this cache and try again [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/14 09:11:03 UTC, 17 replies.
- Re: [PR] [SPARK-46384][SPARK-46404][SS][UI] Fix Operation Duration Stack Chart on Structured Streaming Page [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/14 09:54:33 UTC, 2 replies.
- [PR] [SPARK-28386][SQL] Cannot resolve ORDER BY columns with GROUP BY and HAVING [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2023/12/14 10:19:31 UTC, 27 replies.
- [PR] [SPARK-45005][PS][TESTS][FOLLOWUPS] Deduplicate `test_properties` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/14 11:42:52 UTC, 3 replies.
- [PR] [SPARK-46407][PS][TESTS] Reorganize `OpsOnDiffFramesDisabledTests` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/14 12:47:03 UTC, 4 replies.
- [PR] [SPARK-46406][SQL] Assign a name to the error class _LEGACY_ERROR_TEMP_1023 [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/12/14 13:22:21 UTC, 6 replies.
- [PR] expand parameter [spark] - posted by "huanccwang (via GitHub)" <gi...@apache.org> on 2023/12/14 13:59:17 UTC, 1 replies.
- [PR] [SPARK-46408] Support date_sub on V2ExpressionBuilder [spark] - posted by "caicancai (via GitHub)" <gi...@apache.org> on 2023/12/14 14:52:31 UTC, 0 replies.
- Re: [PR] [SPARK-46408][SQL] Support date_sub on V2ExpressionBuilder [spark] - posted by "caicancai (via GitHub)" <gi...@apache.org> on 2023/12/14 15:05:13 UTC, 7 replies.
- [PR] [WIP][SPARK-46410][SQL] Assign error classes/subclasses to JdbcUtils.classifyException [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/14 15:18:08 UTC, 0 replies.
- [PR] [SPARK-46411][BUILD] Change to use `bcprov/bcpkix-jdk18on` for test [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/14 16:52:15 UTC, 0 replies.
- Re: [PR] [SPARK-23890][SQL] Support CHANGE COLUMN to add nested fields to structs [spark] - posted by "ottomata (via GitHub)" <gi...@apache.org> on 2023/12/14 18:01:44 UTC, 11 replies.
- [PR] [SPARK-46409][CONNECT] Fix spark-connect-scala-client launch script [spark] - posted by "vsevolodstep-db (via GitHub)" <gi...@apache.org> on 2023/12/14 19:59:10 UTC, 4 replies.
- Re: [PR] [SPARK-40193][SQL] Merge subquery plans with different filters [spark] - posted by "benjamin-j-c (via GitHub)" <gi...@apache.org> on 2023/12/14 20:35:19 UTC, 10 replies.
- [PR] [SPARK-46289][SQL] Support ordering UDTs in interpreted mode [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2023/12/14 21:11:45 UTC, 1 replies.
- [PR] [SPARK-46413][PYTHON] Validate returnType of Arrow Python UDF [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2023/12/14 21:42:49 UTC, 4 replies.
- Re: [PR] [SPARK-46003][UI][TESTS] Create an ui-test module with Jest to test ui javascript code [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/14 23:15:16 UTC, 1 replies.
- Re: [PR] [SPARK-45516][CONNECT] Include QueryContext in SparkThrowable proto message [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/14 23:45:54 UTC, 10 replies.
- Re: [PR] [SPARK-43149][SQL] `CreateDataSourceTableCommand` should create metadata first [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/15 00:19:23 UTC, 1 replies.
- Re: [PR] [SPARK-36680][SQL] Supports Dynamic Table Options for Spark SQL [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/15 00:19:26 UTC, 1 replies.
- Re: [PR] [SPARK-45506][CONNECT] Add ivy URI support to SparkConnect addArtifact [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/12/15 01:10:23 UTC, 2 replies.
- [PR] [SPARK-46414][UI] Use prependBaseUri to render javascript imports [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/12/15 02:48:22 UTC, 5 replies.
- Re: [PR] [SPARK-46416][CORE] Add `@tailrec` to `HadoopFSUtils#shouldFilterOutPath` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/15 05:22:01 UTC, 2 replies.
- [PR] [SPARK-46417][SQL] Do not fail when calling hive.getTable and throwException is false [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/12/15 06:01:06 UTC, 8 replies.
- Re: [PR] [SPARK-45904][SQL][CONNECT] Mode function should supports sort with order direction [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/12/15 06:54:02 UTC, 1 replies.
- [PR] [SPARK-46418][PS][TESTS] Reorganize `ReshapeTests` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/15 07:10:21 UTC, 3 replies.
- [PR] [SPARK-46069][SQL][FOLLOWUP] Simplify the code and add more UT [spark] - posted by "wankunde (via GitHub)" <gi...@apache.org> on 2023/12/15 07:33:19 UTC, 8 replies.
- [PR] [WIP] Add rule context [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2023/12/15 07:44:05 UTC, 1 replies.
- Re: [PR] [SPARK-46382][SQL] XML: Capture values interspersed between elements [spark] - posted by "sandip-db (via GitHub)" <gi...@apache.org> on 2023/12/15 07:45:48 UTC, 13 replies.
- Re: [PR] [SPARK-46410][SQL] Assign error classes/subclasses to JdbcUtils.classifyException [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/12/15 10:37:38 UTC, 28 replies.
- [PR] [WIP][SPARK-40876] Widening type promotions in Parquet readers [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2023/12/15 11:12:48 UTC, 0 replies.
- [PR] [SPARK-46419][PS][TESTS] Reorganize `DatetimeIndexTests`: Factor out 3 slow tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/15 11:42:36 UTC, 3 replies.
- [PR] [SPARK-46420] Remove unused transport in SparkSQLCLIDriver [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2023/12/15 12:15:55 UTC, 4 replies.
- [PR] [SPARK-46422][PS][TESTS] Move `test_window` to `pyspark.pandas.tests.window.*` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/15 13:11:08 UTC, 3 replies.
- [PR] [MINOR][CONNECT][PYTHON]Fix minor test issue and properly yield extension from result [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2023/12/15 13:58:05 UTC, 3 replies.
- [PR] [MINOR][SQL][PYTHON] Rename Python physical plan node names [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/15 18:27:40 UTC, 1 replies.
- Re: [PR] [SPARK-45597][PYTHON][SQL] Support creating table using a Python data source in SQL (codegen) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/15 19:04:43 UTC, 0 replies.
- [PR] [SPARK-46423][PYTHON][SQL] Make the Python Data Source instance at DataSource.lookupDataSourceV2 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/15 20:13:49 UTC, 9 replies.
- [PR] [SPARK-46424][PYTHON][SQL] Support Python metrics in Python Data Source [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/15 22:22:33 UTC, 15 replies.
- [PR] [SPARK-46425][INFRA] Pin the bundler version in CI [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/15 23:17:40 UTC, 2 replies.
- Re: [PR] [MINOR][SQL][PYTHON] Rename Python plan node names [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2023/12/15 23:28:57 UTC, 5 replies.
- Re: [PR] [DO-NOT-MERGE][POC] Separate PySpark distribution into pyspark, pyspark_common and pyspark_connect [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/16 00:18:48 UTC, 1 replies.
- Re: [PR] [SPARK-42829] [UI] add repeat identifier to cached RDD on stage page [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/16 00:18:52 UTC, 1 replies.
- [PR] [WIP] DS v2 createTable should not load the table [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/12/16 01:24:31 UTC, 1 replies.
- [PR] [INFRA] Pin `bundler -v 2.4.22` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/16 01:42:59 UTC, 2 replies.
- [PR] [SPARK-46427][PYTHON][SQL] Change Python Data Source's description to be pretty in explain [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/16 02:25:31 UTC, 2 replies.
- Re: [PR] [SPARK-45795][SQL] DS V2 supports push down Mode [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/12/16 03:41:03 UTC, 4 replies.
- [PR] [MINOR][DOCS] Use user-facing feature names in Python metrics documentation [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/16 16:22:22 UTC, 2 replies.
- Re: [PR] [SPARK-46386][PYTHON] Improve assertions of observation (pyspark.sql.observation) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/16 17:45:32 UTC, 1 replies.
- [PR] [WIP][SQL] Convert `IllegalStateException` to `internalError` in session iterators [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/16 18:11:16 UTC, 0 replies.
- Re: [PR] [SPARK-46395][SQL] Assign SQL configs to groups for use in documentation [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2023/12/16 19:47:58 UTC, 0 replies.
- Re: [PR] [SPARK-45959][SQL] Improving performance when addition of 1 column at a time causes increase in the LogicalPlan tree depth [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2023/12/16 21:08:01 UTC, 2 replies.
- Re: [PR] [SPARK-44804][SQL] SortMergeJoin should respect the streamed side ordering [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/17 00:21:00 UTC, 1 replies.
- Re: [PR] [SPARK-43252][SQL] Rename the error class _LEGACY_ERROR_TEMP_2017 to UNRESOLVED_CUSTOM_CLASS [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/17 00:21:02 UTC, 1 replies.
- Re: [PR] [SPARK-42411][K8S] Add support for istio with strict mtls [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/17 00:21:04 UTC, 1 replies.
- [PR] [SPARK-46419][PS][TESTS][FOLLOWUPS] Reorganize DatetimeIndexTests: Factor out remaining slow tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/17 05:07:56 UTC, 0 replies.
- [PR] [SPARK-46430][CONNECT][TESTS] Add test for `ProtoUtils.abbreviate` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/17 05:50:35 UTC, 4 replies.
- Re: [PR] [SPARK-46419][PS][TESTS][FOLLOWUP] Reorganize DatetimeIndexTests: Factor out remaining slow tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/17 05:52:22 UTC, 3 replies.
- [PR] [SPARK-46432][BUILD] Upgrade Netty to 4.1.104.Final [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/17 08:53:38 UTC, 6 replies.
- [PR] [SPARK-46433][PS][TESTS] Reorganize `OpsOnDiffFramesGroupByTests`: Factor out `test_aggregate/apply/cum*` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/17 09:15:32 UTC, 4 replies.
- [PR] [SPARK-45231][INFRA][FOLLOWUP] Remove unrecognized and meaningless command about Ammonite from the GA testing workflow. [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/17 09:36:42 UTC, 2 replies.
- [PR] [SPARK-45993][INFRA] scalac: remove deprecated option -target [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2023/12/17 15:42:59 UTC, 2 replies.
- [PR] [WIP][SQL] Set the rebase configs to the `CORRECTED` mode by default [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/17 16:33:15 UTC, 1 replies.
- Re: [PR] [SPARK-46395][DOCS] Assign Spark configs to groups for use in documentation [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/17 20:53:13 UTC, 4 replies.
- [PR] [SPARK-46434][INFRA] Remove `build_branch33.yml` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/17 21:03:59 UTC, 4 replies.
- [PR] [SPARK-46435][INFRA] Exclude `branch-3.3` from `publish_snapshot.yml` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/17 21:07:45 UTC, 3 replies.
- Re: [PR] [SPARK-46431][SS] Convert `IllegalStateException` to `internalError` in session iterators [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2023/12/17 22:59:02 UTC, 1 replies.
- [PR] [SPARK-46317][INFRA][FOLLOWUP] Install `lxml` in PyPy3.8 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/17 23:19:20 UTC, 5 replies.
- Re: [PR] [SPARK-45041][SQL] Using --proxy-user would get GSS init failed when `hive.metastore.token.signature` not empty [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/18 00:19:44 UTC, 1 replies.
- Re: [PR] [SPARK-44323][SQL] Do not allow options inside tuples to set to null [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/18 00:19:47 UTC, 1 replies.
- [PR] Clean up compatibility configurations related to branch-3.3 daily testing in `build_and_test.yml` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/18 02:13:52 UTC, 0 replies.
- Re: [PR] [SPARK-46436][INFRA] Clean up compatibility configurations related to branch-3.3 daily testing in `build_and_test.yml` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/18 02:19:39 UTC, 3 replies.
- Re: [PR] [SPARK-45292][SQL][HIVE] Remove Guava from shared classes from IsolatedClientLoader [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2023/12/18 03:17:03 UTC, 1 replies.
- [PR] [SPARK-46437][DOCS] Remove cruft from the built-in SQL functions documentation [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2023/12/18 03:41:03 UTC, 12 replies.
- [PR] [SPARK-46438][UI] Fix the broken scope of toggleFramegraph when registering onclick event for the Frame Graph header [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/12/18 05:22:02 UTC, 4 replies.
- [PR] [SPARK-46439][PS][TESTS] Move IO-related tests to `pyspark.pandas.tests.io.*` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/18 06:28:00 UTC, 3 replies.
- [PR] [SPARK-46441][BUILD] Upgrade to use `org.scalatestplus:mockito-5` for UT [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/18 07:28:36 UTC, 5 replies.
- Re: [PR] [SPARK-46440][SQL] Set the rebase configs to the `CORRECTED` mode by default [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/18 07:29:01 UTC, 12 replies.
- [PR] [SPARK-46442][SQL] DS V2 supports push down PERCENTILE_CONT and PERCENTILE_DISC [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/12/18 07:55:39 UTC, 3 replies.
- Re: [PR] [SPARK-45525][SQL][PYTHON] Support for Python data source write using DSv2 [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/12/18 09:07:29 UTC, 2 replies.
- Re: [PR] [SPARK-46444][SQL] V2SessionCatalog#createTable should not load the table [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/12/18 10:08:56 UTC, 10 replies.
- [PR] [SPARK-46443][SQL] Decimal precision and scale should decided by JDBC dialect. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/12/18 10:13:45 UTC, 9 replies.
- [PR] [WIP][SPARK-45725][SQL][FOLLOWUP] Fix arguments of a removed SQL config [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/18 11:23:18 UTC, 0 replies.
- Re: [PR] [SPARK-45725][SQL] Remove the non-default IN subquery runtime filter [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/18 11:26:18 UTC, 0 replies.
- Re: [PR] [SPARK-40295][SQL] Allow v2 functions with literal args in write distribution/ordering [spark] - posted by "faucct (via GitHub)" <gi...@apache.org> on 2023/12/18 12:03:10 UTC, 4 replies.
- Re: [PR] [SPARK-37377][SQL] Initial implementation of Storage-Partitioned Join [spark] - posted by "faucct (via GitHub)" <gi...@apache.org> on 2023/12/18 12:47:59 UTC, 0 replies.
- [PR] [WIP][SPARK-43474][CONNECT][FOLLOWUP] Throw exception from `internalError()` in `SessionHolder` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/18 13:18:32 UTC, 0 replies.
- Re: [PR] [SPARK-43474] [SS] [CONNECT] Add a spark connect access to runtime Dataframes by ID. [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/18 13:21:47 UTC, 0 replies.
- Re: [PR] [SPARK-45725][SQL][FOLLOWUP] Fix arguments of a removed SQL config [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/18 14:36:52 UTC, 1 replies.
- Re: [PR] [SPIP-IN-PROGRESS][DO-NOT-MERGE][SS] Add base support for new arbitrary state management operator, single valueState type, multiple state variables and underlying support for column families for RocksDBStateStoreProvider with/without changelog checkpointing [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2023/12/18 14:41:44 UTC, 35 replies.
- [PR] [SPARK-46446][SQL] Disable subqueries with correlated OFFSET to fix correctness bug [spark] - posted by "jchen5 (via GitHub)" <gi...@apache.org> on 2023/12/18 15:25:25 UTC, 4 replies.
- [PR] [WIP][SQL] Remove the legacy datetime rebasing SQL configs [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/18 16:03:06 UTC, 0 replies.
- [PR] [SPARK-46069][SQL][FOLLOWUP] Simplify the algorithm and add comments [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/12/18 16:33:59 UTC, 4 replies.
- [PR] [SPARK-46448] InlineTable column should be nullable when converted to Decimal might cause null [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2023/12/18 17:03:09 UTC, 3 replies.
- Re: [PR] [SPARK-46420][SQL] Remove unused transport in SparkSQLCLIDriver [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/18 19:59:09 UTC, 0 replies.
- Re: [PR] [SPARK-46447][SQL] Remove the legacy datetime rebasing SQL configs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/18 20:16:07 UTC, 5 replies.
- Re: [PR] [SPARK-46411][BUILD] Change to use `bcprov/bcpkix-jdk18on` for UT [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/18 20:19:31 UTC, 1 replies.
- [PR] [SPARK-46179][SQL] Refactor SQLQueryTestSuite by pulling out code into reusable functions [spark] - posted by "andylam-db (via GitHub)" <gi...@apache.org> on 2023/12/18 21:29:47 UTC, 1 replies.
- Re: [PR] [SPARK-45039][SQL] Include full identifier in Storage tab [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/19 00:19:12 UTC, 1 replies.
- Re: [PR] [SPARK-45452][SQL] Improve `InMemoryFileIndex` to use `FileSystem.listFiles` API [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/12/19 01:42:35 UTC, 1 replies.
- Re: [PR] [SPARK-46179][SQL] Pull out code into reusable functions in SQLQueryTestSuite [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/12/19 01:55:24 UTC, 13 replies.
- [PR] [SPARK-46424][PYTHON][SQL][FOLLOw-UP] Refactor and clean up Python metric implementation [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/19 02:40:25 UTC, 0 replies.
- [PR] [BUILD] Test sbt 1.9.8 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/19 03:26:18 UTC, 1 replies.
- [PR] [SPARK-46433][PS][TESTS][FOLLOWUPS] Reorganize `OpsOnDiffFramesGroupByTests`: Factor out 4 more slow tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/19 03:40:06 UTC, 2 replies.
- Re: [PR] [SPARK-46424][PYTHON][SQL][FOLLOW-UP] Refactor and clean up Python metric implementation [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/19 04:58:48 UTC, 1 replies.
- Re: [PR] [SPARK-46448][SQL] InlineTable column should be nullable when converted to Decimal might cause null [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/12/19 05:25:42 UTC, 3 replies.
- [PR] [SPARK-46451][PS][TESTS] Reorganize `GroupbyStatTests` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/19 05:39:46 UTC, 3 replies.
- [PR] [SPARK-46452][SQL] Add a new API in DataWriter to write an iterator of records [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/12/19 06:31:17 UTC, 13 replies.
- Re: [PR] [SPARK-46453][CONNECT] Throw exception from `internalError()` in `SessionHolder` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/19 07:26:11 UTC, 2 replies.
- Re: [PR] [SPARK-40876][SQL] Widening type promotions in Parquet readers [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/12/19 07:46:35 UTC, 24 replies.
- Re: [PR] [SPARK-46246][SQL] EXECUTE IMMEDIATE SQL support [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/19 08:25:42 UTC, 6 replies.
- [PR] [SPARK-46454][SQL][DSTREAM] Remove redundant `.headOption` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/19 08:39:46 UTC, 3 replies.
- [PR] [SPARK-46455][SQL] Remove redundant type conversion [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/19 08:50:43 UTC, 0 replies.
- [PR] [SPARK-46456][CORE] Set Jetty server stop timeout to 5 seconds to reduce the risk of interrupting shutdown hooks [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/12/19 10:30:39 UTC, 9 replies.
- Re: [PR] [WIP] [SPARK-46392][SQL]Push down Cast expression in DSv2 [spark] - posted by "monkeyboy123 (via GitHub)" <gi...@apache.org> on 2023/12/19 10:49:20 UTC, 2 replies.
- [PR] [MINOR][SQL] Rename ioschema to ioSchema [spark] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2023/12/19 10:55:23 UTC, 3 replies.
- Re: [PR] [SPARK-46302][TESTS] Skip maven daily testing as ivy uses some corrupted cache jar files [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/19 11:03:33 UTC, 13 replies.
- [PR] [SPARK-46446][SQL][Followup] Fix sql tests for subqueries with correlated OFFSET [spark] - posted by "jchen5 (via GitHub)" <gi...@apache.org> on 2023/12/19 15:42:33 UTC, 1 replies.
- [PR] Python streaming source POC [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2023/12/19 21:35:57 UTC, 0 replies.
- Re: [PR] [SPARK-46398][PYTHON][TESTS] Test rangeBetween window function (pyspark.sql.window) [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2023/12/19 22:30:57 UTC, 3 replies.
- [PR] Fix bundler to 2.4.22 to unclock CI [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2023/12/19 22:44:27 UTC, 0 replies.
- Re: [PR] [WIP] Fix bundler to 2.4.22 to unclock CI [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2023/12/19 22:54:04 UTC, 0 replies.
- Re: [PR] [WIP][SS] Python streaming source [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/19 23:39:18 UTC, 2 replies.
- Re: [PR] [SPARK-46456][CORE] Add `spark.ui.jettyStopTimeout` to set Jetty server stop timeout to unblock SparkContext shutdown [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2023/12/20 04:20:14 UTC, 4 replies.
- [PR] [SPARK-46433][PS][TESTS][FOLLOWUPS] Reorganize `OpsOnDiffFramesGroupByTests`: Factor out remaining slow tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/20 05:04:51 UTC, 2 replies.
- Re: [PR] [SPARK-46443][SQL] Decimal precision and scale should decided by H2 dialect. [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/12/20 05:08:06 UTC, 6 replies.
- Re: [PR] [SPARK-46446][SQL][FOLLOW-UP] Fix sql tests for subqueries with correlated OFFSET [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/12/20 05:40:40 UTC, 1 replies.
- Re: [PR] [SPARK-42332][SQL][DOCS] Changing the require to a SparkException in ComplexTypeMergingExpression [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/20 07:08:46 UTC, 6 replies.
- [PR] [SPARK-46460]The filter of partition includes cast function may lead the partition pruning to disable [spark] - posted by "littlelittlewhite09 (via GitHub)" <gi...@apache.org> on 2023/12/20 07:19:12 UTC, 0 replies.
- Re: [PR] [SPARK-42307][SQL][BUILD][DOCS] Adding in a better name for `_LEGACY_ERROR_TEMP_2232` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/20 07:25:53 UTC, 4 replies.
- [PR] [SPARK-46462][PS][TESTS] Reorganize `OpsOnDiffFramesGroupByRollingTests` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/20 08:27:01 UTC, 5 replies.
- Re: [PR] [SPARK-45814][CONNECT][SQL]Make ArrowConverters.createEmptyArrowBatch call close() to avoid memory leak [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/20 10:03:48 UTC, 0 replies.
- [PR] [SPARK-46463][PS][TESTS] Reorganize `OpsOnDiffFramesGroupByExpandingTests` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/20 10:12:17 UTC, 2 replies.
- [PR] [SPARK-46465][PYTHON][CONNECT] Implement `Column.isNaN` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/20 10:57:16 UTC, 0 replies.
- [PR] [SPARK-46464][DOC] Fix the scroll issue of tables when overflow [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/12/20 11:01:21 UTC, 10 replies.
- [PR] alias must not sql keyword [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/20 11:39:45 UTC, 0 replies.
- [PR] [MINOR][SQL][TEST] Rename DePt to DEPT [spark] - posted by "caicancai (via GitHub)" <gi...@apache.org> on 2023/12/20 14:02:26 UTC, 3 replies.
- [PR] Fix typo in pyspark.sql.functions.greatest docstring [spark] - posted by "KazMiddelhoek (via GitHub)" <gi...@apache.org> on 2023/12/20 14:28:48 UTC, 3 replies.
- [PR] [SPARK-46466][SQL] Vectorized parquet reader should never do rebase for timestamp ntz [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/12/20 14:51:40 UTC, 16 replies.
- [PR] [SPARK-46378][SQL][FOLLOWUP] Do not rely on TreeNodeTag in Project [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/12/20 15:55:41 UTC, 24 replies.
- Re: [PR] [SPARK-46460][Optimizer]The filter of partition including cast function may lead the partition pruning to disable [spark] - posted by "littlelittlewhite09 (via GitHub)" <gi...@apache.org> on 2023/12/20 16:57:17 UTC, 5 replies.
- [PR] [SPARK-46467][PYTHON][TESTS] Improve and test exceptions of TimedeltaIndex [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2023/12/20 19:11:44 UTC, 0 replies.
- Re: [PR] [SPARK-46465][PYTHON][CONNECT] Add `Column.isNaN` in PySpark [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/20 23:59:21 UTC, 3 replies.
- Re: [PR] [DONOT Merge & Review] Spark 45068 lowercase [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/21 00:18:52 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-24815] [CORE] Trigger Interval based DRA for Structured Streaming [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/21 00:18:54 UTC, 1 replies.
- Re: [PR] [MINOR][PYTHON][DOCS] Fix typo in pyspark.sql.functions.greatest docstring [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/21 00:52:25 UTC, 1 replies.
- [PR] Cast literal [spark] - posted by "monkeyboy123 (via GitHub)" <gi...@apache.org> on 2023/12/21 01:25:17 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-46467][PS][TESTS] Improve and test exceptions of TimedeltaIndex [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2023/12/21 01:40:05 UTC, 0 replies.
- [PR] [SPARK-46465][PYTHON][DOCS][FOLLOWUPS] Add `Column.isNaN` to API references [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/21 02:23:58 UTC, 2 replies.
- [PR] [SPARK-46469][SQL] Clean up useless local variables in `InsertIntoHiveTable` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/21 02:28:33 UTC, 4 replies.
- [PR] [SPARK-46470][PS][TESTS] Move `test_series_datetime` to `pyspark.pandas.tests.series.*` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/21 03:01:51 UTC, 2 replies.
- [PR] [SPARK-46471][PS][TESTS] Reorganize `OpsOnDiffFramesEnabledTests`: Factor out `test_arithmetic_*` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/21 03:08:46 UTC, 2 replies.
- Re: [PR] [SPARK-43049][SQL] Use CLOB instead of VARCHAR(255) for StringType for Oracle JDBC [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/12/21 04:23:04 UTC, 8 replies.
- [PR] [SPARK-46472][PYTHON][DOCS] Refine docstring of `array_prepend/array_append/array_insert` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/21 06:43:24 UTC, 5 replies.
- [PR] [SPARK-46473][SQL] Reuse `getPartitionedFile` method [spark] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2023/12/21 07:12:59 UTC, 0 replies.
- Re: [PR] [SPARK-46392][SQL] In PromoteStrings, Cast AtomicType to StringType if it is Literal [spark] - posted by "monkeyboy123 (via GitHub)" <gi...@apache.org> on 2023/12/21 07:16:00 UTC, 0 replies.
- [PR] [SPARK-46474][INFRA] Upgrade upload-artifact action to v4 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/21 08:08:01 UTC, 2 replies.
- [PR] [SPARK-46475][BUILD] Upgrade RoaringBitmap to 1.0.1 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/21 09:09:55 UTC, 4 replies.
- [PR] [SPARK-46476][CORE][BUILD] Move `IvyTestUtils` back to test dir [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/21 09:20:27 UTC, 0 replies.
- Re: [PR] [SPARK-46476][BUILD][CORE][CONNECT] Move `IvyTestUtils` back to `src/test` directory [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/21 09:38:02 UTC, 2 replies.
- [PR] [SPARK-46477][SQL] Add bucket info to SD in toHivePartition [spark] - posted by "ashish-kumar-sharma (via GitHub)" <gi...@apache.org> on 2023/12/21 10:52:00 UTC, 0 replies.
- [PR] [SPARK-46478][SQL] Revert SPARK-43049 to use oracle varchar(255) for string [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/12/21 11:20:39 UTC, 8 replies.
- [PR] [SPARK-46471][PS][TESTS][FOLLOWUPS] Reorganize `OpsOnDiffFramesEnabledTests`: Factor out `test_arithmetic_chain_*` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/21 11:24:58 UTC, 5 replies.
- [PR] [SPARK-46479][CORE] Change `Utils.isJavaVersionAtLeast21` to use the utility method from `commons-lang3` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/21 11:35:23 UTC, 12 replies.
- [PR] [SPARK-46480][CORE][SQL] Fix NPE when table cache task attempt [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2023/12/21 12:18:06 UTC, 16 replies.
- [PR] [SPARK-46466][SQL][3.5] Vectorized parquet reader should never do rebase for timestamp ntz [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/12/21 12:31:16 UTC, 3 replies.
- [PR] [SPARK-46380][SQL][FOLLOWUP] Simplify the code for ResolveInlineTables and ResolveInlineTablesSuite [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/12/21 13:24:26 UTC, 5 replies.
- [PR] [WIP][SQL] Restore backward compatibility of `JdbcDialect.classifyException` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/21 14:50:13 UTC, 0 replies.
- [PR] Execute immediate VariableReference foldable [spark] - posted by "milastdbx (via GitHub)" <gi...@apache.org> on 2023/12/21 14:55:37 UTC, 0 replies.
- Re: [PR] [SPARK-46481] Execute immediate VariableReference foldable [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/21 16:30:22 UTC, 9 replies.
- [PR] Handle COUNT bug for EXISTS/IN subqueries [spark] - posted by "agubichev (via GitHub)" <gi...@apache.org> on 2023/12/21 16:43:17 UTC, 0 replies.
- Re: [PR] Handle COUNT bug for EXISTS subqueries [spark] - posted by "agubichev (via GitHub)" <gi...@apache.org> on 2023/12/21 16:50:51 UTC, 0 replies.
- Re: [PR] [SPARK-46179][SQL] Add CrossDbmsQueryTestSuites, which allows generating golden files with other DBMS, starting off with Postgres [spark] - posted by "andylam-db (via GitHub)" <gi...@apache.org> on 2023/12/21 18:29:33 UTC, 8 replies.
- Re: [PR] [SPARK-46468] [SQL] Handle COUNT bug for EXISTS subqueries with Aggregate without grouping keys [spark] - posted by "agubichev (via GitHub)" <gi...@apache.org> on 2023/12/21 19:22:33 UTC, 4 replies.
- [PR] [SPARK-46482][SQL] Revert SPARK-43049 due to performance regression of using CLOB [spark] - posted by "sadikovi (via GitHub)" <gi...@apache.org> on 2023/12/21 21:32:37 UTC, 3 replies.
- Re: [PR] [SPARK-45068][SQL] Make math function output column name displayed in upper-cased style [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/22 00:18:46 UTC, 1 replies.
- Re: [PR] [SPARK-45055] [SQL] Do not transpose windows if they conflict on ORDER BY / PROJECT clauses [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/22 00:18:47 UTC, 1 replies.
- [PR] [SPARK-46483][INFRA] Exclude `apache-rat.jar` from `ScalaUnidoc / unidoc / unidocAllClasspaths` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/22 03:16:16 UTC, 0 replies.
- [PR] [SPARK-46484][SQL][CONNECT] Retain `plan_id` in `ResolveUnpivot` and `UnpivotCoercion ` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/22 03:39:03 UTC, 2 replies.
- [PR] [SPARK-46484][SQL][CONNECT] Retain `plan_id` in `resolveOperators` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/22 03:40:50 UTC, 3 replies.
- [PR] [SPARK-46484][SQL][CONNECT] Retain `tags` in `resolveOperators` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/22 05:25:48 UTC, 2 replies.
- [PR] [SPARK-46480][CORE][SQL][3.5] Fix NPE when table cache task attempt [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2023/12/22 05:43:41 UTC, 2 replies.
- [PR] [SPARK-46485][SQL] V1Write should not add Sort when not needed [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/12/22 07:05:27 UTC, 12 replies.
- [PR] Do not convert array type string retrieved from jdbc driver [spark] - posted by "phanhuyn (via GitHub)" <gi...@apache.org> on 2023/12/22 08:13:05 UTC, 1 replies.
- [PR] [SPARK-46487][SQL] Push down part of filter through aggregate with nondeterministic field [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2023/12/22 09:15:57 UTC, 14 replies.
- [PR] [SPARK-46484][SQL][CONNECT] Make `resolveOperators*` functions keep the plan id [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/22 11:50:14 UTC, 0 replies.
- [PR] [SPARK-XXXX][SQL] Skipping trimAll call during timestamp parsing [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2023/12/22 13:57:46 UTC, 0 replies.
- Re: [PR] [SQL] Skipping trimAll call during timestamp parsing [spark] - posted by "dbatomic (via GitHub)" <gi...@apache.org> on 2023/12/22 14:48:33 UTC, 0 replies.
- Re: [PR] [SPARK-45709][BUILD] Deploy packages when all packages are built [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2023/12/22 15:06:21 UTC, 0 replies.
- Re: [PR] [SPARK-45708][BUILD] Retry mvn deploy [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2023/12/22 15:07:10 UTC, 0 replies.
- Re: [PR] [SPARK-45656][SQL] Fix observation when named observations with the same name on different datasets [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2023/12/22 15:15:45 UTC, 2 replies.
- [PR] [SPARK-46490][SQL] Require error classes in `SparkThrowable` sub-classes [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/22 20:16:16 UTC, 16 replies.
- Re: [PR] [CONNECT][SPARK-45155] Add API Docs for Spark Connect JVM/Scala Client [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/23 00:17:58 UTC, 1 replies.
- Re: [PR] [KUBERNETES] Add ephemeral storage configs for spark on kubernetes [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/23 00:18:00 UTC, 1 replies.
- Re: [PR] [SPARK-45020][SQL] Supress 'NoSuchDatabaseException' for default dbs [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/23 00:18:02 UTC, 1 replies.
- Re: [PR] [SPARK-43851][SQL] Support LCA in grouping expressions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/23 00:18:05 UTC, 1 replies.
- Re: [PR] [SPARK-46483][INFRA] Exclude `apache-rat.jar` from `ScalaUnidoc/unidoc/unidocAllClasspaths` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/23 05:47:17 UTC, 1 replies.
- [PR] [SPARK-46492][BUILD] Simplify the Java version check in `SparkBuild.scala` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/23 10:15:43 UTC, 7 replies.
- [PR] [SPARK-46493][BUILD] Upgraded `apache-rat` used in the `dev/check-license` to 0.15 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/23 10:26:50 UTC, 0 replies.
- Re: [PR] [SPARK-45899][CONNECT] Set errorClass in errorInfoToThrowable [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/23 11:30:25 UTC, 2 replies.
- [PR] [SPARK-46494][SQL] Remove the parse rule of `First`, `Last` and `any_value`. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/12/23 12:50:51 UTC, 2 replies.
- [PR] [WIP][CONNECT] Pass message parameters in metadata of ErrorInfo [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/23 20:03:22 UTC, 0 replies.
- Re: [PR] [SPARK-46493][INFRA] Upgrade `apache-rat` in the `dev/check-license` to 0.15 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/23 23:09:46 UTC, 1 replies.
- Re: [PR] [SPARK-46471][PS][TESTS][FOLLOWUPS] Reorganize `OpsOnDiffFramesEnabledTests`: Factor out `test_assignment_*` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/23 23:13:35 UTC, 1 replies.
- Re: [PR] Update KryoIteratorBenchmark.scala [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/24 00:20:27 UTC, 1 replies.
- Re: [PR] [SPARK-45102] Support keyword columns on filters that interact with HMS [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/24 00:20:29 UTC, 1 replies.
- Re: [PR] [SPARK-46484][WIP][SQL][CONNECT] Make `resolveOperators*` functions keep the plan id [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/24 01:24:31 UTC, 0 replies.
- [PR] [SPARK-46471][PS][TESTS][FOLLOWUPS] Reorganize `OpsOnDiffFramesEnabledTests`: Factor out more tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/24 02:38:01 UTC, 3 replies.
- [PR] [SPARK-46495][INFRA] Merge pyspark-error to pyspark-core [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/24 06:16:05 UTC, 3 replies.
- [PR] [SPARK-46471][PS][TESTS][FOLLOWUPS] Move `OpsOnDiffFramesEnabledTests` to `pyspark.pandas.tests.diff_frames_ops.*`` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/24 10:08:16 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-46484][SQL][CONNECT] Make `resolveOperators*` functions keep the plan id [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/24 22:34:39 UTC, 0 replies.
- Re: [PR] [SPARK-46455][CORE][SQL][SS][CONNECT][PYTHON] Remove redundant type conversion [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/24 22:44:22 UTC, 1 replies.
- [PR] [SPARK-46496][BUILD] Upgrade Arrow to 14.0.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/24 22:58:29 UTC, 3 replies.
- Re: [PR] [SPARK-45129] Add pyspark "ml-connect" extras dependencies [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/25 00:19:29 UTC, 1 replies.
- Re: [PR] [SPARK-43752][SQL] Support default column value on DataSource V2 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/25 00:19:32 UTC, 1 replies.
- [PR] test [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/25 02:41:16 UTC, 1 replies.
- Re: [PR] [SPARK-45893][HIVE] Support drop multiple partitions in batch for hive [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2023/12/25 03:59:35 UTC, 1 replies.
- [PR] [SPARK-46497][SQL][TESTS] Re-enable the test cases that were ignored in SPARK-45309 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/25 04:40:38 UTC, 3 replies.
- [PR] [SPARK-46498][CORE] Clean up unused methods and local variables in `o.a.spark.util.Utils` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/25 05:11:29 UTC, 0 replies.
- [PR] [SPARK-46499][BUILD] Bump sbt-eclipse 6.2.0 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2023/12/25 06:24:03 UTC, 2 replies.
- [PR] Test Ivy 2.5.2 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/25 06:24:15 UTC, 16 replies.
- Re: [PR] [MINOR][INFRA] Comments in GitHub scripts should start with # [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/25 06:50:11 UTC, 4 replies.
- [PR] [SPARK-46500][PS][TESTS] Reorganize `FrameParityPivotTests` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/25 07:52:09 UTC, 4 replies.
- [PR] [SPARK-46501][INFRA] List the python packages with the correct versions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/25 07:56:33 UTC, 3 replies.
- [PR] [SPARK-46502][SQL] Support timestamp types in UnwrapCastInBinaryComparison [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2023/12/25 09:13:36 UTC, 19 replies.
- [PR] [SPARK-40876][SQL][TESTS] Skip the test inputs in `ParquetTypeWideningSuite` that violate the data type conversion rules under ANSI mode [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/25 10:10:52 UTC, 0 replies.
- Re: [PR] [SPARK-46488][SQL] Skipping trimAll call during timestamp parsing [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/25 10:19:41 UTC, 4 replies.
- Re: [PR] [SPARK-40876][SQL][TESTS][FOLLOWUP] Skip the test inputs in `ParquetTypeWideningSuite` that violate the data type conversion rules under ANSI mode [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/25 10:31:02 UTC, 2 replies.
- [PR] [SPARK-46503][PS][TESTS] Move `test_default_index` to `pyspark.pandas.tests.indexes.*` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/25 10:47:10 UTC, 3 replies.
- Re: [PR] [SPARK-40876][SQL][TESTS][FOLLOWUP] Fix failed test in `ParquetTypeWideningSuite` when `SPARK_ANSI_SQL_MODE` is set to true [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/25 12:14:08 UTC, 2 replies.
- [PR] Monthname function [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2023/12/25 16:32:02 UTC, 2 replies.
- Re: [PR] [SPARK-41954][CORE] Add isDecommissioned in ExecutorDeadException [spark] - posted by "warrenzhu25 (via GitHub)" <gi...@apache.org> on 2023/12/25 16:56:11 UTC, 0 replies.
- Re: [PR] [SPARK-46498][CORE] Clean up unused functions and local variables in `o.a.spark.util.Utils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/25 23:43:18 UTC, 0 replies.
- Re: [PR] [SPARK-45152][ML] Add includeLowest Param to Bucketizer [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/26 00:18:31 UTC, 1 replies.
- Re: [PR] [SPARK-45122][DOCS] Automate updating versions.json [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/26 00:18:32 UTC, 1 replies.
- Re: [PR] [SPARK-46498][CORE] Remove an unused local variables from `o.a.spark.util.Utils#getConfiguredLocalDirs` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/26 00:45:22 UTC, 1 replies.
- [PR] [MINOR][DOCS] Python docs also require Pandoc [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2023/12/26 01:09:15 UTC, 3 replies.
- [PR] [SPARK-46504][PS][TESTS] Factor slow tests out of `IndexesTests` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/26 01:37:42 UTC, 2 replies.
- [PR] [SPARK-46505][CONNECT] Make bytes threshold configurable in `ProtoUtils.abbreviate` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/26 01:45:05 UTC, 2 replies.
- [PR] [SPARK-45600][SQL][PYTHON][FOLLOW-UP] Make Python data source registration session level [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/26 02:08:55 UTC, 3 replies.
- [PR] [MINOR][DOCS] Fix rst link in Python API docs for .sql() [spark] - posted by "nchammas (via GitHub)" <gi...@apache.org> on 2023/12/26 02:36:45 UTC, 4 replies.
- [PR] [SPARK-45597][PYTHON][SQL][FOLLOw-UP] Refactor User defined source checking logic to `DataSourceManager` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/26 02:44:30 UTC, 1 replies.
- [PR] [SPARK-46506][PYTHON][DOCS] Refine docstring of `array_intersect/array_union/array_except` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/26 03:39:11 UTC, 2 replies.
- [PR] [SPARK-46507][PS][TESTS] Split `IndexesSlowTests` into multiple tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/26 03:59:31 UTC, 3 replies.
- Re: [PR] [SPARK-45597][PYTHON][SQL][FOLLOW-UP] Minor deduplicate datasource checking logic [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/26 05:52:32 UTC, 1 replies.
- [PR] [SPARK-46504][PS][TESTS][FOLLOWUPS] Make `test_insert` more stable by sorting before comparison [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/26 05:58:11 UTC, 2 replies.
- [PR] [SPARK-46478][SQL][3.5] Revert SPARK-43049 to use oracle varchar(255) for string [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/12/26 06:08:48 UTC, 3 replies.
- [PR] [SPARK-46508][BUILD] Upgrade Jackson to 2.16.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/26 06:25:15 UTC, 4 replies.
- [PR] [SPARK-46509][CORE] Replace `reverse.find` with `findLast` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/26 06:28:24 UTC, 0 replies.
- [PR] [SPARK-46510][CORE] Spark shell log filter should be applied to all AbstractAppender [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2023/12/26 07:21:52 UTC, 5 replies.
- [PR] [SPARK-45914][PYTHON] Support `commit` and `abort` API for Python data source write [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/12/26 08:10:04 UTC, 0 replies.
- Re: [PR] [SPARK-46498][CORE] Remove `shuffleServiceEnabled` from `o.a.spark.util.Utils#getConfiguredLocalDirs` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/26 08:19:37 UTC, 1 replies.
- [PR] [MINOR][SQL] Check the NumericType in canImplicitlyCast is not needed. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/12/26 10:01:32 UTC, 5 replies.
- [PR] [SPARK-46513][PS][TESTS] Move `BasicIndexingTests` to `pyspark.pandas.tests.indexes.*` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/26 10:48:02 UTC, 3 replies.
- [PR] [SPARK-46514][TESTS] Fix HiveMetastoreLazyInitializationSuite [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/12/26 10:51:00 UTC, 16 replies.
- Re: [PR] [SPARK-45352][SQL] Eliminate foldable window partitions [spark] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2023/12/26 13:31:49 UTC, 6 replies.
- [PR] [WIP][SQL] Skip query context catching in `DataFrame` methods [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/26 19:57:02 UTC, 0 replies.
- Re: [PR] [SPARK-44790][SQL] XML: to_xml implementation and bindings for python, connect and SQL [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2023/12/26 20:55:57 UTC, 2 replies.
- Re: [PR] [SPARK-45914][PYTHON] Support commit and abort API for Python data source write [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/26 23:58:06 UTC, 5 replies.
- [PR] [SPARK-46517][PS][TESTS] Reorganize `IndexingTest`: factor out `test_loc*` tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/27 00:51:41 UTC, 3 replies.
- Re: [PR] [SPARK-46515] Add MONTHNAME function [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2023/12/27 01:03:45 UTC, 2 replies.
- [PR] [SPARK-46519][SQL] Clear unused error classes from `error-classes.json` file [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/27 03:05:32 UTC, 17 replies.
- [PR] [SPARK-45917][PYTHON][SQL] Automatic registration of Python Data Source on startup [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/27 04:47:44 UTC, 11 replies.
- [PR] [SPARK-46520 [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/12/27 05:40:51 UTC, 0 replies.
- [PR] [SPARK-46521][PYTHON][DOCS] Refine docstring of `array_remove/array_distinct/array_compact` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/27 07:05:54 UTC, 4 replies.
- [PR] [SPARK-46522][PYTHON] Block Python data source registration with name conflicts [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/12/27 07:58:10 UTC, 6 replies.
- [PR] [SPARK-46524][SQL] Improve error messages for invalid save mode [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/12/27 09:41:59 UTC, 3 replies.
- [PR] [SPARK-46525][DOCKER][TESTS] Fix docker-integration-tests on Apple Chips [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/12/27 10:02:37 UTC, 3 replies.
- [PR] [SPARK-46517][PS][TESTS][FOLLOWUPS] Reorganize `IndexingTest`: factor out `test_iloc*` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/27 10:08:18 UTC, 3 replies.
- Re: [PR] [SPARK-46520][PYTHON] Support overwrite mode for Python data source write [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/27 11:44:23 UTC, 1 replies.
- [PR] [MINOR][K8S] Remove an unused expression `None` from `KubernetesClientUtils#loadSparkConfDirFiles` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/27 12:04:39 UTC, 4 replies.
- [PR] [SPARK-46512][CORE] Optimize shuffle reading when both sort and combine are used. [spark] - posted by "zhengchenyu (via GitHub)" <gi...@apache.org> on 2023/12/27 12:45:01 UTC, 3 replies.
- [PR] [SPARK-40876][SQL] Widening type promotion for decimals with larger scale in Parquet readers [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2023/12/27 17:08:17 UTC, 3 replies.
- [PR] [SPARK-46526][SQL] Support LIMIT over correlated subqueries where predicates only reference outer table [spark] - posted by "agubichev (via GitHub)" <gi...@apache.org> on 2023/12/27 17:54:24 UTC, 1 replies.
- Re: [PR] [SPARK-46525][DOCKER][TESTS] Fix docker-integration-tests on Apple Sillicon [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/27 19:36:16 UTC, 7 replies.
- [PR] [SPARK-46528][BUILD] Upgrade `zstd-jni` to 1.5.5-11 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/27 19:54:28 UTC, 6 replies.
- Re: [PR] [SPARK-25689][YARN][FOLLOWUP] Add a missing argument usage description for ApplicationMasterArguments [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/28 00:18:44 UTC, 1 replies.
- [PR] Upgrad sbt 1.9.8 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/28 02:21:17 UTC, 0 replies.
- [PR] [SPARK-46529][DOCKER] upgrade guava from 18.0 to 19.0 for docker-integration-tests [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/12/28 02:22:15 UTC, 0 replies.
- Re: [PR] [Don't merge & review] upgrade sbt 1.9.8 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/28 02:35:03 UTC, 1 replies.
- [PR] [SPARK-46517][PS][TESTS][FOLLOWUPS] Reorganize `IndexingTest`: factor out `test_loc2d*` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/28 02:53:37 UTC, 3 replies.
- Re: [PR] [SPARK-46529][TESTS] Upgrade guava from 18.0 to 19.0 for `docker-integration-tests` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/28 03:30:14 UTC, 3 replies.
- [PR] [SPARK-46530][PYTHON][SQL] Check Python executable when looking up available Data Sources [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/28 03:57:40 UTC, 9 replies.
- [PR] [SPARK-46517][PS][TESTS][FOLLOWUPS] Reorganize `IndexingTest`: Move to `pyspark.pandas.tests.indexes.*` and add the parity test [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/28 05:09:10 UTC, 2 replies.
- [PR] [SPARK-46531][BUILD] Move the dependency management of `datasketches-java` from `catalyst` to `parent` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/28 06:21:38 UTC, 3 replies.
- Re: [PR] [SPARK-46532][CONNECT] Pass message parameters in metadata of `ErrorInfo` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/28 07:11:48 UTC, 28 replies.
- Re: [PR] [WIP][SPARK-46490][SQL] Require error classes in `SparkThrowable` sub-classes [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/28 07:13:26 UTC, 3 replies.
- [PR] [SPARK-46533][PYTHON][DOCS] Refine docstring of `array_min/array_max/array_size/array_repeat` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/28 07:24:32 UTC, 3 replies.
- [PR] [SPARK-46534][SQL][HIVE] Skip initializing an unused hive client in HiveThriftServer2.startWithContext DeveloperApi [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/12/28 07:52:22 UTC, 0 replies.
- [PR] [SPARK-39859][SQL] Fix describe extended column without col stats [spark] - posted by "Zouxxyy (via GitHub)" <gi...@apache.org> on 2023/12/28 08:34:16 UTC, 0 replies.
- Re: [PR] [SPARK-39859][SQL] Fix NPE when describe extended a column without col stats [spark] - posted by "Zouxxyy (via GitHub)" <gi...@apache.org> on 2023/12/28 08:45:48 UTC, 3 replies.
- Re: [PR] [SPARK-46535][SQL] Fix NPE when describe extended a column without col stats [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/12/28 09:17:33 UTC, 7 replies.
- [PR] [WIP][SQL] Convert NPE and asserts from commands to internal errors [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/28 11:41:55 UTC, 0 replies.
- Re: [PR] [SPARK-46537][SQL] Convert NPE and asserts from commands to internal errors [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/28 11:48:47 UTC, 2 replies.
- Re: [PR] [SPARK-46484][SQL][CONNECT] Make `resolveOperators*` helper functions keep the plan id [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/28 11:53:08 UTC, 3 replies.
- [PR] [SPARK-46538][ML] Fix an ambiguous column reference issue in `ALSModel.transform` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/28 11:59:01 UTC, 2 replies.
- Re: [PR] [SPARK-46538][ML] Fix the ambiguous column reference issue in `ALSModel.transform` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/28 12:40:54 UTC, 6 replies.
- [PR] [WIP] Select except assert error [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2023/12/28 12:49:21 UTC, 0 replies.
- Re: [PR] [SPARK-46539][SQL] SELECT * EXCEPT(all fields from a struct) results in an assertion failure [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/28 19:19:48 UTC, 12 replies.
- Re: [PR] [SPARK-45199][SQL] Release cast from attribute in filter to support predicate push down [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/29 00:15:40 UTC, 1 replies.
- Re: [PR] [SPARK-44459][Core] Add System.runFinalization() to periodic cleanup [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/29 00:15:41 UTC, 1 replies.
- Re: [PR] [SPARK-44812][SQL] Push all predicates according to EqualTo and EqualNullSafe [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/29 00:15:43 UTC, 1 replies.
- Re: [PR] [SPARK-43496][KUBERNETES] Add configuration for pod memory limits [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/29 00:15:45 UTC, 2 replies.
- [PR] [SPARK-46532][CONNECT][PYTHON][FOLLOW-UP] Pass message parameters in Python Spark Connect client [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/29 00:40:00 UTC, 3 replies.
- [PR] [SPARK-46397][PYTHON][CONNECT] Function `sha2` should raise `PySparkValueError` for invalid `numBits` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/29 01:04:59 UTC, 3 replies.
- Re: [PR] [DO-NOT-REVIEW][DRAFT] Spark 45637 multiple state test [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2023/12/29 02:24:48 UTC, 3 replies.
- [PR] [SPARK-46540][PYTHON] Respect column names when Python data source read function outputs named Row objects [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/12/29 02:26:37 UTC, 0 replies.
- [PR] [WIP][SPARK-46541][SQL][CONNECT] Fix the ambiguous column reference in self join [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/29 06:17:10 UTC, 0 replies.
- Re: [PR] Identify issue - Run Spark on Kubernetes Integration test failure [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/29 07:07:42 UTC, 2 replies.
- [PR] [SPARK-46542][SQL] Remove the check for `c>=0` from `ExternalCatalogUtils#needsEscaping` as it is always true [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/29 07:37:37 UTC, 3 replies.
- [PR] [SPARK-46543][PYTHON][CONNECT] Make `json_tuple` throw PySparkValueError for empty fields [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/29 07:47:27 UTC, 2 replies.
- [PR] [SPARK-46544][SQL] Support v2 DESCRIBE TABLE EXTENDED with table stats [spark] - posted by "Zouxxyy (via GitHub)" <gi...@apache.org> on 2023/12/29 09:45:13 UTC, 2 replies.
- [PR] [SPARK-46504][PS][TESTS][FOLLOWUPS] Moving slow tests out of `IndexesTests`: conversion and drop methods [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/29 10:57:57 UTC, 3 replies.
- [PR] Collations proof of concept [spark] - posted by "dbatomic (via GitHub)" <gi...@apache.org> on 2023/12/29 12:30:09 UTC, 0 replies.
- [PR] [WIP][SPARK-46536]Support GROUP BY calendar_interval_type [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2023/12/29 14:49:45 UTC, 0 replies.
- Re: [PR] [MiNOR][DOCS] Fix a typo in HashAggregateExec.scala [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/30 00:18:08 UTC, 1 replies.
- Re: [PR] [SPARK-46509][CORE][SS] Replace `.reverse.find` with `.findLast` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/12/30 00:52:31 UTC, 2 replies.
- [PR] [INFRA] Pin `lxml==4.9.4` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/30 00:54:41 UTC, 2 replies.
- Re: [PR] [SPARK-46545][INFRA] Pin `lxml==4.9.4` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/30 01:00:12 UTC, 4 replies.
- [PR] [SPARK-46546][DOCS] Fix the formatting of tables in `running-on-kubernetes` and `running-on-yarn` pages [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/30 02:07:04 UTC, 4 replies.
- [PR] debug appveyor [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/30 02:19:03 UTC, 1 replies.
- [PR] [SPARK-46547] Fix deadlock between maintenance thread and streaming aggregation operator [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2023/12/30 09:25:16 UTC, 0 replies.
- Re: [PR] [SPARK-46547][SS] Fix deadlock between maintenance thread and streaming aggregation operator [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2023/12/30 09:36:37 UTC, 1 replies.
- Re: [PR] [SPARK-46541][SQL][CONNECT] Fix the ambiguous column reference in self join [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/30 10:23:28 UTC, 2 replies.
- Re: [PR] [SPARK-46536][SQL] Support GROUP BY calendar_interval_type [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/12/30 10:51:39 UTC, 1 replies.
- [PR] [SPARK-46504][PS][TESTS][FOLLOWUPS] Moving move slow tests out of `IndexesTests` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/30 11:08:28 UTC, 3 replies.
- [PR] test slf4j-api 2.0.10 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/12/30 11:11:00 UTC, 1 replies.
- [PR] [SPARK-46548][PYTHON][DOCS] Refine docstring of `get/array_zip/sort_array` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/30 17:57:46 UTC, 3 replies.
- Re: [PR] WIP: refactor Window operator [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/31 00:20:45 UTC, 0 replies.
- Re: [PR] [Don't merge and review] investigate root cause sbt [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/12/31 00:20:47 UTC, 0 replies.
- [PR] [WIP][SPARK-46549][INFRA] Cache the Python dependencies for SQL tests [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/12/31 01:02:28 UTC, 2 replies.
- [PR] [SPARK-46550][BUILD][SQL] Upgrade `datasketches-java` to 5.0.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/31 14:04:02 UTC, 2 replies.
- [PR] [SPARK-46551][PYTHON][DOCS] Refine docstring of `flatten/sequence/shuffle` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/12/31 14:59:06 UTC, 1 replies.
- [PR] [WIP][SQL] Replace `UnsupportedOperationException` by `SparkUnsupportedOperationException` in `catalyst` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/31 15:25:51 UTC, 0 replies.