reviews@spark.apache.org, 2023-11

You are viewing a plain text version of this content. The canonical link for it is here.

- Re: [PR] [SPARK-45733][CONNECT][PYTHON] Support multiple retry policies [spark] - posted by "cdkrot (via GitHub)" <gi...@apache.org> on 2023/11/01 00:13:45 UTC, 23 replies.
- Re: [PR] [SPARK-45654][PYTHON] Add Python data source write API [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/01 00:14:13 UTC, 1 replies.
- Re: [PR] [SPARK-45680][CONNECT] Release session [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/01 00:16:58 UTC, 8 replies.
- [PR] [SQL]WIP [spark] - posted by "anchovYu (via GitHub)" <gi...@apache.org> on 2023/11/01 00:23:30 UTC, 0 replies.
- [PR] [SPARK-45749][CORE][WEBUI] Fix Spark History Server to sort `Duration` column properly [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/01 00:38:46 UTC, 1 replies.
- Re: [PR] [SPARK-45368][SQL] Remove scala2.12 compatibility logic for DoubleType, FloatType, Decimal [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/01 00:58:24 UTC, 1 replies.
- Re: [PR] [SPARK-45704][BUILD] Fix compile warning - using symbols inherited from a superclass shadow symbols defined in an outer scope [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/01 01:09:22 UTC, 2 replies.
- Re: [PR] [SPARK-45697][BUILD] Fix `Unicode escapes in triple quoted strings are deprecated` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/01 01:17:39 UTC, 16 replies.
- Re: [PR] [SPARK-45481][SPARK-45664][SPARK-45711][SQL][FOLLOWUP] Avoid magic strings copy from parquet|orc|avro compression codes [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/01 01:26:44 UTC, 0 replies.
- Re: [PR] [SPARK-42746][SQL] Add the LISTAGG() aggregate function [spark] - posted by "Hisoka-X (via GitHub)" <gi...@apache.org> on 2023/11/01 01:43:04 UTC, 4 replies.
- Re: [PR] [SPARK-45740][SQL] Relax the node prefix of SparkPlanGraphCluster [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2023/11/01 01:49:38 UTC, 2 replies.
- Re: [PR] [SPARK-45749][CORE][WEBUI] Fix `Spark History Server` to sort `Duration` column properly [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/11/01 01:55:58 UTC, 4 replies.
- Re: [PR] [SPARK-45739][PYTHON] Catch IOException instead of EOFException alone for faulthandler [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2023/11/01 02:08:11 UTC, 0 replies.
- Re: [PR] [SPARK-45742][CORE][CONNECT][MLLIB][PYTHON] Introduce an implicit function for Scala Array to wrap into `immutable.ArraySeq`. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/01 02:25:56 UTC, 6 replies.
- Re: [PR] [SPARK-45718][PS] Remove remaining deprecated Pandas features from Spark 3.4.0 [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/01 02:44:11 UTC, 4 replies.
- Re: [PR] [SPARK-33393][SQL] Support SHOW TABLE EXTENDED in v2 [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/01 02:58:43 UTC, 59 replies.
- Re: [PR] [SPARK-45748][SQL] Add a .fromSQL helper function for Literals [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/01 03:26:29 UTC, 11 replies.
- Re: [PR] [WIP][SPARK-45629]Fix `Implicit definition should have explicit type` [spark] - posted by "laglangyue (via GitHub)" <gi...@apache.org> on 2023/11/01 04:30:26 UTC, 1 replies.
- Re: [PR] [SPARK-45734][BUILD] Upgrade commons-io to 2.15.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/01 05:01:47 UTC, 1 replies.
- [PR] [SPARK-45752][SQL] Unreferenced CTE should all be checked by CheckAnalysis0 [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2023/11/01 05:12:39 UTC, 25 replies.
- [PR] [SPARK-45753][CORE] Support `spark.deploy.driverIdPattern` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/01 05:26:12 UTC, 14 replies.
- [PR] [SPARK-45754][CORE] Support `spark.deploy.appIdPattern` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/01 05:37:18 UTC, 4 replies.
- Re: [PR] [SPARK-45744][CORE] Switch `spark.history.store.serializer` to use `PROTOBUF` by default [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/01 06:08:23 UTC, 2 replies.
- Re: [PR] [SPARK-45327][BUILD] Upgrade zstd-jni to 1.5.5-7 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/01 06:11:36 UTC, 2 replies.
- [PR] [SPARK-45755][SQL] Push down limit through Dataset.isEmpty() [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2023/11/01 06:18:06 UTC, 0 replies.
- [PR] [SPARK-45751][CORE][UI] Update the default value for 'spark.executor.… [spark] - posted by "chenyu-opensource (via GitHub)" <gi...@apache.org> on 2023/11/01 06:20:46 UTC, 1 replies.
- Re: [PR] [SPARK-45688][SPARK-45693][CORE] Clean up the deprecated API usage related to `MapOps` & Fix `method += in trait Growable is deprecated` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/01 06:21:27 UTC, 17 replies.
- [PR] [SPARK-45757][ML] Avoid re-computation of NNZ in Binarizer [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/01 07:11:07 UTC, 2 replies.
- Re: [PR] [SPARK-45527][core] Use fraction to do the resource calculation [spark] - posted by "wbo4958 (via GitHub)" <gi...@apache.org> on 2023/11/01 07:13:52 UTC, 11 replies.
- Re: [PR] [SPARK-45755][SQL] Improve `Dataset.isEmpty()` by applying global limit `1` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/01 07:22:44 UTC, 3 replies.
- Re: [PR] [SPARK-45022][SQL] Provide context for dataset API errors [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/11/01 07:38:33 UTC, 4 replies.
- Re: [PR] [SPARK-45751][DOCS] Update the default value for spark.executor.logs.rolling.maxRetainedFile [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/11/01 09:13:38 UTC, 1 replies.
- [PR] [SPARK-45758][SQL] Introduce a mapper for hadoop compression codecs [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/01 12:59:39 UTC, 16 replies.
- [PR] Keep the taskBinary in Stage to avoid deserializing it multiple times, and send binary to executor instead of task. [spark] - posted by "hui730 (via GitHub)" <gi...@apache.org> on 2023/11/01 13:47:54 UTC, 8 replies.
- Re: [PR] [SPARK-45743][BUILD] Upgrade dropwizard metrics 4.2.21 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/01 15:13:06 UTC, 1 replies.
- Re: [PR] [SPARK-45533][CORE] Use j.l.r.Cleaner instead of finalize for RocksDBIterator/LevelDBIterator [spark] - posted by "zhaomin1423 (via GitHub)" <gi...@apache.org> on 2023/11/01 15:20:23 UTC, 62 replies.
- [PR] [hotfix] [docs] Fix typo [spark] - posted by "YuanHanzhong (via GitHub)" <gi...@apache.org> on 2023/11/01 15:47:37 UTC, 3 replies.
- [PR] [SPARK-45760][SQL] Add With expression to avoid duplicating expressions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/01 16:03:23 UTC, 16 replies.
- [PR] [SPARK-45761][K8S][INFRA][DOCS] Upgrade `Volcano` to 1.8.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/01 16:40:51 UTC, 4 replies.
- [PR] [hotfix] [docs] Fix typo [spark] - posted by "YuanHanzhong (via GitHub)" <gi...@apache.org> on 2023/11/01 16:44:09 UTC, 3 replies.
- [PR] SPARK-45762: Support shuffle managers defined in user jars by changing startup order [spark] - posted by "abellina (via GitHub)" <gi...@apache.org> on 2023/11/01 16:53:35 UTC, 0 replies.
- Re: [PR] [SPARK-45762][CORE]: Support shuffle managers defined in user jars by changing startup order [spark] - posted by "abellina (via GitHub)" <gi...@apache.org> on 2023/11/01 16:59:16 UTC, 3 replies.
- [PR] [SPARK-45763][CORE][UI] Improve `MasterPage` to show `Resource` column only when it exists [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/01 18:19:58 UTC, 4 replies.
- [PR] [SPARK-45731][SQL] Also update partition statistics with `ANALYZE TABLE` command [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2023/11/01 20:11:34 UTC, 35 replies.
- [PR] [SPARK-45639][SQL][PYTHON] Support loading Python data sources in DataFrameReader [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/11/01 22:51:35 UTC, 12 replies.
- Re: [PR] [MINOR][DOCS] Fix typo [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/02 00:17:43 UTC, 6 replies.
- Re: [PR] [SPARK-44426][SQL] Optimize adaptive skew join for ExistenceJoin [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/02 00:17:48 UTC, 1 replies.
- Re: [PR] [SPARK-44419][SQL] Support to extract partial filters of datasource v2 table and push them down [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/02 00:17:49 UTC, 1 replies.
- [PR] Temporarily set R-win version to 4.3.2 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/02 01:17:51 UTC, 1 replies.
- Re: [PR] Temporarily pin R-win version to 4.3.2 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/02 01:29:22 UTC, 2 replies.
- [PR] [WIP][CONNECT] Fix column resolution in DataFrame.drop [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/02 02:25:12 UTC, 0 replies.
- [PR] [SPARK-45767][CORE] Delete `TimeStampedHashMap` and its UT [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/02 03:35:35 UTC, 6 replies.
- Re: [PR] [SPARK-45719][K8S] Upgrade AWS SDK to v2 for Kubernetes integration tests module [spark] - posted by "junyuc25 (via GitHub)" <gi...@apache.org> on 2023/11/02 04:00:39 UTC, 5 replies.
- Re: [PR] [SPARK-45511][SS] State Data Source - Reader [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2023/11/02 04:41:43 UTC, 26 replies.
- [PR] [MINOR][DOCS] Fixed typo [spark] - posted by "YuanHanzhong (via GitHub)" <gi...@apache.org> on 2023/11/02 05:34:17 UTC, 9 replies.
- [PR] [SPARK-45768][SQL][PYTHON] Make faulthandler a runtime configuration for Python execution in SQL [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/02 07:17:57 UTC, 9 replies.
- Re: [PR] [SPARK-45730][CORE] Make ReloadingX509TrustManagerSuite less flaky [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2023/11/02 09:37:11 UTC, 8 replies.
- Re: [PR] [WIP][SQL][PYTHON][CONNECT] Fix column resolution in `DataFrame.drop` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/02 10:59:04 UTC, 0 replies.
- Re: [PR] [SPARK-41454][PYTHON] Support Python 3.11 [spark] - posted by "mdhont (via GitHub)" <gi...@apache.org> on 2023/11/02 11:09:04 UTC, 1 replies.
- Re: [PR] [SPARK-45770][SQL][PYTHON][CONNECT] Fix column resolution in `DataFrame.drop` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/02 13:21:11 UTC, 3 replies.
- [PR] [SPARK-45694][SQL] Clean up deprecated API usage View.force and ScalaNumberProxy.signum [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2023/11/02 13:38:09 UTC, 1 replies.
- Re: [PR] [SPARK-45694][SPARK-45695][SQL] Clean up deprecated API usage View.force and ScalaNumberProxy.signum [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/02 13:43:28 UTC, 3 replies.
- Re: [PR] [SPARK-45762][CORE] Support shuffle managers defined in user jars by changing startup order [spark] - posted by "tgravescs (via GitHub)" <gi...@apache.org> on 2023/11/02 14:46:53 UTC, 31 replies.
- Re: [PR] [SPARK-45614][SQL] Assign names to error _LEGACY_ERROR_TEMP_215[6,7,8] [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/02 15:18:35 UTC, 0 replies.
- [PR] [SPARK-45771][CORE] Enable spark.eventLog.rolling.enabled by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/02 16:01:57 UTC, 0 replies.
- Re: [PR] [SPARK-45771][CORE] Enable `spark.eventLog.rolling.enabled` by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/02 16:44:31 UTC, 10 replies.
- Re: [PR] [SPARK-45694][SPARK-45695][SQL] Clean up deprecated API usage `View.force` and `ScalaNumberProxy.signum` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/02 22:06:01 UTC, 5 replies.
- [PR] [SPARK-45773][PYTHON][DOCS] Refine docstring of SparkSession.builder.config [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/11/02 23:25:29 UTC, 4 replies.
- [PR] [WIP][SPARK-4836][UI] Show all stage attempts on UI's job details page [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2023/11/03 00:12:32 UTC, 1 replies.
- Re: [PR] [SPARK-44517][SQL] Respect ignorenulls and child's nullability in first [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/03 00:17:55 UTC, 1 replies.
- Re: [PR] [SPARK-44065][SQL] Optimize BroadcastHashJoin skew in OptimizeSkewedJoin [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/03 00:17:58 UTC, 0 replies.
- [PR] [SPARK-45742][CORE][FOLLOWUP] Remove unnecessary null check from `ArrayImplicits.SparkArrayOps#toImmutableArraySeq` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/03 00:29:26 UTC, 2 replies.
- [PR] [SPARK-45687][SQL] Fix `Passing an explicit array value to a Scala varargs method is deprecated` [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2023/11/03 02:45:11 UTC, 6 replies.
- [PR] [SPARK-45774][CORE][UI] Support `spark.ui.historyServerUrl` in `ApplicationPage` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/03 03:27:34 UTC, 23 replies.
- [PR] [SPARK-45776][CORE] Remove the defensive null check for `MapOutputTrackerMaster#unregisterShuffle` added in SPARK-39553 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/03 03:49:37 UTC, 2 replies.
- [PR] [SPARK-45777][CORE] Support `spark.test.appId` in `LocalSchedulerBackend` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/03 04:23:59 UTC, 8 replies.
- [PR] [SPARK-45556][UI] Allow customized status code and message through WebApplicationException [spark] - posted by "kuwii (via GitHub)" <gi...@apache.org> on 2023/11/03 05:06:58 UTC, 0 replies.
- Re: [PR] [SPARK-45629]Fix `Implicit definition should have explicit type` [spark] - posted by "laglangyue (via GitHub)" <gi...@apache.org> on 2023/11/03 06:43:23 UTC, 3 replies.
- Re: [PR] [SPARK-45774][CORE][UI] Support `spark.master.ui.historyServerUrl` in `ApplicationPage` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/03 07:36:32 UTC, 9 replies.
- Re: [PR] [SPARK-45738][CONNECT]fix status conflict in ExecuteEventsManager and… [spark] - posted by "xieshuaihu (via GitHub)" <gi...@apache.org> on 2023/11/03 08:24:09 UTC, 3 replies.
- [PR] [SPARK-44843][TESTS] Double streamingTimeout for StateStoreMetricsTest to make RocksDBStateStore related streaming tests reliable [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/11/03 08:37:57 UTC, 4 replies.
- [PR] [SPARK-45779][INFRA] Add a check step for jira issue ticket to be resolved [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/11/03 10:40:31 UTC, 4 replies.
- [PR] [SPARK-45780][CONNECT] Propagate all Spark Connect client threadlocals in InheritableThread [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2023/11/03 12:34:14 UTC, 4 replies.
- Re: [PR] [SPARK-44733][PYTHON][DOCS] Add Python to Spark type conversion page to PySpark docs. [spark] - posted by "PhilDakin (via GitHub)" <gi...@apache.org> on 2023/11/03 15:02:45 UTC, 15 replies.
- [PR] [SPARK-45781][BUILD] Upgrade Arrow to 14.0.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/03 15:58:18 UTC, 4 replies.
- [PR] [SPARK-45782][CORE][PYTHON] Add Dataframe API df.explainString() [spark] - posted by "khalidmammadov (via GitHub)" <gi...@apache.org> on 2023/11/03 19:41:51 UTC, 2 replies.
- [PR] [SPARK-44751] Move XSDToSchema from catalyst to core package [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2023/11/03 20:45:48 UTC, 0 replies.
- [PR] [SPARK-45783][PYTHON][CONNECT] Improve error messages when Spark Connect mode is enabled but remote URL is not set [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/11/03 22:43:53 UTC, 7 replies.
- [PR] [SPARK-45785][CORE] Support `spark.deploy.appNumberModulo` to rotate app number [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/04 00:11:06 UTC, 6 replies.
- Re: [PR] [SPARK-44483] [SQL] When using Spark to read the hive table, the number of file partitions cannot be set using Spark's configuration settings [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/04 00:17:14 UTC, 1 replies.
- Re: [PR] [SPARK-44317][SQL] Use PartitionEvaluator API in ShuffledHashJoinExec [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/04 00:17:16 UTC, 1 replies.
- Re: [PR] [SPARK-45556][UI] Allow web page respond customized status code and message through WebApplicationException [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/04 01:05:09 UTC, 8 replies.
- Re: [PR] [SPARK-44366][BUILD] Upgrade antlr4 to 4.13.1 [spark] - posted by "weikangchia (via GitHub)" <gi...@apache.org> on 2023/11/04 01:48:06 UTC, 1 replies.
- [PR] [MINOR][CORE] Validate spark.deploy.defaultCores value during config setting [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/04 05:46:33 UTC, 4 replies.
- [PR] [SPARK-45790][INFRA] Move `graphx` to `mllib*` test pipeline [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/04 07:19:13 UTC, 7 replies.
- [PR] [SPARK-45791][CONNECT][TESTS] Rename `SparkConnectSessionHodlerSuite.scala` to `SparkConnectSessionHolderSuite.scala` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/04 07:49:10 UTC, 5 replies.
- [PR] [SPARK-45779][INFRA][FOLLOWUP] Add more spaces to the prompt [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/04 08:06:04 UTC, 3 replies.
- Re: [PR] [SPARK-45710][SQL] Assign names to error _LEGACY_ERROR_TEMP_21[59,60,61,62] [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/11/04 09:36:33 UTC, 3 replies.
- [PR] [MINOR][CORE] Improve some code for storage compression codecs [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/04 11:39:10 UTC, 0 replies.
- Re: [PR] [SPARK-39931][PYTHON][WIP] Improve applyInPandas performance for very small groups [spark] - posted by "sergun (via GitHub)" <gi...@apache.org> on 2023/11/04 13:37:43 UTC, 2 replies.
- Re: [PR] [SPARK-45779][INFRA][FOLLOWUP] Add more spaces to the prompts [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/04 16:25:09 UTC, 1 replies.
- Re: [PR] [SPARK-44365][SQL] Use PartitionEvaluator API in FileSourceScanExec, RowDataSourceScanExec, MergeRowsExec [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/05 00:19:33 UTC, 1 replies.
- Re: [PR] [SPARK-44412][SQL] Use PartitionEvaluator API in ArrowEvalPythonUDTFExec & BatchEvalPythonUDTFExec [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/05 00:19:35 UTC, 1 replies.
- [PR] [SPARK-45794] [SS] Introduce state metadata source to query the streaming state metadata information [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2023/11/05 05:18:58 UTC, 4 replies.
- [PR] [SPARK-45795][SQL] DS V2 supports push down Mode [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/05 06:59:48 UTC, 1 replies.
- [PR] try to fix OracleIntegrationSuite [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/05 09:27:12 UTC, 0 replies.
- [PR] [SPARK-45796][SQL] Support MODE() WITHIN GROUP (ORDER BY col) [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/05 10:52:11 UTC, 10 replies.
- [PR] [SPARK-45798] Assert server-side session ID [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2023/11/05 11:09:22 UTC, 0 replies.
- [PR] [SPARK-45799][SQL] Remove some unused method in QueryExecutionErrors [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/05 11:59:55 UTC, 1 replies.
- Re: [PR] [SPARK-45687][SQL][MLLIB][KUBERNETES][EXAMPLES][CONNECT] Fix `Passing an explicit array value to a Scala varargs method is deprecated` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/05 12:23:00 UTC, 21 replies.
- Re: [PR] [SPARK-45799][SQL] Remove some unused method in QueryExecutionErrors & QueryCompilationErrors [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/05 13:44:21 UTC, 1 replies.
- Re: [PR] [SPARK-45793][CORE] Improve the built-in compression codecs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/05 16:22:08 UTC, 5 replies.
- [PR] [SPARK-45686] Explicitly convert `Array` to `Seq` when function input is defined as `Seq` to avoid compilation warnings related to `class LowPriorityImplicits2 is deprecated`. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/05 17:41:12 UTC, 0 replies.
- [PR] [SPARK-XXX][CONNECT][PYTHON] Better error handling for SQL Exceptions [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2023/11/05 23:54:09 UTC, 2 replies.
- Re: [PR] [SPARK-43242] Fix throw 'Unexpected type of BlockId' in shuffle corruption diagnose [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/06 00:18:34 UTC, 1 replies.
- [PR] [SPARK-45801][SQL][TESTS] Introduce two helper methods for `QueryTest` that accept the `Array` type `expectedAnswer` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/06 00:56:45 UTC, 1 replies.
- Re: [PR] [SPARK-44886][SQL] Introduce CLUSTER BY clause for CREATE/REPLACE TABLE [spark] - posted by "imback82 (via GitHub)" <gi...@apache.org> on 2023/11/06 04:09:53 UTC, 27 replies.
- [PR] [MINOR][INFRA] Correct Java version in RM Dockerfile description [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2023/11/06 04:14:53 UTC, 2 replies.
- Re: [PR] [SPARK-45686][INFRA][CORE][SQL][SS][CONNECT][MLLIB][GRAPHX][DSTREAM][AVRO][ML][K8S][YARN][PYTHON][R][PROTOBUF][UI][EXAMPLES][TESTS] Explicitly convert `Array` to `Seq` when function input is defined as `Seq` to avoid compilation warnings related to `class LowPriorityImplicits2 is deprecated`. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/06 05:18:32 UTC, 2 replies.
- Re: [PR] [SPARK-45209][CORE][UI] Flame Graph Support For Executor Thread Dump Page [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/06 06:47:11 UTC, 0 replies.
- Re: [PR] [SPARK-45669][CORE] Ensure the continuity of rolling log index [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2023/11/06 07:34:03 UTC, 0 replies.
- [PR] [WIP][SQL] Make `withOrigin` more generic [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/11/06 07:45:45 UTC, 0 replies.
- [PR] [SPARK-45802][CORE] Remove no longer needed Java `majorVersion` checks in `Platform` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/06 08:12:34 UTC, 3 replies.
- Re: [PR] [MINOR][DOCS] Fix some spelling typos [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/11/06 08:46:48 UTC, 2 replies.
- [PR] [SPARK-45803][CORE] Remove the no longer used `RpcAbortException` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/06 08:54:29 UTC, 1 replies.
- Re: [PR] [SPARK-45798][CONNECT] Assert server-side session ID [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2023/11/06 09:15:34 UTC, 24 replies.
- Re: [PR] [SPARK-41635][SQL] GROUP BY ALL [spark] - posted by "cuixiaozong (via GitHub)" <gi...@apache.org> on 2023/11/06 09:42:54 UTC, 2 replies.
- Re: [PR] [SPARK-45686][INFRA][CORE][SQL][SS][CONNECT][MLLIB][DSTREAM][AVRO][ML][K8S][YARN][PYTHON][R][UI] Explicitly convert `Array` to `Seq` when function input is defined as `Seq` to avoid compilation warnings related to `class LowPriorityImplicits2 is deprecated`. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/06 10:12:50 UTC, 0 replies.
- Re: [PR] [SPARK-45606][SQL] Release restrictions on multi-layer runtime filter [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/06 10:30:37 UTC, 3 replies.
- [PR] [SPARK-45804][UI] Add spark.ui.threadDump.flamegraphEnabled config to switch flame graph on/off [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/11/06 10:38:54 UTC, 6 replies.
- Re: [PR] [SPARK-45527][CORE] Use fraction to do the resource calculation [spark] - posted by "wbo4958 (via GitHub)" <gi...@apache.org> on 2023/11/06 11:58:41 UTC, 20 replies.
- Re: [PR] [SPARK-45805][SQL] Make `withOrigin` more generic [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/11/06 12:38:23 UTC, 15 replies.
- Re: [PR] [SPARK-45686][INFRA][CORE][SQL][SS][CONNECT][MLLIB][DSTREAM][AVRO][ML][K8S][YARN][PYTHON][R][UI][GRAPHX][PROTOBUF][TESTS] Explicitly convert `Array` to `Seq` when function input is defined as `Seq` to avoid compilation warnings related to `class LowPriorityImplicits2 is deprecated` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/06 12:56:41 UTC, 0 replies.
- Re: [PR] Add support for java 17 from spark 3.5.0 [spark-docker] - posted by "vakarisbk (via GitHub)" <gi...@apache.org> on 2023/11/06 13:36:08 UTC, 4 replies.
- [PR] Refactor `StorageUtils#bufferCleaner` to avoid directly using classes under the `sun` package [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/06 13:38:10 UTC, 0 replies.
- Re: [PR] [CORE] Refactor `StorageUtils#bufferCleaner` to avoid directly using classes under the `sun` package [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/06 13:38:47 UTC, 1 replies.
- [PR] [DONT REVIEW] Test 3x appveyor [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/06 14:04:11 UTC, 2 replies.
- [PR] SPARK-45807: Add createOrReplaceView(..) / replaceView(..) to ViewCatalog [spark] - posted by "nastra (via GitHub)" <gi...@apache.org> on 2023/11/06 15:35:55 UTC, 0 replies.
- Re: [PR] [SPARK-45807][SQL]: Add createOrReplaceView(..) / replaceView(..) to ViewCatalog [spark] - posted by "nastra (via GitHub)" <gi...@apache.org> on 2023/11/06 15:38:46 UTC, 6 replies.
- Re: [PR] [SPARK-43402][SQL] FileSourceScanExec supports push down data filter with scalar subquery [spark] - posted by "epa095 (via GitHub)" <gi...@apache.org> on 2023/11/06 17:36:10 UTC, 1 replies.
- [PR] [SPARK-45786][SQL] Fix inaccurate Decimal multiplication and division results [spark] - posted by "kazuyukitanimura (via GitHub)" <gi...@apache.org> on 2023/11/06 19:02:00 UTC, 10 replies.
- Re: [PR] [SPARK-45808][CONNECT][PYTHON] Better error handling for SQL Exceptions [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2023/11/06 19:24:15 UTC, 9 replies.
- Re: [PR] [SPARK-44751][SQL] Move `XSDToSchema` from `catalyst` to `core` package [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/06 19:26:41 UTC, 1 replies.
- [PR] [SPARK-45809][PYTHON][DOCS] Refine docstring of `lit` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/06 19:45:40 UTC, 2 replies.
- [PR] [SPARK-45809][PYTHON][DOCS] Refine docstring of `from_xml` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/06 19:55:26 UTC, 0 replies.
- [PR] [SPARK-45186][PYTHON][DOCS] Refine docstring of `schema_of_xml` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/06 20:03:47 UTC, 2 replies.
- [PR] [SPARK-45810][Python] Create Python UDTF API to stop consuming rows from the input table [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2023/11/06 20:09:34 UTC, 21 replies.
- [PR] [WIP][SPARK-45770][SQL][PYTHON][CONNECT] Introduce logical plan `UnresolvedDropColumns` for `Dataframe.drop` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/06 20:10:37 UTC, 1 replies.
- [PR] [SPARK-45258][PYTHON][DOCS] Refine docstring of `sum` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/06 20:10:52 UTC, 3 replies.
- Re: [PR] [SPARK-45708][BUILD] Retry mvn deploy [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2023/11/06 20:15:37 UTC, 2 replies.
- Re: [PR] [SPARK-45709][BUILD] Deploy packages when all packages are built [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2023/11/06 20:17:01 UTC, 0 replies.
- [PR] [SPARK-45259][PYTHON][DOCS] Refine docstring of `count` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/06 20:21:11 UTC, 3 replies.
- [PR] [SPARK-45260][PYTHON][DOCS] Refine docstring of `count_distinct` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/06 20:28:25 UTC, 3 replies.
- [PR] [SPARK-45222][PYTHON][DOCS] Refine docstring of `DataFrameReader.json` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/06 20:41:51 UTC, 8 replies.
- [PR] [SPARK-45223][PYTHON][DOCS] Refine docstring of `Column.when` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/06 21:13:08 UTC, 4 replies.
- [PR] [SPARK-45812][BUILD][PYTHON][PS] Upgrade Pandas to 2.1.2 [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/06 21:51:23 UTC, 4 replies.
- [PR] [SPARK-45813][CONNECT][PYTHON] Return the observed metrics from commands [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2023/11/07 01:42:22 UTC, 8 replies.
- [PR] [SPARK-45814][CONNECT][CORE]Make ArrowConverters.createEmptyArrowBatch call hasNext to avoid memory leak [spark] - posted by "xieshuaihu (via GitHub)" <gi...@apache.org> on 2023/11/07 02:08:05 UTC, 0 replies.
- Re: [PR] [SPARK-45811][PYTHON][DOCS] Refine docstring of `from_xml` [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/11/07 02:15:27 UTC, 3 replies.
- Re: [PR] [SPARK-45686][INFRA][CORE][SQL][SS][CONNECT][MLLIB][DSTREAM][AVRO][ML][K8S][YARN][PYTHON][R][UI][GRAPHX][PROTOBUF][TESTS][EXAMPLES] Explicitly convert `Array` to `Seq` when function input is defined as `Seq` to avoid compilation warnings related to `class LowPriorityImplicits2 is deprecated` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/07 03:09:45 UTC, 10 replies.
- [PR] [SPARK-45815][SQL][Streaming] Provide an interface for other Streaming sources to add `_metadata` columns [spark] - posted by "Yaohua628 (via GitHub)" <gi...@apache.org> on 2023/11/07 03:26:21 UTC, 9 replies.
- Re: [PR] [SPARK-45814][CONNECT][SQL]Make ArrowConverters.createEmptyArrowBatch call hasNext to avoid memory leak [spark] - posted by "xieshuaihu (via GitHub)" <gi...@apache.org> on 2023/11/07 03:35:00 UTC, 6 replies.
- [PR] [SPARK-45013][TEST] Flaky Test with NPE: track allocated resources by taskId [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/11/07 05:01:47 UTC, 6 replies.
- [PR] [SPARK-45816][SQL] Return null when overflowing during casting from timestamp to integers [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2023/11/07 05:53:18 UTC, 6 replies.
- Re: [PR] [SPARK-45431][DOCS] Document new SSL RPC feature [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2023/11/07 06:32:47 UTC, 5 replies.
- [PR] [WIP][SQL] Add a SQL config for extra traces in `Origin` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/11/07 06:51:12 UTC, 0 replies.
- Re: [PR] [SPARK-45816][SQL] Return `NULL` when overflowing during casting from timestamp to integers [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2023/11/07 06:51:49 UTC, 20 replies.
- Re: [PR] [SPARK-40559][PYTHON] Add applyInArrow to groupBy and cogroup [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2023/11/07 07:59:04 UTC, 10 replies.
- [PR] #SPARK-45817 [spark] - posted by "haohao0103 (via GitHub)" <gi...@apache.org> on 2023/11/07 08:10:26 UTC, 0 replies.
- [PR] [SPARK-44751][SQL] XML: Refactor TypeCast and timestampFormatter [spark] - posted by "sandip-db (via GitHub)" <gi...@apache.org> on 2023/11/07 08:27:12 UTC, 2 replies.
- Re: [PR] [SPARK-45509][SQL] Fix df column reference behavior for Spark Connect [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/07 08:34:54 UTC, 2 replies.
- [PR] [SPARK-45819][CORE] Support `clear` in REST Submission API [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/07 08:43:17 UTC, 5 replies.
- [PR] [SPARK-45509][SQL][3.5] Fix df column reference behavior for Spark Connect [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/07 08:55:48 UTC, 2 replies.
- Re: [PR] [SPARK-45629][CORE][SQL][CONNECT][ML][STREAMING][BUILD][EXAMPLES]Fix `Implicit definition should have explicit type` [spark] - posted by "laglangyue (via GitHub)" <gi...@apache.org> on 2023/11/07 09:44:55 UTC, 52 replies.
- [PR] [SPARK-45821][CONNECT]make SparkSession._apply_options throw exception [spark] - posted by "xieshuaihu (via GitHub)" <gi...@apache.org> on 2023/11/07 09:51:22 UTC, 3 replies.
- [PR] [SPARK-45822][CONNECT] SparkConnectSessionManager may look up a stopped sparkcontext [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/11/07 12:01:44 UTC, 5 replies.
- Re: [PR] [SPARK-45817]update hdfs deprecated api [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/07 12:02:24 UTC, 2 replies.
- [PR] [SPARK-45824][SQL] Enforce the error class in `ParseException` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/11/07 12:21:13 UTC, 3 replies.
- Re: [PR] [SPARK-39910][SQL] Delegate path qualification to filesystem during DataSource file path globbing [spark] - posted by "tigrulya-exe (via GitHub)" <gi...@apache.org> on 2023/11/07 12:52:33 UTC, 1 replies.
- Re: [PR] [SPARK-35564][SQL] Improve subexpression elimination [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/07 13:24:07 UTC, 16 replies.
- Re: [PR] [SPARK-45770][SQL][PYTHON][CONNECT] Introduce logical plan `UnresolvedDropColumns` for `Dataframe.drop` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/07 14:20:32 UTC, 13 replies.
- Re: [PR] [SPARK-44751][SQL][FOLLOW-UP] XML: Refactor TypeCast and timestampFormatter [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/07 17:33:46 UTC, 0 replies.
- [PR] [WIP][SQL] Expose stack trace by `DataFrameQueryContext` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/11/07 17:40:24 UTC, 0 replies.
- [PR] [SPARK-45811][PYTHON][DOCS][FOLLOW-UP] Remove an example Spark Connect does not support [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/07 19:23:41 UTC, 2 replies.
- [PR] [SPARK-45786][SQL][3.3] Fix inaccurate Decimal multiplication and division results [spark] - posted by "kazuyukitanimura (via GitHub)" <gi...@apache.org> on 2023/11/07 19:24:38 UTC, 4 replies.
- [PR] [SPARK-23015] Mitigate bug in Windows where starting multiple Spark instances within the same second causes a failure [spark] - posted by "Rafnel (via GitHub)" <gi...@apache.org> on 2023/11/07 21:46:17 UTC, 3 replies.
- [PR] Add Variant data type in Spark. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2023/11/07 22:47:58 UTC, 0 replies.
- Re: [PR] [SPARK-45555][PYTHON] Includes a debuggable object for failed assertion [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/08 00:30:38 UTC, 1 replies.
- [PR] [SPARK-45828][SQL] Remove deprecated method in dsl [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/08 01:37:05 UTC, 2 replies.
- Re: [PR] [SPARK-45814][CONNECT][SQL]Make ArrowConverters.createEmptyArrowBatch call close() to avoid memory leak [spark] - posted by "xieshuaihu (via GitHub)" <gi...@apache.org> on 2023/11/08 03:06:40 UTC, 7 replies.
- Re: [PR] [WIP][SPARK-44937][CORE] Add SSL/TLS support for RPC and Shuffle communications [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2023/11/08 03:21:36 UTC, 1 replies.
- [PR] [SPARK-45831][CORE][SQL] Use collection factory to create an immutable Java collection [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/08 03:44:32 UTC, 0 replies.
- [PR] [SPARK-45562][SQL] XML: Add SQL error class for missing rowTag option [spark] - posted by "sandip-db (via GitHub)" <gi...@apache.org> on 2023/11/08 04:03:08 UTC, 13 replies.
- Re: [PR] [SPARK-45831][CORE][SQL][DSTREAM] Use collection factory to create an immutable Java collection [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/08 04:55:48 UTC, 0 replies.
- Re: [PR] [SPARK-45794][SS] Introduce state metadata source to query the streaming state metadata information [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2023/11/08 04:56:08 UTC, 3 replies.
- [PR] [SPARK-45834][SQL] Fix Pearson correlation calculation more stable [spark] - posted by "liujiayi771 (via GitHub)" <gi...@apache.org> on 2023/11/08 05:53:27 UTC, 13 replies.
- [PR] [SPARK-45829][DOCS] Update the default value for spark.executor.logs.rolling.maxSize [spark] - posted by "chenyu-opensource (via GitHub)" <gi...@apache.org> on 2023/11/08 06:06:22 UTC, 6 replies.
- [PR] [WIP][SPARK-45832][SQL] Fix `Super method + is deprecated.` [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/08 06:59:38 UTC, 1 replies.
- [PR] SPARK-45836:Redundant parameter passing [spark] - posted by "haohao0103 (via GitHub)" <gi...@apache.org> on 2023/11/08 07:27:51 UTC, 2 replies.
- [PR] [SPARK-45836]: remove redundant parameter [spark] - posted by "haohao0103 (via GitHub)" <gi...@apache.org> on 2023/11/08 07:32:29 UTC, 0 replies.
- [PR] [SPARK-45835][INFRA] Make gitHub labeler more accurate and remove outdated comments [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/08 08:10:15 UTC, 8 replies.
- [PR] [SPARK-42821][SQL] Remove unused parameters in splitFiles methods [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/08 08:30:13 UTC, 2 replies.
- Re: [PR] [SPARK-43341][SQL] Patch StructType.toDDL not picking up on non-nullability of nested column [spark] - posted by "BramBoog (via GitHub)" <gi...@apache.org> on 2023/11/08 09:25:34 UTC, 0 replies.
- [PR] [WIP][SPARK-45825][SQL] Fix some scala compile warnings in package sql/catalyst [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/08 10:17:13 UTC, 0 replies.
- [PR] [MINOR][CORE][SQL] Clean up expired comments: `Note: this class supports Scala 2.13. A parallel source tree has a 2.12 implementation.` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/08 11:59:58 UTC, 5 replies.
- Re: [PR] [SPARK-45836][CORE][WEB UI]remove redundant parameter [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/08 12:05:08 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-45825][SQL] Fix some scala compile warnings in module sql/catalyst [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/08 12:11:19 UTC, 2 replies.
- [PR] [SPARK-45837][CONNECT][SCALA] Improve logging information in handling retries [spark] - posted by "cdkrot (via GitHub)" <gi...@apache.org> on 2023/11/08 12:50:57 UTC, 1 replies.
- Re: [PR] [SPARK-45841][SQL] Expose stack trace by `DataFrameQueryContext` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/11/08 12:51:22 UTC, 1 replies.
- [PR] [SPARK-45842] Refactor Catalog Function APIs to use analyzer [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2023/11/08 14:15:53 UTC, 4 replies.
- Re: [PR] [SPARK-45826][SQL] Add a SQL config for extra traces in `Origin` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/08 15:15:58 UTC, 6 replies.
- Re: [PR] [SPARK-45837][CONNECT] Improve logging information in handling retries [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/08 16:29:22 UTC, 3 replies.
- [PR] [SPARK-45843][CORE] Support `killAll` in REST Submission API [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/08 18:17:05 UTC, 0 replies.
- Re: [PR] [SPARK-45827] Add Variant data type in Spark. [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2023/11/08 18:21:27 UTC, 23 replies.
- Re: [PR] [SPARK-45843][CORE] Support `killall` in REST Submission API [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/08 19:22:38 UTC, 7 replies.
- [PR] [SPARK-45844] Implement case-insensitivity for XML [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2023/11/08 19:50:22 UTC, 10 replies.
- [PR] [SPARK-45845][SS][UI] Add number of evicted state rows to streaming UI [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2023/11/08 22:28:42 UTC, 7 replies.
- Re: [PR] [SPARK-45832][SQL] Fix `Super method + is deprecated.` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/09 01:54:35 UTC, 8 replies.
- Re: [PR] [SPARK-45842][SQL] Refactor Catalog Function APIs to use analyzer [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/09 02:22:48 UTC, 0 replies.
- Re: [PR] [SPARK-45831][CORE][SQL][DSTREAM] Use collection factory instead to create immutable Java collections [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/09 02:25:38 UTC, 5 replies.
- Re: [PR] [SPARK-45825][SQL] Fix some scala compile warnings in module sql/catalyst [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/09 03:14:04 UTC, 3 replies.
- [PR] fix typo & remove some unused code [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/09 03:30:27 UTC, 2 replies.
- Re: [PR] [SPARK-45825][SQL][CORE][GRAPHX] Fix some scala compile warnings in module sql/catalyst [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/09 03:33:05 UTC, 12 replies.
- Re: [PR] [SPARK-45830][CORE] Refactor `StorageUtils#bufferCleaner` to avoid directly using classes under the `sun` package [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/09 03:33:57 UTC, 4 replies.
- [PR] [SPARK-45847][SQL][TESTS] CliSuite flakiness due to non-sequential guarantee for stdout&stderr [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/11/09 03:50:27 UTC, 5 replies.
- Re: [PR] [SPARK-44307][SQL] Add Bloom filter for left outer join even if the left side table is smaller than broadcast threshold. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/09 06:05:09 UTC, 1 replies.
- [PR] [SPARK-45848] Make `spark-version-info.properties` generated by `spark-build-info.ps1` include `docroot` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/09 06:17:39 UTC, 1 replies.
- Re: [PR] [SPARK-45655][SQL][SS] Allow non-deterministic expressions inside AggregateFunctions in CollectMetrics [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/09 06:41:07 UTC, 6 replies.
- [PR] [WIP][SPARK-45752][SQL] Simplify the code for check unreferenced CTE relations [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/09 08:27:55 UTC, 5 replies.
- [PR] [SPARK-45814][CONNECT][SQL] Make ArrowConverters.createEmptyArrowBatch call close() to avoid memory leak [spark] - posted by "xieshuaihu (via GitHub)" <gi...@apache.org> on 2023/11/09 08:34:37 UTC, 1 replies.
- [PR] [SPARK-45282][SQL][3.4] Backport SPARK-45592 to 3.4 branch [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2023/11/09 08:39:43 UTC, 2 replies.
- Re: [PR] [SPARK-45278] [YARN] Allow configuring Yarn executor bind address in Yarn [spark] - posted by "tokoko (via GitHub)" <gi...@apache.org> on 2023/11/09 08:53:16 UTC, 1 replies.
- [PR] [INC-66906] supporting all languages and currency symbols [spark] - posted by "vontman (via GitHub)" <gi...@apache.org> on 2023/11/09 10:26:13 UTC, 1 replies.
- Re: [PR] [SPARK-45716][PYTHON][CONNECT] Add StructType.treeString to Python [spark] - posted by "khalidmammadov (via GitHub)" <gi...@apache.org> on 2023/11/09 11:24:55 UTC, 0 replies.
- [PR] [WIP][SQL] Enforce the error classes in sub-classes of `AnalysisException` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/11/09 11:53:16 UTC, 0 replies.
- [PR] [SPARK-45852][CONNECT][PYTHON] Gracefully deal with recursion error during logging [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2023/11/09 12:02:40 UTC, 6 replies.
- Re: [PR] [SPARK-45848][BUILD] Make `spark-version-info.properties` generated by `spark-build-info.ps1` include `docroot` [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2023/11/09 13:08:57 UTC, 3 replies.
- Re: [PR] [SPARK-45850][SQL] Attempt to stabilize `OracleIntegrationSuite ` by upgrading the oracle jdbc driver [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/09 13:44:33 UTC, 3 replies.
- [PR] [MINOR][CONNECT][TESTS] Use `Some(())` instead of `Some()` for `Option[Unit]` return type [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/09 14:09:40 UTC, 3 replies.
- [PR] [SPARK-45849][SQL]: Avoid uneccessary copy when encoding Set [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2023/11/09 15:33:28 UTC, 0 replies.
- [PR] [SPARK-45856] Move ArtifactManager from Spark Connect into SparkSession (sql/core) [spark] - posted by "vicennial (via GitHub)" <gi...@apache.org> on 2023/11/09 15:55:53 UTC, 10 replies.
- [PR] [WIP][Don't merge or review] Test new workflow [spark] - posted by "junyuc25 (via GitHub)" <gi...@apache.org> on 2023/11/09 16:58:42 UTC, 0 replies.
- [PR] [SPARK-45658][SQL][CATALYST] Fixing canonicalization of DynamicPrunin… [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2023/11/09 16:59:28 UTC, 0 replies.
- Re: [PR] [SPARK-45592][SPARK-45282][SQL][3.4] Correctness issue in AQE with InMemoryTableScanExec [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2023/11/09 17:35:14 UTC, 25 replies.
- Re: [PR] [SPARK-44609][KUBERNETES] Remove executor pod from PodsAllocator if it was removed from scheduler backend [spark] - posted by "alibiyeslambek (via GitHub)" <gi...@apache.org> on 2023/11/09 17:40:25 UTC, 0 replies.
- [PR] [MINOR][SQL] Pass `cause` in `CannotReplaceMissingTableException` costructor [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/11/09 18:47:57 UTC, 2 replies.
- [PR] [SPARK-45859][ML] Make UDF objects in ml.functions lazy [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/09 18:56:14 UTC, 9 replies.
- [PR] [SPARK-45867][CORE] Support `spark.worker.idPattern` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/09 20:51:56 UTC, 6 replies.
- [PR] [SPARK-45868][CONNECT] Make sure cccccbdbdjdgtbkunrcrulkicujueengvkgg`gucruhbispark.table use the same parser with vanilla spark [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/09 21:08:46 UTC, 0 replies.
- Re: [PR] [SPARK-45868][CONNECT] Make sure `spark.table` use the same parser with vanilla spark [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/09 21:10:29 UTC, 7 replies.
- Re: [PR] [SPARK-45746][Python] Return specific error messages if UDTF 'analyze' or 'eval' method accepts or returns wrong values [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2023/11/09 23:46:00 UTC, 17 replies.
- Re: [PR] [SPARK-44595][CONNECT] Make the user session cache number and cache time be configurable in spark connect service [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/10 00:17:53 UTC, 1 replies.
- Re: [PR] [SPARK-44179][CORE]Fix the number of executors is calculated incorrctly when the task fails and it is speculated that the task is still executing [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/10 00:17:55 UTC, 1 replies.
- Re: [PR] [SPARK-43905][CORE] Consolidate BlockId parsing and creation [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/10 00:17:58 UTC, 1 replies.
- [PR] [SPARK-45600][PYTHON] Make Python data source registration session level [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/11/10 00:34:00 UTC, 6 replies.
- [PR] [SPARK-45756][CORE] Support `spark.master.useAppNameAsAppId.enabled` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/10 01:32:28 UTC, 16 replies.
- Re: [PR] [SPARK-45814][CONNECT][SQL][3.4] Make ArrowConverters.createEmptyArrowBatch call close() to avoid memory leak [spark] - posted by "xieshuaihu (via GitHub)" <gi...@apache.org> on 2023/11/10 02:19:36 UTC, 2 replies.
- [PR] [SPARK-45870][INFRA] Upgrade action/checkout to v4 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/10 02:22:57 UTC, 2 replies.
- Re: [PR] [SPARK-45869][CORE] Support `spark.master.useAppNameAsAppId.enabled` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/10 02:35:37 UTC, 0 replies.
- Re: [PR] [SPARK-45850][BUILD] Upgrade oracle jdbc driver to 23.3.0.23.09 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/10 02:37:48 UTC, 2 replies.
- Re: [PR] [SPARK-45830][CORE] Refactor `StorageUtils#bufferCleaner` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/10 03:31:07 UTC, 4 replies.
- Re: [PR] [SPARK-43305] Add support for java 17 from spark 3.5.0 [spark-docker] - posted by "Yikun (via GitHub)" <gi...@apache.org> on 2023/11/10 03:36:58 UTC, 2 replies.
- [PR] [SPARK-45871][CONNECT] Change `.toBuffer.toSeq` to `.toSeq` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/10 04:52:10 UTC, 32 replies.
- Re: [PR] [SPARK-45687][CORE][SQL][ML][MLLIB][KUBERNETES][EXAMPLES][CONNECT][STRUCTURED STREAMING] Fix `Passing an explicit array value to a Scala varargs method is deprecated` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/10 05:34:32 UTC, 3 replies.
- [PR] [SPARK-45873][CORE][YARN][K8S] Make ExecutorFailureTracker more tolerant when app remains sufficient resources [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/11/10 06:20:17 UTC, 29 replies.
- [PR] [SPARK-45874][SQL] Remove Java version check from `IsolatedClientLoader` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/10 06:44:36 UTC, 2 replies.
- [PR] [SPARK-45875][CORE] Remove `MissingStageTableRowData` from `core` module [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/10 07:08:34 UTC, 2 replies.
- [PR] [SPARK-45878][SQL][TESTS] Fix ConcurrentModificationException in CliSuite [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/11/10 07:55:14 UTC, 6 replies.
- Re: [PR] [SPARK-45752][SQL] Simplify the code for check unreferenced CTE relations [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/10 07:56:27 UTC, 4 replies.
- [PR] [MINOR][DOCS] Fix the example value in the docs [spark] - posted by "jlfsdtc (via GitHub)" <gi...@apache.org> on 2023/11/10 08:40:19 UTC, 2 replies.
- Re: [PR] [SPARK-45827][SQL] Add Variant data type in Spark. [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/10 08:41:16 UTC, 27 replies.
- Re: [PR] [SPARK-45562][SQL][FOLLOW-UP] XML: Add SQL error class for missing rowTag option [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/10 08:45:48 UTC, 0 replies.
- [PR] [SPARK-45880][SQL] Introduce a new TableCatalog.listTable overload th… [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/10 09:04:24 UTC, 1 replies.
- [PR] [SPARK-45881][SQL] support Higher Order aggregate functions from SQL [spark] - posted by "steven-aerts (via GitHub)" <gi...@apache.org> on 2023/11/10 09:45:35 UTC, 0 replies.
- [PR] [SPARK-45882][SQL] BroadcastHashJoinExec propagate partitioning should respect CoalescedHashPartitioning [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2023/11/10 10:04:52 UTC, 10 replies.
- [PR] [SPARK-45883][BUILD] Upgrade ORC to 1.9.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/10 10:27:18 UTC, 2 replies.
- [PR] [SPARK-45884][BUILD][3.4] Upgrade ORC to 1.8.6 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/10 10:33:14 UTC, 2 replies.
- [PR] [SPARK-45885][BUILD][3.3] Upgrade ORC to 1.7.10 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/10 10:38:07 UTC, 2 replies.
- [PR] [SPARK-45851][CONNECT][SCALA] [DRAFT] Support multiple policies in scala client [spark] - posted by "cdkrot (via GitHub)" <gi...@apache.org> on 2023/11/10 10:46:40 UTC, 1 replies.
- [PR] [WIP][SQL] Output all stack traces in summary of DataFrame context [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/11/10 10:51:00 UTC, 0 replies.
- Re: [PR] [SPARK-45886][SQL] Output full stack trace in `callSite` of DataFrame context [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/11/10 11:06:42 UTC, 2 replies.
- [PR] [WIP][SQL] Align codegen and non-codegen implementation of `Encode` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/11/10 14:23:07 UTC, 0 replies.
- Re: [PR] [SPARK-45851][CONNECT][SCALA] Support multiple policies in scala client [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2023/11/10 14:24:51 UTC, 28 replies.
- Re: [PR] [SPARK-45887][SQL] Align codegen and non-codegen implementation of `Encode` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/11/10 14:26:43 UTC, 7 replies.
- [PR] SPARK-45592][SPARK-45282][SQL] Correctness issue in AQE with InMemoryTableScanExec [spark] - posted by "maryannxue (via GitHub)" <gi...@apache.org> on 2023/11/10 17:09:11 UTC, 0 replies.
- Re: [PR] [SPARK-45592][SPARK-45282][SQL] Correctness issue in AQE with InMemoryTableScanExec [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/10 18:09:43 UTC, 19 replies.
- [PR] [SPARK-45892] Refactor optimizer plan validation [spark] - posted by "xil-db (via GitHub)" <gi...@apache.org> on 2023/11/10 23:20:27 UTC, 0 replies.
- Re: [PR] [SPARK-40129][SQL] Fix Decimal multiply can produce the wrong answer [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/11 00:17:37 UTC, 4 replies.
- Re: [PR] [SPARK-42601][SQL] New physical type Decimal128 for DecimalType [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/11 00:17:39 UTC, 0 replies.
- [PR] Remove trailing slash from Conda cheat sheet URL in 'Using Conda' sec… [spark] - posted by "dead-1ine (via GitHub)" <gi...@apache.org> on 2023/11/11 06:59:34 UTC, 3 replies.
- [PR] [SPARK-43258][SQL] Assign names to error _LEGACY_ERROR_TEMP_202[3,4,5] [spark] - posted by "dengziming (via GitHub)" <gi...@apache.org> on 2023/11/11 07:47:59 UTC, 0 replies.
- [PR] SPARK-45522: [WIP] Jetty 9 -12 upgrade [spark] - posted by "HiuKwok (via GitHub)" <gi...@apache.org> on 2023/11/11 08:39:40 UTC, 2 replies.
- [PR] [SPARK-45893][HIVE] Support drop multiple partitions in batch for hive [spark] - posted by "wecharyu (via GitHub)" <gi...@apache.org> on 2023/11/11 14:22:24 UTC, 12 replies.
- [PR] test [spark] - posted by "justaparth (via GitHub)" <gi...@apache.org> on 2023/11/11 14:46:01 UTC, 0 replies.
- [PR] [SPARK-45894] hive table level setting hadoop.mapred.max.split.size [spark] - posted by "guixiaowen (via GitHub)" <gi...@apache.org> on 2023/11/11 15:03:53 UTC, 0 replies.
- Re: [PR] [SPARK-44659][SQL] Include keyGroupedPartitioning in StoragePartitionJoinParams equality check [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/12 00:19:51 UTC, 1 replies.
- Re: [PR] [SPARK-43100][CORE] Mismatch of field name in log event writer and parser for push shuffle metrics [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/12 00:19:53 UTC, 1 replies.
- Re: [PR] [SPARK-44514][SQL] Optimize join if maximum number of rows on one side is 1 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/12 00:19:55 UTC, 1 replies.
- Re: [PR] [SPARK-38230][SQL] InsertIntoHadoopFsRelationCommand unnecessarily fetches details of partitions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/12 00:19:56 UTC, 1 replies.
- Re: [PR] [SPARK-45871][CONNECT] Optimizations collection conversion related to `.toBuffer` in the `connect` modules [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/12 05:45:47 UTC, 4 replies.
- Re: [PR] [SPARK-45770][SQL][PYTHON][CONNECT] Introduce plan `DataFrameDropColumns` for `Dataframe.drop` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/12 09:30:24 UTC, 1 replies.
- [PR] [SPARK-44493][SQL] Translate catalyst expression into partial datasource filter [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2023/11/12 15:55:00 UTC, 9 replies.
- [PR] tests and fix [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2023/11/12 16:53:31 UTC, 0 replies.
- Re: [PR] [SPARK-45896][SQL] Construct `ValidateExternalType` with the correct expected type [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2023/11/12 17:04:02 UTC, 7 replies.
- [PR] [SPARK-45898] Rewrite catalog table APIs to use unresolved logical plan [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2023/11/12 19:43:34 UTC, 1 replies.
- [PR] [SPARK-45899] Set errorClass in errorInfoToThrowable [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2023/11/12 20:19:55 UTC, 1 replies.
- [PR] [SPARK-43427][Protobuf] spark protobuf: modify serde behavior of unsigned integer types [spark] - posted by "justaparth (via GitHub)" <gi...@apache.org> on 2023/11/12 22:21:46 UTC, 0 replies.
- Re: [PR] [SPARK-45857][SQL] Enforce the error classes in sub-classes of `AnalysisException` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/12 22:56:24 UTC, 0 replies.
- Re: [PR] [SPARK-44001][PROTOBUF] Add option to allow unwrapping protobuf well known wrapper types [spark] - posted by "justaparth (via GitHub)" <gi...@apache.org> on 2023/11/12 23:15:38 UTC, 4 replies.
- Re: [PR] [SPARK-43427][PROTOBUF] spark protobuf: allow upcasting unsigned integer types [spark] - posted by "justaparth (via GitHub)" <gi...@apache.org> on 2023/11/12 23:15:42 UTC, 6 replies.
- Re: [PR] [SPARK-45899][CONNECT] Set errorClass in errorInfoToThrowable [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/12 23:45:55 UTC, 1 replies.
- [PR] [SPARK-45901][DOCS] Collect and update `spark-standalone.md` with new confs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/13 00:00:20 UTC, 2 replies.
- Re: [PR] [SPARK-44203][SQL][HIVE] Return nextRenewalDate instead of None for obtainDelegationTokens method [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/13 00:18:44 UTC, 1 replies.
- Re: [PR] [SPARK-43301][CORE][SHUFFLE] BlockStoreClient getHostLocalDirs RPC supports IOException retry [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/13 00:18:46 UTC, 2 replies.
- Re: [PR] [SPARK-43025][SQL] Eliminate Union if filters have the same child plan [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/13 00:18:48 UTC, 0 replies.
- Re: [PR] [MINOR][DOCS] Remove trailing slash from Conda cheat sheet URL in 'Using Conda' section to fix 404 error [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/13 00:54:42 UTC, 3 replies.
- [PR] [SPARK-45896][SQL][3.4] Construct `ValidateExternalType` with the correct expected type [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2023/11/13 01:03:43 UTC, 2 replies.
- Re: [PR] [SPARK-37287][SQL] Pull out dynamic partition and bucket sort from FileFormatWriter [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/13 02:20:51 UTC, 0 replies.
- [PR] [SPARK-45770][SQL][PYTHON][CONNECT][3.5] Introduce plan DataFrameDropColumns for Dataframe.drop [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/13 02:23:27 UTC, 3 replies.
- [PR] use hadoop 3.3.5 for appveyor test [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/13 02:56:45 UTC, 2 replies.
- Re: [PR] [SPARK-45898][SQL] Rewrite catalog table APIs to use unresolved logical plan [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/13 03:09:40 UTC, 4 replies.
- [PR] [MINOR][PYTHON] Better error message when Python worker crushes [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/13 04:41:55 UTC, 6 replies.
- Re: [PR] [SPARK-45892][SQL] Refactor optimizer plan validation [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/13 06:35:28 UTC, 0 replies.
- [PR] [SPARK-45902][SQL] Remove unused function `resolvePartitionColumns` from `DataSource` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/13 07:01:03 UTC, 2 replies.
- [PR] [SPARK-45723][PYTHON][CONNECT][FOLLOWUP] Replace `toPandas` with `_to_table` in catalog methods [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/13 08:16:41 UTC, 2 replies.
- [PR] [SPARK-45905][SQL] Least common type between decimal types should retain integral digits first [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/13 08:31:54 UTC, 25 replies.
- [PR] [SPARK-45906][YARN] Fix error message extraction from ResourceNotFoundException [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2023/11/13 09:20:19 UTC, 3 replies.
- [PR] [SPARK-45907][CORE] Use ProcessHandle APIs to computeProcessTree in ProcfsMetricsGetter [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/11/13 10:20:28 UTC, 1 replies.
- [PR] [SPARK-45597][PYTHON][SQL] Support creating table using a Python data source in SQL [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/13 11:36:15 UTC, 14 replies.
- [PR] [SPARK-45909][SQL] Remove the cast if it can safely up-cast in `IsNotNull` [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2023/11/13 13:24:05 UTC, 0 replies.
- [PR] [SPARK-45904][SQL][CONNECT] Mode function should supports sort with order direction [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/13 13:48:09 UTC, 7 replies.
- [PR] Documenation: Clarify collect_list -> ArrayType [spark] - posted by "landlord-matt (via GitHub)" <gi...@apache.org> on 2023/11/13 15:35:55 UTC, 0 replies.
- Re: [PR] [SPARK-45909][SQL] Remove `NumericType` cast if it can safely up-cast in `IsNotNull` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/13 16:20:06 UTC, 4 replies.
- Re: [PR] [SPARK-45907][CORE] Use Java9+ ProcessHandle APIs to computeProcessTree in ProcfsMetricsGetter [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/11/13 16:54:02 UTC, 2 replies.
- Re: [PR] [SPARK-45892][SQL] Refactor optimizer plan validation to decouple `validateSchemaOutput` and `validateExprIdUniqueness` [spark] - posted by "xil-db (via GitHub)" <gi...@apache.org> on 2023/11/13 17:23:26 UTC, 5 replies.
- [PR] [SPARK-45747][SS] Use prefix key information in state metadata to handle reading state for session window aggregation [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2023/11/13 19:12:55 UTC, 9 replies.
- Re: [PR] [SPARK-39489][CORE] Improve event logging JsonProtocol performance by using Jackson instead of Json4s [spark] - posted by "msetodev (via GitHub)" <gi...@apache.org> on 2023/11/13 19:27:11 UTC, 5 replies.
- [PR] [SPARK-45912] Enhancement of XSDToSchema API: Change to HDFS API for cloud storage accessibility [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2023/11/13 23:36:49 UTC, 0 replies.
- [PR] [SPARK-45913][PYTHON] Make the internal attributes private from `PySparkException`. [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/14 00:30:44 UTC, 2 replies.
- Re: [PR] [SPARK-45913][PYTHON] Make the internal attributes private from PySpark errors. [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/14 00:44:14 UTC, 3 replies.
- [PR] [SPARK-45525][SQL][PYTHON] Initial support for Python data source write [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/11/14 00:51:27 UTC, 2 replies.
- [PR] [SPARK-45882][SQL][3.5] BroadcastHashJoinExec propagate partitioning should respect CoalescedHashPartitioning [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2023/11/14 01:41:56 UTC, 4 replies.
- [PR] [SPARK-45882][SQL][3.4] BroadcastHashJoinExec propagate partitioning should respect CoalescedHashPartitioning [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2023/11/14 01:54:56 UTC, 2 replies.
- [PR] [MINOR][DOCS] Correct additional Conda documentation URL to fix 404 errors [spark] - posted by "dead-1ine (via GitHub)" <gi...@apache.org> on 2023/11/14 02:23:31 UTC, 6 replies.
- Re: [PR] [SPARK-45844][SQL] Implement case-insensitivity for XML [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/14 04:55:26 UTC, 1 replies.
- [PR] [SPARK-43393][SQL] Address sequence expression overflow bug. [spark] - posted by "thepinetree (via GitHub)" <gi...@apache.org> on 2023/11/14 05:17:33 UTC, 16 replies.
- [PR] [SPARK-45918][PS] Optimize `MultiIndex.symmetric_difference` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/14 05:39:14 UTC, 3 replies.
- Re: [PR] [SPARK-45696][CORE] Fix method tryCompleteWith in trait Promise is deprecated [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/14 05:55:44 UTC, 5 replies.
- [PR] [SPARK-45919][CORE][SQL] Use `record` to simplify Java class definition [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/14 06:25:56 UTC, 2 replies.
- [PR] [SPARK-45920][SQL] group by ordinal should be idempotent [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/14 07:45:59 UTC, 13 replies.
- [PR] [Spark 45908][Python] [spark] - posted by "maintian (via GitHub)" <gi...@apache.org> on 2023/11/14 08:10:39 UTC, 0 replies.
- Re: [PR] [SPARK-45921][INFRA] Use Hadoop `3.3.5` winutils in AppVeyor build [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/14 08:43:51 UTC, 1 replies.
- [PR] [SPARK-45764][PYTHON][DOCS] Make code block copyable [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/14 09:16:41 UTC, 18 replies.
- Re: [PR] [MINOR] Fix some typo [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/14 10:59:46 UTC, 4 replies.
- [PR] [SPARK-45922][CONNECT][CLIENT] [spark] - posted by "cdkrot (via GitHub)" <gi...@apache.org> on 2023/11/14 12:52:05 UTC, 0 replies.
- [PR] [SPARK-38432][SQL][FOLLOWUP] Escape the quote and % for DS V2 pushdown [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/14 13:30:23 UTC, 0 replies.
- Re: [PR] [SPARK-45922][CONNECT][CLIENT] Minor retries refactoring (follow-up to multiple policies) [spark] - posted by "cdkrot (via GitHub)" <gi...@apache.org> on 2023/11/14 13:35:21 UTC, 11 replies.
- [PR] [SPARK-45844][SQL][FOLLOWUP] Improve the caseSensitivityOrdering for XmlInferSchema [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/14 14:10:54 UTC, 3 replies.
- Re: [PR] [SPARK-45350][CORE] Rename the imported `java.lang.Boolean` to JBoolean [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/14 17:08:11 UTC, 0 replies.
- [PR] [SPARK-45911][CORE] Make TLS1.3 the default for RPC SSL [spark] - posted by "hasnain-db (via GitHub)" <gi...@apache.org> on 2023/11/14 17:38:11 UTC, 5 replies.
- [PR] [SPARK-45562][SQL][FOLLOW-UP] XML: Fix SQLSTATE for missing rowTag error [spark] - posted by "sandip-db (via GitHub)" <gi...@apache.org> on 2023/11/14 18:25:26 UTC, 5 replies.
- [PR] [SPARK-44496][SQL][FOLLOW-UP] CalendarIntervalType is also orderable [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2023/11/14 19:59:28 UTC, 5 replies.
- [PR] Spark 45924: Fixing the canonicalization of SubqueryAdaptiveBroadcastExec and making it equivalent with SubqueryBroadcastExec [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2023/11/14 21:51:13 UTC, 0 replies.
- [PR] Spark 45925: Making SubqueryBroadcastExec equivalent to SubqueryAdaptiveBroadcastExec [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2023/11/14 22:20:59 UTC, 0 replies.
- [PR] SPARK-45926 : Implementing equals and hashCode which takes into account pushed runtime filters , in InMemoryTable related scans [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2023/11/14 22:51:43 UTC, 0 replies.
- [PR] [SPARK-45927][PYTHON] Update path handling in Python data source [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/11/14 23:02:26 UTC, 5 replies.
- Re: [PR] [SPARK-45926][SQL] Implementing equals and hashCode which takes into account pushed runtime filters , in InMemoryTable related scans [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/15 02:04:54 UTC, 5 replies.
- Re: [PR] [SPARK-45925][SQL] Making SubqueryBroadcastExec equivalent to SubqueryAdaptiveBroadcastExec [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/15 02:06:08 UTC, 4 replies.
- Re: [PR] [SPARK-45924][SQL] Fixing the canonicalization of SubqueryAdaptiveBroadcastExec and making it equivalent with SubqueryBroadcastExec [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/15 02:06:36 UTC, 14 replies.
- Re: [PR] [SPARK-45908][Python] Add support for writing empty DataFrames to parquet with partitions [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/15 02:11:57 UTC, 4 replies.
- Re: [PR] [SPARK-45912][SQL] Enhancement of XSDToSchema API: Change to HDFS API for cloud storage accessibility [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/15 02:23:03 UTC, 8 replies.
- [PR] [SPARK-45930][SQL] Support non-deterministic UDFs in MapInPandas/MapInArrow [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/11/15 04:10:37 UTC, 3 replies.
- [PR] [SPARK-45931][PYTHON][DOCS] Refine docstring of mapInPandas [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/11/15 04:23:00 UTC, 2 replies.
- Re: [PR] [SPARK-45919][CORE][SQL] Use Java 16 `record` to simplify Java class definition [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/15 07:18:10 UTC, 15 replies.
- Re: [PR] [WIP][SPARK-44098][INFRA] Introduce python breaking change detection [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/15 07:19:29 UTC, 0 replies.
- [PR] [SPARK-45915][SQL] Treat decimal(x, 0) the same as IntegralType in `PromoteStrings` [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2023/11/15 07:50:13 UTC, 5 replies.
- [PR] [SPARK-45898][SQL] Support groupingSets operation in dataframe api [spark] - posted by "JacobZheng0927 (via GitHub)" <gi...@apache.org> on 2023/11/15 08:25:06 UTC, 0 replies.
- Re: [PR] [MINOR][DOCS] Clarify collect_list -> ArrayType [spark] - posted by "landlord-matt (via GitHub)" <gi...@apache.org> on 2023/11/15 09:00:10 UTC, 0 replies.
- [PR] [SPARK-45934][DOCS] Fix `spark-standalone.md` and `running-on-kubernetes.md` table layout [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/15 10:37:07 UTC, 3 replies.
- [PR] [SPARK-45935][PYTHON][DOCS] Fix RST files link substitutions error [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/15 10:42:36 UTC, 4 replies.
- [PR] [SPARK-45936][PS] Optimize `Index.symmetric_difference` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/15 10:51:31 UTC, 2 replies.
- [PR] [SPARK-45562][CORE][DOCS] Regenerate `docs/sql-error-conditions.md` and update `SQLSTATE table` in `error/README.md` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/15 13:12:07 UTC, 0 replies.
- Re: [PR] [SPARK-45562][CORE][DOCS] Regenerate `docs/sql-error-conditions.md` and add `42KDF` to `SQLSTATE table` in `error/README.md` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/15 13:18:38 UTC, 0 replies.
- Re: [PR] [SPARK-45562][DOCS] Regenerate `docs/sql-error-conditions.md` and add `42KDF` to `SQLSTATE table` in `error/README.md` [spark] - posted by "sandip-db (via GitHub)" <gi...@apache.org> on 2023/11/15 14:21:33 UTC, 2 replies.
- [PR] [SPARK-45938][INFRA] Add `utils` to the dependency list of the `core` module in `module.py` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/15 15:16:35 UTC, 0 replies.
- Re: [PR] [SPARK-45938][INFRA] Add `utils` to the dependencies of the `core` module in `module.py` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/15 15:25:51 UTC, 2 replies.
- Re: [PR] [SPARK-45934][DOCS] Fix `Spark Standalone` documentation table layout [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/15 17:17:59 UTC, 16 replies.
- [PR] [SPARK-43393][SQL][3.4] Address sequence expression overflow bug. [spark] - posted by "thepinetree (via GitHub)" <gi...@apache.org> on 2023/11/15 18:10:21 UTC, 1 replies.
- [PR] [SPARK-43393][SQL][3.5] Address sequence expression overflow bug. [spark] - posted by "thepinetree (via GitHub)" <gi...@apache.org> on 2023/11/15 18:10:45 UTC, 2 replies.
- [PR] [SPARK-43393][SQL][3.3] Address sequence expression overflow bug. [spark] - posted by "thepinetree (via GitHub)" <gi...@apache.org> on 2023/11/15 18:11:12 UTC, 5 replies.
- [PR] [SPARK-45941][PS] Update `pandas` to version 2.1.3 [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2023/11/15 20:55:28 UTC, 0 replies.
- Re: [PR] [SPARK-45941][PS] Upgrade `pandas` to version 2.1.3 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/15 21:00:26 UTC, 7 replies.
- [PR] [SPARK-45942][Core] Only do the thread interruption check for putIterator on executors [spark] - posted by "huanliwang-db (via GitHub)" <gi...@apache.org> on 2023/11/15 21:30:37 UTC, 0 replies.
- [PR] [SARK-45866][SQL] Fix for Reuse of Exchange in AQE not happening when DPP filters are pushed down to the underlying Scan (like iceberg) [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2023/11/15 22:00:04 UTC, 3 replies.
- Re: [PR] [SPARK-45719][K8S][TESTS] Upgrade AWS SDK to v2 for Kubernetes IT [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/15 22:09:19 UTC, 1 replies.
- Re: [PR] [SPARK-44488][SQL] Support deserializing long types when creating `Metadata` object from JObject [spark] - posted by "scottsand-db (via GitHub)" <gi...@apache.org> on 2023/11/15 22:29:09 UTC, 1 replies.
- [PR] [SPARK-45827] Fix variant parquet reader. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2023/11/15 22:39:54 UTC, 3 replies.
- Re: [PR] [SPARK-44699][CORE] Add log when finished write events to file in EventLogFileWriter.closeWriter [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/16 00:18:38 UTC, 1 replies.
- Re: [PR] [SPARK-44685][SQL] Remove deprecated Catalog#createExternalTable [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/16 00:18:41 UTC, 4 replies.
- Re: [PR] [Spark Ticket][WIP]Added a warning to pop up in the case the user doesn't use gpus [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/16 00:18:43 UTC, 1 replies.
- Re: [PR] [SPARK-45938][INFRA] Add `utils` to the dependencies of the `core/unsafe/network_common` module in `module.py` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/16 03:02:45 UTC, 3 replies.
- Re: [PR] [SPARK-45506][CONNECT] Add ivy URI support to SparkConnect addArtifact [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/16 03:11:36 UTC, 2 replies.
- [PR] [SPARK-45945][CONNECT] Add a helper function for `parser` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/16 03:20:05 UTC, 2 replies.
- [PR] [SPARK-45764][PYTHON][DOCS][3.5] Make code block copyable [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/16 03:22:31 UTC, 3 replies.
- Re: [PR] [SPARK-45827][SQL] Fix variant parquet reader. [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/16 03:22:46 UTC, 1 replies.
- [PR] [SPARK-45764][PYTHON][DOCS][3.4] Make code block copyable [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/16 03:33:22 UTC, 2 replies.
- [PR] [WIP][INFRA] Test PyArrow 14 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/16 03:38:16 UTC, 1 replies.
- [PR] [SPARK-45764][PYTHON][DOCS][3.3] Make code block copyable [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/16 03:39:12 UTC, 3 replies.
- Re: [PR] [SPARK-45927][PYTHON] Update path handling for Python data source [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/16 05:17:38 UTC, 5 replies.
- [PR] [SPARK-45511] fix state reader suite flakiness by clean up resources after each test run [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2023/11/16 05:50:10 UTC, 0 replies.
- Re: [PR] [SPARK-45511] Fix state reader suite flakiness by clean up resources after each test run [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2023/11/16 05:53:03 UTC, 0 replies.
- [PR] [SPARK-45946] Fix use of deprecated FileUtils write to pass default charset in RocksDBSuite [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2023/11/16 06:48:28 UTC, 0 replies.
- Re: [PR] [SPARK-45946][SS] Fix use of deprecated FileUtils write to pass default charset in RocksDBSuite [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2023/11/16 06:50:02 UTC, 3 replies.
- [PR] [SPARK-45948][K8S] Make single-pod spark jobs respect `spark.app.id` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/16 07:36:07 UTC, 4 replies.
- Re: [PR] [SPARK-32246][BUILD][INFRA] Add new Github Action to run Kinesis tests [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/16 07:50:42 UTC, 13 replies.
- Re: [PR] [SPARK-45949][INFRA] Upgrade `pyarrow` to 14 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/16 07:58:11 UTC, 2 replies.
- Re: [PR] [SPARK-45511][SS] Fix state reader suite flakiness by clean up resources after each test run [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/16 08:03:13 UTC, 14 replies.
- [PR] [SPARK-45950][INFRA] Make `common-utils` module can run tests on GitHub Action [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/16 08:17:30 UTC, 2 replies.
- [PR] [SPARK-45951][INFRA] Upgrade `buf` to v1.28.1 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/16 08:32:46 UTC, 2 replies.
- Re: [PR] [SPARK-45929][SQL] Support groupingSets operation in dataframe api [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/16 09:02:44 UTC, 14 replies.
- [PR] [3.5][SPARK-45920][SQL] group by ordinal should be idempotent [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/16 09:03:49 UTC, 0 replies.
- [PR] [SPARK-45952][PYTHON][DOCS] Use built-in math constants in math functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/16 09:05:32 UTC, 2 replies.
- [PR] [3.4][SPARK-45920][SQL] group by ordinal should be idempotent [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/16 09:05:37 UTC, 0 replies.
- [PR] [3.3][SPARK-45920][SQL] group by ordinal should be idempotent [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/16 09:06:40 UTC, 0 replies.
- [PR] [SPARK-45953][INFRA] Add Python 3.10 to Infra docker image [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/16 09:15:04 UTC, 0 replies.
- Re: [PR] [SPARK-45950][INFRA][CORE] Fix `IvyTestUtils#createIvyDescriptor` function and make `common-utils` module can run tests on GitHub Action [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/16 09:50:10 UTC, 3 replies.
- Re: [PR] [MINOR][DOCS] Clarify collect_list and collect_set -> ArrayType [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/16 10:55:26 UTC, 2 replies.
- [PR] [SPARK-45954][SQL] Remove redundant shuffles [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2023/11/16 12:24:51 UTC, 2 replies.
- [PR] [SPARK-45955][UI] Collapse Support for Flamegraph and thread dump details [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/11/16 12:47:09 UTC, 6 replies.
- [PR] [SPARK-43980][SQL] introducing `select * except` syntax [spark] - posted by "milastdbx (via GitHub)" <gi...@apache.org> on 2023/11/16 15:43:32 UTC, 35 replies.
- Re: [PR] [SPARK-45920][SQL][3.5] group by ordinal should be idempotent [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/16 16:16:48 UTC, 0 replies.
- Re: [PR] [SPARK-45920][SQL][3.4] group by ordinal should be idempotent [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/16 16:19:07 UTC, 0 replies.
- Re: [PR] [SPARK-45920][SQL][3.3] group by ordinal should be idempotent [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/16 16:21:04 UTC, 0 replies.
- Re: [PR] [SPARK-45953][INFRA] Add `Python 3.10` to Infra docker image [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/16 17:30:31 UTC, 4 replies.
- [PR] [SPARK-45956][BUILD] Upgrade `Apache ZooKeeper` to 3.7.2 [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2023/11/16 18:40:17 UTC, 8 replies.
- [PR] [SPARK-45957][DO NOT MERGE] Hacky fix for SQL on streaming temp view [spark] - posted by "rangadi (via GitHub)" <gi...@apache.org> on 2023/11/16 19:04:51 UTC, 0 replies.
- Re: [PR] [SPARK-44924][SS] Add config for FileStreamSource cached files [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2023/11/16 19:30:54 UTC, 0 replies.
- [PR] [SPARK-45958][BUILD] Upgrade Arrow to 14.0.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/16 20:33:15 UTC, 4 replies.
- [PR] [SPARK-45960][INFRA] Add Python 3.10 to the Daily Python Github Action job [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/16 21:41:08 UTC, 5 replies.
- [PR] [SPARK-45961][DOCS] Document `spark.master.*` configurations [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/16 22:46:21 UTC, 2 replies.
- [PR] [SPARK-45961][DOCS][3.5] Document `spark.master.*` configurations [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/16 22:52:09 UTC, 2 replies.
- [PR] [SPARK-45961][DOCS][3.4] Document `spark.master.*` configurations [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/16 22:56:51 UTC, 2 replies.
- [PR] [SPARK-45957] [spark] - posted by "jdesjean (via GitHub)" <gi...@apache.org> on 2023/11/16 23:03:24 UTC, 0 replies.
- [PR] [SPARK-45962] Remove `treatEmptyValuesAsNulls` and use `nullValue` option instead in XML [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2023/11/16 23:26:55 UTC, 0 replies.
- [PR] [SPARK-45786][SQL][FOLLOWUP][TEST] Fix Decimal random number tests with ANSI enabled [spark] - posted by "kazuyukitanimura (via GitHub)" <gi...@apache.org> on 2023/11/16 23:50:53 UTC, 9 replies.
- [PR] [SPARK-45959][SQL]: Improving performance when addition of 1 column at a time causes increase in the LogicalPlan tree depth [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2023/11/16 23:53:58 UTC, 0 replies.
- [PR] [SPARK-45963][SQL][DOCS] Restore documentation for DSv2 API [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/16 23:56:37 UTC, 9 replies.
- Re: [PR] [SPARK-45954][SQL] Avoid generating redundant `ShuffleExchangeExec` node [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2023/11/17 00:06:57 UTC, 4 replies.
- Re: [PR] [SPARK-44704][CORE] Cleanup files from host node after migration due to graceful decommissioning [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/17 00:18:29 UTC, 1 replies.
- Re: [PR] [SPARK-44669][SQL][HIVE] Parquet/ORC files written using Hive Serde should has file extension [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/17 00:18:33 UTC, 1 replies.
- Re: [PR] [SPARK-40909][SQL] Reuse the broadcast exchange for bloom filter [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/17 00:18:36 UTC, 1 replies.
- [PR] [SPARK-45964][SQL] Remove private sql accessor in XML and JSON package under catalyst package [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/17 00:21:40 UTC, 2 replies.
- [PR] [MINOR][SQL] Remove unimplemented instances in XML Data Source [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/17 00:24:49 UTC, 6 replies.
- [PR] [SPARK-45965][SQL] Move DSv2 partitioning expressions into functions.partitioning [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/17 01:16:58 UTC, 16 replies.
- [PR] [SPARK-45967][BUILD] Upgrade jackson to 2.16.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/17 01:59:36 UTC, 6 replies.
- [PR] [SPARK-45966][DOCS][PS] Add missing methods for API reference. [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/17 02:20:43 UTC, 1 replies.
- [PR] [SPARK-45764][FOLLOWUP][PYTHON][DOCS] Remove upper bound for `sphinx-copybutton` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/17 02:30:23 UTC, 3 replies.
- Re: [PR] [SPARK-44021][SQL] Add spark.sql.files.maxPartitionNum [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2023/11/17 02:42:55 UTC, 1 replies.
- [PR] [SPARK-45968][INFRA] Upgrade github docker action to latest version [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/17 02:46:44 UTC, 2 replies.
- Re: [PR] [SPARK-45942][CORE] Only do the thread interruption check for putIterator on executors [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2023/11/17 03:03:32 UTC, 4 replies.
- [PR] [SPARK-45969][DOCS] Document configuration change of executor failure tracker [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2023/11/17 04:20:22 UTC, 10 replies.
- Re: [PR] [SPARK-45962][SQL] Remove `treatEmptyValuesAsNulls` and use `nullValue` option instead in XML [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/17 07:27:27 UTC, 0 replies.
- [PR] [SPARK-45971][CORE] Correct the package name of `SparkCollectionUtils` to `org.apache.spark.util` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/17 07:29:00 UTC, 0 replies.
- [PR] [SPARK-45963][SQL][DOCS][3.5] Restore documentation for DSv2 API [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/17 07:43:07 UTC, 2 replies.
- [PR] [SPARK-45963][SQL][DOCS][3.4] Restore documentation for DSv2 API [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/17 07:43:09 UTC, 3 replies.
- [PR] [SPARK-45943] Determine table stats for `ReplaceData.groupFilterCondition` [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2023/11/17 07:57:38 UTC, 0 replies.
- [PR] [WIP][INFRA] `apt-get` installation clean up [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/17 08:16:53 UTC, 0 replies.
- Re: [PR] [SPARK-37779][SQL] Make ColumnarToRowExec plan canonicalizable after (de)serialization [spark] - posted by "jiantao-vungle (via GitHub)" <gi...@apache.org> on 2023/11/17 08:58:41 UTC, 0 replies.
- Re: [PR] [SPARK-38432][SQL][FOLLOWUP] Escape the _ and % for DS V2 pushdown [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/17 09:50:47 UTC, 21 replies.
- [PR] [SPARK-45974] Add scan.filterAttributes non-empty judgment for RowLevelOperationRuntimeGroupFiltering [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2023/11/17 11:02:42 UTC, 0 replies.
- Re: [PR] [SPARK-45973][INFRA] re-org `apt-get` installations [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/17 11:36:51 UTC, 9 replies.
- [PR] [SPARK-45975] Reset storeAssignmentPolicy to original [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2023/11/17 15:10:25 UTC, 0 replies.
- Re: [PR] [SPARK-45943][SQL] Determine table stats for `ReplaceData.groupFilterCondition` [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2023/11/17 15:20:55 UTC, 26 replies.
- [PR] [MINOR][Docs] Clarify sort behaviour for structs [spark] - posted by "landlord-matt (via GitHub)" <gi...@apache.org> on 2023/11/17 15:54:49 UTC, 0 replies.
- [PR] [SPARK-45681][UI][FOLLOWUP] Check maybeErrorClass instead of maybeErrorClass.length [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/11/17 16:15:17 UTC, 1 replies.
- [PR] [MINOR][CORE] Rename scheduler ref for readability [spark] - posted by "shrinidhijoshi (via GitHub)" <gi...@apache.org> on 2023/11/17 16:18:34 UTC, 8 replies.
- [PR] try to fix ga scaladoc [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/17 16:57:41 UTC, 0 replies.
- [PR] [SPARK-45978][INFRA] Skip unidoc step in docker-integration-tests GitHub Action job [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/17 17:30:45 UTC, 0 replies.
- Re: [PR] [SPARK-45977][BUILD] Make sbt doc execute successfully [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/17 17:39:12 UTC, 5 replies.
- Re: [PR] [SPARK-45975][TESTS] Reset storeAssignmentPolicy to original [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/17 17:45:46 UTC, 2 replies.
- [PR] Raykim/iceberg/upgrade 142 [spark] - posted by "rayhondo (via GitHub)" <gi...@apache.org> on 2023/11/17 17:47:44 UTC, 1 replies.
- Re: [PR] [SPARK-45978][INFRA] Skip unidoc step in `docker-integration-tests` GitHub Action job [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/17 17:56:57 UTC, 5 replies.
- [PR] [SPARK-45979][INFRA] Add `Python 3.11` to Infra docker image [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/17 18:24:14 UTC, 3 replies.
- [PR] [SPARK-45980][INFRA] Add `Python 3.11` to the Daily Python Github Action job [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/17 20:39:55 UTC, 5 replies.
- Re: [PR] [SPARK-45971][CORE][SQL] Correct the package name of `SparkCollectionUtils` to `org.apache.spark.util` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/17 21:38:56 UTC, 2 replies.
- Re: [PR] [SPARK-45956][BUILD] Upgrade `Apache ZooKeeper` to 3.9.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/17 23:46:51 UTC, 1 replies.
- [PR] INFOSEC-1161 test for build [spark] - posted by "c3-KuanTingChen (via GitHub)" <gi...@apache.org> on 2023/11/18 00:35:48 UTC, 2 replies.
- [PR] [SPARK-44973][SQL] Fix ArrayIndexOutOfBoundsException in conv() [spark] - posted by "markj-db (via GitHub)" <gi...@apache.org> on 2023/11/18 00:37:35 UTC, 7 replies.
- [PR] [SPARK-45982][INFRA] re-org R package installations [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/18 01:50:25 UTC, 7 replies.
- Re: [PR] [SPARK-45974][SQL] Add scan.filterAttributes non-empty judgment for RowLevelOperationRuntimeGroupFiltering [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2023/11/18 06:37:58 UTC, 13 replies.
- Re: [PR] [SPARK-42399] [SQL] Support big numbers for conv function (get rid of overflow) [spark] - posted by "NarekDW (via GitHub)" <gi...@apache.org> on 2023/11/18 07:10:38 UTC, 0 replies.
- [PR] [SPARK-45983][PYTHON][DOCS] Refine docstring of `DataFrame.substract` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/18 07:29:07 UTC, 1 replies.
- [PR] [SPARK-45984][PYTHON[DOCS] Refine docstring of `DataFrame.intersectAll` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/18 07:32:27 UTC, 1 replies.
- [PR] [SPARK-45985][PYTHON][DOCS] Refine docstring of `DataFrame.intersect` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/18 07:43:07 UTC, 1 replies.
- Re: [PR] [SPARK-44279][BUILD] Upgrade `optionator` to ^0.9.3 [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2023/11/18 14:36:47 UTC, 2 replies.
- Re: [PR] [SPARK-45265][SQL][WIP] Supporting Hive 4.0 metastore [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/18 18:29:00 UTC, 2 replies.
- Re: [PR] [SPARK-44973][SQL] Fix `ArrayIndexOutOfBoundsException` in `conv()` [spark] - posted by "gerashegalov (via GitHub)" <gi...@apache.org> on 2023/11/18 20:43:49 UTC, 16 replies.
- [PR] [SPARK-45990][SPARK-45987][PYTHON][CONNECT] Upgrade `protobuf` to 4.25.1 to support `Python 3.11` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/18 23:31:36 UTC, 14 replies.
- Re: [PR] [SPARK-43603][PS][CONNECT][TEST] Reorganize ps.DataFrame unit tests [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/18 23:55:21 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-40909][SQL] Reuse the broadcast exchange for bloom filter [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/19 00:20:18 UTC, 1 replies.
- Re: [PR] [SPARK-44662] Perf improvement in BroadcastHashJoin queries with stream side join key on non partition columns [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/19 00:20:19 UTC, 1 replies.
- Re: [PR] [SPARK-42972][DSTREAM]ExecutorAllocationManager cannot allocate new instances when all executors down [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/19 00:20:20 UTC, 1 replies.
- [PR] [SPARK-45991][BUILD] Upgrade `protobuf-java` to 3.25.1 to match with `protobuf` 4.25 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/19 07:04:44 UTC, 0 replies.
- Re: [PR] [SPARK-45991][BUILD] Upgrade `protobuf-java` to 3.25.1 to match with `protobuf` 4.25.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/19 08:46:54 UTC, 2 replies.
- [PR] [SPARK-45965][DOCS][FOLLOW-UP] Document DSv2 partitioning expressions moved to functions.partitioning [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/19 09:28:32 UTC, 3 replies.
- [PR] [SPARK-45988][SPARK-45989][PYTHON] Fix typehints to handle `list` GenericAlias in Python 3.11+ [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/19 10:34:24 UTC, 6 replies.
- [PR] [SPARK-45992][BUILD] Switch from `fgrep` to `grep -F` [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2023/11/19 13:48:21 UTC, 3 replies.
- [PR] [WIP][Scala 2.13 Widening Compiler Warning] Fixing all compilation warnings related to widening conversions [spark] - posted by "hannahkamundson (via GitHub)" <gi...@apache.org> on 2023/11/19 18:12:34 UTC, 1 replies.
- [PR] [SPARK-45994][PYTHON] Change `description-file` to `description_file` [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2023/11/19 21:32:22 UTC, 4 replies.
- Re: [PR] [SPARK-44647][SQL] Support SPJ where join keys are less than cluster keys [spark] - posted by "irsath (via GitHub)" <gi...@apache.org> on 2023/11/19 22:55:59 UTC, 2 replies.
- Re: [PR] [SPARK-45417][PYTHON] Make InheritableThread inherit the active session [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/19 23:37:44 UTC, 3 replies.
- [PR] [SPARK-45986][ML][PYTHON] Fix `pyspark.ml.torch.tests.test_distributor` in Python 3.11 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/20 00:15:19 UTC, 3 replies.
- Re: [PR] [DO NOT MERGE] Avro connector: convert a union of a single type to a StructType instead of a simple type [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/20 00:19:14 UTC, 1 replies.
- Re: [PR] [SPARK-44758][K8S] Support memory limits configurable [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/20 00:19:15 UTC, 1 replies.
- Re: [PR] [SPARK-35148][SQL] Support traversal pruning in transformUpWithNewOutput [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/20 00:19:19 UTC, 1 replies.
- [PR] [SPARK-45995][R][INFRA] Upgrade R version from 4.3.1 to 4.3.2 in AppVeyor [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/20 00:25:12 UTC, 2 replies.
- [PR] [SPARK-45996][PYTHON][CONNECT] Show proper dependency requirement messages for Spark Connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/20 01:32:13 UTC, 4 replies.
- Re: [PR] [MINOR][DOCS] Clarify sort behaviour for structs [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/20 01:40:35 UTC, 4 replies.
- [PR] [SPARK-34503][CORE][TESTS] Fix EventLogFileWritersSuite typo [spark] - posted by "surjikal (via GitHub)" <gi...@apache.org> on 2023/11/20 02:03:42 UTC, 1 replies.
- [PR] [SPARK-45997][PS][CONNECT][DOCS] Remove deprecated APIs from legacy Koalas [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/20 02:04:33 UTC, 0 replies.
- [PR] [SPARK-45861][PYTHON][DOCS] Add user guide for dataframe creation [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/20 03:09:14 UTC, 30 replies.
- [PR] [SPARK-45764][FOLLOWUP][BUILD] Use latest `sphinx-copybutton` from CI [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/20 03:15:10 UTC, 9 replies.
- [PR] [WIP][SPARK-45998][CORE][SQL] Remove redundant type cast [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/20 03:24:20 UTC, 0 replies.
- Re: [PR] [MINOR][CORE][TESTS] Fix EventLogFileWritersSuite typo [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/20 03:26:20 UTC, 5 replies.
- [PR] [SPARK-45682][CORE][FOLLOW-UP] Restore console progress bar in Spark shells [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/20 03:52:52 UTC, 4 replies.
- Re: [PR] [SPARK-45997][PS][PYTHON][CONNECT][DOCS] Remove deprecated APIs from legacy Koalas [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/20 04:50:16 UTC, 1 replies.
- [PR] [SPARK-45999][PS] Use dedicated `PandasProduct` in `cumprod` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/20 05:12:12 UTC, 2 replies.
- [PR] [SPARK-46002][INFRA] Upgrade to Python 3.10 in SQL test [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/20 06:18:50 UTC, 2 replies.
- [PR] [WIP][SPARK-46003][UI][TESTS] Create an ui-test module with Jest to test ui javascript code [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/11/20 06:32:16 UTC, 1 replies.
- [PR] [SPARK-45973][SPARK-45982][INFRA][FOLLOWUPS] Restore apt-get/r installations for branch-3.3/3.4/3.5 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/20 06:52:47 UTC, 7 replies.
- Re: [PR] [SPARK-32846][SQL][PYTHON] Support createDataFrame from an RDD of pd.DataFrames [spark] - posted by "samkumar (via GitHub)" <gi...@apache.org> on 2023/11/20 08:09:14 UTC, 5 replies.
- [PR] [SPARK-46005][INFRA] Upgrade `scikit-learn` to 1.3.2 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/20 09:14:04 UTC, 0 replies.
- [PR] [SPARK-46006][YARN] YarnAllocator miss clean targetNumExecutorsPerResourceProfileId after YarnSchedulerBackend call stop [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2023/11/20 10:03:13 UTC, 11 replies.
- Re: [PR] [SPARK-46003][UI][TESTS] Create an ui-test module with Jest to test ui javascript code [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2023/11/20 10:04:51 UTC, 7 replies.
- [PR] [SPARK-46004][PYTHON][DOCS] Refine docstring of `DataFrame.dropna/fillna/replace` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/20 10:51:08 UTC, 2 replies.
- [PR] upgrade maven plugin to latest version [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/20 11:00:46 UTC, 0 replies.
- [PR] [SPARK-46007][TEST] Add `AmmoniteTest` and mark `ReplE2ESuite` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/20 11:24:37 UTC, 0 replies.
- Re: [PR] [SPARK-46007][TEST] Add `AmmoniteTest` test tag and mark `ReplE2ESuite` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/20 11:35:20 UTC, 4 replies.
- [PR] [SPARK-46009][SQL][CONNECT] Merge the parse rule of PercentileCont and PercentileDisc into functionCall [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/20 12:12:33 UTC, 26 replies.
- Re: [PR] [SPARK-46002][INFRA] Upgrade to Python 3.9 in SQL test [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/20 12:19:34 UTC, 2 replies.
- Re: [PR] [SPARK-46005][INFRA] Upgrade `scikit-learn` to 1.3.2 and `mlflow` to 2.8.1 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/20 12:21:14 UTC, 1 replies.
- Re: [PR] [SPARK-45699][BUILD][SQL][CORE][MLLIB][STREAMING][GRAPHX] Fixing all compilation warnings related to widening conversions [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/20 12:40:01 UTC, 40 replies.
- Re: [PR] [SPARK-45642][CORE][SQL] Fix `FileSystem.isFile & FileSystem.isDirectory is deprecated` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/20 13:03:32 UTC, 2 replies.
- [PR] [SPARK-45827][SQL] Use StructNullableTypeConverter for Variant [spark] - posted by "cashmand (via GitHub)" <gi...@apache.org> on 2023/11/20 16:20:05 UTC, 2 replies.
- [PR] [SPARK-46010][BUILD] Upgrade `Node.js` to 18.X [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2023/11/20 17:43:37 UTC, 4 replies.
- [PR] [WIP][SPARK-46011][CONNECT] Session heartbeat/keepalive using ExtendSession RPC [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2023/11/20 18:09:18 UTC, 2 replies.
- [PR] [SPARK-46012][CORE] EventLogFileReader should not read rolling logs if appStatus is missing [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/20 21:02:20 UTC, 0 replies.
- Re: [PR] [SPARK-45957] Fix SQL commands on streaming temp view [spark] - posted by "rangadi (via GitHub)" <gi...@apache.org> on 2023/11/20 22:59:30 UTC, 5 replies.
- Re: [PR] [SPARK-45998][CORE][SQL][PYTHON][PROTOBUF] Cleanup redundant type cast [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/20 23:03:06 UTC, 1 replies.
- Re: [PR] [SPARK-46012][CORE] EventLogFileReader should not read rolling logs if app status file is missing [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/20 23:19:09 UTC, 9 replies.
- [PR] Bump org.apache.derby:derby from 10.14.2.0 to 10.17.1.0 [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2023/11/20 23:31:01 UTC, 3 replies.
- Re: [PR] [WIP][SPARK-44781][SQL] Runtime filter should supports reuse exchange if it can reduce the data size of application side [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/21 00:19:01 UTC, 1 replies.
- Re: [PR] [SPARK-44767] Plugin API for PySpark and SparkR workers [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/21 00:19:03 UTC, 2 replies.
- [PR] [SPARK-46014][SQL][TESTS] Run `RocksDBStateStoreStreamingAggregationSuite` on a dedicate JVM [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/21 00:21:40 UTC, 0 replies.
- [PR] [SPARK-46013][PYTHON][SQL][DOCS] Improve data source load and save functions docs page [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/11/21 00:23:35 UTC, 3 replies.
- Re: [PR] [SPARK-46014][SQL][TESTS] Run `RocksDBStateStoreStreamingAggregationSuite` on a dedicated JVM [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/21 00:32:06 UTC, 5 replies.
- [PR] [SPARK-46015][DOCS][PS] Fix broken link for Koalas issues [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/21 01:16:20 UTC, 4 replies.
- [PR] [MINOR][DOCS] Correct Python Spark Connect documentation about pip installation [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/21 02:19:21 UTC, 1 replies.
- Re: [PR] [SPARK-46015][DOCS][PS] Remove broken link for Koalas issues [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/21 02:21:42 UTC, 1 replies.
- [PR] [SPARK-45833][SS][DOCS] Document the new introduction of state data source [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2023/11/21 03:35:12 UTC, 31 replies.
- [PR] [SPARK-46019][SQL][TESTS] Fix when `HiveThriftServer2ListenerSuite` and `ThriftServerPageSuite` failed to run locally [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/21 03:38:13 UTC, 1 replies.
- [PR] [SPARK-46020][INFRA] Add `Python 3.12` to Infra docker image [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/21 04:04:41 UTC, 4 replies.
- [PR] [MINOR][BUILD] Rename gprcVersion to grpcVersion in SparkBuild [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/21 05:39:23 UTC, 3 replies.
- Re: [PR] [SPARK-46019][SQL][TESTS] Fix `HiveThriftServer2ListenerSuite` and `ThriftServerPageSuite` failed when there are running on local [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/21 06:14:33 UTC, 6 replies.
- [PR] upgrade rocksdbjni 20231121 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/21 06:18:16 UTC, 0 replies.
- Re: [PR] [Don't merge & review] Upgrade rocksdbjni 20231121 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/21 06:20:08 UTC, 5 replies.
- [PR] [SPARK-46023][PYTHON][DOCS] Annotate parameters at docstrings in pyspark.sql module [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/21 06:27:05 UTC, 5 replies.
- [PR] [SPARK-46021] Support cancel future jobs belonging to a job group [spark] - posted by "anchovYu (via GitHub)" <gi...@apache.org> on 2023/11/21 06:44:44 UTC, 0 replies.
- [PR] [SPARK-46024][PYTHON][DOCS] Document parameters and examples for RuntimeConf get, set and unset [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/21 06:50:19 UTC, 2 replies.
- [PR] [SPARK-46026][PYTHON][DOCS] Refine docstring of UDTF [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/21 07:06:21 UTC, 6 replies.
- [PR] [SPARK-46027][INFRA] Add Python 3.12 to the Daily Python Github Action job [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/21 07:13:03 UTC, 3 replies.
- Re: [PR] [SPARK-46021][CORE] Support cancel future jobs belonging to a job group [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2023/11/21 07:42:44 UTC, 25 replies.
- Re: [PR] [SPARK-45649][SQL] Unify the prepare framework for `OffsetWindowFunctionFrame` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/21 07:56:21 UTC, 1 replies.
- [PR] [SPARK-46028][CONNECT][PYTHON] Make `Column.__getitem__` accept input column [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/21 07:59:01 UTC, 1 replies.
- Re: [PR] [SPARK-46029][SQL] Escape the single quote, `_` and `%` for DS V2 pushdown [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/21 08:13:52 UTC, 17 replies.
- [PR] [SPARK-46031][SQL] Replace `!Optional.isPresent()` with `Optional.isEmpty()` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/21 08:39:38 UTC, 2 replies.
- Re: [PR] An automatic caching solution for Spark [spark] - posted by "lival (via GitHub)" <gi...@apache.org> on 2023/11/21 09:44:56 UTC, 0 replies.
- [PR] [SPARK-46022][SPARK-46017][DOCS][PYTHON] Remove deprecated function APIs from documents [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/21 10:02:59 UTC, 5 replies.
- [PR] [SPARK-46027][INFRA][FOLLOWUP] Fix a typo [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/21 11:22:42 UTC, 3 replies.
- [PR] [SPARK-46033][SQL][TESTS] Fix flaky ArithmeticExpressionSuite [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/21 11:31:32 UTC, 6 replies.
- [PR] [SPARK-46034][BUG] SparkContext add file should also copy file to local root path [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2023/11/21 12:32:35 UTC, 3 replies.
- [PR] [SPARK-46035][BUILD] Upgrade zstd-jni to 1.5.5-9 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/21 12:35:18 UTC, 1 replies.
- Re: [PR] [SPARK-46035][BUILD] Upgrade zstd-jni to 1.5.5-10 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/21 13:06:48 UTC, 7 replies.
- [PR] [SPARK-46037][SQL] When Left Join build Left and codegen is turned off, ShuffledHashJoinExec may result in incorrect results [spark] - posted by "mcdull-zhang (via GitHub)" <gi...@apache.org> on 2023/11/21 13:59:00 UTC, 14 replies.
- [PR] [SPARK-23607][CORE] Use HDFS extended attributes to store application summary information in SHS [spark] - posted by "thejdeep (via GitHub)" <gi...@apache.org> on 2023/11/21 16:17:07 UTC, 1 replies.
- [PR] [SPARK-46038][BUILD] Upgrade log4j2 to 2.22.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/21 16:30:37 UTC, 4 replies.
- Re: [PR] [SPARK-45656][SQL] Fix observation when named observations with the same name on different datasets [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2023/11/21 16:43:42 UTC, 9 replies.
- [PR] [WIP][Spark 38473] use error classes in org.apache.spark.scheduler [spark] - posted by "asmitalim (via GitHub)" <gi...@apache.org> on 2023/11/21 17:37:10 UTC, 1 replies.
- Re: [PR] [SPARK-46019][SQL][TESTS] Fix `HiveThriftServer2ListenerSuite` and `ThriftServerPageSuite` to create `java.io.tmpdir` if it doesn't exist [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/21 18:26:46 UTC, 1 replies.
- [PR] [SPARK-46039][BUILD][CONNECT] Upgrade `grpcio*` to 1.59.3 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/21 18:35:07 UTC, 0 replies.
- Re: [PR] [SPARK-46039][BUILD][CONNECT] Upgrade `grpcio*` to 1.59.3 for Python 3.12 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/21 18:42:57 UTC, 11 replies.
- [PR] [MINOR][TEST] Relax `excludedTpcdsQueries` scope in `TPCDSBase` [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2023/11/21 19:37:42 UTC, 5 replies.
- Re: [PR] [CONNECT][SPARK-45957] Avoid generating execution plan for non-executable commands [spark] - posted by "rangadi (via GitHub)" <gi...@apache.org> on 2023/11/21 19:55:17 UTC, 5 replies.
- [PR] [SPARK-46012][CORE][FOLLOWUP] Invoke fs.listStatus once and reuse the result [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/21 21:17:34 UTC, 0 replies.
- Re: [PR] [SPARK-46012][CORE][FOLLOWUP] Invoke `fs.listStatus` once and reuse the result [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/21 21:22:20 UTC, 5 replies.
- [PR] [SPARK-45511][SS][FOLLOWUP] fix comment in StateDataSourceReadSuite [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2023/11/21 23:11:14 UTC, 3 replies.
- [PR] [SPARK-46040][SQL][Python] Update UDTF API for 'analyze' partitioning/ordering columns to support general expressions [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2023/11/22 00:32:00 UTC, 9 replies.
- Re: [PR] [SPARK-23015][WINDOWS] Mitigate bug in Windows where starting multiple Spark instances within the same second causes a failure [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/22 00:59:59 UTC, 2 replies.
- [PR] [SPARK-46044][PYTHON][TESTS] Improve test coverage of udf.py [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2023/11/22 01:40:32 UTC, 0 replies.
- [PR] [SPARK-46045][DOCS][PS] Add individual categories for `Options and settings` to API reference [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/22 02:16:54 UTC, 2 replies.
- Re: [PR] [SPARK-46034][CORE] SparkContext add file should also copy file to local root path [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2023/11/22 02:24:52 UTC, 23 replies.
- [PR] [SPARK-46043][SQL] Support create table using DSv2 sources [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/11/22 03:42:16 UTC, 16 replies.
- [PR] [SPARK-46047][BUILD] Remove the compilation suppression rule related to the Scala 2.13 deprecated APIs usage [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/22 04:15:28 UTC, 4 replies.
- [PR] [SPARK-46048][PYTHON][SQL] Support DataFrame.groupingSets in PySpark [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/22 05:04:36 UTC, 3 replies.
- Re: [PR] [SPARK-46047][BUILD][SQL] Fix the usage of Scala 2.13 deprecated APIs and make the usage of Scala 2.13 deprecated APIs as compilation error [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/22 07:23:19 UTC, 2 replies.
- [PR] [SPARK-46050][SQL]: Allow additional rules for the Substitution batch [spark] - posted by "nastra (via GitHub)" <gi...@apache.org> on 2023/11/22 07:35:58 UTC, 1 replies.
- [PR] [SPARK-46051][INFRA] Cache python deps for linter and documentation [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/22 07:59:17 UTC, 4 replies.
- [PR] [SPARK-46052][CORE] Remove function TaskScheduler.killAllTaskAttempts [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2023/11/22 08:39:37 UTC, 39 replies.
- [PR] [SPARK-46042][CONNECT] Reenable a `releaseSession` test case in SparkConnectServiceE2ESuite [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/22 08:54:43 UTC, 13 replies.
- [PR] [TYPO] make param name more clear [spark] - posted by "YannByron (via GitHub)" <gi...@apache.org> on 2023/11/22 08:55:04 UTC, 0 replies.
- [PR] [SPARK-46053][TESTS] Support `DEDICATED_JVM_SBT_TESTS` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/22 09:16:39 UTC, 4 replies.
- [PR] [SPARK-45649][SQL] Unify the prepare framework for OffsetWindowFunctionFrame [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/22 11:59:47 UTC, 9 replies.
- Re: [PR] [WIP][SPARK-46051][INFRA] Cache python deps for linter and documentation [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/22 12:32:20 UTC, 0 replies.
- Re: [PR] [SPARK-45380][CORE][SQL][ML][R][CONNECT] Replace `mutable.WrappedArray` with `mutable.ArraySeq` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/22 13:03:09 UTC, 7 replies.
- [PR] [SPARK-46055][SQL] Refactor Catalog Database APIs implementation [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2023/11/22 16:10:07 UTC, 12 replies.
- [PR] [WIP][SPARK-XXX][SQL] Fix Parquet with wide Decimal default values [spark] - posted by "cosmind-db (via GitHub)" <gi...@apache.org> on 2023/11/22 16:39:46 UTC, 0 replies.
- [PR] [SPIP-IN-PROGRESS][DO-NO-MERGE][SS] Add base support for new arbitrary state management operator, single valueState type, multiple state variables and underlying support for column families for RocksDBStateStoreProvider [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2023/11/22 19:35:23 UTC, 0 replies.
- [PR] [SPARK-46042][FOLLOWUP][CONNECT] Test and adapt to streaming RPC behavior change from grpc 1.56 to 1.59 [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2023/11/22 20:07:31 UTC, 13 replies.
- [PR] Upgrade jdbc driver [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/22 23:36:52 UTC, 0 replies.
- Re: [PR] [SPARK-44777][CORE] Eager checkpointing on RDDs [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/23 00:18:41 UTC, 1 replies.
- Re: [PR] [SPARK-44654][SQL]Optimize InSubquery Partition pruning [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/23 00:18:43 UTC, 1 replies.
- [PR] [SPARK-46059][INFRA][PYTHON] Install `six==1.16.0` explicitly for Python 3.12 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/23 00:52:37 UTC, 0 replies.
- [PR] [SPARK-46061][PYTHON][TESTS] Add the test party for reattach test case [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/23 01:25:44 UTC, 12 replies.
- Re: [PR] [SPARK-46059][INFRA][PYTHON] Install `six==1.16.0` explicitly for `pandas` in Python 3.12 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/23 01:29:59 UTC, 5 replies.
- [PR] [SPARK-46062][SQL] Sync the isStreaming flag between CTE definition and reference [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2023/11/23 04:26:41 UTC, 8 replies.
- [PR] [SPARK-46048][PYTHON][CONNECT] Support DataFrame.groupingSets in Python Spark Connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/23 04:36:06 UTC, 3 replies.
- [PR] [SPARK-46063][PYTHON][CONNECT] Improve error messages related to argument types in cute, rollup, groupby, and pivot [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/23 04:39:19 UTC, 3 replies.
- [PR] Remove scala-2.13 profile for Scalafmt in lint-scala script [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/23 04:43:37 UTC, 0 replies.
- Re: [PR] [MINOR][BUILD] Remove scala-2.13 profile for Scalafmt in lint-scala script [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/23 05:34:38 UTC, 1 replies.
- [PR] [SPARK-46065][PS] Refactor `(DataFrame|Series).factorize()` to use `create_map`. [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/23 06:08:24 UTC, 2 replies.
- [PR] [SPARK-46064][SS] Move out EliminateEventTimeWatermark to the analyzer and change to only take effect on resolved child [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2023/11/23 06:15:33 UTC, 0 replies.
- Re: [PR] [SPARK-46064][SQL][SS] Move out EliminateEventTimeWatermark to the analyzer and change to only take effect on resolved child [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2023/11/23 06:16:22 UTC, 6 replies.
- [PR] [SPARK-45862][PYTHON][DOCS] Add user guide for basic dataframe operations [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/23 06:52:27 UTC, 4 replies.
- [PR] [SPARK-46066][SQL] Use the Separators API instead of the String API to construct the `DefaultPrettyPrinter` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/23 06:59:15 UTC, 7 replies.
- Re: [PR] [SPARK-46060][BUILD][TESTS] Upgrade jdbc related test dependencies [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/23 07:21:37 UTC, 0 replies.
- [PR] [SPARK-46067][BUILD] Upgrade commons-compress to 1.25.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/23 07:35:47 UTC, 3 replies.
- [PR] [SPARK-46002][INFRA][FOLLOWUP] Upgrade to Python 3.9 in daily maven test [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/23 07:53:07 UTC, 6 replies.
- [PR] [SPARK-46070][SQL] Compile regex pattern in SparkDateTimeUtils.getZoneId outside the hot loop [spark] - posted by "tanelk (via GitHub)" <gi...@apache.org> on 2023/11/23 10:19:38 UTC, 3 replies.
- [PR] [MINOR][CORE] Move `TransportConfSuite.java` to correct directory [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/23 11:57:47 UTC, 0 replies.
- Re: [PR] [SPARK-30385][WEBUI] WebUI occasionally throw IOException on stop() [spark] - posted by "joelgarciacervera (via GitHub)" <gi...@apache.org> on 2023/11/23 12:05:31 UTC, 0 replies.
- [PR] [SPARK-45760][SQL][FOLLOWUP] Inline With inside conditional branches [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/23 12:22:04 UTC, 22 replies.
- Re: [PR] [SPARK-46055][SQL] Refactor Catalog Database APIs implementation to use DescribeNamespace [spark] - posted by "heyihong (via GitHub)" <gi...@apache.org> on 2023/11/23 13:34:27 UTC, 2 replies.
- [PR] [SPARK-46071][SQL] Optimize CaseWhen toJSON content [spark] - posted by "JacobZheng0927 (via GitHub)" <gi...@apache.org> on 2023/11/23 13:48:50 UTC, 0 replies.
- [PR] [SPARK-46073][SQL] Remove the special resolution of UnresolvedNamespace for certain commands [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/23 14:35:50 UTC, 3 replies.
- [PR] [MINOR][DOCS] Add official documentation on the natural order of structs. Second proposal. [spark] - posted by "landlord-matt (via GitHub)" <gi...@apache.org> on 2023/11/23 14:39:50 UTC, 0 replies.
- [PR] [SPARK-46069][SQL] Support unwrap timestamp type to date type [spark] - posted by "wankunde (via GitHub)" <gi...@apache.org> on 2023/11/23 15:25:22 UTC, 11 replies.
- [PR] [SPARK-46074][CONNECT][SCALA] Insufficient details in error message on UDF failure [spark] - posted by "nija-at (via GitHub)" <gi...@apache.org> on 2023/11/23 16:57:56 UTC, 5 replies.
- [PR] [SPARK-45827] Variant fixes with codegen and vectorized reader disabled [spark] - posted by "cashmand (via GitHub)" <gi...@apache.org> on 2023/11/23 18:11:53 UTC, 0 replies.
- [PR] [SPARK-46075] Improvements to SparkConnectSessionManager [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2023/11/23 20:04:18 UTC, 2 replies.
- Re: [PR] [MINOR][CORE][TESTS] Move `TransportConfSuite.java` to correct directory [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/23 20:18:41 UTC, 2 replies.
- [PR] [SPARK-46076][PYTHON][TESTS] Remove `unittest` alias usage for Python 3.12 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/23 20:50:25 UTC, 1 replies.
- [PR] [MINOR][SS] Relax access constraints on fields of FileStreamSink so the class is extendable, split long method [spark] - posted by "woj-i (via GitHub)" <gi...@apache.org> on 2023/11/23 21:30:38 UTC, 0 replies.
- Re: [PR] [SPARK-46076][PYTHON][TESTS] Remove `unittest` deprecated alias usage for Python 3.12 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/23 23:17:27 UTC, 3 replies.
- Re: [PR] [SPARK-45827][SQL] Variant fixes with codegen and vectorized reader disabled [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/23 23:25:38 UTC, 9 replies.
- [PR] [SPARK-46079][INFRA] Install nightly only at Python 3.12 in Infra docker image [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/24 00:17:46 UTC, 0 replies.
- Re: [PR] [SPARK-42905][MLLIB] fix spearman correlation incorrect and inconsistent results when data has huge amount of ties [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/24 00:18:10 UTC, 0 replies.
- [PR] [SPARK-46080][PYTHON] Upgrade Cloudpickle to 3.0.0 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/24 00:32:34 UTC, 2 replies.
- [PR] [SPARK-46081][INFRA] Set DEDICATED_JVM_SBT_TESTS in `build_java21.yml` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/24 00:36:59 UTC, 1 replies.
- Re: [PR] [SPARK-46079][INFRA] Install `torch` nightly only at Python 3.12 in Infra docker image [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/24 00:47:30 UTC, 1 replies.
- Re: [PR] [SPARK-46081][INFRA] Set `DEDICATED_JVM_SBT_TESTS` in `build_java21.yml` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/24 00:49:18 UTC, 1 replies.
- Re: [PR] [SPARK-42891][CONNECT][PYTHON] Implement CoGrouped Map API [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/24 00:59:48 UTC, 0 replies.
- [PR] [SPARK-46082][PYTHON][CONNECT] Fix protobuf string representation for Pandas Functions API with Spark Connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/24 01:12:22 UTC, 4 replies.
- [PR] [SPARK-46083][PYTHON] Make SparkNoSuchElementException as a canonical error API [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/24 01:52:59 UTC, 4 replies.
- [PR] [SPARK-46084][PS] Refactor data type casting operation for Categorical type. [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/24 01:56:56 UTC, 2 replies.
- [PR] [MINOR] Update Description of `UnknownException` in PySpark Documentation [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/24 02:12:54 UTC, 0 replies.
- Re: [PR] [MINOR][DOCS] Update Description of `UnknownException` in PySpark Documentation [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/24 02:15:35 UTC, 1 replies.
- [PR] [SPARK-46085][CONNECT] Dataset.groupingSets in Scala Spark Connect client [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/24 02:59:25 UTC, 20 replies.
- [PR] [SPARK-46016][DOCS][PS] Fix pandas API support list properly [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/24 03:39:17 UTC, 5 replies.
- [PR] [SPARK-46086][CORE] Fix potential non-atomic operation issues in `ReloadingX509TrustManager` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/24 03:58:44 UTC, 4 replies.
- [PR] [SPARK-46058][CORE] Add separate flag for privateKeyPassword [spark] - posted by "hasnain-db (via GitHub)" <gi...@apache.org> on 2023/11/24 05:06:39 UTC, 8 replies.
- [PR] [SPARK-45356][INFRA] Adjust the test configuration of `maven_test.yml` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/24 05:34:30 UTC, 4 replies.
- [PR] [SPARK-46087][PYTHON] Sync PySpark dependencies in docs and dev requirements [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/24 05:49:53 UTC, 2 replies.
- Re: [PR] [SPARK-45943][SQL] Add a tag to mark resolved subquery plan for ResolveSubquery [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2023/11/24 06:14:14 UTC, 9 replies.
- [PR] test to use lower case attribute reference name [spark] - posted by "copperybean (via GitHub)" <gi...@apache.org> on 2023/11/24 07:21:49 UTC, 1 replies.
- [PR] test to use lower case attribute reference [spark] - posted by "copperybean (via GitHub)" <gi...@apache.org> on 2023/11/24 07:28:22 UTC, 0 replies.
- [PR] [SPARK-46089][BUILD] Upgrade commons-lang3 to 3.14.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/24 09:13:27 UTC, 3 replies.
- [PR] [SPARK-46036][SQL] Removing error-class from raise_error function [spark] - posted by "dbatomic (via GitHub)" <gi...@apache.org> on 2023/11/24 13:48:17 UTC, 16 replies.
- [PR] [SPARK-46091][KUBERNETES] Respect the defined container SPARK_LOCAL_DIRS env [spark] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2023/11/24 13:55:33 UTC, 3 replies.
- [PR] [SPARK-46092] Don't push down Parquet row group filters that overflow [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2023/11/24 15:25:27 UTC, 0 replies.
- Re: [PR] [SPARK-45216][SQL] Fix non-deterministic seeded Dataset APIs [spark] - posted by "JoshRosen (via GitHub)" <gi...@apache.org> on 2023/11/24 22:27:19 UTC, 1 replies.
- [PR] [SPARK-46095][DOCS] Document REST API for Spark Standalone Cluster [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/25 00:12:42 UTC, 0 replies.
- Re: [PR] [SPARK-46095][DOCS] Document `REST API` for Spark Standalone Cluster [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/25 00:59:51 UTC, 4 replies.
- [PR] [SPARK-46096][BUILD] Upgrade `sbt` to 1.9.7 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/25 04:19:08 UTC, 9 replies.
- Re: [PR] [SPARK-45699][BUILD][CORE][SQL][SS][CONNECT][MLLIB][ML][DSTREAM][GRAPHX][K8S][UI] Fixing all compilation warnings related to widening conversions [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/25 04:21:47 UTC, 3 replies.
- [PR] [SPARK-46097][SQL] Push down limit 1 though Union and Aggregate [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2023/11/25 06:35:57 UTC, 2 replies.
- [PR] [SPARK-46099][PS][DOCS] Refactor "Supported pandas API" generation script [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/25 10:06:47 UTC, 2 replies.
- [PR] [SPARK-46100][CORE] Reduce stack depth by replace (string|array).size with (string|array).length [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/25 10:25:20 UTC, 0 replies.
- Re: [PR] [SPARK-46100][CORE][PYTHON] Reduce stack depth by replace (string|array).size with (string|array).length [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/25 10:46:05 UTC, 4 replies.
- Re: [PR] [SPARK-45826][SQL] Add a SQL config for stack traces in DataFrame query context [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/11/25 18:04:12 UTC, 4 replies.
- Re: [PR] [SPARK-46075][CONNECT] Improvements to SparkConnectSessionManager [spark] - posted by "rangadi (via GitHub)" <gi...@apache.org> on 2023/11/25 18:50:28 UTC, 11 replies.
- [PR] [SPARK-46103][PYTHON][BUILD][DOCS] Enhancing PySpark documentation [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/25 20:53:41 UTC, 21 replies.
- Re: [PR] [SPARK-44850][CONNECT] Heartbeat in scala's Spark Connect [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/26 00:20:16 UTC, 1 replies.
- Re: [PR] [SPARK-44209] Expose amount of shuffle data available on the node [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/26 00:20:18 UTC, 1 replies.
- Re: [PR] [SPARK-46103][PYTHON][INFRA][BUILD][DOCS] Enhancing PySpark documentation [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/26 01:45:35 UTC, 6 replies.
- [PR] [SPARK-46090][SQL] Support plan fragment level SQL configs in AQE [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2023/11/26 03:01:35 UTC, 1 replies.
- [PR] [SPARK-46100][CORE][SQL][CONNECT][AVRO] Replace the remaining (string|array).size with (string|array).length [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/26 04:29:59 UTC, 1 replies.
- [PR] [SPARK-46084][PS][FOLLOWUP] More refactoring by using `create_map` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/26 04:57:09 UTC, 3 replies.
- Re: [PR] [SPARK-46100][CORE][R][SQL][SS][CONNECT][ML][MLLIB][DSTREAM][GRAPHX][K8S][AVRO][EXAMPLES] Replace the remaining `(string|array).size` with `(string|array).length` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/26 12:52:43 UTC, 0 replies.
- [PR] [WIP][SPARK-46101][SQL] Reduce stack depth by replace (string|array).size with (string|array).length [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/26 13:08:38 UTC, 0 replies.
- [PR] [SPARK-39769][SQL][3.3.0] Correcting the misspelling Unevaluable -> Inevaluable [spark] - posted by "luogaiyu (via GitHub)" <gi...@apache.org> on 2023/11/26 13:56:12 UTC, 3 replies.
- [PR] [SPARK-46106]If the hive table is a table, the outsourcing information will be displayed during ShowCreateTableCommand. [spark] - posted by "guixiaowen (via GitHub)" <gi...@apache.org> on 2023/11/26 14:43:59 UTC, 1 replies.
- [PR] [SPARK-46106]If the hive table is a table, the outsourcing information will be displayed during ShowCreateTableCommand. #44018 [spark] - posted by "guixiaowen (via GitHub)" <gi...@apache.org> on 2023/11/26 15:11:08 UTC, 0 replies.
- [PR] [WIP][SQL] Restrict charsets in `encode()` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/11/26 17:10:14 UTC, 1 replies.
- Re: [PR] [SPARK-42655][SQL] Incorrect ambiguous column reference error [spark] - posted by "bsikander (via GitHub)" <gi...@apache.org> on 2023/11/26 19:55:33 UTC, 0 replies.
- [PR] [SPARK-46094][CONNECT] Add support for code profiling executors [spark] - posted by "parthchandra (via GitHub)" <gi...@apache.org> on 2023/11/26 23:59:03 UTC, 26 replies.
- Re: [PR] [SPARK-46092][SQL] Don't push down Parquet row group filters that overflow [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/27 00:07:17 UTC, 6 replies.
- [PR] [MAJOR][SQL] XML data source keepInnerXmlAsRaw option [spark] - posted by "ufuksungu (via GitHub)" <gi...@apache.org> on 2023/11/27 00:17:02 UTC, 1 replies.
- Re: [PR] [SPARK-44830][CONNECT] Upgrade grpc to 1.57.2 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/27 00:19:06 UTC, 1 replies.
- [PR] [SPARK-46107][PYTHON][ML] Deprecate pyspark.keyword_only API [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/27 01:04:53 UTC, 7 replies.
- Re: [PR] [MAJOR][SQL] keepInnerXmlAsRaw option for Built-in XML Data Source [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/27 01:07:00 UTC, 1 replies.
- [PR] [SPARK-46110][PYTHON] Use error classes in catalog, conf, connect, observation, pandas modules [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/27 02:24:34 UTC, 3 replies.
- [PR] [SPARK-45888][SS] Apply error class framework to State (Metadata) Data Source [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2023/11/27 02:31:00 UTC, 25 replies.
- [PR] [SPARK-46111][DOCS][PYTHON] Add copyright to the PySpark official documentation. [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/27 02:46:05 UTC, 8 replies.
- [PR] [SPARK-46113][BUILD][DOCS] Update `pydata_sphinx_theme` version requirement to >=0.13 [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/27 03:45:37 UTC, 0 replies.
- [PR] [SPARK-46114][PYTHON] Add PySparkIndexError for error framework [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/27 04:11:09 UTC, 3 replies.
- [PR] [MINOR][PYTHON][DOCS] Remove since decorator usages in pyspark.sql [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/27 04:22:23 UTC, 1 replies.
- [PR] [MINOR][PYTHON] Remove obsolete TODOs for ignores at SQLContext and HiveContext [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/27 04:28:18 UTC, 2 replies.
- [PR] [MINOR][PYTHON] Remove _inferSchema in SQLContext [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/27 04:31:29 UTC, 2 replies.
- [PR] [SPARK-46103][FOLLOWUP] Keep Sphinx version consistency in spark-rm [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/27 05:41:54 UTC, 7 replies.
- [PR] [SPARK-46116][DOCS][PYTHON] Adding "Q&A Support" and "Mailing Lists" link into PySpark doc homepage. [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/27 06:04:43 UTC, 1 replies.
- [PR] [SPARK-46118][SQL][CONNECT] Use `SparkSession.sessionState.conf` instead of `sqlContext.conf` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/27 06:36:37 UTC, 0 replies.
- Re: [PR] [SPARK-46118][SQL][SS][CONNECT] Use `SparkSession.sessionState.conf` instead of `SQLContext.conf` and mark `SQLContext.conf` as deprecated [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/27 06:39:31 UTC, 4 replies.
- [PR] [SPARK-46117][DOCS][PYTHON] Enhancing readability of PySpark API reference by hiding verbose typehints. [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/27 06:47:15 UTC, 2 replies.
- [PR] [SPARK-46006][YARN][FOLLOWUP] YarnAllocator set target executor number to 0 to cancel pending allocate request when driver stop [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2023/11/27 07:32:29 UTC, 5 replies.
- [PR] [SPARK-46120][CONNECT][PYTHON] Remove helper function `DataFrame.withPlan` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/27 07:36:20 UTC, 3 replies.
- [PR] [SPARK-46119][SQL] Override toString method for UnresolvedAlias [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2023/11/27 07:36:24 UTC, 1 replies.
- Re: [PR] [SPARK-46113][BUILD][DOCS] Update `pydata_sphinx_theme` version requirement to `>=0.13` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/27 08:19:52 UTC, 2 replies.
- Re: [PR] [SPARK-46116][DOCS][PYTHON] Adding "Stack Overflow" and "Mailing Lists" link into PySpark doc homepage. [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/27 08:23:37 UTC, 3 replies.
- [PR] Refine docstring of `concat/array_position/element_at/try_element_at` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/27 08:35:19 UTC, 0 replies.
- Re: [PR] [SPARK-46121][PYTHON][DOCS] Refine docstring of `concat/array_position/element_at/try_element_at` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/27 08:39:07 UTC, 4 replies.
- [PR] [SPARK-46123][DOCS][PYTHON] Using brighter color for document title for better visibility [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/27 09:09:09 UTC, 5 replies.
- Re: [PR] [SPARK-46115][SQL] Restrict charsets in `encode()` [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/27 12:31:29 UTC, 5 replies.
- Re: [PR] [SPARK-46055][SQL] Rewrite Catalog Database APIs implementation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/27 13:25:22 UTC, 17 replies.
- [PR] Replace `ArrayOps#toSeq` with `s.c.immutable.ArraySeq.unsafeWrapArray` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/27 13:46:23 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-46124][CORE][SQL][SS][CONNECT][DSTREAM][MLLIB][ML][PYTHON][R][AVRO][K8S][YARN][UI][EXAMPLES] Replace explicit `ArrayOps#toSeq` with `s.c.immutable.ArraySeq.unsafeWrapArray` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/27 14:10:02 UTC, 0 replies.
- Re: [PR] [SPARK-44285] MSK IAM Support [spark] - posted by "ignitz (via GitHub)" <gi...@apache.org> on 2023/11/27 14:59:18 UTC, 0 replies.
- Re: [PR] [SPARK-44870][SQL] Convert HashAggregate to SortAggregate if all grouping expressions are in child output orderings [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/28 00:18:53 UTC, 1 replies.
- Re: [PR] [SPARK-39024][CORE][YARN] Enable graceful decommissioning of executors on "DECOMMISSIONING" node even in case of external shuffle service enabled [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/28 00:18:54 UTC, 1 replies.
- [PR] [SPARK-46126][PYTHON][TESTS] Fix the doctest in pyspark.pandas.frame.DataFrame.to_dict (Python 3.12) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/28 00:31:41 UTC, 3 replies.
- [PR] [SPARK-46129][DOCS][PYTHON] Add GitHub link icon to PySpark doc header [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/28 01:22:18 UTC, 1 replies.
- Re: [PR] [SPARK-42492][SQL] Add new function filter_value [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/28 02:22:47 UTC, 2 replies.
- [PR] [SPARK-46127][PYTHON][TESTS] Disable pyspark.tests.test_worker.WorkerSegfaultNonDaemonTest.test_python_segfault with Python 3.12 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/28 02:36:32 UTC, 3 replies.
- [PR] [SPARK-46131][PYTHON][INFRA] Install torchvision for Python 3.12 build [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/28 02:52:32 UTC, 3 replies.
- [PR] [SPARK-32407][INFRA][DOC] Delete comments on `Sphinx 3.1+` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/28 06:02:13 UTC, 0 replies.
- Re: [PR] [SPARK-32407][SPARK-35375][INFRA][DOCS] Delete comments on `Sphinx` and `Jinja2` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/28 06:12:58 UTC, 1 replies.
- [PR] [SPARK-46133] Refine ShuffleWriteProcessor write method's comment [spark] - posted by "zwangsheng (via GitHub)" <gi...@apache.org> on 2023/11/28 06:32:24 UTC, 4 replies.
- Re: [PR] [SPARK-46101][SQL] Reduce stack depth by replace (string|array).size with (string|array).length [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/28 06:33:06 UTC, 0 replies.
- [PR] [SPARK-46134][PROTOBUF][TESTS] Replace `df.take(1).toSeq(0)` with `df.first()` in `ProtobufFunctionsSuite` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/28 07:12:17 UTC, 4 replies.
- [PR] [SPARK-46135][PYTHON][DOCS] Fix table format error in ipynb docs [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/28 07:26:15 UTC, 18 replies.
- [PR] [SPARK-46127][TESTS][PYTHON][FOLLOw-UP] Fix skip condition from " < (3, 12)" to " > (3, 11)" [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/28 07:33:55 UTC, 0 replies.
- Re: [PR] [SPARK-46127][TESTS][PYTHON][FOLLOW-UP] Fix skip condition from " < (3, 12)" to " > (3, 11)" [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/28 07:34:48 UTC, 1 replies.
- Re: [PR] [SPARK-46124][CORE][SQL][SS][CONNECT][DSTREAM][MLLIB][ML][PYTHON][R][AVRO][K8S][YARN][UI] Replace explicit `ArrayOps#toSeq` with `s.c.immutable.ArraySeq.unsafeWrapArray` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/28 08:13:56 UTC, 6 replies.
- [PR] [SPARK-46103][INFRA][FOLLOWUP] Unpin jinja2 in Python linter [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/28 08:26:48 UTC, 4 replies.
- [PR] [SPARK-32407][SPARK-35375][FOLLOWUP] Delete remaining comments on `Sphinx` and `Jinja2` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/28 08:50:53 UTC, 3 replies.
- [PR] [SPARK-46137] update janino to version 3.1.11 [spark] - posted by "igreenfield (via GitHub)" <gi...@apache.org> on 2023/11/28 11:15:07 UTC, 6 replies.
- [PR] [SPARK-46138][SQL] Clean up the use of `SQLContext` in `hive-thriftserver` module [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/28 11:35:35 UTC, 5 replies.
- [PR] [SPARK-46139][SQL][TESTS] Fix `QueryExecutionErrorsSuite` with Java 21 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/28 13:06:21 UTC, 5 replies.
- [PR] [SPARK-46140][SQL][TESTS] Remove no longer needed JVM module options from `HiveExternalCatalogVersionsSuite` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/28 15:44:08 UTC, 2 replies.
- Re: [PR] [SPARK-46119][SQL] Override `toString` method for `UnresolvedAlias` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/28 16:20:08 UTC, 0 replies.
- [PR] [SPARK-46141] Change default for spark.sql.legacy.ctePrecedencePolicy… [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2023/11/28 16:39:56 UTC, 0 replies.
- Re: [PR] [SPARK-46101][CORE][SQL][MLLIB][SS][R][CONNCT][GRAPHX] Reduce stack depth by replace (string|array).size with (string|array).length [spark] - posted by "srowen (via GitHub)" <gi...@apache.org> on 2023/11/28 17:06:05 UTC, 2 replies.
- Re: [PR] [SPARK-46094] Add support for code profiling executors [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/28 17:24:27 UTC, 2 replies.
- [PR] [SPARK-46142][INFRA] Remove `dev/ansible-for-test-node` directory [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/28 18:19:44 UTC, 4 replies.
- [PR] [SPARK-46144][SQL] Fail INSERT INTO ... REPLACE statement if the condition contains subquery [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2023/11/28 21:22:53 UTC, 3 replies.
- [PR] [SPARK-46145] spark.catalog.listTables does not throw exception when the table or view is not found. [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2023/11/28 23:54:09 UTC, 1 replies.
- Re: [PR] [SPARK-46145][SQL] spark.catalog.listTables does not throw exception when the table or view is not found [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/28 23:59:53 UTC, 10 replies.
- Re: [PR] [SPARK-46108][SQL] keepInnerXmlAsRaw option for Built-in XML Data Source [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/29 00:34:40 UTC, 8 replies.
- [PR] [SPARK-46146][INFRA] Unpin `markupsafe` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/29 00:42:55 UTC, 2 replies.
- [PR] [SPARK-46147][PS][TESTS] Fix the doctest in pyspark.pandas.series.Seires.to_dict (Python 3.12) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/29 00:52:56 UTC, 3 replies.
- [PR] [SPARK-46148][PS] Fix pyspark.pandas.mlflow.load_model test (Python 3.12) [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/29 01:07:53 UTC, 3 replies.
- [PR] [SPARK-46149][ML][PYTHON][TESTS] Skip 'TorchDistributorLocalUnitTests.test_end_to_end_run_locally' with Python 3.12 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/29 01:33:35 UTC, 17 replies.
- Re: [PR] [SPARK-46140][SQL][TESTS] Remove comments about JVM module options from `HiveExternalCatalogVersionsSuite` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/29 01:43:14 UTC, 1 replies.
- [PR] [SPARK-46029][SQL][3.4] Escape the single quote, _ and % for DS V2 pushdown [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/29 02:20:59 UTC, 3 replies.
- [PR] [SPARK-46150][INFRA] Combine python codegen check and protobuf braking change [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2023/11/29 04:09:35 UTC, 2 replies.
- [PR] [SPARK-46151][PYTHON][DOCS] Hide the `More" drop-down button` in the PySpark docs navigation bar [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/29 05:40:59 UTC, 4 replies.
- [PR] [SPARK-46152][SQL] XML: Add DecimalType support in XML schema inference [spark] - posted by "sandip-db (via GitHub)" <gi...@apache.org> on 2023/11/29 05:47:38 UTC, 5 replies.
- [PR] [SPARK-46154][INFRA] [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/29 05:55:59 UTC, 0 replies.
- Re: [PR] [SPARK-46154][INFRA] Add a new Daily testing GitHub Action job for Maven with Java 21 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/29 05:56:36 UTC, 8 replies.
- [PR] [SPARK-46155][INFRA] Upgrade github-script action to v7 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/29 06:11:19 UTC, 6 replies.
- Re: [PR] [SPARK-46151][PYTHON][DOCS] Hide the `More drop-down button` in the PySpark docs navigation bar [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/29 06:20:24 UTC, 3 replies.
- [PR] [SPARK-45267][PS][FOLLOWUP] Remove duplicated test [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/29 06:24:09 UTC, 3 replies.
- [PR] [SPARK-46169][PS] Assign appropriate JIRA numbers for missing parameters from `DataFrame` API. [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2023/11/29 07:09:39 UTC, 1 replies.
- [PR] [SPARK-46170][SQL] Support inject adaptive query post planner strategy rules in SparkSessionExtensions [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2023/11/29 07:36:37 UTC, 16 replies.
- [PR] [MINOR][PYTHON][DOCS] Fix some outdated info for development/testing.rst [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2023/11/29 07:39:01 UTC, 2 replies.
- [PR] [DO-NOT-REVIEW][DRAFT] Spark 45637 multiple state test [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2023/11/29 09:06:10 UTC, 13 replies.
- [PR] [SPARK-46171][SQL][PYSPARK][R] Remove `HiveContext` from Apache Spark 4.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/29 10:49:17 UTC, 0 replies.
- [PR] [WIP][DOCS] Describe arguments of `encode()` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/11/29 10:49:28 UTC, 0 replies.
- Re: [PR] [SPARK-46171][SQL][PYTHON][R][DOCS] Remove `HiveContext` from Apache Spark 4.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/29 11:03:42 UTC, 7 replies.
- [PR] [SPARK-46055][SQL][FOLLOWUP] Respect code style for scala and reduce the stack depth. [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/29 11:36:40 UTC, 6 replies.
- Re: [PR] [SPARK-46172][SQL][DOCS] Describe arguments of `encode()` [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/29 13:11:03 UTC, 1 replies.
- Re: [PR] [SPARK-46141][SQL] Change default for spark.sql.legacy.ctePrecedencePolicy to CORRECTED [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/29 16:15:52 UTC, 1 replies.
- [PR] Spark 38473 use error classes in org.apache.spark.scheduler [spark] - posted by "asmitalim (via GitHub)" <gi...@apache.org> on 2023/11/29 16:28:17 UTC, 0 replies.
- [PR] [SPARK-46174][BUILD] Upgrade `gcs-connector` to 2.2.18 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/29 18:15:47 UTC, 2 replies.
- [PR] [SPARK-45962][SQL] Remove treatEmptyValuesAsNulls and use nullValue option instead in XML [spark] - posted by "shujingyang-db (via GitHub)" <gi...@apache.org> on 2023/11/29 19:23:48 UTC, 0 replies.
- [PR] created rough service [spark] - posted by "thesauravshukla (via GitHub)" <gi...@apache.org> on 2023/11/29 20:53:12 UTC, 2 replies.
- Re: [PR] [SPARK-46133][CORE][DOCS] Make `ShuffleWriteProcessor.write` method description up-to-date [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/29 21:42:44 UTC, 1 replies.
- Re: [PR] [SPARK-46060][BUILD][TESTS] Upgrade `MySQL/MariaDB/PostgreSQL/DB2` test dependencies [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/29 21:48:21 UTC, 0 replies.
- [PR] Add CrossDbmsQueryTestSuites, which allows generating golden files with Postgres/other DBMS [spark] - posted by "andylam-db (via GitHub)" <gi...@apache.org> on 2023/11/29 21:56:16 UTC, 0 replies.
- Re: [PR] [SPARK-45959][SQL] Improving performance when addition of 1 column at a time causes increase in the LogicalPlan tree depth [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2023/11/29 22:00:31 UTC, 2 replies.
- Re: [PR] [SPARK-45943][SQL] Move DetermineTableStats to resolution rules [spark] - posted by "ahshahid (via GitHub)" <gi...@apache.org> on 2023/11/29 23:05:10 UTC, 4 replies.
- Re: [PR] [WIP] AWS sdk upgrade [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/30 00:18:49 UTC, 0 replies.
- Re: [PR] [SPARK-44864] Align streaming statistics link format with other page links [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/30 00:18:50 UTC, 1 replies.
- Re: [PR] [SPARK-44793][SQL] Fixing pipelineTime metric for WholeStageCodegen [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/11/30 00:18:52 UTC, 0 replies.
- [PR] [SPARK-45940][PYTHON] Add InputPartition to DataSourceReader interface [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2023/11/30 00:23:49 UTC, 7 replies.
- [PR] [SPARK-46177][PYTHON][CONNECT][ML][TESTS] Skip 'CrossValidatorTests.test_crossvalidator_with_fold_col' with Python 3.12 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/30 00:37:20 UTC, 3 replies.
- Re: [PR] [SPARK-46138][SQL] Clean up the use of `SQLContext` in `hive-thriftserver` module and mark `SparkSQLEnv.sqlContext` as `deprecated` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2023/11/30 00:42:26 UTC, 1 replies.
- [PR] [SPARK-46178][CONNECT][TESTS] Move MockDF under PlanOnlyTestFixture [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/30 00:46:59 UTC, 2 replies.
- Re: [PR] [SPARK-45962][SQL][FOLLOW-UP] Handles whitespaces when `nullValue` option is enabled [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/30 00:50:46 UTC, 1 replies.
- [PR] [SPARK-46181][PYTHON][INFRA] Split scheduled Python build [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/30 01:43:47 UTC, 4 replies.
- Re: [PR] [SPARK-46056][SQL] Fix Parquet vectorized read NPE with byteArrayDecimalType default value [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/11/30 02:08:49 UTC, 1 replies.
- [PR] [SPARK-46029][SQL][3.3] Escape the single quote, _ and % for DS V2 pushdown [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/30 02:40:27 UTC, 0 replies.
- [PR] [SPARK-46182] Track the lastTaskRunningTime using the exact task finished event [spark] - posted by "jiangxb1987 (via GitHub)" <gi...@apache.org> on 2023/11/30 03:18:55 UTC, 1 replies.
- Re: [PR] [SPARK-46091][K8S] Respect the defined container SPARK_LOCAL_DIRS env [spark] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2023/11/30 05:21:24 UTC, 3 replies.
- Re: [PR] [SPARK-44881[COMMON]Executor stucked on retrying to fetch shuffle data when `java.lang.OutOfMemoryError. unable to create native thread` exception occurred. [spark] - posted by "fengDianDemaNong (via GitHub)" <gi...@apache.org> on 2023/11/30 08:23:53 UTC, 0 replies.
- Re: [PR] [SPARK-46179][SQL] Add CrossDbmsQueryTestSuites, which allows generating golden files with Postgres/other DBMS [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2023/11/30 08:41:07 UTC, 6 replies.
- Re: [PR] SPARK-12105 - SPARK-SQL add convenient show functions [spark] - posted by "yousefpal (via GitHub)" <gi...@apache.org> on 2023/11/30 08:58:13 UTC, 0 replies.
- [PR] [SPARK-46184][CORE][SQL][CONNECT][MLLIB] Reduce stack depth by replace Option.isDefined with Option.isEmpty [spark] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/11/30 10:56:06 UTC, 0 replies.
- [PR] [SPARK-XXXX]Properly support error handling and conversion for AddArt… [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2023/11/30 11:35:22 UTC, 0 replies.
- [PR] Add official image Dockerfile for Apache Spark 3.4.2 [spark-docker] - posted by "Yikun (via GitHub)" <gi...@apache.org> on 2023/11/30 11:50:53 UTC, 0 replies.
- Re: [PR] [SPARK-46185] Add official image Dockerfile for Apache Spark 3.4.2 [spark-docker] - posted by "Yikun (via GitHub)" <gi...@apache.org> on 2023/11/30 12:02:55 UTC, 0 replies.
- [PR] EXECUTE IMMEDIATE SQL support [spark] - posted by "milastdbx (via GitHub)" <gi...@apache.org> on 2023/11/30 16:34:13 UTC, 0 replies.
- [PR] [WIP][SQL] Align codegen and non-codegen implementation of `StringDecode` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/11/30 16:48:54 UTC, 0 replies.
- Re: [PR] [SPARK-45605][CORE][SQL][SS][CONNECT][MLLIB][GRAPHX][DSTREAM][PROTOBUF][EXAMPLES] Replace `s.c.MapOps.mapValues` with `s.c.MapOps.view.mapValues` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2023/11/30 17:10:21 UTC, 0 replies.
- Re: [PR] [SPARK-46187][SQL] Align codegen and non-codegen implementation of `StringDecode` [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/11/30 17:52:55 UTC, 2 replies.
- Re: [PR] [SPARK-38473][CORE][COMMON][DOCS][SQL] Use error classes in org.apache.spark.scheduler [spark] - posted by "hannahkamundson (via GitHub)" <gi...@apache.org> on 2023/11/30 19:07:34 UTC, 0 replies.
- [PR] [SPARK-46186][CONNECT] Fix illegal state transition when ExecuteThreadRunner interrupted before started [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2023/11/30 20:37:02 UTC, 3 replies.
- Re: [PR] [SPARK-45093]Properly support error handling and conversion for AddArtifactHandler [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2023/11/30 20:52:55 UTC, 0 replies.
- [PR] [SPARK-46188][Doc] Fix the CSS of Spark doc's generated tables [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2023/11/30 21:21:05 UTC, 8 replies.
- [PR] [SPARK-46188][Doc][3.5] Fix the CSS of Spark doc's generated tables [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2023/11/30 22:29:44 UTC, 5 replies.
- [PR] [MINOR][DOCS] Fix the result file description of CoalescedRDDBenchmark [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2023/11/30 22:40:26 UTC, 0 replies.
- [PR] [SPARK-46189][PS][SQL] Perform comparisons and arithmetic between same types in various Pandas aggregate functions to avoid interpreted mode errors [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2023/11/30 23:19:38 UTC, 6 replies.