reviews@spark.apache.org, 2024-08

You are viewing a plain text version of this content. The canonical link for it is here.

- Re: [PR] [SPARK-49006] Implement purging for OperatorStateMetadataV2 and StateSchemaV3 files [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/08/01 00:03:39 UTC, 1 replies.
- Re: [PR] [SPARK-47702][CORE] Remove Shuffle service endpoint from the locations list when RDD block is removed form a node. [spark] - posted by "attilapiros (via GitHub)" <gi...@apache.org> on 2024/08/01 00:19:29 UTC, 14 replies.
- Re: [PR] [SPARK-49074][SQL] Fix variant with `df.cache()` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/01 00:47:56 UTC, 1 replies.
- Re: [PR] [SPARK-48480][SS][Connect] StreamingQueryListener should not be affected by spark.interrupt() [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/08/01 01:04:46 UTC, 3 replies.
- [PR] [SPARK-49075][BUILD][TESTS] Upgrade JUNit5 related to the latest version [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/01 01:23:20 UTC, 0 replies.
- Re: [PR] [SPARK-49038][SQL] Fix regression in Spark UI SQL operator metrics calculation to filter out invalid accumulator values correctly [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/01 02:14:45 UTC, 10 replies.
- Re: [PR] [SPARK-49066][SQL][TESTS] Refactor `OrcEncryptionSuite` and make `spark.hadoop.hadoop.security.key.provider.path` effective only within `OrcEncryptionSuite` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/01 02:29:54 UTC, 0 replies.
- [PR] [SPARK-49066][SQL][TESTS][3.5] Refactor `OrcEncryptionSuite` and make `spark.hadoop.hadoop.security.key.provider.path` effective only within `OrcEncryptionSuite` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/01 02:45:56 UTC, 2 replies.
- [PR] [SPARK-49076][SQL] Fix the outdated logical plan name in 's comments [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/01 02:57:03 UTC, 0 replies.
- Re: [PR] [SPARK-49076][SQL] Fix the outdated `logical plan name` in `AstBuilder's` comments [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/01 03:05:34 UTC, 3 replies.
- [PR] [SPARK-49066][SQL][TESTS] Remove `bouncycastle-related` test dependencies from `hive-thriftserver` module [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/01 03:33:29 UTC, 1 replies.
- Re: [PR] [SPARK-48628][CORE] Add task peak on/off heap memory metrics [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2024/08/01 04:54:09 UTC, 27 replies.
- [PR] [MINOR][PS][DOCS] Add `DataFrame.plot.kde` to API reference [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/08/01 04:55:26 UTC, 2 replies.
- Re: [PR] [SPARK-49050][SS] Integrate TransformWithState operator with Virtual Column Families [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/08/01 05:34:26 UTC, 41 replies.
- [PR] [SPARK-49000][SQL] Fix "select count(distinct 1) from t" where t is empty table by expanding RewriteDistinctAggregates [spark] - posted by "nikolamand-db (via GitHub)" <gi...@apache.org> on 2024/08/01 05:46:59 UTC, 10 replies.
- Re: [PR] [SPARK-49075][BUILD][TESTS] Upgrade JUnit5 related to the latest version [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/01 05:51:19 UTC, 4 replies.
- Re: [PR] [SPARK-49002][SQL] Consistently handle invalid locations in WAREHOUSE/SCHEMA/TABLE/PARTITION/DIRECTORY [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/01 05:55:21 UTC, 2 replies.
- Re: [PR] [SPARK-48906][SQL] Introduce `SHOW COLLATIONS LIKE ...` syntax to show all collations [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/08/01 06:57:41 UTC, 18 replies.
- Re: [PR] [SPARK-44638][SQL][TESTS][3.4] Add test for Char/Varchar in JDBC customSchema option [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/01 07:10:31 UTC, 3 replies.
- [PR] [SPARK-49000][SQL][FOLLOWUP] Fix "select count(distinct 1) from t" where t is empty table by expanding RewriteDistinctAggregates [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/01 07:11:45 UTC, 3 replies.
- Re: [PR] [SPARK-48344][SQL] SQL API change to support execution of compound statements [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2024/08/01 07:53:24 UTC, 3 replies.
- Re: [PR] [SPARK-49077][SQL][TESTS] Remove `bouncycastle-related` test dependencies from `hive-thriftserver` module [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/01 08:04:07 UTC, 2 replies.
- Re: [PR] [SPARK-42199][SQL] Fix issues around Dataset.groupByKey [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/08/01 08:17:59 UTC, 5 replies.
- [PR] [SPARK-49078][SQL] Support show columns syntax in v2 table [spark] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/08/01 08:46:37 UTC, 22 replies.
- Re: [PR] [SPARK-49039][UI] Reset checkbox when executor metrics are loaded in the Stages tab [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/08/01 08:55:58 UTC, 3 replies.
- Re: [PR] [SPARK-49018][SQL] Fix approx_count_distinct not working correctly with collation [spark] - posted by "viktorluc-db (via GitHub)" <gi...@apache.org> on 2024/08/01 10:09:53 UTC, 5 replies.
- Re: [PR] [SC-170296] GROUP BY with MapType nested inside complex type [spark] - posted by "nebojsa-db (via GitHub)" <gi...@apache.org> on 2024/08/01 10:14:37 UTC, 4 replies.
- Re: [PR] [SPARK-48700] [SQL] Mode expression for complex types (all collations) [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/01 10:15:56 UTC, 39 replies.
- Re: [PR] [SPARK-49071][SQL] Remove ArraySortLike trait [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/01 11:23:27 UTC, 2 replies.
- Re: [PR] [SPARK-42388][SQL] Avoid parquet footer reads twice in vectorized reader [spark] - posted by "yabola (via GitHub)" <gi...@apache.org> on 2024/08/01 12:08:33 UTC, 0 replies.
- Re: [PR] [SPARK-48911][SQL][TESTS] Improve collation support testing for various expressions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/01 13:43:23 UTC, 10 replies.
- Re: [PR] [SPARK-49065][SQL] Rebasing in legacy formatters/parsers must support non JVM default time zones [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/01 14:28:46 UTC, 1 replies.
- Re: [PR] [SPARK-48346][SQL] Support for IF ELSE statements in SQL scripts [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/01 14:37:43 UTC, 18 replies.
- Re: [PR] [SPARK-49057][SQL] Do not block the AQE loop when submitting query stages [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/01 14:50:09 UTC, 8 replies.
- [PR] [SPARK-49080][SQL][TEST] Upgrade `mssql-jdbc` to 12.8.0.jre11 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/08/01 15:09:25 UTC, 7 replies.
- [PR] [SPARK-49081][SQL][DOCS] Add data source options docs of `Protobuf` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/08/01 17:52:15 UTC, 2 replies.
- Re: [PR] [SPARK-49047][PYTHON][CONNECT] Truncate the message for logging [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/01 18:32:23 UTC, 6 replies.
- Re: [PR] [SPARK-49070][SS][SQL] TransformWithStateExec.initialState is rewritten incorrectly to produce invalid query plan [spark] - posted by "huaxingao (via GitHub)" <gi...@apache.org> on 2024/08/01 19:24:50 UTC, 3 replies.
- Re: [PR] [SPARK-49052] Add SparkOperator main entry point class [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/01 19:35:06 UTC, 1 replies.
- Re: [PR] [SPARK-49052] Add SparkOperator class and tests [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/01 19:38:36 UTC, 1 replies.
- Re: [PR] [SPARK-49045] Add docker image build for operator [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/01 19:54:53 UTC, 2 replies.
- [PR] [MINOR] Use LinkedHashSet for ResolveLateralColumnAliasReference to generate stable hash for the plan [spark] - posted by "zhangyt26 (via GitHub)" <gi...@apache.org> on 2024/08/01 20:04:34 UTC, 2 replies.
- [PR] [SPARK-49004][CONNECT] Register Column API internal functions in separate namespace [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/01 20:52:39 UTC, 4 replies.
- [PR] [SPARK-49083][CONNECT] Allow from_xml and from_json to natively work with json schemas [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/01 21:12:08 UTC, 6 replies.
- [PR] [SPARK-49021][SS] Add support for reading transformWithState value state variables with state data source reader [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/08/01 23:46:46 UTC, 32 replies.
- Re: [PR] [SPARK-49048][SS] Add support for reading relevant operator metadata at given batch id [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/08/02 00:14:45 UTC, 21 replies.
- Re: [PR] [SPARK-47944][BUILD] Upgrade icu4j to 75.1 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/02 00:20:52 UTC, 3 replies.
- Re: [PR] [SPARK-44305][SQL] Dynamically choose whether to broadcast hadoop conf [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/02 00:20:53 UTC, 2 replies.
- Re: [PR] [SPARK-47936][BUILD] Improve `toUpperCase` & `toLowerCase` with `Locale.ROOT` rules [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/02 00:20:54 UTC, 1 replies.
- Re: [PR] [SPARK-49062][SQL] Migrate XML to File Data Source V2 [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/02 00:48:33 UTC, 8 replies.
- Re: [PR] [MINOR][DOCS] Fix typos in `docs/sql-data-sources-xml.md` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/02 00:48:50 UTC, 1 replies.
- Re: [PR] [MINOR][DOCS] Fix typos in docs/sql-ref-number-pattern.md [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/02 00:54:38 UTC, 3 replies.
- Re: [PR] Multiple spark application can be submitted within the current process [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/02 00:55:26 UTC, 0 replies.
- Re: [PR] [SPARK-49073][SQL][DOCS] Improve the doc `sql-ref-syntax-qry-select.md` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/02 01:12:59 UTC, 6 replies.
- Re: [PR] [SPARK-49072][DOCS] Fix abnormal display of text content which contains two $ in one line but non-formula in docs [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/02 01:13:00 UTC, 1 replies.
- [PR] [SPARK-49090][CORE] Support `JWSFilter` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/02 01:15:06 UTC, 17 replies.
- Re: [PR] [SPARK-48939][AVRO] Support reading Avro with recursive schema reference [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/02 01:34:28 UTC, 19 replies.
- [PR] Bump rexml from 3.2.6 to 3.3.3 in /docs [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/08/02 01:38:17 UTC, 5 replies.
- [PR] 3.3.0 kylin 4.6.22.0.6 hotfix 0813 [spark] - posted by "Mrhs121 (via GitHub)" <gi...@apache.org> on 2024/08/02 02:39:25 UTC, 1 replies.
- Re: [PR] [SPARK-47430][SQL] Rework group by map type [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/02 02:52:47 UTC, 4 replies.
- [PR] [SPARK-48791][FOLLOW-UP] Fix regression caused by immutable conversion on TaskMetrics#externalAccums [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2024/08/02 03:13:02 UTC, 8 replies.
- Re: [PR] [SPARK-48755][SS] State V2 base implementation and ValueState support [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/02 03:15:48 UTC, 27 replies.
- [PR] [SPARK-48763][CONNECT][BUILD][FOLLOW-UP] Move Spark Connect common/server into sql directory [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/02 04:09:32 UTC, 4 replies.
- Re: [PR] [SPARK-48936][CONNECT] Makes spark-shell works with Spark connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/02 04:25:43 UTC, 32 replies.
- Re: [PR] [SPARK-49000][SQL][3.4] Fix "select count(distinct 1) from t" where t is empty table by expanding RewriteDistinctAggregates [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/02 05:59:14 UTC, 1 replies.
- Re: [PR] [SPARK-49000][SQL][3.5] Fix "select count(distinct 1) from t" where t is empty table by expanding RewriteDistinctAggregates [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/02 06:18:17 UTC, 3 replies.
- Re: [PR] [SPARK-49093][SQL] GROUP BY with MapType nested inside complex type [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/02 06:28:29 UTC, 0 replies.
- Re: [PR] [SPARK-49000][SQL][FOLLOWUP] Improve code style and update comments [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/02 08:09:27 UTC, 1 replies.
- [PR] [MINOR][SQL]remove useless `return` [spark] - posted by "jlfsdtc (via GitHub)" <gi...@apache.org> on 2024/08/02 08:13:44 UTC, 0 replies.
- [PR] docs: use the same Spark version in the readme and quick-start [spark-connect-go] - posted by "haoxins (via GitHub)" <gi...@apache.org> on 2024/08/02 08:55:01 UTC, 0 replies.
- Re: [PR] [SPARK-33832][SQL] Support optimize skewed join even if introduce extra shuffle [spark] - posted by "lifulong (via GitHub)" <gi...@apache.org> on 2024/08/02 09:19:37 UTC, 7 replies.
- [PR] [SPARK-49063][SQL]Fix Between with ScalarSubqueries [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/08/02 09:22:28 UTC, 0 replies.
- Re: [PR] [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort stage when committed file not consistent with task status [spark] - posted by "akki (via GitHub)" <gi...@apache.org> on 2024/08/02 09:44:20 UTC, 0 replies.
- Re: [PR] [SPARK-48292][CORE] Revert [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort stage when committed file not consistent with task status [spark] - posted by "akki (via GitHub)" <gi...@apache.org> on 2024/08/02 09:49:54 UTC, 3 replies.
- [PR] [SPARK-49082][SQL] Widening type promotions in `AvroDeserializer` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/08/02 09:53:44 UTC, 17 replies.
- [PR] [SPARK-49094][SQL] Fix ignoreCorruptFiles non-functioning for hive orc impl with mergeSchema off [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/02 10:20:08 UTC, 19 replies.
- [PR] [SPARK-49095][SQL] Update `DecimalType` compatible logic of `Avro` data source to avoid loss of decimal precision [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/08/02 10:46:59 UTC, 0 replies.
- [PR] [SPARK-48763][FOLLOWUP] Make `dev/lint-scala` error message more accurate [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/02 11:30:48 UTC, 3 replies.
- [PR] Verifying Run documentation build [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/02 13:38:28 UTC, 2 replies.
- Re: [PR] [SPARK-48338][SQL] Improve exceptions thrown from parser/interpreter [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/02 14:43:20 UTC, 9 replies.
- [PR] [MINOR][DOCS] Fix broken links in docs [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/08/02 14:46:35 UTC, 0 replies.
- Re: [PR] [SPARK-49063][SQL] Fix Between with ScalarSubqueries [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/02 14:52:07 UTC, 5 replies.
- [PR] [SPARK-49097][INFRA] Add Python3 environment detection for the `build_orror_docs` method in `build_api_decs.rb` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/08/02 15:16:36 UTC, 0 replies.
- Re: [PR] [SPARK-49017][SQL] Insert statement fails when multiple parameters are being used [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/02 15:17:46 UTC, 24 replies.
- Re: [PR] [SPARK-49097][INFRA] Add Python3 environment detection for the `build_error_docs` method in `build_api_decs.rb` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/08/02 15:24:59 UTC, 4 replies.
- [PR] Add first workflow [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2024/08/02 18:23:39 UTC, 1 replies.
- [PR] [SPARK-39098][SQL] Add write options for INSERT [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2024/08/02 20:34:05 UTC, 0 replies.
- [PR] [SPARK-49099] Refactor CatalogManager.setCurrentNamespace [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2024/08/02 20:54:25 UTC, 1 replies.
- [PR] [SPARK-48913] Implement IndentingXMLStreamWriter [spark] - posted by "aldenlau-db (via GitHub)" <gi...@apache.org> on 2024/08/02 23:41:45 UTC, 12 replies.
- Re: [PR] [SPARK-48949][SQL] SPJ: Runtime partition filtering [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2024/08/02 23:45:55 UTC, 7 replies.
- Re: [PR] [SPARK-45387][SQL]Optimize hive patition filter when the comparision dataType not match [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/03 00:20:35 UTC, 1 replies.
- Re: [PR] [SPARK-42846][SQL] Integrate _LEGACY_ERROR_TEMP_2011 into UNEXPECTED_DATA_TYPE [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/03 00:20:36 UTC, 1 replies.
- Re: [PR] [SPARK-49080][SQL][TEST] Upgrade `mssql-jdbc` to 12.8.0.jre11 and MsSQLServer docker image tag to `2022-CU14-ubuntu-22.04` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/03 01:14:58 UTC, 0 replies.
- [PR] [SPARK-47894][CORE][FOLLOWUP] Add trailing slashes to `Environment` page link [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/03 02:33:39 UTC, 0 replies.
- Re: [PR] [SPARK-48931][SS][FOLLOWUP] Reduce Cloud Store List API cost for state store maintenance task [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/08/03 06:32:52 UTC, 1 replies.
- Re: [PR] [SPARK-48480][SS][CONNECT] StreamingQueryListener should not be affected by spark.interrupt() [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/03 08:01:30 UTC, 1 replies.
- Re: [PR] [SPARK-48791][CORE][FOLLOW-UP] Fix regression caused by immutable conversion on TaskMetrics#externalAccums [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2024/08/03 15:31:15 UTC, 14 replies.
- Re: [PR] [SPARK-47894][CORE][FOLLOWUP] Add a trailing slash to `MasterPage`'s `Environment` page link [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/03 19:21:06 UTC, 1 replies.
- [PR] [SPARK-49103][CORE] Support `spark.master.rest.filters` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/03 22:12:30 UTC, 4 replies.
- Re: [PR] [SPARK-43025][SQL] Eliminate Union if filters have the same child plan [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/04 00:23:21 UTC, 1 replies.
- [PR] [SPARK-49104][CORE][DOCS] Document `JWSFilter` usage in Spark UI and REST API and rename parameter to `secretKey` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/04 04:38:38 UTC, 10 replies.
- Re: [PR] [WIP][SPARK-49097][INFRA] Add Python3 environment detection for the `build_error_docs` method in `build_api_decs.rb` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/08/04 07:01:17 UTC, 0 replies.
- [PR] [SPARK-49105][BUILD][TESTS] Upgrade `ojdbc11` to 23.5.0.24.07 and OracleDatabaseOnDocker docker image tag to `oracle-free:23.5-slim` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/08/04 15:31:30 UTC, 2 replies.
- [PR] [SPARK-48807][SQL][DOCS][FOLLOWUP] Update `docs/sql-migration-guide.md` for Binary Support for CSV datasource [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/08/04 15:58:36 UTC, 4 replies.
- Re: [PR] [SPARK-48731][INFRA] Upgrade `docker/build-push-action` to v6 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/04 20:16:49 UTC, 2 replies.
- Re: [PR] [SPARK-48834][SQL] Disable variant input/output to python scalar UDFs, UDTFs, UDAFs during query compilation [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/04 20:25:41 UTC, 1 replies.
- [PR] [SPARK-48834][SQL][TESTS] Add `assume(shouldTestPandasUDFs)` to PythonUDFSuite complex variant input test [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/04 20:29:56 UTC, 0 replies.
- Re: [PR] [SPARK-49106][DOCS] Documented `Prometheus` endpoints [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/04 22:09:16 UTC, 4 replies.
- Re: [PR] [MINOR][DOCS] Fix broken links in streaming docs [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/04 22:22:55 UTC, 1 replies.
- Re: [PR] [SPARK-47995][PYTHON][INFRA][TESTS] Upgrade `pyarrow` to 16.0.0 in GitHub Action CI [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/04 22:42:27 UTC, 0 replies.
- Re: [PR] [SPARK-48590][BUILD] Upgrade netty to `4.1.112.Final` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/04 22:48:25 UTC, 2 replies.
- Re: [PR] [SPARK-48834][SQL][TESTS][FOLLOWUP] Add `assume(shouldTestPandasUDFs)` to PythonUDFSuite complex variant input test [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/04 22:50:52 UTC, 3 replies.
- Re: [PR] [SPARK-48728][SQL] Support ignoreNulls for collect_list and collect_set [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/04 23:39:01 UTC, 0 replies.
- Re: [PR] [MINOR][SQL]remove needless `return` in TSetIpAddressProcessor [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/04 23:50:12 UTC, 2 replies.
- Re: [PR] [SPARK-49099][SQL] Refactor CatalogManager.setCurrentNamespace [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/05 02:01:36 UTC, 0 replies.
- Re: [PR] [SPARK-49060] Clean up Mima rules for SQL-Connect binary compatibility checks [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/05 02:16:22 UTC, 1 replies.
- Re: [PR] [SPARK-49095][SQL] Update `DecimalType`and `Decimal` compatible logic of `Avro` data source to avoid loss of decimal precision [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/08/05 02:38:40 UTC, 4 replies.
- [PR] [SPARK-49107][SQL] `ROUTINE_ALREADY_EXISTS` supports RoutineType [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/08/05 03:33:36 UTC, 2 replies.
- [PR] [SPARK-49108][EXAMPLE] Add `submit_pi.sh` example via REST API [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/05 06:40:38 UTC, 1 replies.
- Re: [PR] [SPARK-49108][EXAMPLE] Add `submit_pi.sh` REST API example [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/05 07:47:14 UTC, 3 replies.
- [PR] [SPARK 49109][SQL] Rename leftover BinaryLcase to Lcase [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/08/05 08:06:49 UTC, 3 replies.
- [PR] [MINOR][SQL] Remove orphans in ProtoToParsedPlanTestSuite and PlanGenerationTestSuite [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/05 08:21:43 UTC, 4 replies.
- [PR] [SPARK-49110][SQL] Fix reading metadata columns for tables with CHAR columns [spark] - posted by "tomvanbussel (via GitHub)" <gi...@apache.org> on 2024/08/05 09:15:02 UTC, 0 replies.
- Re: [PR] [SPARK-49043][SQL] Fix interpreted codepath group by on map containing collated strings [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2024/08/05 09:15:47 UTC, 12 replies.
- [PR] [SPARK-48763][TESTS][FOLLOW-UP] Update project location in PlanGenerationTestSuite [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/05 09:22:39 UTC, 6 replies.
- Re: [PR] [SPARK-44239][SQL] Free memory allocated by large vectors when vectors are reset [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/05 09:27:02 UTC, 5 replies.
- Re: [PR] [SPARK-49060][CONNECT] Clean up Mima rules for SQL-Connect binary compatibility checks [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/05 10:11:26 UTC, 1 replies.
- [PR] DataSourceV2Strategy - Move method to object [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2024/08/05 11:04:28 UTC, 0 replies.
- [PR] [WIP] Implement Levenshtein distance for utf8_lcase collation [spark] - posted by "viktorluc-db (via GitHub)" <gi...@apache.org> on 2024/08/05 12:16:25 UTC, 4 replies.
- [PR] [SPARK-49112][CONNECT][TEST] Make `createLocalRelationProto` support relation with `TimestampType` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/08/05 12:52:23 UTC, 0 replies.
- Re: [PR] [SPARK-47430][SQL] Rework group by map type to fix bind reference exception [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/05 12:58:02 UTC, 17 replies.
- [PR] [WIP][SPARK-?][SQL] SQL Scripting execution (including Spark Connect) [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2024/08/05 13:11:26 UTC, 4 replies.
- [PR] [SPARK-48989][SQL][FOLLOWUP] Fix SubstringIndex codegen [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/05 13:36:15 UTC, 5 replies.
- [PR] [SPARK-49113] remove assert from datasource v2 strategy [spark] - posted by "milastdbx (via GitHub)" <gi...@apache.org> on 2024/08/05 13:59:27 UTC, 0 replies.
- [PR] [SPARK-48791][CORE][FOLLOW-UP][3.5] Fix regression caused by immutable conversion on TaskMetrics#externalAccums [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2024/08/05 14:27:21 UTC, 3 replies.
- [PR] [SPARK-48791][CORE][FOLLOW-UP][3.4] Fix regression caused by immutable conversion on TaskMetrics#externalAccums [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2024/08/05 14:30:30 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-48344][SQL] SQL Scripting execution (including Spark Connect) [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2024/08/05 15:01:10 UTC, 32 replies.
- Re: [PR] [SPARK-49014][BUILD] Bump Apache Avro to 1.12.0 [spark] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2024/08/05 15:29:04 UTC, 6 replies.
- [PR] [SPARK-48824] Add Identity Column sql syntax [spark] - posted by "zhipengmao-db (via GitHub)" <gi...@apache.org> on 2024/08/05 16:26:42 UTC, 0 replies.
- [PR] Fixed comma splice in cluster-overview.md [spark] - posted by "j-j-wright (via GitHub)" <gi...@apache.org> on 2024/08/05 17:09:50 UTC, 1 replies.
- Re: [PR] [SPARK-49004][CONNECT] Use separate registry for Column API internal functions [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/05 17:14:40 UTC, 6 replies.
- [PR] [SPARK-49114] Subcategorize cannot load state store errors [spark] - posted by "riyaverm-db (via GitHub)" <gi...@apache.org> on 2024/08/05 18:14:56 UTC, 3 replies.
- Re: [PR] [SPARK-48821][SQL] Support Update in DataFrameWriterV2 [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2024/08/05 18:20:00 UTC, 16 replies.
- Re: [PR] [SPARK-49114] Sub-categorize cannot load state store errors [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/08/05 21:06:40 UTC, 12 replies.
- Re: [PR] [SPARK-44167][SQL] Add Catalog APIs for loading stored procedures [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2024/08/05 21:12:35 UTC, 0 replies.
- [PR] [SPARK-49116][K8S] Fix `InvalidDefaultArgInFrom` in Python/R binding Dockerfiles [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/05 21:14:54 UTC, 5 replies.
- [PR] [SPARK-49117][K8S] Fix `docker-image-tool.sh` to be up-to-date [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/05 21:47:37 UTC, 5 replies.
- [PR] [MINOR][INFRA] Add `bin/docker-image-tool.sh` to KUBERNETES label [spark] - posted by "williamhyun (via GitHub)" <gi...@apache.org> on 2024/08/05 22:07:57 UTC, 2 replies.
- Re: [PR] [SPARK-48592][INFRA] Add scala style check for logging message inline variables [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/08/05 22:08:08 UTC, 1 replies.
- [PR] [SPARK-48778][SQL][TESTS] Improve collation support testing - add unit tests for string expressions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/05 22:20:36 UTC, 11 replies.
- Re: [PR] [SPARK-48967][SQL] Improve performance and memory footprint of "INSERT INTO ... VALUES" Statements [spark] - posted by "costas-db (via GitHub)" <gi...@apache.org> on 2024/08/05 23:06:59 UTC, 11 replies.
- [PR] [SPARK-48937][SQL] Add collation support for StringToMap string expressions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/05 23:49:36 UTC, 7 replies.
- [PR] [WIP][SQL] Update StringType interface for collation support [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/05 23:51:30 UTC, 0 replies.
- [PR] [SPARK-47359][SQL][FOLLOWUP] Remove unused genCode for StringTranslate [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/05 23:56:44 UTC, 3 replies.
- Re: [PR] [Don't review, only for test][SPARK-48022][BUILD] Upgrade `jersey` to `3.1.6` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/06 00:21:11 UTC, 1 replies.
- Re: [PR] [SPARK-47488][k8s]fix driver pod stuck when driver on k8s [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/06 00:21:12 UTC, 1 replies.
- Re: [PR] [SPARK-49112][CONNECT][TEST] Make `createLocalRelationProto` support `TimestampType` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/06 00:59:56 UTC, 1 replies.
- [PR] [WIP][SPARK-48763][TESTS][FOLLOW-UP] Update project location in PlanGenerationTestSuite [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/06 01:48:05 UTC, 1 replies.
- Re: [PR] [SPARK-49099][SQL] CatalogManager.setCurrentNamespace should respect custom session catalog [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/06 01:59:12 UTC, 18 replies.
- Re: [PR] [SPARK-49015][CORE] Connect Server should respect `spark.log.structuredLogging.enabled` [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/08/06 02:14:51 UTC, 33 replies.
- [PR] [SPARK-49115][DOCS] Add docs for state metadata source for operators using schema format v2 such as transformWithState [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/08/06 05:47:36 UTC, 5 replies.
- [PR] [MINOR][INFRA] Mute `stale` Github Action in forks [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/06 06:43:01 UTC, 2 replies.
- Re: [PR] [SPARK-48769][SQL] Support constant folding for ScalaUDF [spark] - posted by "eejbyfeldt (via GitHub)" <gi...@apache.org> on 2024/08/06 06:47:38 UTC, 0 replies.
- [PR] [SPARK-49120][BUILD] Bump Gson 2.11.0 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/08/06 08:20:58 UTC, 7 replies.
- [PR] [WIP][SPARK-49119][SQL] Fix the inconsistency of syntax `show columns` between v1 and v2 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/06 08:23:51 UTC, 0 replies.
- [PR] [SPARK-49047][PYTHON][CONNECT][FOLLOWUP] Catch potential truncation failure [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/08/06 08:28:37 UTC, 2 replies.
- Re: [PR] [SPARK-48978][SQL] Implement ASCII fast path in collation support for UTF8_LCASE [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/06 09:07:04 UTC, 1 replies.
- Re: [PR] [SPARK-49119][SQL] Fix the inconsistency of syntax `show columns` between v1 and v2 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/06 09:25:15 UTC, 32 replies.
- [PR] [SPARK-49099][SQL][FOLLOWUP] recover tests in DDLSuite [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/06 10:53:26 UTC, 0 replies.
- Re: [PR] [SPARK-49099][SQL][FOLLOWUP][3.5] recover tests in DDLSuite [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/06 11:06:12 UTC, 1 replies.
- Re: [PR] Enhance the metrics in SparkUI with logical plan stats [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/06 11:39:20 UTC, 0 replies.
- [PR] [SPARK-49122][Connect][SQL] Add addArtifact API to the Spark SQL Core [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/08/06 13:40:33 UTC, 0 replies.
- Re: [PR] [SPARK-36680][SQL] Supports Dynamic Table Options for Spark SQL [spark] - posted by "advancedxy (via GitHub)" <gi...@apache.org> on 2024/08/06 14:35:30 UTC, 0 replies.
- [PR] [SPARK-49124][BUILD] Upgrade tink to 1.14.1 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/08/06 14:51:41 UTC, 2 replies.
- Re: [PR] [SPARK-49098][SQL] Add write options for INSERT [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/06 14:59:25 UTC, 3 replies.
- [PR] [SPARK-49125][SQL] Allow duplicated column names in CSV writing [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/06 15:20:06 UTC, 9 replies.
- Re: [PR] [SPARK-39142][SPARK-42235][PYTHON] Add overloads in pandas function stub file [spark] - posted by "pontusvision (via GitHub)" <gi...@apache.org> on 2024/08/06 15:20:32 UTC, 0 replies.
- [PR] [SPARK-48843] Adding more tests that would have failed had the fix ap… [spark] - posted by "nemanjapetr-db (via GitHub)" <gi...@apache.org> on 2024/08/06 15:28:22 UTC, 0 replies.
- [PR] Spark 49089 [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/06 16:09:55 UTC, 0 replies.
- [PR] [SPARK-49126][CORE] Move `spark.history.ui.maxApplications` config definition to `History.scala` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/06 17:42:58 UTC, 5 replies.
- [PR] [SPARK-49086][CONNECT] Move ML function registration to SparkSessionExtensions [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/06 17:46:51 UTC, 7 replies.
- Re: [PR] [SPARK-49111] DataSourceV2Strategy - Move static methods to companion object [spark] - posted by "gatorsmile (via GitHub)" <gi...@apache.org> on 2024/08/06 18:45:24 UTC, 2 replies.
- [PR] [ES-1074670][SQL] Add parquet nanosAsLong behavior change to 3.2 migration guide [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2024/08/06 19:27:01 UTC, 1 replies.
- [PR] [SPARK-49128][CORE] Support custom History Server UI title [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/06 20:03:49 UTC, 5 replies.
- Re: [PR] Operator 0.1.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/06 20:51:30 UTC, 2 replies.
- [PR] [SPARK-49024][CONNECT] Add support for functions to column node. [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/06 21:05:22 UTC, 2 replies.
- [PR] [SPARK-49129] Fix `ENTRYPOINT` to point `/opt/spark-operator/operator/docker-entrypoint.sh` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/06 21:15:04 UTC, 5 replies.
- [PR] [SPARK-45923] Verify built images in `build-image` CI job via `docker run` test [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/06 21:34:43 UTC, 4 replies.
- [PR] [SPARK-49132] Minimize docker image by removing redundant `chown` commands [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/06 22:00:40 UTC, 4 replies.
- [PR] [SPARK-49131][SS] TransformWithState should properly set implicit grouping keys even with lazy iterators [spark] - posted by "neilramaswamy (via GitHub)" <gi...@apache.org> on 2024/08/06 23:21:36 UTC, 17 replies.
- Re: [PR] [SPARK-44571][SQL] Eliminate the Join by combine multiple Aggregates [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/07 00:21:15 UTC, 1 replies.
- Re: [PR] [SPARK-48781][SQL] Add Catalog APIs for loading stored procedures [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2024/08/07 01:57:10 UTC, 15 replies.
- Re: [PR] [SPARK-49089][CONNECT] Move hardcoded Catalyst Expressions to the internal function registry [spark] - posted by "asfgit (via GitHub)" <gi...@apache.org> on 2024/08/07 02:05:48 UTC, 0 replies.
- Re: [PR] [SPARK-48843][FOLLOWUP] Adding more tests that would have failed had the fix ap… [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/07 02:46:54 UTC, 4 replies.
- Re: [PR] [SPARK-48881][SQL] Some dynamic partitions can be compensated to specific partition values [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/07 03:23:13 UTC, 7 replies.
- Re: [PR] [MINOR][SQL] Add parquet nanosAsLong behavior change to 3.2 migration guide [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/07 03:36:04 UTC, 1 replies.
- [PR] [MINOR][CORE] Fix a typo in ResourceProfile comment [spark] - posted by "Windber (via GitHub)" <gi...@apache.org> on 2024/08/07 05:13:43 UTC, 2 replies.
- Re: [PR] [SPARK-49113] Dont assert on translation bugs - silently swallow the exception [spark] - posted by "gatorsmile (via GitHub)" <gi...@apache.org> on 2024/08/07 05:44:18 UTC, 17 replies.
- [PR] [SPARK-49134][INFRA] Support retry for deploying artifacts to Nexus staging repository [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/07 06:13:55 UTC, 5 replies.
- [PR] [SPARK-48911][SQL][FOLLOWUP][TESTS] Fix test for collect_set [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/07 07:14:19 UTC, 2 replies.
- [PR] [WIP][SPARK-49135][SQL] Replace `limit(2)` with `limit(1)` in `NonLeafStatementExec` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/07 07:45:36 UTC, 0 replies.
- [PR] [SPARK-49136][SQL] Eagerly initialize DriverManager on Driver [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/08/07 08:14:47 UTC, 4 replies.
- [PR] [CONNECT][PYTHON] Reduce Spark Connect client log level to debug [spark] - posted by "nija-at (via GitHub)" <gi...@apache.org> on 2024/08/07 08:35:18 UTC, 1 replies.
- [PR] [SPARK-49137][SQL] When the Boolean condition in the `if statement` is invalid, an exception should be thrown [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/07 08:59:55 UTC, 16 replies.
- [PR] [SPARK-49138][SQL] Fix CollationTypeCasts of several expressions [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/08/07 09:03:20 UTC, 9 replies.
- Re: [PR] [SPARK-49135][SQL] Replace `limit(2)` with `limit(1)` in `NonLeafStatementExec` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/07 09:06:59 UTC, 5 replies.
- Re: [PR] [SPARK-48835] Introduce versoning to jdbc connectors [spark] - posted by "milastdbx (via GitHub)" <gi...@apache.org> on 2024/08/07 09:08:05 UTC, 1 replies.
- Re: [PR] [SPARK-48824] Add Identity Column SQL syntax [spark] - posted by "zhipengmao-db (via GitHub)" <gi...@apache.org> on 2024/08/07 09:37:42 UTC, 7 replies.
- Re: [PR] [WIP][SPARK-48347][SQL] Support for WHILE statement [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2024/08/07 09:50:23 UTC, 12 replies.
- [PR] [SPARK-49139][SQL] Enable collations by default for Spark 4.0.0 Preview 2 [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/07 10:03:09 UTC, 2 replies.
- [PR] [SPARK-49140][SQL] Widening type promotion from int/long to decimal and support custom decimal logic type for int in `AvroDeserializer` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/08/07 10:42:06 UTC, 9 replies.
- [PR] [SPARK-49141][SQL] Mark variant as hive incompatible data type [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/07 11:04:45 UTC, 5 replies.
- [PR] [SPARK-48843][FOLLOWUP] Adding a PySpark test. [spark] - posted by "nemanjapetr-db (via GitHub)" <gi...@apache.org> on 2024/08/07 15:30:59 UTC, 4 replies.
- [PR] [SPARK-49143][K8S][DOCS] Update `YuniKorn` docs with v1.5.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/07 16:17:22 UTC, 5 replies.
- [PR] [SPARK-49144] Use the latest `setup-java` v4 with `cache` feature [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/07 17:25:34 UTC, 4 replies.
- [PR] [SPARK-49145] Improve readability of log4j console log output [spark] - posted by "asl3 (via GitHub)" <gi...@apache.org> on 2024/08/07 17:39:11 UTC, 5 replies.
- Re: [PR] [WIP][SPARK-49145] Improve readability of log4j console log output [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/07 18:32:40 UTC, 4 replies.
- Re: [PR] [SPARK-49122][Connect][SQL] Add `addArtifact` API to the Spark SQL Core [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/07 19:16:39 UTC, 3 replies.
- [PR] [SPARK-49146][SS]Move assertion errors related to watermark missing in append mode streaming queries to error framework [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2024/08/07 20:31:55 UTC, 1 replies.
- [PR] [SPARK-49147][CORE] Mark KryoSerializer as a stable interface [spark] - posted by "robreeves (via GitHub)" <gi...@apache.org> on 2024/08/07 22:21:52 UTC, 1 replies.
- Re: [PR] [SPARK-49147][CORE] Mark `KryoSerializer` as a stable interface [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/07 22:26:07 UTC, 0 replies.
- Re: [PR] [SPARK-49147][CORE] Mark `KryoRegistrator` as a stable interface [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/07 22:27:33 UTC, 1 replies.
- [PR] [SPARK-49148] Use the latest PMD 6.x rules instead of the deprecated ones [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/07 22:34:25 UTC, 3 replies.
- Re: [PR] [SPARK-49142][CONNECT][PYTHON] Lower Spark Connect client log level to debug [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/07 23:27:22 UTC, 7 replies.
- [PR] [SPARK-49150][BUILD] Upgrade `commons-lang3` to 3.16.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/07 23:32:01 UTC, 2 replies.
- [PR] [SPARK-49151][BUILD] Upgrade `slf4j` to 2.0.14 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/07 23:40:13 UTC, 2 replies.
- Re: [PR] [SPARK-49147][CORE] Mark `KryoRegistrator` with DeveloperApi interface [spark] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/08/08 00:19:35 UTC, 9 replies.
- Re: [PR] Update sql-ref-syntax-qry-select-setops.md [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/08 00:21:15 UTC, 1 replies.
- [PR] [SPARK-49153] Increase `Gradle` JVM memory to `4g` like Spark repo [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/08 02:35:52 UTC, 4 replies.
- Re: [PR] [SPARK-49139][SQL] Enable collations by default [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/08 02:48:03 UTC, 4 replies.
- [PR] [SPARK-49152][SQL] V2SessionCatalog should use V2Command when possible [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2024/08/08 02:57:31 UTC, 2 replies.
- [PR] [SPARK-49154][K8S][INFRA][DOCS] Upgrade `Volcano` to 1.9.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/08 03:00:47 UTC, 4 replies.
- Re: [PR] [MINOR][DOCS] use the same Spark version in the readme and quick-start [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/08/08 04:22:51 UTC, 3 replies.
- [PR] [SPARK-48754]Support Retries in Go client [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/08/08 05:26:53 UTC, 2 replies.
- [PR] [SPARK-49155][SQL] Change to using an Array of `Any|AnyRef` to construct `GenericArrayData` wherever possible [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/08 05:37:23 UTC, 4 replies.
- Re: [PR] [SPARK-49155][SQL] Use more appropriate parameter type to construct `GenericArrayData` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/08 06:33:24 UTC, 1 replies.
- [PR] [SPARK-49156] Enforce ImmutableField and UselessParentheses rules [spark-kubernetes-operator] - posted by "williamhyun (via GitHub)" <gi...@apache.org> on 2024/08/08 06:38:18 UTC, 2 replies.
- [PR] [SPARK-49157] Enforce SignatureDeclareThrowsException and AvoidThrowingRawExceptionTypes rules [spark-kubernetes-operator] - posted by "williamhyun (via GitHub)" <gi...@apache.org> on 2024/08/08 06:46:40 UTC, 0 replies.
- Re: [PR] [SPARK-49157] Enforce `SignatureDeclareThrowsException` and `AvoidThrowingRawExceptionTypes` rules [spark-kubernetes-operator] - posted by "williamhyun (via GitHub)" <gi...@apache.org> on 2024/08/08 06:47:12 UTC, 2 replies.
- [PR] [MINIOR][SQL][PARSE] Change null to None [spark] - posted by "caicancai (via GitHub)" <gi...@apache.org> on 2024/08/08 06:58:08 UTC, 5 replies.
- [PR] [SPARK-49158] Enforce ConfusingTernary and PrematureDeclaration rules [spark-kubernetes-operator] - posted by "williamhyun (via GitHub)" <gi...@apache.org> on 2024/08/08 07:00:00 UTC, 1 replies.
- [PR] Change the target type of encoding `ArrayType` from `mutable.ArraySeq` to `immutable.ArraySeq` in Spark internals [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/08 07:11:49 UTC, 4 replies.
- Re: [PR] [SPARK-49158] Enforce `ConfusingTernary` and `PrematureDeclaration` rules [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/08 07:18:25 UTC, 0 replies.
- [PR] [SPARK-49159] Enforce `FieldDeclarationsShouldBeAtStartOfClass`, `LinguisticNaming` and `ClassWithOnlyPrivateConstructorsShouldBeFinal` rules [spark-kubernetes-operator] - posted by "williamhyun (via GitHub)" <gi...@apache.org> on 2024/08/08 07:20:45 UTC, 2 replies.
- Re: [PR] [SPARK-][CORE][SQL][CONNECT][ML][R][TESTS] Change the target type of encoding `ArrayType` from `mutable.ArraySeq` to `immutable.ArraySeq` in Spark internals [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/08 07:34:27 UTC, 0 replies.
- Re: [PR] [SPARK-49095][SQL] Update `DecimalType`and `decimal fields` compatible logic of `Avro` data source to avoid loss of decimal precision [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/08/08 09:40:30 UTC, 0 replies.
- Re: [PR] [SPARK-49111][SQL] Move withProjectAndFilter to the companion object of DataSourceV2Strategy [spark] - posted by "urosstan-db (via GitHub)" <gi...@apache.org> on 2024/08/08 10:06:42 UTC, 3 replies.
- [PR] Set correct `since` for named_struct [spark] - posted by "andrusha (via GitHub)" <gi...@apache.org> on 2024/08/08 11:35:33 UTC, 5 replies.
- [PR] [SPARK-49162][SQL] Push down date_trunc function [spark] - posted by "IvanK-db (via GitHub)" <gi...@apache.org> on 2024/08/08 12:20:15 UTC, 2 replies.
- [PR] [SPARK-49142][CONNECT][PYTHON] Follow up to revert proto to string performance cost [spark] - posted by "nija-at (via GitHub)" <gi...@apache.org> on 2024/08/08 13:05:23 UTC, 2 replies.
- Re: [PR] [SPARK-47410][SQL][FOLLOWUP] Update StringType interface for collation support [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/08 13:50:19 UTC, 3 replies.
- [PR] [SPARK-49163][SQL] Attempt to create table based on broken parquet partition data results should return user-facing error [spark] - posted by "nikolamand-db (via GitHub)" <gi...@apache.org> on 2024/08/08 13:56:35 UTC, 2 replies.
- Re: [PR] [MINOR] Allowing the merge tool to use JIRA Token [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/08/08 14:14:23 UTC, 1 replies.
- [PR] Fix not NullSafeEqual in predicate of SQL query in JDBC Relation [spark] - posted by "PetarVasiljevic-DB (via GitHub)" <gi...@apache.org> on 2024/08/08 14:22:25 UTC, 0 replies.
- Re: [PR] [SPARK-48753] Upgrade arrow to v17 [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/08/08 14:50:19 UTC, 1 replies.
- [PR] [WIP][SQL] Handle invalid UTF-8 strings in string functions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/08 15:02:12 UTC, 0 replies.
- [PR] [SPARK-47410][SQL][FOLLOWUP] Limit part of StringType API to private[sql] [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/08 15:10:26 UTC, 2 replies.
- [PR] [WIP][SPARK-48355][SQL] Support for CASE statement [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2024/08/08 15:11:51 UTC, 2 replies.
- [PR] [SPARK-49165] Fix RestartPolicyTest to cover `SchedulingFailure` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/08 16:33:52 UTC, 0 replies.
- Re: [PR] [SPARK-49165] Fix `RestartPolicyTest` to cover `SchedulingFailure` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/08 16:38:40 UTC, 4 replies.
- Re: [PR] [SPARK-49166][SQL] Support OFFSET in correlated subquery [spark] - posted by "averyqi-db (via GitHub)" <gi...@apache.org> on 2024/08/08 18:49:35 UTC, 7 replies.
- [PR] [SPARK-49166] Support OFFSET in correlated subquery [spark] - posted by "averyqi-db (via GitHub)" <gi...@apache.org> on 2024/08/08 18:53:47 UTC, 0 replies.
- [PR] [SPARK-49167] Enforce UseUtilityClass rule [spark-kubernetes-operator] - posted by "williamhyun (via GitHub)" <gi...@apache.org> on 2024/08/08 19:51:30 UTC, 1 replies.
- Re: [PR] [SPARK-49167] Enforce `UseUtilityClass` rule [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/08 20:40:42 UTC, 0 replies.
- [PR] [SPARK-49168] Add `OpenContainers` Annotations to docker image [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/08 22:10:46 UTC, 5 replies.
- [PR] [SPARK-49169][BUILD] Upgrade `commons-compress` to 1.27.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/08 23:28:04 UTC, 4 replies.
- [PR] [SPARK-49170][BUILD] Upgrade snappy to 1.1.10.6 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/08 23:35:13 UTC, 3 replies.
- Re: [PR] [SPARK-48051][SQL] Add golden table variant tests written by different engines [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/09 00:21:30 UTC, 1 replies.
- [PR] [SPARK-49171][CONNECT][DOCS] Update Spark Shell with Spark Connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/09 02:20:54 UTC, 9 replies.
- [PR] [SPARK-49172][PYTHON][DOCS] Refine the type hints in functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/08/09 02:33:07 UTC, 2 replies.
- [PR] [SPARK-49174][BUILD][DOCS] Exclude the dir `docs/util` from doc build [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/09 02:59:42 UTC, 0 replies.
- [PR] [SPARK-49171][CONNECT] Change Spark Connect shell prompt from `@` to `scala>` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/09 03:03:30 UTC, 1 replies.
- [PR] [SPARK-49175][PYTHON][MIRROR] Use UnsupportedType to check DataType validation for Arrow UDF [spark] - posted by "jackylee-ch (via GitHub)" <gi...@apache.org> on 2024/08/09 05:35:34 UTC, 2 replies.
- Re: [PR] [SPARK-49174][BUILD][DOCS] Exclude the dir `docs/util` from `_site` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/09 06:22:52 UTC, 7 replies.
- [PR] [SPARK-49176][K8S][DOCS] Fix `spark.ui.custom.executor.log.url` docs by adding K8s [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/09 06:38:21 UTC, 7 replies.
- [PR] [SPARK-49177][INFRA][DOCS] Make GA's `build_error_docs` run only once [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/09 07:04:58 UTC, 5 replies.
- Re: [PR] [SPARK-49164]Fix not NullSafeEqual in predicate of SQL query in JDBC Relation [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/08/09 07:44:02 UTC, 0 replies.
- Re: [PR] [SPARK-49178][CORE][SQL][CONNECT][ML][R][TESTS] Fix the performance regression with `Row#getSeq` between master and 3.5 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/09 07:59:53 UTC, 2 replies.
- [PR] [SPARK-49179][SQL] Fix v2 multi bucketed inner joins throw AssertionError [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2024/08/09 08:08:33 UTC, 11 replies.
- [PR] [SPARK-49183][SQL] V2SessionCatalog.createTable should respect PROP_IS_MANAGED_LOCATION [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/09 09:45:25 UTC, 14 replies.
- Re: [PR] [SPARK-47261][SQL] Assign better name for errors _LEGACY_ERROR_TEMP_1172, _LEGACY_ERROR_TEMP_1173, and _LEGACY_ERROR_TEMP_1174 [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/08/09 09:52:20 UTC, 2 replies.
- Re: [PR] [SPARK-49016][SQL] Queries from raw CSV files are disallowed when the referenced columns only include the internal corrupt record column [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/08/09 09:57:05 UTC, 4 replies.
- [PR] [SPARK-47257][SQL] Assign names to error classes _LEGACY_ERROR_TEMP_105[3-4] and _LEGACY_ERROR_TEMP_1113 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/08/09 10:02:47 UTC, 1 replies.
- Re: [PR] [SPARK-48882][SS] Assign names to streaming output mode related error classes [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/08/09 10:13:05 UTC, 7 replies.
- [PR] [SPARK-49185][PS][PYTHON][CONNECT] Reimplement `kde` plot with Spark SQL [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/08/09 10:25:44 UTC, 3 replies.
- Re: [PR] [SPARK-42307][SQL] Assign name for error _LEGACY_ERROR_TEMP_2232 [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/08/09 10:48:26 UTC, 11 replies.
- [PR] [SPARK-49182][DOCS][PYTHON] Stop publish site/docs/{version}/api/python/_sources dir [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/09 11:16:10 UTC, 4 replies.
- Re: [PR] [WIP][SPARK-48353][SQL] Introduction of Error Handling mechanism in SQL Scripting [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2024/08/09 12:02:14 UTC, 61 replies.
- [PR] [SPARK-35680][FOLLOWUP] Add more tests for toYearMonthIntervalString(… [spark] - posted by "nemanjapetr-db (via GitHub)" <gi...@apache.org> on 2024/08/09 12:55:41 UTC, 0 replies.
- [PR] [WIP][SPARK-49022] Use Column Node API in Column [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/09 13:50:27 UTC, 26 replies.
- Re: [PR] [SQL] Add more tests for toYearMonthIntervalString(… [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/08/09 14:04:51 UTC, 1 replies.
- Re: [PR] [SPARK-49152][SQL] V2SessionCatalog should use V2Command [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/09 14:22:18 UTC, 23 replies.
- Re: [PR] [SPARK-49164][SQL] Fix not NullSafeEqual in predicate of SQL query in JDBC Relation [spark] - posted by "PetarVasiljevic-DB (via GitHub)" <gi...@apache.org> on 2024/08/09 15:59:23 UTC, 5 replies.
- [PR] [SPARK-49114][FOLLOWUP] Sub-categorize cannot load state store errors [spark] - posted by "riyaverm-db (via GitHub)" <gi...@apache.org> on 2024/08/09 16:43:11 UTC, 1 replies.
- [PR] [SPARK-49188][SQL] Internal error on concat_ws called on array of arrays of string [spark] - posted by "nikolamand-db (via GitHub)" <gi...@apache.org> on 2024/08/09 17:14:12 UTC, 2 replies.
- [PR] [SPARK-49190][K8S] Add `SPARK_EXECUTOR_ATTRIBUTE_(APP|EXECUTOR)_ID` if `CUSTOM_EXECUTOR_LOG_URL` is defined [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/09 18:15:13 UTC, 8 replies.
- [PR] [WIP][SQL] Handle invalid UTF-8 strings in SubstringIndex [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/09 18:31:33 UTC, 2 replies.
- [PR] [WIP][SQL] Handle invalid UTF-8 strings in StringLocate [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/09 20:39:20 UTC, 2 replies.
- [PR] [WIP][SQL] Handle invalid UTF-8 strings in StringInstr [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/09 21:17:31 UTC, 2 replies.
- [PR] [WIP][SQL] Handle invalid UTF-8 strings in StringTrim [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/09 21:50:27 UTC, 2 replies.
- [PR] [WIP][SQL] Handle invalid UTF-8 strings in StringTranslate [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/09 21:59:53 UTC, 2 replies.
- Re: [PR] [SPARK-49178][CORE][SQL][CONNECT][ML][R][TESTS] Optimize performance of `Row#getSeq` to match the performance when using Spark 3.5 with Scala 2.12. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/09 22:30:18 UTC, 1 replies.
- Re: [PR] [SPARK-49178][CORE][SQL][CONNECT][ML][R] Optimize performance of `Row#getSeq` to match the performance when using Spark 3.5 with Scala 2.12. [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/10 02:45:15 UTC, 4 replies.
- [PR] [SPARK-49178][SQL] Optimize performance of Row#getSeq to match the performance when using Spark 3.5 with Scala 2.12 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/10 03:33:49 UTC, 0 replies.
- Re: [PR] [SPARK-49178][SQL] Optimize performance of `Row#getSeq` to match the performance when using Spark 3.5 with Scala 2.12 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/10 03:36:48 UTC, 7 replies.
- Re: [PR] [SPARK-47573][K8S] Support custom driver log url [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/10 06:04:39 UTC, 9 replies.
- Re: [PR] [SPARK-48204][INFRA][FOLLOW] fix release scripts for the "finalize" step [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/10 12:38:30 UTC, 3 replies.
- [PR] [WIP] Improve the performance of RowSetUtils.toColumnBasedSet [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2024/08/11 01:17:14 UTC, 3 replies.
- Re: [PR] [SPARK-49114][SS][FOLLOWUP] Sub-categorize cannot load state store errors [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/11 01:23:20 UTC, 0 replies.
- [PR] [SPARK-48936][CONNECT][FOLLOW-UP] Makes spark-shell with Spark connect work with SPARK_REMOTE environment variable [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/11 02:18:20 UTC, 3 replies.
- [PR] [HotFix] Clear unused error methods in QueryCompilationErrors [spark] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/08/11 06:22:20 UTC, 1 replies.
- Re: [PR] [SPARK-49193] Improve the performance of RowSetUtils.toColumnBasedSet [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2024/08/11 06:27:51 UTC, 0 replies.
- Re: [PR] [SQL][HotFix] Clear unused error methods in QueryCompilationErrors [spark] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/08/11 08:30:09 UTC, 3 replies.
- Re: [PR] [SPARK-49193][SQL] Improve the performance of RowSetUtils.toColumnBasedSet [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/11 08:32:51 UTC, 2 replies.
- Re: [PR] [SPARK-44141] Removed need to have buf preinstalled [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/08/11 18:27:41 UTC, 1 replies.
- [PR] [SPARK-XXXX] Adding Integration Tests [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/08/11 18:36:01 UTC, 0 replies.
- Re: [PR] [SPARK-49078][FOLLOWUP] Clear unused error methods in QueryCompilationErrors [spark] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/08/12 01:30:38 UTC, 0 replies.
- [PR] [SPARK-49195][CONNECT] Embed script level parsing logic into SparkSubmitCommandBuilder [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/12 01:38:24 UTC, 3 replies.
- [PR] [SPARK-49196][BUILD] Upgrade `kubernetes-client` to 6.13.2 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/12 01:44:03 UTC, 2 replies.
- [PR] [SPARK-49197][CORE] Redact `Spark Command` output in `launcher` module [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/12 01:55:06 UTC, 4 replies.
- Re: [PR] [SPARK-49114][SS][FOLLOWUP] Add missing error classes into json definition file [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/08/12 01:59:58 UTC, 2 replies.
- [PR] [SPARK-49198][CONNECT] Prune more jars required for Spark Connect shell [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/12 01:59:59 UTC, 11 replies.
- [PR] [SPARK-49199][BUILD] `build/mvn` should check project local install Maven ahead [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/08/12 02:44:40 UTC, 1 replies.
- Re: [PR] [SPARK-49078][SQL][FOLLOWUP] Clear unused error methods in QueryCompilationErrors [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/12 02:52:39 UTC, 8 replies.
- [PR] [SPARK-49200][SQL] Fix null type non-codegen ordering exception [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2024/08/12 03:18:34 UTC, 5 replies.
- Re: [PR] [SPARK-48347][SQL] Support for WHILE statement [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/12 03:35:54 UTC, 9 replies.
- [PR] [SPARK-49201][PS][PYTHON][CONNECT] Reimplement `hist` plot with Spark SQL [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/08/12 03:42:17 UTC, 4 replies.
- Re: [PR] [SPARK-48754] Adding Integration Tests [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/08/12 04:25:49 UTC, 1 replies.
- Re: [PR] [SPARK-49173][CONNECT] Change Spark Connect shell prompt from `@` to `scala>` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/12 05:25:35 UTC, 3 replies.
- Re: [PR] [SPARK-49199][BUILD] `build/mvn` should check project local installed Maven ahead [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/12 05:46:05 UTC, 4 replies.
- [PR] Adding additional tests [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/08/12 05:51:52 UTC, 2 replies.
- Re: [PR] [SPARK-49078][SQL][FOLLOWUP] Clear unused showColumnsNotSupportedForV2TablesError in QueryCompilationErrors and add more uts [spark] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/08/12 06:10:59 UTC, 3 replies.
- [PR] Publish 3.5.2 to docker registry [spark-docker] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/12 06:20:40 UTC, 17 replies.
- [PR] [SPARK-49204][SQL] Fix surrogate pair handling in string expressions [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/12 07:01:24 UTC, 0 replies.
- [PR] [SPARK-49204][SQL] Fix surrogate pair handling in StringReplace [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/12 07:19:56 UTC, 2 replies.
- [PR] [SPARK-49204][SQL] Fix surrogate pair handling in StringInstr and StringLocate [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/12 07:28:29 UTC, 2 replies.
- Re: [PR] [SPARK-47741] Added stack overflow handling in parser [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/12 07:33:19 UTC, 3 replies.
- [PR] [SPARK-49204][SQL] Fix surrogate pair handling in SubstringIndex [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/12 07:34:40 UTC, 2 replies.
- [PR] [SPARK-49204][SQL] Fix surrogate pair handling in StringTrim [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/12 07:39:09 UTC, 2 replies.
- [PR] [SPARK-49206][CORE][UI] Add `Environment Variables` table to Master `EnvironmentPage` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/12 07:46:22 UTC, 3 replies.
- [PR] [SPARK-49207][SQL] Fix one-to-many case mapping in SplitPart and StringSplitSQL [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/12 07:48:38 UTC, 2 replies.
- [PR] [WIP][SPARK-49121][SQL] Support `from_protobuf` and `to_protobuf` for SQL functions [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/08/12 08:19:05 UTC, 1 replies.
- Re: [PR] [SPARK-46632][SQL] Fix subexpression elimination when equivalent ternary expressions have different children [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/12 08:29:27 UTC, 2 replies.
- Re: [PR] [SPARK-49208][SQL] Add more tests for toYearMonthIntervalString(… [spark] - posted by "nemanjapetr-db (via GitHub)" <gi...@apache.org> on 2024/08/12 08:56:36 UTC, 5 replies.
- Re: [PR] [DO-NOT-MERGE] Verifying Run documentation build [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/12 09:22:06 UTC, 0 replies.
- [PR] [SPARK-49210][SQL] Support driver metrics for DS v2 write [spark] - posted by "Zouxxyy (via GitHub)" <gi...@apache.org> on 2024/08/12 10:01:26 UTC, 1 replies.
- [PR] [SPARK-47741][SQL][TESTS][FOLLOWUP] Make `EXEC IMMEDIATE STACK OVERFLOW` in `ExecuteImmediateEndToEndSuite` check existing exception [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/12 11:12:59 UTC, 0 replies.
- Re: [PR] [SPARK-47741][SQL][TESTS][FOLLOWUP] Make `EXEC IMMEDIATE STACK OVERFLOW` in `ExecuteImmediateEndToEndSuite` check the actual target exception [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/12 11:24:25 UTC, 0 replies.
- [PR] [SPARK-48463][ML] Make Binarizer, Bucketizer, VectorAssembler, FeatureHasher, QuantizeDiscretizer, OnehotEncoder, StopWordsRemover, Imputer, Interactor supporting nested input columns [spark] - posted by "WeichenXu123 (via GitHub)" <gi...@apache.org> on 2024/08/12 11:32:05 UTC, 2 replies.
- Re: [PR] [SPARK-49208][SQL][TESTS] Add more tests for negative MONTH intervals [spark] - posted by "nemanjapetr-db (via GitHub)" <gi...@apache.org> on 2024/08/12 11:40:38 UTC, 4 replies.
- [PR] [SPARK-49187][BUILD] Upgrade slf4j to 2.0.16 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/12 11:52:28 UTC, 2 replies.
- [PR] Support arrow.LIST in data frame.Collect() [spark-connect-go] - posted by "rraymondgh (via GitHub)" <gi...@apache.org> on 2024/08/12 11:59:51 UTC, 2 replies.
- Re: [PR] [SPARK-47257][SQL] Assign names to error classes _LEGACY_ERROR_TEMP_105[3-4] and _LEGACY_ERROR_TEMP_1331 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/08/12 12:40:15 UTC, 5 replies.
- Re: [PR] [SPARK-48755][SS][PYTHON] transformWithState pyspark base implementation and ValueState support [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/08/12 13:24:57 UTC, 16 replies.
- Re: [PR] [SPARK-34366][SQL] Add interface for DS v2 metrics [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/12 13:56:12 UTC, 2 replies.
- [PR] [SPARK-49038][SQL] SQLMetric should report the raw value in the accumulator update event [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/12 14:43:21 UTC, 12 replies.
- Re: [PR] [SPARK-47741][SQL][TESTS][FOLLOWUP] Make `EXEC IMMEDIATE STACK OVERFLOW` in `ExecuteImmediateEndToEndSuite` check the intercepted exception [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/12 14:52:32 UTC, 2 replies.
- [PR] [3.5] fix compilation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/12 15:02:05 UTC, 0 replies.
- Re: [PR] [SPARK-49183][SQL][FOLLOWUP][3.5] Fix compilation [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/12 15:45:23 UTC, 3 replies.
- Re: [PR] [SPARK-48784][SQL] Add ::: syntax as a shorthand for try_cast [spark] - posted by "gene-db (via GitHub)" <gi...@apache.org> on 2024/08/12 16:45:51 UTC, 0 replies.
- [PR] [SPARK-49211][SQL] V2 Catalog can also support built-in data sources [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2024/08/12 18:42:17 UTC, 47 replies.
- Re: [PR] [SPARK-49146][SS] Move assertion errors related to watermark missing in append mode streaming queries to error framework [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2024/08/12 21:07:12 UTC, 2 replies.
- [PR] [SPARK-49213][SQL] Add collation support unit tests for comparison and equality [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/12 22:08:49 UTC, 0 replies.
- [PR] [SPARK-49213][SQL] Add collation support unit tests for Contains, StartsWith, and EndsWith [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/12 22:11:55 UTC, 0 replies.
- [PR] [SPARK-49213][SQL] Add collation support unit tests for Upper, Lower, and InitCap [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/12 22:15:40 UTC, 0 replies.
- [PR] [SPARK-49213][SQL] Add collation support unit tests for FindInSet [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/12 22:18:35 UTC, 0 replies.
- [PR] [SPARK-49213][SQL] Add collation support unit tests for StringTranslate [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/12 22:21:36 UTC, 0 replies.
- Re: [PR] [SPARK-48674][Connect] Extracted error handling functions from SparkConnectService to a trait. [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/12 23:40:17 UTC, 0 replies.
- [PR] [SPARK-48398] Add Helm chart for Operator Deployment [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/08/12 23:51:13 UTC, 6 replies.
- [PR] [WIP] TWS VCF Integration [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/08/13 02:16:54 UTC, 0 replies.
- [PR] [SPARK-49215][PYTHON][DOCS] Document the NaN handling in df.na.drop [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/08/13 03:17:19 UTC, 2 replies.
- [PR] Fix to not log message context with explicitly LogEntry constructed when Structured Logging conf is off [spark] - posted by "anchovYu (via GitHub)" <gi...@apache.org> on 2024/08/13 03:42:35 UTC, 1 replies.
- Re: [PR] [SPARK-49216][CORE]Fix to not log message context with explicitly LogEntry constructed when Structured Logging conf is off [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/08/13 04:07:17 UTC, 5 replies.
- [PR] [SPARK-49217][CORE] Support separate buffer size configuration in UnsafeShuffleWriter [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/08/13 04:48:31 UTC, 4 replies.
- [PR] [SPARK-49205][SQL] KeyGroupedPartitioning should inherit HashPartitioningLike [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2024/08/13 05:23:59 UTC, 5 replies.
- [PR] Publish 3.4.3 to docker registry [spark-docker] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/13 05:58:50 UTC, 1 replies.
- [PR] [SPARK-49179][SQL][3.5] Fix v2 multi bucketed inner joins throw AssertionError [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2024/08/13 05:59:15 UTC, 2 replies.
- [PR] [SPARK-49179][SQL][3.4] Fix v2 multi bucketed inner joins throw AssertionError [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2024/08/13 06:07:30 UTC, 2 replies.
- [PR] ODP-2020|ODP-1095 Critical CVE fixes patch [spark] - posted by "senthh (via GitHub)" <gi...@apache.org> on 2024/08/13 07:40:41 UTC, 1 replies.
- [PR] [SPARK-48760][SQL][FOLLOWUP] Override `hashCode` method for `TableChange.ClusterBy` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/13 08:16:35 UTC, 2 replies.
- [PR] [WIP][INFRA]Fix compilation warnings related to `Regular tasks always evaluate task dependencies (.value) regardless of if expressions` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/13 09:34:49 UTC, 0 replies.
- [PR] [SPARK-49222][SQL] Clear useless methods in QueryCompilationErrors [spark] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/08/13 09:49:03 UTC, 20 replies.
- Re: [PR] [SPARK-49221][BUILD] Fix sbt compilation warnings related to `Regular tasks always evaluate task dependencies (.value) regardless of if expressions` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/13 10:55:40 UTC, 4 replies.
- [PR] [SPARK-49203][SQL] Add expression for `java.util.Arrays.binarySearch` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/13 11:54:48 UTC, 36 replies.
- Re: [PR] [SPARK-48493][PYTHON] Enhance Python Datasource Reader with direct Arrow Batch support for improved performance [spark] - posted by "LucaCanali (via GitHub)" <gi...@apache.org> on 2024/08/13 12:46:57 UTC, 4 replies.
- [PR] [SPARK-49223][ML][SQL] Introduce an expression for multi-column grouped count [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/08/13 13:20:53 UTC, 3 replies.
- [PR] [SPARK-49224][TESTS] Regenerate benchmark results [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/13 16:12:59 UTC, 19 replies.
- [PR] [MINOR] Upgrade to Spark 3.5.2 in the docs and CI [spark-connect-go] - posted by "haoxins (via GitHub)" <gi...@apache.org> on 2024/08/13 16:20:14 UTC, 1 replies.
- [PR] [SPARK-48873][FOLLOWUP] Add useUnsafeRow to JSON options. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/08/13 17:10:15 UTC, 2 replies.
- [PR] [SPARK-49225][SQL][CONNECT] Add ColumnNode sql & normalize [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/13 17:19:35 UTC, 3 replies.
- [PR] [SPARK-49226][SQL] Clean-up UDF code generation [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/13 18:30:08 UTC, 3 replies.
- Re: [PR] [SPARK-48966][SQL] Improve error message with invalid unresolved column reference in UDTF call [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/08/13 19:07:32 UTC, 3 replies.
- Re: [PR] [SPARK-48913][SQL] Implement IndentingXMLStreamWriter [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/13 22:24:03 UTC, 3 replies.
- Re: [PR] [WIP][SPARK-49223][ML][SQL] Introduce an expression for multi-column grouped count [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/08/14 02:00:36 UTC, 0 replies.
- [PR] Revert "[SPARK-48628][CORE] Add task peak on/off heap memory metrics" [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/14 02:12:59 UTC, 5 replies.
- [PR] [SPARK-49232][INFRA][TESTS] Remove the logic related to `SKIP_SPARK_RELEASE_VERSIONS` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/14 02:44:15 UTC, 6 replies.
- [PR] [SPARK-49038][SQL][3.5] SQLMetric should report the raw value in the accumulator update event [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/14 03:37:32 UTC, 3 replies.
- [PR] [SPARK-49234][BUILD] Upgrade `xz` to `1.10` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/14 04:57:24 UTC, 10 replies.
- [PR] [SPARK-48913][BUILD][FOLLOWUP] Remove `txw2` from `LICENSE-binary` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/14 05:13:16 UTC, 1 replies.
- Re: [PR] [SPARK-48913][BUILD][FOLLOWUP] Remove `txw2` from `LICENSE-binary` and delete `LICENSE-txw2.txt` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/14 05:32:41 UTC, 3 replies.
- [PR] [MINOR][DOCS] Explicitly mention RDD/SparkContext are unsupported in Spark Connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/14 06:02:47 UTC, 2 replies.
- [PR] [SPARK-45854] listTables should not fail with a temp view and DelegatingCatalogExtension [spark] - posted by "clee704 (via GitHub)" <gi...@apache.org> on 2024/08/14 06:03:22 UTC, 0 replies.
- Re: [PR] [SPARK-49232][INFRA][TESTS] Remove `3.4.2` from `SKIP_SPARK_RELEASE_VERSIONS` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/14 06:04:26 UTC, 3 replies.
- Re: [PR] [SPARK-48873][SQL][FOLLOWUP] Add useUnsafeRow to JSON options. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/08/14 06:56:53 UTC, 7 replies.
- Re: [PR] [SPARK-47210][SQL] Addition of implicit casting without indeterminate support [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/08/14 07:06:49 UTC, 0 replies.
- Re: [PR] [SPARK-48618][SQL] Utilize the `ErrorCode` and `SQLState` returned in SQLException to make errors more accurate [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/14 07:19:40 UTC, 2 replies.
- Re: [PR] [SPARK-48549][SQL] Restrict the number of parameters for function `sentences` to `1` or `3` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/14 07:34:14 UTC, 5 replies.
- [PR] [SPARK-XXXX] Adding Builtin Functions [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/08/14 08:24:55 UTC, 0 replies.
- Re: [PR] [SPARK-48355][SQL] Support for CASE statement [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2024/08/14 08:49:02 UTC, 17 replies.
- [PR] [SPARK-49137][SQL] Assign a reasonable error condition, when the Boolean condition in the if statement return an empty row [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/14 09:03:07 UTC, 0 replies.
- Re: [PR] [SPARK-47323][K8S] Support custom executor log urls [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/08/14 09:09:30 UTC, 1 replies.
- Re: [PR] [SPARK-49137][SQL] Assign a reasonable error condition, when the Boolean condition in the if statement returns an empty row [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/14 09:10:54 UTC, 0 replies.
- Re: [PR] [SPARK-49137][SQL][FOLLOWUP] Assign a reasonable error condition, when the Boolean condition in the if statement returns an empty row [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/08/14 09:52:09 UTC, 10 replies.
- [PR] [SPARK-47265][SQL][FOLLOWUP] V2SessionCatalog#createTable should not fail [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/14 10:51:07 UTC, 4 replies.
- [PR] [SPARK-48358][SQL] Support for REPEAT statement [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2024/08/14 11:17:32 UTC, 7 replies.
- [PR] [SQL] Remove unnecessary asserts from loop iterators [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2024/08/14 11:48:46 UTC, 0 replies.
- Re: [PR] [SPARK-47258][SQL] Assign names to error classes _LEGACY_ERROR_TEMP_127[0-5] [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/08/14 12:59:45 UTC, 6 replies.
- Re: [PR] [SPARK-49016][SQL] Restore the behavior that queries from raw CSV files are disallowed when only include corrupt record column and assign name to `_LEGACY_ERROR_TEMP_1285` [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/08/14 13:35:25 UTC, 9 replies.
- [PR] SPARK-45590: Upgrade okio to 1.17.6 from 1.15.0 [spark] - posted by "roczei (via GitHub)" <gi...@apache.org> on 2024/08/14 14:24:55 UTC, 0 replies.
- [PR] [SPARK-49152][SQL][FOLLOWUP] table location string should be Hadoop Path string [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/14 14:39:27 UTC, 8 replies.
- Re: [PR] [SPARK-45590][BUILD] Upgrade okio to 1.17.6 from 1.15.0 [spark] - posted by "roczei (via GitHub)" <gi...@apache.org> on 2024/08/14 14:44:00 UTC, 5 replies.
- Re: [PR] [SQL] Bind JDBC dialect to JDBCRDD at construction [spark] - posted by "johnnywalker (via GitHub)" <gi...@apache.org> on 2024/08/14 15:14:01 UTC, 10 replies.
- [PR] [SPARK-49235] Refactor ResolveInlineTables rule so it doesn't traverse the whole tree [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2024/08/14 15:58:39 UTC, 0 replies.
- [PR] [SPARK-49236] Update `README.md` with `build/test/CI` info [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/14 16:28:39 UTC, 4 replies.
- [PR] [SPARK-49237] Speed up docker image building by excluding `check` instead of `test` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/14 17:39:22 UTC, 4 replies.
- [PR] [SPARK-49238] Upgrade Gradle to 8.10 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/14 18:03:39 UTC, 3 replies.
- [PR] [SPARK-49239] Add `k8s-integration-tests` GitHub Action CI job [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/14 18:25:29 UTC, 3 replies.
- Re: [PR] [SPARK-49235][SQL] Refactor ResolveInlineTables rule so it doesn't traverse the whole tree [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2024/08/14 19:49:25 UTC, 3 replies.
- [PR] ODP-2032 Spark3 CVE's reconciliation from ODP-3.2.3.2-3 to ODP-main [spark] - posted by "senthh (via GitHub)" <gi...@apache.org> on 2024/08/14 20:07:02 UTC, 1 replies.
- [PR] [SPARK-49240][BUILD] Add `scalastyle` and `checkstyle` rules to avoid `URL` constructors [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/14 22:04:15 UTC, 16 replies.
- [PR] [SPARK-49241](Add OpenTelemetryPush Sink) [spark] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2024/08/14 22:21:12 UTC, 0 replies.
- Re: [PR] [SPARK-49241][CORE] Add `OpenTelemetryPush` Sink [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/14 22:30:09 UTC, 21 replies.
- [PR] [SPARK-49242][BUILD] Upgrade commons-cli to 1.9.0 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/15 00:04:14 UTC, 2 replies.
- [PR] [SPARK-49152][SQL][FOLLOWUP][3.5] table location string should be Hadoop Path string [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/15 00:11:47 UTC, 4 replies.
- Re: [PR] [SPARK-48947][SQL] Use lowercased charset name to decrease cache missing in Charset.forName [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/15 02:21:42 UTC, 2 replies.
- [PR] [SPARK-49243][INFRA][K8S] Add `OpenContainers` Annotations in docker images [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/15 04:10:15 UTC, 26 replies.
- Re: [PR] [SPARK-48796][SS] Load Column Family Id from State Schema for VCF when restarting [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/08/15 05:55:20 UTC, 14 replies.
- [PR] [MINOR][SQL] Changes the `test:runMain` description related to run command in the code comments to `Test/runMain` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/15 07:42:52 UTC, 0 replies.
- Re: [PR] [MINOR][SQL] Changes the `test:runMain` in the code comments to `Test/runMain` [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/15 08:34:52 UTC, 0 replies.
- Re: [PR] [MINOR][SQL][TESTS] Changes the `test:runMain` in the code comments to `Test/runMain` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/15 08:39:51 UTC, 2 replies.
- Re: [PR] [WIP][SQL] Refactor the implementation of `SparkDateTimeUtils#toJavaDate` [spark] - posted by "nadavwr (via GitHub)" <gi...@apache.org> on 2024/08/15 08:49:24 UTC, 3 replies.
- [PR] Allowing GitHub Issues and Projects [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/08/15 09:28:25 UTC, 2 replies.
- [PR] Cache v2 [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/08/15 09:55:57 UTC, 0 replies.
- [I] Adding Builtin Functions [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/08/15 10:45:50 UTC, 0 replies.
- [I] Add support for Config() API [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/08/15 10:56:03 UTC, 0 replies.
- Re: [PR] [SPARK-46798][Structured Streaming] Kafka custom partition location assignment (rack awareness) [spark] - posted by "unbalanced (via GitHub)" <gi...@apache.org> on 2024/08/15 11:08:06 UTC, 7 replies.
- Re: [PR] [MINOR][SQL] Remove unnecessary asserts from loop iterators [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/08/15 11:46:21 UTC, 0 replies.
- [PR] Refactor ResolveBinaryArithmetic [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2024/08/15 12:03:17 UTC, 1 replies.
- [PR] [SPARK-45590][BUILD][3.5] Upgrade okio to 1.17.6 from 1.15.0 [spark] - posted by "roczei (via GitHub)" <gi...@apache.org> on 2024/08/15 12:37:37 UTC, 4 replies.
- [PR] [SPARK-45590][BUILD][3.4] Upgrade okio to 1.17.6 from 1.15.0 [spark] - posted by "roczei (via GitHub)" <gi...@apache.org> on 2024/08/15 13:02:55 UTC, 3 replies.
- [I] Add support for Interrupt() [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/08/15 13:03:28 UTC, 0 replies.
- [PR] [WIP] Changed initCap behaviour with UTF8_BINARY collation [spark] - posted by "viktorluc-db (via GitHub)" <gi...@apache.org> on 2024/08/15 13:04:03 UTC, 15 replies.
- [PR] [SPARK-49246][SQL] TableCatalog#loadTable should indicate if it's for writing [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/15 13:54:29 UTC, 12 replies.
- Re: [PR] [MINOR] Properly Cache Artifacts in CI [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/08/15 14:58:30 UTC, 1 replies.
- [PR] [SPARK-49245] [SQL] Refactor some analyzer rules [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2024/08/15 15:03:48 UTC, 3 replies.
- [PR] [SPARK-49251][BUILD] Upgrade ORC to 2.0.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/15 16:04:09 UTC, 5 replies.
- [PR] [SPARK-49250][SQL] Improve error message for nested UnresolvedWindowExpression in CheckAnalysis [spark] - posted by "vladimirg-db (via GitHub)" <gi...@apache.org> on 2024/08/15 16:22:40 UTC, 3 replies.
- Re: [PR] [SPARK-48682][SQL][FOLLOWUP] Changed initCap behaviour with UTF8_BINARY collation [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/15 16:33:14 UTC, 14 replies.
- Re: [PR] [SPARK-48796][SS] Load Column Family Id from RocksDBCheckpointMetadata for VCF when restarting [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/08/15 20:39:16 UTC, 26 replies.
- Re: [PR] [SPARK-48398] Add Helm Chart [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/15 22:01:55 UTC, 1 replies.
- [PR] [SPARK-49253] Install and test Helm chart in K8s integration test CI [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/15 22:09:34 UTC, 4 replies.
- [PR] Load Column Family Id from RocksDBCheckpointMetadata for VCF when res… [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/08/15 22:13:54 UTC, 5 replies.
- Re: [PR] [SPARK-49211][SQL][3.5] V2 Catalog can also support built-in data sources [spark] - posted by "amaliujia (via GitHub)" <gi...@apache.org> on 2024/08/16 00:50:21 UTC, 5 replies.
- [PR] [SPARK-49254][BUILD] Upgrade mima-core & sbt-mima-plugin to 1.1.4 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/16 00:58:54 UTC, 3 replies.
- Re: [PR] [SPARK-48960][CONNECT] Makes spark-submit works with Spark connect [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/16 01:07:08 UTC, 24 replies.
- [PR] [MINOR][DOCS] Use `SparkSession.builder.getOrCreate()` over the deprecated `build()` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/16 01:52:40 UTC, 2 replies.
- [PR] [SPARK-49255][BUILD][K8S] Upgrade `kubernetes-client` to 6.13.3 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/16 02:07:54 UTC, 3 replies.
- Re: [PR] [SPARK-48714][PYTHON] Implement `DataFrame.mergeInto` in PySpark [spark] - posted by "yashgangrades (via GitHub)" <gi...@apache.org> on 2024/08/16 02:13:09 UTC, 4 replies.
- [PR] [SPARK-48803][FOLLOWUP] Remove unused error-condition `_LEGACY_ERROR_TEMP_2088` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/16 02:20:05 UTC, 3 replies.
- [PR] [SPARK-49256] Upgrade `kubernetes-client` to 6.13.3 and `commons-langUpgrade `kubernetes-client` to 6.13.3 and `commons-lang3` to 3.16.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/16 02:22:56 UTC, 0 replies.
- Re: [PR] [SPARK-49256] Upgrade `kubernetes-client` to 6.13.3 and `commons-lang3` to 3.16.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/16 02:27:06 UTC, 2 replies.
- [PR] [SPARK-49257][INFRA] Make `bundler install` can retry [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/16 03:21:44 UTC, 2 replies.
- [PR] [WIP][SPARK-49025][CONNECT] Remove Column.expr and Column.apply(Expression) from Column [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/16 03:42:47 UTC, 4 replies.
- [PR] [SPARK-49258] Add `pi.yaml` example and update README.md [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/16 04:03:37 UTC, 3 replies.
- Re: [PR] [SPARK-48873][SQL][FOLLOW-UP] Add useUnsafeRow to JSON options. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/08/16 05:42:10 UTC, 2 replies.
- [PR] [MINOR] fix the warning of go mod [spark-connect-go] - posted by "haoxins (via GitHub)" <gi...@apache.org> on 2024/08/16 07:18:03 UTC, 4 replies.
- [PR] [MINOR] fix the example in the quick start doc [spark-connect-go] - posted by "haoxins (via GitHub)" <gi...@apache.org> on 2024/08/16 07:31:27 UTC, 3 replies.
- [PR] [WIP] No longer prepend the classes path of `sql/core` module in Spark Connect Shell [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/16 07:39:31 UTC, 2 replies.
- [PR] [WIP][SPARK-48066][SQL][TESTS] Enable ANSI for TPCDSQueryBenchmark [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/16 07:41:17 UTC, 8 replies.
- Re: [PR] [SPARK-38862][Core] - allow integration of a secure gateway to SparkSubmissionServer alongside spark.authenticate props [spark] - posted by "ScrapCodes (via GitHub)" <gi...@apache.org> on 2024/08/16 08:39:47 UTC, 2 replies.
- [PR] Add width style for shuffle-write-time-checkbox-div [spark] - posted by "xunxunmimi5577 (via GitHub)" <gi...@apache.org> on 2024/08/16 08:55:41 UTC, 1 replies.
- Re: [PR] [SPARK-48682][SQL][FOLLOW-UP] Changed initCap behaviour with UTF8_BINARY collation [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/16 09:20:21 UTC, 33 replies.
- [I] Proposal: Add `Iter` for `DataFrame` interface [spark-connect-go] - posted by "haoxins (via GitHub)" <gi...@apache.org> on 2024/08/16 09:28:37 UTC, 2 replies.
- Re: [PR] [SPARK-48066][SQL][TESTS] Enable ANSI for TPCDSQueryBenchmark [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/16 10:19:03 UTC, 1 replies.
- [PR] [WIP][SLQ] Add trimming sensitivity support for collations [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/16 10:54:11 UTC, 0 replies.
- Re: [PR] [SPARK-49260][CONNECT] No longer prepend the classes path of `sql/core` module in Spark Connect Shell [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/16 12:08:49 UTC, 5 replies.
- Re: [PR] [SPARK-49249][SPARK-49122][Connect][SQL] Add `addArtifact` API to the Spark SQL Core [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/08/16 12:26:33 UTC, 4 replies.
- [PR] [SPARK-49263] [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2024/08/16 13:16:25 UTC, 0 replies.
- Re: [PR] [SPARK-49263] Spark Connect python client: Consistently handle boolean Dataframe reader options [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2024/08/16 13:18:46 UTC, 0 replies.
- Re: [PR] [SPARK-49213][SQL][TESTS] Add collation support unit tests for comparison and equality [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/08/16 14:47:28 UTC, 1 replies.
- Re: [PR] [SPARK-49265][SQL][TESTS] Add collation support unit tests for Upper, Lower, and InitCap [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/08/16 17:18:10 UTC, 1 replies.
- Re: [PR] [SPARK-24252][SQL] Add v2 catalog plugin system [spark] - posted by "juliuszsompolski (via GitHub)" <gi...@apache.org> on 2024/08/16 17:20:18 UTC, 1 replies.
- [PR] [SQL] Eagerly evaluate VALUES() list in AstBuilder [spark] - posted by "costas-db (via GitHub)" <gi...@apache.org> on 2024/08/16 19:56:40 UTC, 0 replies.
- [PR] [SPARK-45891][FOLLOW-UP][VARIANT] Address post-merge comments [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/08/16 21:20:34 UTC, 3 replies.
- Re: [PR] [SPARK-45891][SQL][PYTHON][VARIANT] Add support for interval types in the Variant Spec [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/08/16 21:21:00 UTC, 0 replies.
- [PR] [SPARK-49252] Make`TaskSetExcludeList` and `HeathTracker` independent [spark] - posted by "tianhanhu (via GitHub)" <gi...@apache.org> on 2024/08/16 21:31:50 UTC, 1 replies.
- [PR] [SPARK-49268][CORE] Log IO exceptions in SHS history provider [spark] - posted by "robreeves (via GitHub)" <gi...@apache.org> on 2024/08/16 21:34:11 UTC, 12 replies.
- [PR] [SPARK-49270] Add `sql.yaml` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/16 21:56:44 UTC, 4 replies.
- [PR] [SPARK-49271] Improve `gradlew` to support both `curl` and `wget` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/16 22:19:33 UTC, 4 replies.
- [PR] [SPARK-49272] Update `Dockerfile` to use `alpine/java:17-jdk` instead of `gradle:8.9.0-jdk17-jammy` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/16 22:44:30 UTC, 9 replies.
- Re: [PR] [SPARK-49022] Use Column Node API in Column [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/17 00:28:55 UTC, 8 replies.
- Re: [PR] [SPARK-49269][SQL] Eagerly evaluate VALUES() list in AstBuilder [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/17 02:15:32 UTC, 3 replies.
- [PR] [SPARK-48867][BUILD] Upgrade `okhttp` to 4.12.0 and `okio` to 3.6.0 [spark] - posted by "roczei (via GitHub)" <gi...@apache.org> on 2024/08/17 13:31:36 UTC, 1 replies.
- [PR] [SPARK-49275][SQL] Fix return type nullness of the xpath expression [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/08/17 17:15:20 UTC, 7 replies.
- Re: [PR] [SPARK-48867][BUILD] Upgrade `okhttp` to 4.12.0 and `okio` to 3.9.0 [spark] - posted by "roczei (via GitHub)" <gi...@apache.org> on 2024/08/17 19:15:39 UTC, 25 replies.
- [PR] [SPARK-49276] Use API Group `spark.apache.org` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/17 21:44:13 UTC, 4 replies.
- [PR] [SPARK-49277] Refactor `RestartPolicyTest` to test per case [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/18 02:31:09 UTC, 4 replies.
- Re: [PR] [SPARK-49025][CONNECT] Make Column implementation agnostic [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/18 03:31:24 UTC, 4 replies.
- [PR] [SPARK-49278] Revise `reconciler` package [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/18 04:20:06 UTC, 1 replies.
- [PR] [SPARK-49279] Revise `observers` package [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/18 05:22:13 UTC, 2 replies.
- [PR] [SPARK-49280] Add `pi-with-one-pod.yaml` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/18 05:35:40 UTC, 4 replies.
- Re: [PR] [SPARK-49278] Revise `reconcilesteps` package and `SparkAppReconciler` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/18 06:09:45 UTC, 1 replies.
- Re: [PR] [SPARK-49264][SQL][TESTS] Add collation support unit tests for Contains, StartsWith, and EndsWith [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/08/18 07:54:13 UTC, 1 replies.
- [PR] [SPARK-48796][SQL] Optimze parquet binary getBytes with getBytesUnsafe to avoid copy cost [spark] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/08/18 13:13:06 UTC, 8 replies.
- [PR] Add width attribute for shuffle-write-time checkbox. [spark] - posted by "xunxunmimi5577 (via GitHub)" <gi...@apache.org> on 2024/08/18 15:33:08 UTC, 1 replies.
- [PR] [SPARK-49289] Fix `docker-entrypoint.sh` to quote the environment variables [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/18 22:35:14 UTC, 2 replies.
- [PR] [SPARK-49290] Remove `commons-lang3` dependency from `spark-operator-api` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/18 22:57:31 UTC, 3 replies.
- Re: [PR] [SPARK-49263][CONNECT] Spark Connect python client: Consistently handle boolean Dataframe reader options [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/18 23:53:48 UTC, 9 replies.
- Re: [PR] [SPARK-49252][CORE] Make`TaskSetExcludeList` and `HeathTracker` independent [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/19 00:28:21 UTC, 13 replies.
- [PR] [SPARK-49291] Fix `javadoc` generation and add `lint` test pipeline to prevent [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/19 01:51:33 UTC, 4 replies.
- [PR] [SPARK-49292][BUILD] Upgrade dropwizard metrics to 4.2.27 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/19 02:08:23 UTC, 5 replies.
- [PR] [SPARK-49293] Add `_MESSAGE` postfix to `DRIVER_(READY|RUNNING)` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/19 02:10:29 UTC, 2 replies.
- [PR] [SPARK-49295] Add `NOTICE`, `NOTICE-binary`, `LICENSE-binary` files and update `*.gradle` files [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/19 02:33:14 UTC, 3 replies.
- Re: [PR] [SPARK-49294]Add width attribute for shuffle-write-time checkbox. [spark] - posted by "xunxunmimi5577 (via GitHub)" <gi...@apache.org> on 2024/08/19 03:20:30 UTC, 0 replies.
- [PR] [SPARK-49296] Add `deploy.gradle` to support publish-related tasks [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/19 03:30:46 UTC, 2 replies.
- [PR] [MINOR] Use `IOException` in `SparkOperatorConfManager` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/19 04:31:14 UTC, 2 replies.
- [PR] [SPARK-49298] Reduce `spark-operator` fat jar size by excluding dependencies [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/19 06:11:52 UTC, 14 replies.
- [PR] [SPARK-49299] Add `buildDockerImage` Gradle Task [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/19 07:24:25 UTC, 5 replies.
- [PR] [SPARK-49300][CORE]Fix Hadoop delegation token leak when tokenRenewalInterval is not set. [spark] - posted by "zhangshuyan0 (via GitHub)" <gi...@apache.org> on 2024/08/19 08:38:39 UTC, 14 replies.
- Re: [PR] [SPARK-49266][SQL][TESTS] Add collation support unit tests for FindInSet [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/08/19 11:06:41 UTC, 1 replies.
- [PR] [SPARK-49190][K8S][FOLLOW-UP] Add how to populate executor log url vars with env vars [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/08/19 11:18:44 UTC, 5 replies.
- [PR] [SPARK-47262] Renamed legacy classes for Parquet conversion errors [spark] - posted by "vladanvasi-db (via GitHub)" <gi...@apache.org> on 2024/08/19 14:33:19 UTC, 0 replies.
- [PR] [SPARK-49244][SQL] Further exception improvements for parser/interpreter [spark] - posted by "dusantism-db (via GitHub)" <gi...@apache.org> on 2024/08/19 15:20:40 UTC, 9 replies.
- [PR] [SPARK-49301][SS] Chunk arrow data passed to Python worker [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2024/08/19 17:58:56 UTC, 3 replies.
- [PR] [SPARK-49303] Implement TTL for ValueState in transformWithStateInPandas API [spark] - posted by "chaoqin-li1123 (via GitHub)" <gi...@apache.org> on 2024/08/19 18:25:56 UTC, 1 replies.
- [PR] [SPARK-49304] Add `-SNAPSHOT` postfix to `Spark Operator` version [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/19 18:48:21 UTC, 5 replies.
- [PR] [SPARK-49305] Revise `Spark Operator` docker image [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/19 19:27:07 UTC, 2 replies.
- [PR] [SPARK-49274][CONNECT] Support java serialization based encoders [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/19 20:14:38 UTC, 4 replies.
- [PR] [SPARK-49309] Use `HTTP_*` constant variables instead of magic numbers [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/19 21:08:24 UTC, 6 replies.
- [PR] [SPARK-49310][BUILD] Test Parquet 1.14.2 [spark] - posted by "Fokko (via GitHub)" <gi...@apache.org> on 2024/08/19 21:18:24 UTC, 1 replies.
- [PR] [SPARK-49311] Make it possible for large 'interval second' values to be cast to decimal [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/08/19 22:43:48 UTC, 0 replies.
- Re: [PR] [SPARK-49121][SQL] Support `from_protobuf` and `to_protobuf` for SQL functions [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/08/20 00:18:42 UTC, 11 replies.
- [PR] [SPARK-49313][BUILD][TESTS] Upgrade `DB2` & `MySQL` & `Postgres` & `Mariadb` docker image version [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/20 01:50:15 UTC, 4 replies.
- [PR] [SPARK-49314][BUILD][TESTS] Upgrade `h2` to 2.3.232 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/08/20 01:57:49 UTC, 0 replies.
- [PR] [SPARK-49312][PYTHON] Improve error message for `assertSchemaEqual` [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/08/20 02:00:02 UTC, 2 replies.
- Re: [PR] [SPARK-49075][BUILD] Upgrade JUnit5 related to the latest version [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/20 02:38:17 UTC, 3 replies.
- Re: [PR] [SPARK-40425][SQL] DROP TABLE does not need to do table lookup [spark] - posted by "gaecoli (via GitHub)" <gi...@apache.org> on 2024/08/20 03:06:08 UTC, 0 replies.
- Re: [PR] [SPARK-43203][SQL] Move all Drop Table case to DataSource V2 [spark] - posted by "gaecoli (via GitHub)" <gi...@apache.org> on 2024/08/20 03:07:35 UTC, 4 replies.
- [PR] [SPARK-49315] Generalize `relocateGeneratedCRD` Gradle Task to handle `*.spark.apache.org-v1.yml` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/20 03:24:32 UTC, 3 replies.
- [PR] [SPARK-49316] Generalize `printer-columns.sh` to handle `*.spark.apache.org-v1.yml` files [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/20 03:38:50 UTC, 3 replies.
- [PR] [SPARK-49026][CONNECT] Add ColumnNode to Proto conversion [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/20 04:21:21 UTC, 2 replies.
- [PR] [WIP][SQL] Preempt low priority error on LCA until end of check analysis to improve error experience [spark] - posted by "anchovYu (via GitHub)" <gi...@apache.org> on 2024/08/20 05:00:04 UTC, 0 replies.
- [PR] [SPARK-49317] Add `pi-on-yunikorn.yaml` example and update `README.md` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/20 05:03:19 UTC, 4 replies.
- [PR] [SPARK-49319] Add `SparkCluster` to `spark-operator-api` module and examples [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/20 06:43:25 UTC, 5 replies.
- Re: [PR] [SPARK-49267][SQL][TESTS] Add collation support unit tests for StringTranslate [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/08/20 07:09:13 UTC, 1 replies.
- [PR] [SPARK-49017][SQL] Insert statement fails when multiple parameters are being used (Backport) [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/08/20 07:27:00 UTC, 1 replies.
- Re: [PR] [SPARK-49017][SQL][3.5] Insert statement fails when multiple parameters are being used [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/08/20 09:53:08 UTC, 1 replies.
- [PR] [SPARK-49249][SPARK-49320] Add new tag-related APIs in Connect back to Spark Core [spark] - posted by "xupefei (via GitHub)" <gi...@apache.org> on 2024/08/20 12:26:25 UTC, 45 replies.
- Re: [PR] [SPARK-49321][SQL] Bind JDBC dialect to JDBCRDD at construction [spark] - posted by "johnnywalker (via GitHub)" <gi...@apache.org> on 2024/08/20 13:58:02 UTC, 0 replies.
- Re: [PR] [SPARK-48919][CONNECT] Move connect code generation and dependency management to a separate project [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/20 14:11:06 UTC, 0 replies.
- [PR] [CONNECT] Move MockObserver [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2024/08/20 16:06:37 UTC, 0 replies.
- [PR] [SPARK-49322] Add `SparkCluster` to `spark-submission-worker` module [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/20 16:35:18 UTC, 9 replies.
- [PR] [SPARK-49214] Add e2e test in operator workflow [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2024/08/20 17:20:58 UTC, 17 replies.
- [PR] [SPARK-49306][SQL] Create SQL function aliases for 'zeroifnull' and 'nullifzero' [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/08/20 17:57:45 UTC, 1 replies.
- [PR] [Minor] Fix spelling mistake in comment [spark] - posted by "tedyu (via GitHub)" <gi...@apache.org> on 2024/08/20 18:15:30 UTC, 0 replies.
- [PR] [SPARK-49325] Add `SparkCluster` to `spark-operator` module [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/20 18:33:07 UTC, 16 replies.
- Re: [PR] [SPARK-49323][CONNECT] Move MockObserver from Spark Connect Server's test folder to the Server's main folder [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/08/20 20:20:03 UTC, 5 replies.
- Re: [PR] [WIP][SPARK-49318][SQL] Preempt low priority error on LCA until end of check analysis to improve error experience [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/08/20 21:12:20 UTC, 1 replies.
- [PR] classify foreach user error [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/08/20 22:04:55 UTC, 0 replies.
- [PR] Handle Concurrent Create Table AS Select FROM commands [spark] - posted by "sumeet-db (via GitHub)" <gi...@apache.org> on 2024/08/20 22:04:59 UTC, 2 replies.
- Re: [PR] [SPARK-49306][SQL] Create new SQL functions 'zeroifnull' and 'nullifzero' [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/21 00:19:43 UTC, 5 replies.
- Re: [PR] [Only TEST] test jaxb-runtime 2.3.9 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/21 00:21:25 UTC, 1 replies.
- Re: [PR] [SPARK-48231][BUILD] Remove unused CodeHaus Jackson dependencies [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/21 00:21:27 UTC, 1 replies.
- Re: [PR] [SPARK-48234][SQL] Fix previous reader checks in Vectorized DELTA_BYTE_ARRAY decoder [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/21 00:21:29 UTC, 1 replies.
- Re: [PR] [SPARK-48006][SQL]add SortOrder for window function which has no orde… [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/21 00:21:30 UTC, 1 replies.
- Re: [PR] [SPARK-47954][K8S] Support creating ingress entry for external UI access [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/21 00:21:31 UTC, 1 replies.
- Re: [PR] [SPARK-47672][SQL] Avoid double eval from filter pushDown w/ projection pushdown [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/21 00:21:33 UTC, 1 replies.
- Re: [PR] [SPARK-47672][SQL] Avoid double eval from filter pushDown [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/21 00:21:34 UTC, 1 replies.
- Re: [PR] [SPARK-45720] Upgrade AWS SDK to v2 for Spark Kinesis connector module [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/21 00:21:35 UTC, 1 replies.
- Re: [PR] [SPARK-45862][PYTHON][DOCS] Add user guide for basic dataframe operations [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/21 00:21:37 UTC, 1 replies.
- [PR] [SPARK-49327][BUILD] Upgrade `commons-compress` to 1.27.1 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/21 00:48:41 UTC, 3 replies.
- [PR] [SPARK-49328] Propagate Spark configurations to `SparkCluster` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/21 01:35:59 UTC, 3 replies.
- [PR] [SPARK-49329] Support user provided spec for SparkCluster [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/08/21 01:42:05 UTC, 8 replies.
- [PR] [SPARK-49142][FOLLOWUP][CONNECT][PYTHON] Use PySparkLogger for Spark Connect client log [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/08/21 02:14:19 UTC, 2 replies.
- Re: [PR] [SPARK-49300][CORE] Fix Hadoop delegation token leak when tokenRenewalInterval is not set. [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2024/08/21 03:08:29 UTC, 6 replies.
- [PR] [SPARK-49330] Revise `InstanceConfig` to `ExecutorInstanceConfig` class [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/21 04:08:10 UTC, 6 replies.
- [PR] Use minikube action [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2024/08/21 04:26:53 UTC, 0 replies.
- Re: [PR] [SPARK-49331] Use `setup-minikube` GitHub Action [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/21 04:35:40 UTC, 4 replies.
- [PR] [SPARK-49332] Add K8s service for `Workers` to `SparkClusterResourceSpec` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/21 05:25:55 UTC, 4 replies.
- Re: [PR] [SPARK-46444][SQL] V2SessionCatalog#createTable should not load the table [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/21 05:36:59 UTC, 0 replies.
- Re: [PR] [SPARK-44473][SQL] [BUG] Overwriting the same partition of a partitioned table multiple times with empty data yields non-idempotent results [spark] - posted by "ychris78 (via GitHub)" <gi...@apache.org> on 2024/08/21 05:49:28 UTC, 0 replies.
- Re: [PR] [SPARK-47336][SQL][CONNECT] Provide to PySpark a functionality to get estimated size of DataFrame in bytes [spark] - posted by "SemyonSinchenko (via GitHub)" <gi...@apache.org> on 2024/08/21 07:11:43 UTC, 0 replies.
- Re: [PR] [SPARK-49311][SQL] Make it possible for large 'interval second' values to be cast to decimal [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/08/21 07:32:43 UTC, 8 replies.
- [PR] [SC-174553][CONNECT] Limit the nesting level when truncating a protobuf message [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/08/21 08:42:49 UTC, 0 replies.
- Re: [PR] [CONNECT] Limit the nesting level when truncating a protobuf message [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/21 08:52:14 UTC, 0 replies.
- [PR] [SPARK-49334][SQL] `str_to_map` should check whether the `collation` values of all parameter types are the same [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/21 09:07:42 UTC, 14 replies.
- [PR] [SPARK-49333][SQL] Shutdown timeout thread while cleaning up SparkExecuteStatementOperation [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2024/08/21 09:11:24 UTC, 6 replies.
- [PR] [SPARK-49335][BUILD] Upgrade Maven to 3.9.9 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/21 09:12:57 UTC, 5 replies.
- Re: [PR] [SPARK-47262][SQL] Changed Parquet conversion errors to throw SparkException.internal [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/08/21 09:21:14 UTC, 2 replies.
- [PR] [SPARK-48779][SQL][TESTS] Improve collation support testing - add golden files [spark] - posted by "viktorluc-db (via GitHub)" <gi...@apache.org> on 2024/08/21 09:59:17 UTC, 8 replies.
- [PR] [SPARK-48638][FOLLOW][CONNECT] Fix documentation for ExecutionInfo [spark] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/08/21 10:05:32 UTC, 2 replies.
- [I] Support for user agent [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/08/21 10:21:12 UTC, 0 replies.
- [PR] [MINOR] Enhance the quick start example [spark-connect-go] - posted by "haoxins (via GitHub)" <gi...@apache.org> on 2024/08/21 11:02:14 UTC, 2 replies.
- [I] Increase Code Coverage for DataFrame module [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/08/21 11:07:13 UTC, 1 replies.
- Re: [PR] #47 Adding Builtin Functions [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/08/21 11:29:17 UTC, 1 replies.
- Re: [PR] [SPARK-47262][SQL] Assign names to error conditions for parquet conversions [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/08/21 13:27:08 UTC, 4 replies.
- Re: [PR] [SPARK-49336][CONNECT] Limit the nesting level when truncating a protobuf message [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/21 14:48:49 UTC, 5 replies.
- Re: [PR] [SPARK-49300][CORE][3.5] Fix Hadoop delegation token leak when tokenRenewalInterval is not set. [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/21 15:07:01 UTC, 3 replies.
- [PR] [SPARK-49338][CORE][SQL][K8S] Make Spark Deamons support `spark.log.structuredLogging.enabled` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/21 16:15:52 UTC, 1 replies.
- [PR] [SPARK-49338][CORE][SQL][K8S] Make Spark Deamons support `spark.log.structuredLogging.enabled` property [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/21 16:55:07 UTC, 1 replies.
- [PR] [SPARK-49339]Use minikube action [spark] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2024/08/21 17:14:41 UTC, 0 replies.
- Re: [PR] Rebased value state [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/08/21 17:17:03 UTC, 0 replies.
- Re: [PR] [SPARK-49303][SS] Implement TTL for ValueState in transformWithStateInPandas API [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2024/08/21 17:32:23 UTC, 7 replies.
- [PR] [SPARK-49332][FOLLOWUP] Fix worker parameter to match with master service [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/21 17:50:55 UTC, 3 replies.
- Re: [PR] [SPARK-49338][CORE][SQL][K8S] Make Spark Deamons support `spark.log.structuredLogging.enabled` system property [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/21 17:55:07 UTC, 4 replies.
- [PR] [SPARK-49340] Document `SparkCluster` and add `submit-pi-to-prod.sh` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/21 18:16:41 UTC, 7 replies.
- [PR] [SPARK-49341] Remove `connector/docker` in favor of `Apache Spark Operator` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/21 18:34:02 UTC, 2 replies.
- Re: [PR] [SPARK-49339][INFRA] Use `setup-minikube` GitHub Action [spark] - posted by "bjornjorgensen (via GitHub)" <gi...@apache.org> on 2024/08/21 19:58:17 UTC, 12 replies.
- Re: [PR] [SPARK-49318][SQL] Preempt low priority error on LCA until end of check analysis to improve error experience [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/08/21 20:05:35 UTC, 2 replies.
- [PR] [MINOR] Add License/RepoSize status images [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/21 20:18:20 UTC, 0 replies.
- [PR] [SPARK-49342][SQL] Make TO_AVRO SQL function 'jsonFormatSchema' argument optional [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/08/21 22:00:07 UTC, 4 replies.
- Re: [PR] [SPARK-49044][SQL] ValidateExternalType should return child in error [spark] - posted by "michTalebzadeh (via GitHub)" <gi...@apache.org> on 2024/08/21 22:05:46 UTC, 0 replies.
- [PR] [SPARK-48482][PYTHON][FOLLOWUP] dropDuplicates and dropDuplicatesWIthinWatermark should accept named parameter [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/08/21 22:20:46 UTC, 11 replies.
- [PR] [SPARK-48441][SQL][FOLLOWUP] Fix StringTrim behaviour for UTF8_LCASE collation [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/21 22:27:59 UTC, 3 replies.
- Re: [PR] [MINOR] Add `License`/`RepoSize` status images [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/21 22:28:58 UTC, 1 replies.
- Re: [PR] [SPARK-49326][SS] Classify Error class for Foreach sink user function error [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2024/08/21 22:59:56 UTC, 4 replies.
- [PR] [WIP] Prototype to implement new SQL pipe syntax [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/08/21 23:33:00 UTC, 0 replies.
- [PR] [SPARK-49343] Document nightly versions of operator image and Helm Chart [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/22 00:07:07 UTC, 3 replies.
- Re: [PR] [SPARK-48255][BUILD] Guava should not respect `hadoop.deps.scope` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/22 00:21:23 UTC, 1 replies.
- Re: [PR] [SPARK-48246][BUILD] Add a new ScalaStyle Rule `RedundantIfChecker` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/22 00:21:23 UTC, 1 replies.
- Re: [PR] [Test] exclude scala.collection.Seq at java side [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/22 00:21:26 UTC, 1 replies.
- Re: [PR] [SPARK-49281][SQL] Optimze parquet binary getBytes with getBytesUnsafe to avoid copy cost [spark] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2024/08/22 01:07:27 UTC, 1 replies.
- [PR] [SPARK-49345][CONNECT] Make sure using the current running Spark Session [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/22 01:48:23 UTC, 2 replies.
- [PR] [SPARK-49027][CONNECT][SQL] Share Column API between Class and Connect [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/22 02:06:02 UTC, 34 replies.
- [PR] [SPARK-49344][PS] Support `json_normalize` for Pandas API on Spark [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/08/22 02:43:54 UTC, 5 replies.
- [PR] Final transpose [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/08/22 03:02:17 UTC, 1 replies.
- [PR] [MINOR] bump go version to 1.22 [spark-connect-go] - posted by "haoxins (via GitHub)" <gi...@apache.org> on 2024/08/22 03:14:20 UTC, 0 replies.
- Re: [PR] [SPARK-45915][SQL] Treat decimal(x, 0) the same as IntegralType in `PromoteStrings` [spark] - posted by "littlelittlewhite09 (via GitHub)" <gi...@apache.org> on 2024/08/22 03:57:18 UTC, 1 replies.
- [PR] [SPARK-49346] Add `publish_snapshot_dockerhub.yml` Daily GitHub Action job [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/22 04:01:58 UTC, 2 replies.
- [PR] [SPARK-49347][R] Deprecate SparkR [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/22 04:15:34 UTC, 5 replies.
- [PR] [SPARK-49348] Support `schedulerName` for SparkCluster [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/22 05:19:52 UTC, 3 replies.
- [PR] [SPARK-49351] Add `publish_snapshot_chart.yml` GitHub Action job [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/22 06:09:06 UTC, 5 replies.
- [PR] SPARK-49352: Avoid redundant array transform for identical expression [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2024/08/22 06:46:16 UTC, 1 replies.
- [PR] [SPARK-49331][FOLLOWUP] Fix `cpu` to `cpus` in `setup-minikube` setting [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/22 07:07:18 UTC, 7 replies.
- [PR] [SPARK-49353][SQL] Fix the doc of `spark.sql.legacy.javaCharsets` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/22 07:07:31 UTC, 4 replies.
- [PR] [MINOR] Fix and enhance the spark session example [spark-connect-go] - posted by "haoxins (via GitHub)" <gi...@apache.org> on 2024/08/22 07:59:57 UTC, 2 replies.
- Re: [PR] [SPARK-49223][ML] Simplify the StringIndexer.countByValue with builtin functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/08/22 08:22:09 UTC, 1 replies.
- [PR] [SPARK-49354][SQL] `split_part` should check whether the `collation` values of all parameter types are the same [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/22 09:12:05 UTC, 13 replies.
- [PR] [SPARK-47259][SQL] Assign names to error conditions for interval errors [spark] - posted by "vladanvasi-db (via GitHub)" <gi...@apache.org> on 2024/08/22 10:28:04 UTC, 19 replies.
- [PR] [SPARK-49355][SQL] `levenshtein` should check whether the `collation` values of all parameter types are the same [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/22 11:40:28 UTC, 14 replies.
- [PR] [SPARK-49359][SQL] Allow StagedTableCatalog implementations to fall back to non-atomic write [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/22 14:10:20 UTC, 7 replies.
- Re: [PR] [SPARK-43403][UI] Ensure old SparkUI in HistoryServer has been detached before loading new one [spark] - posted by "SlovinG (via GitHub)" <gi...@apache.org> on 2024/08/22 14:34:09 UTC, 0 replies.
- Re: [PR] [SPARK-49353][SQL] Update docs related to `UTF-32` encoding/decoding [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/08/22 16:20:10 UTC, 1 replies.
- [PR] [SPARK-49360] Use `rsync` to upload to `nightlies` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/22 19:15:59 UTC, 3 replies.
- [PR] [SPARK-49360][FOLLOWUP] Use `/*` for path [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/22 19:40:53 UTC, 5 replies.
- [PR] Bump rexml from 3.2.6 to 3.3.6 in /docs [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/08/22 20:17:02 UTC, 2 replies.
- [PR] [SPARK-49361] Fix `Dockerfile` by removing unused `ARG` from builder and moving default value [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/22 20:20:33 UTC, 5 replies.
- [PR] [SPARK-49362] Simplify snapshot HelmChart to use `apache/spark-kubernetes-operator:main-snapshot` by default [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/22 22:11:24 UTC, 4 replies.
- [PR] [SPARK-49363] Add unit tests for potential RocksDB state store SST file mismatch [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2024/08/22 23:51:28 UTC, 4 replies.
- [PR] [SPARK-49362][FOLLOWUP] Remove `build-tools/helm/` from the path [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/23 00:04:51 UTC, 3 replies.
- [PR] [SPARK-49306][Python] Create SQL function aliases for 'zeroifnull' and 'nullifzero' [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2024/08/23 00:18:35 UTC, 3 replies.
- Re: [PR] Collation Expr walker [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/23 00:21:22 UTC, 1 replies.
- Re: [PR] [Only Test] Test label profiler [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/23 00:21:23 UTC, 1 replies.
- Re: [PR] [DRAFT][SQL] Eliminate unnecessary COLLATE expressions in query analysis [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/23 00:21:27 UTC, 1 replies.
- Re: [PR] [SPARK-47625][SQL] Addition of Indeterminate Collation Support [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/23 00:21:28 UTC, 1 replies.
- Re: [PR] [SPARK-46350][SS] Fix state removal for stream-stream join with one watermark and one time-interval condition [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/23 00:21:30 UTC, 1 replies.
- Re: [PR] [SPARK-36691][PYTHON] PythonRunner failed should pass error message to ApplicationMaster too [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/23 00:21:31 UTC, 1 replies.
- Re: [PR] [SPARK-49008][PYTHON] Use `ParamSpec` to propagate `func` signature in `transform` [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/23 00:46:22 UTC, 4 replies.
- Re: [PR] [SPARK-49363][SS] Add unit tests for potential RocksDB state store SST file mismatch [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/08/23 02:11:46 UTC, 0 replies.
- Re: [PR] [SPARK-49352][SQL] Avoid redundant array transform for identical expression [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/23 02:18:42 UTC, 27 replies.
- Re: [PR] [SPARK-27734][CORE][SQL] Add memory based thresholds for shuffle spill [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/08/23 04:35:02 UTC, 3 replies.
- [PR] [SPARK-49365][PS] Simplify the bucket aggregation in hist plot [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/08/23 05:34:31 UTC, 2 replies.
- [PR] [SPARK-49366][CONNECT] Delay the ambiguous detection in column resolution [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/08/23 05:41:02 UTC, 0 replies.
- [PR] [SPARK-49367][PS] Parallelize the KDE computation for multiple columns (plotly backend) [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/08/23 06:57:04 UTC, 3 replies.
- Re: [PR] [SPARK-49306][PYTHON][SQL] Create SQL function aliases for 'zeroifnull' and 'nullifzero' [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/08/23 06:59:27 UTC, 9 replies.
- [I] Add Support for Additional DataFrame Functionality [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/08/23 08:52:02 UTC, 0 replies.
- [PR] [SPARK-49121][TESTS][FOLLOWUP] Change to dynamically calculate `ExpectedContext#stop` in test case "SPARK-49121: from_protobuf and to_protobuf SQL functions" [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/23 09:03:40 UTC, 1 replies.
- Re: [PR] [SPARK-49121][PROTOBUF][TESTS][FOLLOWUP] Change to dynamically calculate `ExpectedContext#stop` in test case "SPARK-49121: from_protobuf and to_protobuf SQL functions" [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/23 09:10:22 UTC, 3 replies.
- Re: [PR] [MINOR] Enhance the quick start example and spark session example [spark-connect-go] - posted by "haoxins (via GitHub)" <gi...@apache.org> on 2024/08/23 09:35:23 UTC, 7 replies.
- Re: [PR] [SPARK-48134][CORE] Spark core (java side): Migrate `error/warn/info` with variables to structured logging framework [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/08/23 09:35:25 UTC, 0 replies.
- [PR] [#58] Adding Support for select, selectExpr, crossJoin, and Alias [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/08/23 10:05:26 UTC, 2 replies.
- Re: [PR] [SPARK-48867][BUILD] Upgrade `okhttp` to 4.12.0, `okio` to 3.9.0 and `esdk-obs-java` to 3.24.3 [spark] - posted by "roczei (via GitHub)" <gi...@apache.org> on 2024/08/23 10:52:35 UTC, 2 replies.
- [PR] [SPARK-49368][CONNECT] Avoid accessing protobuf lite classes directly [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/08/23 15:42:56 UTC, 4 replies.
- [PR] [SPARK-49370][BUILD] `maven.scaladoc.skip` should not affect test code compilation [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/08/23 16:13:53 UTC, 3 replies.
- [PR] SPARK-49373: ProtobufFunctionsSuite test case should not be environment-dependent [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2024/08/23 19:25:35 UTC, 0 replies.
- Re: [PR] [SPARK-49373][CONNECTOR][TESTS] Fix `ProtobufFunctionsSuite` to be environment-independent [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/23 20:31:13 UTC, 0 replies.
- Re: [PR] [SPARK-49373][PROTOBUF][TESTS] Fix `ProtobufFunctionsSuite` to be environment-independent [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/23 20:33:02 UTC, 5 replies.
- Re: [PR] [SPARK-49363][SS][TESTS] Add unit tests for potential RocksDB state store SST file mismatch [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2024/08/23 21:06:29 UTC, 9 replies.
- [PR] Add state transition e2e test for happy path [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2024/08/23 21:40:09 UTC, 0 replies.
- Re: [PR] [SPARK-49324] Add state transition e2e test for happy path [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/23 22:55:41 UTC, 4 replies.
- [PR] [SPARK-49372][SS] Ensure that latestSnapshot is set to none on close to avoid subsequent use [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/08/23 23:14:17 UTC, 4 replies.
- [PR] [SPARK-49375][BUILD] Upgrade `postgresql` to 42.7.4 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/23 23:28:31 UTC, 3 replies.
- [PR] [SPARK-49376] Introduce ClusterToleration and WorkerInstanceConfig [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/08/23 23:41:14 UTC, 3 replies.
- Re: [PR] [SPARK-49314][BUILD][TESTS] Upgrade `h2` to 2.3.232, `postgresql` to 42.7.4 and `mssql` to 12.8.1.jre11 [spark] - posted by "wayneguow (via GitHub)" <gi...@apache.org> on 2024/08/24 00:05:17 UTC, 6 replies.
- Re: [PR] [SPARK-48270][SQL] Improve the OptimizeRepartition with Repartition [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/24 00:20:47 UTC, 1 replies.
- Re: [PR] [SPARK-47429][SQL] Rename error class to condition [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/24 00:20:48 UTC, 1 replies.
- Re: [PR] [SPARK-42492][SQL] Add new function filter_value [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/24 00:20:53 UTC, 1 replies.
- [PR] [SPARK-49352][SQL][3.5] Avoid redundant array transform for identical expression [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2024/08/24 00:38:22 UTC, 4 replies.
- Re: [PR] [SPARK-49352][SQL][3.4] Avoid redundant array transform for identical expression [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2024/08/24 00:38:33 UTC, 3 replies.
- [PR] [SPARK-49377]Fix e2e catch step application not found [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2024/08/24 05:13:16 UTC, 0 replies.
- Re: [PR] [SPARK-49377] Fix e2e catch step application not found [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/24 05:36:50 UTC, 1 replies.
- Re: [PR] [Only Test] Test without local maven cache [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/25 00:24:00 UTC, 1 replies.
- Re: [PR] [TEST Only] test sbt 1.10.0 performance without local maven repo cache [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/25 00:24:02 UTC, 1 replies.
- [PR] [SPARK-49378][SS] Break apart the Structured Streaming Programming Guide [spark] - posted by "neilramaswamy (via GitHub)" <gi...@apache.org> on 2024/08/25 15:02:29 UTC, 0 replies.
- [PR] [SPARK-49379] Enable Pull Request Labeler [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/25 20:26:39 UTC, 2 replies.
- Re: [PR] [SPARK-49324] Add `SparkApplication` state transition e2e test [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2024/08/25 21:38:46 UTC, 4 replies.
- [PR] [SPARK-49380] Add `cluster-with-template.yaml` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/25 22:02:20 UTC, 0 replies.
- Re: [PR] [SPARK-49380] Add `cluster-with-template.yaml` example [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/25 22:07:03 UTC, 3 replies.
- [PR] [SPARK-49379][FOLLOWUP] Add `labler.yml` workflow file [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/25 22:18:34 UTC, 4 replies.
- Re: [PR] [SPARK-49241][CORE] Add `OpenTelemetryPush` Sink with `opentelemetry` profile [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/25 22:55:15 UTC, 14 replies.
- [PR] [SPARK-49381][K8S][TESTS] Fix `SPARK-41388` test case to assert the result [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/26 00:03:52 UTC, 7 replies.
- Re: [PR] [SPARK-48324][SQL] Codegen Support for `hll_sketch_estimate` and `hll_union` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/26 00:22:04 UTC, 1 replies.
- Re: [PR] [SPARK-48251][BUILD] Disable `maven local cache` on GA's step `MIMA test` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/26 00:22:05 UTC, 1 replies.
- Re: [PR] [WIP][SPARK-47227][FOLLOW][DOCS] Building Extensions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/26 00:22:07 UTC, 2 replies.
- Re: [PR] [SPARK-49384][BUILD] Upgrade rocksdbjni to 9.5.2 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/26 02:00:37 UTC, 2 replies.
- [PR] [SPARK-49382][PS] Make frame box plot properly render the fliers/outlier [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/08/26 02:06:08 UTC, 0 replies.
- [PR] [SPARK-49385][K8S] Fix `getReusablePVCs` to use `podCreationTimeout` instead of `podAllocationDelay` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/26 02:37:28 UTC, 2 replies.
- Re: [PR] [SPARK-49382][PS] Make frame box plot properly render the fliers/outliers [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/08/26 03:20:34 UTC, 2 replies.
- [PR] [SPARK-49359][TESTS][FOLLOWUP][3.5] Fix compilation to rename `util.Map` to `jutil.Map` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/26 04:00:14 UTC, 5 replies.
- [PR] [SPARK-49387][PYTHON] Fix type hint for `accuracy` in `percentile_approx` and `approx_percentile` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/08/26 04:26:20 UTC, 2 replies.
- [PR] [SPARK-49388] Remove `SPARK_NO_DAEMONIZE` in favor of live log UIs [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/26 04:53:57 UTC, 2 replies.
- [PR] [SPARK-49389] Support `master|worker` container templates [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/26 06:04:29 UTC, 5 replies.
- Re: [PR] [SPARK-49378][DOCS][SS] Break apart the Structured Streaming Programming Guide [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/26 07:05:47 UTC, 22 replies.
- [PR] [SPARK-49391][PS] Box plot select outliers by distance from fences [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/08/26 07:23:00 UTC, 2 replies.
- [PR] [SPARK-49204][SQL][FOLLOWUP] Fix IndexOutOfBoundsException when dealing with surrogate pairs [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2024/08/26 11:57:53 UTC, 16 replies.
- [PR] [SPARK-48788][WIP] Expose task peak onheap/offheap execution memory to API [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2024/08/26 12:49:35 UTC, 0 replies.
- [PR] [#58] Initial Support for `GroupBy` [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/08/26 14:35:09 UTC, 2 replies.
- [PR] [SPARK-49392] Catch errors when failing to write to external data source [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/26 15:24:54 UTC, 5 replies.
- [PR] Add Agg function along with a represenation of literals [spark-connect-go] - posted by "mathiasschw-db (via GitHub)" <gi...@apache.org> on 2024/08/26 15:26:21 UTC, 1 replies.
- [PR] [SPARK-49393][SQL] Fail by default in deprecated catalog plugin APIs [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/26 15:36:15 UTC, 9 replies.
- [PR] Add Agg function an expression literals [spark-connect-go] - posted by "mathiasschw-db (via GitHub)" <gi...@apache.org> on 2024/08/26 15:36:20 UTC, 1 replies.
- [PR] [SPARK-49395] Add `8081` port to Worker resource spec [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/26 17:56:39 UTC, 2 replies.
- [PR] [SPARK-49397] Add `Clean Up` section to `README.md` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/26 18:31:39 UTC, 3 replies.
- [PR] [SS][RocksDB Hardening] Improve RocksDB SST file mapping management, and fix issue with reloading same version with existing snapshot [spark] - posted by "sahnib (via GitHub)" <gi...@apache.org> on 2024/08/26 18:32:28 UTC, 1 replies.
- [PR] [SPARK-49261][SQL] Don't replace literals in aggregate expressions with `Expand` output attributes that stand in for group-by expressions [spark] - posted by "bersprockets (via GitHub)" <gi...@apache.org> on 2024/08/26 19:48:12 UTC, 1 replies.
- [PR] [SPARK-49396][SQL] remain nullability while simplifyConditional [spark] - posted by "averyqi-db (via GitHub)" <gi...@apache.org> on 2024/08/26 19:50:50 UTC, 3 replies.
- [PR] compiling [spark] - posted by "jingz-db (via GitHub)" <gi...@apache.org> on 2024/08/26 20:18:48 UTC, 0 replies.
- Re: [PR] [SPARK-49366][CONNECT] Treat Union node as leaf in dataframe column resolution [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/08/26 20:28:18 UTC, 3 replies.
- Re: [PR] [MINOR] Fix spelling mistake in comment [spark] - posted by "tedyu (via GitHub)" <gi...@apache.org> on 2024/08/26 21:56:17 UTC, 9 replies.
- [PR] [MINOR] Remove unused versions from `gradle.properties` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/26 22:40:31 UTC, 3 replies.
- [PR] [SPARK-49399] Add examples for different Spark image types [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/08/26 22:52:32 UTC, 11 replies.
- [PR] [SPARK-49400] Use Gradle Version Catalog [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/26 23:20:28 UTC, 3 replies.
- [PR] [SPARK-49401][BUILD] Upgrade `checkstyle` to 10.18.0 & `scalafmt` to 3.8.3 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/27 01:20:11 UTC, 1 replies.
- [PR] [WIP] Enabling deleteIfExists operator in TWS with Virtual Column Families [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2024/08/27 02:00:08 UTC, 0 replies.
- [PR] [SPARK-49347][R][FOLLOW-UP] Set SPARK_TESTING in Windows build [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/27 03:04:32 UTC, 2 replies.
- [PR] [SPARK-49029][CONNECT][SQL] Create shared Dataset interface [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/27 03:15:39 UTC, 5 replies.
- Re: [PR] [SPARK-43242][CORE] Fix throw 'Unexpected type of BlockId' in shuffle corruption diagnose [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2024/08/27 03:36:25 UTC, 7 replies.
- [PR] [SPARK-49402][PYTHON] Fix Binder integration in PySpark documentation [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/27 05:06:04 UTC, 2 replies.
- [PR] [SPARK-49383][SQL][PYTHON][CONNECT] Support Transpose DataFrame API [spark] - posted by "xinrong-meng (via GitHub)" <gi...@apache.org> on 2024/08/27 06:53:46 UTC, 30 replies.
- [PR] [SPARK-49403] Add `log4j2` default setting to `values.yaml` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/27 07:07:38 UTC, 3 replies.
- [PR] [WIP][SPARK-49085][SQL] Remove special casing for Protobuf functions in Connect [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/08/27 07:08:40 UTC, 8 replies.
- [PR] [FOLLOWUP][SPARK-49017][SQL] Add more testing [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/08/27 07:35:50 UTC, 0 replies.
- [PR] [SPARK-49404] Adjust `ERROR`-level log messages [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/27 07:45:01 UTC, 9 replies.
- Re: [PR] [SPARK-41469][CORE] Avoid unnecessary task rerun on decommissioned executor lost if shuffle data migrated [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2024/08/27 08:13:54 UTC, 1 replies.
- [PR] [SPARK-49405][SQL] Restrict charsets in JsonOptions [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/27 08:16:14 UTC, 2 replies.
- [PR] [SPARK-49406][SQL][TESTS] Add two test cases for `from_avro/to_avro` from the perspective of `GenericRecord` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/27 09:22:41 UTC, 2 replies.
- Re: [PR] [SPARK-49017][SQL][TESTS][FOLLOW-UP] Add testing for CreateTableAs with parameters [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/08/27 09:35:04 UTC, 5 replies.
- [PR] [SPARK-49408][SQL] Use IndexedSeq in ProjectingInternalRow [spark] - posted by "wzx140 (via GitHub)" <gi...@apache.org> on 2024/08/27 11:38:16 UTC, 3 replies.
- [I] Add stack trace support to spark errors [spark-connect-go] - posted by "mathiasschw-db (via GitHub)" <gi...@apache.org> on 2024/08/27 12:30:14 UTC, 2 replies.
- [PR] Add stack trace support to spark errors [spark-connect-go] - posted by "mathiasschw-db (via GitHub)" <gi...@apache.org> on 2024/08/27 12:31:43 UTC, 0 replies.
- [PR] [SPARK-49357][CONNECT][PYTHON] Vertically truncate deeply nested protobuf message [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/08/27 12:46:08 UTC, 2 replies.
- [PR] [SPARK-45278][YARN] Support executor bind address in Yarn executors [spark] - posted by "gedeh (via GitHub)" <gi...@apache.org> on 2024/08/27 14:00:14 UTC, 2 replies.
- [PR] [SPARK-49410][SQL] Update collation benchmarks [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2024/08/27 16:09:17 UTC, 0 replies.
- Re: [PR] [SPARK-48359][SQL] Built-in functions for Zstd compression and decompression [spark] - posted by "xi-db (via GitHub)" <gi...@apache.org> on 2024/08/27 16:32:03 UTC, 1 replies.
- [PR] [SPARK-49028][CONNECT][SQL] Create a shared SparkSession [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/27 18:29:45 UTC, 5 replies.
- [PR] [WIP] Communicate CheckpointID between driver and stateful operators [spark] - posted by "siying (via GitHub)" <gi...@apache.org> on 2024/08/27 18:32:58 UTC, 0 replies.
- Re: [PR] [SPARK-49050] Enabling deleteIfExists operator in TWS with Virtual Column Families [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2024/08/27 19:24:38 UTC, 11 replies.
- [PR] [SPARK-45278][YARN] Support executor bind address in Yarn executors for Spark 3.5 [spark] - posted by "gedeh (via GitHub)" <gi...@apache.org> on 2024/08/27 21:08:22 UTC, 6 replies.
- [PR] Improve Package Structure [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/08/27 21:38:59 UTC, 3 replies.
- [PR] [SPARK-49412][PS] Compute all box plot metrics in single job [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/08/28 01:24:46 UTC, 5 replies.
- [PR] [SPARK-49419][CONNECT][SQL] Create shared DataFrameStatFunctions [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/28 02:28:06 UTC, 2 replies.
- [PR] [MINOR][SQL] Fix the incorrect method `@link` tag in `StagingTableCatalog` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/28 02:57:40 UTC, 3 replies.
- [PR] [SPARK-49438][SQL] Fix the pretty name of the `FromAvro` & `ToAvro` expression [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/28 03:00:27 UTC, 4 replies.
- [PR] [SPARK-49439][SQL] Fix the pretty name of the `FromProtobuf` & `ToProtobuf` expression [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/28 03:08:15 UTC, 5 replies.
- [PR] [SPARK-49402][PYTHON][FOLLOW-UP] Manually load ~/.profile in Spark Connect notebook [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/28 03:24:22 UTC, 2 replies.
- [PR] [SPARK-49440][CORE] Clean up unused LogKey definitions [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/28 03:26:28 UTC, 1 replies.
- [PR] [SPARK-49441][ML] `StringIndexer` sort arrays in executors [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/08/28 04:40:47 UTC, 4 replies.
- Re: [PR] [SPARK-49410][SQL][TESTS] Update collation benchmarks [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/08/28 07:39:53 UTC, 6 replies.
- [PR] [SPARK-46037][SQL] Correctness fix for Shuffled Hash Join build left without codegen [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2024/08/28 08:11:28 UTC, 3 replies.
- Re: [PR] SPARK-5983 [WEBUI] Don't respond to HTTP TRACE in HTTP-based UIs [spark] - posted by "AakarshitAgarwal (via GitHub)" <gi...@apache.org> on 2024/08/28 08:18:41 UTC, 1 replies.
- [PR] [ES-1203248] Modified UnivocityParser to throw runtime exceptions caused by ArrayIndexOutOfBounds with more user-oriented messages [spark] - posted by "vladanvasi-db (via GitHub)" <gi...@apache.org> on 2024/08/28 08:59:27 UTC, 0 replies.
- [PR] [SPARK-49443] Implement to_variant_object expression and make schema_of_variant expressions print OBJECT for for Variant Objects [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/08/28 09:10:32 UTC, 0 replies.
- Re: [PR] [SPARK-49444] Modified UnivocityParser to throw runtime exceptions caused by ArrayIndexOutOfBounds with more user-oriented messages [spark] - posted by "MaxGekk (via GitHub)" <gi...@apache.org> on 2024/08/28 09:22:47 UTC, 1 replies.
- Re: [PR] [SPARK-49443][SQL][PYTHON] Implement to_variant_object expression and make schema_of_variant expressions print OBJECT for for Variant Objects [spark] - posted by "harshmotw-db (via GitHub)" <gi...@apache.org> on 2024/08/28 09:41:29 UTC, 9 replies.
- [PR] [SPARK-49445][UI] Support show tooltip in the progress bar of UI [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/08/28 10:19:30 UTC, 3 replies.
- [PR] port to 3.4 for [SPARK-43242][CORE] Fix throw 'Unexpected type of BlockId' in shuffle corruption diagnose [spark] - posted by "CavemanIV (via GitHub)" <gi...@apache.org> on 2024/08/28 10:54:07 UTC, 0 replies.
- [PR] port to 3.5 [SPARK-43242][CORE] Fix throw 'Unexpected type of BlockId' in shuffle corruption diagnose [spark] - posted by "CavemanIV (via GitHub)" <gi...@apache.org> on 2024/08/28 11:01:38 UTC, 0 replies.
- [PR] To solve the issue of generating excessively large execution plans when encountering multiple levels of subqueries while enabling DynamicPartitionPruning. [spark] - posted by "chenfengbin2009 (via GitHub)" <gi...@apache.org> on 2024/08/28 11:50:10 UTC, 4 replies.
- [PR] [SPARK-49446][BUILD] Upgrade jetty to 11.0.23 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/28 12:55:22 UTC, 4 replies.
- Re: [PR] [#63] Add stack trace support to spark errors [spark-connect-go] - posted by "grundprinzip (via GitHub)" <gi...@apache.org> on 2024/08/28 14:47:21 UTC, 1 replies.
- Re: [PR] [SPARK-49399] Add `pi-scala.yaml` and `pyspark-pi.yaml` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/28 15:09:11 UTC, 2 replies.
- [PR] [SPARK-49447][K8S] Fix `spark.kubernetes.allocation.batch.delay` to prevent small values less than 100 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/28 15:39:13 UTC, 5 replies.
- [PR] Fix spark.sql.optimizer.canChangeCachedPlanOutputPartitioning Configuration Default to Match Documentation [spark] - posted by "DennisJLi (via GitHub)" <gi...@apache.org> on 2024/08/28 16:11:52 UTC, 0 replies.
- Re: [PR] [SPARK-48400][CORE] Promote `PrometheusServlet` to `DeveloperApi` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/28 17:20:25 UTC, 1 replies.
- Re: [PR] [SPARK-41262][SQL] Fix `spark.sql.optimizer.canChangeCachedPlanOutputPartitioning` Configuration Default to Match Documentation [spark] - posted by "DennisJLi (via GitHub)" <gi...@apache.org> on 2024/08/28 17:20:33 UTC, 3 replies.
- [PR] Update sql-migration-guide.md documentation to include new `spark.sql.optimizer.canChangeCachedPlanOutputPartitioning` in 3.5.1 [spark] - posted by "DennisJLi (via GitHub)" <gi...@apache.org> on 2024/08/28 17:32:59 UTC, 0 replies.
- Re: [PR] Update sql-migration-guide.md documentation to include disablement of `spark.sql.optimizer.canChangeCachedPlanOutputPartitioning` in 3.5.1 [spark] - posted by "DennisJLi (via GitHub)" <gi...@apache.org> on 2024/08/28 18:17:06 UTC, 1 replies.
- [PR] [SPARK-48482][PYTHON][FOLLOWUP] Revert dropDuplicates and dropDuplicatesWIthinWatermark should accept variable length args [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/08/28 18:55:23 UTC, 3 replies.
- [PR] [SPARK-49449] Remove string-from-metadata and binary-from-metadata [spark] - posted by "cashmand (via GitHub)" <gi...@apache.org> on 2024/08/28 18:59:10 UTC, 0 replies.
- [PR] [SPARK-49421][CONNECT][SQL] Create a shared RelationalGroupedDataset interface [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/28 19:42:25 UTC, 1 replies.
- [PR] [SPARK-49450][SQL] Improve normalised collation names [spark] - posted by "mihailom-db (via GitHub)" <gi...@apache.org> on 2024/08/28 19:44:22 UTC, 3 replies.
- [PR] [SPARK-49451] Allow duplicate keys in parse_json. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2024/08/28 21:36:47 UTC, 10 replies.
- [PR] [SPARK-49423][CONNECT][SQL] Consolidate Observation in sql/api [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/28 23:27:08 UTC, 4 replies.
- [PR] [SPARK-49425][CONNECT][SQL]Create a shared DataFrameWriter [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/29 01:01:45 UTC, 0 replies.
- Re: [PR] [SPARK-41811][PYTHON][CONNECT] Implement `SQLStringFormatter` with `WithRelations` [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2024/08/29 01:19:01 UTC, 1 replies.
- Re: [PR] [SPARK-49406][SQL][TESTS] Add three test cases for `from_avro/to_avro` from the perspective of `GenericRecord` [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/29 02:11:46 UTC, 4 replies.
- Re: [PR] [SPARK-46995][DOCS][FOLLOWUP] Update `sql-migration-guide.md` documentation [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/29 03:37:36 UTC, 2 replies.
- [PR] Add quotes for number [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2024/08/29 03:55:32 UTC, 0 replies.
- [PR] [WIP][SQL] [spark] - posted by "anchovYu (via GitHub)" <gi...@apache.org> on 2024/08/29 04:04:00 UTC, 0 replies.
- Re: [PR] [SPARK-48788][CORE][WIP] Expose task peak onheap/offheap execution memory to API [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2024/08/29 05:01:36 UTC, 0 replies.
- [PR] [SPARK-49455][SQL][TESTS] Refactor `StagingInMemoryTableCatalog` to override the non-deprecated functions [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2024/08/29 05:32:04 UTC, 0 replies.
- [PR] [SPARK-49456][DOCS] Fix hash fragment scrolling behavior on version-specific Spark documentation [spark] - posted by "neilramaswamy (via GitHub)" <gi...@apache.org> on 2024/08/29 06:08:30 UTC, 0 replies.
- [PR] [SPARK-49457][BUILD] Remove uncommon curl option `--retry-all-errors` [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/08/29 06:21:44 UTC, 7 replies.
- [PR] [WIP][SPARK-49259][Structured Streaming]Size based partition creation during kafka read [spark] - posted by "SubhamSinghal (via GitHub)" <gi...@apache.org> on 2024/08/29 06:36:17 UTC, 2 replies.
- Re: [PR] [SPARK-49453] Add quotes for number [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/29 06:44:35 UTC, 1 replies.
- Re: [PR] [SPARK-49449][SQL][DOCS] Remove string-from-metadata and binary-from-metadata [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/08/29 08:16:09 UTC, 1 replies.
- [PR] ODP-2135 Upgrade avro to 1.11.3 [spark] - posted by "senthh (via GitHub)" <gi...@apache.org> on 2024/08/29 09:07:11 UTC, 1 replies.
- [PR] [SPARK-49459][CORE][SHUFFLE] Support CRC32C for Shuffle Checksum [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/29 09:42:09 UTC, 1 replies.
- Re: [PR] [SPARK-49456][DOCS] Fix hash fragment scrolling behavior on versioned Spark documentation [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/29 11:27:05 UTC, 3 replies.
- [PR] [SPARK-49458][CONNECT][PYTHON] Supply server-side session id via ReattachExecute [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/08/29 12:15:40 UTC, 0 replies.
- [PR] [SPARK-49460][SQL] Fix NPE in EmptyRelationExec [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2024/08/29 12:29:23 UTC, 6 replies.
- [PR] [SPARK-49461][SS] Persistent Checkpoint ID to commit logs and read it back [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/08/29 18:10:17 UTC, 1 replies.
- Re: [PR] [SPARK-49411][SS] Communicate CheckpointID between driver and stateful operators [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2024/08/29 18:43:09 UTC, 6 replies.
- Re: [PR] [SPARK-49454][SQL] Avoid double normalization in the cache process [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2024/08/29 21:43:06 UTC, 1 replies.
- [PR] [SPARK-49463] Support ListState for TransformWithStateInPandas [spark] - posted by "bogao007 (via GitHub)" <gi...@apache.org> on 2024/08/29 22:30:04 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-49259][SS]Size based partition creation during kafka read [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2024/08/29 22:49:39 UTC, 0 replies.
- Re: [PR] [SPARK-49085][SQL] Remove special casing for Protobuf functions in Connect [spark] - posted by "itholic (via GitHub)" <gi...@apache.org> on 2024/08/29 22:58:36 UTC, 12 replies.
- [PR] [SPARK-49464] Add docs for operator [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/08/29 23:02:54 UTC, 1 replies.
- [PR] [SPARK-49465] Fix example props override in helm chart operatorConfiguration.dynamicConfig.data [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2024/08/29 23:19:57 UTC, 2 replies.
- [PR] [SPARK-49466][BUILD] Upgrade `zstd-jni` to 1.5.6-5 [spark] - posted by "panbingkun (via GitHub)" <gi...@apache.org> on 2024/08/29 23:38:32 UTC, 2 replies.
- Re: [PR] [SPARK-19426][SQL] Custom coalescer for Dataset [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/30 00:22:16 UTC, 1 replies.
- Re: [PR] [SPARK-46395][CORE] Assign Spark configs to groups for use in documentation [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/30 00:22:17 UTC, 1 replies.
- Re: [PR] [SPARK-45744][CORE] Switch `spark.history.store.serializer` to use `PROTOBUF` by default [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/30 00:22:18 UTC, 0 replies.
- Re: [PR] [SPARK-43242][CORE][3.5] Fix throw 'Unexpected type of BlockId' in shuffle corruption diagnose [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2024/08/30 03:11:55 UTC, 1 replies.
- Re: [PR] [SPARK-43242][CORE][3.4] Fix throw 'Unexpected type of BlockId' in shuffle corruption diagnose [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2024/08/30 03:12:04 UTC, 1 replies.
- Re: [PR] [SPARK-37618][CORE] Remove shuffle blocks using the shuffle service for released executors [spark] - posted by "wangyum (via GitHub)" <gi...@apache.org> on 2024/08/30 03:33:40 UTC, 3 replies.
- [PR] Add Hot Properties Reload Test [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2024/08/30 03:40:20 UTC, 0 replies.
- [PR] [SPARK-49469][CONNECT][TESTS] Add dummy protos for expression and datatype [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/08/30 03:54:11 UTC, 1 replies.
- [PR] [MINOR] Add `artifacts` to `.gitignore` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2024/08/30 04:19:04 UTC, 2 replies.
- Re: [PR] [SPARK-43612][PYTHON][CONNECT][FOLLOW-UP] Copy dependent data files to data directory [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/30 06:06:22 UTC, 0 replies.
- [PR] [SPARK-49409][CONNECT] Adjust the default value of CONNECT_SESSION_PLAN_CACHE_SIZE [spark] - posted by "changgyoopark-db (via GitHub)" <gi...@apache.org> on 2024/08/30 07:16:20 UTC, 2 replies.
- [PR] [SPARK-49470][UI] Update dataTables stylesheets and javascripts from 1.13.5 to 1.13.11 [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2024/08/30 08:00:11 UTC, 0 replies.
- [PR] [MINOR][INFRA] Exclude .python-version from git [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/08/30 09:46:32 UTC, 0 replies.
- Re: [PR] [SPARK-47307][SQL][3.5] Add a config to optionally chunk base64 strings [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2024/08/30 13:55:46 UTC, 0 replies.
- Re: [PR] [SPARK-49459][CORE][SHUFFLE] Support `CRC32C` for Shuffle Checksum [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/30 16:06:22 UTC, 0 replies.
- [PR] [WIP][SPARK-49474][SS] Classify Error class for FlatMapGroupsWithState user function error [spark] - posted by "liviazhu-db (via GitHub)" <gi...@apache.org> on 2024/08/30 18:08:19 UTC, 0 replies.
- [PR] [SPARK-49476] Fix nullability of base64 function [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2024/08/30 20:14:21 UTC, 1 replies.
- [PR] [SPARK-49477][PYTHON] Improve pandas udf invalid return type error message [spark] - posted by "allisonwang-db (via GitHub)" <gi...@apache.org> on 2024/08/30 22:09:25 UTC, 0 replies.
- [PR] [SPARK-48782][SQL] Add support for executing procedures in catalogs [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2024/08/30 22:38:24 UTC, 2 replies.
- [PR] [SPARK-49478][CONNECT] Handle null metrics in ConnectProgressExecutionListenerSuite [spark] - posted by "davintjong-db (via GitHub)" <gi...@apache.org> on 2024/08/30 23:38:53 UTC, 0 replies.
- Re: [PR] [WIP][DO NOT REVIEW] dummy PR [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/31 00:22:12 UTC, 0 replies.
- Re: [PR] [SPARK-48354][SQL] JDBC Connectors predicate pushdown testing [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/08/31 00:22:14 UTC, 0 replies.
- Re: [PR] [SPARK-49460][SQL] Remove `cleanupResource()` from EmptyRelationExec [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2024/08/31 00:50:59 UTC, 5 replies.
- [PR] [SPARK-46698][SPARK-46895][CORE][3.5] Replace Timer with single thread scheduled executor [spark] - posted by "jshmchenxi (via GitHub)" <gi...@apache.org> on 2024/08/31 05:00:02 UTC, 3 replies.
- [PR] [SPARK-49480][CORE] Fix NullPointerException from `SparkThrowableHelper.isInternalError` [spark] - posted by "jshmchenxi (via GitHub)" <gi...@apache.org> on 2024/08/31 07:00:55 UTC, 1 replies.
- Re: [PR] [SPARK-47730][K8S] Support `APP_ID` and `EXECUTOR_ID` placeholders in labels [spark] - posted by "jshmchenxi (via GitHub)" <gi...@apache.org> on 2024/08/31 12:52:01 UTC, 0 replies.
- [PR] [SPARK-49482][SQL] Refactor V2 parquet datasource [spark] - posted by "mikecsx (via GitHub)" <gi...@apache.org> on 2024/08/31 14:07:29 UTC, 0 replies.
- Re: [PR] [SPARK-49468] Add Hot Properties Reload Test [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/31 18:46:23 UTC, 1 replies.
- Re: [PR] [Do not review] Fix group by on collated string [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/31 19:14:33 UTC, 1 replies.
- Re: [PR] [TEST][WIP][][SQL] Introduction of error handling mechanism in SQL Scripting [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/31 19:17:06 UTC, 1 replies.
- Re: [PR] add possibility to set log filename & disable spark log rotation [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/31 19:20:39 UTC, 1 replies.
- Re: [PR] add possibility to set log filename & disable spark log rotation #47373 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/08/31 19:23:40 UTC, 0 replies.