You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@kyuubi.apache.org by "wForget (via GitHub)" <gi...@apache.org> on 2023/09/18 08:04:12 UTC
[GitHub] [kyuubi-website] wForget opened a new pull request, #131: Release 1.7.2
wForget opened a new pull request, #131:
URL: https://github.com/apache/kyuubi-website/pull/131
(no comment)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [kyuubi-website] pan3793 commented on a diff in pull request #131: Release 1.7.2
Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 commented on code in PR #131:
URL: https://github.com/apache/kyuubi-website/pull/131#discussion_r1328422447
##########
src/en/release/1.7.2.md:
##########
@@ -0,0 +1,142 @@
+---
+title: Release Notes - 1.7.2
+date: 2023-09-18
+linked: true
+meta:
+_edit_last: '4'
+_wpas_done_all: '1'
+---
+<!---
+ Licensed under the Apache License, Version 2.0 (the "License");
+ you may not use this file except in compliance with the License.
+ You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License. See accompanying LICENSE file.
+-->
+
+### Highlight
+
+- Enhance JDBC Client and Beeline Client, like: Support running Python scripts and codes in Beeline, fix Http authentication exception message is empty, backport HIVE-19048: Initscript errors are ignored, backport HIVE-15820: comment at the head of beeline -e.
+- Enhance submission engine related code, like: support yarn-client and yarn-cluster for YarnApplicationOperation, different engine submit timeout config, destroy build process when waitCompletion is false and engine is running in cluster mode
+- Fix many flaky tests and incorrect documentations
+
+### Server
+
+- [KYUUBI #4786] Support yarn-client and yarn-cluster for YarnApplicationOperation
+- [KYUUBI #4801] Using different engine submit timeout config for kubernetes and yarn
+- [KYUUBI #4811] Do not update app info after batch or application terminated
+- [KYUUBI #4816] [K8S] Correct the implementation of cleanup terminated appInfo
+- [KYUUBI #4830] [TEST] Fix flaky test "support to interrupt the thrift request if remote engine is broken"
+- [KYUUBI #4840] Return cached appInfo iif both op and app are terminated
+- [KYUUBI #4841] [MINOR] Log more info for closing session
+- [KYUUBI #4807] [TEST] Retry more times to fix flaky test "spnego batch rest client"
+- [KYUUBI #4807] [FOLLOWUP] Fix flaky test "basic batch rest client"
+- [KYUUBI #4855] Change socket "connection refused" message match pattern
+- [KYUUBI #4858] Relax test message assertion in "sync query causes engine crash"
+- [KYUUBI #4919] Fix the flaky tests in the "open batch session" functionality within the "BatchesResourceSuite"
+- [KYUUBI #4876] fix Flaky test BackendServiceMetricSuite
+- [KYUUBI #4979] Fix flaky test: support to interrupt the thrift request if remote engine is broken
+- [KYUUBI #4977] Log error message when REST API invocation error occurs
+- [KYUUBI #4946] Alter the order of initLoggerEventHandler
+- [KYUUBI #5072] [TEST] Fix KyuubiOperationWithEngineSecuritySuite and related issues
+- [KYUUBI #5043] [1.7] Destroy the build process when waitCompletion is false and the engine is running in cluster mode
+- [KYUUBI #3920] [TEST] Fix flaky test - distribute lock
+- [KYUUBI #5204] Thrift HTTP FE checks req conf nullable before evaluating proxy user
+
+### Spark Engine
+
+- [KYUUBI #4838] Fix spark operation exception leak in `withLocalProperties` method
+- [KYUUBI #4835] [K8S] Using hive conf to check whether to apply HIVE_DELEGATION_TOKEN
+- [KYUUBI #4915] Adapt database not exist error message change for Spark 3.4
+- [KYUUBI #4952] Enhance AWS Glue default database does not exist error message on opening session
+- [KYUUBI #5005] Remove default settings `spark.sql.execution.topKSortFallbackThreshold`
+- [KYUUBI #5025] Use formatDuration instead of formatDurationVerbose in SparkUI's engine tab
+- [KYUUBI #5019] Shows details of compilation info in SparkUI's engine tab
+- [KYUUBI #5045] Initialize EXECUTOR_POD_NAME_PREFIX_MAX_LENGTH before using
+- [KYUUBI #5105] [Bug] getColumns gets duplicate column names when Spark integrates with Iceberg
+- [KYUUBI #5148] Improve spark.driver.host assignment in Spark on K8s client mode
+- [KYUUBI #5232] In SparkOperation#cleanup always calls cancelJobGroup even though it's in the completed state
+
+### Spark Extensions
+
+- [KYUUBI #4995] Use hadoop conf and hive conf from catalog options
+- [KYUUBI #5028] Update session hadoop conf to catalog hadoop conf
+
+### Client
+
+- [KYUUBI #4859] HttpException message should not be null
+- [KYUUBI #4969] [TEST] Run JUnit tests on beeline module
+- [KYUUBI #4962] [1.7] Backport HIVE-19048: Initscript errors are ignored
+- [KYUUBI #4965] [BEELINE] Support --python-mode option and remove comments for non-python mode
+- [KYUUBI #4305] Backport HIVE-15820: comment at the head of beeline -e
+- [KYUUBI #5100] [Minor] Fix unpaired quote in message pattern
+- [KYUUBI #5101] [MINOR] Remove unused StringBuilders in ResultSets
+- [KYUUBI #5129] KyuubiBeeline should redirect JDK logging
+
+### Common
Review Comment:
```suggestion
### Common
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [kyuubi-website] pan3793 commented on a diff in pull request #131: Release 1.7.2
Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 commented on code in PR #131:
URL: https://github.com/apache/kyuubi-website/pull/131#discussion_r1328379223
##########
src/zh/release/1.7.2.md:
##########
@@ -0,0 +1,141 @@
+---
+title: 发布记录 - 1.7.2
+date: 2023-09-18
+linked: true
+meta:
+_edit_last: '4'
+_wpas_done_all: '1'
+---
+<!---
+ Licensed under the Apache License, Version 2.0 (the "License");
+ you may not use this file except in compliance with the License.
+ You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License. See accompanying LICENSE file.
+-->
+
+### 重要变更
+- 增强 JDBC和Beeline客户端：Beeline支持运行Python脚本和代码；Http认证异常消息为空；HIVE-19048: 初始化脚本错误；HIVE-15820: Beeline执行前面存在注释SQL问题等
+- 增强引擎启动相关代码：在YarnApplicationOperation中支持yarn-client/yarn-cluster；不同的超时时间配置；当关闭waitCompletion仅在cluster模式时销毁创建进程。
Review Comment:
```suggestion
- 增强与引擎启动相关的代码：在YarnApplicationOperation中支持yarn-client/yarn-cluster模式；支持为多种调度器独立配置超时时间；当waitCompletion禁用时，仅在cluster模式下销毁spark-submit进程。
```
##########
src/zh/release/1.7.2.md:
##########
@@ -0,0 +1,141 @@
+---
+title: 发布记录 - 1.7.2
+date: 2023-09-18
+linked: true
+meta:
+_edit_last: '4'
+_wpas_done_all: '1'
+---
+<!---
+ Licensed under the Apache License, Version 2.0 (the "License");
+ you may not use this file except in compliance with the License.
+ You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License. See accompanying LICENSE file.
+-->
+
+### 重要变更
+- 增强 JDBC和Beeline客户端：Beeline支持运行Python脚本和代码；Http认证异常消息为空；HIVE-19048: 初始化脚本错误；HIVE-15820: Beeline执行前面存在注释SQL问题等
+- 增强引擎启动相关代码：在YarnApplicationOperation中支持yarn-client/yarn-cluster；不同的超时时间配置；当关闭waitCompletion仅在cluster模式时销毁创建进程。
Review Comment:
```suggestion
- 增强与引擎启动相关的代码：在YarnApplicationOperation中支持yarn-client/yarn-cluster模式；支持为多种调度器独立配置超时时间；当waitCompletion禁用时，仅在cluster模式下销毁spark-submit进程。
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [kyuubi-website] pan3793 merged pull request #131: Release 1.7.2
Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 merged PR #131:
URL: https://github.com/apache/kyuubi-website/pull/131
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [kyuubi-website] pan3793 commented on a diff in pull request #131: Release 1.7.2
Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 commented on code in PR #131:
URL: https://github.com/apache/kyuubi-website/pull/131#discussion_r1328422198
##########
src/en/release/1.7.2.md:
##########
@@ -0,0 +1,142 @@
+---
+title: Release Notes - 1.7.2
+date: 2023-09-18
+linked: true
+meta:
+_edit_last: '4'
+_wpas_done_all: '1'
+---
+<!---
+ Licensed under the Apache License, Version 2.0 (the "License");
+ you may not use this file except in compliance with the License.
+ You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License. See accompanying LICENSE file.
+-->
+
+### Highlight
+
+- Enhance JDBC Client and Beeline Client, like: Support running Python scripts and codes in Beeline, fix Http authentication exception message is empty, backport HIVE-19048: Initscript errors are ignored, backport HIVE-15820: comment at the head of beeline -e.
+- Enhance submission engine related code, like: support yarn-client and yarn-cluster for YarnApplicationOperation, different engine submit timeout config, destroy build process when waitCompletion is false and engine is running in cluster mode
+- Fix many flaky tests and incorrect documentations
+
+### Server
+
+- [KYUUBI #4786] Support yarn-client and yarn-cluster for YarnApplicationOperation
+- [KYUUBI #4801] Using different engine submit timeout config for kubernetes and yarn
+- [KYUUBI #4811] Do not update app info after batch or application terminated
+- [KYUUBI #4816] [K8S] Correct the implementation of cleanup terminated appInfo
+- [KYUUBI #4830] [TEST] Fix flaky test "support to interrupt the thrift request if remote engine is broken"
+- [KYUUBI #4840] Return cached appInfo iif both op and app are terminated
+- [KYUUBI #4841] [MINOR] Log more info for closing session
+- [KYUUBI #4807] [TEST] Retry more times to fix flaky test "spnego batch rest client"
+- [KYUUBI #4807] [FOLLOWUP] Fix flaky test "basic batch rest client"
+- [KYUUBI #4855] Change socket "connection refused" message match pattern
+- [KYUUBI #4858] Relax test message assertion in "sync query causes engine crash"
+- [KYUUBI #4919] Fix the flaky tests in the "open batch session" functionality within the "BatchesResourceSuite"
+- [KYUUBI #4876] fix Flaky test BackendServiceMetricSuite
+- [KYUUBI #4979] Fix flaky test: support to interrupt the thrift request if remote engine is broken
+- [KYUUBI #4977] Log error message when REST API invocation error occurs
+- [KYUUBI #4946] Alter the order of initLoggerEventHandler
+- [KYUUBI #5072] [TEST] Fix KyuubiOperationWithEngineSecuritySuite and related issues
+- [KYUUBI #5043] [1.7] Destroy the build process when waitCompletion is false and the engine is running in cluster mode
+- [KYUUBI #3920] [TEST] Fix flaky test - distribute lock
+- [KYUUBI #5204] Thrift HTTP FE checks req conf nullable before evaluating proxy user
+
+### Spark Engine
+
+- [KYUUBI #4838] Fix spark operation exception leak in `withLocalProperties` method
+- [KYUUBI #4835] [K8S] Using hive conf to check whether to apply HIVE_DELEGATION_TOKEN
+- [KYUUBI #4915] Adapt database not exist error message change for Spark 3.4
+- [KYUUBI #4952] Enhance AWS Glue default database does not exist error message on opening session
+- [KYUUBI #5005] Remove default settings `spark.sql.execution.topKSortFallbackThreshold`
+- [KYUUBI #5025] Use formatDuration instead of formatDurationVerbose in SparkUI's engine tab
+- [KYUUBI #5019] Shows details of compilation info in SparkUI's engine tab
+- [KYUUBI #5045] Initialize EXECUTOR_POD_NAME_PREFIX_MAX_LENGTH before using
+- [KYUUBI #5105] [Bug] getColumns gets duplicate column names when Spark integrates with Iceberg
+- [KYUUBI #5148] Improve spark.driver.host assignment in Spark on K8s client mode
+- [KYUUBI #5232] In SparkOperation#cleanup always calls cancelJobGroup even though it's in the completed state
+
+### Spark Extensions
Review Comment:
```suggestion
### Spark Extensions
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [kyuubi-website] pan3793 commented on a diff in pull request #131: Release 1.7.2
Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 commented on code in PR #131:
URL: https://github.com/apache/kyuubi-website/pull/131#discussion_r1328383933
##########
src/en/release/1.7.2.md:
##########
@@ -0,0 +1,142 @@
+---
+title: Release Notes - 1.7.2
+date: 2023-09-18
+linked: true
+meta:
+_edit_last: '4'
+_wpas_done_all: '1'
+---
+<!---
+ Licensed under the Apache License, Version 2.0 (the "License");
+ you may not use this file except in compliance with the License.
+ You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License. See accompanying LICENSE file.
+-->
+
+### Highlight
+
+- Enhance JDBC Client and Beeline Client, like: Support running Python scripts and codes in Beeline, fix Http authentication exception message is empty, backport HIVE-19048: Initscript errors are ignored, backport HIVE-15820: comment at the head of beeline -e.
+- Enhance submission engine related code, like: support yarn-client and yarn-cluster for YarnApplicationOperation, different engine submit timeout config, destroy build process when waitCompletion is false and engine is running in cluster mode
+- Fixed many flaky tests and incorrect documentations
Review Comment:
Use imperative sentence
```suggestion
- Fix many flaky tests and incorrect documentations
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [kyuubi-website] pan3793 commented on a diff in pull request #131: Release 1.7.2
Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 commented on code in PR #131:
URL: https://github.com/apache/kyuubi-website/pull/131#discussion_r1328418915
##########
src/en/release/1.7.2.md:
##########
@@ -0,0 +1,142 @@
+---
+title: Release Notes - 1.7.2
+date: 2023-09-18
+linked: true
+meta:
+_edit_last: '4'
+_wpas_done_all: '1'
+---
+<!---
+ Licensed under the Apache License, Version 2.0 (the "License");
+ you may not use this file except in compliance with the License.
+ You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License. See accompanying LICENSE file.
+-->
+
+### Highlight
+
+- Enhance JDBC Client and Beeline Client, like: Support running Python scripts and codes in Beeline, fix Http authentication exception message is empty, backport HIVE-19048: Initscript errors are ignored, backport HIVE-15820: comment at the head of beeline -e.
+- Enhance submission engine related code, like: support yarn-client and yarn-cluster for YarnApplicationOperation, different engine submit timeout config, destroy build process when waitCompletion is false and engine is running in cluster mode
+- Fix many flaky tests and incorrect documentations
+
+### Server
+
+- [KYUUBI #4786] Support yarn-client and yarn-cluster for YarnApplicationOperation
+- [KYUUBI #4801] Using different engine submit timeout config for kubernetes and yarn
+- [KYUUBI #4811] Do not update app info after batch or application terminated
+- [KYUUBI #4816] [K8S] Correct the implementation of cleanup terminated appInfo
+- [KYUUBI #4830] [TEST] Fix flaky test "support to interrupt the thrift request if remote engine is broken"
+- [KYUUBI #4840] Return cached appInfo iif both op and app are terminated
+- [KYUUBI #4841] [MINOR] Log more info for closing session
+- [KYUUBI #4807] [TEST] Retry more times to fix flaky test "spnego batch rest client"
+- [KYUUBI #4807] [FOLLOWUP] Fix flaky test "basic batch rest client"
+- [KYUUBI #4855] Change socket "connection refused" message match pattern
+- [KYUUBI #4858] Relax test message assertion in "sync query causes engine crash"
+- [KYUUBI #4919] Fix the flaky tests in the "open batch session" functionality within the "BatchesResourceSuite"
+- [KYUUBI #4876] fix Flaky test BackendServiceMetricSuite
+- [KYUUBI #4979] Fix flaky test: support to interrupt the thrift request if remote engine is broken
+- [KYUUBI #4977] Log error message when REST API invocation error occurs
+- [KYUUBI #4946] Alter the order of initLoggerEventHandler
+- [KYUUBI #5072] [TEST] Fix KyuubiOperationWithEngineSecuritySuite and related issues
+- [KYUUBI #5043] [1.7] Destroy the build process when waitCompletion is false and the engine is running in cluster mode
+- [KYUUBI #3920] [TEST] Fix flaky test - distribute lock
+- [KYUUBI #5204] Thrift HTTP FE checks req conf nullable before evaluating proxy user
+
+### Spark Engine
+
+- [KYUUBI #4838] Fix spark operation exception leak in `withLocalProperties` method
+- [KYUUBI #4835] [K8S] Using hive conf to check whether to apply HIVE_DELEGATION_TOKEN
+- [KYUUBI #4915] Adapt database not exist error message change for Spark 3.4
+- [KYUUBI #4952] Enhance AWS Glue default database does not exist error message on opening session
+- [KYUUBI #5005] Remove default settings `spark.sql.execution.topKSortFallbackThreshold`
+- [KYUUBI #5025] Use formatDuration instead of formatDurationVerbose in SparkUI's engine tab
+- [KYUUBI #5019] Shows details of compilation info in SparkUI's engine tab
+- [KYUUBI #5045] Initialize EXECUTOR_POD_NAME_PREFIX_MAX_LENGTH before using
+- [KYUUBI #5105] [Bug] getColumns gets duplicate column names when Spark integrates with Iceberg
+- [KYUUBI #5148] Improve spark.driver.host assignment in Spark on K8s client mode
+- [KYUUBI #5232] In SparkOperation#cleanup always calls cancelJobGroup even though it's in the completed state
+
+### Spark Extensions
Review Comment:
nit
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [kyuubi-website] pan3793 commented on a diff in pull request #131: Release 1.7.2
Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 commented on code in PR #131:
URL: https://github.com/apache/kyuubi-website/pull/131#discussion_r1328374802
##########
hugo.toml:
##########
@@ -337,6 +337,6 @@ defaultContentLanguage = 'en'
keepQuotes = true
[params]
- releases = [ 'v1.7.1', 'v1.6.1-incubating', 'v1.5.2-incubating', 'v1.4.1-incubating', 'v1.3.1-incubating' ]
+ releases = [ 'v1.7.2', 'v1.7.1', 'v1.6.1-incubating', 'v1.5.2-incubating', 'v1.4.1-incubating', 'v1.3.1-incubating' ]
Review Comment:
```suggestion
releases = [ 'v1.7.2', 'v1.6.1-incubating', 'v1.5.2-incubating', 'v1.4.1-incubating', 'v1.3.1-incubating' ]
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [kyuubi-website] pan3793 commented on a diff in pull request #131: Release 1.7.2
Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 commented on code in PR #131:
URL: https://github.com/apache/kyuubi-website/pull/131#discussion_r1328422742
##########
src/zh/release/1.7.2.md:
##########
@@ -0,0 +1,141 @@
+---
+title: 发布记录 - 1.7.2
+date: 2023-09-18
+linked: true
+meta:
+_edit_last: '4'
+_wpas_done_all: '1'
+---
+<!---
+ Licensed under the Apache License, Version 2.0 (the "License");
+ you may not use this file except in compliance with the License.
+ You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License. See accompanying LICENSE file.
+-->
+
+### 重要变更
+- 增强JDBC驱动和Beeline客户端：Beeline支持Python模式；修复HTTP认证异常消息缺失；修复HIVE-19048：正确传递初始化脚本错误；修复HIVE-15820：beeline -e无法执行注释开头的SQL
+- 增强与引擎启动相关的代码：在YarnApplicationOperation中支持yarn-client/yarn-cluster模式；支持为多种调度器独立配置超时时间；当waitCompletion禁用时，仅在cluster模式下销毁spark-submit进程
+- 修复大量不稳定的测试用例和文档错误
+
+### Server
+
+- [KYUUBI #4786] Support yarn-client and yarn-cluster for YarnApplicationOperation
+- [KYUUBI #4801] Using different engine submit timeout config for kubernetes and yarn
+- [KYUUBI #4811] Do not update app info after batch or application terminated
+- [KYUUBI #4816] [K8S] Correct the implementation of cleanup terminated appInfo
+- [KYUUBI #4830] [TEST] Fix flaky test "support to interrupt the thrift request if remote engine is broken"
+- [KYUUBI #4840] Return cached appInfo iif both op and app are terminated
+- [KYUUBI #4841] [MINOR] Log more info for closing session
+- [KYUUBI #4807] [TEST] Retry more times to fix flaky test "spnego batch rest client"
+- [KYUUBI #4807] [FOLLOWUP] Fix flaky test "basic batch rest client"
+- [KYUUBI #4855] Change socket "connection refused" message match pattern
+- [KYUUBI #4858] Relax test message assertion in "sync query causes engine crash"
+- [KYUUBI #4919] Fix the flaky tests in the "open batch session" functionality within the "BatchesResourceSuite"
+- [KYUUBI #4876] fix Flaky test BackendServiceMetricSuite
+- [KYUUBI #4979] Fix flaky test: support to interrupt the thrift request if remote engine is broken
+- [KYUUBI #4977] Log error message when REST API invocation error occurs
+- [KYUUBI #4946] Alter the order of initLoggerEventHandler
+- [KYUUBI #5072] [TEST] Fix KyuubiOperationWithEngineSecuritySuite and related issues
+- [KYUUBI #5043] [1.7] Destroy the build process when waitCompletion is false and the engine is running in cluster mode
+- [KYUUBI #3920] [TEST] Fix flaky test - distribute lock
+- [KYUUBI #5204] Thrift HTTP FE checks req conf nullable before evaluating proxy user
+
+### Spark Engine
+
+- [KYUUBI #4838] Fix spark operation exception leak in `withLocalProperties` method
+- [KYUUBI #4835] [K8S] Using hive conf to check whether to apply HIVE_DELEGATION_TOKEN
+- [KYUUBI #4915] Adapt database not exist error message change for Spark 3.4
+- [KYUUBI #4952] Enhance AWS Glue default database does not exist error message on opening session
+- [KYUUBI #5005] Remove default settings `spark.sql.execution.topKSortFallbackThreshold`
+- [KYUUBI #5025] Use formatDuration instead of formatDurationVerbose in SparkUI's engine tab
+- [KYUUBI #5019] Shows details of compilation info in SparkUI's engine tab
+- [KYUUBI #5045] Initialize EXECUTOR_POD_NAME_PREFIX_MAX_LENGTH before using
+- [KYUUBI #5105] [Bug] getColumns gets duplicate column names when Spark integrates with Iceberg
+- [KYUUBI #5148] Improve spark.driver.host assignment in Spark on K8s client mode
+- [KYUUBI #5232] In SparkOperation#cleanup always calls cancelJobGroup even though it's in the completed state
+
+### Spark Extensions
+
+- [KYUUBI #4995] Use hadoop conf and hive conf from catalog options
+- [KYUUBI #5028] Update session hadoop conf to catalog hadoop conf
+
+### Client
+
+- [KYUUBI #4859] HttpException message should not be null
+- [KYUUBI #4969] [TEST] Run JUnit tests on beeline module
+- [KYUUBI #4962] [1.7] Backport HIVE-19048: Initscript errors are ignored
+- [KYUUBI #4965] [BEELINE] Support --python-mode option and remove comments for non-python mode
+- [KYUUBI #4305] Backport HIVE-15820: comment at the head of beeline -e
+- [KYUUBI #5100] [Minor] Fix unpaired quote in message pattern
+- [KYUUBI #5101] [MINOR] Remove unused StringBuilders in ResultSets
+- [KYUUBI #5129] KyuubiBeeline should redirect JDK logging
+
+### Common
Review Comment:
```suggestion
### Common
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [kyuubi-website] pan3793 commented on a diff in pull request #131: Release 1.7.2
Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 commented on code in PR #131:
URL: https://github.com/apache/kyuubi-website/pull/131#discussion_r1328376375
##########
src/zh/release/1.7.2.md:
##########
@@ -0,0 +1,141 @@
+---
+title: 发布记录 - 1.7.2
+date: 2023-09-18
+linked: true
+meta:
+_edit_last: '4'
+_wpas_done_all: '1'
+---
+<!---
+ Licensed under the Apache License, Version 2.0 (the "License");
+ you may not use this file except in compliance with the License.
+ You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License. See accompanying LICENSE file.
+-->
+
+### 重要变更
+- 增强 JDBC和Beeline客户端：Beeline支持运行Python脚本和代码；Http认证异常消息为空；HIVE-19048: 初始化脚本错误；HIVE-15820: Beeline执行前面存在注释SQL问题等
Review Comment:
use consistent ":" or "：" and spaces
##########
src/zh/release/1.7.2.md:
##########
@@ -0,0 +1,141 @@
+---
+title: 发布记录 - 1.7.2
+date: 2023-09-18
+linked: true
+meta:
+_edit_last: '4'
+_wpas_done_all: '1'
+---
+<!---
+ Licensed under the Apache License, Version 2.0 (the "License");
+ you may not use this file except in compliance with the License.
+ You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License. See accompanying LICENSE file.
+-->
+
+### 重要变更
+- 增强 JDBC和Beeline客户端：Beeline支持运行Python脚本和代码；Http认证异常消息为空；HIVE-19048: 初始化脚本错误；HIVE-15820: Beeline执行前面存在注释SQL问题等
Review Comment:
use consistent ":" or "：" and spaces
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [kyuubi-website] pan3793 commented on a diff in pull request #131: Release 1.7.2
Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 commented on code in PR #131:
URL: https://github.com/apache/kyuubi-website/pull/131#discussion_r1328379545
##########
src/zh/release/1.7.2.md:
##########
@@ -0,0 +1,141 @@
+---
+title: 发布记录 - 1.7.2
+date: 2023-09-18
+linked: true
+meta:
+_edit_last: '4'
+_wpas_done_all: '1'
+---
+<!---
+ Licensed under the Apache License, Version 2.0 (the "License");
+ you may not use this file except in compliance with the License.
+ You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License. See accompanying LICENSE file.
+-->
+
+### 重要变更
+- 增强 JDBC和Beeline客户端：Beeline支持运行Python脚本和代码；Http认证异常消息为空；HIVE-19048: 初始化脚本错误；HIVE-15820: Beeline执行前面存在注释SQL问题等
Review Comment:
Http => HTTP
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org
[GitHub] [kyuubi-website] pan3793 commented on a diff in pull request #131: Release 1.7.2
Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 commented on code in PR #131:
URL: https://github.com/apache/kyuubi-website/pull/131#discussion_r1328373956
##########
src/zh/release/1.7.2.md:
##########
@@ -0,0 +1,141 @@
+---
+title: 发布记录 - 1.7.2
+date: 2023-09-18
+linked: true
+meta:
+_edit_last: '4'
+_wpas_done_all: '1'
+---
+<!---
+ Licensed under the Apache License, Version 2.0 (the "License");
+ you may not use this file except in compliance with the License.
+ You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License. See accompanying LICENSE file.
+-->
+
+### 重要变更
+- 增强 JDBC和Beeline客户端：Beeline支持运行Python脚本和代码；Http认证异常消息为空；HIVE-19048: 初始化脚本错误；HIVE-15820: Beeline执行前面存在注释SQL问题等
+- 增强引擎启动相关代码：在YarnApplicationOperation中支持yarn-client/yarn-cluster；不同的超时时间配置；当关闭waitCompletion仅在cluster模式时销毁创建进程。
+- 修复大量不稳定的测试用例和文档错误
+
+### Server
+
+- [KYUUBI #4786] Support yarn-client and yarn-cluster for YarnApplicationOperation
+- [KYUUBI #4801] Using different engine submit timeout config for kubernetes and yarn
+- [KYUUBI #4811] Do not update app info after batch or application terminated
+- [KYUUBI #4816] [K8S] Correct the implementation of cleanup terminated appInfo
+- [KYUUBI #4830] [TEST] Fix flaky test "support to interrupt the thrift request if remote engine is broken"
+- [KYUUBI #4840] Return cached appInfo iif both op and app are terminated
+- [KYUUBI #4841] [MINOR] Log more info for closing session
+- [KYUUBI #4807] [TEST] Retry more times to fix flaky test "spnego batch rest client"
+- [KYUUBI #4807] [FOLLOWUP] Fix flaky test "basic batch rest client"
+- [KYUUBI #4855] Change socket "connection refused" message match pattern
+- [KYUUBI #4858] Relax test message assertion in "sync query causes engine crash"
+- [KYUUBI #4919] Fix the flaky tests in the "open batch session" functionality within the "BatchesResourceSuite"
+- [KYUUBI #4876] fix Flaky test BackendServiceMetricSuite
+- [KYUUBI #4979] Fix flaky test: support to interrupt the thrift request if remote engine is broken
+- [KYUUBI #4977] Log error message when REST API invocation error occurs
+- [KYUUBI #4946] Alter the order of initLoggerEventHandler
+- [KYUUBI #5072] [TEST] Fix KyuubiOperationWithEngineSecuritySuite and related issues
+- [KYUUBI #5043] [1.7] Destroy the build process when waitCompletion is false and the engine is running in cluster mode
+- [KYUUBI #3920] [TEST] Fix flaky test - distribute lock
+- [KYUUBI #5204] Thrift HTTP FE checks req conf nullable before evaluating proxy user
+
+### Spark Engine
+
+- [KYUUBI #4838] Fix spark operation exception leak in `withLocalProperties` method
+- [KYUUBI #4835] [K8S] Using hive conf to check whether to apply HIVE_DELEGATION_TOKEN
+- [KYUUBI #4915] Adapt database not exist error message change for Spark 3.4
+- [KYUUBI #4952] Enhance AWS Glue default database does not exist error message on opening session
+- [KYUUBI #5005] Remove default settings `spark.sql.execution.topKSortFallbackThreshold`
+- [KYUUBI #5025] Use formatDuration instead of formatDurationVerbose in SparkUI's engine tab
+- [KYUUBI #5019] Shows details of compilation info in SparkUI's engine tab
+- [KYUUBI #5045] Initialize EXECUTOR_POD_NAME_PREFIX_MAX_LENGTH before using
+- [KYUUBI #5105] [Bug] getColumns gets duplicate column names when Spark integrates with Iceberg
+- [KYUUBI #5148] Improve spark.driver.host assignment in Spark on K8s client mode
+- [KYUUBI #5232] In SparkOperation#cleanup always calls cancelJobGroup even though it's in the completed state
+
+### Spark Extensions
Review Comment:
```suggestion
### Spark Extensions
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org