You are viewing a plain text version of this content. The canonical link for it is here.
- [jira] [Created] (SPARK-41343) Move FunctionName parsing to server side - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/01 00:34:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41343) Move FunctionName parsing to server side - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/01 00:40:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41343) Move FunctionName parsing to server side - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/01 00:40:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41344) Reading V2 datasource masks underlying error - posted by "Kevin Cheung (Jira)" <ji...@apache.org> on 2022/12/01 01:09:00 UTC, 7 replies.
- [jira] [Created] (SPARK-41344) Reading V2 datasource masks underlying error - posted by "Kevin Cheung (Jira)" <ji...@apache.org> on 2022/12/01 01:09:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41344) Reading V2 datasource masks underlying error - posted by "Kevin Cheung (Jira)" <ji...@apache.org> on 2022/12/01 01:11:00 UTC, 11 replies.
- [jira] [Comment Edited] (SPARK-41344) Reading V2 datasource masks underlying error - posted by "Kevin Cheung (Jira)" <ji...@apache.org> on 2022/12/01 01:11:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-41235) High-order function: array_compact - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/01 01:52:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41232) High-order function: array_append - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/01 01:52:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-41233) High-order function: array_prepend - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/01 01:54:00 UTC, 5 replies.
- [jira] [Resolved] (SPARK-41321) Support target field for UnresolvedStar - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/01 02:41:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41321) Support target field for UnresolvedStar - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/01 02:41:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41226) Refactor Spark types by introducing physical types - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/01 03:25:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41226) Refactor Spark types by introducing physical types - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/01 03:25:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41314) Assign a name to the error class _LEGACY_ERROR_TEMP_1094 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/01 04:08:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41314) Assign a name to the error class _LEGACY_ERROR_TEMP_1094 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/01 04:08:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41345) Add Hint to Connect Proto - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/01 04:30:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41345) Add Hint to Connect Proto - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/01 04:36:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41345) Add Hint to Connect Proto - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/01 04:36:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41346) Implement asc and desc methods - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/01 04:57:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41346) Implement asc and desc methods - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/01 05:01:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41346) Implement asc and desc methods - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/01 05:01:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41347) Add Cast to Expression proto - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/01 05:06:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41227) Implement DataFrame cross join - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/01 05:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41347) Add Cast to Expression proto - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/01 05:10:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41347) Add Cast to Expression proto - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/01 05:10:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41347) Add Cast to Expression proto - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/01 05:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41343) Move FunctionName parsing to server side - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/01 05:28:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41336) BroadcastExchange does not support the execute() code path. when AQE enabled - posted by "JacobZheng (Jira)" <ji...@apache.org> on 2022/12/01 05:52:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41237) Assign a name to the error class _LEGACY_ERROR_TEMP_0030 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/01 06:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41237) Assign a name to the error class _LEGACY_ERROR_TEMP_0030 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/01 06:15:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41228) Rename COLUMN_NOT_IN_GROUP_BY_CLAUSE to MISSING_AGGREGATION - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/01 06:19:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41228) Rename COLUMN_NOT_IN_GROUP_BY_CLAUSE to MISSING_AGGREGATION - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/01 06:19:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41338) resolve outer references and normal columns in the same analyzer batch - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/01 06:21:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41338) resolve outer references and normal columns in the same analyzer batch - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/01 06:21:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-28303) Support DELETE/UPDATE/MERGE Operations in DataSource V2 - posted by "Charlie (Jira)" <ji...@apache.org> on 2022/12/01 06:29:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41339) RocksDB state store WriteBatch doesn't clean up native memory - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2022/12/01 06:51:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41339) RocksDB state store WriteBatch doesn't clean up native memory - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2022/12/01 06:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41348) Refactor `UnsafeArrayWriterSuite` to check error class - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/01 07:04:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41348) Refactor `UnsafeArrayWriterSuite` to check error class - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/01 07:08:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41348) Refactor `UnsafeArrayWriterSuite` to check error class - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/01 07:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41294) Assign a name to the error class _LEGACY_ERROR_TEMP_1203 - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2022/12/01 07:37:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41294) Assign a name to the error class _LEGACY_ERROR_TEMP_1203 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/01 07:42:00 UTC, 1 replies.
- [jira] (SPARK-41294) Assign a name to the error class _LEGACY_ERROR_TEMP_1203 - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2022/12/01 07:43:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-39257) use spark.read.jdbc() to read data from SQL databse into dataframe, it fails silently, when the session is killed from SQL server side - posted by "Sandeep Katta (Jira)" <ji...@apache.org> on 2022/12/01 08:00:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-39257) use spark.read.jdbc() to read data from SQL databse into dataframe, it fails silently, when the session is killed from SQL server side - posted by "Sandeep Katta (Jira)" <ji...@apache.org> on 2022/12/01 08:03:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41314) Assign a name to the error class _LEGACY_ERROR_TEMP_1094 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/01 08:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41347) Add Cast to Expression proto - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/01 09:32:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41346) Implement asc and desc methods - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/01 10:48:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41349) Implement `DataFrame.hint` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/01 11:05:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41349) Implement `DataFrame.hint` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/01 11:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41349) Implement `DataFrame.hint` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/01 11:06:00 UTC, 6 replies.
- [jira] [Resolved] (SPARK-41345) Add Hint to Connect Proto - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/01 11:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41348) Refactor `UnsafeArrayWriterSuite` to check error class - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/01 11:46:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41350) allow simple name access of using join hidden columns after subquery alias - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/01 13:38:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41350) allow simple name access of using join hidden columns after subquery alias - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/01 13:51:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41350) allow simple name access of using join hidden columns after subquery alias - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/01 13:51:00 UTC, 4 replies.
- [jira] [Created] (SPARK-41351) Column does not support != - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/01 13:59:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41351) Column does not support != - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/01 14:04:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41351) Column does not support != - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/01 14:04:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41342) Add support for distributed deep learning framework - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/01 15:03:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41324) Follow-up on JDK-8180450 - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/01 15:04:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41319) when-otherwise support - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/01 15:05:00 UTC, 5 replies.
- [jira] [Updated] (SPARK-41253) Make K8s volcano IT work in Github Action - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/01 15:06:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41219) Regression in IntegralDivide returning null instead of 0 - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/01 15:07:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41087) Make `build/mvn` use the same JAVA_OPTS as `dev/make-distribution.sh` - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/01 15:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41013) spark-3.1.2以cluster模式提交作业报 Could not initialize class com.github.luben.zstd.ZstdOutputStream - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/01 15:13:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41008) Isotonic regression result differs from sklearn implementation - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/01 15:16:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41313) Combine fixes for SPARK-3900 and SPARK-21138 - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/01 18:10:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41352) Support DataFrame.hint - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/01 18:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41352) Support DataFrame.hint - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/01 18:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41352) Support DataFrame.hint - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/01 18:48:00 UTC, 0 replies.
- [jira] [Deleted] (SPARK-41352) Support DataFrame.hint - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/01 18:50:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-40586) Decouple plan transformation and validation on server side - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/01 18:51:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-40586) Decouple plan transformation and validation on server side - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/01 18:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41271) Parameterized SQL - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/01 19:10:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-36950) Normalize semi-structured data into tabular tables. - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2022/12/01 19:26:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41232) High-order function: array_append - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/01 20:00:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-40970) Support List[Column] for Join's on argument. - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/01 20:48:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-40970) Support List[Column] for Join's on argument. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/01 20:59:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-40970) Support List[Column] for Join's on argument. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/01 20:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41353) UNRESOLVED_ROUTINE error class - posted by "Serge Rielau (Jira)" <ji...@apache.org> on 2022/12/01 21:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41234) High-order function: array_insert - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/01 23:55:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41234) High-order function: array_insert - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/01 23:55:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41354) Implement `DataFrame.repartitionByRange` - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2022/12/02 01:22:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41354) Support `DataFrame.repartitionByRange` - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2022/12/02 01:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41319) when-otherwise support - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/02 01:33:00 UTC, 3 replies.
- [jira] [Created] (SPARK-41355) Workaround hive table name validation issue - posted by "Wan Kun (Jira)" <ji...@apache.org> on 2022/12/02 01:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41355) Workaround hive table name validation issue - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 01:38:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41355) Workaround hive table name validation issue - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 01:38:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41336) BroadcastExchange does not support the execute() code path. when AQE enabled - posted by "JacobZheng (Jira)" <ji...@apache.org> on 2022/12/02 02:24:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41356) Refactor `ColumnVectorUtils#populate` method to use physical types - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/02 03:26:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41356) Refactor `ColumnVectorUtils#populate` method to use physical types - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 03:35:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41356) Refactor `ColumnVectorUtils#populate` method to use physical types - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 03:35:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41356) Find and refactor all cases suitable for using `PhysicalDataType` instead of `DataType` - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/02 03:44:00 UTC, 3 replies.
- [jira] (SPARK-41236) The renamed field name cannot be recognized after group filtering - posted by "Ritika Maheshwari (Jira)" <ji...@apache.org> on 2022/12/02 04:23:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41356) Find and refactor all cases suitable for using `PhysicalDataType` instead of `DataType` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 04:25:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41353) UNRESOLVED_ROUTINE error class - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 05:36:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41353) UNRESOLVED_ROUTINE error class - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 05:36:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41344) Reading V2 datasource masks underlying error - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 06:08:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-35011) False active executor in UI that caused by BlockManager reregistration - posted by "wuyi (Jira)" <ji...@apache.org> on 2022/12/02 06:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41357) Implement math functions - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/02 06:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41357) Implement math functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 06:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41357) Implement math functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 06:32:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41358) Use `PhysicalDataType` instead of DataType in ColumnVectorUtils - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/02 06:37:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41358) Use `PhysicalDataType` instead of DataType in ColumnVectorUtils - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/02 06:38:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41359) Use `PhysicalDataType` instead of DataType in UnsafeRow - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/02 06:39:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41358) Use `PhysicalDataType` instead of DataType in ColumnVectorUtils - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 06:49:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41358) Use `PhysicalDataType` instead of DataType in ColumnVectorUtils - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 06:49:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41360) Avoid BlockMananger re-registration if the executor has been lost - posted by "wuyi (Jira)" <ji...@apache.org> on 2022/12/02 07:04:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41236) The renamed field name cannot be recognized after group filtering - posted by "Ritika Maheshwari (Jira)" <ji...@apache.org> on 2022/12/02 07:33:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41360) Avoid BlockManager re-registration if the executor has been lost - posted by "wuyi (Jira)" <ji...@apache.org> on 2022/12/02 07:56:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41235) High-order function: array_compact - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 08:05:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41361) Invalid call toAttribute on unresolved object exception caused by WidenSetOperationTypes - posted by "mcdull_zhang (Jira)" <ji...@apache.org> on 2022/12/02 08:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-40988) Test case for insert partition should verify value - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 08:10:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-40970) Support List[Column] for Join's on argument. - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/02 08:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41360) Avoid BlockManager re-registration if the executor has been lost - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 08:19:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41360) Avoid BlockManager re-registration if the executor has been lost - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 08:19:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-41361) Invalid call toAttribute on unresolved object exception caused by WidenSetOperationTypes - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 08:31:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41361) Invalid call toAttribute on unresolved object exception caused by WidenSetOperationTypes - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 08:31:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41337) Add a physical rule to remove the partialLimitExec node - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/02 08:54:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41362) Better type errors when passing wrong parameters - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/02 09:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41363) implement normal functions - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/02 09:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41364) implement `broadcast` function - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/02 09:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41362) Better type errors when passing wrong parameters - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 09:21:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41362) Better type errors when passing wrong parameters - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 09:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41365) Stages UI page fails to load for proxy in some yarn versions - posted by "Mars (Jira)" <ji...@apache.org> on 2022/12/02 09:47:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-38277) Clear write batch after RocksDB state store's commit - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 09:50:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-38277) Clear write batch after RocksDB state store's commit - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 09:50:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41365) Stages UI page fails to load for proxy in some yarn versions - posted by "Mars (Jira)" <ji...@apache.org> on 2022/12/02 09:54:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41365) Stages UI page fails to load for proxy in some yarn versions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 10:13:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-41365) Stages UI page fails to load for proxy in some yarn versions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 10:13:00 UTC, 5 replies.
- [jira] [Resolved] (SPARK-41357) Implement math functions - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/02 10:44:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41366) DF.groupby.agg() API should be compatible - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/02 11:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41363) implement normal functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 12:22:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41363) implement normal functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 12:22:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41367) Enable V2 file tables in read paths in session catalog - posted by "Peter Toth (Jira)" <ji...@apache.org> on 2022/12/02 13:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41367) Enable V2 file tables in read paths in session catalog - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 13:30:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41367) Enable V2 file tables in read paths in session catalog - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 13:30:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41368) Reorder the window partition expressions by expression stats - posted by "Wan Kun (Jira)" <ji...@apache.org> on 2022/12/02 14:49:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41368) Reorder the window partition expressions by expression stats - posted by "Wan Kun (Jira)" <ji...@apache.org> on 2022/12/02 14:49:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41368) Reorder the window partition expressions by expression stats - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 14:56:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41368) Reorder the window partition expressions by expression stats - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 14:56:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41369) Refactor connect directory structure - posted by "Venkata Sai Akhil Gudesa (Jira)" <ji...@apache.org> on 2022/12/02 14:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41370) Add data frame equality check for testing purposes. - posted by "Oscar Delicaat (Jira)" <ji...@apache.org> on 2022/12/02 15:08:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41369) Refactor connect directory structure - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 15:24:00 UTC, 5 replies.
- [jira] [Commented] (SPARK-41369) Refactor connect directory structure - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 15:24:00 UTC, 8 replies.
- [jira] [Created] (SPARK-41371) Improve Documentation for Command proto - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/02 17:51:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41305) Connect Proto Completeness - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 17:55:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41305) Connect Proto Completeness - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 17:55:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41372) Support DataFrame TempView - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/02 18:39:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41372) Support DataFrame TempView - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 18:46:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41372) Support DataFrame TempView - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 18:46:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41373) Rename CAST_WITH_FUN_SUGGESTION to CAST_WITH_FUNC_SUGGESTION - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/02 19:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41373) Rename CAST_WITH_FUN_SUGGESTION to CAST_WITH_FUNC_SUGGESTION - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 19:35:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41373) Rename CAST_WITH_FUN_SUGGESTION to CAST_WITH_FUNC_SUGGESTION - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 19:35:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-40099) Merge adjacent CaseWhen branches if their values are the same - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 19:45:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-40099) Merge adjacent CaseWhen branches if their values are the same - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 19:45:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41313) AM shutdown hook fails with IllegalStateException if AM crashes on startup (recurrence of SPARK-3900) - posted by "Erik Krogen (Jira)" <ji...@apache.org> on 2022/12/02 23:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41374) Update ORC to 1.8.1 - posted by "William Hyun (Jira)" <ji...@apache.org> on 2022/12/02 23:42:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41374) Update ORC to 1.8.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 23:48:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41374) Update ORC to 1.8.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/02 23:48:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41374) Update ORC to 1.8.1 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/03 03:21:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41253) Make K8s volcano IT work in Github Action - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/03 06:46:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41253) Make K8s volcano IT work in Github Action - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/03 06:46:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41153) Log migrated shuffle data size and migration time - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/03 07:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41153) Log migrated shuffle data size and migration time - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/03 07:00:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41136) Shorten graceful shutdown time of ExecutorPodsSnapshotsStoreImpl to prevent blocking shutdown process - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/03 07:04:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41136) Shorten graceful shutdown time of ExecutorPodsSnapshotsStoreImpl to prevent blocking shutdown process - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/03 07:04:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-38921) Use k8s-client to create queue resource in Volcano IT - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2022/12/03 12:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41375) Avoid empty latest KafkaSourceOffset - posted by "Wechar (Jira)" <ji...@apache.org> on 2022/12/03 19:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41375) Avoid empty latest KafkaSourceOffset - posted by "Wechar (Jira)" <ji...@apache.org> on 2022/12/03 19:12:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41375) Avoid empty latest KafkaSourceOffset - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/03 19:23:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41375) Avoid empty latest KafkaSourceOffset - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/03 19:23:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41373) Rename CAST_WITH_FUN_SUGGESTION to CAST_WITH_FUNC_SUGGESTION - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/03 21:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41349) Implement `DataFrame.hint` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/04 05:03:00 UTC, 4 replies.
- [jira] [Created] (SPARK-41376) Executor netty direct memory check should respect spark.shuffle.io.preferDirectBufs - posted by "Cheng Pan (Jira)" <ji...@apache.org> on 2022/12/04 13:17:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41376) Executor netty direct memory check should respect spark.shuffle.io.preferDirectBufs - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/04 13:27:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41376) Executor netty direct memory check should respect spark.shuffle.io.preferDirectBufs - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/04 13:27:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-41313) AM shutdown hook fails with IllegalStateException if AM crashes on startup (recurrence of SPARK-3900) - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/04 14:26:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41313) AM shutdown hook fails with IllegalStateException if AM crashes on startup (recurrence of SPARK-3900) - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/04 14:26:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41136) Shorten graceful shutdown time of ExecutorPodsSnapshotsStoreImpl to prevent blocking shutdown process - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/04 15:15:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41377) Fix spark-version-info.properties not found on Windows - posted by "Gautham Banasandra (Jira)" <ji...@apache.org> on 2022/12/04 15:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41377) Fix spark-version-info.properties not found on Windows - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/04 15:22:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41377) Fix spark-version-info.properties not found on Windows - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/04 15:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41377) Fix spark-version-info.properties not found on Windows - posted by "Gautham Banasandra (Jira)" <ji...@apache.org> on 2022/12/04 15:48:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41378) Support Column Stats in DS V2 - posted by "Huaxin Gao (Jira)" <ji...@apache.org> on 2022/12/04 23:02:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41379) Inconsistency of spark session in DataFrame in user function for foreachBatch sink in PySpark - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2022/12/04 23:37:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41379) Inconsistency of spark session in DataFrame in user function for foreachBatch sink in PySpark - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2022/12/04 23:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41378) Support Column Stats in DS V2 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 00:07:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41378) Support Column Stats in DS V2 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 00:07:00 UTC, 6 replies.
- [jira] [Resolved] (SPARK-41363) implement normal functions - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/05 00:51:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41305) Connect Proto Completeness - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/05 01:00:40 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41366) DF.groupby.agg() API should be compatible - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 01:05:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41366) DF.groupby.agg() API should be compatible - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 01:05:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41351) Column does not support != - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/05 01:06:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41350) allow simple name access of using join hidden columns after subquery alias - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/05 01:25:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41371) Improve Documentation for Command proto - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/05 02:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41371) Improve Documentation for Command proto - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/05 02:26:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-41305) Connect Proto Completeness - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/05 02:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41380) Implement aggregation functions - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/05 02:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41381) Implement count_distinct and sum_distinct functions - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/05 02:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41382) implement `product` function - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/05 02:38:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41383) Implement `DataFrame.cube` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/05 02:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41380) Implement aggregation functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 03:13:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41380) Implement aggregation functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 03:13:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41379) Inconsistency of spark session in DataFrame in user function for foreachBatch sink in PySpark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 03:20:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-40379) Propagate decommission executor loss reason during onDisconnect in K8s - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/05 03:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-40379) Propagate decommission executor loss reason during onDisconnect in K8s - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 04:15:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41358) Use `PhysicalDataType` instead of DataType in ColumnVectorUtils - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/05 04:55:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41384) Should use SQLExpression for str arguments in Projection - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/05 05:04:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41384) Should use SQLExpression for str arguments in Projection - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 05:10:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41384) Should use SQLExpression for str arguments in Projection - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 05:10:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41385) Replace deprecated `.newInstance()` in K8s module - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/05 05:31:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41385) Replace deprecated `.newInstance()` in K8s module - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 05:33:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41385) Replace deprecated `.newInstance()` in K8s module - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 05:33:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41379) Inconsistency of spark session in DataFrame in user function for foreachBatch sink in PySpark - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2022/12/05 06:02:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41380) Implement aggregation functions - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/05 06:02:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41385) Replace deprecated `.newInstance()` in K8s module - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/05 06:28:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41151) Keep built-in file _metadata column nullable value consistent - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 06:37:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41386) Resolve small files with REBALANCE Hint - posted by "Zhe Dong (Jira)" <ji...@apache.org> on 2022/12/05 07:16:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41386) Resolve small files with REBALANCE Hint - posted by "Zhe Dong (Jira)" <ji...@apache.org> on 2022/12/05 07:17:00 UTC, 7 replies.
- [jira] [Commented] (SPARK-41387) Add assertion on end offset range for Kafka data source with Trigger.AvailableNow - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2022/12/05 07:21:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41387) Add assertion on end offset range for Kafka data source with Trigger.AvailableNow - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2022/12/05 07:21:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41241) Use Hive and Spark SQL to modify table field comment, the modified results of Hive cannot be queried using Spark SQL - posted by "weiliang hao (Jira)" <ji...@apache.org> on 2022/12/05 07:23:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41387) Add assertion on end offset range for Kafka data source with Trigger.AvailableNow - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 07:35:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41388) getReusablePVCs should ignore recently created PVCs in the previous batch - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/05 07:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41388) getReusablePVCs should ignore recently created PVCs in the previous batch - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 07:48:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41388) getReusablePVCs should ignore recently created PVCs in the previous batch - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 07:48:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41389) Reuse `WRONG_NUM_ARGS` instead of `_LEGACY_ERROR_TEMP_1043` and `_LEGACY_ERROR_TEMP_1044` - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/05 08:20:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41355) Workaround hive table name validation issue - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/05 08:20:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41389) Reuse `WRONG_NUM_ARGS` instead of `_LEGACY_ERROR_TEMP_1043` and `_LEGACY_ERROR_TEMP_1044` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 08:27:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41389) Reuse `WRONG_NUM_ARGS` instead of `_LEGACY_ERROR_TEMP_1043` and `_LEGACY_ERROR_TEMP_1044` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 08:27:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41389) Reuse `WRONG_NUM_ARGS` instead of `_LEGACY_ERROR_TEMP_1044` - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/05 08:56:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41381) Implement count_distinct and sum_distinct functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 09:20:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41381) Implement count_distinct and sum_distinct functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 09:20:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41388) getReusablePVCs should ignore recently created PVCs in the previous batch - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/05 09:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41388) getReusablePVCs should ignore recently created PVCs in the previous batch - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/05 09:28:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41266) Spark does not parse timestamp strings when using the IN operator - posted by "huldar chen (Jira)" <ji...@apache.org> on 2022/12/05 09:54:00 UTC, 3 replies.
- [jira] (SPARK-41266) Spark does not parse timestamp strings when using the IN operator - posted by "huldar chen (Jira)" <ji...@apache.org> on 2022/12/05 09:57:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-41266) Spark does not parse timestamp strings when using the IN operator - posted by "Laurens Versluis (Jira)" <ji...@apache.org> on 2022/12/05 10:12:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41382) implement `product` function - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 10:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41382) implement `product` function - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 10:14:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41008) Isotonic regression result differs from sklearn implementation - posted by "Ahmed Mahran (Jira)" <ji...@apache.org> on 2022/12/05 10:43:00 UTC, 6 replies.
- [jira] [Updated] (SPARK-41386) There are some small files when using rebalance(column) - posted by "Zhe Dong (Jira)" <ji...@apache.org> on 2022/12/05 10:58:00 UTC, 9 replies.
- [jira] [Created] (SPARK-41390) Update the script used to generate register function in UDFRegistration - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/05 11:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41390) Update the script used to generate register function in UDFRegistration - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 11:14:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41390) Update the script used to generate register function in UDFRegistration - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 11:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41391) The output column name of `groupby.agg(count_distinct)` is incorrect - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/05 11:29:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41391) The output column name of `groupBy.agg(count_distinct)` is incorrect - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/05 11:39:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41391) The output column name of `groupBy.agg(count_distinct)` is incorrect - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 11:52:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41391) The output column name of `groupBy.agg(count_distinct)` is incorrect - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 11:52:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41392) spark builds against hadoop trunk/3.4.0-SNAPSHOT fail in scala-maven plugin - posted by "Steve Loughran (Jira)" <ji...@apache.org> on 2022/12/05 13:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-32530) SPIP: Kotlin support for Apache Spark - posted by "Maziyar PANAHI (Jira)" <ji...@apache.org> on 2022/12/05 13:12:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41167) Optimize LikeSimplification rule to improve multi like performance - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2022/12/05 13:49:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41167) Optimize LikeSimplification rule to improve multi like performance - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2022/12/05 13:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-36853) Code failing on checkstyle - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/05 14:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-40286) Load Data from S3 deletes data source file - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/05 14:47:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-40253) Data read exception in orc format - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/05 14:47:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-40284) spark concurrent overwrite mode writes data to files in HDFS format, all request data write success - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/05 14:48:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-39948) exclude velocity 1.5 jar - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/05 14:49:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-40141) Task listener overloads no longer needed with JDK 8+ - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/05 14:49:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-40141) Task listener overloads no longer needed with JDK 8+ - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/05 14:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-40642) wrong doc on memory tuning regarding String object memory size, changed since version>=9 - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/05 14:52:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41389) Reuse `WRONG_NUM_ARGS` instead of `_LEGACY_ERROR_TEMP_1044` - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/05 15:06:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41389) Reuse `WRONG_NUM_ARGS` instead of `_LEGACY_ERROR_TEMP_1044` - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/05 15:06:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41393) Upgrade slf4j to 2.0.5 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/05 15:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41393) Upgrade slf4j to 2.0.5 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 15:33:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41393) Upgrade slf4j to 2.0.5 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 15:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41392) spark builds against hadoop trunk/3.4.0-SNAPSHOT fail in scala-maven plugin - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/05 15:36:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-40419) Integrate Grouped Aggregate Pandas UDFs into *.sql test cases - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 17:05:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41372) Support DataFrame TempView - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2022/12/05 17:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-39257) use spark.read.jdbc() to read data from SQL databse into dataframe, it fails silently, when the session is killed from SQL server side - posted by "Sandeep Katta (Jira)" <ji...@apache.org> on 2022/12/05 18:34:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41394) Skip MemoryProfilerTests when pandas is not installed - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/05 18:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41394) Skip MemoryProfilerTests when pandas is not installed - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 18:52:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41394) Skip MemoryProfilerTests when pandas is not installed - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 18:52:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-18502) Spark does not handle columns that contain backquote (`) - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2022/12/05 19:34:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-18502) Spark does not handle columns that contain backquote (`) - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2022/12/05 19:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41395) InterpretedMutableProjection can corrupt unsafe buffer when used with decimal data - posted by "Bruce Robbins (Jira)" <ji...@apache.org> on 2022/12/05 19:56:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41395) InterpretedMutableProjection can corrupt unsafe buffer when used with decimal data - posted by "Bruce Robbins (Jira)" <ji...@apache.org> on 2022/12/05 19:57:00 UTC, 4 replies.
- [jira] [Resolved] (SPARK-41390) Update the script used to generate register function in UDFRegistration - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/05 20:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41396) Oneof field support and recursive fields - posted by "Sandish Kumar HN (Jira)" <ji...@apache.org> on 2022/12/05 21:30:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41396) Oneof field support and recursive fields - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 21:54:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41396) Oneof field support and recursive fields - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 21:54:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41394) Skip MemoryProfilerTests when pandas is not installed - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/05 22:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41395) InterpretedMutableProjection can corrupt unsafe buffer when used with decimal data - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 22:57:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41395) InterpretedMutableProjection can corrupt unsafe buffer when used with decimal data - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 22:57:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-41397) Implement part of string/binary functions - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2022/12/05 23:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41397) Implement part of String/Binary functions - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2022/12/05 23:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41397) Implement part of string/binary functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 23:16:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41397) Implement part of string/binary functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/05 23:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41398) Relax constraints on Storage-Partitioned Join when partition keys after runtime filtering do not match - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2022/12/05 23:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41398) Relax constraints on Storage-Partitioned Join when partition keys after runtime filtering do not match - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 00:35:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41398) Relax constraints on Storage-Partitioned Join when partition keys after runtime filtering do not match - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 00:35:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41369) Refactor connect directory structure - posted by "Herman van Hövell (Jira)" <ji...@apache.org> on 2022/12/06 00:50:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41399) Refactor column related tests to test_connect_column - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/06 00:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41400) Split of API classes from Catalyst - posted by "Herman van Hövell (Jira)" <ji...@apache.org> on 2022/12/06 00:53:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41399) Refactor column related tests to test_connect_column - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 00:56:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41399) Refactor column related tests to test_connect_column - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 00:56:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41399) Refactor column related tests to test_connect_column - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/06 03:12:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41399) Refactor column related tests to test_connect_column - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/06 03:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41247) Unify the protobuf versions in Spark connect and protobuf connector - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 03:35:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41401) spark2 stagedir can't be change - posted by "sinlang (Jira)" <ji...@apache.org> on 2022/12/06 03:36:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41401) spark2 stagedir can't be change - posted by "sinlang (Jira)" <ji...@apache.org> on 2022/12/06 03:37:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41402) Override nodeName of StringDecode - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2022/12/06 04:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41244) Introducing a Protobuf serializer for UI data on KV store - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/06 05:47:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-41369) Refactor connect directory structure - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/06 06:07:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41369) Refactor connect directory structure - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/06 06:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41034) Connect DataFrame should require RemoteSparkSession - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 06:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-34987) AQE improve: change shuffle hash join to sort merge join when skewed shuffle hash join exists - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2022/12/06 06:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-40801) Upgrade Apache Commons Text to 1.10 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 06:53:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41001) Connection string support for Python client - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 07:17:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41403) Implement DataFrame.describe - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/06 08:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41403) Implement DataFrame.describe - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/06 08:17:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41404) Support `ColumnarBatchSuite#testRandomRows` to test more primitive dataType - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/06 08:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41404) Support `ColumnarBatchSuite#testRandomRows` to test more primitive dataType - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 08:29:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41404) Support `ColumnarBatchSuite#testRandomRows` to test more primitive dataType - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 08:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41405) centralize the column resolution logic - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/06 09:20:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41405) centralize the column resolution logic - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 09:22:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41405) centralize the column resolution logic - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 09:22:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41317) PySpark write API for Spark Connect - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 09:28:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41121) Upgrade sbt-assembly from 1.2.0 to 2.0.0 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/06 09:33:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41121) Upgrade sbt-assembly from 1.2.0 to 2.0.0 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/06 09:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41406) Refactor error message for `NUM_COLUMNS_MISMATCH` to make it more generic - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2022/12/06 10:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41319) when-otherwise support - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 10:16:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-28869) Roll over event log files - posted by "Ranga Reddy (Jira)" <ji...@apache.org> on 2022/12/06 11:21:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-28869) Roll over event log files - posted by "Ranga Reddy (Jira)" <ji...@apache.org> on 2022/12/06 11:22:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41406) Refactor error message for `NUM_COLUMNS_MISMATCH` to make it more generic - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 12:01:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41406) Refactor error message for `NUM_COLUMNS_MISMATCH` to make it more generic - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 12:01:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41403) Implement DataFrame.describe - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 12:25:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41407) Pull out v1 write to WriteFiles - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2022/12/06 12:45:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41407) Pull out v1 write to WriteFiles - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 12:48:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-41407) Pull out v1 write to WriteFiles - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 12:48:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41408) Upgrade scala-maven-plugin to 4.8.0 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/06 14:15:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41408) Upgrade scala-maven-plugin to 4.8.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 14:17:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41408) Upgrade scala-maven-plugin to 4.8.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 14:17:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41409) Reuse `WRONG_NUM_ARGS` instead of `_LEGACY_ERROR_TEMP_1043` - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/06 15:40:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41409) Reuse `WRONG_NUM_ARGS` instead of `_LEGACY_ERROR_TEMP_1043` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 15:44:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41409) Reuse `WRONG_NUM_ARGS` instead of `_LEGACY_ERROR_TEMP_1043` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 15:44:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41398) Relax constraints on Storage-Partitioned Join when partition keys after runtime filtering do not match - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/06 15:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41393) Upgrade slf4j to 2.0.5 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/06 15:58:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41410) Support PVC-oriented executor pod allocation - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/06 17:18:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41410) Support PVC-oriented executor pod allocation - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 17:25:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41410) Support PVC-oriented executor pod allocation - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 17:25:00 UTC, 6 replies.
- [jira] [Created] (SPARK-41411) Multi-Stateful Operator watermark support bug fix - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2022/12/06 18:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41411) Multi-Stateful Operator watermark support bug fix - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2022/12/06 19:02:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41411) Multi-Stateful Operator watermark support bug fix - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 19:04:00 UTC, 2 replies.
- [jira] (SPARK-41411) Multi-Stateful Operator watermark support bug fix - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2022/12/06 19:07:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41411) Multi-Stateful Operator watermark support bug fix - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2022/12/06 19:23:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41412) Implement `Cast` - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/06 19:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41413) Storage-Partitioned Join should avoid shuffle when partition keys mismatch, but join expressions are compatible - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2022/12/06 20:43:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-38918) Nested column pruning should filter out attributes that do not belong to the current relation - posted by "Wing Yew Poon (Jira)" <ji...@apache.org> on 2022/12/06 21:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41414) Implement data/timestamp functions - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2022/12/06 22:01:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41410) Support PVC-oriented executor pod allocation - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/06 22:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41414) Implement date/timestamp functions - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2022/12/06 22:38:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41414) Implement date/timestamp functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 22:40:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41414) Implement date/timestamp functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 22:40:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41411) Multi-Stateful Operator watermark support bug fix - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2022/12/06 23:36:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41231) Built-in SQL Function Improvement - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 23:42:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41231) Built-in SQL Function Improvement - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/06 23:42:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41415) SASL Request Retries - posted by "Aravind Patnam (Jira)" <ji...@apache.org> on 2022/12/07 00:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41415) SASL Request Retry - posted by "Aravind Patnam (Jira)" <ji...@apache.org> on 2022/12/07 00:59:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41413) Storage-Partitioned Join should avoid shuffle when partition keys mismatch, but join expressions are compatible - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 01:44:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41413) Storage-Partitioned Join should avoid shuffle when partition keys mismatch, but join expressions are compatible - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 01:44:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41366) DF.groupby.agg() API should be compatible - posted by "Herman van Hövell (Jira)" <ji...@apache.org> on 2022/12/07 02:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41416) Rewrite self join in in predicate to aggregate - posted by "Wan Kun (Jira)" <ji...@apache.org> on 2022/12/07 02:18:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41416) Rewrite self join in in predicate to aggregate - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 02:30:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41416) Rewrite self join in in predicate to aggregate - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 02:30:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-39865) Show proper error messages on the overflow errors of table insert - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 02:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41417) Assign a name to the error class _LEGACY_ERROR_TEMP_0019 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/07 02:51:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41417) Assign a name to the error class _LEGACY_ERROR_TEMP_0019 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 02:58:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41417) Assign a name to the error class _LEGACY_ERROR_TEMP_0019 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 02:58:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41418) Upgrade scala-maven-plugin from 4.7.2 to 4.8.0 - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2022/12/07 03:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41418) Upgrade scala-maven-plugin from 4.7.2 to 4.8.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 03:03:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41418) Upgrade scala-maven-plugin from 4.7.2 to 4.8.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 03:04:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41419) [K8S] Decrement PVC_COUNTER when the pod deletion happens - posted by "Ted Yu (Jira)" <ji...@apache.org> on 2022/12/07 03:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41419) [K8S] Decrement PVC_COUNTER when the pod deletion happens - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 03:08:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41419) [K8S] Decrement PVC_COUNTER when the pod deletion happens - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 03:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41382) implement `product` function - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/07 03:43:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41397) Implement part of string/binary functions - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/07 04:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41386) There are some small files when using rebalance(column) - posted by "Zhe Dong (Jira)" <ji...@apache.org> on 2022/12/07 04:24:00 UTC, 5 replies.
- [jira] [Created] (SPARK-41421) Protobuf serializer for ApplicationEnvironmentInfoWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/07 04:49:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41420) Protobuf serializer for ApplicationInfoWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/07 04:49:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41423) Protobuf serializer for StageDataWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/07 04:50:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41425) Protobuf serializer for RDDStorageInfoWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/07 04:50:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41422) Protobuf serializer for ExecutorSummaryWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/07 04:50:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41424) Protobuf serializer for TaskDataWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/07 04:50:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41426) Protobuf serializer for ResourceProfileWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/07 04:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41427) Protobuf serializer for ExecutorStageSummaryWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/07 04:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41428) Protobuf serializer for SpeculationStageSummaryWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/07 04:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41430) Protobuf serializer for ProcessSummaryWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/07 04:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41429) Protobuf serializer for RDDOperationGraphWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/07 04:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41432) Protobuf serializer for SparkPlanGraphWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/07 04:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41431) Protobuf serializer for SQLExecutionUIData - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/07 04:53:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41053) Better Spark UI scalability and Driver stability for large applications - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/07 04:56:00 UTC, 6 replies.
- [jira] [Created] (SPARK-41433) Make Max Arrow BatchSize configurable - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/07 05:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41433) Make Max Arrow BatchSize configurable - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 05:09:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41433) Make Max Arrow BatchSize configurable - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 05:09:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41434) Support LambdaFunction expresssion - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/07 05:24:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41415) SASL Request Retries - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 06:00:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41415) SASL Request Retries - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 06:00:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41298) Getting Count on data frame is giving the performance issue - posted by "Ramakrishna (Jira)" <ji...@apache.org> on 2022/12/07 06:54:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41435) Make `curdate()` throw `WRONG_NUM_ARGS ` instead of `_LEGACY_ERROR_TEMP_1043 ` when args is not null - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/07 07:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41435) Make `curdate()` throw `WRONG_NUM_ARGS ` instead of `_LEGACY_ERROR_TEMP_1043 ` when args is not null - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 07:13:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41435) Make `curdate()` throw `WRONG_NUM_ARGS ` instead of `_LEGACY_ERROR_TEMP_1043 ` when args is not null - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 07:13:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41436) Implement `collection` functions: A~C - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/07 07:15:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41436) Implement `collection` functions: A~C - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 07:22:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41436) Implement `collection` functions: A~C - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 07:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41283) Feature parity: Functions API in Spark Connect - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/07 07:39:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41437) Do not optimize the input query twice for v1 write fallback - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/07 07:46:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41437) Do not optimize the input query twice for v1 write fallback - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 07:48:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41437) Do not optimize the input query twice for v1 write fallback - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 07:48:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41381) Implement count_distinct and sum_distinct functions - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/07 07:53:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-40852) Implement `DataFrame.summary` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 07:57:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41349) Implement `DataFrame.hint` - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/07 08:09:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41403) Implement DataFrame.describe - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/07 08:25:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-41386) There are some small files when using rebalance(column) - posted by "Zhe Dong (Jira)" <ji...@apache.org> on 2022/12/07 08:30:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41433) Make Max Arrow BatchSize configurable - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/07 08:31:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41386) There are some small files when using rebalance(column) - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 08:44:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41438) Implement DataFrame. colRegex - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/07 09:24:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41439) Implement `DataFrame.melt` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/07 09:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41440) Implement DataFrame.randomSplit - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/07 09:27:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41438) Implement DataFrame. colRegex - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/07 09:30:00 UTC, 3 replies.
- [jira] (SPARK-41438) Implement DataFrame. colRegex - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/07 09:52:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41439) Implement `DataFrame.melt` - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/07 09:52:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41418) Upgrade scala-maven-plugin from 4.7.2 to 4.8.0 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/07 10:33:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-41418) Upgrade scala-maven-plugin from 4.7.2 to 4.8.0 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/07 10:33:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41437) Do not optimize the input query twice for v1 write fallback - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/07 10:39:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41008) Isotonic regression result differs from sklearn implementation - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 12:38:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41441) Allow Generate with no required child output to host outer references - posted by "Allison Wang (Jira)" <ji...@apache.org> on 2022/12/07 16:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41441) Allow Generate with no required child output to host outer references - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 18:02:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41441) Allow Generate with no required child output to host outer references - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 18:02:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-41349) Implement `DataFrame.hint` - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/07 18:15:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41233) High-order function: array_prepend - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 19:59:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41442) Only update SQLMetric value if merging with valid metric - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2022/12/07 20:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41442) Only update SQLMetric value if merging with valid metric - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 20:59:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41442) Only update SQLMetric value if merging with valid metric - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 20:59:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41412) Implement `Cast` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 21:00:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41412) Implement `Cast` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/07 21:00:00 UTC, 4 replies.
- [jira] [Resolved] (SPARK-41378) Support Column Stats in DS V2 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/07 21:17:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41376) Executor netty direct memory check should respect spark.shuffle.io.preferDirectBufs - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/08 00:16:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41376) Executor netty direct memory check should respect spark.shuffle.io.preferDirectBufs - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/08 00:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41443) Assign a name to the error class _LEGACY_ERROR_TEMP_1061 - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2022/12/08 02:27:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41443) Assign a name to the error class _LEGACY_ERROR_TEMP_1061 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/08 02:31:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41443) Assign a name to the error class _LEGACY_ERROR_TEMP_1061 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/08 02:31:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41439) Implement `DataFrame.melt` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/08 02:33:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41444) Support read.json - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/08 03:56:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41284) Feature parity: I/O in Spark Connect - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/08 04:03:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41284) Feature parity: I/O in Spark Connect - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/08 04:03:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41350) allow simple name access of using join hidden columns after subquery alias - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/08 04:27:00 UTC, 0 replies.
- [jira] (SPARK-41439) Implement `DataFrame.melt` - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/08 04:34:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41442) Only update SQLMetric value if merging with valid metric - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/08 05:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41284) Feature parity: I/O in Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/08 06:10:00 UTC, 0 replies.
- [jira] (SPARK-41284) Feature parity: I/O in Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/08 06:20:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41444) Support read.json - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/08 06:20:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41444) Support read.json - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/08 06:20:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-41284) Feature parity: I/O in Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/08 06:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41445) Implement DataFrameReader.parquet - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/08 06:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41444) Implement DataFrameReader.json - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/08 06:21:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41444) Implement DataFrameReader.json - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/08 06:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41445) Implement DataFrameReader.parquet - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/08 06:30:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41445) Implement DataFrameReader.parquet - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/08 06:30:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-38277) Clear write batch after RocksDB state store's commit - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2022/12/08 07:23:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-39948) exclude velocity 1.5 jar - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/08 07:45:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41446) Make `createDataFrame` support schema and more input dataset type - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/08 07:49:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41446) Make `createDataFrame` support schema and more input dataset types - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/08 08:02:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41446) Make `createDataFrame` support schema and more input dataset types - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/08 08:09:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41446) Make `createDataFrame` support schema and more input dataset types - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/08 08:09:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41375) Avoid empty latest KafkaSourceOffset - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2022/12/08 08:14:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41445) Implement DataFrameReader.parquet - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/08 08:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41447) clean up expired event log files that don't exist in listing db - posted by "shuyouZZ (Jira)" <ji...@apache.org> on 2022/12/08 08:44:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41412) Implement `Cast` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/08 08:58:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41436) Implement `collection` functions: A~C - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/08 09:00:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41439) Implement `DataFrame.melt` and `DataFrame.unpivot` - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/08 09:31:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41447) clean up expired event log files that don't exist in listing db - posted by "shuyouZZ (Jira)" <ji...@apache.org> on 2022/12/08 09:42:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41448) Make consistent MR job IDs in DSV2 and FileFormatWriter - posted by "Hui An (Jira)" <ji...@apache.org> on 2022/12/08 10:23:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41448) Make consistent MR job IDs in FileBatchWriter and FileFormatWriter - posted by "Hui An (Jira)" <ji...@apache.org> on 2022/12/08 10:27:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41448) Make consistent MR job IDs in FileBatchWriter and FileFormatWriter - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/08 10:32:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41448) Make consistent MR job IDs in FileBatchWriter and FileFormatWriter - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/08 10:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41447) clean up expired event log files that don't exist in listing db - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/08 11:40:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41447) clean up expired event log files that don't exist in listing db - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/08 11:40:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41449) Stage level scheduling, allow to change number of executors - posted by "Shay Elbaz (Jira)" <ji...@apache.org> on 2022/12/08 11:49:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41449) Stage level scheduling, allow to change number of executors - posted by "Shay Elbaz (Jira)" <ji...@apache.org> on 2022/12/08 11:50:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41435) Make `curdate()` throw `WRONG_NUM_ARGS ` instead of `_LEGACY_ERROR_TEMP_1043 ` when args is not null - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/08 12:41:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-36833) Can't use SSL with spark on kubernetes on service level - posted by "Gellért (Jira)" <ji...@apache.org> on 2022/12/08 12:44:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41450) PySpark built from master code raise error "java.lang.ClassNotFoundException: org.eclipse.jetty.server.Handler" - posted by "Weichen Xu (Jira)" <ji...@apache.org> on 2022/12/08 13:34:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41450) PySpark built from master code raise error "java.lang.ClassNotFoundException: org.eclipse.jetty.server.Handler" - posted by "Weichen Xu (Jira)" <ji...@apache.org> on 2022/12/08 13:36:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41408) Upgrade scala-maven-plugin to 4.8.0 - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/08 13:42:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41008) Isotonic regression result differs from sklearn implementation - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/08 14:30:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41451) Avoid using empty abbrevMarker in StringUtils.abbreviate - posted by "Cheng Pan (Jira)" <ji...@apache.org> on 2022/12/08 15:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41451) Avoid using empty abbrevMarker in StringUtils.abbreviate - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/08 16:30:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41451) Avoid using empty abbrevMarker in StringUtils.abbreviate - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/08 16:30:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41452) to_char throws NullPointerException when format is null - posted by "Bruce Robbins (Jira)" <ji...@apache.org> on 2022/12/08 21:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41452) to_char throws NullPointerException when format is null - posted by "Bruce Robbins (Jira)" <ji...@apache.org> on 2022/12/08 21:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41452) to_char throws NullPointerException when format is null - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/08 21:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41452) to_char throws NullPointerException when format is null - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/08 21:32:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41453) Implement DataFrame.subtract - posted by "Tom van Bussel (Jira)" <ji...@apache.org> on 2022/12/08 22:32:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41454) Support Python 3.11 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/08 22:49:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41454) Support Python 3.11 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/08 22:50:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41454) Support Python 3.11 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/08 22:50:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41455) Resolve dtypes inconsistencies of date/timestamp functions - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2022/12/08 23:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41455) Resolve dtypes inconsistencies of date/timestamp functions - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2022/12/08 23:59:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41452) to_char throws NullPointerException when format is null - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/09 00:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41454) Support Python 3.11 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/09 00:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41125) Simple call to createDataFrame fails with PicklingError but only on python3.11 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/09 00:37:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41450) PySpark built from master code raise error "java.lang.ClassNotFoundException: org.eclipse.jetty.server.Handler" - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/09 01:10:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41402) Override nodeName of StringDecode - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/09 01:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41440) Implement DataFrame.randomSplit - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/09 04:16:00 UTC, 5 replies.
- [jira] [Created] (SPARK-41456) Improve the performance of try_cast - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/09 05:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41456) Improve the performance of try_cast - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/09 05:18:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41456) Improve the performance of try_cast - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 05:19:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41456) Improve the performance of try_cast - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 05:19:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41457) Refactor pandas, pyarrow and grpc check in tests - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/09 05:25:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41458) Correctly transform the SPI services for Yarn Shuffle Service - posted by "Cheng Pan (Jira)" <ji...@apache.org> on 2022/12/09 05:36:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41458) Correctly transform the SPI services for Yarn Shuffle Service - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 05:44:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41458) Correctly transform the SPI services for Yarn Shuffle Service - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 05:44:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41459) Spark Thrift Server operation log output is empty - posted by "Yun Tian (Jira)" <ji...@apache.org> on 2022/12/09 06:43:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41457) Refactor pandas, pyarrow and grpc check in tests - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 06:46:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41457) Refactor pandas, pyarrow and grpc check in tests - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 06:46:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41460) Introduce IsolatedThreadSafeRpcEndpoint to extend IsolatedRpcEndpoint - posted by "wuyi (Jira)" <ji...@apache.org> on 2022/12/09 06:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41459) Spark Thrift Server operation log output is empty - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2022/12/09 06:56:00 UTC, 4 replies.
- [jira] [Assigned] (SPARK-41459) Spark Thrift Server operation log output is empty - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 07:04:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41329) Solve circular import between Column and _typing/functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 07:05:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41329) Solve circular import between Column and _typing/functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 07:05:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-41460) Introduce IsolatedThreadSafeRpcEndpoint to extend IsolatedRpcEndpoint - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 07:10:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41460) Introduce IsolatedThreadSafeRpcEndpoint to extend IsolatedRpcEndpoint - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 07:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41461) protoc-3.21.9-linux-x86_64.exe requires GLIBC_2.14 - posted by "Haonan Jiang (Jira)" <ji...@apache.org> on 2022/12/09 07:14:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41461) protoc-3.21.9-linux-x86_64.exe requires GLIBC_2.14 - posted by "Haonan Jiang (Jira)" <ji...@apache.org> on 2022/12/09 07:15:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41461) protoc-3.21.9-linux-x86_64.exe requires GLIBC_2.14 - posted by "Haonan Jiang (Jira)" <ji...@apache.org> on 2022/12/09 07:16:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-41125) Simple call to createDataFrame fails with PicklingError but only on python3.11 - posted by "Jamie (Jira)" <ji...@apache.org> on 2022/12/09 07:23:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41462) Date and timestamp type can up cast to TimestampNTZ - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/09 07:59:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41462) Date and timestamp type can up cast to TimestampNTZ - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 08:01:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41462) Date and timestamp type can up cast to TimestampNTZ - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 08:01:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41463) Ensure error class (and subclass) names contain only capital letters, numbers and underscores - posted by "Bo Zhang (Jira)" <ji...@apache.org> on 2022/12/09 08:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41463) Ensure error class (and subclass) names contain only capital letters, numbers and underscores - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 08:19:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41463) Ensure error class (and subclass) names contain only capital letters, numbers and underscores - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 08:19:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41439) Implement `DataFrame.melt` and `DataFrame.unpivot` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/09 08:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41439) Implement `DataFrame.melt` and `DataFrame.unpivot` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/09 08:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41464) Implement DataFrame.to - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/09 08:30:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41244) Introducing a Protobuf serializer for UI data on KV store - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 08:38:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41461) protoc-3.21.9-linux-x86_64.exe requires GLIBC_2.14 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 08:51:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41455) Resolve dtypes inconsistencies of date/timestamp functions - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/09 09:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41402) Override nodeName of StringDecode - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 09:21:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41402) Override nodeName of StringDecode - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 09:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41465) Assign a name to the error class _LEGACY_ERROR_TEMP_1235 - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2022/12/09 09:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-40270) Make compute.max_rows as None working in DataFrame.style - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 09:27:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-41465) Assign a name to the error class _LEGACY_ERROR_TEMP_1235 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 09:38:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41465) Assign a name to the error class _LEGACY_ERROR_TEMP_1235 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 09:38:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41377) Fix spark-version-info.properties not found on Windows - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/09 10:08:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-39948) exclude velocity 1.5 jar - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/09 10:13:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-39948) Exclude hive-vector-code-gen dependency - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/09 10:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-39948) Exclude hive-vector-code-gen dependency - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/09 10:14:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-39948) exclude velocity 1.5 jar - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/09 10:14:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-39948) exclude velocity 1.5 jar - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/09 10:14:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37863) Add submitTime for Spark Application - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/09 10:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-8731) Beeline doesn't work with -e option when started in background - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/09 10:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41466) Change Scala Style configuration to catch AnyFunSuite instead of FunSuite - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/09 10:22:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41466) Change Scala Style configuration to catch AnyFunSuite instead of FunSuite - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 10:28:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41466) Change Scala Style configuration to catch AnyFunSuite instead of FunSuite - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 10:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41467) Upgrade httpclient from 4.5.13 to 4.5.14 - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2022/12/09 11:15:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41467) Upgrade httpclient from 4.5.13 to 4.5.14 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 11:22:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41467) Upgrade httpclient from 4.5.13 to 4.5.14 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 11:22:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41450) PySpark built from master code raise error "java.lang.ClassNotFoundException: org.eclipse.jetty.server.Handler" - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 11:47:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41392) spark builds against hadoop trunk/3.4.0-SNAPSHOT fail in scala-maven plugin - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 12:00:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41468) Fix PlanExpression handling in EquivalentExpressions - posted by "Peter Toth (Jira)" <ji...@apache.org> on 2022/12/09 12:34:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41225) Disable unsupported functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 12:43:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41395) InterpretedMutableProjection can corrupt unsafe buffer when used with decimal data - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/09 12:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41468) Fix PlanExpression handling in EquivalentExpressions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 12:58:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41468) Fix PlanExpression handling in EquivalentExpressions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 12:58:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41446) Make `createDataFrame` support schema and more input dataset types - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/09 13:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41458) Correctly transform the SPI services for Yarn Shuffle Service - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/09 14:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41458) Correctly transform the SPI services for Yarn Shuffle Service - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/09 14:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41402) Override nodeName of StringDecode - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/09 14:56:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41469) Task rerun on decommissioned executor can be avoided if shuffle data has migrated - posted by "wuyi (Jira)" <ji...@apache.org> on 2022/12/09 15:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41469) Task rerun on decommissioned executor can be avoided if shuffle data has migrated - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 15:27:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41469) Task rerun on decommissioned executor can be avoided if shuffle data has migrated - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 15:27:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41450) PySpark built from master code raise error "java.lang.ClassNotFoundException: org.eclipse.jetty.server.Handler" - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/09 15:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41470) SPJ shouldn't assume InternalRow implements equals and hashCode - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2022/12/09 17:17:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37376) SPJ: Introduce a new DataSource V2 interface HasPartitionKey - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2022/12/09 17:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37378) SPJ: Convert V2 Transform expressions into catalyst expressions and load their associated functions from V2 FunctionCatalog - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2022/12/09 17:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37377) SPJ: Initial implementation of Storage-Partitioned Join - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2022/12/09 17:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41471) SPJ: reduce Spark shuffle when only one side of a join is KeyGroupedPartitioning - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2022/12/09 17:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41413) SPJ: Spark should avoid shuffle when partition keys mismatch, but join expressions are compatible - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2022/12/09 17:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37375) Umbrella: Storage Partitioned Join (SPJ) - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2022/12/09 17:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-40946) SPJ: Introduce a new DataSource V2 interface SupportsPushDownClusterKeys - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2022/12/09 17:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41413) SPJ: Avoid shuffle when partition keys mismatch, but join expressions are compatible - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2022/12/09 17:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41398) SPJ: Relax constraints on Storage-Partitioned Join when partition keys after runtime filtering do not match - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2022/12/09 17:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41470) SPJ: Spark shouldn't assume InternalRow implements equals and hashCode - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2022/12/09 17:23:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41471) SPJ: Reduce Spark shuffle when only one side of a join is KeyGroupedPartitioning - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2022/12/09 17:23:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41462) Date and timestamp type can up cast to TimestampNTZ - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/09 17:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41466) Change Scala Style configuration to catch AnyFunSuite instead of FunSuite - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/09 17:32:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41472) Implement the rest of string/binary functions - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2022/12/09 22:40:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41283) Feature parity: Functions API in Spark Connect - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2022/12/09 22:41:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41472) Implement the rest of string/binary functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 22:45:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41472) Implement the rest of string/binary functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/09 22:45:00 UTC, 3 replies.
- [jira] [Created] (SPARK-41473) Implement `functions.format_number` - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2022/12/09 22:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41456) Improve the performance of try_cast - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/09 23:51:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41451) Avoid using empty abbrevMarker in StringUtils.abbreviate - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/10 00:17:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-41451) Avoid using empty abbrevMarker in StringUtils.abbreviate - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/10 00:17:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41329) Solve circular import between Column and _typing/functions - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/10 00:34:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41474) Exclude proto files from spark-protobuf - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/10 00:36:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41474) Exclude proto files from spark-protobuf - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/10 00:39:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41474) Exclude proto files from spark-protobuf - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/10 00:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41475) Fix lint-scala command error - posted by "Deng Ziming (Jira)" <ji...@apache.org> on 2022/12/10 00:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41475) Fix lint-scala command error - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/10 00:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41475) Fix lint-scala command error - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/10 00:54:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41414) Implement date/timestamp functions - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/10 01:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41476) Prevent `README.md` from triggering CIs - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/10 02:26:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41476) Prevent `README.md` from triggering CIs - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/10 02:28:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41476) Prevent `README.md` from triggering CIs - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/10 02:28:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41474) Exclude proto files from spark-protobuf - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/10 02:59:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41475) Fix lint-scala command error - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/10 05:28:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41457) Refactor pandas, pyarrow and grpc check in tests - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/10 05:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41477) Correctly infer the datatype of literal integers - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/10 05:46:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41477) Correctly infer the datatype of literal integers - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/10 05:51:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41477) Correctly infer the datatype of literal integers - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/10 05:51:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41467) Upgrade httpclient from 4.5.13 to 4.5.14 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/10 06:10:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41417) Assign a name to the error class _LEGACY_ERROR_TEMP_0019 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/10 06:51:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41476) Prevent `README.md` from triggering CIs - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/10 08:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41440) Implement DataFrame.randomSplit - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/10 12:00:00 UTC, 3 replies.
- [jira] [Created] (SPARK-41478) Assign a name to the error class _LEGACY_ERROR_TEMP_1234 - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2022/12/10 12:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41478) Assign a name to the error class _LEGACY_ERROR_TEMP_1234 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/10 12:10:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41478) Assign a name to the error class _LEGACY_ERROR_TEMP_1234 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/10 12:10:00 UTC, 2 replies.
- [jira] (SPARK-41440) Implement DataFrame.randomSplit - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/10 12:48:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41439) Implement `DataFrame.melt` and `DataFrame.unpivot` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/10 13:35:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41443) Assign a name to the error class _LEGACY_ERROR_TEMP_1061 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/10 16:28:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41460) Introduce IsolatedThreadSafeRpcEndpoint to extend IsolatedRpcEndpoint - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/10 23:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41461) protoc-3.21.9-linux-x86_64.exe requires GLIBC_2.14 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/11 01:17:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41404) Support `ColumnarBatchSuite#testRandomRows` to test more primitive dataType - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/11 03:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41479) Add `IPv4 and IPv6` section to K8s document - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/11 08:20:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41479) Add `IPv4 and IPv6` section to K8s document - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/11 08:24:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41479) Add `IPv4 and IPv6` section to K8s document - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/11 08:24:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-41246) When RddId exceeds Integer.Max_VALUE, RddId becomes negative - posted by "Qiang Yang (Jira)" <ji...@apache.org> on 2022/12/11 13:32:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41480) Clarify that input_file_name returns an URI encoded file name - posted by "Jonas (Jira)" <ji...@apache.org> on 2022/12/11 16:55:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41480) Clarify that input_file_name returns an URI encoded file name - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/11 17:19:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41480) Clarify that input_file_name returns an URI encoded file name - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/11 17:19:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41479) Add `IPv4 and IPv6` section to K8s document - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/11 21:07:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41477) Correctly infer the datatype of literal integers - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/12 00:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41481) Reuse `INVALID_TYPED_LITERAL` instead of `_LEGACY_ERROR_TEMP_1020` - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/12 01:55:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41481) Reuse `INVALID_TYPED_LITERAL` instead of `_LEGACY_ERROR_TEMP_1020` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/12 01:59:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41481) Reuse `INVALID_TYPED_LITERAL` instead of `_LEGACY_ERROR_TEMP_1020` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/12 01:59:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41481) Reuse `INVALID_TYPED_LITERAL` instead of `_LEGACY_ERROR_TEMP_0020` - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/12 02:11:00 UTC, 0 replies.
- [jira] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/12 02:18:00 UTC, 3 replies.
- [jira] [Created] (SPARK-41482) Upgrade dropwizard metrics 4.2.13 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/12 03:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41482) Upgrade dropwizard metrics 4.2.13 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/12 03:24:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41482) Upgrade dropwizard metrics 4.2.13 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/12 03:24:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41483) MetricsSystem report takes too much time, which may lead to spark application failed on yarn. - posted by "Deng An (Jira)" <ji...@apache.org> on 2022/12/12 03:26:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41483) MetricsSystem report takes too much time, which may lead to spark application failed on yarn. - posted by "Deng An (Jira)" <ji...@apache.org> on 2022/12/12 03:30:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41483) MetricsSystem report takes too much time, which may lead to spark application failed on yarn. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/12 03:36:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41483) MetricsSystem report takes too much time, which may lead to spark application failed on yarn. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/12 03:36:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41483) MetricsSystem report may cost too much time, which will lead to spark application failed on yarn. - posted by "Deng An (Jira)" <ji...@apache.org> on 2022/12/12 03:37:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41485) Unify the environment variable of *_PROTOC_EXEC_PATH - posted by "Haonan Jiang (Jira)" <ji...@apache.org> on 2022/12/12 04:23:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41484) Implement `collection` functions: E~M - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/12 04:23:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41485) Unify the environment variable of *_PROTOC_EXEC_PATH - posted by "Haonan Jiang (Jira)" <ji...@apache.org> on 2022/12/12 04:24:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41484) Implement `collection` functions: E~M - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/12 04:30:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41486) Upgrade MySQL docker image to 8.0.31 to support arm64 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/12 04:30:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41484) Implement `collection` functions: E~M - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/12 04:30:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41486) Upgrade MySQL docker image to 8.0.31 to support arm64 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/12 04:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41486) Upgrade MySQL docker image to 8.0.31 to support arm64 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/12 04:32:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-36880) Inline type hints for python/pyspark/sql/functions.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/12 04:45:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41187) [Core] LiveExecutor MemoryLeak in AppStatusListener when ExecutorLost happen - posted by "Mridul Muralidharan (Jira)" <ji...@apache.org> on 2022/12/12 04:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41187) [Core] LiveExecutor MemoryLeak in AppStatusListener when ExecutorLost happen - posted by "Mridul Muralidharan (Jira)" <ji...@apache.org> on 2022/12/12 04:55:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41487) Assign name to _LEGACY_ERROR_TEMP_1020 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/12 05:45:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41488) Assign name to _LEGACY_ERROR_TEMP_1176 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/12 05:46:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41490) Assign name to _LEGACY_ERROR_TEMP_2441 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/12 05:48:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41489) Assign name to _LEGACY_ERROR_TEMP_2415 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/12 05:48:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41486) Upgrade MySQL docker image to 8.0.31 to support arm64 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/12 06:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41463) Ensure error class (and subclass) names contain only capital letters, numbers and underscores - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/12 06:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41491) Update postgres 15.1 - posted by "William Hyun (Jira)" <ji...@apache.org> on 2022/12/12 07:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41491) Update postgres 15.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/12 07:14:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41491) Update postgres 15.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/12 07:14:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41484) Implement `collection` functions: E~M - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/12 07:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41492) implement MISC function - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/12 07:30:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41492) implement MISC function - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/12 07:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41492) implement MISC function - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/12 07:32:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41493) Make csv functions support options - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/12 07:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41494) Make json functions support options - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/12 07:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41495) Implement `collection` functions: P~Z - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/12 08:45:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41495) Implement `collection` functions: P~Z - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/12 08:51:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41495) Implement `collection` functions: P~Z - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/12 08:51:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41492) implement MISC function - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/12 09:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41496) Spark doesn't support multiple documents in one pod template file - posted by "Yanzhe Xu (Jira)" <ji...@apache.org> on 2022/12/12 09:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41496) Spark doesn't support multiple documents in one pod template file - posted by "Yanzhe Xu (Jira)" <ji...@apache.org> on 2022/12/12 09:20:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-41468) Fix PlanExpression handling in EquivalentExpressions - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/12 10:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-40775) V2 file scans have duplicative descriptions - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/12 10:17:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-40775) V2 file scans have duplicative descriptions - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/12 10:17:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41448) Make consistent MR job IDs in FileBatchWriter and FileFormatWriter - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/12 10:26:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-40171) Fix flaky tests in ImageFileFormatSuite - posted by "Ahmed Mahran (Jira)" <ji...@apache.org> on 2022/12/12 10:36:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41438) Implement DataFrame. colRegex - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/12 11:32:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41497) Accumulator undercounting in the case of retry task with rdd cache - posted by "wuyi (Jira)" <ji...@apache.org> on 2022/12/12 12:23:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41485) Unify the environment variable of *_PROTOC_EXEC_PATH - posted by "Haonan Jiang (Jira)" <ji...@apache.org> on 2022/12/12 12:35:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41498) Union does not propagate Metadata output - posted by "Fredrik Klauß (Jira)" <ji...@apache.org> on 2022/12/12 12:42:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41498) Union does not propagate Metadata output - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/12 12:48:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41498) Union does not propagate Metadata output - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/12 12:48:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41214) SQL metrics are missing from Spark UI when AQE for Cached DataFrame is enabled - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/12 13:20:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41497) Accumulator undercounting in the case of retry task with rdd cache - posted by "wuyi (Jira)" <ji...@apache.org> on 2022/12/12 13:22:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41497) Accumulator undercounting in the case of retry task with rdd cache - posted by "wuyi (Jira)" <ji...@apache.org> on 2022/12/12 13:25:00 UTC, 9 replies.
- [jira] [Resolved] (SPARK-41491) Update postgres 15.1 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/12 15:35:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41491) Update postgres docker image to 15.1 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/12 15:35:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41360) Avoid BlockManager re-registration if the executor has been lost - posted by "Mridul Muralidharan (Jira)" <ji...@apache.org> on 2022/12/12 19:33:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-40776) Add documentation (similar to Avro functions). - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/12 23:33:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-40776) Add documentation (similar to Avro functions). - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/12 23:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-27561) Support "lateral column alias references" to allow column aliases to be used within SELECT clauses - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/13 00:03:00 UTC, 3 replies.
- [jira] [Updated] (SPARK-41498) Union does not propagate Metadata output - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2022/12/13 00:04:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41495) Implement `collection` functions: P~Z - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/13 01:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41499) Upgrade protobuf version to 3.21.11 - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/13 01:27:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41499) Upgrade protobuf version to 3.21.11 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/13 01:30:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41499) Upgrade protobuf version to 3.21.11 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/13 01:30:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41501) auto generate concat as Double when string minus an INTERVAL type - posted by "JacobZheng (Jira)" <ji...@apache.org> on 2022/12/13 02:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41500) auto generate concat as Double when string minus an INTERVAL type - posted by "JacobZheng (Jira)" <ji...@apache.org> on 2022/12/13 02:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41502) Upgrade the minimum Minikube version to 1.28.0 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/13 02:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41502) Upgrade the minimum Minikube version to 1.28.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/13 02:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41502) Upgrade the minimum Minikube version to 1.28.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/13 02:19:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41501) auto generate concat as Double when string minus an INTERVAL type - posted by "JacobZheng (Jira)" <ji...@apache.org> on 2022/12/13 02:36:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-41501) auto generate concat as Double when string minus an INTERVAL type - posted by "JacobZheng (Jira)" <ji...@apache.org> on 2022/12/13 02:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41503) Implement Partition Transformation Functions - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/13 03:06:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41502) Upgrade the minimum Minikube version to 1.28.0 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/13 03:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41504) Update R version to 4.1.2 in Dockerfile comment - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/13 03:29:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41504) Update R version to 4.1.2 in Dockerfile comment - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/13 03:29:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41504) Update R version to 4.1.2 in Dockerfile comment - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/13 03:31:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41504) Update R version to 4.1.2 in Dockerfile comment - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/13 03:31:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41504) Update R version to 4.1.2 in Dockerfile comment - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/13 03:41:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41499) Upgrade protobuf version to 3.21.11 - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/13 04:13:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-33782) Place spark.files, spark.jars and spark.files under the current working directory on the driver in K8S cluster mode - posted by "Holden Karau (Jira)" <ji...@apache.org> on 2022/12/13 05:20:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41481) Reuse `INVALID_TYPED_LITERAL` instead of `_LEGACY_ERROR_TEMP_0020` - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/13 06:02:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41481) Reuse `INVALID_TYPED_LITERAL` instead of `_LEGACY_ERROR_TEMP_0020` - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/13 06:02:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41505) Assign name to _LEGACY_ERROR_TEMP_1179 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/13 06:26:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-38217) insert overwrite failed for external table with dynamic partition table - posted by "Jiayi Liu (Jira)" <ji...@apache.org> on 2022/12/13 07:12:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-41497) Accumulator undercounting in the case of retry task with rdd cache - posted by "Mridul Muralidharan (Jira)" <ji...@apache.org> on 2022/12/13 07:42:00 UTC, 4 replies.
- [jira] [Created] (SPARK-41506) Refactor LiteralExpression to support DataType - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/13 08:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41506) Refactor LiteralExpression to support DataType - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/13 08:32:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41506) Refactor LiteralExpression to support DataType - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/13 08:32:00 UTC, 6 replies.
- [jira] [Assigned] (SPARK-41424) Protobuf serializer for TaskDataWrapper - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/13 08:46:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41424) Protobuf serializer for TaskDataWrapper - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/13 08:46:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41507) Correct group of collection_funcs - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/13 08:46:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41507) Correct group of collection_funcs - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/13 08:47:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41507) Correct group of collection_funcs - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/13 08:47:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41406) Refactor error message for `NUM_COLUMNS_MISMATCH` to make it more generic - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/13 11:03:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41508) Assign name to _LEGACY_ERROR_TEMP_1179 and unwrap the existing SparkThrowable - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/13 11:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41508) assign name to _LEGACY_ERROR_TEMP_1179 and unwrap the existing SparkThrowable - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/13 11:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41509) Delay execution hash until after aggregation for semi-join runtime filter. - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/13 11:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41509) Delay execution hash until after aggregation for semi-join runtime filter. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/13 11:26:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41509) Delay execution hash until after aggregation for semi-join runtime filter. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/13 11:26:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41509) Delay execution hash until after aggregation for semi-join runtime filter. - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/13 12:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41510) Support easy way for user defined PYTHONPATH in workers - posted by "Ohad Raviv (Jira)" <ji...@apache.org> on 2022/12/13 12:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41511) LongToUnsafeRowMap support ignoresDuplicatedKey - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2022/12/13 12:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41511) LongToUnsafeRowMap support ignoresDuplicatedKey - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/13 12:17:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41511) LongToUnsafeRowMap support ignoresDuplicatedKey - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/13 12:17:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41510) Support easy way for user defined PYTHONPATH in workers - posted by "Ohad Raviv (Jira)" <ji...@apache.org> on 2022/12/13 12:18:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41510) Support easy way for user defined PYTHONPATH in workers - posted by "Ohad Raviv (Jira)" <ji...@apache.org> on 2022/12/13 12:23:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-41510) Support easy way for user defined PYTHONPATH in workers - posted by "Ohad Raviv (Jira)" <ji...@apache.org> on 2022/12/13 12:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41478) Assign a name to the error class _LEGACY_ERROR_TEMP_1234 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/13 13:57:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-39601) AllocationFailure should not be treated as exitCausedByApp when driver is shutting down - posted by "Thomas Graves (Jira)" <ji...@apache.org> on 2022/12/13 14:20:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-39601) AllocationFailure should not be treated as exitCausedByApp when driver is shutting down - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/13 14:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-27561) Support "lateral column alias references" to allow column aliases to be used within SELECT clauses - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/13 16:15:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-27561) Support "lateral column alias references" to allow column aliases to be used within SELECT clauses - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/13 16:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41482) Upgrade dropwizard metrics 4.2.13 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/13 18:39:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41062) Rename UNSUPPORTED_CORRELATED_REFERENCE to CORRELATED_REFERENCE - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/13 18:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41062) Rename UNSUPPORTED_CORRELATED_REFERENCE to CORRELATED_REFERENCE - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/13 18:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41506) Refactor LiteralExpression to support DataType - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/14 00:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41512) Row count based shuffle read to optimize global limit after a single partition shuffle (optionally with input partition sorted) - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/14 02:35:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41513) Implement a Accumulator to collect per mapper row count metrics - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/14 02:36:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41512) Row count based shuffle read to optimize global limit after a single partition shuffle (optionally with input partition sorted) - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/14 02:36:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41512) Row count based shuffle read to optimize global limit after a single partition shuffle (optionally with input partition sorted) - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/14 02:39:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41513) Implement a Accumulator to collect per mapper row count metrics - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/14 02:46:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41513) Implement a Accumulator to collect per mapper row count metrics - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/14 02:46:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41409) Reuse `WRONG_NUM_ARGS` instead of `_LEGACY_ERROR_TEMP_1043` - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/14 05:23:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41514) Add `PVC-oriented executor pod allocation` section and revise config name - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/14 05:25:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41514) Add `PVC-oriented executor pod allocation` section and revise config name - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/14 05:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41514) Add `PVC-oriented executor pod allocation` section and revise config name - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/14 05:28:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41248) Add config flag to control before of JSON partial results parsing in SPARK-40646 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/14 05:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41248) Add config flag to control before of JSON partial results parsing in SPARK-40646 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/14 05:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-38719) Test the error class: CANNOT_CAST_DATATYPE - posted by "Jayadeep Jayaraman (Jira)" <ji...@apache.org> on 2022/12/14 05:43:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-41410) Support PVC-oriented executor pod allocation - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/14 05:44:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41514) Add `PVC-oriented executor pod allocation` section and revise config name - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/14 05:44:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41515) PVC-oriented executor pod allocation - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/14 05:44:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-40459) recoverDiskStore should not stop by existing recomputed files - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/14 05:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-40304) Add decomTestTag to K8s Integration Test - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/14 05:47:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-40198) Enable spark.storage.decommission.(rdd|shuffle)Blocks.enabled by default - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/14 05:48:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-39965) Skip PVC cleanup when driver doesn't own PVCs - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/14 05:49:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-39846) Enable spark.dynamicAllocation.shuffleTracking.enabled by default - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/14 05:51:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-39898) Upgrade kubernetes-client to 5.12.3 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/14 05:51:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-39688) getReusablePVCs should handle accounts with no PVC permission - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/14 05:52:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-39450) Reuse PVCs by default - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/14 05:54:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-39324) Log ExecutorDecommission as INFO level in TaskSchedulerImpl - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/14 05:55:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41515) PVC-oriented executor pod allocation - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/14 05:57:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-38719) Test the error class: CANNOT_CAST_DATATYPE - posted by "Jayadeep Jayaraman (Jira)" <ji...@apache.org> on 2022/12/14 06:56:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41514) Add `PVC-oriented executor pod allocation` section and revise config name - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/14 08:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41516) Allow jdbc dialects to override the query used to create a table - posted by "xiaoping.huang (Jira)" <ji...@apache.org> on 2022/12/14 10:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41516) Allow jdbc dialects to override the query used to create a table - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/14 10:31:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41516) Allow jdbc dialects to override the query used to create a table - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/14 10:31:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41508) Assign name to _LEGACY_ERROR_TEMP_1179 and unwrap the existing SparkThrowable - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/14 12:57:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41508) Assign name to _LEGACY_ERROR_TEMP_1179 and unwrap the existing SparkThrowable - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/14 12:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41517) Failed to find name hashes for org.apache.spark.connect.proto.LocalRelation - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/14 13:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41517) Failed to find name hashes for org.apache.spark.connect.proto.LocalRelation - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/14 13:11:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-41517) Failed to find name hashes for org.apache.spark.connect.proto.LocalRelation - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/14 13:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41518) Assign a name to the error class _LEGACY_ERROR_TEMP_2422 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/14 16:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41518) Assign a name to the error class _LEGACY_ERROR_TEMP_2422 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/14 16:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41518) Assign a name to the error class _LEGACY_ERROR_TEMP_2422 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/14 16:34:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41519) Pin versions-maven-plugin version - posted by "John Zhuge (Jira)" <ji...@apache.org> on 2022/12/14 21:59:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41519) Pin versions-maven-plugin version - posted by "John Zhuge (Jira)" <ji...@apache.org> on 2022/12/14 22:01:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41520) Split AND_OR TreePattern to separate AND and OR TreePatterns - posted by "Kelvin Jiang (Jira)" <ji...@apache.org> on 2022/12/15 01:56:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41438) Implement DataFrame. colRegex - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/15 02:04:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41520) Split AND_OR TreePattern to separate AND and OR TreePatterns - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/15 02:06:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41520) Split AND_OR TreePattern to separate AND and OR TreePatterns - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/15 02:06:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41521) Upgrade fabric8io - kubernetes-client from 6.2.0 to 6.3.0 - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2022/12/15 02:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41521) Upgrade fabric8io - kubernetes-client from 6.2.0 to 6.3.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/15 02:11:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41521) Upgrade fabric8io - kubernetes-client from 6.2.0 to 6.3.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/15 02:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41522) GA dependencies test faild - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/15 03:07:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41522) GA dependencies test faild - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/15 03:11:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41522) GA dependencies test faild - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/15 03:11:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41523) `protoc-jar-maven-plugin` should uniformly use `protoc-jar-maven-plugin.version` as the version - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/15 04:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41523) `protoc-jar-maven-plugin` should uniformly use `protoc-jar-maven-plugin.version` as the version - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/15 04:54:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41523) `protoc-jar-maven-plugin` should uniformly use `protoc-jar-maven-plugin.version` as the version - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/15 05:00:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41523) `protoc-jar-maven-plugin` should uniformly use `protoc-jar-maven-plugin.version` as the version - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/15 05:00:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41521) Upgrade fabric8io - kubernetes-client from 6.2.0 to 6.3.0 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/15 05:44:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41521) Upgrade kubernetes-client to 6.3.0 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/15 05:44:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41434) Support LambdaFunction expresssion - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/15 05:47:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41434) Support LambdaFunction expresssion - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/15 05:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41524) Expose SQL confs and extraOptions separately in o.a.s.sql.execution.streaming.state.RocksDBConf - posted by "Huanli Wang (Jira)" <ji...@apache.org> on 2022/12/15 06:04:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41524) Expose SQL confs and extraOptions separately in o.a.s.sql.execution.streaming.state.RocksDBConf - posted by "Huanli Wang (Jira)" <ji...@apache.org> on 2022/12/15 06:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41271) Parameterized SQL - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/15 06:15:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41524) Expose SQL confs and extraOptions separately in o.a.s.sql.execution.streaming.state.RocksDBConf - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/15 06:19:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41524) Expose SQL confs and extraOptions separately in o.a.s.sql.execution.streaming.state.RocksDBConf - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/15 06:19:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41037) Fix pandas_udf when return type is array of MapType working properly. - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/15 06:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41525) Use unique list of executor IDs and PVC names in onNewSnapshots - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/15 07:20:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41525) Use unique list of known executor IDs and PVC names in onNewSnapshots - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/15 07:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41525) Improve onNewSnapshots to use unique list of known executor IDs and PVC names - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/15 07:26:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-41525) Improve onNewSnapshots to use unique list of known executor IDs and PVC names - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/15 07:26:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41525) Improve onNewSnapshots to use unique list of known executor IDs and PVC names - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/15 07:26:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41515) PVC-oriented executor pod allocation - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/15 07:28:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41453) Implement DataFrame.subtract - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/15 07:58:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-41464) Implement DataFrame.to - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/15 07:59:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41522) GA dependencies test faild - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/15 08:02:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41525) Improve onNewSnapshots to use unique list of known executor IDs and PVC names - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/15 08:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41522) GA dependencies test faild - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/15 08:41:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41453) Implement DataFrame.subtract - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/15 09:18:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41526) Implement `Column.isin` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/15 09:33:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41526) Implement `Column.isin` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/15 09:42:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41526) Implement `Column.isin` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/15 09:42:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41472) Implement the rest of string/binary functions - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/15 09:49:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41521) Upgrade kubernetes-client to 6.3.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/15 10:05:00 UTC, 1 replies.
- [jira] [Reopened] (SPARK-41521) Upgrade kubernetes-client to 6.3.0 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/15 10:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41521) Upgrade kubernetes-client to 6.3.0 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/15 10:06:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41527) Implement DataFrame.observe - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/15 10:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41528) Sharing namespace between PySpark and Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/15 10:40:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41528) Sharing namespace between PySpark and Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/15 10:40:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41528) Sharing namespace between PySpark and Spark Connect - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/15 10:41:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41528) Sharing namespace between PySpark and Spark Connect - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/15 10:41:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-41289) Feature parity: Catalog API - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/15 10:42:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41281) Feature parity: SparkSession API in Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/15 10:42:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/15 10:42:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41279) Feature parity: DataFrame API in Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/15 10:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41529) Implement SparkSession.stop - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/15 10:42:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41288) Server-specific improvement, error handling and API - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/15 10:43:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41286) Build, package and infrastructure for Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/15 10:43:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-40452) Developer documentation - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/15 10:43:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-40451) Type annotations for Spark Connect Python client - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/15 10:43:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41526) Implement `Column.isin` - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/15 11:58:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41530) extend MedianHeap to support percentile - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/15 12:17:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41530) extend MedianHeap to support percentile - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/15 12:22:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41530) extend MedianHeap to support percentile - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/15 12:22:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41511) LongToUnsafeRowMap support ignoresDuplicatedKey - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/15 13:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41531) Debugging and Stability - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/15 15:01:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41532) DF operations that involve multiple data frames should fail if sessions don't match - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/15 15:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41533) GRPC Errors on the client should be cleaned up - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/15 15:04:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41534) Setup initial client module for Spark Connect - posted by "Venkata Sai Akhil Gudesa (Jira)" <ji...@apache.org> on 2022/12/15 15:48:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41534) Setup initial client module for Spark Connect - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/15 16:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41534) Setup initial client module for Spark Connect - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/15 16:00:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41465) Assign a name to the error class _LEGACY_ERROR_TEMP_1235 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/15 18:23:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41524) Expose SQL confs and extraOptions separately in o.a.s.sql.execution.streaming.state.RocksDBConf - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2022/12/15 21:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41535) InterpretedUnsafeProjection and InterpretedMutableProjection can corrupt unsafe buffer when used with calendar interval data - posted by "Bruce Robbins (Jira)" <ji...@apache.org> on 2022/12/15 21:15:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41535) InterpretedUnsafeProjection and InterpretedMutableProjection can corrupt unsafe buffer when used with calendar interval data - posted by "Bruce Robbins (Jira)" <ji...@apache.org> on 2022/12/15 21:21:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41536) Remove `Dynamic Resource Allocation` from K8s Future Work - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/15 22:26:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41536) Remove `Dynamic Resource Allocation` from K8s Future Work - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/15 22:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41536) Remove `Dynamic Resource Allocation` from K8s Future Work - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/15 22:28:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-41536) Remove `Dynamic Resource Allocation` from K8s Future Work - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/15 22:29:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41537) Protobuf backwards compatibility testing - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/15 23:02:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41537) Protobuf backwards compatibility testing - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/15 23:02:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41538) Metadata column should be appended at the end of project list - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/16 00:04:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41538) Metadata column should be appended at the end of project list - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 00:13:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41538) Metadata column should be appended at the end of project list - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 00:13:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41536) Remove `Dynamic Resource Allocation` from K8s Future Work - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 00:44:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41094) The saveAsTable method fails to be executed, resulting in data file loss - posted by "pengfei zhao (Jira)" <ji...@apache.org> on 2022/12/16 01:36:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-41531) Debugging and Stability - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/16 01:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41539) stats and constraints in LogicalRDD may not be in sync with output attributes - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2022/12/16 02:39:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-40687) Support data masking built-in Function 'mask' - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/16 02:51:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-40687) Support data masking built-in Function 'mask' - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/16 02:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41539) stats and constraints in LogicalRDD may not be in sync with output attributes - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 02:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41540) Add `DISK_USED` executor roll policy - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 02:59:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41539) stats and constraints in LogicalRDD may not be in sync with output attributes - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 02:59:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41540) Add `DISK_USED` executor roll policy - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 03:02:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41540) Add `DISK_USED` executor roll policy - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 03:02:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41540) Add `DISK_USED` executor roll policy - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 03:20:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41520) Split AND_OR TreePattern to separate AND and OR TreePatterns - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/16 03:40:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41464) Implement DataFrame.to - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 04:11:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41541) Fix wrong child call in SQLShuffleWriteMetricsReporter.decRecordsWritten() - posted by "Josh Rosen (Jira)" <ji...@apache.org> on 2022/12/16 04:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41542) Run Coverage report for Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/16 04:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41542) Run Coverage report for Spark Connect - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 04:22:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41542) Run Coverage report for Spark Connect - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 04:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41319) when-otherwise support - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/16 04:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41540) Add `DISK_USED` executor roll policy - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 04:27:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41541) Fix wrong child call in SQLShuffleWriteMetricsReporter.decRecordsWritten() - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 04:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41543) Add `TOTAL_SHUFFLE_WRITE` executor roll policy - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 04:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41543) Add `TOTAL_SHUFFLE_WRITE` executor roll policy - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 04:56:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41543) Add `TOTAL_SHUFFLE_WRITE` executor roll policy - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 04:56:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41542) Run Coverage report for Spark Connect - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 05:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41544) Upgrade `versions-maven-plugin` to 2.14.1 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/16 05:24:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41544) Upgrade `versions-maven-plugin` to 2.14.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 05:33:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41544) Upgrade `versions-maven-plugin` to 2.14.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 05:33:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41508) Assign name to _LEGACY_ERROR_TEMP_1179 and unwrap the existing SparkThrowable - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/16 05:56:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41543) Add `TOTAL_SHUFFLE_WRITE` executor roll policy - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 06:03:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41387) Add assertion on end offset range for Kafka data source with Trigger.AvailableNow - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2022/12/16 06:45:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41545) Implement json functions - posted by "Deng Ziming (Jira)" <ji...@apache.org> on 2022/12/16 06:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41424) Protobuf serializer for TaskDataWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/16 07:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41518) Assign a name to the error class _LEGACY_ERROR_TEMP_2422 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/16 07:21:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41538) Metadata column should be appended at the end of project list - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/16 07:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41527) Implement DataFrame.observe - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/16 08:09:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41544) Upgrade `versions-maven-plugin` to 2.14.1 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/16 09:06:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41453) Implement DataFrame.subtract - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/16 09:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41541) Fix wrong child call in SQLShuffleWriteMetricsReporter.decRecordsWritten() - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/16 10:18:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41334) move SortField from relations.proto to expressions.proto - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 11:00:00 UTC, 4 replies.
- [jira] [Assigned] (SPARK-41334) move SortField from relations.proto to expressions.proto - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 11:00:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41527) Implement DataFrame.observe - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 12:29:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41546) pyspark_types_to_proto_types should supports StructType. - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/16 12:47:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41546) pyspark_types_to_proto_types should supports StructType. - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/16 12:47:00 UTC, 2 replies.
- [jira] (SPARK-41527) Implement DataFrame.observe - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/16 12:48:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24497) ANSI SQL: Recursive query - posted by "gabrywu (Jira)" <ji...@apache.org> on 2022/12/16 12:50:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41547) Reenable ANSI mode in pyspark.sql.tests.connect.test_connect_functions - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/16 13:01:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41547) Reenable ANSI mode in pyspark.sql.tests.connect.test_connect_functions - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/16 13:02:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41548) Disable ANSI mode in pyspark.sql.tests.connect.test_connect_functions - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/16 13:04:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41547) Reenable ANSI mode in pyspark.sql.tests.connect.test_connect_functions - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/16 13:05:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41548) Disable ANSI mode in pyspark.sql.tests.connect.test_connect_functions - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/16 13:09:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41548) Disable ANSI mode in pyspark.sql.tests.connect.test_connect_functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 13:13:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41548) Disable ANSI mode in pyspark.sql.tests.connect.test_connect_functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 13:13:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41523) `protoc-jar-maven-plugin` should uniformly use `protoc-jar-maven-plugin.version` as the version - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/16 13:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41420) Protobuf serializer for ApplicationInfoWrapper - posted by "Sandeep Singh (Jira)" <ji...@apache.org> on 2022/12/16 14:55:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41420) Protobuf serializer for ApplicationInfoWrapper - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 14:59:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41549) Create a TIME data type - posted by "Patrick Grandjean (Jira)" <ji...@apache.org> on 2022/12/16 16:06:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41548) Disable ANSI mode in pyspark.sql.tests.connect.test_connect_functions - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 17:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-39006) Show a directional error message for PVC Dynamic Allocation Failure - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 17:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41550) Dynamic Allocation on K8S GA - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 17:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-38019) ExecutorMonitor.timedOutExecutors should be deterministic - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 17:31:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41550) Dynamic Allocation on K8S GA - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 17:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41515) PVC-oriented executor pod allocation - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 17:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41543) Add `TOTAL_SHUFFLE_WRITE` executor roll policy - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 17:38:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41551) Improve/complete PathOutputCommitProtocol support for dynamic partitioning - posted by "Steve Loughran (Jira)" <ji...@apache.org> on 2022/12/16 17:46:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-39987) Support PEAK_JVM_(ON|OFF)HEAP_MEMORY executor rolling policy - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 18:25:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-38023) ExecutorMonitor.onExecutorRemoved should handle ExecutorDecommission as finished - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 18:26:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-33870) Enable spark.storage.replication.proactive by default - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 18:27:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41162) Anti-join must not be pushed below aggregation with ambiguous predicates - posted by "Shardul Mahadik (Jira)" <ji...@apache.org> on 2022/12/16 18:28:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-41162) Anti-join must not be pushed below aggregation with ambiguous predicates - posted by "Shardul Mahadik (Jira)" <ji...@apache.org> on 2022/12/16 18:28:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-38417) Remove `Experimental` from `RDD.cleanShuffleDependencies` API - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 18:28:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-38418) Add PySpark cleanShuffleDependencies API - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 18:29:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-39322) Remove `Experimental` from `spark.dynamicAllocation.shuffleTracking.enabled` - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 18:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41552) Upgrade kubernetes-client to 6.3.1 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 18:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41552) Upgrade kubernetes-client to 6.3.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 18:40:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41552) Upgrade kubernetes-client to 6.3.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 18:40:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-40379) Propagate decommission executor loss reason during onDisconnect in K8s - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 18:49:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-40979) Keep removed executor info in decommission state - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 18:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-40979) Keep removed executor info in decommission state - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 18:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-40596) Populate ExecutorDecommission with more informative messages - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 18:53:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-40596) Populate ExecutorDecommission with more informative messages - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 18:54:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-40636) Fix wrong remained shuffles log in BlockManagerDecommissioner - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 18:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-40481) Ignore stage fetch failure caused by decommissioned executor - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 18:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-40481) Ignore stage fetch failure caused by decommissioned executor - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 18:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-40636) Fix wrong remained shuffles log in BlockManagerDecommissioner - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 18:56:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-40269) Randomize the orders of peer in BlockManagerDecommissioner - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 18:56:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-40269) Randomize the orders of peer in BlockManagerDecommissioner - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 18:57:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-40060) Add numberDecommissioningExecutors metric - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 18:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-40060) Add numberDecommissioningExecutors metric - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 18:57:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-38062) FallbackStorage shouldn't attempt to resolve arbitrary "remote" hostname - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 18:58:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41365) Stages UI page fails to load for proxy in some yarn versions - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 19:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41421) Protobuf serializer for ApplicationEnvironmentInfoWrapper - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 20:27:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41421) Protobuf serializer for ApplicationEnvironmentInfoWrapper - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 20:27:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-41053) Better Spark UI scalability and Driver stability for large applications - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/16 20:31:00 UTC, 5 replies.
- [jira] [Created] (SPARK-41553) Change num_files to repartition - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2022/12/16 20:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41049) Nondeterministic expressions have unstable values if they are children of CodegenFallback expressions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 20:52:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41049) Nondeterministic expressions have unstable values if they are children of CodegenFallback expressions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 20:52:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41553) Change num_files to repartition - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 20:56:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41553) Change num_files to repartition - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 20:56:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41552) Upgrade kubernetes-client to 6.3.1 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 21:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41554) Decimal.changePrecision produces ArrayIndexOutOfBoundsException - posted by "Oleksiy Dyagilev (Jira)" <ji...@apache.org> on 2022/12/16 21:05:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41447) clean up expired event log files that don't exist in listing db - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 21:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41447) Reduce the number of doMergeApplicationListing invocations - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 22:00:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41554) Decimal.changePrecision produces ArrayIndexOutOfBoundsException - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 23:29:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41554) Decimal.changePrecision produces ArrayIndexOutOfBoundsException - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/16 23:29:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41530) extend MedianHeap to support percentile - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 23:48:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41530) Rename MedianHeap to PercentileMap and support percentile - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/16 23:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41422) Protobuf serializer for ExecutorSummaryWrapper - posted by "Sandeep Singh (Jira)" <ji...@apache.org> on 2022/12/17 00:12:00 UTC, 4 replies.
- [jira] [Assigned] (SPARK-41422) Protobuf serializer for ExecutorSummaryWrapper - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/17 00:32:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-41422) Protobuf serializer for ExecutorSummaryWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/17 00:34:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41555) Multi sparkSession should share single SQLAppStatusStore - posted by "jiahong.li (Jira)" <ji...@apache.org> on 2022/12/17 00:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41555) Multi sparkSession should share single SQLAppStatusStore - posted by "jiahong.li (Jira)" <ji...@apache.org> on 2022/12/17 00:51:00 UTC, 6 replies.
- [jira] [Commented] (SPARK-41555) Multi sparkSession should share single SQLAppStatusStore - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/17 01:09:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41555) Multi sparkSession should share single SQLAppStatusStore - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/17 01:09:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41162) Anti-join must not be pushed below aggregation with ambiguous predicates - posted by "Shardul Mahadik (Jira)" <ji...@apache.org> on 2022/12/17 01:57:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41421) Protobuf serializer for ApplicationEnvironmentInfoWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/17 01:59:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41546) pyspark_types_to_proto_types should supports StructType. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/17 03:22:00 UTC, 2 replies.
- [jira] (SPARK-41546) pyspark_types_to_proto_types should supports StructType. - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/17 03:23:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41556) input_file_positon - posted by "gabrywu (Jira)" <ji...@apache.org> on 2022/12/17 05:16:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41556) input_file_positon - posted by "gabrywu (Jira)" <ji...@apache.org> on 2022/12/17 05:18:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-41556) input_file_positon - posted by "gabrywu (Jira)" <ji...@apache.org> on 2022/12/17 05:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41425) Protobuf serializer for RDDStorageInfoWrapper - posted by "Sandeep Singh (Jira)" <ji...@apache.org> on 2022/12/17 06:02:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41425) Protobuf serializer for RDDStorageInfoWrapper - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/17 06:39:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41557) Union of tables with and without metadata column fails when used in join - posted by "Shardul Mahadik (Jira)" <ji...@apache.org> on 2022/12/17 07:20:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41557) Union of tables with and without metadata column fails when used in join - posted by "Shardul Mahadik (Jira)" <ji...@apache.org> on 2022/12/17 07:21:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41557) Union of tables with and without metadata column fails when used in join - posted by "Shardul Mahadik (Jira)" <ji...@apache.org> on 2022/12/17 07:22:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41426) Protobuf serializer for ResourceProfileWrapper - posted by "Sandeep Singh (Jira)" <ji...@apache.org> on 2022/12/17 07:31:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41426) Protobuf serializer for ResourceProfileWrapper - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/17 07:35:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41558) Disable Coverage in python.pyspark.tests.test_memory_profiler - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/17 07:59:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41558) Disable Coverage in python.pyspark.tests.test_memory_profiler - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/17 08:04:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41558) Disable Coverage in python.pyspark.tests.test_memory_profiler - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/17 08:04:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41559) Reenable Codecov report in the scheduled job - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/17 08:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41559) Reenable Codecov report in the scheduled job - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/17 08:14:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41559) Reenable Codecov report in the scheduled job - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/17 08:14:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41559) Reenable Codecov report in the scheduled job - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/17 11:10:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41558) Disable Coverage in python.pyspark.tests.test_memory_profiler - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/17 11:40:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41428) Protobuf serializer for SpeculationStageSummaryWrapper - posted by "Sandeep Singh (Jira)" <ji...@apache.org> on 2022/12/17 12:12:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41428) Protobuf serializer for SpeculationStageSummaryWrapper - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/17 12:31:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-41535) InterpretedUnsafeProjection and InterpretedMutableProjection can corrupt unsafe buffer when used with calendar interval data - posted by "Bruce Robbins (Jira)" <ji...@apache.org> on 2022/12/17 18:46:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41430) Protobuf serializer for ProcessSummaryWrapper - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/17 19:53:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41430) Protobuf serializer for ProcessSummaryWrapper - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/17 19:53:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41429) Protobuf serializer for RDDOperationGraphWrapper - posted by "Sandeep Singh (Jira)" <ji...@apache.org> on 2022/12/18 05:34:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41429) Protobuf serializer for RDDOperationGraphWrapper - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/18 05:36:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41560) Document how to add new functions - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/18 05:46:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41561) Upgrade slf4j related dependencies from 2.0.5 to 2.0.6 - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2022/12/18 11:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41561) Upgrade slf4j related dependencies from 2.0.5 to 2.0.6 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/18 11:17:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41561) Upgrade slf4j related dependencies from 2.0.5 to 2.0.6 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/18 11:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41562) Upgrade joda-time from 2.12.1 to 2.12.2 - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2022/12/18 11:28:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41562) Upgrade joda-time from 2.12.1 to 2.12.2 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/18 11:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41562) Upgrade joda-time from 2.12.1 to 2.12.2 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/18 11:32:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41563) Support partition filter in MSCK REPAIR TABLE statement - posted by "Wechar (Jira)" <ji...@apache.org> on 2022/12/18 14:21:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-40708) Auto update table statistics based on write metrics - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/18 14:41:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41563) Support partition filter in MSCK REPAIR TABLE statement - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/18 14:44:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41563) Support partition filter in MSCK REPAIR TABLE statement - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/18 14:44:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41564) Iterator returned by GenerateExec isn't interruptible which prevents task from being killed even after cancellation - posted by "Mehreen Ali (Jira)" <ji...@apache.org> on 2022/12/18 16:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41565) Add the error class UNRESOLVED_ROUTINE - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/18 17:15:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41565) Add the error class UNRESOLVED_ROUTINE - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/18 17:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41565) Add the error class UNRESOLVED_ROUTINE - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/18 17:16:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41566) Upgrade netty from 4.1.84.Final to 4.1.86.Final - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2022/12/18 21:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41566) Upgrade netty from 4.1.84.Final to 4.1.86.Final - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/18 21:19:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41566) Upgrade netty from 4.1.84.Final to 4.1.86.Final - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/18 21:19:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-41566) Upgrade netty from 4.1.84.Final to 4.1.86.Final - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2022/12/18 21:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41535) InterpretedUnsafeProjection and InterpretedMutableProjection can corrupt unsafe buffer when used with calendar interval data - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/18 23:13:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41561) Upgrade slf4j related dependencies from 2.0.5 to 2.0.6 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/19 00:44:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41546) pyspark_types_to_proto_types should supports StructType. - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/19 01:10:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41562) Upgrade joda-time from 2.12.1 to 2.12.2 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/19 02:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41567) Move configuration of `versions-maven-plugin` to parent pom - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/19 02:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41567) Move configuration of `versions-maven-plugin` to parent pom - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/19 03:00:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41567) Move configuration of `versions-maven-plugin` to parent pom - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/19 03:00:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41568) Assign name to _LEGACY_ERROR_TEMP_1236 - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2022/12/19 03:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41568) Assign name to _LEGACY_ERROR_TEMP_1236 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/19 03:18:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41568) Assign name to _LEGACY_ERROR_TEMP_1236 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/19 03:18:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41334) move SortField from relations.proto to expressions.proto - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/19 03:55:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41569) Upgrade rocksdbjni to 7.8.3 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/19 04:45:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41570) Spark 3.3.0 Netty Buffer Issue - posted by "shamim (Jira)" <ji...@apache.org> on 2022/12/19 05:32:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41572) Assign name to _LEGACY_ERROR_TEMP_2149 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/19 06:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41571) Assign name to _LEGACY_ERROR_TEMP_2009 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/19 06:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41573) Assign name to _LEGACY_ERROR_TEMP_2136 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/19 06:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41580) Assign name to _LEGACY_ERROR_TEMP_2137 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/19 06:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41579) Assign name to _LEGACY_ERROR_TEMP_1249 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/19 06:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41574) Assign name to _LEGACY_ERROR_TEMP_2009 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/19 06:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41575) Assign name to _LEGACY_ERROR_TEMP_2054 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/19 06:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41577) Assign name to _LEGACY_ERROR_TEMP_1130 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/19 06:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41578) Assign name to _LEGACY_ERROR_TEMP_2141 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/19 06:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41576) Assign name to _LEGACY_ERROR_TEMP_2051 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/19 06:05:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41571) Assign name to _LEGACY_ERROR_TEMP_2149 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/19 06:06:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41571) Assign name to _LEGACY_ERROR_TEMP_2408 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/19 06:09:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41571) Assign name to _LEGACY_ERROR_TEMP_2310 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/19 06:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41573) Assign name to _LEGACY_ERROR_TEMP_2136 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/19 06:11:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41572) Assign name to _LEGACY_ERROR_TEMP_2149 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/19 06:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41581) Assign name to _LEGACY_ERROR_TEMP_1230 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/19 06:11:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41577) Assign name to _LEGACY_ERROR_TEMP_1130 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/19 06:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41582) Reuse `INVALID_TYPED_LITERAL` instead of `_LEGACY_ERROR_TEMP_0022` - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/19 06:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41582) Reuse `INVALID_TYPED_LITERAL` instead of `_LEGACY_ERROR_TEMP_0022` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/19 06:55:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41582) Reuse `INVALID_TYPED_LITERAL` instead of `_LEGACY_ERROR_TEMP_0022` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/19 06:55:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41583) Add Spark Connect and protobuf into setup.py with specifying dependencies - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/19 07:04:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41583) Add Spark Connect and protobuf into setup.py with specifying dependencies - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/19 07:08:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41583) Add Spark Connect and protobuf into setup.py with specifying dependencies - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/19 07:08:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41584) Upgrade RoaringBitmap to 0.9.36 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/19 08:01:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41584) Upgrade RoaringBitmap to 0.9.36 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/19 08:09:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41584) Upgrade RoaringBitmap to 0.9.36 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/19 08:09:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41585) The Spark exclude node functionality for YARN should work independently of dynamic allocation - posted by "Luca Canali (Jira)" <ji...@apache.org> on 2022/12/19 09:33:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41585) The Spark exclude node functionality for YARN should work independently of dynamic allocation - posted by "Luca Canali (Jira)" <ji...@apache.org> on 2022/12/19 09:42:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41585) The Spark exclude node functionality for YARN should work independently of dynamic allocation - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/19 09:45:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41585) The Spark exclude node functionality for YARN should work independently of dynamic allocation - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/19 09:45:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-21829) Enable config to permanently blacklist a list of nodes - posted by "Luca Canali (Jira)" <ji...@apache.org> on 2022/12/19 09:45:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41586) Introduce new PySpark package: pyspark.errors - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/19 10:53:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41586) Introduce new PySpark package: pyspark.errors - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/19 10:53:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41587) Upgrade org.scalatestplus:selenium-4-4 to org.scalatestplus:selenium-4-7 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/19 11:44:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41586) Introduce new PySpark package: pyspark.errors - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/19 11:49:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41587) Upgrade org.scalatestplus:selenium-4-4 to org.scalatestplus:selenium-4-7 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/19 11:51:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41587) Upgrade org.scalatestplus:selenium-4-4 to org.scalatestplus:selenium-4-7 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/19 11:51:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41441) Allow Generate with no required child output to host outer references - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/19 12:09:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41277) Save and leverage shuffle key in tblproperties - posted by "Ohad Raviv (Jira)" <ji...@apache.org> on 2022/12/19 12:26:00 UTC, 2 replies.
- [jira] (SPARK-41422) Protobuf serializer for ExecutorSummaryWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/19 18:52:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41427) Protobuf serializer for ExecutorStageSummaryWrapper - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/19 18:54:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41427) Protobuf serializer for ExecutorStageSummaryWrapper - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/19 18:54:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41420) Protobuf serializer for ApplicationInfoWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/19 19:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41588) Make "Rule id not found" error message more actionable - posted by "Reynold Xin (Jira)" <ji...@apache.org> on 2022/12/19 23:03:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41588) Make "Rule id not found" error message more actionable - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/19 23:05:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41588) Make "Rule id not found" error message more actionable - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/19 23:05:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41588) Make "Rule id not found" error message more actionable - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/19 23:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41583) Add Spark Connect and protobuf into setup.py with specifying dependencies - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/20 00:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41589) PyTorch Distributor - posted by "Rithwik Ediga Lakhamsani (Jira)" <ji...@apache.org> on 2022/12/20 00:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41590) Implement Baseline API Code - posted by "Rithwik Ediga Lakhamsani (Jira)" <ji...@apache.org> on 2022/12/20 00:17:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41589) PyTorch Distributor - posted by "Rithwik Ediga Lakhamsani (Jira)" <ji...@apache.org> on 2022/12/20 00:19:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-41589) PyTorch Distributor - posted by "Rithwik Ediga Lakhamsani (Jira)" <ji...@apache.org> on 2022/12/20 00:19:00 UTC, 6 replies.
- [jira] [Created] (SPARK-41591) Implement functionality for training a PyTorch file locally - posted by "Rithwik Ediga Lakhamsani (Jira)" <ji...@apache.org> on 2022/12/20 00:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41593) Implement logging from the executor nodes - posted by "Rithwik Ediga Lakhamsani (Jira)" <ji...@apache.org> on 2022/12/20 00:22:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41592) Implement functionality for training a PyTorch file on the executors - posted by "Rithwik Ediga Lakhamsani (Jira)" <ji...@apache.org> on 2022/12/20 00:22:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-41589) PyTorch Distributor - posted by "Rithwik Ediga Lakhamsani (Jira)" <ji...@apache.org> on 2022/12/20 00:28:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41535) InterpretedUnsafeProjection and InterpretedMutableProjection can corrupt unsafe buffer when used with calendar interval data - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/20 00:32:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41594) Support table-valued generator functions in the FROM clause - posted by "Allison Wang (Jira)" <ji...@apache.org> on 2022/12/20 01:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41595) Support generator function explode/explode_outer in the FROM clause - posted by "Allison Wang (Jira)" <ji...@apache.org> on 2022/12/20 01:25:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41595) Support generator function explode/explode_outer in the FROM clause - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/20 01:47:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41595) Support generator function explode/explode_outer in the FROM clause - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/20 01:47:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41423) Protobuf serializer for StageDataWrapper - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2022/12/20 01:49:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41427) Protobuf serializer for ExecutorStageSummaryWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/20 05:10:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41425) Protobuf serializer for RDDStorageInfoWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/20 05:12:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-39591) SPIP: Asynchronous Offset Management in Structured Streaming - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2022/12/20 07:40:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-39591) SPIP: Asynchronous Offset Management in Structured Streaming - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2022/12/20 07:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41596) Document the new feature "Async Progress Tracking" to Structured Streaming guide doc - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2022/12/20 07:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41596) Document the new feature "Async Progress Tracking" to Structured Streaming guide doc - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2022/12/20 07:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-40513) SPIP: Support Docker Official Image for Spark - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2022/12/20 08:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-40518) Add Spark Docker Official Image doc - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2022/12/20 08:08:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-40520) Add a script to generate DOI mainifest - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2022/12/20 08:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41354) Implement `DataFrame.repartitionByRange` - posted by "Deng Ziming (Jira)" <ji...@apache.org> on 2022/12/20 09:31:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41597) Improve PySpark errors - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/20 10:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41586) Introduce new PySpark package: pyspark.errors - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/20 10:23:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41598) Migrate the errors from `pyspark/sql/functions.py` into error class. - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/20 10:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41598) Migrate the errors from `pyspark/sql/functions.py` into error class. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/20 10:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41598) Migrate the errors from `pyspark/sql/functions.py` into error class. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/20 10:37:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41599) Memory leak in FileSystem.CACHE when submitting apps to secure cluster using InProcessLauncher - posted by "Maciej Smolenski (Jira)" <ji...@apache.org> on 2022/12/20 10:46:00 UTC, 12 replies.
- [jira] [Created] (SPARK-41599) Memory leak in FileSystem.CACHE when submitting apps to secure cluster using InProcessLauncher - posted by "Maciej Smolenski (Jira)" <ji...@apache.org> on 2022/12/20 10:46:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41600) Support Catalog.cacheTable - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41431) Protobuf serializer for SQLExecutionUIData - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/20 11:12:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41603) Support Catalog.createTable - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:12:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-41431) Protobuf serializer for SQLExecutionUIData - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/20 11:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41602) Support Catalog.createExternalTable - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41601) Support Catalog.clearCache - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41604) Support Catalog.currentCatalog - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41606) Support Catalog dropGlobalTempView - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41605) Support Catalog.currentDatabase - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41608) Support Catalog.functionExists - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41607) Support Catalog.dropTempView - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41609) Support Catalog.getDatabase - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41612) Support Catalog.isCached - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41610) Support Catalog.getFunction - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41611) Support Catalog.getTable - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41613) Support Catalog.listCatalogs - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41615) Support Catalog.listDatabases - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41614) Support Catalog.listColumns - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41616) Support Catalog.listFunctions - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41617) Support Catalog.listTables - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41618) Support Catalog.recoverPartitions - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41622) Support Catalog.setCurrentDatabase - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41621) Support Catalog.setCurrentCatalog - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41620) Support Catalog.registerFunction - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41619) Support Catalog.refreshTable - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41623) Support Catalog.uncacheTable - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:22:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41624) Support Python logging - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41625) Feature parity: Streaming support - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 11:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41431) Protobuf serializer for SQLExecutionUIData - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/20 12:57:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41551) Improve/complete PathOutputCommitProtocol support for dynamic partitioning - posted by "Steve Loughran (Jira)" <ji...@apache.org> on 2022/12/20 14:06:00 UTC, 3 replies.
- [jira] [Created] (SPARK-41626) Document validation choices for local and remote input validation - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 14:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41627) Spark Connect Server Development - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 14:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41628) Support async query execution - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 14:28:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41625) Feature parity: Streaming support - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 14:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41629) Support for protocol extensions - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/20 14:42:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41569) Upgrade rocksdbjni to 7.8.3 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/20 15:02:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41569) Upgrade rocksdbjni to 7.8.3 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/20 15:02:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-26209) Allow for dataframe bucketization without Hive - posted by "Yeachan Park (Jira)" <ji...@apache.org> on 2022/12/20 15:14:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41582) Reuse `INVALID_TYPED_LITERAL` instead of `_LEGACY_ERROR_TEMP_0022` - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/20 15:16:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41432) Protobuf serializer for SparkPlanGraphWrapper - posted by "Sandeep Singh (Jira)" <ji...@apache.org> on 2022/12/20 15:45:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41568) Assign name to _LEGACY_ERROR_TEMP_1236 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/20 18:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41630) Support lateral column alias in Project code path - posted by "Xinyi Yu (Jira)" <ji...@apache.org> on 2022/12/20 18:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41631) Support lateral column alias in Aggregate code path - posted by "Xinyi Yu (Jira)" <ji...@apache.org> on 2022/12/20 18:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41630) Support lateral column alias in Project code path - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/20 18:23:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41630) Support lateral column alias in Project code path - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/20 18:23:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41631) Support lateral column alias in Aggregate code path - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/20 18:24:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41631) Support lateral column alias in Aggregate code path - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/20 18:24:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24518) Using Hadoop credential provider API to store password - posted by "Brahma Reddy Battula (Jira)" <ji...@apache.org> on 2022/12/20 18:34:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41632) Support explicit lateral virtual table name - posted by "Xinyi Yu (Jira)" <ji...@apache.org> on 2022/12/20 19:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41633) Identify aggregation expression in the nodePatterns of PythonUDF - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/20 20:29:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41633) Identify aggregation expression in the nodePatterns of PythonUDF - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/20 20:39:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41633) Identify aggregation expression in the nodePatterns of PythonUDF - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/20 20:39:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41634) Upgrade minimatch to 3.1.2 - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2022/12/20 20:50:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41634) Upgrade minimatch to 3.1.2 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/20 20:52:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41634) Upgrade minimatch to 3.1.2 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/20 20:52:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41635) GROUP BY ALL - posted by "Reynold Xin (Jira)" <ji...@apache.org> on 2022/12/20 23:02:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41635) GROUP BY ALL - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/20 23:04:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41635) GROUP BY ALL - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/20 23:04:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41635) GROUP BY ALL - posted by "Reynold Xin (Jira)" <ji...@apache.org> on 2022/12/20 23:22:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41636) DataSourceStrategy#selectFilters returns predicates in non-deterministic order - posted by "Jonny Serencsa (Jira)" <ji...@apache.org> on 2022/12/21 00:05:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41528) Sharing namespace between PySpark and Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 00:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41637) ORDER BY ALL - posted by "Reynold Xin (Jira)" <ji...@apache.org> on 2022/12/21 00:36:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41637) ORDER BY ALL - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 00:39:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41637) ORDER BY ALL - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 00:39:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41638) Move most tests to .sql files - posted by "Xinyi Yu (Jira)" <ji...@apache.org> on 2022/12/21 01:18:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41589) PyTorch Distributor - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 01:27:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41584) Upgrade RoaringBitmap to 0.9.36 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 01:33:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41396) Oneof field support and recursive fields - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/21 01:38:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-40520) Add a script to generate DOI mainifest - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2022/12/21 02:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41566) Upgrade netty from 4.1.84.Final to 4.1.86.Final - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 02:27:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41440) Implement DataFrame.randomSplit - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 02:32:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41639) Remove ScalaReflectionLock - posted by "Sandish Kumar HN (Jira)" <ji...@apache.org> on 2022/12/21 02:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41639) Remove ScalaReflectionLock - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 02:50:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41639) Remove ScalaReflectionLock - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 02:50:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41631) Support lateral column alias in Aggregate code path - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/21 02:55:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41640) implement `Window` functions - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/21 03:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41641) Implement `Column.over` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/21 03:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41640) implement `Window` functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 03:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41640) implement `Window` functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 03:07:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41641) Implement `Column.over` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 03:08:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41641) Implement `Column.over` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 03:08:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41192) Task finished before speculative task scheduled leads to holding idle executors - posted by "Mridul Muralidharan (Jira)" <ji...@apache.org> on 2022/12/21 03:37:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41192) Task finished before speculative task scheduled leads to holding idle executors - posted by "Mridul Muralidharan (Jira)" <ji...@apache.org> on 2022/12/21 03:37:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41434) Support LambdaFunction expresssion - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 03:44:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41426) Protobuf serializer for ResourceProfileWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/21 04:01:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41642) Deduplicate docstrings in Python Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 04:19:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41642) Deduplicate docstrings in Python Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 04:20:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41642) Deduplicate docstrings in Python Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 04:20:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41643) Deduplicate docstrings in pyspark.sql.connect.column - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 04:21:00 UTC, 3 replies.
- [jira] [Created] (SPARK-41643) Deduplicate docstrings in pyspark.sql.connect.column - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 04:21:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41292) Window-function support - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 04:28:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41292) Window-function support - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 04:28:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-41587) Upgrade org.scalatestplus:selenium-4-4 to org.scalatestplus:selenium-4-7 - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2022/12/21 04:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41634) Upgrade minimatch to 3.1.2 - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2022/12/21 04:51:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41539) stats and constraints in LogicalRDD may not be in sync with output attributes - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2022/12/21 06:03:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41597) Improve PySpark errors - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/21 06:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41644) Introducing SPI mechanism to make it easy for other modules to register ProtoBufSerializer - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/21 06:42:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41644) Introducing SPI mechanism to make it easy for other modules to register ProtoBufSerializer - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 06:44:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41644) Introducing SPI mechanism to make it easy for other modules to register ProtoBufSerializer - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 06:44:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41643) Deduplicate docstrings in pyspark.sql.connect.column - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 07:09:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41645) Deduplicate docstrings in pyspark.sql.connect.dataframe - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 07:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41647) Deduplicate docstrings in pyspark.sql.connect.functions - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 07:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41646) Deduplicate docstrings in pyspark.sql.connect.session - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 07:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41648) Deduplicate docstrings in pyspark.sql.connect.readwriter - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 07:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41642) Deduplicate docstrings in Python Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 07:13:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41649) Deduplicate docstrings in pyspark.sql.connect.window - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 07:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41650) json expressions much slower in optimized mode - posted by "Yi Zhang (Jira)" <ji...@apache.org> on 2022/12/21 07:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41651) Test parity: pyspark.sql.tests.test_dataframe - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 07:17:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41651) Test parity: pyspark.sql.tests.test_dataframe - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 07:17:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41651) Test parity: pyspark.sql.tests.test_dataframe - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 07:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41650) json expressions much slower in optimized mode - posted by "Yi Zhang (Jira)" <ji...@apache.org> on 2022/12/21 07:18:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41652) Test parity: pyspark.sql.tests.test_functions - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 07:18:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41652) Test parity: pyspark.sql.tests.test_functions - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 07:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41652) Test parity: pyspark.sql.tests.test_functions - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 07:19:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41653) Test parity: enable doctests in Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 07:23:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41653) Test parity: enable doctests in Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 07:23:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41654) Enable doctests in pyspark.sql.connect.window - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 07:25:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41656) Enable doctests in pyspark.sql.connect.dataframe - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 07:25:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41655) Enable doctests in pyspark.sql.connect.column - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 07:25:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41659) Enable doctests in pyspark.sql.connect.readwriter - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 07:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41658) Enable doctests in pyspark.sql.connect.functions - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 07:26:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41653) Test parity: enable doctests in Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 07:26:00 UTC, 3 replies.
- [jira] [Created] (SPARK-41657) Enable doctests in pyspark.sql.connect.session - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 07:26:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41653) Test parity: enable doctests in Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 07:29:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41652) Test parity: pyspark.sql.tests.test_functions - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 07:29:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41651) Test parity: pyspark.sql.tests.test_dataframe - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 07:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41660) only propagate metadata columns if they are used - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/21 07:30:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41660) only propagate metadata columns if they are used - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 07:35:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41660) only propagate metadata columns if they are used - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 07:35:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41648) Deduplicate docstrings in pyspark.sql.connect.readwriter - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 07:55:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41648) Deduplicate docstrings in pyspark.sql.connect.readwriter - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 07:55:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41464) Implement DataFrame.to - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/21 08:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41661) Support for Python UDFs - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/21 09:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41662) Minimal support for pickled Python UDFs - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/21 09:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41643) Deduplicate docstrings in pyspark.sql.connect.column - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 09:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41663) Implement the rest of Lambda functions - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/21 09:57:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41663) Implement the rest of Lambda functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 10:00:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41663) Implement the rest of Lambda functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 10:00:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41364) implement `broadcast` function - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 10:22:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41364) implement `broadcast` function - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 10:22:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41664) Support streaming client data to create large DataFrames - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/21 10:25:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41646) Deduplicate docstrings in pyspark.sql.connect.session - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 11:21:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41646) Deduplicate docstrings in pyspark.sql.connect.session - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 11:21:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41364) implement `broadcast` function - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/21 12:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41665) Spark streaming query scheduling synchronisation with Trigger Interval - posted by "Thomas Prelle (Jira)" <ji...@apache.org> on 2022/12/21 12:58:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41665) Spark streaming query scheduling synchronisation with Trigger Interval - posted by "Thomas Prelle (Jira)" <ji...@apache.org> on 2022/12/21 12:58:00 UTC, 4 replies.
- [jira] [Resolved] (SPARK-41660) only propagate metadata columns if they are used - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/21 13:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41509) Delay execution hash until after aggregation for semi-join runtime filter. - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/21 13:12:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41565) Add the error class UNRESOLVED_ROUTINE - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/21 13:34:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41666) Support parameterized SQL in PySpark - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/21 13:56:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41666) Support parameterized SQL in PySpark - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/21 13:59:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41354) Implement `DataFrame.repartitionByRange` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 14:26:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41666) Support parameterized SQL in PySpark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 14:40:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41666) Support parameterized SQL in PySpark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 14:40:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41667) Expose env var SPARK_DRIVER_POD_NAME in Driver Pod - posted by "Cheng Pan (Jira)" <ji...@apache.org> on 2022/12/21 16:13:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41667) Expose env var SPARK_DRIVER_POD_NAME in Driver Pod - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 16:19:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41667) Expose env var SPARK_DRIVER_POD_NAME in Driver Pod - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 16:19:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41644) Introducing SPI mechanism to make it easy for other modules to register ProtoBufSerializer - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/21 18:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41668) DECODE function returns wrong results when passed NULL - posted by "Serge Rielau (Jira)" <ji...@apache.org> on 2022/12/21 19:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41650) json expressions much slower in optimized mode - posted by "Yi Zhang (Jira)" <ji...@apache.org> on 2022/12/21 20:11:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41669) Speed up CollapseProject for wide tables - posted by "Allison Wang (Jira)" <ji...@apache.org> on 2022/12/21 20:25:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41669) Speed up CollapseProject for wide tables - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 20:53:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41669) Speed up CollapseProject for wide tables - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 20:53:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41615) Support Catalog.listDatabases - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 20:58:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41615) Support Catalog.listDatabases - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 20:58:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41668) DECODE function returns wrong results when passed NULL - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 21:00:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41668) DECODE function returns wrong results when passed NULL - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/21 21:00:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41670) Introduce builtin and session namespaces for builtin functions and temp views/functions - posted by "Serge Rielau (Jira)" <ji...@apache.org> on 2022/12/21 21:33:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-41557) Union of tables with and without metadata column fails when used in join - posted by "Maxime Thébault (Jira)" <ji...@apache.org> on 2022/12/22 00:32:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41663) Implement the rest of Lambda functions - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/22 00:36:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41648) Deduplicate docstrings in pyspark.sql.connect.readwriter - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/22 00:51:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41646) Deduplicate docstrings in pyspark.sql.connect.session - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/22 00:53:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41432) Protobuf serializer for SparkPlanGraphWrapper - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 00:54:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41671) Implement initial Catalog.* API - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/22 01:48:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41669) Speed up CollapseProject for wide tables - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/22 02:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41671) Implement initial Catalog.* API - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 02:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41671) Implement initial Catalog.* API - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 02:32:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41668) DECODE function returns wrong results when passed NULL - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/22 02:38:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41672) Enable the deprecated functions - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/22 03:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41672) Enable the deprecated functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 03:05:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41672) Enable the deprecated functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 03:05:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41639) Remove ScalaReflectionLock - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/22 03:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41673) Implement `Column.astype` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/22 03:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41673) Implement `Column.astype` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 03:53:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41673) Implement `Column.astype` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 03:53:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41674) Runtime filter should supports the any side of child join as filter creation side - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/22 04:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41674) Runtime filter should supports the any side of child join as filter creation side - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 04:34:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41674) Runtime filter should supports the any side of child join as filter creation side - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 04:34:00 UTC, 1 replies.
- [jira] [Deleted] (SPARK-41671) Implement initial Catalog.* API - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/22 04:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41428) Protobuf serializer for SpeculationStageSummaryWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/22 05:40:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41672) Enable the deprecated functions - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/22 05:42:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41668) DECODE function returns wrong results when passed NULL - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/22 05:58:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41675) Make column op support datetime - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/22 06:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41675) Make column op support `datetime` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/22 06:18:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41675) Make column op support `datetime` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 06:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41675) Make column op support `datetime` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 06:20:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41673) Implement `Column.astype` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/22 06:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41292) Window-function support - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/22 07:07:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41640) implement `Window` functions - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/22 07:07:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41641) Implement `Column.over` - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/22 07:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41282) Feature parity: Column API in Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/22 07:07:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41675) Make column op support `datetime` - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/22 07:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41676) Protobuf serializer for StreamingQueryData - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/22 07:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41677) Protobuf serializer for StreamingQueryProgressWrapper - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/22 07:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41678) Protobuf serializer for LogInfo - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/22 07:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41679) Protobuf serializer for LogInfo - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/22 07:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41680) Protobuf serializer for CachedQuantile - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/22 07:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41681) Factor GroupedData out to group.py - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/22 07:40:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41679) Protobuf serializer for StreamBlockData - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/22 07:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41682) Protobuf serializer for ApplicationStoreInfo - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/22 07:43:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41681) Factor GroupedData out to group.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 07:44:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41681) Factor GroupedData out to group.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 07:44:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41679) Protobuf serializer for StreamBlockData - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/22 08:02:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41679) Protobuf serializer for StreamBlockData - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/22 08:03:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41683) Spark UI: In jobs API, numActiveStages can be negative in some cases - posted by "wy (Jira)" <ji...@apache.org> on 2022/12/22 08:06:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41683) Spark UI: In jobs API, numActiveStages can be negative in some cases - posted by "wy (Jira)" <ji...@apache.org> on 2022/12/22 08:07:00 UTC, 6 replies.
- [jira] [Commented] (SPARK-41680) Protobuf serializer for CachedQuantile - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/22 08:18:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41680) Protobuf serializer for CachedQuantile - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/22 08:18:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41682) Protobuf serializer for ApplicationStoreInfo - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/22 08:35:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41682) Protobuf serializer for ApplicationStoreInfo - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/22 08:35:00 UTC, 1 replies.
- [jira] (SPARK-41682) Protobuf serializer for ApplicationStoreInfo - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/22 08:42:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41682) Protobuf serializer for ApplicationStoreInfo - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/22 08:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41678) Protobuf serializer for LogInfo - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/22 08:47:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41678) Protobuf serializer for LogInfo - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/22 08:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41684) spark3 read the one partition data and write to anthor partition cause error - posted by "sinlang (Jira)" <ji...@apache.org> on 2022/12/22 08:54:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41685) Support optional using Protobuf serializer for KVStore in History server - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/22 08:56:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41686) Upgrade Apache Ivy to 2.5.1 - posted by "Tobias Stadler (Jira)" <ji...@apache.org> on 2022/12/22 09:00:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41674) Runtime filter should supports multi level shuffle join side as filter creation side - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/22 09:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41599) Memory leak in FileSystem.CACHE when submitting apps to secure cluster using InProcessLauncher - posted by "Steve Loughran (Jira)" <ji...@apache.org> on 2022/12/22 09:48:00 UTC, 4 replies.
- [jira] [Assigned] (SPARK-41686) Upgrade Apache Ivy to 2.5.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 09:58:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41686) Upgrade Apache Ivy to 2.5.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 09:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41645) Deduplicate docstrings in pyspark.sql.connect.dataframe - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 10:25:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41645) Deduplicate docstrings in pyspark.sql.connect.dataframe - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 10:25:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41681) Factor GroupedData out to group.py - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/22 10:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41687) Deduplicate docstrings in pyspark.sql.connect.group - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/22 10:27:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41687) Deduplicate docstrings in pyspark.sql.connect.group - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 11:01:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41687) Deduplicate docstrings in pyspark.sql.connect.group - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 11:01:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41688) Move Expressions to expressions.py - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/22 11:01:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41688) Move Expressions to expressions.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 11:06:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41688) Move Expressions to expressions.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 11:06:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41649) Deduplicate docstrings in pyspark.sql.connect.window - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 11:09:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41649) Deduplicate docstrings in pyspark.sql.connect.window - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 11:09:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41635) GROUP BY ALL - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/22 12:00:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41513) Implement a Accumulator to collect per mapper row count metrics - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/22 12:00:01 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41647) Deduplicate docstrings in pyspark.sql.connect.functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 12:22:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41647) Deduplicate docstrings in pyspark.sql.connect.functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 12:22:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41569) Upgrade rocksdbjni to 7.8.3 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/22 12:27:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41689) Enable doctests in pyspark.sql.connect.group - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/22 12:34:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41689) Enable doctests in pyspark.sql.group - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/22 12:34:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41687) Deduplicate docstrings in pyspark.sql.connect.group - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/22 12:51:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41649) Deduplicate docstrings in pyspark.sql.connect.window - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/22 12:52:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41686) Upgrade Apache Ivy to 2.5.1 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/22 12:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41030) Upgrade Apache Ivy to 2.5.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 12:55:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41030) Upgrade Apache Ivy to 2.5.1 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/22 12:55:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41688) Move Expressions to expressions.py - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/22 12:56:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41534) Setup initial client module for Spark Connect - posted by "Herman van Hövell (Jira)" <ji...@apache.org> on 2022/12/22 18:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41690) Introduce AgnosticEncoders - posted by "Herman van Hövell (Jira)" <ji...@apache.org> on 2022/12/22 18:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41551) Improve/complete PathOutputCommitProtocol support for dynamic partitioning - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 18:48:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41691) Implement row count based shuffle read for global limit - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2022/12/22 18:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41690) Introduce AgnosticEncoders - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 19:06:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41690) Introduce AgnosticEncoders - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/22 19:06:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41413) SPJ: Avoid shuffle when partition keys mismatch, but join expressions are compatible - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2022/12/22 19:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41413) SPJ: Avoid shuffle when partition keys mismatch, but join expressions are compatible - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2022/12/22 19:58:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41679) Protobuf serializer for StreamBlockData - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/22 22:18:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41680) Protobuf serializer for CachedQuantile - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/22 22:20:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41645) Deduplicate docstrings in pyspark.sql.connect.dataframe - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/22 23:23:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41670) Introduce builtin and session namespaces for builtin functions and temp views/functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/23 01:35:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41670) Introduce builtin and session namespaces for builtin functions and temp views/functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/23 01:35:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41591) Implement functionality for training a PyTorch file locally - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/23 02:36:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41591) Implement functionality for training a PyTorch file locally - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/23 02:36:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41677) Protobuf serializer for StreamingQueryProgressWrapper - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/23 03:48:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41676) Protobuf serializer for StreamingQueryData - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/23 03:52:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41637) ORDER BY ALL - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/23 04:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41647) Deduplicate docstrings in pyspark.sql.connect.functions - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/23 05:39:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41642) Deduplicate docstrings in Python Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/23 05:40:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41683) Spark UI: In jobs API, numActiveStages can be negative in some cases - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/23 06:03:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41683) Spark UI: In jobs API, numActiveStages can be negative in some cases - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/23 06:03:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41692) implement `DataFrame.rollup` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/23 07:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41693) Implement `GroupedData.pivot` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/23 07:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41383) Implement `DataFrame.cube` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/23 07:51:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41383) Implement `DataFrame.cube` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/23 07:51:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41692) implement `DataFrame.rollup` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/23 07:52:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41692) implement `DataFrame.rollup` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/23 07:52:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41693) Implement `GroupedData.pivot` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/23 07:53:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-41693) Implement `GroupedData.pivot` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/23 07:53:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41422) Protobuf serializer for ExecutorSummaryWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/23 08:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41694) Add new config to clean up `spark.ui.store.path` directory when SparkContext.stop() - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/23 08:35:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41423) Protobuf serializer for StageDataWrapper - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/23 09:16:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41666) Support parameterized SQL in PySpark - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/23 09:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41407) Pull out v1 write to WriteFiles - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/23 10:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41695) Upgrade netty to 4.1.86.Final - posted by "Tobias Stadler (Jira)" <ji...@apache.org> on 2022/12/23 10:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41696) Upgrade Hadoop to 3.3.4 - posted by "Tobias Stadler (Jira)" <ji...@apache.org> on 2022/12/23 10:45:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41697) Enable test_df_show, test_drop, test_dropna, test_toDF_with_schema_string and test_with_columns_renamed - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/23 10:50:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41697) Enable test_df_show, test_drop, test_dropna, test_toDF_with_schema_string and test_with_columns_renamed - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/23 10:53:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41697) Enable test_df_show, test_drop, test_dropna, test_toDF_with_schema_string and test_with_columns_renamed - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/23 10:53:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41692) implement `DataFrame.rollup` - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/23 10:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41383) Implement `DataFrame.cube` - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/23 10:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41693) Implement `GroupedData.pivot` - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/23 10:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41698) Enable 16 tests that pass - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/23 11:09:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41698) Enable 16 tests that pass - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/23 11:22:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41698) Enable 16 tests that pass - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/23 11:22:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41498) Union does not propagate Metadata output - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/23 11:40:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41698) Enable 16 tests that pass - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/23 12:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41697) Enable test_df_show, test_drop, test_dropna, test_toDF_with_schema_string and test_with_columns_renamed - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/23 12:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41695) Upgrade netty to 4.1.86.Final - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/23 18:22:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41695) Upgrade netty to 4.1.86.Final - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/23 18:22:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41696) Upgrade Hadoop to 3.3.4 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/23 20:30:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41696) Upgrade Hadoop to 3.3.4 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/23 20:30:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41431) Protobuf serializer for SQLExecutionUIData - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/23 23:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41430) Protobuf serializer for ProcessSummaryWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/23 23:56:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-41677) Protobuf serializer for StreamingQueryProgressWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/24 00:25:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41699) Upgrade buf to v1.11.0 - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/24 01:08:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41699) Upgrade buf to v1.11.0 - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/24 01:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41699) Upgrade buf to v1.11.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/24 01:17:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41699) Upgrade buf to v1.11.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/24 01:18:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41685) Support optional using Protobuf serializer for KVStore in History server - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/24 01:20:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41685) Support optional using Protobuf serializer for KVStore in History server - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/24 02:34:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41503) Implement Partition Transformation Functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/24 04:14:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41503) Implement Partition Transformation Functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/24 04:14:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41700) Remove `FunctionBuilder` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/24 04:46:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41700) Remove `FunctionBuilder` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/24 04:49:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41700) Remove `FunctionBuilder` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/24 04:49:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41699) Upgrade buf to v1.11.0 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/24 21:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41503) Implement Partition Transformation Functions - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/24 21:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41701) Make column op support `decimal` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/25 03:45:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41701) Make column op support `decimal` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/25 03:49:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41701) Make column op support `decimal` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/25 03:49:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41702) Add invalid ops - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/25 04:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41702) Add invalid ops - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/25 04:40:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41702) Add invalid ops - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/25 04:40:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41700) Remove `FunctionBuilder` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/25 05:34:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41111) Implement `DataFrame.show` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/25 09:35:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41703) Combine NullType and typed_null - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/25 10:23:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41703) Combine NullType and typed_null - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/25 10:32:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41703) Combine NullType and typed_null - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/25 10:32:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41702) Add invalid ops - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/25 10:52:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41701) Make column op support `decimal` - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/25 10:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41704) Upgrade `sbt-assembly` from 2.0.0 to 2.1.0 - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2022/12/25 12:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41704) Upgrade `sbt-assembly` from 2.0.0 to 2.1.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/25 13:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41704) Upgrade `sbt-assembly` from 2.0.0 to 2.1.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/25 13:00:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41533) GRPC Errors on the client should be cleaned up - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/25 23:26:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41533) GRPC Errors on the client should be cleaned up - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/25 23:26:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41705) Move generate_protos.sh to dev/ - posted by "Ted Yu (Jira)" <ji...@apache.org> on 2022/12/26 01:27:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41705) Move generate_protos.sh to dev/ - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/26 01:29:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41705) Move generate_protos.sh to dev/ - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/26 01:29:00 UTC, 0 replies.
- [jira] (SPARK-41464) Implement DataFrame.to - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/26 02:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41706) pyspark_types_to_proto_types should supports MapType - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/26 04:41:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41706) pyspark_types_to_proto_types should supports MapType - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/26 04:51:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41706) pyspark_types_to_proto_types should supports MapType - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/26 04:51:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41707) Implement initial Catalog.* API - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 05:34:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41707) Implement initial Catalog.* API - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/26 05:37:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41707) Implement initial Catalog.* API - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/26 05:37:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41708) Pull v1write information to write file node - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2022/12/26 05:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41709) Explicitly define `Seq` as `collection.Seq` to reduce `toSeq` when create ui objects from protobuf objects for Scala 2.13 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/26 06:21:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41709) Explicitly define `Seq` as `collection.Seq` to reduce `toSeq` when create ui objects from protobuf objects for Scala 2.13 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/26 06:28:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41709) Explicitly define `Seq` as `collection.Seq` to reduce `toSeq` when create ui objects from protobuf objects for Scala 2.13 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/26 06:28:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41710) Implement `Column.between` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/26 06:29:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41710) Implement `Column.between` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/26 06:31:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41710) Implement `Column.between` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/26 06:31:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41711) Upgrade protobuf-java to 3.21.12 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/26 06:43:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41711) Upgrade protobuf-java to 3.21.12 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/26 06:49:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41711) Upgrade protobuf-java to 3.21.12 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/26 06:49:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41712) Migrate the Spark Connect errors into error classes. - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2022/12/26 06:50:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41713) Make CTAS hold a nested execution for data writing - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2022/12/26 07:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41714) Update maven-checkstyle-plugin from 3.1.2 to 3.2.0 - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2022/12/26 08:09:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41703) Combine NullType and typed_null - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/26 08:13:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41714) Update maven-checkstyle-plugin from 3.1.2 to 3.2.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/26 08:13:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41714) Update maven-checkstyle-plugin from 3.1.2 to 3.2.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/26 08:13:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41704) Upgrade `sbt-assembly` from 2.0.0 to 2.1.0 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 08:36:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41232) High-order function: array_append - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/26 08:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41277) Save and leverage shuffle key in tblproperties - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/26 08:41:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41713) Make CTAS hold a nested execution for data writing - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/26 08:49:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-41233) High-order function: array_prepend - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/26 08:49:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41713) Make CTAS hold a nested execution for data writing - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/26 08:49:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41277) Leverage shuffle key as bucketing properties - posted by "Ohad Raviv (Jira)" <ji...@apache.org> on 2022/12/26 08:51:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41234) High-order function: array_insert - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/26 08:54:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41067) Implement `DataFrame.stat.cov` - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/26 09:18:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-41067) Implement `DataFrame.stat.cov` - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/26 09:19:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41710) Implement `Column.between` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/26 09:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-32166) Metastore problem on Spark3.0 with Hive3.0 - posted by "kevinshin (Jira)" <ji...@apache.org> on 2022/12/26 10:18:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41602) Support Catalog.createExternalTable - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:42:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41603) Support Catalog.createTable - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:42:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41601) Support Catalog.clearCache - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:42:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41606) Support Catalog dropGlobalTempView - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:43:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41607) Support Catalog.dropTempView - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:43:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41608) Support Catalog.functionExists - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:43:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41610) Support Catalog.getFunction - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:43:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41609) Support Catalog.getDatabase - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:43:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41604) Support Catalog.currentCatalog - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:43:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41605) Support Catalog.currentDatabase - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:43:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41614) Support Catalog.listColumns - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:44:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41613) Support Catalog.listCatalogs - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:44:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41617) Support Catalog.listTables - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:44:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41618) Support Catalog.recoverPartitions - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:44:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41616) Support Catalog.listFunctions - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:44:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41611) Support Catalog.getTable - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:44:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41615) Support Catalog.listDatabases - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:44:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41622) Support Catalog.setCurrentDatabase - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41621) Support Catalog.setCurrentCatalog - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41289) Feature parity: Catalog API - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41270) Add Catalog tableExists and namespaceExists in Connect proto - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41620) Support Catalog.registerFunction - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41619) Support Catalog.refreshTable - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41613) Support Catalog.listCatalogs - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:46:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41715) Catch specific exceptions for both Spark Connect and PySpark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41716) Factor pyspark.sql.connect.Catalog._catalog_to_pandas to client.py - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:56:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41717) Implement the command logic for print and _repr_html_ - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 11:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41718) Numpy 1.24 breaks PySpark due to use of `np.bool` instead of `np.bool_` in many places - posted by "Phillip Cloud (Jira)" <ji...@apache.org> on 2022/12/26 12:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41718) Numpy 1.24 breaks PySpark due to use of `np.bool` instead of `np.bool_` in many places - posted by "Phillip Cloud (Jira)" <ji...@apache.org> on 2022/12/26 12:56:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41719) Spark SSL Options should be set only when ssl is enabled - posted by "Shrikant Prasad (Jira)" <ji...@apache.org> on 2022/12/26 13:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41719) Spark SSL Options should be set only when ssl is enabled - posted by "Shrikant Prasad (Jira)" <ji...@apache.org> on 2022/12/26 13:11:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41719) Spark SSLOptions sub settings should be set only when ssl is enabled - posted by "Shrikant Prasad (Jira)" <ji...@apache.org> on 2022/12/26 13:12:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41720) Rename UnresolvedFunc to UnresolvedFunctionName - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/26 13:36:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41719) Spark SSLOptions sub settings should be set only when ssl is enabled - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/26 13:38:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41719) Spark SSLOptions sub settings should be set only when ssl is enabled - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/26 13:38:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41720) Rename UnresolvedFunc to UnresolvedFunctionName - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/26 13:40:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41720) Rename UnresolvedFunc to UnresolvedFunctionName - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/26 13:40:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41717) Implement the command logic for print and _repr_html_ - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/26 13:50:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41717) Implement the command logic for print and _repr_html_ - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/26 13:50:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41707) Implement initial Catalog.* API - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 23:01:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41711) Upgrade protobuf-java to 3.21.12 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 23:09:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41720) Rename UnresolvedFunc to UnresolvedFunctionName - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/26 23:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41721) Enable doctests in pyspark.sql.connect.catalog - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/27 00:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41721) Enable doctests in pyspark.sql.connect.catalog - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 01:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41721) Enable doctests in pyspark.sql.connect.catalog - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 01:00:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41717) Implement the command logic for print and _repr_html_ - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/27 01:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41654) Enable doctests in pyspark.sql.connect.window - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 01:19:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41654) Enable doctests in pyspark.sql.connect.window - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 01:19:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41722) Implement 3 missing time window functions - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/27 03:06:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41694) Add new config to clean up `spark.ui.store.path` directory when SparkContext.stop() - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 03:07:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41694) Add new config to clean up `spark.ui.store.path` directory when SparkContext.stop() - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 03:07:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41722) Implement 3 missing time window functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 03:12:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41722) Implement 3 missing time window functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 03:12:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41722) Implement time window functions - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/27 03:19:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41690) Introduce AgnosticEncoders - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/27 03:38:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41723) Implement `sequence` function - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/27 03:40:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41723) Implement `sequence` function - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 03:43:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41723) Implement `sequence` function - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 03:43:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41235) High-order function: array_compact - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/27 03:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41473) Implement `functions.format_number` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 03:55:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41473) Implement `functions.format_number` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 03:55:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41724) Implement `call_udf` function - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/27 04:51:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41724) Implement `call_udf` function - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 04:53:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41724) Implement `call_udf` function - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 04:53:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41722) Implement time window functions - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/27 05:02:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41722) Implement time window functions - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/27 05:02:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41725) Remove the workaround of sql(...).collect back in PySpark tests - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/27 05:22:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41529) Implement SparkSession.stop - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 05:26:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41529) Implement SparkSession.stop - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 05:26:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41726) Remove OptimizedCreateHiveTableAsSelectCommand - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2022/12/27 05:48:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41727) ClassCastException when config spark.sql.hive.metastore* properties under jdk17 - posted by "kevinshin (Jira)" <ji...@apache.org> on 2022/12/27 06:00:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41727) ClassCastException when config spark.sql.hive.metastore* properties under jdk17 - posted by "kevinshin (Jira)" <ji...@apache.org> on 2022/12/27 06:01:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41723) Implement `sequence` function - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/27 06:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41473) Implement `functions.format_number` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/27 06:17:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41724) Implement `call_udf` function - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/27 06:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41706) pyspark_types_to_proto_types should supports MapType - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/27 06:36:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41676) Protobuf serializer for StreamingQueryData - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 06:54:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41728) Implement `unwrap_udt` function - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/27 07:23:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41728) Implement `unwrap_udt` function - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 07:27:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41728) Implement `unwrap_udt` function - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 07:27:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41729) Assign name to _LEGACY_ERROR_TEMP_0011 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/27 07:38:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41068) Implement `DataFrame.stat.corr` - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/27 07:43:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-41729) Assign name to _LEGACY_ERROR_TEMP_0011 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/27 07:43:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41729) Assign name to _LEGACY_ERROR_TEMP_0011 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 07:47:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41729) Assign name to _LEGACY_ERROR_TEMP_0011 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 07:47:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41068) Implement `DataFrame.stat.corr` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 07:50:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41529) Implement SparkSession.stop - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/27 07:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41721) Enable doctests in pyspark.sql.connect.catalog - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/27 07:58:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41730) `min` fails on the minimal timestamp - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/27 09:09:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41730) `min` fails on the minimal timestamp - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 09:12:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41730) `min` fails on the minimal timestamp - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 09:12:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41728) Implement `unwrap_udt` function - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/27 10:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41731) Implement the column accessor - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/27 10:23:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41731) Implement the column accessor - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 10:25:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41731) Implement the column accessor - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 10:25:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41732) Session window: analysis rule "SessionWindowing" does not apply tree-pattern based pruning - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2022/12/27 11:16:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41732) Session window: analysis rule "SessionWindowing" does not apply tree-pattern based pruning - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2022/12/27 11:17:00 UTC, 3 replies.
- [jira] [Created] (SPARK-41733) Session window: analysis rule "ResolveWindowTime" does not apply tree-pattern based pruning - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2022/12/27 11:27:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41732) Session window: analysis rule "SessionWindowing" does not apply tree-pattern based pruning - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 11:28:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41067) Implement `DataFrame.stat.cov` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 11:38:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41733) Session window: analysis rule "ResolveWindowTime" does not apply tree-pattern based pruning - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 11:39:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41733) Session window: analysis rule "ResolveWindowTime" does not apply tree-pattern based pruning - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 11:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41734) Wrap catalog messages into a parent message - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/27 12:02:00 UTC, 0 replies.
- [jira] (SPARK-41068) Implement `DataFrame.stat.corr` - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/27 12:31:00 UTC, 0 replies.
- [jira] (SPARK-41067) Implement `DataFrame.stat.cov` - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/27 12:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41065) Implement `DataFrame.freqItems ` and `DataFrame.stat.freqItems ` - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/27 12:32:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41731) Implement the column accessor - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/27 12:52:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41714) Update maven-checkstyle-plugin from 3.1.2 to 3.2.0 - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/27 18:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41714) Update maven-checkstyle-plugin from 3.1.2 to 3.2.0 - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/27 18:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41469) Task rerun on decommissioned executor can be avoided if shuffle data has migrated - posted by "Mridul Muralidharan (Jira)" <ji...@apache.org> on 2022/12/27 21:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41655) Enable doctests in pyspark.sql.connect.column - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 23:15:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-41655) Enable doctests in pyspark.sql.connect.column - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/27 23:15:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41654) Enable doctests in pyspark.sql.connect.window - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/28 01:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41735) Any SparkThrowable (with an error class) not in `error-classes.json` is masked in `SQLExecution.withNewExecutionId` and end-user will see `org.apache.spark.SparkException: [INTERNAL_ERROR]` - posted by "Allison Portis (Jira)" <ji...@apache.org> on 2022/12/28 01:48:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41736) pyspark_types_to_proto_types should supports ArrayType - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/28 02:06:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41736) pyspark_types_to_proto_types should supports ArrayType - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 02:59:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41736) pyspark_types_to_proto_types should supports ArrayType - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 02:59:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41069) Implement `DataFrame.approxQuantile` and `DataFrame.stat.approxQuantile` - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/28 03:00:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41734) Wrap catalog messages into a parent message - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 03:35:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41734) Wrap catalog messages into a parent message - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 03:35:00 UTC, 1 replies.
- [jira] (SPARK-41069) Implement `DataFrame.approxQuantile` and `DataFrame.stat.approxQuantile` - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/28 04:10:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41732) Session window: analysis rule "SessionWindowing" does not apply tree-pattern based pruning - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2022/12/28 04:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41737) Implement `GroupedData.{min, max, avg, sum}` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/28 05:02:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41333) Make `Groupby.{min, max, sum, avg, mean}` compatible with PySpark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 05:09:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41333) Make `Groupby.{min, max, sum, avg, mean}` compatible with PySpark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 05:09:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41737) Implement `GroupedData.{min, max, avg, sum}` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 05:10:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41737) Implement `GroupedData.{min, max, avg, sum}` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 05:10:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41738) Client ID should be mixed into SparkSession cache - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/28 06:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41738) Client ID should be mixed into SparkSession cache - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 06:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41738) Client ID should be mixed into SparkSession cache - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 06:12:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41729) Assign name to _LEGACY_ERROR_TEMP_0011 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/28 06:38:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41734) Wrap catalog messages into a parent message - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/28 06:40:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41736) pyspark_types_to_proto_types should supports ArrayType - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/28 06:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41733) Session window: analysis rule "ResolveWindowTime" does not apply tree-pattern based pruning - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2022/12/28 07:02:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41572) Assign name to _LEGACY_ERROR_TEMP_2149 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 07:19:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41572) Assign name to _LEGACY_ERROR_TEMP_2149 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 07:19:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41739) CheckRule should not be executed when analyze view child - posted by "Yi Zhu (Jira)" <ji...@apache.org> on 2022/12/28 07:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41739) CheckRule should not be executed when analyze view child - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 07:27:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41739) CheckRule should not be executed when analyze view child - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 07:27:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41579) Assign name to _LEGACY_ERROR_TEMP_1249 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 07:48:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41579) Assign name to _LEGACY_ERROR_TEMP_1249 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 07:48:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41740) Implement `Column.name` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/28 08:40:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41740) Implement `Column.name` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 08:44:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41740) Implement `Column.name` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 08:44:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41069) Implement `DataFrame.approxQuantile` and `DataFrame.stat.approxQuantile` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 09:00:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41713) Make CTAS hold a nested execution for data writing - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/28 09:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41741) [SQL] ParquetFilters StringStartsWith push down matching string do not use UTF-8 - posted by "Jiale He (Jira)" <ji...@apache.org> on 2022/12/28 10:00:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41741) [SQL] ParquetFilters StringStartsWith push down matching string do not use UTF-8 - posted by "Jiale He (Jira)" <ji...@apache.org> on 2022/12/28 10:00:00 UTC, 7 replies.
- [jira] [Assigned] (SPARK-41726) Remove OptimizedCreateHiveTableAsSelectCommand - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 10:10:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41726) Remove OptimizedCreateHiveTableAsSelectCommand - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 10:10:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41740) Implement `Column.name` - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/28 11:01:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41738) Client ID should be mixed into SparkSession cache - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/28 11:06:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41689) Enable doctests in pyspark.sql.connect.group - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 11:49:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41689) Enable doctests in pyspark.sql.connect.group - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 11:49:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41742) Support star in groupBy.agg() - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/28 12:01:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41743) groupBy(...).agg(...).sort does not actually sort the output - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/28 12:03:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41742) Support star in groupBy.agg() - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/28 12:04:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41732) Session window: analysis rule "SessionWindowing" does not apply tree-pattern based pruning - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2022/12/28 12:04:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41744) Support multiple arguments in groupBy.max(...) - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/28 12:08:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41745) SparkSession.createDataFrame does not respect the column names in the row - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/28 12:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41746) SparkSession.createDataFrame does not support nested datatypes - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/28 12:14:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41747) Support multiple arguments in groupBy.avg(...) - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/28 12:17:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41747) Support multiple arguments in groupBy.agv(...) - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/28 12:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41747) Support multiple arguments in groupBy.age(...) - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/28 12:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41748) Support multiple arguments in groupBy.min(...) - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/28 12:18:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41471) SPJ: Reduce Spark shuffle when only one side of a join is KeyGroupedPartitioning - posted by "Mars (Jira)" <ji...@apache.org> on 2022/12/28 12:19:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41749) Support multiple arguments in groupBy.sum(...) - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/28 12:20:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41748) Support multiple arguments in groupBy.min(...) - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/28 12:21:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41067) Implement `DataFrame.stat.cov` - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/28 12:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41750) Upgrade dev.ludovic.netlib to 3.0.3 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/28 13:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41751) Support Column.bitwiseAND - posted by "Sandeep Singh (Jira)" <ji...@apache.org> on 2022/12/28 13:21:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41750) Upgrade dev.ludovic.netlib to 3.0.3 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 13:22:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41750) Upgrade dev.ludovic.netlib to 3.0.3 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 13:22:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-41751) Support Column.bitwiseAND - posted by "Sandeep Singh (Jira)" <ji...@apache.org> on 2022/12/28 13:23:00 UTC, 4 replies.
- [jira] [Resolved] (SPARK-41689) Enable doctests in pyspark.sql.connect.group - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/28 17:46:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41750) Upgrade dev.ludovic.netlib to 3.0.3 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/28 17:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41752) UI improvement for nested SQL executions - posted by "Linhong Liu (Jira)" <ji...@apache.org> on 2022/12/28 19:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41753) Add tests for ArrayZip to check the result size and nullability. - posted by "Takuya Ueshin (Jira)" <ji...@apache.org> on 2022/12/28 22:21:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41753) Add tests for ArrayZip to check the result size and nullability. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 22:28:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41753) Add tests for ArrayZip to check the result size and nullability. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 22:28:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-41709) Explicitly define `Seq` as `collection.Seq` to reduce `toSeq` when create ui objects from protobuf objects for Scala 2.13 - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/28 23:27:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41709) Explicitly define `Seq` as `collection.Seq` to reduce `toSeq` when create ui objects from protobuf objects for Scala 2.13 - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2022/12/28 23:27:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41432) Protobuf serializer for SparkPlanGraphWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/28 23:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41592) Implement functionality for training a PyTorch file on the executors - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 23:40:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41592) Implement functionality for training a PyTorch file on the executors - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/28 23:40:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41533) GRPC Errors on the client should be cleaned up - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/29 00:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41752) UI improvement for nested SQL executions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 00:09:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41752) UI improvement for nested SQL executions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 00:09:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41754) Add simple developer guides for UI protobuf serializer - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/29 00:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41754) Add simple developer guides for UI protobuf serializer - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 00:49:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41754) Add simple developer guides for UI protobuf serializer - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 00:49:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41354) Implement `DataFrame.repartitionByRange` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/29 00:58:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41737) Implement `GroupedData.{min, max, avg, sum}` - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/29 01:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41333) Make `Groupby.{min, max, sum, avg, mean}` compatible with PySpark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/29 01:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41755) Reorder the relation IDs - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/29 01:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41747) Support multiple arguments in groupBy.avg(...) - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 01:37:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41747) Support multiple arguments in groupBy.avg(...) - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 01:37:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41744) Support multiple arguments in groupBy.max(...) - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 01:38:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41744) Support multiple arguments in groupBy.max(...) - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 01:38:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41748) Support multiple arguments in groupBy.min(...) - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 01:39:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41748) Support multiple arguments in groupBy.min(...) - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 01:39:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41749) Support multiple arguments in groupBy.sum(...) - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 01:40:00 UTC, 4 replies.
- [jira] [Assigned] (SPARK-41749) Support multiple arguments in groupBy.sum(...) - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 01:40:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41756) Support Column.getField, Column.getItem - posted by "Sandeep Singh (Jira)" <ji...@apache.org> on 2022/12/29 01:41:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41756) Support Column.getField, Column.getItem - posted by "Sandeep Singh (Jira)" <ji...@apache.org> on 2022/12/29 01:43:00 UTC, 4 replies.
- [jira] [Updated] (SPARK-41757) Compatibility of string representation in Column - posted by "Sandeep Singh (Jira)" <ji...@apache.org> on 2022/12/29 01:45:00 UTC, 4 replies.
- [jira] [Created] (SPARK-41757) Compatibility of string representation in Column - posted by "Sandeep Singh (Jira)" <ji...@apache.org> on 2022/12/29 01:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41749) Support multiple arguments in groupBy.sum(...) - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/29 02:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41744) Support multiple arguments in groupBy.max(...) - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/29 02:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41747) Support multiple arguments in groupBy.avg(...) - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/29 02:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41748) Support multiple arguments in groupBy.min(...) - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/29 02:04:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41751) Support Column.bitwiseAND,bitwiseOR,bitwiseXOR,eqNullSafe,isNotNull,isNull,isin - posted by "Sandeep Singh (Jira)" <ji...@apache.org> on 2022/12/29 02:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41751) Support Column.bitwiseAND,bitwiseOR,bitwiseXOR,eqNullSafe,isNotNull - posted by "Sandeep Singh (Jira)" <ji...@apache.org> on 2022/12/29 02:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41758) Support Window.rowsBetween - posted by "Sandeep Singh (Jira)" <ji...@apache.org> on 2022/12/29 02:29:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41758) Support Window.rowsBetween - posted by "Sandeep Singh (Jira)" <ji...@apache.org> on 2022/12/29 02:29:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41758) Support Window.rowsBetween - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/29 02:38:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41753) Add tests for ArrayZip to check the result size and nullability. - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/29 02:39:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41751) Support Column.bitwiseAND,bitwiseOR,bitwiseXOR,eqNullSafe,isNotNull,isNull,isin - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 02:42:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41751) Support Column.bitwiseAND,bitwiseOR,bitwiseXOR,eqNullSafe,isNotNull,isNull,isin - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 02:42:00 UTC, 3 replies.
- [jira] [Created] (SPARK-41759) Use `weakIntern` on string values in create new objects during deserialization - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2022/12/29 03:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41759) Use `weakIntern` on string values in create new objects during deserialization - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2022/12/29 03:02:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41756) Support Column.getField, Column.getItem - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/29 03:08:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-41758) Support Window.rowsBetween - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/29 03:09:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41760) Enforce scalafmt for Spark Connect Client module - posted by "Deng Ziming (Jira)" <ji...@apache.org> on 2022/12/29 03:09:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41760) Enforce scalafmt for Spark Connect Client module - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 03:16:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41760) Enforce scalafmt for Spark Connect Client module - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 03:16:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41761) Fix arithmetic ops: negate, pow - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/29 03:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41762) Make `Column.__neg__` return the same column name as PySpark - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/29 03:38:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41759) Use `weakIntern` on string values in create new objects during deserialization - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 03:43:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41761) Fix arithmetic ops: negate, pow - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 03:45:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41761) Fix arithmetic ops: negate, pow - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 03:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41708) Pull v1write information to write file node - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 03:49:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41708) Pull v1write information to write file node - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 03:49:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41763) Improve v1 writes - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2022/12/29 03:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37287) Pull out dynamic partition and bucket sort from FileFormatWriter - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2022/12/29 03:54:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41764) Make the internal string op name consistent with FunctionRegistry - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/29 03:55:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41764) Make the internal op name consistent with FunctionRegistry - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/29 03:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-40107) Pull out empty2null conversion from FileFormatWriter - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2022/12/29 03:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37194) Avoid unnecessary sort in FileFormatWriter if it's not dynamic partition - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2022/12/29 03:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41407) Pull out v1 write to WriteFiles - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2022/12/29 03:57:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-40201) Improve v1 write test coverage - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2022/12/29 03:57:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41713) Make CTAS hold a nested execution for data writing - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2022/12/29 03:58:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41726) Remove OptimizedCreateHiveTableAsSelectCommand - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2022/12/29 03:58:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41708) Pull v1write information to write file node - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2022/12/29 03:59:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41764) Make the internal string op name consistent with FunctionRegistry - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 04:00:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41764) Make the internal string op name consistent with FunctionRegistry - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 04:00:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41765) Move v1 write metrics to WriteFiles - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2022/12/29 04:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41763) Improve v1 writes - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2022/12/29 04:05:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41751) Support Column.bitwiseAND,bitwiseOR,bitwiseXOR,eqNullSafe,isNotNull,isNull,isin - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/29 04:08:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41578) Assign name to _LEGACY_ERROR_TEMP_2141 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 04:57:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41578) Assign name to _LEGACY_ERROR_TEMP_2141 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 04:57:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41766) Handle decommission request for unregistered executor - posted by "Zhongwei Zhu (Jira)" <ji...@apache.org> on 2022/12/29 05:20:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41766) Handle decommission request sent before executor registration - posted by "Zhongwei Zhu (Jira)" <ji...@apache.org> on 2022/12/29 05:25:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41766) Handle decommission request sent before executor registration - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 05:26:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41766) Handle decommission request sent before executor registration - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 05:26:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41685) Support optional using Protobuf serializer for KVStore in History server - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/29 05:46:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41576) Assign name to _LEGACY_ERROR_TEMP_2051 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 06:01:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41576) Assign name to _LEGACY_ERROR_TEMP_2051 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 06:01:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41581) Assign name to _LEGACY_ERROR_TEMP_1230 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 06:43:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41581) Assign name to _LEGACY_ERROR_TEMP_1230 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 06:43:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41767) Implement `Column.{withField, dropFields}` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/29 06:57:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41767) Implement `Column.{withField, dropFields}` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 07:21:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41767) Implement `Column.{withField, dropFields}` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 07:21:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-41735) Any SparkThrowable (with an error class) not in error-classes.json is masked in SQLExecution.withNewExecutionId and end-user will see "org.apache.spark.SparkException: [INTERNAL_ERROR]" - posted by "Allison Portis (Jira)" <ji...@apache.org> on 2022/12/29 08:11:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41573) Assign name to _LEGACY_ERROR_TEMP_2136 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 08:17:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41573) Assign name to _LEGACY_ERROR_TEMP_2136 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 08:17:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41761) Fix arithmetic ops: negate, pow - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/29 08:42:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41571) Assign name to _LEGACY_ERROR_TEMP_2310 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 08:50:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41571) Assign name to _LEGACY_ERROR_TEMP_2310 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 08:50:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41764) Make the internal string op name consistent with FunctionRegistry - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/29 10:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41768) Refactor the definition of enumeration - `JobExecutionStatus` to follow with the code style - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2022/12/29 11:13:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41768) Refactor the definition of enumeration - `JobExecutionStatus` to follow with the code style - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2022/12/29 11:13:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41344) Reading V2 datasource masks underlying error - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/29 11:28:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41768) Refactor the definition of enum - `JobExecutionStatus` to follow with the code style - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2022/12/29 11:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41768) Refactor the definition of enum - `JobExecutionStatus` to follow with the code style - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 11:43:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41768) Refactor the definition of enum - `JobExecutionStatus` to follow with the code style - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 11:43:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41769) Remove useless semicolons - posted by "jingxiong zhong (Jira)" <ji...@apache.org> on 2022/12/29 11:52:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41655) Enable doctests in pyspark.sql.connect.column - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/29 11:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41767) Implement `Column.{withField, dropFields}` - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/29 11:58:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41756) Support Column.getField, Column.getItem - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/29 11:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41770) eqNullSafe does not support None as its argument - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/29 12:06:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41771) __getitem__ does not work with Column.isin - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/29 12:10:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41758) Support Window.rowsBetween - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/29 12:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41772) Enable pyspark.sql.connect.column.Column.withField doctest - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/29 12:38:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41773) Window.partitionBy is not respected with row_number - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/29 13:06:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41769) Remove useless semicolons - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 13:10:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41769) Remove useless semicolons - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 13:10:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-36392) pandas fixed width file support - posted by "John Ayoub (Jira)" <ji...@apache.org> on 2022/12/29 13:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41769) Remove useless semicolons - posted by "jingxiong zhong (Jira)" <ji...@apache.org> on 2022/12/29 13:24:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41629) Support for protocol extensions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 16:07:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41629) Support for protocol extensions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 16:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41774) Remove def test_vectorized_udf_unsupported_types - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2022/12/29 18:02:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41774) Remove def test_vectorized_udf_unsupported_types - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2022/12/29 18:03:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41774) Remove def test_vectorized_udf_unsupported_types - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 18:16:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41774) Remove def test_vectorized_udf_unsupported_types - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 18:16:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41775) Implement training functions as input - posted by "Rithwik Ediga Lakhamsani (Jira)" <ji...@apache.org> on 2022/12/29 18:40:00 UTC, 4 replies.
- [jira] [Created] (SPARK-41775) Implement training functions as input - posted by "Rithwik Ediga Lakhamsani (Jira)" <ji...@apache.org> on 2022/12/29 18:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41776) Implement support for PyTorch Lightning - posted by "Rithwik Ediga Lakhamsani (Jira)" <ji...@apache.org> on 2022/12/29 18:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41777) Add Integration Tests - posted by "Rithwik Ediga Lakhamsani (Jira)" <ji...@apache.org> on 2022/12/29 18:43:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41537) Protobuf backwards compatibility testing - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 19:37:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41743) groupBy(...).agg(...).sort does not actually sort the output - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/29 20:24:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-41743) groupBy(...).agg(...).sort does not actually sort the output - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/29 20:25:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41743) groupBy(...).agg(...).sort does not actually sort the output - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 20:41:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41757) Compatibility of string representation in Column - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 20:59:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41757) Compatibility of string representation in Column - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 20:59:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41778) Add an alias "reduce" to ArrayAggregate - posted by "Takuya Ueshin (Jira)" <ji...@apache.org> on 2022/12/29 21:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41778) Add an alias "reduce" to ArrayAggregate - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 21:08:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41778) Add an alias "reduce" to ArrayAggregate - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 21:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41742) Support star in groupBy.agg() - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 21:16:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41742) Support star in groupBy.agg() - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 21:16:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41593) Implement logging from the executor nodes - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 23:11:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41593) Implement logging from the executor nodes - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/29 23:11:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41429) Protobuf serializer for RDDOperationGraphWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/30 00:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41726) Remove OptimizedCreateHiveTableAsSelectCommand - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/30 01:03:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41778) Add an alias "reduce" to ArrayAggregate - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/30 02:12:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41742) Support star in groupBy.agg() - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/30 02:23:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41743) groupBy(...).agg(...).sort does not actually sort the output - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/30 02:26:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41708) Pull v1write information to WriteFiles - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2022/12/30 02:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41774) Remove def test_vectorized_udf_unsupported_types - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/30 02:53:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41771) __getitem__ does not work with Column.isin - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/30 02:55:00 UTC, 3 replies.
- [jira] [Created] (SPARK-41780) `regexp_replace('', '[a\\\\d]{0, 2}', 'x')` causes an internal error - posted by "Remzi Yang (Jira)" <ji...@apache.org> on 2022/12/30 03:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41779) Make getitem support filter and select - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/30 03:16:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41780) `regexp_replace('', '[a\\\\d]{0, 2}', 'x')` causes an internal error - posted by "Remzi Yang (Jira)" <ji...@apache.org> on 2022/12/30 03:17:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41779) Make getitem support filter and select - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 03:21:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41779) Make getitem support filter and select - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 03:21:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41781) Add the ability to create resources before creating executor pod - posted by "Qian Sun (Jira)" <ji...@apache.org> on 2022/12/30 03:21:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41771) __getitem__ does not work with Column.isin - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 03:23:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41782) Regenerate benchmark results - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/30 03:26:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41782) Regenerate benchmark results - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 03:29:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41782) Regenerate benchmark results - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 03:29:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41783) Make column op support None - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/30 03:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41760) Enforce scalafmt for Spark Connect Client module - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/30 04:09:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41783) Make column op support None - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 04:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41783) Make column op support None - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 04:11:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41770) eqNullSafe does not support None as its argument - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 04:12:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41770) eqNullSafe does not support None as its argument - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 04:12:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41784) Add missing `__rmod__` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/30 04:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41784) Add missing `__rmod__` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 04:57:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41784) Add missing `__rmod__` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 04:57:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41068) Implement `DataFrame.stat.corr` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/30 05:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41785) Implement `GroupedData.mean` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/30 05:43:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41785) Implement `GroupedData.mean` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 05:46:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41785) Implement `GroupedData.mean` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 05:46:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-41781) Add the ability to create pvc before creating driver/executor pod - posted by "Qian Sun (Jira)" <ji...@apache.org> on 2022/12/30 06:10:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41782) Regenerate benchmark results - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/30 06:13:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41578) Assign name to _LEGACY_ERROR_TEMP_2141 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2022/12/30 07:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41580) Assign name to _LEGACY_ERROR_TEMP_2137 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 07:38:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41580) Assign name to _LEGACY_ERROR_TEMP_2137 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 07:38:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41745) SparkSession.createDataFrame does not respect the column names in the row - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/30 07:40:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-41781) Add the ability to create pvc before creating driver/executor pod - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 07:43:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41781) Add the ability to create pvc before creating driver/executor pod - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 07:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41786) Deduplicate helper functions - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/30 07:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41786) Deduplicate helper functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 07:52:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41786) Deduplicate helper functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 07:52:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41779) Make getitem support filter and select - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/30 08:12:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41771) __getitem__ does not work with Column.isin - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/30 08:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41756) Support Column.getField, Column.getItem - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/30 08:35:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41758) Support Window.rowsBetween - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/30 08:35:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41787) Upgrade silencer from 1.7.10 to 1.7.12 - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2022/12/30 08:54:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41787) Upgrade silencer from 1.7.10 to 1.7.12 - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2022/12/30 08:58:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41787) Upgrade silencer from 1.7.10 to 1.7.12 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 08:59:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41787) Upgrade silencer from 1.7.10 to 1.7.12 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 08:59:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41629) Support for protocol extensions - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/30 09:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41788) Move InsertIntoStatement to basicLogicalOperators - posted by "Cheng Pan (Jira)" <ji...@apache.org> on 2022/12/30 10:13:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41788) Move InsertIntoStatement to basicLogicalOperators - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 10:19:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41788) Move InsertIntoStatement to basicLogicalOperators - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 10:19:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41789) Make `createDataFrame` support list of Rows - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/30 10:25:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41745) SparkSession.createDataFrame does not respect the column names in the row - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 10:56:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41789) Make `createDataFrame` support list of Rows - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 10:58:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41789) Make `createDataFrame` support list of Rows - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 10:58:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41790) Transform will get wrong date when only specify reader or writer 's row format delimited - posted by "mattshma (Jira)" <ji...@apache.org> on 2022/12/30 13:13:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41790) Transform will get wrong date when only specify reader or writer 's row format delimited - posted by "mattshma (Jira)" <ji...@apache.org> on 2022/12/30 13:14:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41790) Set TRANSFORM reader and writer's format correctly - posted by "mattshma (Jira)" <ji...@apache.org> on 2022/12/30 13:47:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41790) Set TRANSFORM reader and writer's format correctly - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 13:55:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41790) Set TRANSFORM reader and writer's format correctly - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 13:55:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41791) Create distinct metadata attributes for metadata that is constant or file and metadata that is generated during the scan - posted by "Jan-Ole Sasse (Jira)" <ji...@apache.org> on 2022/12/30 14:16:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41791) Create distinct metadata attributes for metadata that is constant or file and metadata that is generated during the scan - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 14:20:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41791) Create distinct metadata attributes for metadata that is constant or file and metadata that is generated during the scan - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 14:20:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-41553) Fix the documentation for num_files - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2022/12/30 14:23:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41741) [SQL] ParquetFilters StringStartsWith push down matching string do not use UTF-8 - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2022/12/30 20:04:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41754) Add simple developer guides for UI protobuf serializer - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/30 21:47:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41423) Protobuf serializer for StageDataWrapper - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/30 21:50:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41792) Shuffle merge finalization removes the wrong finalization state from the DB - posted by "Mridul Muralidharan (Jira)" <ji...@apache.org> on 2022/12/30 21:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41792) Shuffle merge finalization removes the wrong finalization state from the DB - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 22:54:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41792) Shuffle merge finalization removes the wrong finalization state from the DB - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/30 22:54:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41783) Make column op support None - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/31 00:52:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41770) eqNullSafe does not support None as its argument - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/31 00:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41784) Add missing `__rmod__` - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/31 00:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41785) Implement `GroupedData.mean` - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/31 00:55:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41787) Upgrade silencer from 1.7.10 to 1.7.12 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/31 00:56:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41745) SparkSession.createDataFrame does not respect the column names in the row - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/31 01:05:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41789) Make `createDataFrame` support list of Rows - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/31 01:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41793) Incorrect result for window frames defined as ranges on large decimals - posted by "Gera Shegalov (Jira)" <ji...@apache.org> on 2022/12/31 01:07:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41793) Incorrect result for window frames defined by a range clause on large decimals - posted by "Gera Shegalov (Jira)" <ji...@apache.org> on 2022/12/31 01:07:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41553) Fix the documentation for num_files - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/31 01:27:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41553) Fix the documentation for num_files - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/31 01:27:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41793) Incorrect result for window frames defined by a range clause on large decimals - posted by "Gera Shegalov (Jira)" <ji...@apache.org> on 2022/12/31 01:37:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41794) Reenable ANSI mode in pyspark.sql.tests.connect.test_connect_column - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/31 01:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41795) Disable ANSI mode in pyspark.sql.tests.connect.test_connect_column - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/31 01:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41795) Disable ANSI mode in pyspark.sql.tests.connect.test_connect_column - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/31 01:40:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41049) Nondeterministic expressions have unstable values if they are children of CodegenFallback expressions - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/12/31 02:06:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41773) Window.partitionBy is not respected with row_number - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/31 02:19:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41773) Window.partitionBy is not respected with row_number - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/31 02:19:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41786) Deduplicate helper functions - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/31 02:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41796) Test the error class: UNSUPPORTED_SUBQUERY_EXPRESSION_CATEGORY.UNSUPPORTED_CORRELATED_REFERENCE_DATA_TYPE - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2022/12/31 02:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41797) Enable test for `array_repeat` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/31 03:09:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41797) Enable test for `array_repeat` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/31 03:09:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41797) Enable test for `array_repeat` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/31 03:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41797) Enable test for `array_repeat` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/31 03:12:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-41796) Test the error class: UNSUPPORTED_CORRELATED_REFERENCE_DATA_TYPE - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2022/12/31 03:24:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41796) Test the error class: UNSUPPORTED_CORRELATED_REFERENCE_DATA_TYPE - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/31 03:24:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41796) Test the error class: UNSUPPORTED_CORRELATED_REFERENCE_DATA_TYPE - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/31 03:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41069) Implement `DataFrame.approxQuantile` and `DataFrame.stat.approxQuantile` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/31 04:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41798) Upgrade hive-storage-api to 2.8.1 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/31 05:05:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41773) Window.partitionBy is not respected with row_number - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2022/12/31 05:06:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41798) Upgrade hive-storage-api to 2.8.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/31 05:08:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41798) Upgrade hive-storage-api to 2.8.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/31 05:08:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-41797) Enable test for `array_repeat` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/31 06:06:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41799) Combine plan-related tests - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/31 07:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41799) Combine plan-related tests - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/31 07:16:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41799) Combine plan-related tests - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/31 07:16:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41493) Make csv functions support options - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/31 09:11:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41493) Make csv functions support options - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/31 09:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41066) Implement `DataFrame.sampleBy ` and `DataFrame.stat.sampleBy ` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2022/12/31 09:44:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-41065) Implement `DataFrame.freqItems ` and `DataFrame.stat.freqItems ` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/31 10:06:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41800) Upgrade commons-compress to 1.22 - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2022/12/31 10:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41800) Upgrade commons-compress to 1.22 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/31 10:26:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-41800) Upgrade commons-compress to 1.22 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/31 10:26:00 UTC, 1 replies.
- [jira] (SPARK-41065) Implement `DataFrame.freqItems ` and `DataFrame.stat.freqItems ` - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/31 10:27:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41066) Implement `DataFrame.sampleBy ` and `DataFrame.stat.sampleBy ` - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2022/12/31 10:28:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-41798) Upgrade hive-storage-api to 2.8.1 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/31 11:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41801) Remove *args: Any, **kwargs: Any for def transpose - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2022/12/31 12:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41801) Remove *args: Any, **kwargs: Any for def transpose - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/31 12:08:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-41801) Remove *args: Any, **kwargs: Any for def transpose - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/31 12:08:00 UTC, 1 replies.
- [jira] [Created] (SPARK-41802) Upgrade Apache httpcore to 4.4.16 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2022/12/31 15:25:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41802) Upgrade Apache httpcore to 4.4.16 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/31 15:30:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-41802) Upgrade Apache httpcore to 4.4.16 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2022/12/31 15:30:00 UTC, 0 replies.
- [jira] [Created] (SPARK-41803) log() function variations are missing - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2022/12/31 16:12:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41802) Upgrade Apache httpcore to 4.4.16 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/12/31 20:09:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41804) InterpretedUnsafeProjection doesn't properly handle an array of UDTs - posted by "Bruce Robbins (Jira)" <ji...@apache.org> on 2022/12/31 23:24:00 UTC, 2 replies.
- [jira] [Created] (SPARK-41804) InterpretedUnsafeProjection doesn't properly handle an array of UDTs - posted by "Bruce Robbins (Jira)" <ji...@apache.org> on 2022/12/31 23:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41676) Protobuf serializer for StreamingQueryData - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2022/12/31 23:37:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41804) InterpretedUnsafeProjection doesn't properly handle an array of UDTs - posted by "Bruce Robbins (Jira)" <ji...@apache.org> on 2022/12/31 23:39:00 UTC, 0 replies.