You are viewing a plain text version of this content. The canonical link for it is here.

---

- [jira] [Created] (SPARK-37175) Performance improvement to hash joins with many duplicate keys - posted by "Bruce Robbins (Jira)" <ji...@apache.org> on 2021/11/01 00:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37175) Performance improvement to hash joins with many duplicate keys - posted by "Bruce Robbins (Jira)" <ji...@apache.org> on 2021/11/01 00:15:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37129) Supplement all micro benchmark results use to Java 17 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/01 00:58:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37129) Supplement all micro benchmark results use to Java 17 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/01 00:59:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37172) Push down filters having both partitioning and non-partitioning columns - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2021/11/01 01:05:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37170) Pin PySpark version installed in the Binder environment for tagged commit - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/01 01:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37175) Performance improvement to hash joins with many duplicate keys - posted by "Sumeet (Jira)" <ji...@apache.org> on 2021/11/01 02:27:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37173) Optimize GetFunctionsOperation to get builtin functions only once when use wild function name pattern - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/01 03:32:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37173) Optimize GetFunctionsOperation to get builtin functions only once when use wild function name pattern - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/01 03:32:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37160) Add a config to optionally disable paddin for char type - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/01 05:30:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37150) Migrate DESCRIBE NAMESPACE to use V2 command by default - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/01 05:56:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37150) Migrate DESCRIBE NAMESPACE to use V2 command by default - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/01 05:56:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37161) RowToColumnConverter support AnsiIntervalType - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/01 06:57:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37161) RowToColumnConverter support AnsiIntervalType - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/01 06:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37013) `select format_string('%0$s', 'Hello')` has different behavior when using java 8 and Java 17 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/01 07:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37176) JsonSource's infer should have the same exception handle logic as JacksonParser's parse logic - posted by "Xianjin YE (Jira)" <ji...@apache.org> on 2021/11/01 08:04:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37176) JsonSource's infer should have the same exception handle logic as JacksonParser's parse logic - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/01 08:18:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37176) JsonSource's infer should have the same exception handle logic as JacksonParser's parse logic - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/01 08:18:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-36061) Create a PodGroup with user specified minimum resources required - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/01 09:58:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-36061) Create a PodGroup with user specified minimum resources required - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/01 09:58:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23977) Add commit protocol binding to Hadoop 3.1 PathOutputCommitter mechanism - posted by "Gustavo Martin (Jira)" <ji...@apache.org> on 2021/11/01 10:34:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-23977) Add commit protocol binding to Hadoop 3.1 PathOutputCommitter mechanism - posted by "Gustavo Martin (Jira)" <ji...@apache.org> on 2021/11/01 10:35:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37062) Introduce a new data source for providing consistent set of rows per microbatch - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2021/11/01 11:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37062) Introduce a new data source for providing consistent set of rows per microbatch - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2021/11/01 11:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37177) Support LONG argument to the Spark SQL LIMIT clause - posted by "Douglas Moore (Jira)" <ji...@apache.org> on 2021/11/01 12:19:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37178) Add Target Encoding to ml.feature - posted by "Simon Tao (Jira)" <ji...@apache.org> on 2021/11/01 12:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37034) What's the progress of vectorized execution for spark? - posted by "xiaoli (Jira)" <ji...@apache.org> on 2021/11/01 13:08:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37178) Add Target Encoding to ml.feature - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/01 13:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37178) Add Target Encoding to ml.feature - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/01 13:48:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37179) ANSI mode: Allow casting between Timestamp and Numeric - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/11/01 13:49:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37179) ANSI mode: Allow casting between Timestamp and Numeric - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/11/01 13:50:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37179) ANSI mode: Allow casting between Timestamp and Numeric - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/11/01 13:53:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37179) ANSI mode: Allow casting between Timestamp and Numeric - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/01 14:22:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37180) PySpark.pandas should support __version__ - posted by "Chuck Connell (Jira)" <ji...@apache.org> on 2021/11/01 14:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37180) PySpark.pandas should support __version__ - posted by "Chuck Connell (Jira)" <ji...@apache.org> on 2021/11/01 15:04:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-36566) Add Spark appname as a label to the executor pods - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/11/01 15:10:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-36566) Add Spark appname as a label to the executor pods - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/11/01 15:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-36566) Add Spark appname as a label to the executor pods - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/01 15:20:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-37034) What's the progress of vectorized execution for spark? - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/01 15:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37166) SPIP: Storage Partitioned Join - posted by "Erik Krogen (Jira)" <ji...@apache.org> on 2021/11/01 17:56:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37181) pyspark.pandas.read_csv() should support latin-1 encoding - posted by "Chuck Connell (Jira)" <ji...@apache.org> on 2021/11/01 18:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37182) pyspark.pandas.to_numeric() should support the errors option - posted by "Chuck Connell (Jira)" <ji...@apache.org> on 2021/11/01 18:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37183) pyspark.pandas.DataFrame.map() should support .fillna() - posted by "Chuck Connell (Jira)" <ji...@apache.org> on 2021/11/01 19:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37184) pyspark.pandas should support DF["column"].str.split("some_suffix").str[0] - posted by "Chuck Connell (Jira)" <ji...@apache.org> on 2021/11/01 19:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37182) pyspark.pandas.to_numeric() should support the errors option - posted by "Chuck Connell (Jira)" <ji...@apache.org> on 2021/11/01 19:30:00 UTC, 0 replies.
- [jira] [Issue Comment Deleted] (SPARK-37182) pyspark.pandas.to_numeric() should support the errors option - posted by "Chuck Connell (Jira)" <ji...@apache.org> on 2021/11/01 19:35:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37182) pyspark.pandas.to_numeric() should support the errors option - posted by "Chuck Connell (Jira)" <ji...@apache.org> on 2021/11/01 19:35:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37185) DataFrame.take() only uses one worker - posted by "mathieu longtin (Jira)" <ji...@apache.org> on 2021/11/01 20:02:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37185) DataFrame.take() only uses one worker - posted by "mathieu longtin (Jira)" <ji...@apache.org> on 2021/11/01 20:09:00 UTC, 3 replies.
- [jira] [Created] (SPARK-37186) pyspark.pandas should support tseries.offsets - posted by "Chuck Connell (Jira)" <ji...@apache.org> on 2021/11/01 21:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37187) pyspark.pandas fails to create a histogram of one column from a large DataFrame - posted by "Chuck Connell (Jira)" <ji...@apache.org> on 2021/11/01 21:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37188) pyspark.pandas histogram accepts the title option but does not add a title to the plot - posted by "Chuck Connell (Jira)" <ji...@apache.org> on 2021/11/01 21:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37189) CLONE - pyspark.pandas histogram accepts the title option but does not add a title to the plot - posted by "Chuck Connell (Jira)" <ji...@apache.org> on 2021/11/01 21:19:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37189) pyspark.pandas histogram accepts the range option but does not use it - posted by "Chuck Connell (Jira)" <ji...@apache.org> on 2021/11/01 21:19:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37023) Avoid fetching merge status when shuffleMergeEnabled is false for a shuffleDependency during retry - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/01 22:26:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37023) Avoid fetching merge status when shuffleMergeEnabled is false for a shuffleDependency during retry - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/01 22:26:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37190) Improve error messages for casting under ANSI mode - posted by "Allison Wang (Jira)" <ji...@apache.org> on 2021/11/01 22:49:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37191) Allow merging DecimalTypes with different precision values - posted by "Ivan (Jira)" <ji...@apache.org> on 2021/11/01 23:02:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37191) Allow merging DecimalTypes with different precision values - posted by "Ivan (Jira)" <ji...@apache.org> on 2021/11/01 23:10:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37191) Allow merging DecimalTypes with different precision values - posted by "Ivan (Jira)" <ji...@apache.org> on 2021/11/01 23:17:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37191) Allow merging DecimalTypes with different precision values - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/01 23:21:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37190) Improve error messages for casting under ANSI mode - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/01 23:37:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37190) Improve error messages for casting under ANSI mode - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/01 23:37:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-36554) Error message while trying to use spark sql functions directly on dataframe columns without using select expression - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/02 01:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37159) Change HiveExternalCatalogVersionsSuite to be able to test with Java 17 - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/02 02:04:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37192) Migrate SHOW TBLPROPERTIES to use V2 command by default - posted by "PengLei (Jira)" <ji...@apache.org> on 2021/11/02 03:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37192) Migrate SHOW TBLPROPERTIES to use V2 command by default - posted by "PengLei (Jira)" <ji...@apache.org> on 2021/11/02 03:06:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-37124) Support RowToColumnarExec with Arrow - posted by "Chendi.Xue (Jira)" <ji...@apache.org> on 2021/11/02 03:23:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37193) DynamicJoinSelection.shouldDemoteBroadcastHashJoin should not apply to outer joins - posted by "Eugene Koifman (Jira)" <ji...@apache.org> on 2021/11/02 03:34:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37051) The filter operator gets wrong results in char type - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2021/11/02 03:38:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37193) DynamicJoinSelection.shouldDemoteBroadcastHashJoin should not apply to outer joins - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/02 03:43:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37193) DynamicJoinSelection.shouldDemoteBroadcastHashJoin should not apply to outer joins - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/02 03:43:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-35496) Upgrade Scala 2.13 to 2.13.7 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2021/11/02 05:25:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37164) Add ExpressionBuilder for functions with complex overloads - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/02 06:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37164) Add ExpressionBuilder for functions with complex overloads - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/02 06:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37168) Improve error messages for SQL functions and operators under ANSI mode - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/02 06:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37168) Improve error messages for SQL functions and operators under ANSI mode - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/02 06:48:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37152) Inline type hints for python/pyspark/context.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/02 06:53:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37152) Inline type hints for python/pyspark/context.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/02 06:53:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37030) Maven build failed in windows! - posted by "Shockang (Jira)" <ji...@apache.org> on 2021/11/02 07:37:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37156) Inline type hints for python/pyspark/storagelevel.py - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/02 07:44:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37156) Inline type hints for python/pyspark/storagelevel.py - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/02 07:44:00 UTC, 0 replies.
- Subscribe - posted by XING JIN <ji...@gmail.com> on 2021/11/02 07:47:24 UTC, 0 replies.
- [jira] [Commented] (SPARK-37189) pyspark.pandas histogram accepts the range option but does not use it - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/02 07:53:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-37177) Support LONG argument to the Spark SQL LIMIT clause - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/02 07:56:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37174) WARN WindowExec: No Partition Defined is being printed 4 times. - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/02 07:57:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-37174) WARN WindowExec: No Partition Defined is being printed 4 times. - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/02 07:58:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37194) Avoid unnecessary sort in FileFormatWriter if it's not dynamic partition - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2021/11/02 08:23:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37194) Avoid unnecessary sort in FileFormatWriter if it's not dynamic partition - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2021/11/02 08:25:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-26365) spark-submit for k8s cluster doesn't propagate exit code - posted by "Oscar Bonilla (Jira)" <ji...@apache.org> on 2021/11/02 08:30:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-36924) CAST between ANSI intervals and numerics - posted by "PengLei (Jira)" <ji...@apache.org> on 2021/11/02 08:38:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37195) Unify v1 and v2 SHOW TBLPROPERTIES tests - posted by "PengLei (Jira)" <ji...@apache.org> on 2021/11/02 09:09:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-36895) Add Create Index syntax support - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/02 09:22:00 UTC, 5 replies.
- [jira] [Assigned] (SPARK-37194) Avoid unnecessary sort in FileFormatWriter if it's not dynamic partition - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/02 09:34:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37194) Avoid unnecessary sort in FileFormatWriter if it's not dynamic partition - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/02 09:34:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37176) JsonSource's infer should have the same exception handle logic as JacksonParser's parse logic - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/02 09:41:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37196) NPE in org.apache.spark.sql.hive.HiveShim$.toCatalystDecimal(HiveShim.scala:106) - posted by "Sergey Yavorski (Jira)" <ji...@apache.org> on 2021/11/02 09:57:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37196) NPE in org.apache.spark.sql.hive.HiveShim$.toCatalystDecimal(HiveShim.scala:106) - posted by "Sergey Yavorski (Jira)" <ji...@apache.org> on 2021/11/02 10:02:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37197) PySpark pandas recent issues from chconnell - posted by "Chuck Connell (Jira)" <ji...@apache.org> on 2021/11/02 13:17:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-37189) pyspark.pandas histogram accepts the range option but does not use it - posted by "Chuck Connell (Jira)" <ji...@apache.org> on 2021/11/02 13:19:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24853) Support Column type for withColumn and withColumnRenamed apis - posted by "Nicholas Chammas (Jira)" <ji...@apache.org> on 2021/11/02 14:39:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24853) Support Column type for withColumn and withColumnRenamed apis - posted by "Nicholas Chammas (Jira)" <ji...@apache.org> on 2021/11/02 14:39:00 UTC, 1 replies.
- [jira] [Reopened] (SPARK-24853) Support Column type for withColumn and withColumnRenamed apis - posted by "Nicholas Chammas (Jira)" <ji...@apache.org> on 2021/11/02 14:39:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24853) Support Column type for withColumn and withColumnRenamed apis - posted by "Nicholas Chammas (Jira)" <ji...@apache.org> on 2021/11/02 14:42:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37066) Improve ORC RecordReader's error message - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/11/02 15:30:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37066) Improve ORC RecordReader's error message - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/11/02 15:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37066) Improve ORC RecordReader's error message - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/11/02 15:30:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37198) pyspark.pandas read_csv() and to_csv() should handle local files - posted by "Chuck Connell (Jira)" <ji...@apache.org> on 2021/11/02 18:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37199) Add a deterministic field to QueryPlan - posted by "Abhishek Somani (Jira)" <ji...@apache.org> on 2021/11/02 18:09:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-37197) PySpark pandas recent issues from chconnell - posted by "Chuck Connell (Jira)" <ji...@apache.org> on 2021/11/02 18:09:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-37199) Add a deterministic field to QueryPlan - posted by "Abhishek Somani (Jira)" <ji...@apache.org> on 2021/11/02 18:09:01 UTC, 1 replies.
- [jira] [Commented] (SPARK-37199) Add a deterministic field to QueryPlan - posted by "Abhishek Somani (Jira)" <ji...@apache.org> on 2021/11/02 18:10:01 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37199) Add a deterministic field to QueryPlan - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/02 18:23:01 UTC, 2 replies.
- [jira] [Created] (SPARK-37200) Drop index support - posted by "Huaxin Gao (Jira)" <ji...@apache.org> on 2021/11/02 21:27:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37200) Drop index support - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/02 21:29:01 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37200) Drop index support - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/02 21:29:01 UTC, 1 replies.
- [jira] [Assigned] (SPARK-36879) Support Parquet v2 data page encodings for the vectorized path - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/02 22:15:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-36879) Support Parquet v2 data page encodings for the vectorized path - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/02 22:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-36935) Enhance ParquetSchemaConverter to capture Parquet repetition & definition level - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/02 23:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37201) Spark SQL reads unnecessary nested fields (filter after explode) - posted by "Sergey Kotlov (Jira)" <ji...@apache.org> on 2021/11/03 01:41:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37201) Spark SQL reads unnecсessary nested fields (filter after explode) - posted by "Sergey Kotlov (Jira)" <ji...@apache.org> on 2021/11/03 01:44:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37201) Spark SQL reads unnecessary nested fields (filter after explode) - posted by "Sergey Kotlov (Jira)" <ji...@apache.org> on 2021/11/03 01:45:00 UTC, 4 replies.
- [jira] [Resolved] (SPARK-32567) Code-gen for full outer shuffled hash join - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/03 03:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-32567) Code-gen for full outer shuffled hash join - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/03 03:19:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37191) Allow merging DecimalTypes with different precision values - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/03 03:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24774) support reading AVRO logical types - Decimal - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/03 03:32:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37202) Temp view didn't collect temp function that registered with catalog API - posted by "Linhong Liu (Jira)" <ji...@apache.org> on 2021/11/03 04:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37202) Temp view didn't collect temp function that registered with catalog API - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/03 04:58:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-37202) Temp view didn't collect temp function that registered with catalog API - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/03 04:58:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37179) ANSI mode: Allow casting between Timestamp and Numeric - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/03 06:01:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37179) ANSI mode: Add a config to allow casting between Datetime and Numeric - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/11/03 06:04:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37200) Drop index support - posted by "Huaxin Gao (Jira)" <ji...@apache.org> on 2021/11/03 06:23:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37203) Fix NotSerializableException when observe with percentile_approx - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/11/03 07:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37203) Fix NotSerializableException when observe with percentile_approx - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/11/03 07:35:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37203) Fix NotSerializableException when observe with percentile_approx - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/03 08:06:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-26365) spark-submit for k8s cluster doesn't propagate exit code - posted by "Oscar Bonilla (Jira)" <ji...@apache.org> on 2021/11/03 08:41:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37195) Unify v1 and v2 SHOW TBLPROPERTIES tests - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/03 09:53:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37195) Unify v1 and v2 SHOW TBLPROPERTIES tests - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/03 09:53:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37077) Annotations for pyspark.sql.context.SQLContext.createDataFrame are broken - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/03 12:12:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-36894) RDD.toDF should be synchronized with dispatched variants of SparkSession.createDataFrame - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/03 12:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-36894) RDD.toDF should be synchronized with dispatched variants of SparkSession.createDataFrame - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/03 12:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37077) Annotations for pyspark.sql.context.SQLContext.createDataFrame are broken - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/03 12:12:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37030) Maven build failed in windows! - posted by "Shockang (Jira)" <ji...@apache.org> on 2021/11/03 12:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-36894) RDD.toDF should be synchronized with dispatched variants of SparkSession.createDataFrame - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/03 14:00:04 UTC, 3 replies.
- [jira] [Commented] (SPARK-37077) Annotations for pyspark.sql.context.SQLContext.createDataFrame are broken - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/03 14:01:00 UTC, 5 replies.
- [jira] [Created] (SPARK-37204) Update Apache Parent POM version to 24 in the pom.xml - posted by "Janardhan Pulivarthi (Jira)" <ji...@apache.org> on 2021/11/03 15:17:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37204) Update Apache Parent POM version to 24 in the pom.xml - posted by "Janardhan Pulivarthi (Jira)" <ji...@apache.org> on 2021/11/03 15:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37204) Update Apache Parent POM version to 24 in the pom.xml - posted by "Janardhan Pulivarthi (Jira)" <ji...@apache.org> on 2021/11/03 15:18:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37149) Improve error messages for arithmetic overflow under ANSI mode - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/03 16:56:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37202) Temp view didn't collect temp function that registered with catalog API - posted by "Huaxin Gao (Jira)" <ji...@apache.org> on 2021/11/03 17:52:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37060) Report driver status does not handle response from backup masters - posted by "Mohamadreza Rostami (Jira)" <ji...@apache.org> on 2021/11/03 19:59:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-36566) Add Spark appname as a label to the executor pods - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/03 23:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37205) Support mapreduce.job.send-token-conf when starting containers in YARN - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/11/03 23:46:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37205) Support mapreduce.job.send-token-conf when starting containers in YARN - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/11/04 00:17:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37108) Expose make_date expression in R - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/04 00:45:01 UTC, 1 replies.
- [jira] [Commented] (SPARK-37108) Expose make_date expression in R - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/04 00:45:01 UTC, 1 replies.
- [jira] [Commented] (SPARK-36989) Migrate type hint data tests - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/04 01:47:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37054) Porting "pandas API on Spark: Internals" to PySpark docs. - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/11/04 02:58:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37108) Expose make_date expression in R - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/04 03:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37206) Upgrade Avro to 1.11.0 - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/04 04:27:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37206) Upgrade Avro to 1.11.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/04 04:32:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37206) Upgrade Avro to 1.11.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/04 04:32:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37023) Avoid fetching merge status when shuffleMergeEnabled is false for a shuffleDependency during retry - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/04 05:14:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37190) Improve error messages for casting under ANSI mode - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/04 06:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37181) pyspark.pandas.read_csv() should support latin-1 encoding - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/04 06:24:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37183) pyspark.pandas.DataFrame.map() should support .fillna() - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/04 06:25:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37187) pyspark.pandas fails to create a histogram of one column from a large DataFrame - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/04 06:25:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37186) pyspark.pandas should support tseries.offsets - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/04 06:25:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37188) pyspark.pandas histogram accepts the title option but does not add a title to the plot - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/04 06:25:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37184) pyspark.pandas should support DF["column"].str.split("some_suffix").str[0] - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/04 06:25:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37198) pyspark.pandas read_csv() and to_csv() should handle local files - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/04 06:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37206) Upgrade Avro to 1.11.0 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/04 06:26:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37197) Behaviour inconsistency between pandas and pandas API on Spark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/04 06:26:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37197) Behaviour inconsistency between pandas and pandas API on Spark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/04 06:28:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-37180) PySpark.pandas should support __version__ - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/04 07:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37180) PySpark.pandas should support __version__ - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/04 07:32:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37180) PySpark.pandas should support __version__ - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/04 07:34:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-35496) Upgrade Scala 2.13 to 2.13.7 - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/04 08:03:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-35149) I am facing this issue regularly, how to fix this issue. - posted by "freedom1993 feng (Jira)" <ji...@apache.org> on 2021/11/04 08:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37207) Python API does not have isEmpty - posted by "Dhiren Navani (Jira)" <ji...@apache.org> on 2021/11/04 08:22:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37207) Python API does not have isEmpty - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/04 08:51:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37207) Python API does not have isEmpty - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/04 08:51:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-37038) Sample push down in DS v2 - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/04 14:27:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37038) Sample push down in DS v2 - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/04 14:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37208) Support mapping Spark gpu/fpga resource types to custom YARN resource type - posted by "Thomas Graves (Jira)" <ji...@apache.org> on 2021/11/04 15:19:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37203) Fix NotSerializableException when observe with TypedImperativeAggregate - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/11/04 15:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37208) Support mapping Spark gpu/fpga resource types to custom YARN resource type - posted by "Thomas Graves (Jira)" <ji...@apache.org> on 2021/11/04 15:19:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37198) pyspark.pandas read_csv() and to_csv() should handle local files - posted by "Chuck Connell (Jira)" <ji...@apache.org> on 2021/11/04 15:43:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-37198) pyspark.pandas read_csv() and to_csv() should handle local files - posted by "Chuck Connell (Jira)" <ji...@apache.org> on 2021/11/04 15:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37209) YarnShuffleIntegrationSuite and other two similar cases in `resource-managers` test failed - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2021/11/04 16:02:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37209) YarnShuffleIntegrationSuite and other two similar cases in `resource-managers` test failed - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2021/11/04 16:04:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-31726) Make spark.files available in driver with cluster deploy mode on kubernetes - posted by "Martin Andersson (Jira)" <ji...@apache.org> on 2021/11/04 17:27:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-31726) Make spark.files available in driver with cluster deploy mode on kubernetes - posted by "Martin Andersson (Jira)" <ji...@apache.org> on 2021/11/04 18:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37208) Support mapping Spark gpu/fpga resource types to custom YARN resource type - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/04 18:32:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37210) An error occurred while concurrently writing to different static partitions - posted by "Zhen Wang (Jira)" <ji...@apache.org> on 2021/11/05 03:36:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37210) An error occurred while concurrently writing to different static partitions - posted by "Zhen Wang (Jira)" <ji...@apache.org> on 2021/11/05 04:41:00 UTC, 4 replies.
- [jira] [Created] (SPARK-37211) More descriptions and adding an image to the failure message about enabling GitHub Actions - posted by "Yuto Akutsu (Jira)" <ji...@apache.org> on 2021/11/05 04:41:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37210) An error occurred while concurrently writing to different static partitions - posted by "Zhen Wang (Jira)" <ji...@apache.org> on 2021/11/05 04:52:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37157) Inline type hints for python/pyspark/util.py - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/05 05:30:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37157) Inline type hints for python/pyspark/util.py - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/05 05:31:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37211) More descriptions and adding an image to the failure message about enabling GitHub Actions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/05 05:34:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37211) More descriptions and adding an image to the failure message about enabling GitHub Actions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/05 05:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37137) Inline type hints for python/pyspark/conf.py - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/05 05:41:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37137) Inline type hints for python/pyspark/conf.py - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/05 05:41:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-37210) An error occurred while concurrently writing to different static partitions - posted by "Zhen Wang (Jira)" <ji...@apache.org> on 2021/11/05 07:29:00 UTC, 3 replies.
- [jira] [Created] (SPARK-37212) Improve the implement of aggregate pushdown. - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/11/05 07:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37212) Improve the implement of aggregate pushdown. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/05 07:43:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37212) Improve the implement of aggregate pushdown. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/05 07:43:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37213) In the latest version release (Spark.3.2.O) in the Apache Spark documentation, the "O" at the end feels wrong, and it is written as the English letter "O" - posted by "liu zhuang (Jira)" <ji...@apache.org> on 2021/11/05 07:58:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37213) In the latest version release (Spark.3.2.O) in the Apache Spark documentation, the "O" at the end feels wrong, and it is written as the English letter "O" - posted by "liu zhuang (Jira)" <ji...@apache.org> on 2021/11/05 08:03:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37213) In the latest version release (Spark.3.2.O) in the Apache Spark documentation, the "O" at the end feels wrong, and it is written as the English letter "O" - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2021/11/05 08:23:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37213) In the latest version release (Spark.3.2.O) in the Apache Spark documentation, the "O" at the end feels wrong, and it is written as the English letter "O" - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2021/11/05 08:23:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37203) Fix NotSerializableException when observe with TypedImperativeAggregate - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/05 08:31:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37203) Fix NotSerializableException when observe with TypedImperativeAggregate - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/05 08:31:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37210) An error occurred while concurrently writing to different static partitions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/05 08:35:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37214) Fail query analysis earlier with invalid identifiers - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/05 08:52:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-32940) Collect, first and last should be deterministic aggregate functions - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/05 09:05:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-32940) Collect, first and last should be deterministic aggregate functions - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/05 09:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37215) Support Application Timeouts on YARN - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2021/11/05 09:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37214) Fail query analysis earlier with invalid identifiers - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/05 09:34:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37214) Fail query analysis earlier with invalid identifiers - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/05 09:34:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37215) Support Application Timeouts on YARN - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/05 09:41:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37215) Support Application Timeouts on YARN - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/05 09:41:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37216) Add the Hive macro functionality to SparkSQL - posted by "hgs (Jira)" <ji...@apache.org> on 2021/11/05 10:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37216) Add the Hive macro functionality to SparkSQL - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/05 10:35:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37216) Add the Hive macro functionality to SparkSQL - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/05 10:35:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37217) Dynamic partitions should fail quickly when writing to external tables to prevent data deletion - posted by "dzcxzl (Jira)" <ji...@apache.org> on 2021/11/05 10:59:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37217) Dynamic partitions should fail quickly when writing to external tables to prevent data deletion - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/05 11:36:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37217) Dynamic partitions should fail quickly when writing to external tables to prevent data deletion - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/05 11:36:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-36924) CAST between ANSI intervals and numerics - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/05 11:36:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37212) Improve the implement of aggregate pushdown. - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/05 12:23:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-36182) Support TimestampNTZ type in Parquet file source - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/05 13:36:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-34230) Let AQE determine the right parallelism in DistributionAndOrderingUtils - posted by "Anton Okolnychyi (Jira)" <ji...@apache.org> on 2021/11/05 17:37:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37218) Parameterize shuffle partitions in TPCDSQueryBenchmark - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/05 20:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37218) Parameterize shuffle partitions in TPCDSQueryBenchmark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/05 20:36:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37218) Parameterize shuffle partitions in TPCDSQueryBenchmark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/05 20:36:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37218) Parameterize `spark.sql.shuffle.partitions` in TPCDSQueryBenchmark - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/05 20:47:01 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37151) Avoid executor state sync attempt fail continuously in a short timeframe - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/05 21:18:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37208) Support mapping Spark gpu/fpga resource types to custom YARN resource type - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/05 21:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-35496) Upgrade Scala 2.13 to 2.13.7 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/05 21:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-35496) Upgrade Scala 2.13 to 2.13.7 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/05 21:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-33539) Standardize exception messages in Spark - posted by "Allison Wang (Jira)" <ji...@apache.org> on 2021/11/05 21:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37219) support AS OF syntax - posted by "Huaxin Gao (Jira)" <ji...@apache.org> on 2021/11/05 21:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37219) support AS OF syntax - posted by "Huaxin Gao (Jira)" <ji...@apache.org> on 2021/11/05 21:56:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37218) Parameterize `spark.sql.shuffle.partitions` in TPCDSQueryBenchmark - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/11/05 22:31:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37219) support AS OF syntax - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/05 22:37:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37219) support AS OF syntax - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/05 22:37:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37218) Parameterize `spark.sql.shuffle.partitions` in TPCDSQueryBenchmark - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/11/05 22:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37218) Parameterize `spark.sql.shuffle.partitions` in TPCDSQueryBenchmark - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/05 23:36:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-36998) Handle concurrent eviction of same application in SHS - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/06 00:35:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-36998) Handle concurrent eviction of same application in SHS - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/06 00:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37167) Add benchmark for aggregate push down - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/11/06 01:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37220) Do not split input file for Parquet reader with aggregate push down - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/11/06 01:45:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37221) The collect-like API in SparkPlan should support columnar output - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/11/06 01:46:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37220) Do not split input file for Parquet reader with aggregate push down - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/06 01:51:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-37220) Do not split input file for Parquet reader with aggregate push down - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/06 01:51:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37222) Max iterations reached in Operator Optimization w/left_anti or left_semi join and nested structures - posted by "Shawn Smith (Jira)" <ji...@apache.org> on 2021/11/06 01:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37222) Max iterations reached in Operator Optimization w/left_anti or left_semi join and nested structures - posted by "Shawn Smith (Jira)" <ji...@apache.org> on 2021/11/06 02:18:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37221) The collect-like API in SparkPlan should support columnar output - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/06 02:37:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37221) The collect-like API in SparkPlan should support columnar output - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/06 02:38:00 UTC, 2 replies.
- [jira] [Issue Comment Deleted] (SPARK-33245) Add built-in UDF - GETBIT - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/11/06 03:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-33574) Improve locality for push-based shuffle especially for join like operations - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/06 05:37:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-33574) Improve locality for push-based shuffle especially for join like operations - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/06 05:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37223) Fix unit test check in JoinHintSuite - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/11/06 05:46:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37223) Fix unit test check in JoinHintSuite - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/11/06 05:50:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37223) Fix unit test check in JoinHintSuite - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/06 05:51:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37223) Fix unit test check in JoinHintSuite - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/06 05:51:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37224) Optimize write path on RocksDB state store provider - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2021/11/06 06:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37224) Optimize write path on RocksDB state store provider - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2021/11/06 06:40:00 UTC, 4 replies.
- [jira] [Assigned] (SPARK-37224) Optimize write path on RocksDB state store provider - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/06 07:39:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-37225) Read/write dataframes with ANSI intervals from/to Avro files - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/06 09:08:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37225) Read/write dataframes with ANSI intervals from/to Avro files - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/06 09:08:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37225) Read/write dataframes with ANSI intervals from/to Avro files - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/06 09:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37225) Read/write dataframes with ANSI intervals from/to Avro files - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/06 09:09:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37226) Filter push down through window - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2021/11/06 15:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37220) Do not split input file for Parquet reader with aggregate push down - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/11/06 16:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37226) Filter push down through window - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/06 16:39:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37226) Filter push down through window - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/06 16:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-19230) View creation in Derby gets SQLDataException because definition gets very big - posted by "Tal Franji (Jira)" <ji...@apache.org> on 2021/11/06 16:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37227) DataFrame.mapInArrow - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/07 05:09:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37227) DataFrame.mapInArrow - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/07 05:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37228) Implement DataFrame.mapInArrow in Python - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/07 05:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37229) Implement DataFrame.mapInArrow in Scala - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/07 05:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37228) Implement DataFrame.mapInArrow in Python - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/07 05:12:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-30153) Extend data exchange options for vectorized UDF functions with vanilla Arrow serialization - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/07 05:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37230) Document DataFrame.mapInArrow - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/07 05:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37228) Implement DataFrame.mapInArrow in Python - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/07 05:42:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-36665) Add more Not operator optimizations - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/11/07 08:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-36665) Add more Not operator optimizations - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/11/07 08:19:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-35933) PartitionFilters and pushFilters not applied to window functions - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2021/11/07 10:37:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37223) Fix unit test check in JoinHintSuite - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/11/07 13:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37207) Python API does not have isEmpty - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/11/07 13:53:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-36998) Handle concurrent eviction of same application in SHS - posted by "Thejdeep Gudivada (Jira)" <ji...@apache.org> on 2021/11/07 17:16:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37231) Dynamic writes/reads of ANSI interval partitions - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/07 18:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37231) Dynamic writes/reads of ANSI interval partitions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/07 18:44:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37231) Dynamic writes/reads of ANSI interval partitions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/07 18:45:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37232) Upgrade ORC to 1.7.1 - posted by "William Hyun (Jira)" <ji...@apache.org> on 2021/11/07 19:14:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37232) Upgrade ORC to 1.7.1 - posted by "William Hyun (Jira)" <ji...@apache.org> on 2021/11/07 19:15:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37232) Upgrade ORC to 1.7.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/07 19:44:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37232) Upgrade ORC to 1.7.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/07 19:44:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37232) Upgrade ORC to 1.7.1 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/07 21:18:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37120) Add Java17 GitHub Action build and test job - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/08 00:45:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-37120) Add Java17 GitHub Action build and test job - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/08 00:45:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-36998) Handle concurrent eviction of same application in SHS - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/08 01:15:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37221) The collect-like API in SparkPlan should support columnar output - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/11/08 01:21:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37120) Add Java17 GitHub Action build and test job - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/08 01:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37233) Inline type hints for files in python/pyspark/mllib - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/08 01:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37234) Inline type hints for python/pyspark/mllib/_statistics.py - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/08 01:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37234) Inline type hints for python/pyspark/mllib/_statistics.py - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/08 01:57:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37234) Inline type hints for python/pyspark/mllib/stat/_statistics.py - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/08 02:02:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37235) Inline type hints for python/pyspark/mllib/distribution.py and __init__.py - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/08 02:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37236) Inline type hints for distribution.py, __init__.py in python/pyspark/mllib/stat/ - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/08 02:03:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37236) Inline type hints for KernelDensity.pyi, test.py in python/pyspark/mllib/stat/ - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/08 02:04:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-37235) Inline type hints for distribution.py and __init__.py in python/pyspark/mllib/ - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/08 02:05:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37235) Inline type hints for distribution.py and __init__.py in python/pyspark/mllib/stat - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/08 02:05:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-37235) Inline type hints for distribution.py and __init__.py in python/pyspark/mllib/stat - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/08 02:06:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37236) Inline type hints for KernelDensity.pyi, test.py in python/pyspark/mllib/stat/ - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/08 02:07:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-35437) Use expressions to filter Hive partitions at client side - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/11/08 02:25:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-35437) Use expressions to filter Hive partitions at client side - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/11/08 02:25:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-34521) spark.createDataFrame does not support Pandas StringDtype extension type - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/08 02:46:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-34521) spark.createDataFrame does not support Pandas StringDtype extension type - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/08 02:46:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-35437) Use expressions to filter Hive partitions at client side - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/11/08 03:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37237) Upgrade kubernetes-client to 5.9.0 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/08 03:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37237) Upgrade kubernetes-client to 5.9.0 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/08 03:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37237) Upgrade kubernetes-client to 5.9.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/08 03:45:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37237) Upgrade kubernetes-client to 5.9.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/08 03:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37236) Inline type hints for KernelDensity.pyi, test.py in python/pyspark/mllib/stat/ - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/08 03:46:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37199) Add a deterministic field to QueryPlan - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/08 04:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37238) Upgrade ORC to 1.6.12 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/08 04:56:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37238) Upgrade ORC to 1.6.12 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/08 05:01:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37238) Upgrade ORC to 1.6.12 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/08 05:02:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37214) Fail query analysis earlier with invalid identifiers - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/08 05:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37231) Dynamic writes/reads of ANSI interval partitions - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/08 06:03:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37211) More descriptions and adding an image to the failure message about enabling GitHub Actions - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/08 06:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-30602) SPIP: Support push-based shuffle to improve shuffle efficiency - posted by "Jin Xing (Jira)" <ji...@apache.org> on 2021/11/08 06:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37234) Inline type hints for python/pyspark/mllib/stat/_statistics.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/08 06:51:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37234) Inline type hints for python/pyspark/mllib/stat/_statistics.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/08 06:51:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37238) Upgrade ORC to 1.6.12 - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/08 07:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37158) Add doc about spark not supported hive built-in function - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/08 07:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37239) Avoid unnecessary `setReplication` in Yarn mode - posted by "wang-zhun (Jira)" <ji...@apache.org> on 2021/11/08 07:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37235) Inline type hints for distribution.py and __init__.py in python/pyspark/mllib/stat - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/08 07:46:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37239) Avoid unnecessary `setReplication` in Yarn mode - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2021/11/08 07:48:00 UTC, 7 replies.
- [jira] [Created] (SPARK-37240) Cannot read partitioned parquet files with ANSI interval partition values - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/08 08:00:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37240) Cannot read partitioned parquet files with ANSI interval partition values - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/08 08:02:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37241) Upgrade Jackson to 2.13.0 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/08 08:04:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37196) NPE in org.apache.spark.sql.hive.HiveShim$.toCatalystDecimal(HiveShim.scala:106) - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2021/11/08 08:14:00 UTC, 4 replies.
- [jira] [Reopened] (SPARK-36038) Basic speculation metrics at stage level - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/08 08:29:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-36038) Basic speculation metrics at stage level - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/08 08:47:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-36038) Basic speculation metrics at stage level - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/08 08:47:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37241) Upgrade Jackson to 2.13.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/08 08:47:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37241) Upgrade Jackson to 2.13.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/08 08:47:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37240) Cannot read partitioned parquet files with ANSI interval partition values - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/08 08:48:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-37239) Avoid unnecessary `setReplication` in Yarn mode - posted by "wang-zhun (Jira)" <ji...@apache.org> on 2021/11/08 09:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37242) option -v is broken? - posted by "Patrice DUROUX (Jira)" <ji...@apache.org> on 2021/11/08 10:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37242) option -v is broken? - posted by "Patrice DUROUX (Jira)" <ji...@apache.org> on 2021/11/08 10:41:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37196) NPE in org.apache.spark.sql.hive.HiveShim$.toCatalystDecimal(HiveShim.scala:106) - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/08 11:02:00 UTC, 4 replies.
- [jira] [Created] (SPARK-37243) Fix the format of the document - posted by "yikf (Jira)" <ji...@apache.org> on 2021/11/08 11:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37243) Fix the format of the document - posted by "yikf (Jira)" <ji...@apache.org> on 2021/11/08 11:35:00 UTC, 4 replies.
- [jira] [Assigned] (SPARK-37239) Avoid unnecessary `setReplication` in Yarn mode - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/08 11:47:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37243) Fix the format of the document - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/08 11:58:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37243) Fix the format of the document - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/08 11:58:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37243) Fix the format of the document - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/11/08 13:20:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37225) Read/write dataframes with ANSI intervals from/to Avro files - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/08 15:17:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37241) Upgrade Jackson to 2.13.0 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/08 15:23:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37240) Cannot read partitioned parquet files with ANSI interval partition values - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/08 15:25:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37237) Upgrade kubernetes-client to 5.9.0 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/08 18:05:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37217) The number of dynamic partitions should early check when writing to external tables - posted by "dzcxzl (Jira)" <ji...@apache.org> on 2021/11/08 19:14:00 UTC, 0 replies.
- [jira] (SPARK-36895) Add Create Index syntax support - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/08 19:25:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-26413) SPIP: RDD Arrow Support in Spark Core and PySpark - posted by "Ruslan Dautkhanov (Jira)" <ji...@apache.org> on 2021/11/08 20:13:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37196) NPE in org.apache.spark.sql.hive.HiveShim$.toCatalystDecimal(HiveShim.scala:106) - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/08 20:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37244) Support Python 3.10 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/08 21:02:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37244) Support Python 3.10 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/08 21:06:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37244) Build and test with Python 3.10 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/08 21:08:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37244) Build and test on Python 3.10 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/08 21:08:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37244) Build and test on Python 3.10 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/08 21:19:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37244) Build and test on Python 3.10 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/08 21:49:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37245) SAP HANA : Truncate doesn't truncate the table but rather drops the table - posted by "Balaji Balasubramaniam (Jira)" <ji...@apache.org> on 2021/11/08 23:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-35867) Enable vectorized read for VectorizedPlainValuesReader.readBooleans - posted by "Kazuyuki Tanimura (Jira)" <ji...@apache.org> on 2021/11/08 23:26:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37246) Support Python 3.10 in PySpark - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/11/08 23:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37246) Support Python 3.10 in PySpark - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/11/08 23:56:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37247) Failed test_create_nan_decimal_dataframe (pyspark.sql.tests.test_dataframe.DataFrameTests) - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/11/09 00:07:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37247) Failed test_create_nan_decimal_dataframe (pyspark.sql.tests.test_dataframe.DataFrameTests) - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/11/09 00:09:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37248) Failed test_make_date (pyspark.sql.tests.test_functions.FunctionsTests) - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/11/09 00:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37249) ImportError: cannot import name 'Callable' from 'collections' - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/11/09 00:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37250) Failed test_capture_user_friendly_exception (pyspark.sql.tests.test_utils.UtilsTests) - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/11/09 00:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37251) Failed _joinAsOf doctest - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/11/09 00:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37246) Support Python 3.10 in PySpark - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/09 01:29:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37252) Ignore test_memory_limit on non-Linux environment - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/09 01:32:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37235) Inline type hints for distribution.py and __init__.py in python/pyspark/mllib/stat - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/09 01:33:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37252) Ignore test_memory_limit on non-Linux environment - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/09 01:50:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37252) Ignore test_memory_limit on non-Linux environment - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/09 01:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37251) Failed _joinAsOf doctest - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/11/09 02:34:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37250) Failed test_capture_user_friendly_exception (pyspark.sql.tests.test_utils.UtilsTests) - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/11/09 02:35:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37248) Failed test_make_date (pyspark.sql.tests.test_functions.FunctionsTests) - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/11/09 02:35:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37247) Failed test_create_nan_decimal_dataframe (pyspark.sql.tests.test_dataframe.DataFrameTests) - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/11/09 02:35:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37252) Ignore test_memory_limit on non-Linux environment - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/09 02:41:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37249) ImportError: cannot import name 'Callable' from 'collections' - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/09 02:50:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-37249) ImportError: cannot import name 'Callable' from 'collections' - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/09 02:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37246) Support Python 3.10 in PySpark - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/11/09 03:18:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37239) Avoid unnecessary `setReplication` in Yarn mode - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/11/09 03:55:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37244) Build and test on Python 3.10 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/09 04:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24907) Migrate JDBC data source to DataSource API v2 - posted by "melin (Jira)" <ji...@apache.org> on 2021/11/09 04:14:00 UTC, 3 replies.
- [jira] (SPARK-24907) Migrate JDBC data source to DataSource API v2 - posted by "melin (Jira)" <ji...@apache.org> on 2021/11/09 04:17:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37245) SAP HANA : Truncate doesn't truncate the table but rather drops the table - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/09 06:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37245) SAP HANA : Truncate doesn't truncate the table but rather drops the table - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/09 06:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37242) option -v is broken? - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/09 06:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37198) pyspark.pandas read_csv() and to_csv() should handle local files - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/09 06:18:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-36998) Handle concurrent eviction of same application in SHS - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/09 06:35:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37253) try_simplify_traceback should not fail when tb_frame.f_lineno is None - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/09 08:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37253) try_simplify_traceback should not fail when tb_frame.f_lineno is None - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/09 09:00:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37253) try_simplify_traceback should not fail when tb_frame.f_lineno is None - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/09 09:00:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37253) try_simplify_traceback should not fail when tb_frame.f_lineno is None - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/09 09:01:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37254) 100% CPU usage on Spark Thrift Server. - posted by "ramakrishna chilaka (Jira)" <ji...@apache.org> on 2021/11/09 10:34:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37254) 100% CPU usage on Spark Thrift Server. - posted by "ramakrishna chilaka (Jira)" <ji...@apache.org> on 2021/11/09 10:44:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37255) When Used with PyHive (by dropbox) query timeout doesn't result in propagation to the UI - posted by "ramakrishna chilaka (Jira)" <ji...@apache.org> on 2021/11/09 11:02:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37253) try_simplify_traceback should not fail when tb_frame.f_lineno is None - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/09 11:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25224) Improvement of Spark SQL ThriftServer memory management - posted by "ramakrishna chilaka (Jira)" <ji...@apache.org> on 2021/11/09 12:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37256) Replace `ScalaObjectMapper` with `ClassTagExtensions` to fix compilation warnings - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2021/11/09 12:38:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37256) Replace `ScalaObjectMapper` with `ClassTagExtensions` to fix compilation warnings - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/09 12:52:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37256) Replace `ScalaObjectMapper` with `ClassTagExtensions` to fix compilation warnings - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/09 12:52:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37257) Update setup.py for Python 3.10 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/09 13:09:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37257) Update setup.py for Python 3.10 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/09 13:52:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37257) Update setup.py for Python 3.10 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/09 13:52:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37201) Spark SQL reads unnecessary nested fields (filter after explode) - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/11/09 14:13:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37258) Add Volcano support in kubernetes-client - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/11/09 14:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37258) Add Volcano support in kubernetes-client - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/11/09 14:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37201) Spark SQL reads unnecessary nested fields (filter after explode) - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/09 14:51:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37259) JDBC read is always going to wrap the query in a select statement - posted by "Kevin Appel (Jira)" <ji...@apache.org> on 2021/11/09 15:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-35557) Adapt uses of JDK 17 Internal APIs - posted by "Olivier Peyrusse (Jira)" <ji...@apache.org> on 2021/11/09 15:35:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37259) JDBC read is always going to wrap the query in a select statement - posted by "Kevin Appel (Jira)" <ji...@apache.org> on 2021/11/09 15:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-35011) Avoid Block Manager registerations when StopExecutor msg is in-flight. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/09 15:52:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37257) Update setup.py for Python 3.10 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/09 16:04:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-37251) Failed _joinAsOf doctest - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/09 16:10:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-37250) Failed test_capture_user_friendly_exception (pyspark.sql.tests.test_utils.UtilsTests) - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/09 16:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37251) Failed _joinAsOf doctest - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/09 16:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37250) Failed test_capture_user_friendly_exception (pyspark.sql.tests.test_utils.UtilsTests) - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/09 16:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37249) ImportError: cannot import name 'Callable' from 'collections' - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/09 16:11:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37248) Failed test_make_date (pyspark.sql.tests.test_functions.FunctionsTests) - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/09 16:11:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-37248) Failed test_make_date (pyspark.sql.tests.test_functions.FunctionsTests) - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/09 16:11:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37246) Run PyArrow tests on Python 3.10 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/09 16:12:00 UTC, 1 replies.
- [jira] [Closed] (SPARK-37247) Failed test_create_nan_decimal_dataframe (pyspark.sql.tests.test_dataframe.DataFrameTests) - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/09 16:12:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-37246) Run PyArrow tests on Python 3.10 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/09 16:13:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37246) Run PyArrow tests on Python 3.10 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/09 16:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37260) PYSPARK Arrow 3.2.0 docs link invalid - posted by "Thomas Graves (Jira)" <ji...@apache.org> on 2021/11/09 17:35:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37261) Check adding partitions with ANSI intervals - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/09 18:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37261) Check adding partitions with ANSI intervals - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/09 18:21:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37261) Check adding partitions with ANSI intervals - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/09 18:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37262) Not log empty aggregate and group by in JDBCScan - posted by "Huaxin Gao (Jira)" <ji...@apache.org> on 2021/11/09 23:05:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37262) Not log empty aggregate and group by in JDBCScan - posted by "Huaxin Gao (Jira)" <ji...@apache.org> on 2021/11/09 23:06:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37262) Not log empty aggregate and group by in JDBCScan - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/09 23:54:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37262) Not log empty aggregate and group by in JDBCScan - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/09 23:54:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37263) Reduce pandas-on-Spark warning for internal usage. - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/11/10 00:36:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-36575) Executor lost may cause spark stage to hang - posted by "wuyi (Jira)" <ji...@apache.org> on 2021/11/10 03:25:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-36575) Executor lost may cause spark stage to hang - posted by "wuyi (Jira)" <ji...@apache.org> on 2021/11/10 03:26:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-36575) Executor lost may cause spark stage to hang - posted by "wuyi (Jira)" <ji...@apache.org> on 2021/11/10 03:27:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-36575) Executor lost may cause spark stage to hang - posted by "wuyi (Jira)" <ji...@apache.org> on 2021/11/10 03:27:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37260) PYSPARK Arrow 3.2.0 docs link invalid - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/10 04:04:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-37260) PYSPARK Arrow 3.2.0 docs link invalid - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/10 04:04:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37264) Skip dependency testing on Java 17 temporarily - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/10 04:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37265) Support Java 17 in `dev/test-dependencies.sh` - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/10 04:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37264) Skip dependency testing on Java 17 temporarily - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/10 05:04:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37264) Skip dependency testing on Java 17 temporarily - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/10 05:09:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37264) Skip dependency testing on Java 17 temporarily - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/10 05:09:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37264) Cut the transitive dependency on hadoop-client-api which orc-shims depends on only for Java 17 with hadoop-2.7 - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/10 05:56:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37264) [SPARK-37264][BUILD] Exclude hadoop-client-api transitive dependency from orc-core - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/10 06:08:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37264) [SPARK-37264][BUILD] Exclude hadoop-client-api transitive dependency from orc-core - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/10 06:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37265) Support Java 17 in `dev/test-dependencies.sh` - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/10 06:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37266) Optimize the analysis for view text of persist view and fix security vulnerabilities caused by sql tampering - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/11/10 08:25:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37266) Optimize the analysis for view text of persistent view and fix security vulnerabilities caused by sql tampering - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/11/10 08:29:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37267) OptimizeSkewInRebalancePartitions support optimize non-root node - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2021/11/10 08:42:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37267) OptimizeSkewInRebalancePartitions support optimize non-root node - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/10 08:54:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37267) OptimizeSkewInRebalancePartitions support optimize non-root node - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/10 08:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37266) Optimize the analysis for view text of persistent view and fix security vulnerabilities caused by sql tampering - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/10 08:59:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37266) Optimize the analysis for view text of persistent view and fix security vulnerabilities caused by sql tampering - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/10 08:59:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37022) Use black as a formatter for the whole PySpark codebase. - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/10 09:40:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37022) Use black as a formatter for the whole PySpark codebase. - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/10 09:40:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37022) Use black as a formatter for the whole PySpark codebase. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/10 09:55:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37268) Remove unused method call in FileScanRDD - posted by "Junfan Zhang (Jira)" <ji...@apache.org> on 2021/11/10 11:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37268) Remove unused method call in FileScanRDD - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/10 11:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37268) Remove unused method call in FileScanRDD - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/10 11:12:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37269) The partitionOverwriteMode option is not respected when using insertInto - posted by "David Szakallas (Jira)" <ji...@apache.org> on 2021/11/10 11:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37270) Incorect result of filter using isNull condition - posted by "Tomasz Kus (Jira)" <ji...@apache.org> on 2021/11/10 12:03:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37261) Check adding partitions with ANSI intervals - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/10 12:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37270) Incorect result of filter using isNull condition - posted by "Tomasz Kus (Jira)" <ji...@apache.org> on 2021/11/10 12:23:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37236) Inline type hints for KernelDensity.pyi, test.py in python/pyspark/mllib/stat/ - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/10 13:23:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37045) Unify v1 and v2 ALTER TABLE .. ADD COLUMNS tests - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/10 14:02:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37045) Unify v1 and v2 ALTER TABLE .. ADD COLUMNS tests - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/10 14:02:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37271) Spark OOM issue - posted by "M Shadab (Jira)" <ji...@apache.org> on 2021/11/10 15:54:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37271) Spark OOM issue - posted by "M Shadab (Jira)" <ji...@apache.org> on 2021/11/10 15:56:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37271) Spark OOM issue - posted by "M Shadab (Jira)" <ji...@apache.org> on 2021/11/10 15:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37271) Spark OOM issue - posted by "M Shadab (Jira)" <ji...@apache.org> on 2021/11/10 15:57:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37265) Support Java 17 in `dev/test-dependencies.sh` - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/10 18:02:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-35557) Adapt uses of JDK 17 Internal APIs - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/10 18:05:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-33502) Large number of SELECT columns causes StackOverflowError - posted by "Arwin S Tio (Jira)" <ji...@apache.org> on 2021/11/10 19:23:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37272) Add ExtendedRocksDBTest - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/11 00:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37273) Hidden File Metadata Support for Spark SQL - posted by "Yaohua Zhao (Jira)" <ji...@apache.org> on 2021/11/11 00:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37272) Add ExtendedRocksDBTest - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 00:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37272) Add ExtendedRocksDBTest - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 00:58:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-37260) PYSPARK Arrow 3.2.0 docs link invalid - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/11 02:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37260) PYSPARK Arrow 3.2.0 docs link invalid - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/11 02:26:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37233) Inline type hints for files in python/pyspark/mllib - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/11 02:27:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37254) 100% CPU usage on Spark Thrift Server. - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/11 02:28:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37272) Add `ExtendedRocksDBTest` and disable RocksDB tests on Apple Silicon - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/11 02:40:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-37272) Add ExtendedRocksDBTest - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/11 02:40:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-37109) Install Java 17 on all of the Jenkins workers - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/11 02:48:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37109) Install Java 17 on all of the Jenkins workers - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/11 02:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-36900) "SPARK-36464: size returns correct positive number even with over 2GB data" will oom with JDK17 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/11 02:48:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37264) Exclude hadoop-client-api transitive dependency from orc-core - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/11 02:50:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37273) Hidden File Metadata Support for Spark SQL - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/11 03:04:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37273) Hidden File Metadata Support for Spark SQL - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/11 03:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37255) When Used with PyHive (by dropbox) query timeout doesn't result in propagation to the UI - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/11 03:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37255) When Used with PyHive (by dropbox) query timeout doesn't result in propagation to the UI - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/11 03:08:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37274) These parameters should be of type long, not int - posted by "hao (Jira)" <ji...@apache.org> on 2021/11/11 03:23:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37275) Support ANSI intervals in PySpark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/11 03:25:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37277) Support DayTimeIntervalType in Arrow - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/11 03:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37276) Support YearMonthIntervalType in Arrow - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/11 03:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37278) Support YearMonthIntervalType in createDataFrame/toPandas and Python UDFs - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/11 03:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37279) Support DayTimeIntervalType in createDataFrame/toPandas and Python UDFs - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/11 03:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37278) Support YearMonthIntervalType in createDataFrame/toPandas and Python UDFs - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/11 03:30:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37280) Support YearMonthIntervalType in Py4J - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/11 03:31:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37281) Support DayTimeIntervalType in Py4J - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/11 03:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37281) Support DayTimeIntervalType in Py4J - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/11 03:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37275) Support ANSI intervals in PySpark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/11 03:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37278) Support YearMonthIntervalType in createDataFrame/toPandas and Python UDFs - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/11 03:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37270) Incorect result of filter using isNull condition - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/11 04:03:00 UTC, 5 replies.
- [jira] [Assigned] (SPARK-36799) Pass queryExecution name in CLI when only select query - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/11 04:42:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-36799) Pass queryExecution name in CLI when only select query - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/11 04:42:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-36799) Pass queryExecution name in CLI - posted by "dzcxzl (Jira)" <ji...@apache.org> on 2021/11/11 04:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-36182) Support TimestampNTZ type in Parquet file source - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/11 04:47:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-36073) EquivalentExpressions fixes and improvements - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/11 04:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-36073) EquivalentExpressions fixes and improvements - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/11 04:50:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37282) Add ExtendedLevelDBTest and disable LevelDB tests on Apple Silicon - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/11 05:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37282) Add ExtendedLevelDBTest and disable LevelDB tests on Apple Silicon - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 05:22:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-37282) Add ExtendedLevelDBTest and disable LevelDB tests on Apple Silicon - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 05:23:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-37276) Support YearMonthIntervalType in Arrow - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/11 05:28:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37263) Add an option to silence advice for pandas API on Spark. - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/11/11 05:52:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37263) Create an option to silence advice for pandas API on Spark. - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/11/11 05:52:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37274) These parameters should be of type long, not int - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 05:58:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37274) These parameters should be of type long, not int - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 05:58:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37283) Don't try to store a V1 table which contains ANSI intervals in Hive compatible format - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/11 06:37:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37283) Don't try to store a V1 table which contains ANSI intervals in Hive compatible format - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/11 06:38:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37263) Add PandasAPIOnSparkAdviceWarning class - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/11/11 06:56:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37283) Don't try to store a V1 table which contains ANSI intervals in Hive compatible format - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 06:59:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37263) Add PandasAPIOnSparkAdviceWarning class - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 06:59:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37283) Don't try to store a V1 table which contains ANSI intervals in Hive compatible format - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 06:59:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37263) Add PandasAPIOnSparkAdviceWarning class - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 06:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37284) Upgrade Jekyll to 4.2.1 - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/11 06:59:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37284) Upgrade Jekyll to 4.2.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 07:02:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37284) Upgrade Jekyll to 4.2.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 07:03:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37282) Add ExtendedLevelDBTest and disable LevelDB tests on Apple Silicon - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/11 07:04:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37274) When the value of this parameter is greater than the maximum value of int type, the value will be thrown out of bounds. The document description of this parameter should remind the user of this risk point - posted by "hao (Jira)" <ji...@apache.org> on 2021/11/11 07:26:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37285) Add Weight of Evidence and Information value to ml.feature - posted by "Simon Tao (Jira)" <ji...@apache.org> on 2021/11/11 07:56:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37023) Avoid fetching merge status when shuffleMergeEnabled is false for a shuffleDependency during retry - posted by "Mridul Muralidharan (Jira)" <ji...@apache.org> on 2021/11/11 09:04:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37285) Add Weight of Evidence and Information value to ml.feature - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 09:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37285) Add Weight of Evidence and Information value to ml.feature - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 09:07:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37262) Not log empty aggregate and group by in JDBCScan - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/11 09:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37286) Move compileAggregates from JDBCRDD to JdbcDialect - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/11/11 09:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37287) Pull out dynamic partition and bucket sort from FileFormatWriter - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2021/11/11 09:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37286) Move compileAggregates from JDBCRDD to JdbcDialect - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 09:58:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37286) Move compileAggregates from JDBCRDD to JdbcDialect - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 09:58:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37288) Backport update pyspakr.since annotation to 3.1 and 3.2 - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/11 10:09:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37288) Backport update pyspark.since annotation to 3.1 and 3.2 - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/11 10:10:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-37288) Backport update pyspark.since annotation to 3.1 and 3.2 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 10:25:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37288) Backport update pyspark.since annotation to 3.1 and 3.2 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 10:25:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37289) Refactoring:remove the unnecessary function with partitionSchemaOption - posted by "tenglei (Jira)" <ji...@apache.org> on 2021/11/11 10:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37290) Exponential planning time in case of non-deterministic function - posted by "Kaya Kupferschmidt (Jira)" <ji...@apache.org> on 2021/11/11 11:29:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37290) Exponential planning time in case of non-deterministic function - posted by "Kaya Kupferschmidt (Jira)" <ji...@apache.org> on 2021/11/11 11:31:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37258) Add Volcano support in kubernetes-client - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/11/11 11:38:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37286) Move compileFilter and compileAggregates from JDBCRDD to JdbcDialect - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/11/11 12:14:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37291) PySpark SparkSession.config should respect enableHiveSupport - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/11/11 13:25:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37292) Removes outer join if it only has DISTINCT on streamed side with alias - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2021/11/11 13:29:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37292) Removes outer join if it only has DISTINCT on streamed side with alias - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2021/11/11 13:31:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37019) Add Codegen support to array higher-order-functions - posted by "Adam Binford (Jira)" <ji...@apache.org> on 2021/11/11 13:55:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37292) Removes outer join if it only has DISTINCT on streamed side with alias - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 14:00:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37289) Refactoring:remove the unnecessary function with partitionSchemaOption - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 14:00:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37289) Refactoring:remove the unnecessary function with partitionSchemaOption - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 14:00:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37292) Removes outer join if it only has DISTINCT on streamed side with alias - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 14:00:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37019) Add Codegen support to array higher-order-functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 14:00:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-15428) Disable support for multiple streaming aggregations - posted by "Hongbo (Jira)" <ji...@apache.org> on 2021/11/11 14:26:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37291) PySpark SparkSession.config should respect enableHiveSupport - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 15:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37291) PySpark SparkSession.config should respect enableHiveSupport - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 15:11:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37267) OptimizeSkewInRebalancePartitions support optimize non-root node - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/11 16:08:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37293) Remove explicit GC options from Scala tests - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/11 16:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37293) Remove explicit GC options from Scala tests - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/11 16:51:00 UTC, 1 replies.
- [jira] [Closed] (SPARK-35557) Adapt uses of JDK 17 Internal APIs - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/11 16:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37293) Remove explicit GC options from Scala tests - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 16:59:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37293) Remove explicit GC options from Scala tests - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 16:59:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-33772) Build and Run Spark on Java 17 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/11 17:01:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-33772) Build and Run Spark on Java 17 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/11 17:02:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-37265) Support Java 17 in `dev/test-dependencies.sh` - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/11 17:02:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-33772) Build and Run Spark on Java 17 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/11 17:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37294) Check inserting of ANSI intervals into a table partitioned by the interval columns - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/11 19:04:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37294) Check inserting of ANSI intervals into a table partitioned by the interval columns - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 19:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37294) Check inserting of ANSI intervals into a table partitioned by the interval columns - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/11 19:15:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37120) Add Daily GitHub Action jobs for Java11/17 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/11 20:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37295) illegal reflective access operation has occurred; Please consider reporting this to the maintainers - posted by "Andrew Davidson (Jira)" <ji...@apache.org> on 2021/11/11 21:29:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37284) Upgrade Jekyll to 4.2.1 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/11 23:09:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-36845) Inline type hint files for files in python/pyspark/sql - posted by "Takuya Ueshin (Jira)" <ji...@apache.org> on 2021/11/11 23:41:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-35011) Avoid Block Manager registerations when StopExecutor msg is in-flight. - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/12 00:20:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-35011) Avoid Block Manager registerations when StopExecutor msg is in-flight. - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/12 00:20:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37268) Remove unused method call in FileScanRDD - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/12 00:27:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37268) Remove unused method call in FileScanRDD - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/12 00:28:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37263) Add PandasAPIOnSparkAdviceWarning class - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/12 01:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37296) Add missing type hints in python/pyspark/util.py - posted by "Takuya Ueshin (Jira)" <ji...@apache.org> on 2021/11/12 01:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37287) Pull out dynamic partition and bucket sort from FileFormatWriter - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2021/11/12 01:16:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37296) Add missing type hints in python/pyspark/util.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/12 02:01:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37296) Add missing type hints in python/pyspark/util.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/12 02:01:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37293) Remove explicit GC options from Scala tests - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/12 02:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37297) Capture SQL statement executed at source in spark debug log - posted by "Sivakumar Ramaswamy (Jira)" <ji...@apache.org> on 2021/11/12 03:18:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37296) Add missing type hints in python/pyspark/util.py - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/12 03:46:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-15428) Disable support for multiple streaming aggregations - posted by "Hongbo (Jira)" <ji...@apache.org> on 2021/11/12 03:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-36825) Read/write dataframes with ANSI intervals from/to parquet files - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/12 05:06:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37292) Removes outer join if it only has DISTINCT on streamed side with alias - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/12 05:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37298) Use unique exprId in RewriteAsOfJoin - posted by "Allison Wang (Jira)" <ji...@apache.org> on 2021/11/12 06:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37299) Fix Python linter failure in branch-3.1 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/11/12 06:21:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37298) Use unique exprId in RewriteAsOfJoin - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/12 06:23:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37298) Use unique exprId in RewriteAsOfJoin - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/12 06:23:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37300) TaskSchedulerImpl should ignore task finished event if its task was already finished state - posted by "hujiahua (Jira)" <ji...@apache.org> on 2021/11/12 07:19:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37300) TaskSchedulerImpl should ignore task finished event if its task was already finished state - posted by "hujiahua (Jira)" <ji...@apache.org> on 2021/11/12 07:24:00 UTC, 5 replies.
- [jira] [Created] (SPARK-37301) ConcurrentModificationException caused by CollectionAccumulator serialization in the heartbeat thread - posted by "mcdull_zhang (Jira)" <ji...@apache.org> on 2021/11/12 08:00:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37301) ConcurrentModificationException caused by CollectionAccumulator serialization in the heartbeat thread - posted by "mcdull_zhang (Jira)" <ji...@apache.org> on 2021/11/12 08:01:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37287) Pull out dynamic partition and bucket sort from FileFormatWriter - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/12 08:02:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37287) Pull out dynamic partition and bucket sort from FileFormatWriter - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/12 08:02:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37301) ConcurrentModificationException caused by CollectionAccumulator serialization in the heartbeat thread - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/12 08:11:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37301) ConcurrentModificationException caused by CollectionAccumulator serialization in the heartbeat thread - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/12 08:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37295) illegal reflective access operation has occurred; Please consider reporting this to the maintainers - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2021/11/12 08:21:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37294) Check inserting of ANSI intervals into a table partitioned by the interval columns - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/12 08:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37302) Explicitly download the dependencies of guava and jetty-io in test-dependencies.sh - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/12 10:20:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37302) Explicitly download the dependencies of guava and jetty-io in test-dependencies.sh - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/12 10:46:00 UTC, 3 replies.
- [jira] [Created] (SPARK-37303) ALTER TABLE .. REPLACE COLUMNS works incorrectly for v2 tables in tests - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/12 10:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37304) Check replacing columns with ANSI intervals - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/12 10:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37302) Explicitly download the dependencies of guava and jetty-io in test-dependencies.sh - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/12 11:10:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37302) Explicitly download the dependencies of guava and jetty-io in test-dependencies.sh - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/12 11:10:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37304) Check replacing columns with ANSI intervals - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/12 11:19:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37304) Check replacing columns with ANSI intervals - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/12 11:19:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37305) Spark Dynamic Resource Allocation in Standalone Mode - posted by "Fernando (Jira)" <ji...@apache.org> on 2021/11/12 11:38:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37306) Unify v1 and v2 ALTER TABLE .. REPLACE COLUMNS tests - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/12 14:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37306) Unify v1 and v2 ALTER TABLE .. REPLACE COLUMNS tests - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/12 14:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37306) Unify v1 and v2 ALTER TABLE .. REPLACE COLUMNS tests - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/12 14:19:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37304) Check replacing columns with ANSI intervals - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/12 14:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37202) Temp view didn't collect temp function that registered with catalog API - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/12 14:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37307) Don't obtain JDBC connection for empty partition - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/11/12 14:49:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37266) View text can only be SELECT queries - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/11/12 16:07:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37308) Flaky Test: DDLParserSuite.create view -- basic - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/12 18:35:00 UTC, 4 replies.
- [jira] [Created] (SPARK-37308) Flaky Test: DDLParserSuite.create view -- basic - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/12 18:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37308) Flaky Test: DDLParserSuite.create view -- basic - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/12 18:59:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37139) Inline type hints for python/pyspark/taskcontext.py and python/pyspark/version.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/12 19:08:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37302) Explicitly download the dependencies of guava and jetty-io in test-dependencies.sh - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/12 19:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37309) Add available_now to PySpark trigger function - posted by "Lennox Stevenson (Jira)" <ji...@apache.org> on 2021/11/12 20:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25642) Add new Metrics in External Shuffle Service to help determine Network performance and Connection Handling capabilities of the Shuffle Service - posted by "Yongjun Zhang (Jira)" <ji...@apache.org> on 2021/11/12 20:31:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37311) Migrate ALTER NAMESPACE ... SET LOCATION to use v2 command by default - posted by "Terry Kim (Jira)" <ji...@apache.org> on 2021/11/12 20:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37310) Migrate ALTER NAMESPACE ... SET PROPERTIES to use v2 command by default - posted by "Terry Kim (Jira)" <ji...@apache.org> on 2021/11/12 20:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37311) Migrate ALTER NAMESPACE ... SET LOCATION to use v2 command by default - posted by "Terry Kim (Jira)" <ji...@apache.org> on 2021/11/12 20:32:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37310) Migrate ALTER NAMESPACE ... SET PROPERTIES to use v2 command by default - posted by "Terry Kim (Jira)" <ji...@apache.org> on 2021/11/12 20:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-34332) Unify v1 and v2 ALTER TABLE .. SET LOCATION tests - posted by "Terry Kim (Jira)" <ji...@apache.org> on 2021/11/12 21:30:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37298) Use unique exprId in RewriteAsOfJoin - posted by "Takuya Ueshin (Jira)" <ji...@apache.org> on 2021/11/12 23:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37312) Add `.java-version` to `.gitignore` and `.rat-excludes` - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/13 01:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37312) Add `.java-version` to `.gitignore` and `.rat-excludes` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/13 01:28:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37312) Add `.java-version` to `.gitignore` and `.rat-excludes` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/13 01:28:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-37312) Add `.java-version` to `.gitignore` and `.rat-excludes` - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/13 01:29:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37300) TaskSchedulerImpl should ignore task finished event if its task was already finished state - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/13 02:03:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37300) TaskSchedulerImpl should ignore task finished event if its task was already finished state - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/13 02:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37313) Child stage using merged output or not should be based on the availability of merged output from parent stage - posted by "Minchu Yang (Jira)" <ji...@apache.org> on 2021/11/13 02:49:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37314) Upgrade kubernetes-client to 5.10.1 - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/13 04:14:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37314) Upgrade kubernetes-client to 5.10.1 - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/13 04:16:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37314) Upgrade kubernetes-client to 5.10.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/13 04:20:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37314) Upgrade kubernetes-client to 5.10.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/13 04:20:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37312) Add `.java-version` to `.gitignore` and `.rat-excludes` - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/13 05:45:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37307) Don't obtain JDBC connection for empty partition - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/13 07:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37307) Don't obtain JDBC connection for empty partition - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/13 07:05:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37270) Incorect result of filter using isNull condition - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/13 08:33:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37314) Upgrade kubernetes-client to 5.10.1 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/13 08:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-35352) Add code-gen for full outer sort merge join - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/11/13 09:39:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-35352) Add code-gen for full outer sort merge join - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/13 10:04:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-35352) Add code-gen for full outer sort merge join - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/13 10:04:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37315) Mitigate a ConcurrentModificationException thrown from a test in MLEventSuite - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/13 15:37:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37315) Mitigate a ConcurrentModificationException thrown from a test in MLEventSuite - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/13 15:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37315) Mitigate a ConcurrentModificationException thrown from a test in MLEventSuite - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/13 16:06:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37315) Mitigate a ConcurrentModificationException thrown from a test in MLEventSuite - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/13 16:06:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37307) Don't obtain JDBC connection for empty partition - posted by "Huaxin Gao (Jira)" <ji...@apache.org> on 2021/11/13 17:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37315) Mitigate ConcurrentModificationException thrown from a test in MLEventSuite - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/13 17:55:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37315) Mitigate ConcurrentModificationException thrown from a test in MLEventSuite - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/13 18:46:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37291) PySpark SparkSession.config should respect enableHiveSupport - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/13 23:42:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37291) PySpark init SparkSession should copy conf to sharedState - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/13 23:43:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37316) Add code-gen for existence sort merge join - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/11/14 01:21:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37316) Add code-gen for existence sort merge join - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/11/14 01:22:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37317) Reduce weights in GaussianMixtureSuite - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/14 02:25:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37317) Reduce weights in GaussianMixtureSuite - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/14 02:31:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37317) Reduce weights in GaussianMixtureSuite - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/14 02:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37318) Make FallbackStorageSuite robust in terms of DNS - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/14 03:17:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37318) Make FallbackStorageSuite robust in terms of DNS - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/14 03:22:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37318) Make FallbackStorageSuite robust in terms of DNS - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/14 03:22:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-35781) Support Spark on Apple Silicon on macOS natively - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/14 04:56:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37319) Support K8s image building with Java 17 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/14 06:03:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37319) Support K8s image building with Java 17 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/14 06:08:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-37319) Support K8s image building with Java 17 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/14 06:08:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-36876) Support Dynamic Partition pruning for HiveTableScanExec - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/14 07:17:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37320) Delete py_container_checks.zip after the test in DepsTestsSuite finishes - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/14 08:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37320) Delete py_container_checks.zip after the test in DepsTestsSuite finishes - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/14 08:54:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37318) Make FallbackStorageSuite robust in terms of DNS - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/14 09:03:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37320) Delete py_container_checks.zip after the test in DepsTestsSuite finishes - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/14 09:08:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37320) Delete py_container_checks.zip after the test in DepsTestsSuite finishes - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/14 09:08:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-36934) Timestamp are written as array bytes. - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2021/11/14 13:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37321) Wrong size estimation that leads to Cannot broadcast the table that is larger than 8GB: 8 GB - posted by "Izek Greenfield (Jira)" <ji...@apache.org> on 2021/11/14 14:35:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37321) Wrong size estimation that leads to Cannot broadcast the table that is larger than 8GB: 8 GB - posted by "Izek Greenfield (Jira)" <ji...@apache.org> on 2021/11/14 14:36:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37321) Wrong size estimation that leads to "Cannot broadcast the table that is larger than 8GB: 8 GB" - posted by "Izek Greenfield (Jira)" <ji...@apache.org> on 2021/11/14 14:37:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37321) Wrong size estimation leads to "Cannot broadcast the table that is larger than 8GB: 8 GB" - posted by "Izek Greenfield (Jira)" <ji...@apache.org> on 2021/11/14 14:38:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-32567) Code-gen for full outer shuffled hash join - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/14 15:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37317) Reduce weights in GaussianMixtureSuite - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/14 16:43:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37320) Delete py_container_checks.zip after the test in DepsTestsSuite finishes - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/14 16:46:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37317) Reduce weights in GaussianMixtureSuite - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/14 16:49:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37322) `run_scala_tests` should respect test module order - posted by "William Hyun (Jira)" <ji...@apache.org> on 2021/11/14 19:13:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37322) `run_scala_tests` should respect test module order - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/14 19:18:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37322) `run_scala_tests` should respect test module order - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/14 19:18:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37322) `run_scala_tests` should respect test module order - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/14 20:34:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37289) Refactoring:remove the unnecessary function with partitionSchemaOption - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/14 20:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37289) Refactoring:remove the unnecessary function with partitionSchemaOption - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/14 20:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37323) Pin `docutils` in branch-3.1 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/14 21:51:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37323) Pin `docutils` in branch-3.1 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/14 21:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37324) Support Decimal RoundingMode.UP, DOWN, HALF_DOWN - posted by "Sathiya Kumar (Jira)" <ji...@apache.org> on 2021/11/14 21:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37324) Support Decimal RoundingMode.UP, DOWN, HALF_DOWN - posted by "Sathiya Kumar (Jira)" <ji...@apache.org> on 2021/11/14 21:56:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37323) Pin `docutils` in branch-3.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/14 22:08:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37323) Pin `docutils` in branch-3.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/14 22:08:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37324) Support Decimal RoundingMode.UP, DOWN, HALF_DOWN - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/14 23:10:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-36533) Allow streaming queries with Trigger.Once run in multiple batches - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/14 23:10:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37324) Support Decimal RoundingMode.UP, DOWN, HALF_DOWN - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/14 23:10:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37323) Pin `docutils` in branch-3.1 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/14 23:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37228) Implement DataFrame.mapInArrow in Python - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/14 23:53:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-35345) Add BloomFilter Benchmark test for Parquet - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/15 00:10:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37319) Support K8s image building with Java 17 - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/15 00:23:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37299) Fix Python linter failure in branch-3.1 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/15 01:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37309) Add available_now to PySpark trigger function - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/15 01:13:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-37295) illegal reflective access operation has occurred; Please consider reporting this to the maintainers - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/15 01:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37295) illegal reflective access operation has occurred; Please consider reporting this to the maintainers - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/15 01:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37278) Support YearMonthIntervalType in createDataFrame/toPandas and Python UDFs - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/15 02:00:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37280) Support YearMonthIntervalType in Py4J - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/15 02:00:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37276) Support YearMonthIntervalType in Arrow - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/15 02:00:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-37309) Add available_now to PySpark trigger function - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2021/11/15 03:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37309) Add available_now to PySpark trigger function - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2021/11/15 03:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37325) Result vector from pandas_udf was not the required length - posted by "liu (Jira)" <ji...@apache.org> on 2021/11/15 03:42:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37325) Result vector from pandas_udf was not the required length - posted by "liu (Jira)" <ji...@apache.org> on 2021/11/15 03:43:00 UTC, 9 replies.
- [jira] [Created] (SPARK-37326) Support TimestampNTZ in CSV data source - posted by "Ivan Sadikov (Jira)" <ji...@apache.org> on 2021/11/15 03:45:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37327) Silence the advice log for internal usage - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/11/15 03:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37326) Support TimestampNTZ in CSV data source - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/15 04:09:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37326) Support TimestampNTZ in CSV data source - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/15 04:09:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37299) Fix Python linter failure in branch-3.1 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/11/15 04:17:00 UTC, 0 replies.
- [jira] (SPARK-37299) Fix Python linter failure in branch-3.1 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/11/15 04:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37327) Silence the to_pandas() advice log for internal usage - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/11/15 04:20:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37327) Silence the to_pandas() advice log for internal usage - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/15 05:10:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37327) Silence the to_pandas() advice log for internal usage - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/15 05:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37328) SPARK-33832 brings the bug that OptimizeSkewedJoin may not work since it was applied onn whole plan innstead of new stage plan - posted by "Lietong Liu (Jira)" <ji...@apache.org> on 2021/11/15 06:27:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37328) SPARK-33832 brings the bug that OptimizeSkewedJoin may not work since it was applied onn whole plan innstead of new stage plan - posted by "Lietong Liu (Jira)" <ji...@apache.org> on 2021/11/15 06:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37329) File system delegation tokens are leaked - posted by "Wei-Chiu Chuang (Jira)" <ji...@apache.org> on 2021/11/15 07:46:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37330) Migrate ReplaceTableStatement to v2 command - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/15 07:56:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37330) Migrate ReplaceTableStatement to v2 command - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/15 07:56:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37329) File system delegation tokens are leaked - posted by "Wei-Chiu Chuang (Jira)" <ji...@apache.org> on 2021/11/15 08:05:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-36223) TPCDSQueryTestSuite should run with different config set - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/15 08:06:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-36223) TPCDSQueryTestSuite should run with different config set - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/15 08:07:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37327) Silence the to_pandas() advice log for internal usage - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/15 08:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37331) Add the ability to creating resources before driver pod - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/11/15 08:34:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37331) Add the ability to creating resources before driver pod - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/15 09:29:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37331) Add the ability to creating resources before driver pod - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/15 09:29:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37283) Don't try to store a V1 table which contains ANSI intervals in Hive compatible format - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/15 10:01:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37332) Check adding of ANSI interval columns - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/15 10:17:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37332) Check adding of ANSI interval columns to v1/v2 tables - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/15 10:18:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37332) Check adding of ANSI interval columns to v1/v2 tables - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/15 10:19:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37181) pyspark.pandas.read_csv() should support latin-1 encoding - posted by "pralabhkumar (Jira)" <ji...@apache.org> on 2021/11/15 10:32:00 UTC, 5 replies.
- [jira] [Comment Edited] (SPARK-37181) pyspark.pandas.read_csv() should support latin-1 encoding - posted by "pralabhkumar (Jira)" <ji...@apache.org> on 2021/11/15 10:33:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-37332) Check adding of ANSI interval columns to v1/v2 tables - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/15 11:11:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-35352) Add code-gen for full outer sort merge join - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/15 11:36:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37316) Add code-gen for existence sort merge join - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/15 12:20:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-37328) SPARK-33832 brings the bug that OptimizeSkewedJoin may not work since it was applied on whole plan innstead of new stage plan - posted by "Lietong Liu (Jira)" <ji...@apache.org> on 2021/11/15 12:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37333) Specify the required distribution at V1Write - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2021/11/15 12:33:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37328) SPARK-33832 brings the bug that OptimizeSkewedJoin may not work since it was applied on whole plan innstead of new stage plan - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/15 12:37:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37328) SPARK-33832 brings the bug that OptimizeSkewedJoin may not work since it was applied on whole plan innstead of new stage plan - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/15 12:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37334) pandas `convert_dtypes` method support - posted by "Ali Amin-Nejad (Jira)" <ji...@apache.org> on 2021/11/15 13:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37266) View text can only be SELECT queries - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/15 14:50:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-37329) File system delegation tokens are leaked - posted by "Wei-Chiu Chuang (Jira)" <ji...@apache.org> on 2021/11/15 14:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37329) File system delegation tokens are leaked - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/15 15:13:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37335) Clarify output of FPGrowth - posted by "Nicholas Chammas (Jira)" <ji...@apache.org> on 2021/11/15 17:05:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37335) Clarify output of FPGrowth - posted by "Nicholas Chammas (Jira)" <ji...@apache.org> on 2021/11/15 17:06:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37335) Clarify output of FPGrowth - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/15 17:16:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37335) Clarify output of FPGrowth - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/15 17:16:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37336) Migrate common ML utils to SparkSession - posted by "Nicholas Chammas (Jira)" <ji...@apache.org> on 2021/11/15 17:19:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37336) Migrate _java2py to SparkSession - posted by "Nicholas Chammas (Jira)" <ji...@apache.org> on 2021/11/15 17:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37336) Migrate _java2py to SparkSession - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/15 17:33:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37336) Migrate _java2py to SparkSession - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/15 17:33:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37337) Improve the API of Spark DataFrame to pandas-on-Spark DataFrame conversion - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/11/15 19:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37338) Rename to_pandas_on_spark to pandas_api - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/11/15 19:48:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37338) Rename (Spark)DataFrame.to_pandas_on_spark to (Spark)DataFrame.pandas_api - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/11/15 19:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37338) Rename to_pandas_on_spark to pandas_api - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/11/15 19:50:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37338) Rename (Spark)DataFrame.to_pandas_on_spark to (Spark)DataFrame.pandas_api - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/15 20:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37338) Rename (Spark)DataFrame.to_pandas_on_spark to (Spark)DataFrame.pandas_api - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/15 20:12:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37339) Add `spark-version` label to driver and executor pods - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/15 20:18:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37339) Add `spark-version` label to driver and executor pods - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/15 20:22:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37339) Add `spark-version` label to driver and executor pods - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/15 20:22:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-34332) Unify v1 and v2 ALTER TABLE .. SET LOCATION tests - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/15 20:41:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-35867) Enable vectorized read for VectorizedPlainValuesReader.readBooleans - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/15 22:16:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37339) Add `spark-version` label to driver and executor pods - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/15 22:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37340) Display StageIds in Operators for SQL UI - posted by "Yian Liou (Jira)" <ji...@apache.org> on 2021/11/15 22:46:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37340) Display StageIds in Operators for SQL UI - posted by "Yian Liou (Jira)" <ji...@apache.org> on 2021/11/15 22:47:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-31646) Remove unused registeredConnections counter from ShuffleMetrics - posted by "Yongjun Zhang (Jira)" <ji...@apache.org> on 2021/11/15 23:14:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-31646) Remove unused registeredConnections counter from ShuffleMetrics - posted by "Yongjun Zhang (Jira)" <ji...@apache.org> on 2021/11/15 23:18:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37341) Avoid unnecessary buffer and copy in full outer sort merge join - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/11/16 00:03:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37341) Avoid unnecessary buffer and copy in full outer sort merge join - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/16 00:13:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37341) Avoid unnecessary buffer and copy in full outer sort merge join - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/16 00:13:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37342) Upgrade Apache Arrow to 6.0.0 - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/11/16 00:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37342) Upgrade Apache Arrow to 6.0.0 - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/11/16 00:21:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37342) Upgrade Apache Arrow to 6.0.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/16 00:24:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37342) Upgrade Apache Arrow to 6.0.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/16 00:24:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37335) Clarify output of FPGrowth - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/11/16 00:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37343) Implement createIndex and IndexExists in JDBC (Postgres dialect) - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/16 01:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37343) Implement createIndex and IndexExists in JDBC (Postgres dialect) - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/16 01:13:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37344) split function behave differently between spark 2.3 and spark 3.2 - posted by "ocean (Jira)" <ji...@apache.org> on 2021/11/16 02:01:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37344) split function behave differently between spark 2.3 and spark 3.2 - posted by "ocean (Jira)" <ji...@apache.org> on 2021/11/16 02:04:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37344) split function behave differently between spark 2.3 and spark 3.2 - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/11/16 02:18:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-37344) split function behave differently between spark 2.3 and spark 3.2 - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/11/16 02:52:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37338) Rename (Spark)DataFrame.to_pandas_on_spark to (Spark)DataFrame.pandas_api - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/11/16 03:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37337) Improve the API of Spark DataFrame to pandas-on-Spark DataFrame conversion - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/11/16 03:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37337) Improve the API of Spark DataFrame to pandas-on-Spark DataFrame conversion - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/16 03:12:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37337) Improve the API of Spark DataFrame to pandas-on-Spark DataFrame conversion - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/16 03:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37277) Support DayTimeIntervalType in Arrow - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/16 03:49:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-37277) Support DayTimeIntervalType in Arrow - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/16 03:49:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37332) Check adding of ANSI interval columns to v1/v2 tables - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/16 07:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data - posted by "Wei Zhang (Jira)" <ji...@apache.org> on 2021/11/16 09:19:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37345) Add java.security.jgss/sun.security.krb5 to DEFAULT_MODULE_OPTIONS - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2021/11/16 10:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37345) Add java.security.jgss/sun.security.krb5 to DEFAULT_MODULE_OPTIONS - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/16 10:16:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37345) Add java.security.jgss/sun.security.krb5 to DEFAULT_MODULE_OPTIONS - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/16 10:16:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37344) split function behave differently between spark 2.3 and spark 3.2 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/16 10:41:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37346) Link migration guide to each project. - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/11/16 11:09:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37346) Link migration guide to each project. - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/11/16 11:09:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37347) Spark Thrift Server (STS) driver fullFC becourse of timeoutExecutor not shutdown correctly - posted by "liukai (Jira)" <ji...@apache.org> on 2021/11/16 11:33:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-37209) YarnShuffleIntegrationSuite and other two similar cases in `resource-managers` test failed - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2021/11/16 12:11:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37209) YarnShuffleIntegrationSuite and other two similar cases in `resource-managers` test failed - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2021/11/16 12:11:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37347) Spark Thrift Server (STS) driver fullFC becourse of timeoutExecutor not shutdown correctly - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2021/11/16 12:28:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37347) Spark Thrift Server (STS) driver fullFC becourse of timeoutExecutor not shutdown correctly - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/16 12:28:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37347) Spark Thrift Server (STS) driver fullFC becourse of timeoutExecutor not shutdown correctly - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/16 12:28:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37342) Upgrade Apache Arrow to 6.0.0 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/16 12:57:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data - posted by "Wei Zhang (Jira)" <ji...@apache.org> on 2021/11/16 13:17:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37346) Link migration guide for structured stream. - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/11/16 14:42:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37346) Link migration guide for struct stream. - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/11/16 14:42:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37346) Link migration guide for structured stream. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/16 14:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37346) Link migration guide for structured stream. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/16 14:45:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37219) support AS OF syntax - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/16 15:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37209) YarnShuffleIntegrationSuite and other two similar cases in `resource-managers` test failed - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/16 15:16:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37181) pyspark.pandas.read_csv() should support latin-1 encoding - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/16 15:16:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37348) PySpark pmod function - posted by "Tim Schwab (Jira)" <ji...@apache.org> on 2021/11/16 16:15:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37348) PySpark pmod function - posted by "Tim Schwab (Jira)" <ji...@apache.org> on 2021/11/16 16:16:00 UTC, 4 replies.
- [jira] [Updated] (SPARK-37348) PySpark pmod function - posted by "Tim Schwab (Jira)" <ji...@apache.org> on 2021/11/16 16:21:00 UTC, 4 replies.
- [jira] [Resolved] (SPARK-35672) Spark fails to launch executors with very large user classpath lists on YARN - posted by "Attila Zsolt Piros (Jira)" <ji...@apache.org> on 2021/11/16 17:10:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37340) Display StageIds in Operators for SQL UI - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/16 19:48:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37349) Improve SQL Rest API Parsing - posted by "Yian Liou (Jira)" <ji...@apache.org> on 2021/11/17 01:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37349) Improve SQL Rest API Parsing - posted by "Yian Liou (Jira)" <ji...@apache.org> on 2021/11/17 01:24:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37345) Add java.security.jgss/sun.security.krb5 to DEFAULT_MODULE_OPTIONS - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2021/11/17 01:39:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-36231) Support arithmetic operations of Series containing Decimal(np.nan) - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/17 02:06:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-36000) Support creation and operations of ps.Series/Index with Decimal('NaN') - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/17 02:06:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-36000) Support creation and operations of ps.Series/Index with Decimal('NaN') - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/17 02:06:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-36231) Support arithmetic operations of Series containing Decimal(np.nan) - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/17 02:06:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-28242) DataStreamer keeps logging errors even after fixing writeStream output sink - posted by "Shefron Yudy (Jira)" <ji...@apache.org> on 2021/11/17 02:36:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37341) Avoid unnecessary buffer and copy in full outer sort merge join - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/17 02:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-35345) Add BloomFilter Benchmark test for Parquet - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/17 02:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-35345) Add BloomFilter Benchmark test for Parquet - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/17 02:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37350) EventLoggingListener keep logging errors after hdfs restart all datanodes - posted by "Shefron Yudy (Jira)" <ji...@apache.org> on 2021/11/17 03:11:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37350) EventLoggingListener keep logging errors after hdfs restart all datanodes - posted by "Shefron Yudy (Jira)" <ji...@apache.org> on 2021/11/17 03:12:00 UTC, 4 replies.
- [jira] [Created] (SPARK-37351) Supports write data flow control - posted by "melin (Jira)" <ji...@apache.org> on 2021/11/17 03:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37230) Document DataFrame.mapInArrow - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/17 04:30:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37230) Document DataFrame.mapInArrow - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/17 04:30:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37350) EventLoggingListener keep logging errors after hdfs restart all datanodes - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/17 04:38:00 UTC, 3 replies.
- [jira] [Updated] (SPARK-37334) pandas `convert_dtypes` method support - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/17 04:38:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37325) Result vector from pandas_udf was not the required length - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/17 04:40:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37325) Result vector from pandas_udf was not the required length - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/17 04:41:00 UTC, 1 replies.
- [jira] (SPARK-37277) Support DayTimeIntervalType in Arrow - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/17 05:07:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-37277) Support DayTimeIntervalType in Arrow - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/17 05:07:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37277) Support DayTimeIntervalType in Arrow - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/17 05:07:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37281) Support DayTimeIntervalType in Py4J - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/17 05:15:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37281) Support DayTimeIntervalType in Py4J - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/17 05:15:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37279) Support DayTimeIntervalType in createDataFrame/toPandas and Python UDFs - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/17 05:16:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37279) Support DayTimeIntervalType in createDataFrame/toPandas and Python UDFs - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/17 05:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37352) Silence the `index_col` advice in `to_spark()` for internal usage - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/11/17 05:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37352) Silence the `index_col` advice in `to_spark()` for internal usage - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/11/17 05:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37352) Silence the `index_col` advice in `to_spark()` for internal usage - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/17 06:17:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37352) Silence the `index_col` advice in `to_spark()` for internal usage - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/17 06:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37353) Resolved attribute(s) region_id#7993 missing from lm_tam_code#2666,ld_month#2697,geo_sub_district_id#2677 when doing left join - posted by "Anubhav Tarar (Jira)" <ji...@apache.org> on 2021/11/17 06:43:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-37325) Result vector from pandas_udf was not the required length - posted by "liu (Jira)" <ji...@apache.org> on 2021/11/17 07:15:00 UTC, 3 replies.
- [jira] [Created] (SPARK-37354) Make the Java version installed on the container image used by the K8s integration tests with SBT configurable - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/17 08:01:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37354) Make the Java version installed on the container image used by the K8s integration tests with SBT configurable - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/17 08:21:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37354) Make the Java version installed on the container image used by the K8s integration tests with SBT configurable - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/17 08:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37355) Avoid Block Manager registrations when Executor is shutting down - posted by "Wan Kun (Jira)" <ji...@apache.org> on 2021/11/17 08:53:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37355) Avoid Block Manager registrations when Executor is shutting down - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/17 09:17:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37355) Avoid Block Manager registrations when Executor is shutting down - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/17 09:17:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37352) Silence the `index_col` advice in `to_spark()` for internal usage - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/17 09:32:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37356) Add fine grained locking to BlockInfoManager - posted by "Herman van Hövell (Jira)" <ji...@apache.org> on 2021/11/17 12:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37356) Add fine grained locking to BlockInfoManager - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/17 13:21:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37195) Unify v1 and v2 SHOW TBLPROPERTIES tests - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/17 13:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37357) Add merged last partition factor for rebalance - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2021/11/17 13:47:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37316) Add code-gen for existence sort merge join - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/17 13:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37181) pyspark.pandas.read_csv() should support latin-1 encoding - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/17 14:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37357) Add merged last partition factor for rebalance - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2021/11/17 14:32:00 UTC, 5 replies.
- [jira] [Updated] (SPARK-37357) Add merged last partition factor for split skew partition - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2021/11/17 14:34:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37357) Add merged last partition factor for rebalance - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/17 14:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37357) Add merged last partition factor for rebalance - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/17 14:48:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-36924) CAST between ANSI intervals and numerics - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/17 14:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37358) Spark-on-K8S: Allow disabling of resources.limits.memory in executor pod spec - posted by "Andrew de Quincey (Jira)" <ji...@apache.org> on 2021/11/17 16:43:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37358) Spark-on-K8S: Allow disabling of resources.limits.memory in executor pod spec - posted by "Andrew de Quincey (Jira)" <ji...@apache.org> on 2021/11/17 16:54:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37205) Support mapreduce.job.send-token-conf when starting containers in YARN - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/17 17:32:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37205) Support mapreduce.job.send-token-conf when starting containers in YARN - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/17 17:32:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37359) Spark K8s decom test looks for a non longer current string - posted by "Holden Karau (Jira)" <ji...@apache.org> on 2021/11/17 20:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37359) Spark K8s decom test looks for a non longer current string - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/17 20:53:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37359) Spark K8s decom test looks for a non longer current string - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/17 20:53:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37359) Spark K8s tests are broken - posted by "Holden Karau (Jira)" <ji...@apache.org> on 2021/11/17 20:55:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37279) Support DayTimeIntervalType in createDataFrame/toPandas and Python UDFs - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/18 00:03:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37349) Improve SQL Rest API Parsing - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 00:29:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37230) Document DataFrame.mapInArrow - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/18 01:02:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-36646) Push down group by partition column for Aggregate (Min/Max/Count) for Parquet - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/11/18 01:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-36646) Push down group by partition column for Aggregate (Min/Max/Count) for Parquet - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/11/18 01:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37360) Support TimestampNTZ in JSON data source - posted by "Ivan Sadikov (Jira)" <ji...@apache.org> on 2021/11/18 02:06:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37361) Introduce Z-order for efficient data skipping - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/11/18 02:07:00 UTC, 3 replies.
- [jira] [Created] (SPARK-37361) Introduce Z-order for efficient data skipping - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/11/18 02:07:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-31585) Support Z-order curve expression - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/11/18 02:08:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37362) Support float type in Z-order expression - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/11/18 02:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37353) Resolved attribute(s) region_id#7993 missing from lm_tam_code#2666,ld_month#2697,geo_sub_district_id#2677 when doing left join - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/18 02:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37363) Support string type in Z-order expression - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/11/18 02:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37364) Add code-gen evaluation for Z-order expression - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/11/18 02:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37365) Add ZORDER BY syntax and plan rule - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/11/18 02:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37361) Introduce Z-order for efficient data skipping - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/11/18 02:15:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37360) Support TimestampNTZ in JSON data source - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 02:21:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37360) Support TimestampNTZ in JSON data source - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 02:21:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37308) Flaky Test: DDLParserSuite.create view -- basic - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 02:21:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-31585) Support Z-order curve expression - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 02:30:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-31585) Support Z-order curve expression - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 02:30:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37366) Add benchmark for Z-order - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/11/18 02:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37367) Reeable exception test in DDLParserSuite.create view -- basic - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/18 02:40:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37367) Reeable exception test in DDLParserSuite.create view -- basic - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/18 02:40:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37367) Reenable exception test in DDLParserSuite.create view -- basic - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/18 02:42:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37368) Deflake TPC-DS build - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/18 02:46:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-36346) Support TimestampNTZ type in Orc file source - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/11/18 02:47:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-36346) Support TimestampNTZ type in Orc file source - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/11/18 02:47:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37368) Deflake TPC-DS build - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 02:52:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37368) Deflake TPC-DS build - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 02:52:00 UTC, 1 replies.
- [jira] (SPARK-36346) Support TimestampNTZ type in Orc file source - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/11/18 02:52:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37308) Flaky Test: DDLParserSuite.create view -- basic - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/18 04:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37369) Avoid redundant ColumnarToRow transistion on InMemoryTableScan - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/11/18 04:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37369) Avoid redundant ColumnarToRow transistion on InMemoryTableScan - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 04:55:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37369) Avoid redundant ColumnarToRow transistion on InMemoryTableScan - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 04:56:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37281) Support DayTimeIntervalType in Py4J - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/18 05:38:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37368) Deflake TPC-DS build - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/18 05:38:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37224) Optimize write path on RocksDB state store provider - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2021/11/18 06:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37370) Add SQL configs to control newly added join code-gen in 3.3 - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/11/18 07:03:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37370) Add SQL configs to control newly added join code-gen in 3.3 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 07:19:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37370) Add SQL configs to control newly added join code-gen in 3.3 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 07:19:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-36357) Support pushdown Timestamp with local time zone for orc - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/11/18 07:24:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-36357) Support pushdown Timestamp with local time zone for orc - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 07:27:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-36357) Support pushdown Timestamp with local time zone for orc - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 07:27:00 UTC, 0 replies.
- [jira] (SPARK-36357) Support pushdown Timestamp with local time zone for orc - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/11/18 07:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37371) UnionExec should support columnar if all children support columnar - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/11/18 08:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37371) UnionExec should support columnar if all children support columnar - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 09:00:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37371) UnionExec should support columnar if all children support columnar - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 09:00:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37275) Support ANSI intervals in PySpark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/18 09:17:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37155) Inline type hints for python/pyspark/statcounter.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/18 11:27:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37155) Inline type hints for python/pyspark/statcounter.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/18 11:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37372) Remove redundant Pod label editition - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/11/18 12:34:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37357) Create skew partition specs should respect min partition size - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2021/11/18 12:48:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37372) Remove redundant Pod label editition - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 12:57:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37372) Remove redundant Pod label editition - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 12:57:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-36180) Support TimestampNTZ type in Hive - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/11/18 13:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-36180) Support TimestampNTZ type in Hive - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 13:29:00 UTC, 0 replies.
- [jira] (SPARK-37189) pyspark.pandas histogram accepts the range option but does not use it - posted by "pralabhkumar (Jira)" <ji...@apache.org> on 2021/11/18 14:53:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37188) pyspark.pandas histogram accepts the title option but does not add a title to the plot - posted by "pralabhkumar (Jira)" <ji...@apache.org> on 2021/11/18 14:55:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-37188) pyspark.pandas histogram accepts the title option but does not add a title to the plot - posted by "pralabhkumar (Jira)" <ji...@apache.org> on 2021/11/18 14:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-35672) Spark fails to launch executors with very large user classpath lists on YARN - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 16:59:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37373) Collect LocalSparkContext worker logs in case of test failure - posted by "Attila Zsolt Piros (Jira)" <ji...@apache.org> on 2021/11/18 17:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-36664) Log time spent waiting for cluster resources - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 17:48:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-36664) Log time spent waiting for cluster resources - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 17:48:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37373) Collect LocalSparkContext worker logs in case of test failure - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 18:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37373) Collect LocalSparkContext worker logs in case of test failure - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 18:20:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37373) Collect LocalSparkContext worker logs in case of test failure - posted by "Attila Zsolt Piros (Jira)" <ji...@apache.org> on 2021/11/18 18:38:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37356) Add fine grained locking to BlockInfoManager - posted by "Herman van Hövell (Jira)" <ji...@apache.org> on 2021/11/18 21:24:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37374) StatCounter should use mergeStats when merging with self. - posted by "Takuya Ueshin (Jira)" <ji...@apache.org> on 2021/11/18 22:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37374) StatCounter should use mergeStats when merging with self. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 22:21:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37374) StatCounter should use mergeStats when merging with self. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/18 22:21:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37166) SPIP: Storage Partitioned Join - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/11/18 23:09:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37375) Umbrella: Storage Partitioned Join - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/11/18 23:11:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37166) SPIP: Storage Partitioned Join - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/11/18 23:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37376) Introduce a new DataSource V2 interface HasPartitionKey - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/11/18 23:38:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37377) Refactor V2 Partitioning interface and remove deprecated usage of Distribution - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/11/18 23:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37378) Convert V2 Transform expressions into catalyst expressions and load their associated functions from V2 FunctionCatalog - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/11/18 23:50:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37379) Add tree pattern pruning to CTESubstitution rule - posted by "Josh Rosen (Jira)" <ji...@apache.org> on 2021/11/19 00:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37380) Miscellaneous Python lint infra cleanup - posted by "Nicholas Chammas (Jira)" <ji...@apache.org> on 2021/11/19 00:18:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37380) Miscellaneous Python lint infra cleanup - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 00:27:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37380) Miscellaneous Python lint infra cleanup - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 00:27:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37376) Introduce a new DataSource V2 interface HasPartitionKey - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 00:59:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37376) Introduce a new DataSource V2 interface HasPartitionKey - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 00:59:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37381) Unify v1 and v2 SHOW CREATE TABLE tests - posted by "PengLei (Jira)" <ji...@apache.org> on 2021/11/19 01:28:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37379) Add tree pattern pruning to CTESubstitution rule - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 01:36:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37336) Migrate _java2py to SparkSession - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/19 01:44:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37270) Incorect result of filter using isNull condition - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2021/11/19 01:46:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37374) StatCounter should use mergeStats when merging with self. - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/19 02:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-34863) Support nested column in Spark Parquet vectorized readers - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 02:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37382) `with as` clause got inconsistent results - posted by "caican (Jira)" <ji...@apache.org> on 2021/11/19 03:13:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37371) UnionExec should support columnar if all children support columnar - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/11/19 03:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37371) UnionExec should support columnar if all children support columnar - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/11/19 03:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37382) `with as` clause got inconsistent results - posted by "caican (Jira)" <ji...@apache.org> on 2021/11/19 03:21:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-37038) Sample push down in DS v2 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 04:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37383) Prints the parsing time for each phase of a SQL - posted by "caican (Jira)" <ji...@apache.org> on 2021/11/19 04:37:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37370) Add SQL configs to control newly added join code-gen in 3.3 - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/19 04:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37384) Flay test: HealthTrackerIntegrationSuite.If preferred node is bad, without excludeOnFailure job will fail - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/19 04:41:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37384) Flay test: HealthTrackerIntegrationSuite.If preferred node is bad, without excludeOnFailure job will fail - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 04:44:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37384) Flay test: HealthTrackerIntegrationSuite.If preferred node is bad, without excludeOnFailure job will fail - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 04:44:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37385) Add tests for TimestampNTZ and TimestampLTZ for Parquet data source - posted by "Ivan Sadikov (Jira)" <ji...@apache.org> on 2021/11/19 04:49:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37386) simplify OptimizeSkewedJoin to not run the cost evaluator - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/19 04:57:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37386) simplify OptimizeSkewedJoin to not run the cost evaluator - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 05:00:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-37383) Print the parsing time for each phase of a SQL - posted by "caican (Jira)" <ji...@apache.org> on 2021/11/19 05:03:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37385) Add tests for TimestampNTZ and TimestampLTZ for Parquet data source - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 05:21:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37385) Add tests for TimestampNTZ and TimestampLTZ for Parquet data source - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 05:22:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37384) Flay test: HealthTrackerIntegrationSuite.If preferred node is bad, without excludeOnFailure job will fail - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/19 06:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37387) Allow nondeterministic expression in aggregate function - posted by "Leona Yoda (Jira)" <ji...@apache.org> on 2021/11/19 07:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37383) Print the parsing time for each phase of a SQL - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 07:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37383) Print the parsing time for each phase of a SQL - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 07:07:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37387) Allow nondeterministic expression in aggregate function - posted by "Leona Yoda (Jira)" <ji...@apache.org> on 2021/11/19 07:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37387) Allow nondeterministic expression in aggregate function - posted by "Leona Yoda (Jira)" <ji...@apache.org> on 2021/11/19 07:15:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37386) simplify OptimizeSkewedJoin to not run the cost evaluator - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/19 07:28:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37382) `with as` clause got inconsistent results - posted by "jiasheng55 (Jira)" <ji...@apache.org> on 2021/11/19 08:00:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-37382) `with as` clause got inconsistent results - posted by "jiasheng55 (Jira)" <ji...@apache.org> on 2021/11/19 08:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37192) Migrate SHOW TBLPROPERTIES to use V2 command by default - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 09:00:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-36902) Migrate CreateTableAsSelectStatement to v2 command - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 09:29:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37388) WidthBucket throws NullPointerException in WholeStageCodegenExec - posted by "Tom van Bussel (Jira)" <ji...@apache.org> on 2021/11/19 12:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37389) Check unclosed bracketed comments - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/11/19 13:31:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37389) Check unclosed bracketed comments - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 13:45:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37389) Check unclosed bracketed comments - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 13:45:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37390) Buggy method retrival in pyspark.docs.conf.setup - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/19 14:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37390) Buggy method retrival in pyspark.docs.conf.setup - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 14:23:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37390) Buggy method retrival in pyspark.docs.conf.setup - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 14:23:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37388) WidthBucket throws NullPointerException in WholeStageCodegenExec - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 14:53:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37388) WidthBucket throws NullPointerException in WholeStageCodegenExec - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 14:53:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37259) JDBC read is always going to wrap the query in a select statement - posted by "Peter Toth (Jira)" <ji...@apache.org> on 2021/11/19 15:57:00 UTC, 6 replies.
- [jira] [Resolved] (SPARK-37385) Add tests for TimestampNTZ and TimestampLTZ for Parquet data source - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/19 16:09:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37349) Improve SQL Rest API Parsing - posted by "Yian Liou (Jira)" <ji...@apache.org> on 2021/11/19 19:28:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-34497 - posted by "Danny Guinther (Jira)" <ji...@apache.org> on 2021/11/19 19:28:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-34497 - posted by "Danny Guinther (Jira)" <ji...@apache.org> on 2021/11/19 19:29:00 UTC, 3 replies.
- [jira] [Created] (SPARK-37392) Catalyst optimizer very time-consuming and memory-intensive with some "explode(array)" - posted by "Francois MARTIN (Jira)" <ji...@apache.org> on 2021/11/19 19:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37392) Catalyst optimizer very time-consuming and memory-intensive with some "explode(array)" - posted by "Francois MARTIN (Jira)" <ji...@apache.org> on 2021/11/19 20:02:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37393) Inline annotations for {ml, mllib}/common.py - posted by "Nicholas Chammas (Jira)" <ji...@apache.org> on 2021/11/19 21:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37393) Inline annotations for {ml, mllib}/common.py - posted by "Nicholas Chammas (Jira)" <ji...@apache.org> on 2021/11/19 21:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-36997) Test type hints against examples - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/19 21:44:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-36997) Test type hints against examples - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/19 21:44:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37393) Inline annotations for {ml, mllib}/common.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 21:59:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37393) Inline annotations for {ml, mllib}/common.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 21:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37394) Skip registering to ESS if a customized shuffle manager is configured - posted by "Weiwei Yang (Jira)" <ji...@apache.org> on 2021/11/19 23:03:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37394) Skip registering to ESS if a customized shuffle manager is configured - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 23:08:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-36900) "SPARK-36464: size returns correct positive number even with over 2GB data" will oom with JDK17 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/19 23:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37394) Skip registering to ESS if a customized shuffle manager is configured - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/19 23:08:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37394) Skip registering with ESS if a customized shuffle manager is configured - posted by "Weiwei Yang (Jira)" <ji...@apache.org> on 2021/11/19 23:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37379) Add tree pattern pruning to CTESubstitution rule - posted by "Josh Rosen (Jira)" <ji...@apache.org> on 2021/11/19 23:26:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37343) Implement createIndex and IndexExists in JDBC (Postgres dialect) - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/20 05:24:00 UTC, 1 replies.
- [jira] (SPARK-28880) ANSI SQL: Nested bracketed comments - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/11/20 08:44:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37395) Inline type hint files for files in python/pyspark/sql - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 09:45:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37395) Inline type hint files for files in python/pyspark/ml - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 09:47:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37396) Inline type hint files for files in python/pyspark/mllib - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 09:48:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37397) Inline type hints for python/pyspark/ml/base.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 09:54:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37398) Inline type hints for python/pyspark/ml/classification.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 09:55:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37399) Inline type hints for python/pyspark/ml/common.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 09:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37400) Inline type hints for python/pyspark/ml/classification.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:04:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37401) Inline type hints for python/pyspark/ml/clustering.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:06:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37400) Inline type hints for python/pyspark/mllib/classification.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:11:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37402) Inline type hints for python/pyspark/mllib/clustering.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37403) Inline type hints for python/pyspark/mllib/common.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37404) Inline type hints for python/pyspark/ml/evaluation.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37399) Inline type hints for python/pyspark/ml/common.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/20 10:26:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37399) Inline type hints for python/pyspark/ml/common.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/20 10:26:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37403) Inline type hints for python/pyspark/mllib/common.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/20 10:28:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37403) Inline type hints for python/pyspark/mllib/common.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/20 10:28:00 UTC, 3 replies.
- [jira] [Created] (SPARK-37405) Inline type hints for python/pyspark/ml/feature.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:29:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37396) Inline type hint files for files in python/pyspark/mllib - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37406) Inline type hints for python/pyspark/ml/fpm.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37406) Inline type hints for python/pyspark/ml/fpm.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37407) Inline type hints for python/pyspark/ml/functions.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37408) Inline type hints for python/pyspark/ml/image.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:38:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37409) CLONE - Inline type hints for python/pyspark/ml/Inline type hints from python/pyspark/ml/image.pyi to python/pyspark/ml/pipeline.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37409) CLONE - Inline type hints for python/pyspark/ml/Inline type hints from python/pyspark/ml/image.pyi to python/pyspark/ml/pipeline.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37409) Inline type hints for python/pyspark/ml/pipeline.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37410) Inline type hints for python/pyspark/ml/recommendation.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37411) Inline type hints for python/pyspark/ml/regression.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:44:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37390) Buggy method retrival in pyspark.docs.conf.setup - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37410) Inline type hints for python/pyspark/ml/recommendation.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:51:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37411) Inline type hints for python/pyspark/ml/regression.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37412) Inline type hints for python/pyspark/ml/stat.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37413) Inline type hints for python/pyspark/ml/tree.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37415) Inline type hints for python/pyspark/ml/util.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:54:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37414) Inline type hints for python/pyspark/ml/tuning.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:54:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37416) Inline type hints for python/pyspark/ml/wrapper.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:56:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37417) Inline type hints for python/pyspark/ml/linalg/__init__.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 10:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37418) Inline type hints for python/pyspark/ml/param/__init__.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 11:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37419) Inline type hints for python/pyspark/ml/param/shared.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/20 11:04:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37419) Inline type hints for python/pyspark/ml/param/shared.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/20 13:03:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37419) Inline type hints for python/pyspark/ml/param/shared.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/20 13:03:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37420) Oracle JDBC - java.lang.ArithmeticException: Decimal precision 49 exceeds max precision 38 - posted by "t oo (Jira)" <ji...@apache.org> on 2021/11/20 23:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37420) Oracle JDBC - java.lang.ArithmeticException: Decimal precision 49 exceeds max precision 38 - posted by "t oo (Jira)" <ji...@apache.org> on 2021/11/21 00:03:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37395) Inline type hint files for files in python/pyspark/ml - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/21 10:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37422) Inline type hints for python/pyspark/mllib/feature.pypy - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/21 10:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37421) Inline type hints for python/pyspark/mllib/evaluation.pypy - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/21 10:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37423) Inline type hints for python/pyspark/mllib/fpm.pypy - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/21 10:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37424) Inline type hints for python/pyspark/mllib/random.pypy - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/21 10:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37426) Inline type hints for python/pyspark/mllib/regression.pypy - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/21 10:54:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37425) Inline type hints for python/pyspark/mllib/recommendation.pypy - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/21 10:54:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37428) Inline type hints for python/pyspark/mllib/util.pypy - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/21 10:55:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37427) Inline type hints for python/pyspark/mllib/tree.pypy - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/21 10:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37421) Inline type hints for python/pyspark/mllib/evaluation.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/21 12:45:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37422) Inline type hints for python/pyspark/mllib/feature.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/21 12:45:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37425) Inline type hints for python/pyspark/mllib/recommendation.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/21 12:46:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37423) Inline type hints for python/pyspark/mllib/fpm.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/21 12:46:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37426) Inline type hints for python/pyspark/mllib/regression.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/21 12:46:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37424) Inline type hints for python/pyspark/mllib/random.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/21 12:46:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37427) Inline type hints for python/pyspark/mllib/tree.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/21 12:46:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37428) Inline type hints for python/pyspark/mllib/util.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/21 12:46:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37429) Inline type hints for python/pyspark/mllib/linalg/__init__.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/21 12:48:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37430) Inline type hints for python/pyspark/mllib/linalg/distributed.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/21 12:49:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37431) pyspark.{ml, mllib}.linalg.Vector API - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/21 13:51:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37104) RDD and DStream should be covariant - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/21 15:27:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37104) RDD and DStream should be covariant - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/21 15:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37432) Driver keep a record of decommission executor - posted by "Hoa Le (Jira)" <ji...@apache.org> on 2021/11/21 18:38:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37432) Driver keep a record of decommission executor - posted by "Hoa Le (Jira)" <ji...@apache.org> on 2021/11/21 18:41:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37433) TimeZoneAwareExpression throws NoSuchElementException: None.get on expr.eval() - posted by "Sathiya Kumar (Jira)" <ji...@apache.org> on 2021/11/21 23:17:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37433) TimeZoneAwareExpression throws NoSuchElementException: None.get on expr.eval() - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/21 23:39:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37433) TimeZoneAwareExpression throws NoSuchElementException: None.get on expr.eval() - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/21 23:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-34497 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/22 00:10:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37209) YarnShuffleIntegrationSuite and other two similar cases in `resource-managers` test failed - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/11/22 01:13:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-36231) Support arithmetic operations of Series containing Decimal(np.nan) - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/22 02:34:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-36231) Support arithmetic operations of Series containing Decimal(np.nan) - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/22 02:34:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37354) Make the Java version installed on the container image used by the K8s integration tests with SBT configurable - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/22 02:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37434) Add a new profile to auto disable unsupported UTs on Macos using Apple Silicon - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2021/11/22 03:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37434) Add a new profile to auto disable unsupported UTs on Macos using Apple Silicon - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/22 03:30:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37434) Add a new profile to auto disable unsupported UTs on Macos using Apple Silicon - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/22 03:30:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37435) Did not find value which can be converted into java.lang.String - posted by "Ziqun Ye (Jira)" <ji...@apache.org> on 2021/11/22 05:14:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37436) Uses Python's standard string formatter for SQL API in pandas API on Spark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/22 06:34:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37436) Uses Python's standard string formatter for SQL API in pandas API on Spark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/22 06:34:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37436) Uses Python's standard string formatter for SQL API in pandas API on Spark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/22 06:37:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37436) Uses Python's standard string formatter for SQL API in pandas API on Spark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/22 06:37:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37407) Inline type hints for python/pyspark/ml/functions.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/22 06:42:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37407) Inline type hints for python/pyspark/ml/functions.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/22 06:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37437) Remove unused profile - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/11/22 06:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37437) Remove unused profile - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/22 07:02:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37437) Remove unused profile - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/22 07:02:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37421) Inline type hints for python/pyspark/mllib/evaluation.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/22 07:12:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37421) Inline type hints for python/pyspark/mllib/evaluation.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/22 07:12:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37388) WidthBucket throws NullPointerException in WholeStageCodegenExec - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/22 08:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37438) ANSI mode: Use store assignment rules for resolving function invocation - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/11/22 08:51:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37438) ANSI mode: Use store assignment rules for resolving function invocation - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/11/22 08:59:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37438) ANSI mode: Use store assignment rules for resolving function invocation - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/22 09:25:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37438) ANSI mode: Use store assignment rules for resolving function invocation - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/22 09:25:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-36357) Support pushdown Timestamp with local time zone for orc - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/22 12:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-35885) Use keyserver.ubuntu.com as a keyserver for CRAN - posted by "Marek Novotny (Jira)" <ji...@apache.org> on 2021/11/22 13:12:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37393) Inline annotations for {ml, mllib}/common.py - posted by "Nicholas Chammas (Jira)" <ji...@apache.org> on 2021/11/22 15:17:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-34497 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/22 15:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-32001 - posted by "Danny Guinther (Jira)" <ji...@apache.org> on 2021/11/22 15:24:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37192) Migrate SHOW TBLPROPERTIES to use V2 command by default - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/22 15:49:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37440) org.apache.spark.sql.AnalysisException: Non-time-based windows are not supported on streaming DataFrames/Datasets;; despite of time-based window - posted by "Ilya (Jira)" <ji...@apache.org> on 2021/11/22 16:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37441) org.apache.spark.sql.AnalysisException: Non-time-based windows are not supported on streaming DataFrames/Datasets;; despite of time-based window - posted by "Ilya (Jira)" <ji...@apache.org> on 2021/11/22 16:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37439) org.apache.spark.sql.AnalysisException: Non-time-based windows are not supported on streaming DataFrames/Datasets;; despite of time-based window - posted by "Ilya (Jira)" <ji...@apache.org> on 2021/11/22 16:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-32001 - posted by "Danny Guinther (Jira)" <ji...@apache.org> on 2021/11/22 16:20:00 UTC, 5 replies.
- [jira] [Created] (SPARK-37442) In AQE, wrong InMemoryRelation size estimation causes "Cannot broadcast the table that is larger than 8GB: 8 GB" failure - posted by "Michael Chen (Jira)" <ji...@apache.org> on 2021/11/22 19:02:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37442) In AQE, wrong InMemoryRelation size estimation causes "Cannot broadcast the table that is larger than 8GB: 8 GB" failure - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/22 19:17:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37442) In AQE, wrong InMemoryRelation size estimation causes "Cannot broadcast the table that is larger than 8GB: 8 GB" failure - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/22 19:17:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37441) org.apache.spark.sql.AnalysisException: Non-time-based windows are not supported on streaming DataFrames/Datasets;; despite of time-based window - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2021/11/22 20:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37440) org.apache.spark.sql.AnalysisException: Non-time-based windows are not supported on streaming DataFrames/Datasets;; despite of time-based window - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2021/11/22 20:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37439) org.apache.spark.sql.AnalysisException: Non-time-based windows are not supported on streaming DataFrames/Datasets;; despite of time-based window - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2021/11/22 20:38:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37439) org.apache.spark.sql.AnalysisException: Non-time-based windows are not supported on streaming DataFrames/Datasets;; despite of time-based window - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2021/11/22 20:38:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37443) Provide a profiler for Python/Pandas UDFs - posted by "Takuya Ueshin (Jira)" <ji...@apache.org> on 2021/11/22 23:21:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37443) Provide a profiler for Python/Pandas UDFs - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/22 23:35:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37443) Provide a profiler for Python/Pandas UDFs - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/22 23:35:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37337) Improve the API of Spark DataFrame to pandas-on-Spark DataFrame conversion - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/22 23:40:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-30537) toPandas gets wrong dtypes when applied on empty DF when Arrow enabled - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/23 00:06:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-30537) toPandas gets wrong dtypes when applied on empty DF when Arrow enabled - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/23 00:06:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37444) ALTER NAMESPACE ... SET LOCATION handles empty location consistently across v1 and v2 command - posted by "Terry Kim (Jira)" <ji...@apache.org> on 2021/11/23 02:11:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37444) ALTER NAMESPACE ... SET LOCATION should handle empty location consistently across v1 and v2 command - posted by "Terry Kim (Jira)" <ji...@apache.org> on 2021/11/23 02:15:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37444) ALTER NAMESPACE ... SET LOCATION should handle empty location consistently across v1 and v2 command - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/23 02:23:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37444) ALTER NAMESPACE ... SET LOCATION should handle empty location consistently across v1 and v2 command - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/23 02:23:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-36231) Support arithmetic operations of Series containing Decimal(np.nan) - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/23 03:18:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-32079) PySpark <> Beam pickling issues for collections.namedtuple - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/23 03:23:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-32079) PySpark <> Beam pickling issues for collections.namedtuple - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/23 03:23:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-22674) PySpark breaks serialization of namedtuple subclasses - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/23 03:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-27810) PySpark breaks Cloudpickle serialization of collections.namedtuple objects - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/23 03:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37445) Update hadoop-profile - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/11/23 03:40:00 UTC, 3 replies.
- [jira] [Created] (SPARK-37445) Update hadoop-profile - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/11/23 03:40:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-32079) PySpark <> Beam pickling issues for collections.namedtuple - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/23 05:44:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37438) ANSI mode: Use store assignment rules for resolving function invocation - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/11/23 06:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37445) Update hadoop-profile - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/23 07:00:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-37446) hive-2.3.9 related API use invoke method - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/11/23 07:32:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37446) hive-2.3.9 related API use invoke method - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/11/23 07:32:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37446) hive-2.3.9 related API use invoke method - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/11/23 07:34:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37447) Cache LogicalPlan.isStreaming() in a lazy val - posted by "Josh Rosen (Jira)" <ji...@apache.org> on 2021/11/23 08:04:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37447) Cache LogicalPlan.isStreaming() in a lazy val - posted by "Josh Rosen (Jira)" <ji...@apache.org> on 2021/11/23 08:04:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37447) Cache LogicalPlan.isStreaming() in a lazy val - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/23 08:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37448) Avoid CurrentOrigin.withOrigin calls in tree transformation methods when partial function isn't defined - posted by "Josh Rosen (Jira)" <ji...@apache.org> on 2021/11/23 08:43:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37448) Avoid CurrentOrigin.withOrigin calls in tree transformation methods when partial function isn't defined - posted by "Josh Rosen (Jira)" <ji...@apache.org> on 2021/11/23 08:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-22674) PySpark breaks serialization of namedtuple subclasses - posted by "Sergei Lebedev (Jira)" <ji...@apache.org> on 2021/11/23 09:52:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-11792) SizeEstimator cannot provide a good size estimation of UnsafeHashedRelations - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/23 11:55:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37259) JDBC read is always going to wrap the query in a select statement - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/23 12:12:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37449) Side effects between PySpark, Numpy and Pygeos - posted by "Carlos Gameiro (Jira)" <ji...@apache.org> on 2021/11/23 12:13:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37449) Side effects between PySpark, Numpy and Pygeos - posted by "Carlos Gameiro (Jira)" <ji...@apache.org> on 2021/11/23 12:13:00 UTC, 3 replies.
- [jira] [Created] (SPARK-37450) Spark SQL reads unnecessary nested fields (another type of pruning case) - posted by "Jiri Humpolicek (Jira)" <ji...@apache.org> on 2021/11/23 12:23:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37449) Side effects between PySpark and Numpy - posted by "Carlos Gameiro (Jira)" <ji...@apache.org> on 2021/11/23 12:31:00 UTC, 3 replies.
- [jira] [Updated] (SPARK-37449) Side effects between PySpark Pandas UDF and Numpy indexing - posted by "Carlos Gameiro (Jira)" <ji...@apache.org> on 2021/11/23 12:36:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-37450) Spark SQL reads unnecessary nested fields (another type of pruning case) - posted by "Jiri Humpolicek (Jira)" <ji...@apache.org> on 2021/11/23 13:05:00 UTC, 6 replies.
- [jira] [Commented] (SPARK-21187) Complete support for remaining Spark data types in Arrow Converters - posted by "Michelle m Hovington (Jira)" <ji...@apache.org> on 2021/11/23 16:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37432) Driver keep a record of decommission executor - posted by "Hoa Le (Jira)" <ji...@apache.org> on 2021/11/23 19:21:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-37432) Driver keep a record of decommission executor - posted by "Hoa Le (Jira)" <ji...@apache.org> on 2021/11/23 20:44:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25642) Add new Metrics in External Shuffle Service to help determine Network performance and Connection Handling capabilities of the Shuffle Service - posted by "Yongjun Zhang (Jira)" <ji...@apache.org> on 2021/11/23 22:47:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-37446) hive-2.3.9 related API use invoke method - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/24 00:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37446) hive-2.3.9 related API use invoke method - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/24 00:38:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-37435) Did not find value which can be converted into java.lang.String - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/24 01:36:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37449) Side effects between PySpark Pandas UDF and Numpy indexing - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/24 01:36:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37380) Miscellaneous Python lint infra cleanup - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/24 01:45:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-37450) Spark SQL reads unnecessary nested fields (another type of pruning case) - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/11/24 02:33:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37367) Reenable exception test in DDLParserSuite.create view -- basic - posted by "Xiao Li (Jira)" <ji...@apache.org> on 2021/11/24 03:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37451) Performance improvement regressed String to Decimal cast - posted by "Raza Jafri (Jira)" <ji...@apache.org> on 2021/11/24 04:28:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37451) Performance improvement regressed String to Decimal cast - posted by "Raza Jafri (Jira)" <ji...@apache.org> on 2021/11/24 04:30:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-32446) Add new executor metrics summary REST APIs and parameters - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/24 05:37:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37451) Performance improvement regressed String to Decimal cast - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/24 06:12:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37389) Check unclosed bracketed comments - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/24 08:20:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-28299) Evaluation of multiple CTE uses - posted by "Peter Toth (Jira)" <ji...@apache.org> on 2021/11/24 09:56:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37452) Char and Varchar breaks backward compatibility between v3 and v2 - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2021/11/24 10:21:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37452) Char and Varchar breaks backward compatibility between v3 and v2 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/24 10:38:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37452) Char and Varchar breaks backward compatibility between v3 and v2 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/24 10:38:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37453) Split TPC-DS build in GitHub Actions - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/24 10:48:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37453) Split TPC-DS build in GitHub Actions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/24 10:50:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-37449) Side effects between PySpark Pandas UDF and Numpy indexing - posted by "Carlos Gameiro (Jira)" <ji...@apache.org> on 2021/11/24 10:50:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37453) Split TPC-DS build in GitHub Actions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/24 10:51:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37399) Inline type hints for python/pyspark/ml/common.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/24 10:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37403) Inline type hints for python/pyspark/mllib/common.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/24 10:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-32929) StreamSuite failure on IBM Z: - SPARK-20432: union one stream with itself - posted by "Kun Lu (Jira)" <ji...@apache.org> on 2021/11/24 14:29:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-26663) Cannot query a Hive table with subdirectories - posted by "Valeriy Borysyuk (Jira)" <ji...@apache.org> on 2021/11/24 15:35:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-26663) Cannot query a Hive table with subdirectories - posted by "Valeriy Borysyuk (Jira)" <ji...@apache.org> on 2021/11/24 15:36:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37454) support expressions in time travel timestamp - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/24 15:41:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37454) support expressions in time travel timestamp - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/24 15:47:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37454) support expressions in time travel timestamp - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/24 15:47:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-37444) ALTER NAMESPACE ... SET LOCATION should handle empty location consistently across v1 and v2 command - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/24 16:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-36861) Partition columns are overly eagerly parsed as dates - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/24 20:46:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-36861) Partition columns are overly eagerly parsed as dates - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/24 20:46:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37450) Spark SQL reads unnecessary nested fields (another type of pruning case) - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/24 23:39:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-34287) Object hash and sort aggregation improvement - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/11/24 23:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37455) Replace hash with sort aggregate if child is already sorted - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/11/24 23:42:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37455) Replace hash with sort aggregate if child is already sorted - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/24 23:46:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37455) Replace hash with sort aggregate if child is already sorted - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/24 23:46:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37453) Split TPC-DS build in GitHub Actions - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/25 00:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37357) Add small partition factor for rebalance partitions - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2021/11/25 01:35:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37456) CREATE NAMESPACE should qualify location for v2 command - posted by "Terry Kim (Jira)" <ji...@apache.org> on 2021/11/25 01:41:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37456) CREATE NAMESPACE should qualify location for v2 command - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/25 01:50:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37456) CREATE NAMESPACE should qualify location for v2 command - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/25 01:50:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37457) Update cloudpickle to v2.0.0 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/25 02:48:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37457) Update cloudpickle to v2.0.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/25 02:54:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37457) Update cloudpickle to v2.0.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/25 02:54:00 UTC, 2 replies.
- [jira] [Reopened] (SPARK-37325) Result vector from pandas_udf was not the required length - posted by "liu (Jira)" <ji...@apache.org> on 2021/11/25 03:00:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-37325) Result vector from pandas_udf was not the required length - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/25 03:02:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37458) Remove unnecessary object serialization on foreachBatch - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2021/11/25 03:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37458) Remove unnecessary object serialization on foreachBatch - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2021/11/25 03:12:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37458) Remove unnecessary object serialization on foreachBatch - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/25 03:40:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37459) Upgrade commons-cli to 1.5.0 - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/25 04:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37459) Upgrade commons-cli to 1.5.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/25 04:42:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37459) Upgrade commons-cli to 1.5.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/25 04:42:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37459) Upgrade commons-cli to 1.5.0 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/25 07:12:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37456) CREATE NAMESPACE should qualify location for v2 command - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/25 07:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-34332) Unify v1 and v2 ALTER TABLE .. SET LOCATION tests - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/25 07:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-36861) Partition columns are overly eagerly parsed as dates - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/25 07:56:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37389) Check unclosed bracketed comments - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/25 07:59:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37454) support expressions in time travel timestamp - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/25 08:06:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37460) ALTER (DATABASE|SCHEMA|NAMESPACE) ... SET LOCATION command not documented - posted by "Yuto Akutsu (Jira)" <ji...@apache.org> on 2021/11/25 08:33:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37460) ALTER (DATABASE|SCHEMA|NAMESPACE) ... SET LOCATION command not documented - posted by "Yuto Akutsu (Jira)" <ji...@apache.org> on 2021/11/25 08:35:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37311) Migrate ALTER NAMESPACE ... SET LOCATION to use v2 command by default - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/25 08:40:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37357) Add small partition factor for rebalance partitions - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/25 08:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37357) Add small partition factor for rebalance partitions - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/25 08:45:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37460) ALTER (DATABASE|SCHEMA|NAMESPACE) ... SET LOCATION command not documented - posted by "Yuto Akutsu (Jira)" <ji...@apache.org> on 2021/11/25 09:02:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37461) yarn-client mode client's appid value is null - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/11/25 10:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37461) yarn-client mode client's appid value is null - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/25 11:05:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37461) yarn-client mode client's appid value is null - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/25 11:05:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37462) To avoid unnecessary flight request calculations - posted by "weixiuli (Jira)" <ji...@apache.org> on 2021/11/25 11:39:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37311) Migrate ALTER NAMESPACE ... SET LOCATION to use v2 command by default - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/25 11:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37462) To avoid unnecessary calculation of outstanding fetch requests and RPCS - posted by "weixiuli (Jira)" <ji...@apache.org> on 2021/11/25 12:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37462) Avoid unnecessary calculating the number of outstanding fetch requests and RPCS - posted by "weixiuli (Jira)" <ji...@apache.org> on 2021/11/25 12:23:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37445) Update hadoop-profile - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/25 12:29:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37462) Avoid unnecessary calculating the number of outstanding fetch requests and RPCS - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/25 12:41:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37462) Avoid unnecessary calculating the number of outstanding fetch requests and RPCS - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/25 12:41:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37463) read/write Timestamp ntz or ltz to Orc uses UTC timestamp - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/11/25 12:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37463) read/write Timestamp ntz or ltz to Orc uses UTC timestamp - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/25 12:56:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37463) read/write Timestamp ntz or ltz to Orc uses UTC timestamp - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/25 12:56:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37463) Read/Write Timestamp ntz or ltz to Orc uses UTC timestamp - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/11/25 13:02:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37464) SCHEMA and DATABASE should simply be aliases of NAMESPACE - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/25 14:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37464) SCHEMA and DATABASE should simply be aliases of NAMESPACE - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/25 14:49:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37464) SCHEMA and DATABASE should simply be aliases of NAMESPACE - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/25 14:49:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37465) PySpark tests failing on Pandas 0.23 - posted by "Willi Raschkowski (Jira)" <ji...@apache.org> on 2021/11/25 17:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37465) PySpark tests failing on Pandas 0.23 - posted by "Willi Raschkowski (Jira)" <ji...@apache.org> on 2021/11/25 17:23:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-32079) PySpark <> Beam pickling issues for collections.namedtuple - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/25 23:22:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-37445) Update hadoop-profile - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/26 00:34:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37445) Update hadoop-profile - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/26 00:34:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37466) Support subexpression elimination in lambda functions - posted by "Adam Binford (Jira)" <ji...@apache.org> on 2021/11/26 00:45:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37467) Consolidate whole stage and non-whole stage subexpression elimination - posted by "Adam Binford (Jira)" <ji...@apache.org> on 2021/11/26 00:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37436) Uses Python's standard string formatter for SQL API in pandas API on Spark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/26 01:38:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37381) Unify v1 and v2 SHOW CREATE TABLE tests - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/26 01:40:00 UTC, 4 replies.
- [jira] [Resolved] (SPARK-37457) Update cloudpickle to v2.0.0 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/26 01:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37465) PySpark tests failing on Pandas 0.23 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/26 02:00:00 UTC, 6 replies.
- [jira] [Created] (SPARK-37468) Support ANSI intervals and TimestampNTZ for UnionEstimation - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/26 03:11:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37468) Support ANSI intervals and TimestampNTZ for UnionEstimation - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/26 03:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37468) Support ANSI intervals and TimestampNTZ for UnionEstimation - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/26 03:18:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37468) Support ANSI intervals and TimestampNTZ for UnionEstimation - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/26 03:18:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37099) Impl a rank-based filter to optimize top-k computation - posted by "zhengruifeng (Jira)" <ji...@apache.org> on 2021/11/26 03:29:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37460) ALTER (DATABASE|SCHEMA|NAMESPACE) ... SET LOCATION command not documented - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/26 03:50:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37381) Unify v1 and v2 SHOW CREATE TABLE tests - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/26 04:14:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37469) Unified "fetchWaitTime" and "shuffleReadTime" metrics On UI - posted by "Yazhi Wang (Jira)" <ji...@apache.org> on 2021/11/26 04:16:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37469) Unified "fetchWaitTime" and "shuffleReadTime" metrics On UI - posted by "Yazhi Wang (Jira)" <ji...@apache.org> on 2021/11/26 04:18:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-37469) Unified "fetchWaitTime" and "shuffleReadTime" metrics On UI - posted by "Yazhi Wang (Jira)" <ji...@apache.org> on 2021/11/26 04:18:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37470) A new created table gets duplicated after ALTER DATABASE SET LOCATION command - posted by "Yuto Akutsu (Jira)" <ji...@apache.org> on 2021/11/26 05:40:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37470) A new created table gets duplicated after ALTER DATABASE SET LOCATION command - posted by "Yuto Akutsu (Jira)" <ji...@apache.org> on 2021/11/26 05:41:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37469) Unified "fetchWaitTime" and "shuffleReadTime" metrics On UI - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/26 06:10:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37471) spark-sql support nested bracketed comment - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/11/26 07:27:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37471) spark-sql support nested bracketed comment - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/11/26 07:34:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-36240) Graceful termination of Spark Structured Streaming queries - posted by "yufei ding (Jira)" <ji...@apache.org> on 2021/11/26 08:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37471) spark-sql support nested bracketed comment - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/26 08:43:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37471) spark-sql support nested bracketed comment - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/26 08:43:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37472) Missing functionality in spark.pandas - posted by "Rens Jochemsen (Jira)" <ji...@apache.org> on 2021/11/26 09:57:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-34735) Add modified configs for SQL execution in UI - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/11/26 13:04:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-34735) Add modified configs for SQL execution in UI - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/11/26 13:05:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-37465) PySpark tests failing on Pandas 0.23 - posted by "Willi Raschkowski (Jira)" <ji...@apache.org> on 2021/11/26 14:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37465) PySpark tests failing on Pandas 0.23 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/26 17:20:00 UTC, 3 replies.
- [jira] [Updated] (SPARK-37473) BypassMergeSortShuffleWriter may loss data when disk is missing however catagory is present - posted by "haiyangyu (Jira)" <ji...@apache.org> on 2021/11/27 07:08:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37473) BypassMergeSortShuffleWriter may loss data when disk is missing however catagory is present - posted by "haiyangyu (Jira)" <ji...@apache.org> on 2021/11/27 07:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37473) BypassMergeSortShuffleWriter may loss data when disk is missing however catagory is present - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/27 07:14:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37473) BypassMergeSortShuffleWriter may loss data when disk is missing however catagory is present - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/27 07:14:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-33875) Implement DESCRIBE COLUMN for v2 catalog - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/27 08:58:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37437) Remove unused profile - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/11/27 14:52:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37437) Remove unused hive-2.3 profile - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/11/27 14:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37467) Consolidate whole stage and non-whole stage subexpression elimination - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/27 15:28:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37467) Consolidate whole stage and non-whole stage subexpression elimination - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/27 15:28:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37474) Migrate SparkR documentation to pkgdown - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/11/27 15:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37474) Migrate SparkR documentation to pkgdown - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/27 16:06:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37474) Migrate SparkR documentation to pkgdown - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/27 16:06:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37475) Add Scale Parameter to Floor and Ceil functions - posted by "Sathiya Kumar (Jira)" <ji...@apache.org> on 2021/11/27 20:02:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37476) udaf doesnt work with nullable case class result - posted by "koert kuipers (Jira)" <ji...@apache.org> on 2021/11/27 21:48:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37476) udaf doesnt work with nullable case class result - posted by "koert kuipers (Jira)" <ji...@apache.org> on 2021/11/27 21:49:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37476) udaf doesnt work with nullable (or option of) case class result - posted by "koert kuipers (Jira)" <ji...@apache.org> on 2021/11/27 21:50:00 UTC, 6 replies.
- [jira] [Assigned] (SPARK-37475) Add Scale Parameter to Floor and Ceil functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/27 22:36:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37475) Add Scale Parameter to Floor and Ceil functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/27 22:36:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-33340) spark run on kubernetes has Could not load KUBERNETES classes issue - posted by "aaronHadoop (Jira)" <ji...@apache.org> on 2021/11/27 23:19:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37475) Add Scale Parameter to Floor and Ceil functions - posted by "Sathiya Kumar (Jira)" <ji...@apache.org> on 2021/11/28 00:01:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-33340) spark run on kubernetes has Could not load KUBERNETES classes issue - posted by "aaronHadoop (Jira)" <ji...@apache.org> on 2021/11/28 00:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37461) yarn-client mode client's appid value is null - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/11/28 14:54:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-37461) yarn-client mode client's appid value is null - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/11/28 14:55:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37477) Migrate SHOW CREATE TABLE to use V2 command by default - posted by "PengLei (Jira)" <ji...@apache.org> on 2021/11/29 02:10:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37153) Inline type hints for python/pyspark/profiler.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/29 04:04:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37153) Inline type hints for python/pyspark/profiler.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/29 04:04:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37055) Apply 'compute.eager_check' across all the codebase - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/29 04:45:00 UTC, 4 replies.
- [jira] [Created] (SPARK-37478) Unify v1 and v2 DROP NAMESPACE tests - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/29 04:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37478) Unify v1 and v2 DROP NAMESPACE tests - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/29 04:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37479) Migrate DROP NAMESPACE to use V2 command by default - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/29 04:54:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37479) Migrate DROP NAMESPACE to use V2 command by default - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/29 04:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37443) Provide a profiler for Python/Pandas UDFs - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/29 05:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-36525) DS V2 Index Support - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2021/11/29 06:06:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37291) PySpark init SparkSession should copy conf to sharedState - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/29 06:18:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-36346) Support TimestampNTZ type in Orc file source - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/29 06:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37480) Configurations in docs/running-on-kubernetes.md are not uptodate - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/11/29 07:27:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37480) Configurations in docs/running-on-kubernetes.md are not uptodate - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/29 07:31:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37480) Configurations in docs/running-on-kubernetes.md are not uptodate - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/29 07:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37481) Disappearance of skipped stages mislead the bug hunting - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2021/11/29 07:42:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37481) Disappearance of skipped stages mislead the bug hunting - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2021/11/29 07:43:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37481) Disappearance of skipped stages mislead the bug hunting - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/29 07:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37481) Disappearance of skipped stages mislead the bug hunting - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/29 07:59:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-34714) collect_list(struct()) fails when used with GROUP BY - posted by "Manu Zhang (Jira)" <ji...@apache.org> on 2021/11/29 08:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37482) Skip check monotonic increasing for Series.asof with 'compute.eager_check' - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/29 08:40:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37447) Cache LogicalPlan.isStreaming() in a lazy val - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/29 08:47:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-34248) Allow implicit casting string literal to other data types under ANSI mode - posted by "王俊博 (Jira)" <ji...@apache.org> on 2021/11/29 09:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-34248) Allow implicit casting string literal to other data types under ANSI mode - posted by "王俊博 (Jira)" <ji...@apache.org> on 2021/11/29 09:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-33354) New explicit cast syntax rules in ANSI mode - posted by "王俊博 (Jira)" <ji...@apache.org> on 2021/11/29 09:34:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37452) Char and Varchar breaks backward compatibility between v3 and v2 - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2021/11/29 09:49:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37483) Support pushdown down top N to JDBC data source V2 - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/11/29 09:59:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37464) SCHEMA and DATABASE should simply be aliases of NAMESPACE - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/29 10:06:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37482) Skip check monotonic increasing for Series.asof with 'compute.eager_check' - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/29 10:13:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37482) Skip check monotonic increasing for Series.asof with 'compute.eager_check' - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/29 10:13:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37483) Support pushdown down top N to JDBC data source V2 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/29 10:14:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37483) Support pushdown down top N to JDBC data source V2 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/29 10:14:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37484) Replace Get and getOrElse with getOrElse - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2021/11/29 11:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37484) Replace Get and getOrElse with getOrElse - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/29 11:18:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37484) Replace Get and getOrElse with getOrElse - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/29 11:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37485) Replace map with expressions which produce no result with foreach - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2021/11/29 11:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37485) Replace map with expressions which produce no result with foreach - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/29 11:38:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37485) Replace map with expressions which produce no result with foreach - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/29 11:38:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37463) Read/Write Timestamp ntz to Orc uses UTC timestamp - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/11/29 11:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37463) Read/Write Timestamp ntz from/to Orc uses UTC timestamp - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/11/29 11:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37463) Read/Write Timestamp ntz from/to Orc uses UTC time zone - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/11/29 11:59:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37463) Read/Write Timestamp ntz from/to Orc uses UTC time zone - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/29 12:02:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37486) an error occurred while using the udf jars located in the lakefs, a inner filesystem in Tencent Cloud DLC. - posted by "Kevin Pis (Jira)" <ji...@apache.org> on 2021/11/29 13:13:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37486) an error occurred while using the udf jars located in the lakefs, a inner filesystem in Tencent Cloud DLC. - posted by "Kevin Pis (Jira)" <ji...@apache.org> on 2021/11/29 13:18:00 UTC, 6 replies.
- [jira] [Created] (SPARK-37487) CollectMetrics is executed twice if it is followed by an sort - posted by "Tanel Kiis (Jira)" <ji...@apache.org> on 2021/11/29 13:25:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37487) CollectMetrics is executed twice if it is followed by an sort - posted by "Tanel Kiis (Jira)" <ji...@apache.org> on 2021/11/29 13:26:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37487) CollectMetrics is executed twice if it is followed by an sort - posted by "Tanel Kiis (Jira)" <ji...@apache.org> on 2021/11/29 13:29:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37487) CollectMetrics is executed twice if it is followed by a sort - posted by "Tanel Kiis (Jira)" <ji...@apache.org> on 2021/11/29 13:32:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37488) With enough resources, the task may still be permanently pending - posted by "Yiqun Zhang (Jira)" <ji...@apache.org> on 2021/11/29 13:57:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37488) With enough resources, the task may still be permanently pending - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/29 14:28:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37488) With enough resources, the task may still be permanently pending - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/29 14:28:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37485) Replace map with expressions which produce no result with foreach - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/11/29 15:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37484) Replace Get and getOrElse with getOrElse - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/11/29 15:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-32001 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/29 16:04:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37489) Skip hasnans check in numops if eager_check disable - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/11/29 16:04:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37489) Skip hasnans check in numops if eager_check disable - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/29 16:16:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37489) Skip hasnans check in numops if eager_check disable - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/29 16:16:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37490) Show hint if analyzer fails due to ANSI type coercion - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/11/29 16:42:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37490) Show hint if analyzer fails due to ANSI type coercion - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/29 16:59:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37490) Show hint if analyzer fails due to ANSI type coercion - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/29 16:59:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37468) Support ANSI intervals and TimestampNTZ for UnionEstimation - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/29 18:54:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37491) Fix Series.asof when values of the series is not sorted - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/30 01:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37492) Optimize Orc test code with withAllNativeOrcReaders - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/11/30 01:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37492) Optimize Orc test code with withAllNativeOrcReaders - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 01:40:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37492) Optimize Orc test code with withAllNativeOrcReaders - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 01:40:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37493) expose driver gc time - posted by "zhoubin (Jira)" <ji...@apache.org> on 2021/11/30 02:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37494) Unify v1 and v2 option output of `SHOW CREATE TABLE` command - posted by "PengLei (Jira)" <ji...@apache.org> on 2021/11/30 02:31:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37493) expose driver gc time and duration time - posted by "zhoubin (Jira)" <ji...@apache.org> on 2021/11/30 02:33:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37483) Support push down top N to JDBC data source V2 - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/11/30 02:34:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37494) Unify v1 and v2 options output of `SHOW CREATE TABLE` command - posted by "PengLei (Jira)" <ji...@apache.org> on 2021/11/30 02:37:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37485) Replace map with expressions which produce no result with foreach - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/30 02:39:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37484) Replace Get and getOrElse with getOrElse - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/30 02:40:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37482) Skip check monotonic increasing for Series.asof with 'compute.eager_check' - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/30 02:41:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37493) expose driver gc time and duration time - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 03:00:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37493) expose driver gc time and duration time - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 03:00:02 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37486) an error occurred while using the udf jars located in the lakefs, a inner filesystem in Tencent Cloud DLC. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 03:01:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37486) an error occurred while using the udf jars located in the lakefs, a inner filesystem in Tencent Cloud DLC. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 03:01:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-35867) Enable vectorized read for VectorizedPlainValuesReader.readBooleans - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/11/30 03:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37472) Missing functionality in spark.pandas - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/30 04:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37452) Char and Varchar breaks backward compatibility between v3 and v2 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/30 04:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-36850) Migrate CreateTableStatement to v2 command framework - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/30 04:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-36850) Migrate CreateTableStatement to v2 command framework - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/11/30 04:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37492) Optimize Orc test code with withAllNativeOrcReaders - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/30 04:55:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37495) Skip identical index checking of Series.compare when config 'compute.eager_check' is disabled - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/30 05:00:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37465) PySpark tests failing on Pandas 0.23 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/30 05:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37496) Migrate ReplaceTableAsSelectStatement to v2 command - posted by "Huaxin Gao (Jira)" <ji...@apache.org> on 2021/11/30 05:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37495) Skip identical index checking of Series.compare when config 'compute.eager_check' is disabled - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 06:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37495) Skip identical index checking of Series.compare when config 'compute.eager_check' is disabled - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 06:00:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37497) Promote ExecutorPods[PollingSnapshot|WatchSnapshot]Source to DeveloperApi - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/30 06:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37497) Promote ExecutorPods[PollingSnapshot|WatchSnapshot]Source to DeveloperApi - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 06:23:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37498) test_reuse_worker_of_parallelize_range is flaky - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/11/30 06:23:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37497) Promote ExecutorPods[PollingSnapshot|WatchSnapshot]Source to DeveloperApi - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 06:23:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37499) Close HiveClientImpl.sessionState when shutdown - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/11/30 06:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37499) Close HiveClientImpl.sessionState when shutdown - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/11/30 06:28:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37489) Skip hasnans check in numops if eager_check disable - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/30 06:37:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-36396) Implement DataFrame.cov - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/30 06:47:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-36396) Implement DataFrame.cov - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/30 06:47:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37494) Unify v1 and v2 options output of `SHOW CREATE TABLE` command - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 07:02:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37494) Unify v1 and v2 options output of `SHOW CREATE TABLE` command - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 07:02:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37499) Close HiveClientImpl.sessionState when shutdown - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/11/30 07:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37496) Migrate ReplaceTableAsSelectStatement to v2 command - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 08:08:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37496) Migrate ReplaceTableAsSelectStatement to v2 command - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 08:08:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37500) Incorrect scope when using named_windows in CTEs - posted by "Lauri Koobas (Jira)" <ji...@apache.org> on 2021/11/30 08:23:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37500) Incorrect scope when using named_windows in CTEs - posted by "Lauri Koobas (Jira)" <ji...@apache.org> on 2021/11/30 08:23:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37501) CREATE TABLE should qualify location for v2 command - posted by "PengLei (Jira)" <ji...@apache.org> on 2021/11/30 08:32:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-37381) Unify v1 and v2 SHOW CREATE TABLE tests - posted by "dch nguyen (Jira)" <ji...@apache.org> on 2021/11/30 08:34:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37502) Support cast aware output partitioning and required if it can up cast - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2021/11/30 08:38:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37501) CREATE/REPLACE TABLE should qualify location for v2 command - posted by "PengLei (Jira)" <ji...@apache.org> on 2021/11/30 08:44:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37502) Support cast aware output partitioning and required if it can up cast - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2021/11/30 08:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37502) Support cast aware output partitioning and required if it can up cast - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 09:01:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37502) Support cast aware output partitioning and required if it can up cast - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 09:01:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37503) Improve SparkSession startup issue - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/11/30 09:13:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37346) Link migration guide for structured stream. - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/11/30 09:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-34568) enableHiveSupport should ignore if SparkContext is created - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/11/30 09:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37504) pyspark should not pass all options to session states. - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/11/30 09:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37504) pyspark should not pass all options to session states. - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/11/30 09:23:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37054) Porting "pandas API on Spark: Internals" to PySpark docs. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 10:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37501) CREATE/REPLACE TABLE should qualify location for v2 command - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 11:09:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37501) CREATE/REPLACE TABLE should qualify location for v2 command - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 11:10:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37505) mesos module is missing log4j.properties file for UT - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2021/11/30 11:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37505) mesos module is missing log4j.properties file for UT - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 11:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37505) mesos module is missing log4j.properties file for UT - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 11:45:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37506) Change the never changed 'var' to 'val' - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2021/11/30 11:50:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37506) Change the never changed 'var' to 'val' - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 12:02:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37506) Change the never changed 'var' to 'val' - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 12:02:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37507) Add the TO_BINARY() function - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/30 13:28:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37507) Add the TO_BINARY() function - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/30 13:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37508) Add CONTAINS() function - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/30 14:03:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37508) Add CONTAINS() function - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/30 14:04:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-37508) Add CONTAINS() function - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/30 14:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37508) Add CONTAINS() function - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/11/30 14:10:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-10925) Exception when joining DataFrames - posted by "Joao Miguel Pinto (Jira)" <ji...@apache.org> on 2021/11/30 14:19:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-10925) Exception when joining DataFrames - posted by "Joao Miguel Pinto (Jira)" <ji...@apache.org> on 2021/11/30 14:21:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37508) Add CONTAINS() function - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 15:48:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-12185) Add Histogram support to Spark SQL/DataFrames - posted by "Nicholas Chammas (Jira)" <ji...@apache.org> on 2021/11/30 16:25:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-12185) Add Histogram support to Spark SQL/DataFrames - posted by "Nicholas Chammas (Jira)" <ji...@apache.org> on 2021/11/30 16:25:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-26589) proper `median` method for spark dataframe - posted by "Nicholas Chammas (Jira)" <ji...@apache.org> on 2021/11/30 18:12:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-26589) proper `median` method for spark dataframe - posted by "Nicholas Chammas (Jira)" <ji...@apache.org> on 2021/11/30 18:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37509) Improve Fallback Storage upload speed by avoiding S3 rate limiter - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/30 19:35:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37509) Improve Fallback Storage upload speed by avoiding S3 rate limiter - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 19:39:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37509) Improve Fallback Storage upload speed by avoiding S3 rate limiter - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 19:43:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37487) CollectMetrics is executed twice if it is followed by a sort - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/11/30 22:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37505) mesos module is missing log4j.properties file for UT - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/30 22:42:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37509) Improve Fallback Storage upload speed by avoiding S3 rate limiter - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/30 23:04:00 UTC, 0 replies.