issues@spark.apache.org, 2018-07

You are viewing a plain text version of this content. The canonical link for it is here.

- [jira] [Resolved] (SPARK-24654) Update, fix LICENSE and NOTICE, and specialize for source vs binary - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/01 00:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24470) RestSubmissionClient to be robust against 404 & non json responses - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/01 01:51:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24470) RestSubmissionClient to be robust against 404 & non json responses - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/01 01:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24707) Enable spark-kafka-streaming to maintain min buffer using async thread to avoid blocking kafka poll - posted by "Sidhavratha Kumar (JIRA)" <ji...@apache.org> on 2018/07/01 02:16:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24707) Enable spark-kafka-streaming to maintain min buffer using async thread to avoid blocking kafka poll - posted by "Sidhavratha Kumar (JIRA)" <ji...@apache.org> on 2018/07/01 02:17:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24707) Enable spark-kafka-streaming to maintain min buffer using async thread to avoid blocking kafka poll - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/01 03:10:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24707) Enable spark-kafka-streaming to maintain min buffer using async thread to avoid blocking kafka poll - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/01 03:10:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-20427) Issue with Spark interpreting Oracle datatype NUMBER - posted by "Oliver Richardson (JIRA)" <ji...@apache.org> on 2018/07/01 07:52:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24708) Document the default spark url of master in standalone is "spark://localhost:7070" - posted by "Chia-Ping Tsai (JIRA)" <ji...@apache.org> on 2018/07/01 08:58:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24621) WebUI - application 'name' urls point to http instead of https (even when ssl enabled) - posted by "t oo (JIRA)" <ji...@apache.org> on 2018/07/01 09:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24709) Inferring schema from JSON string literal - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/07/01 09:42:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24642) Add a function which infers schema from a JSON column - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/07/01 09:46:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24642) Add a function which infers schema from a JSON column - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/07/01 09:46:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24709) Inferring schema from JSON string literal - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/01 10:05:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24709) Inferring schema from JSON string literal - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/01 10:05:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24642) Add a function which infers schema from a JSON column - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/07/01 10:06:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24710) Information Gain Ratio for decision trees - posted by "Pablo J. Villacorta (JIRA)" <ji...@apache.org> on 2018/07/01 13:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24165) UDF within when().otherwise() raises NullPointerException - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/01 14:08:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24165) UDF within when().otherwise() raises NullPointerException - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/01 14:08:00 UTC, 2 replies.
- [jira] [Created] (SPARK-24711) Integration tests will not work with exclude/include tags - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/07/01 15:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24711) Integration tests will not work with exclude/include tags - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/07/01 15:39:00 UTC, 2 replies.
- [jira] [Created] (SPARK-24712) TrainValidationSplit ignores label column name and forces to be "label" - posted by "Pablo J. Villacorta (JIRA)" <ji...@apache.org> on 2018/07/01 18:49:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24712) TrainValidationSplit ignores label column name and forces to be "label" - posted by "Pablo J. Villacorta (JIRA)" <ji...@apache.org> on 2018/07/01 18:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-21809) Change Stage Page to use datatables to support sorting columns and searching - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/01 19:30:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24713) AppMatser of spark streaming kafka OOM if there are hundreds of topics consumed - posted by "Yuanbo Liu (JIRA)" <ji...@apache.org> on 2018/07/02 03:13:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24530) Sphinx doesn't render autodoc_docstring_signature correctly (with Python 2?) and pyspark.ml docs are broken - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/07/02 03:19:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24530) Sphinx doesn't render autodoc_docstring_signature correctly (with Python 2?) and pyspark.ml docs are broken - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/07/02 03:20:00 UTC, 5 replies.
- [jira] [Created] (SPARK-24714) AnalysisSuite should use ClassTag to check the runtime instance - posted by "Chia-Ping Tsai (JIRA)" <ji...@apache.org> on 2018/07/02 03:29:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24714) AnalysisSuite should use ClassTag to check the runtime instance - posted by "Chia-Ping Tsai (JIRA)" <ji...@apache.org> on 2018/07/02 03:31:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-24528) Missing optimization for Aggregations/Windowing on a bucketed table - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/07/02 03:56:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24713) AppMatser of spark streaming kafka OOM if there are hundreds of topics consumed - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/02 04:05:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24713) AppMatser of spark streaming kafka OOM if there are hundreds of topics consumed - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/02 04:05:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24715) sbt build brings a wrong jline versions - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/07/02 05:17:00 UTC, 2 replies.
- [jira] [Created] (SPARK-24715) sbt build bring a wrong jline versions - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/07/02 05:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24708) Document the default spark url of master in standalone is "spark://localhost:7070" - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/07/02 05:28:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24706) Support ByteType and ShortType pushdown to parquet - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/02 05:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24706) Support ByteType and ShortType pushdown to parquet - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/02 05:58:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24705) Spark.sql.adaptive.enabled=true is enabled and self-join query - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/07/02 06:19:00 UTC, 7 replies.
- [jira] [Comment Edited] (SPARK-24705) Spark.sql.adaptive.enabled=true is enabled and self-join query - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/07/02 06:21:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24665) Add SQLConf in PySpark to manage all sql configs - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/02 06:37:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24665) Add SQLConf in PySpark to manage all sql configs - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/02 06:37:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24703) Unable to multiply calender interval with long/int - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/07/02 06:58:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-24715) sbt build brings a wrong jline versions - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/02 07:20:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24715) sbt build brings a wrong jline versions - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/02 07:20:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24673) scala sql function from_utc_timestamp second argument could be Column instead of String - posted by "Antonio Murgia (JIRA)" <ji...@apache.org> on 2018/07/02 07:27:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-24714) AnalysisSuite should use ClassTag to check the runtime instance - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/02 08:01:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-8614) Row order preservation for operations on MLlib IndexedRowMatrix - posted by "Anuj Nagpall (JIRA)" <ji...@apache.org> on 2018/07/02 09:09:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24716) Refactor ParquetFilters - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/02 09:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24716) Refactor ParquetFilters - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/02 09:34:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24716) Refactor ParquetFilters - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/02 09:47:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24596) Non-cascading Cache Invalidation - posted by "ant_nebula (JIRA)" <ji...@apache.org> on 2018/07/02 09:52:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-8614) Row order preservation for operations on MLlib IndexedRowMatrix - posted by "Anuj Nagpall (JIRA)" <ji...@apache.org> on 2018/07/02 10:41:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-24711) Integration tests will not work with exclude/include tags - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/02 10:58:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24711) Integration tests will not work with exclude/include tags - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/02 10:58:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24712) TrainValidationSplit ignores label column name and forces to be "label" - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/07/02 11:37:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24712) TrainValidationSplit ignores label column name and forces to be "label" - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/07/02 11:38:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23243) Shuffle+Repartition on an RDD could lead to incorrect answers - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/02 12:41:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-17181) [Spark2.0 web ui]The status of the certain jobs is still displayed as running even if all the stages of this job have already finished - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/07/02 13:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24717) Split out min retain version of state for memory in HDFSBackedStateStoreProvider - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/07/02 14:03:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24717) Split out min retain version of state for memory in HDFSBackedStateStoreProvider - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/07/02 14:04:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-22008) Spark Streaming Dynamic Allocation auto fix maxNumExecutors - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/02 14:06:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24715) sbt build brings a wrong jline versions - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/02 14:11:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24507) Description in "Level of Parallelism in Data Receiving" section of Spark Streaming Programming Guide in is not relevan for the recent Kafka direct apprach - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/02 14:41:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24507) Description in "Level of Parallelism in Data Receiving" section of Spark Streaming Programming Guide in is not relevan for the recent Kafka direct apprach - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/02 14:41:00 UTC, 0 replies.
- [jira] [Issue Comment Deleted] (SPARK-24716) Refactor ParquetFilters - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/02 14:48:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-13343) speculative tasks that didn't commit shouldn't be marked as success - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/07/02 14:50:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-24718) Timestamp support pushdown to parquet data source - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/02 15:46:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24718) Timestamp support pushdown to parquet data source - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/02 15:46:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24718) Timestamp support pushdown to parquet data source - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/02 15:47:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24681) Cannot create a view from a table when a nested column name contains ':' - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/02 17:21:00 UTC, 3 replies.
- [jira] [Created] (SPARK-24719) ClusteringEvaluator supports integer type labels - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/07/02 17:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24681) Cannot create a view from a table when a nested column name contains ':' - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/02 17:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24719) ClusteringEvaluator supports integer type labels - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/07/02 17:23:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24683) SparkLauncher.NO_RESOURCE doesn't work with Java applications - posted by "Matt Cheah (JIRA)" <ji...@apache.org> on 2018/07/02 17:31:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-24720) kafka transaction creates Non-consecutive Offsets (due to transaction offset) making streaming fail when failOnDataLoss=true - posted by "Quentin Ambard (JIRA)" <ji...@apache.org> on 2018/07/02 17:56:00 UTC, 3 replies.
- [jira] [Created] (SPARK-24720) kafka transaction creates Non-consecutive Offsets (due to transaction offset) making streaming fail when failOnDataLoss=true - posted by "Quentin Ambard (JIRA)" <ji...@apache.org> on 2018/07/02 17:56:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24721) Failed to call PythonUDF whose input is the output of another PythonUDF - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/02 17:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24721) Failed to call PythonUDF whose input is the output of another PythonUDF - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/02 17:58:00 UTC, 5 replies.
- [jira] [Commented] (SPARK-24719) ClusteringEvaluator supports integer type labels - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/07/02 18:11:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-24668) PySpark crashes when getting the webui url if the webui is disabled - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/07/02 18:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24668) PySpark crashes when getting the webui url if the webui is disabled - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/07/02 18:28:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24673) scala sql function from_utc_timestamp second argument could be Column instead of String - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/02 19:08:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24428) Remove unused code and fix any related doc in K8s module - posted by "Anirudh Ramanathan (JIRA)" <ji...@apache.org> on 2018/07/02 20:09:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24428) Remove unused code and fix any related doc in K8s module - posted by "Anirudh Ramanathan (JIRA)" <ji...@apache.org> on 2018/07/02 20:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24722) Column-based API for pivoting - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/07/02 21:03:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24722) Column-based API for pivoting - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/02 21:09:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24722) Column-based API for pivoting - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/02 21:09:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24164) Support column list as the pivot column in Pivot - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/07/02 21:16:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24717) Split out min retain version of state for memory in HDFSBackedStateStoreProvider - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/02 22:25:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24579) SPIP: Standardize Optimized Data Exchange between Spark and DL/AI frameworks - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/07/02 23:20:00 UTC, 6 replies.
- [jira] [Created] (SPARK-24723) Discuss necessary info and access in barrier mode + YARN - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/07/02 23:24:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24724) Discuss necessary info and access in barrier mode + Kubernetes - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/07/02 23:25:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24724) Discuss necessary info and access in barrier mode + Kubernetes - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/07/02 23:25:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24725) Discuss necessary info and access in barrier mode + Mesos - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/07/02 23:26:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24725) Discuss necessary info and access in barrier mode + Mesos - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/07/02 23:26:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24615) Accelerator aware task scheduling for Spark - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/07/02 23:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24726) Discuss necessary info and access in barrier mode + Standalone - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/07/02 23:44:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24726) Discuss necessary info and access in barrier mode + Standalone - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/07/02 23:46:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24725) Discuss necessary info and access in barrier mode + Mesos - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/07/03 00:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24727) The cache 100 in CodeGenerator is too small for streaming - posted by "ant_nebula (JIRA)" <ji...@apache.org> on 2018/07/03 01:38:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24727) The cache 100 in CodeGenerator is too small for streaming - posted by "ant_nebula (JIRA)" <ji...@apache.org> on 2018/07/03 01:39:00 UTC, 6 replies.
- [jira] [Created] (SPARK-24728) org.apache.spark.repl.ExecutorClassLoader with cache - posted by "ant_nebula (JIRA)" <ji...@apache.org> on 2018/07/03 02:17:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24728) org.apache.spark.repl.ExecutorClassLoader with cache - posted by "ant_nebula (JIRA)" <ji...@apache.org> on 2018/07/03 02:19:00 UTC, 8 replies.
- [jira] [Commented] (SPARK-9219) ClassCastException in instance of org.apache.spark.rdd.MapPartitionsRDD - posted by "ant_nebula (JIRA)" <ji...@apache.org> on 2018/07/03 02:41:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-18074) UDFs don't work on non-local environment - posted by "ant_nebula (JIRA)" <ji...@apache.org> on 2018/07/03 02:41:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-18015) CLONE - ClassCastException in instance of org.apache.spark.rdd.MapPartitionsRDD - posted by "ant_nebula (JIRA)" <ji...@apache.org> on 2018/07/03 02:42:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-19938) java.lang.ClassCastException: cannot assign instance of scala.collection.immutable.List$SerializationProxy to field - posted by "ant_nebula (JIRA)" <ji...@apache.org> on 2018/07/03 02:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24729) Spark - stackoverflow error - org.apache.spark.sql.catalyst.plans.QueryPlan - posted by "t oo (JIRA)" <ji...@apache.org> on 2018/07/03 03:13:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24385) Trivially-true EqualNullSafe should be handled like EqualTo in Dataset.join - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/03 04:21:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24385) Trivially-true EqualNullSafe should be handled like EqualTo in Dataset.join - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/03 04:22:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24730) Add policy to choose max as global watermark when streaming query has multiple watermarks - posted by "Tathagata Das (JIRA)" <ji...@apache.org> on 2018/07/03 04:28:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24385) Trivially-true EqualNullSafe should be handled like EqualTo in Dataset.join - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/03 04:31:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24730) Add policy to choose max as global watermark when streaming query has multiple watermarks - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/03 04:33:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24730) Add policy to choose max as global watermark when streaming query has multiple watermarks - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/03 04:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-18673) Dataframes doesn't work on Hadoop 3.x; Hive rejects Hadoop version - posted by "Emma Tang (JIRA)" <ji...@apache.org> on 2018/07/03 05:00:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-23698) Spark code contains numerous undefined names in Python 3 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/03 07:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24731) java.io.IOException: s3n://aail-twitter : 400 : Bad Request - posted by "sivakphani (JIRA)" <ji...@apache.org> on 2018/07/03 07:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24731) java.io.IOException: s3n://bucketname: 400 : Bad Request - posted by "sivakphani (JIRA)" <ji...@apache.org> on 2018/07/03 07:41:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24535) Fix java version parsing in SparkR on Windows - posted by "Felix Cheung (JIRA)" <ji...@apache.org> on 2018/07/03 07:50:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24535) Fix java version parsing in SparkR - posted by "Felix Cheung (JIRA)" <ji...@apache.org> on 2018/07/03 07:50:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24535) Fix java version parsing in SparkR on Windows - posted by "Felix Cheung (JIRA)" <ji...@apache.org> on 2018/07/03 07:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24732) Type coercion between MapTypes. - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/07/03 08:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24732) Type coercion between MapTypes. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/03 08:18:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24732) Type coercion between MapTypes. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/03 08:18:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24681) Cannot create a view from a table when a nested column name contains ':' - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/07/03 08:38:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24727) The cache 100 in CodeGenerator is too small for streaming - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/07/03 09:07:00 UTC, 5 replies.
- [jira] [Commented] (SPARK-24729) Spark - stackoverflow error - org.apache.spark.sql.catalyst.plans.QueryPlan - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/07/03 09:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24733) Dataframe saved to parquet can have different metadata then the resulting parquet file - posted by "David Herskovics (JIRA)" <ji...@apache.org> on 2018/07/03 11:09:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24734) Fix containsNull of Concat for array type. - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/07/03 11:21:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24727) The cache 100 in CodeGenerator is too small for streaming - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/03 11:30:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24734) Fix containsNull of Concat for array type. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/03 11:36:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24734) Fix containsNull of Concat for array type. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/03 11:36:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24421) sun.misc.Unsafe in JDK9+ - posted by "Andrew Korzhuev (JIRA)" <ji...@apache.org> on 2018/07/03 11:44:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-24421) sun.misc.Unsafe in JDK9+ - posted by "Andrew Korzhuev (JIRA)" <ji...@apache.org> on 2018/07/03 11:45:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24422) Add JDK9+ in our Jenkins' build servers - posted by "Andrew Korzhuev (JIRA)" <ji...@apache.org> on 2018/07/03 11:47:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-24422) Add JDK9+ in our Jenkins' build servers - posted by "Andrew Korzhuev (JIRA)" <ji...@apache.org> on 2018/07/03 11:47:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24727) The cache 100 in CodeGenerator is too small for streaming - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/03 13:23:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24702) Unable to cast to calendar interval in spark sql. - posted by "Daniel Mateus Pires (JIRA)" <ji...@apache.org> on 2018/07/03 13:26:00 UTC, 4 replies.
- [jira] [Comment Edited] (SPARK-24702) Unable to cast to calendar interval in spark sql. - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/07/03 13:37:02 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24702) Unable to cast to calendar interval in spark sql. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/03 14:32:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24207) PrefixSpan: R API - posted by "Huaxin Gao (JIRA)" <ji...@apache.org> on 2018/07/03 14:43:00 UTC, 1 replies.
- [jira] [Issue Comment Deleted] (SPARK-24702) Unable to cast to calendar interval in spark sql. - posted by "Daniel Mateus Pires (JIRA)" <ji...@apache.org> on 2018/07/03 14:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24420) Upgrade ASM to 6.x to support JDK9+ - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/07/03 17:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-20202) Remove references to org.spark-project.hive - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/03 17:20:00 UTC, 8 replies.
- [jira] [Created] (SPARK-24735) Improve exception when mixing pandas_udf types - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/07/03 20:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-7856) Scalable PCA implementation for tall and fat matrices - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/03 21:29:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-9883) Distance to each cluster given a point (KMeansModel) - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/03 21:31:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-5152) Let metrics.properties file take an hdfs:// path - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/04 00:54:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-5152) Let metrics.properties file take an hdfs:// path - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/04 00:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24709) Inferring schema from JSON string literal - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/04 01:39:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23698) Spark code contains numerous undefined names in Python 3 - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/04 01:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-23698) Spark code contains numerous undefined names in Python 3 - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/04 01:45:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24535) Fix java version parsing in SparkR on Windows - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/07/04 01:57:00 UTC, 2 replies.
- [jira] [Created] (SPARK-24736) --py-files appears to pass non-local URL's into PYTHONPATH directly. - posted by "Jonathan A Weaver (JIRA)" <ji...@apache.org> on 2018/07/04 02:23:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24644) Pyarrow exception while running pandas_udf on pyspark 2.3.1 - posted by "Hichame El Khalfi (JIRA)" <ji...@apache.org> on 2018/07/04 02:45:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-24207) PrefixSpan: R API - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/04 03:25:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24732) Type coercion between MapTypes. - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/04 04:23:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24681) Cannot create a view from a table when a nested column name contains ':' - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/04 04:40:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24467) VectorAssemblerEstimator - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/07/04 06:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24438) Empty strings and null strings are written to the same partition - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/07/04 07:38:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-22384) Refine partition pruning when attribute is wrapped in Cast - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/04 07:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24570) SparkSQL - show schemas/tables in dropdowns of SQL client tools (ie Squirrel SQL, DBVisualizer.etc) - posted by "t oo (JIRA)" <ji...@apache.org> on 2018/07/04 07:56:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24570) SparkSQL - show schemas/tables in dropdowns of SQL client tools (ie Squirrel SQL, DBVisualizer.etc) - posted by "t oo (JIRA)" <ji...@apache.org> on 2018/07/04 07:56:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24704) The order of stages in the DAG graph is incorrect - posted by "Herman van Hovell (JIRA)" <ji...@apache.org> on 2018/07/04 08:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24737) Type coercion between StructTypes. - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/07/04 08:25:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24737) Type coercion between StructTypes. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/04 08:35:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24737) Type coercion between StructTypes. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/04 08:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-13127) Upgrade Parquet to 1.9 (Fixes parquet sorting) - posted by "Al M (JIRA)" <ji...@apache.org> on 2018/07/04 09:37:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-19498) Discussion: Making MLlib APIs extensible for 3rd party libraries - posted by "Peter Knight (JIRA)" <ji...@apache.org> on 2018/07/04 10:09:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-24474) Cores are left idle when there are a lot of tasks to run - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/04 10:38:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-19498) Discussion: Making MLlib APIs extensible for 3rd party libraries - posted by "Peter Knight (JIRA)" <ji...@apache.org> on 2018/07/04 11:28:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24727) The cache 100 in CodeGenerator is too small for streaming - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/04 12:06:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24716) Refactor ParquetFilters - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/04 12:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24738) [HistoryServer] FsHistoryProvider clean outdated event logs at start - posted by "ShuMing Li (JIRA)" <ji...@apache.org> on 2018/07/04 12:41:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24635) Remove Blocks class - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/04 12:43:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24635) Remove Blocks class - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/04 12:43:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24739) PySpark does not work with Python 3.7.0 - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/04 13:48:00 UTC, 3 replies.
- [jira] [Created] (SPARK-24739) PySpark does not work with Python 3.7.0 - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/04 13:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24739) PySpark does not work with Python 3.7.0 - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/04 13:48:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-24739) PySpark does not work with Python 3.7.0 - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/04 13:53:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24740) PySpark tests do not pass with NumPy 0.14.x+ - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/04 15:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24740) PySpark tests do not pass with NumPy 0.14.x+ - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/04 15:32:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-24474) Cores are left idle when there are a lot of tasks to run - posted by "Al M (JIRA)" <ji...@apache.org> on 2018/07/04 16:18:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24740) PySpark tests do not pass with NumPy 0.14.x+ - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/04 16:24:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24710) Information Gain Ratio for decision trees - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/04 18:43:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24672) No job is running but there are active tasks - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/04 18:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23682) Memory issue with Spark structured streaming - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/07/04 21:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-17213) Parquet String Pushdown for Non-Eq Comparisons Broken - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/04 22:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24741) Have a built-in AVRO data source implementation - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/05 00:27:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24741) Have a built-in AVRO data source implementation - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/05 00:27:00 UTC, 4 replies.
- [jira] [Updated] (SPARK-24741) Have a built-in AVRO data source implementation - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/05 00:32:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-24549) Support DecimalType push down to the parquet data sources - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/05 01:23:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24698) In Pyspark's ML, an Identifiable's UID has 20 random characters rather than the 12 mentioned in the documentation. - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/05 02:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24698) In Pyspark's ML, an Identifiable's UID has 20 random characters rather than the 12 mentioned in the documentation. - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/05 02:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24723) Discuss necessary info and access in barrier mode + YARN - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/07/05 02:46:00 UTC, 4 replies.
- [jira] [Created] (SPARK-24742) Field Metadata raises NullPointerException in hashCode method - posted by "Kaya Kupferschmidt (JIRA)" <ji...@apache.org> on 2018/07/05 06:00:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24742) Field Metadata raises NullPointerException in hashCode method - posted by "Kaya Kupferschmidt (JIRA)" <ji...@apache.org> on 2018/07/05 06:01:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24743) Update the DirectKafkaWordCount example to support the new API of Kafka - posted by "luochuan (JIRA)" <ji...@apache.org> on 2018/07/05 06:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24743) Update the DirectKafkaWordCount example to support the new API of Kafka - posted by "luochuan (JIRA)" <ji...@apache.org> on 2018/07/05 06:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24743) Update the JavaDirectKafkaWordCount example to support the new API of Kafka - posted by "luochuan (JIRA)" <ji...@apache.org> on 2018/07/05 07:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24744) Structured Streaming set SparkSession configuration with the value in the metadata if there is not a option set by user. - posted by "bjkonglu (JIRA)" <ji...@apache.org> on 2018/07/05 07:44:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24673) scala sql function from_utc_timestamp second argument could be Column instead of String - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/05 08:13:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24673) scala sql function from_utc_timestamp second argument could be Column instead of String - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/05 08:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24743) Update the JavaDirectKafkaWordCount example to support the new API of Kafka - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/05 08:39:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24743) Update the JavaDirectKafkaWordCount example to support the new API of Kafka - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/05 08:39:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-24744) Structured Streaming set SparkSession configuration with the value in the metadata if there is not a option set by user. - posted by "bjkonglu (JIRA)" <ji...@apache.org> on 2018/07/05 09:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24745) Map function does not keep rdd name - posted by "Igor Pergenitsa (JIRA)" <ji...@apache.org> on 2018/07/05 09:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24744) Structured Streaming set SparkSession configuration with the value in the metadata if there is not a option set by user. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/05 09:16:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24744) Structured Streaming set SparkSession configuration with the value in the metadata if there is not a option set by user. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/05 09:16:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24464) Unit tests for MLlib's Instrumentation - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/07/05 09:56:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24361) Polish code block manipulation API - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/05 12:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24361) Polish code block manipulation API - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/05 12:51:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-23820) Allow the long form of call sites to be recorded in the log - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/05 13:33:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23820) Allow the long form of call sites to be recorded in the log - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/05 13:34:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24711) Integration tests will not work with exclude/include tags - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/05 13:39:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24743) Update the JavaDirectKafkaWordCount example to support the new API of Kafka - posted by "Cody Koeninger (JIRA)" <ji...@apache.org> on 2018/07/05 14:09:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24746) AWS S3 301 Moved Permanently error message even after setting fs.s3a.endpoint for bucket in Mumbai region. - posted by "Kushagra Singh (JIRA)" <ji...@apache.org> on 2018/07/05 15:07:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24675) Rename table: validate existence of new location - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/05 16:25:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24747) Make spark.ml.util.Instrumentation class more flexible - posted by "Bago Amirbekian (JIRA)" <ji...@apache.org> on 2018/07/05 18:15:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24747) Make spark.ml.util.Instrumentation class more flexible - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/05 18:28:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24747) Make spark.ml.util.Instrumentation class more flexible - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/05 18:28:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-24747) Make spark.ml.util.Instrumentation class more flexible - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/07/05 21:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24694) Integration tests pass only one app argument - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/05 21:36:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24694) Integration tests pass only one app argument - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/05 21:36:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24163) Support "ANY" or sub-query for Pivot "IN" clause - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/05 22:26:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24163) Support "ANY" or sub-query for Pivot "IN" clause - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/05 22:26:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24164) Support column list as the pivot column in Pivot - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/05 22:26:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24748) Support for reporting custom metrics via Streaming Query Progress - posted by "Arun Mahadevan (JIRA)" <ji...@apache.org> on 2018/07/06 01:51:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24748) Support for reporting custom metrics via Streaming Query Progress - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/06 02:06:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24748) Support for reporting custom metrics via Streaming Query Progress - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/06 02:06:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24737) Type coercion between StructTypes. - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/06 03:12:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24692) Improvement FilterPushdownBenchmark - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/06 03:15:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24692) Improvement FilterPushdownBenchmark - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/06 03:15:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24742) Field Metadata raises NullPointerException in hashCode method - posted by "Kaya Kupferschmidt (JIRA)" <ji...@apache.org> on 2018/07/06 05:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24742) Field Metadata raises NullPointerException in hashCode method - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/06 05:17:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24746) AWS S3 301 Moved Permanently error message even after setting fs.s3a.endpoint for bucket in Mumbai region. - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/07/06 05:36:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24749) Cannot filter array with named_struct - posted by "pin_zhang (JIRA)" <ji...@apache.org> on 2018/07/06 05:55:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24535) Fix java version parsing in SparkR on Windows - posted by "Felix Cheung (JIRA)" <ji...@apache.org> on 2018/07/06 07:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24749) Cannot filter array with named_struct - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/06 07:30:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24749) Cannot filter array with named_struct - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/06 07:30:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-24723) Discuss necessary info and access in barrier mode + YARN - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/07/06 08:26:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24666) Word2Vec generate infinity vectors when numIterations are large - posted by "ZhongYu (JIRA)" <ji...@apache.org> on 2018/07/06 08:33:00 UTC, 2 replies.
- [jira] [Created] (SPARK-24750) HiveCaseSensitiveInferenceMode with INFER_AND_SAVE will show WRITE permission denied even if select table operation - posted by "Lantao Jin (JIRA)" <ji...@apache.org> on 2018/07/06 09:20:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24750) HiveCaseSensitiveInferenceMode with INFER_AND_SAVE will show WRITE permission denied even if select table operation - posted by "Lantao Jin (JIRA)" <ji...@apache.org> on 2018/07/06 09:21:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24750) HiveCaseSensitiveInferenceMode with INFER_AND_SAVE will show WRITE permission denied even if select table operation - posted by "Lantao Jin (JIRA)" <ji...@apache.org> on 2018/07/06 09:23:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24492) Endless attempted task when TaskCommitDenied exception writing to S3A - posted by "Steve Loughran (JIRA)" <ji...@apache.org> on 2018/07/06 11:37:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24720) kafka transaction creates Non-consecutive Offsets (due to transaction offset) making streaming fail when failOnDataLoss=true - posted by "Cody Koeninger (JIRA)" <ji...@apache.org> on 2018/07/06 13:07:00 UTC, 4 replies.
- [jira] [Reopened] (SPARK-24152) SparkR CRAN feasibility check server problem - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/06 17:01:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24751) [k8s] Relaunch failed executor pods - posted by "Dharmesh Kakadia (JIRA)" <ji...@apache.org> on 2018/07/06 18:36:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24751) [k8s] Relaunch failed executor pods - posted by "Dharmesh Kakadia (JIRA)" <ji...@apache.org> on 2018/07/06 18:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24752) date_format provides incorrect year after a timezone conversation changes the year on a timestamp - posted by "Noah Lidell (JIRA)" <ji...@apache.org> on 2018/07/06 18:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24752) date_format provides incorrect year after a timezone conversation changes the year on a timestamp - posted by "Noah Lidell (JIRA)" <ji...@apache.org> on 2018/07/06 18:55:00 UTC, 2 replies.
- [jira] [Created] (SPARK-24753) bad backslah parsing in SQL statements - posted by "mathieu longtin (JIRA)" <ji...@apache.org> on 2018/07/06 19:25:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24152) SparkR CRAN feasibility check server problem - posted by "Felix Cheung (JIRA)" <ji...@apache.org> on 2018/07/06 20:56:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24018) Spark-without-hadoop package fails to create or read parquet files with snappy compression - posted by "Patrick Clay (JIRA)" <ji...@apache.org> on 2018/07/06 22:27:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-24152) SparkR CRAN feasibility check server problem - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/07 01:21:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24569) Spark Aggregator with output type Option[Boolean] creates column of type Row - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/07 02:55:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24569) Spark Aggregator with output type Option[Boolean] creates column of type Row - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/07 02:56:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24749) Cannot filter array with named_struct - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/07 03:36:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24739) PySpark does not work with Python 3.7.0 - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/07 03:39:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24740) PySpark tests do not pass with NumPy 0.14.x+ - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/07 03:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24754) Minhash integer overflow - posted by "Jiayuan Ma (JIRA)" <ji...@apache.org> on 2018/07/07 05:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24754) Minhash integer overflow - posted by "Kazuaki Ishizaki (JIRA)" <ji...@apache.org> on 2018/07/07 07:12:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24753) bad backslah parsing in SQL statements - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/07/07 07:23:00 UTC, 5 replies.
- [jira] [Issue Comment Deleted] (SPARK-24753) bad backslah parsing in SQL statements - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/07/07 07:24:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24755) Executor loss can cause task to be not resubmitted - posted by "Mridul Muralidharan (JIRA)" <ji...@apache.org> on 2018/07/07 07:31:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24755) Executor loss can cause task to be not resubmitted - posted by "Mridul Muralidharan (JIRA)" <ji...@apache.org> on 2018/07/07 07:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24755) Executor loss can cause task to not be resubmitted - posted by "Mridul Muralidharan (JIRA)" <ji...@apache.org> on 2018/07/07 07:33:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24752) date_format provides incorrect year after a timezone conversation changes the year on a timestamp - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/07/07 08:00:00 UTC, 3 replies.
- [jira] [Created] (SPARK-24756) Incorrect Statistics - posted by "Nick Jordan (JIRA)" <ji...@apache.org> on 2018/07/07 14:32:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24757) Improve error message for broadcast timeouts - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/07/07 15:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24757) Improve error message for broadcast timeouts - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/07 16:01:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24757) Improve error message for broadcast timeouts - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/07 16:01:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24757) Improve error message for broadcast timeouts - posted by "Herman van Hovell (JIRA)" <ji...@apache.org> on 2018/07/07 20:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24758) Create table wants to use /user/hive/warehouse in clean clone - posted by "Bruce Robbins (JIRA)" <ji...@apache.org> on 2018/07/07 21:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24759) No reordering keys for broadcast hash join - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/07 23:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24759) No reordering keys for broadcast hash join - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/07 23:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24759) No reordering keys for broadcast hash join - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/07 23:12:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24759) No reordering keys for broadcast hash join - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/07 23:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24760) Pandas UDF does not handle NaN correctly - posted by "Mortada Mehyar (JIRA)" <ji...@apache.org> on 2018/07/07 23:30:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23629) Building streaming-kafka-0-8-assembly or streaming-flume-assembly adds incompatible jline jar to assembly - posted by "Bruce Robbins (JIRA)" <ji...@apache.org> on 2018/07/07 23:57:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23629) Building streaming-kafka-0-8-assembly or streaming-flume-assembly adds incompatible jline jar to assembly - posted by "Bruce Robbins (JIRA)" <ji...@apache.org> on 2018/07/07 23:58:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24755) Executor loss can cause task to not be resubmitted - posted by "Hieu Tri Huynh (JIRA)" <ji...@apache.org> on 2018/07/08 01:52:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-24755) Executor loss can cause task to not be resubmitted - posted by "Hieu Tri Huynh (JIRA)" <ji...@apache.org> on 2018/07/08 03:06:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24756) Incorrect Statistics - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/07/08 03:23:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24674) Spark on Kubernetes BLAS performance - posted by "Felix Cheung (JIRA)" <ji...@apache.org> on 2018/07/08 03:40:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24528) Missing optimization for Aggregations/Windowing on a bucketed table - posted by "Ohad Raviv (JIRA)" <ji...@apache.org> on 2018/07/08 07:38:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24582) Design: Barrier execution mode - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/07/08 16:44:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24755) Executor loss can cause task to not be resubmitted - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/08 18:45:00 UTC, 2 replies.
- [jira] [Created] (SPARK-24761) Check modifiability of config parameters - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/07/08 19:26:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24761) Check modifiability of config parameters - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/08 19:38:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24761) Check modifiability of config parameters - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/08 19:38:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-13343) speculative tasks that didn't commit shouldn't be marked as success - posted by "Hieu Tri Huynh (JIRA)" <ji...@apache.org> on 2018/07/08 20:59:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-13343) speculative tasks that didn't commit shouldn't be marked as success - posted by "Hieu Tri Huynh (JIRA)" <ji...@apache.org> on 2018/07/08 21:03:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24646) Support wildcard '*' for to spark.yarn.dist.forceDownloadSchemes - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/07/09 02:23:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24646) Support wildcard '*' for to spark.yarn.dist.forceDownloadSchemes - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/07/09 02:23:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24762) Aggregator should be able to use Option of Product encoder - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/07/09 03:40:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24752) date_format provides incorrect year after a timezone conversation changes the year on a timestamp - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/07/09 03:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24762) Aggregator should be able to use Option of Product encoder - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/09 03:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24762) Aggregator should be able to use Option of Product encoder - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/09 03:45:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24576) Upgrade Apache ORC to 1.5.2 - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/07/09 04:09:00 UTC, 2 replies.
- [jira] [Created] (SPARK-24763) Remove redundant key data from value in streaming aggregation - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/07/09 04:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24763) Remove redundant key data from value in streaming aggregation - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/07/09 05:11:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24760) Pandas UDF does not handle NaN correctly - posted by "Mortada Mehyar (JIRA)" <ji...@apache.org> on 2018/07/09 05:18:00 UTC, 10 replies.
- [jira] [Comment Edited] (SPARK-24763) Remove redundant key data from value in streaming aggregation - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/07/09 05:19:00 UTC, 4 replies.
- [jira] [Assigned] (SPARK-24763) Remove redundant key data from value in streaming aggregation - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/09 06:27:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24149) Automatic namespaces discovery in HDFS federation - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/09 06:51:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24438) Empty strings and null strings are written to the same partition - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/07/09 08:38:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24605) size(null) should return null - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/09 10:02:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24438) Empty strings and null strings are written to the same partition - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/09 10:10:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-23936) High-order function: map_concat(map1, map2, ..., mapN) → map - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/07/09 12:21:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23936) High-order function: map_concat(map1, map2, ..., mapN) → map - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/07/09 12:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-16534) Kafka 0.10 Python support - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/07/09 14:53:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24268) DataType in error messages are not coherent - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/09 15:00:00 UTC, 4 replies.
- [jira] [Resolved] (SPARK-24268) DataType in error messages are not coherent - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/09 15:00:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24208) Cannot resolve column in self join after applying Pandas UDF - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/09 15:37:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24208) Cannot resolve column in self join after applying Pandas UDF - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/09 15:37:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-21743) top-most limit should not cause memory leak - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/09 16:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24745) Map function does not keep rdd name - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/07/09 16:31:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-17694) convert DataFrame to DataSet should check columns match - posted by "Paweł Batko (JIRA)" <ji...@apache.org> on 2018/07/09 17:45:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-22187) Update unsaferow format for saved state such that we can set timeouts when state is null - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/09 17:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-18230) MatrixFactorizationModel.recommendProducts throws NoSuchElement exception when the user does not exist - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/09 18:21:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-18230) MatrixFactorizationModel.recommendProducts throws NoSuchElement exception when the user does not exist - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/09 18:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-18230) MatrixFactorizationModel.recommendProducts throws NoSuchElement exception when the user does not exist - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/07/09 18:38:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-23822) Improve error message for Parquet schema mismatches - posted by "nirav patel (JIRA)" <ji...@apache.org> on 2018/07/09 18:58:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24764) Add ServiceLoader implementation for SparkHadoopUtil - posted by "Shruti Gumma (JIRA)" <ji...@apache.org> on 2018/07/09 19:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24179) History Server for Kubernetes - posted by "Chaoran Yu (JIRA)" <ji...@apache.org> on 2018/07/09 19:42:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24018) Spark-without-hadoop package fails to create or read parquet files with snappy compression - posted by "Patrick Clay (JIRA)" <ji...@apache.org> on 2018/07/09 20:50:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-21318) The exception message thrown by `lookupFunction` is ambiguous. - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/09 21:48:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-21318) The exception message thrown by `lookupFunction` is ambiguous. - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/09 21:48:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24759) No reordering keys for broadcast hash join - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/09 21:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-21318) The exception message thrown by `lookupFunction` is ambiguous. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/09 21:55:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24765) Add custom Kubernetes scheduler config parameter to spark-submit - posted by "Nihal Harish (JIRA)" <ji...@apache.org> on 2018/07/09 23:46:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24760) Pandas UDF does not handle NaN correctly - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/07/10 02:17:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-24268) DataType in error messages are not coherent - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/10 06:28:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24268) DataType in error messages are not coherent - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/10 06:28:00 UTC, 4 replies.
- [jira] [Assigned] (SPARK-24718) Timestamp support pushdown to parquet data source - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/10 06:51:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-15613) Incorrect days to millis conversion - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/10 07:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-15613) Incorrect days to millis conversion - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/10 07:39:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24706) Support ByteType and ShortType pushdown to parquet - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/10 07:59:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24678) We should use 'PROCESS_LOCAL' first for Spark-Streaming - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/07/10 12:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24678) We should use 'PROCESS_LOCAL' first for Spark-Streaming - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/07/10 12:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24677) Avoid NoSuchElementException from MedianHeap - posted by "dzcxzl (JIRA)" <ji...@apache.org> on 2018/07/10 12:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24687) When NoClassDefError thrown during task serialization will cause job hang - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/10 13:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24687) When NoClassDefError thrown during task serialization will cause job hang - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/10 13:19:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24766) CreateHiveTableAsSelectCommand and InsertIntoHiveDirCommand won't generate decimal column stats - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/10 15:28:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24766) CreateHiveTableAsSelectCommand and InsertIntoHiveDirCommand won't generate decimal column stats - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/10 15:29:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-22503) Using current processing time to generate windows in streaming processing - posted by "wangsan (JIRA)" <ji...@apache.org> on 2018/07/10 15:46:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24767) Propagate MDC to spark-submit thread in InProcessAppHandle - posted by "Yifei Huang (JIRA)" <ji...@apache.org> on 2018/07/10 15:54:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24760) Pandas UDF does not handle NaN correctly - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/07/10 16:49:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24768) Have a built-in AVRO data source implementation - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/10 17:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24768) Have a built-in AVRO data source implementation - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/10 17:23:00 UTC, 3 replies.
- [jira] [Updated] (SPARK-24765) Add custom Kubernetes scheduler config parameter to spark-submit - posted by "Nihal Harish (JIRA)" <ji...@apache.org> on 2018/07/10 17:27:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24765) Add custom Kubernetes scheduler config parameter to spark-submit - posted by "Yinan Li (JIRA)" <ji...@apache.org> on 2018/07/10 17:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24769) Support for parsing AVRO string column - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/10 17:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24770) Supporting to convert a column into binary of avro format - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/10 17:38:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24769) Support for parsing AVRO binary column - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/10 17:44:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24770) Supporting to convert a column into binary of AVRO format - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/10 17:44:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24768) Have a built-in AVRO data source implementation - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/10 17:44:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24768) Have a built-in AVRO data source implementation - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/10 17:44:00 UTC, 3 replies.
- [jira] [Created] (SPARK-24771) Upgrade AVRO version from 1.7.7 to 1.8 - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/10 17:45:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24772) support reading AVRO logical types - Decimal - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/10 17:46:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24775) support reading AVRO logical types - Duration - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/10 17:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24774) support reading AVRO logical types - Time with different precisions - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/10 17:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24773) support reading AVRO logical types - Timestamp with different precisions - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/10 17:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24777) Refactor AVRO read/write benchmark - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/10 17:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24776) Improve AVRO unit test: use - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/10 17:51:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24776) AVRO unit test: use SQLTestUtils and Replace deprecated methods - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/10 17:55:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24753) bad backslah parsing in SQL statements - posted by "mathieu longtin (JIRA)" <ji...@apache.org> on 2018/07/10 18:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24662) Structured Streaming should support LIMIT - posted by "Tathagata Das (JIRA)" <ji...@apache.org> on 2018/07/10 18:09:01 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24662) Structured Streaming should support LIMIT - posted by "Tathagata Das (JIRA)" <ji...@apache.org> on 2018/07/10 18:09:01 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24765) Add custom Kubernetes scheduler config parameter to spark-submit - posted by "Nihal Harish (JIRA)" <ji...@apache.org> on 2018/07/10 18:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24778) DateTimeUtils.getTimeZone method returns GMT time if timezone cannot be parsed - posted by "Vinitha Reddy Gankidi (JIRA)" <ji...@apache.org> on 2018/07/10 18:48:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24778) DateTimeUtils.getTimeZone method returns GMT time if timezone cannot be parsed - posted by "Vinitha Reddy Gankidi (JIRA)" <ji...@apache.org> on 2018/07/10 19:01:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-24767) Propagate MDC to spark-submit thread in InProcessAppHandle - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/10 19:22:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24767) Propagate MDC to spark-submit thread in InProcessAppHandle - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/10 19:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24778) DateTimeUtils.getTimeZone method returns GMT time if timezone cannot be parsed - posted by "Vinitha Reddy Gankidi (JIRA)" <ji...@apache.org> on 2018/07/10 21:26:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-22947) SPIP: as-of join in Spark SQL - posted by "Ruslan Dautkhanov (JIRA)" <ji...@apache.org> on 2018/07/10 21:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-22658) SPIP: TeansorFlowOnSpark as a Scalable Deep Learning Lib of Apache Spark - posted by "Ruslan Dautkhanov (JIRA)" <ji...@apache.org> on 2018/07/10 21:48:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24779) Add sequence / map_concat / map_from_entries / an option in months_between UDF to disable rounding-off - posted by "Huaxin Gao (JIRA)" <ji...@apache.org> on 2018/07/10 22:28:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24779) Add sequence / map_concat / map_from_entries / an option in months_between UDF to disable rounding-off - posted by "Huaxin Gao (JIRA)" <ji...@apache.org> on 2018/07/10 22:29:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data - posted by "John Vincent Thorpe (JIRA)" <ji...@apache.org> on 2018/07/10 23:47:00 UTC, 9 replies.
- [jira] [Commented] (SPARK-24766) CreateHiveTableAsSelectCommand and InsertIntoHiveDirCommand won't generate decimal column stats - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/11 00:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24766) CreateHiveTableAsSelect and InsertIntoHiveDir won't generate decimal column stats - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/11 01:00:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24766) CreateHiveTableAsSelect and InsertIntoHiveDir won't generate decimal column stats - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/11 01:25:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24780) DataFrame.column_name should take into account DataFrame alias for future joins - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/07/11 01:37:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24780) DataFrame.column_name should resolve to a distinct ref - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/07/11 01:48:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24780) DataFrame.column_name should take into account DataFrame alias for future joins - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/07/11 01:48:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24530) Sphinx doesn't render autodoc_docstring_signature correctly (with Python 2?) and pyspark.ml docs are broken - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/11 02:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24766) CreateHiveTableAsSelect and InsertIntoHiveDir won't generate decimal column stats - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/07/11 02:33:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24753) bad backslah parsing in SQL statements - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/11 02:35:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24730) Add policy to choose max as global watermark when streaming query has multiple watermarks - posted by "Tathagata Das (JIRA)" <ji...@apache.org> on 2018/07/11 02:36:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24766) CreateHiveTableAsSelect and InsertIntoHiveDir won't generate decimal column stats in parquet - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/11 02:41:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24753) bad backslah parsing in SQL statements - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/07/11 03:00:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24697) Fix the reported start offsets in streaming query progress - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/11 03:30:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24165) UDF within when().otherwise() raises NullPointerException - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/11 04:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24736) --py-files not functional for non local URLs. It appears to pass non-local URL's into PYTHONPATH directly. - posted by "Jonathan A Weaver (JIRA)" <ji...@apache.org> on 2018/07/11 04:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24781) Using a reference from Dataset in Filter might not work. - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/07/11 05:08:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24781) Using a reference from Dataset in Filter/Sort might not work. - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/07/11 06:00:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-23529) Specify hostpath volume and mount the volume in Spark driver and executor pods in Kubernetes - posted by "Felix Cheung (JIRA)" <ji...@apache.org> on 2018/07/11 06:11:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23461) vignettes should include model predictions for some ML models - posted by "Felix Cheung (JIRA)" <ji...@apache.org> on 2018/07/11 06:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-23461) vignettes should include model predictions for some ML models - posted by "Felix Cheung (JIRA)" <ji...@apache.org> on 2018/07/11 06:20:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-14220) Build and test Spark against Scala 2.12 - posted by "Felix Cheung (JIRA)" <ji...@apache.org> on 2018/07/11 06:26:01 UTC, 7 replies.
- [jira] [Updated] (SPARK-24644) Pyarrow exception while running pandas_udf on pyspark 2.3.1 - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/11 06:30:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24781) Using a reference from Dataset in Filter/Sort might not work. - posted by "Felix Cheung (JIRA)" <ji...@apache.org> on 2018/07/11 06:31:00 UTC, 5 replies.
- [jira] [Updated] (SPARK-23410) Unable to read jsons in charset different from UTF-8 - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/11 06:33:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24667) If folders managed by DiskBlockManager are deleted manually, shell throws FileNotFoundException - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/11 06:34:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23858) Need to apply pyarrow adjustments to complex types with DateType/TimestampType - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/11 06:48:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24409) exception when sending large list in filter(col(x).isin(list)) - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/11 07:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24370) spark checkpoint creates many 0 byte empty files(partitions) in checkpoint directory - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/11 07:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24782) Simplify conf access in expressions - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/07/11 09:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24782) Simplify conf access in expressions - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/11 09:03:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24782) Simplify conf access in expressions - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/11 09:03:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24781) Using a reference from Dataset in Filter/Sort might not work. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/11 09:06:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-23125) Offset commit failed when spark-streaming batch time is more than kafkaParams session timeout. - posted by "Tim Van Wassenhove (JIRA)" <ji...@apache.org> on 2018/07/11 09:06:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24699) Watermark / Append mode should work with Trigger.Once - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/11 09:30:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24783) spark.sql.shuffle.partitions=0 should throw exception - posted by "Avi minsky (JIRA)" <ji...@apache.org> on 2018/07/11 09:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-19680) Offsets out of range with no configured reset policy for partitions - posted by "Biplob Biswas (JIRA)" <ji...@apache.org> on 2018/07/11 11:14:00 UTC, 2 replies.
- [jira] [Created] (SPARK-24784) Retraining (each document as separate file) creates OOME - posted by "Jatin Puri (JIRA)" <ji...@apache.org> on 2018/07/11 12:25:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-17901) NettyRpcEndpointRef: Error sending message and Caused by: java.util.ConcurrentModificationException - posted by "Harel Ben Attia (JIRA)" <ji...@apache.org> on 2018/07/11 14:20:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24432) Add support for dynamic resource allocation - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/07/11 14:23:00 UTC, 4 replies.
- [jira] [Comment Edited] (SPARK-17901) NettyRpcEndpointRef: Error sending message and Caused by: java.util.ConcurrentModificationException - posted by "Harel Ben Attia (JIRA)" <ji...@apache.org> on 2018/07/11 14:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24562) Allow running same tests with multiple configs in SQLQueryTestSuite - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/11 15:44:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24562) Allow running same tests with multiple configs in SQLQueryTestSuite - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/11 15:45:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23146) Support client mode for Kubernetes cluster backend - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/11 18:04:00 UTC, 2 replies.
- [jira] [Created] (SPARK-24785) Making sure REPL prints Spark UI info and then Welcome message - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/07/11 18:06:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-14220) Build and test Spark against Scala 2.12 - posted by "Erik LaBianca (JIRA)" <ji...@apache.org> on 2018/07/11 18:08:03 UTC, 3 replies.
- [jira] [Assigned] (SPARK-24785) Making sure REPL prints Spark UI info and then Welcome message - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/11 18:17:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24785) Making sure REPL prints Spark UI info and then Welcome message - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/11 18:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24786) Executors not being released after all cached data is unpersisted - posted by "Jeffrey Charles (JIRA)" <ji...@apache.org> on 2018/07/11 18:21:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-20202) Remove references to org.spark-project.hive - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/11 18:25:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24470) RestSubmissionClient to be robust against 404 & non json responses - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/11 18:50:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-23254) Add user guide entry for DataFrame multivariate summary - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/11 18:57:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23254) Add user guide entry for DataFrame multivariate summary - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/11 18:57:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24754) Minhash integer overflow - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/11 19:04:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-24786) Executors not being released after all cached data is unpersisted - posted by "Jeffrey Charles (JIRA)" <ji...@apache.org> on 2018/07/11 19:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24697) Fix the reported start offsets in streaming query progress - posted by "Tathagata Das (JIRA)" <ji...@apache.org> on 2018/07/11 19:46:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24697) Fix the reported start offsets in streaming query progress - posted by "Tathagata Das (JIRA)" <ji...@apache.org> on 2018/07/11 19:46:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24787) Events being dropped at an alarming rate due to hsync being slow for eventLogging - posted by "Sanket Reddy (JIRA)" <ji...@apache.org> on 2018/07/11 20:48:01 UTC, 0 replies.
- [jira] [Commented] (SPARK-24787) Events being dropped at an alarming rate due to hsync being slow for eventLogging - posted by "Sanket Reddy (JIRA)" <ji...@apache.org> on 2018/07/11 20:49:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24788) RelationalGroupedDataset.toString throws errors when grouping by UnresolvedAttribute - posted by "Chris Horn (JIRA)" <ji...@apache.org> on 2018/07/11 21:25:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24788) RelationalGroupedDataset.toString throws errors when grouping by UnresolvedAttribute - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/11 21:31:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24788) RelationalGroupedDataset.toString throws errors when grouping by UnresolvedAttribute - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/11 21:31:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24724) Discuss necessary info and access in barrier mode + Kubernetes - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/11 21:44:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24789) SparkThriftServer - support for hive.server2.authentication.ldap.userFilter - posted by "t oo (JIRA)" <ji...@apache.org> on 2018/07/11 22:17:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24790) Allow complex aggregate expressions in Pivot - posted by "Maryann Xue (JIRA)" <ji...@apache.org> on 2018/07/11 22:44:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24790) Allow complex aggregate expressions in Pivot - posted by "Maryann Xue (JIRA)" <ji...@apache.org> on 2018/07/11 22:44:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24764) Add ServiceLoader implementation for SparkHadoopUtil - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/07/11 22:50:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-24790) Allow complex aggregate expressions in Pivot - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/11 22:57:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24790) Allow complex aggregate expressions in Pivot - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/11 22:57:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24782) Simplify conf access in expressions - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/12 00:32:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24761) Check modifiability of config parameters - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/12 00:40:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24529) Add spotbugs into maven build process - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/12 01:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24529) Add spotbugs into maven build process - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/12 01:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24705) Spark.sql.adaptive.enabled=true is enabled and self-join query - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/12 02:55:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24791) Spark Structured Streaming randomly does not process batch - posted by "Arvind Ramachandran (JIRA)" <ji...@apache.org> on 2018/07/12 03:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24792) Add API `.avro` in DataFrameReader/DataFrameWriter - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/12 04:19:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23885) trying to spark submit 2.3.0 on minikube - posted by "Anirudh Ramanathan (JIRA)" <ji...@apache.org> on 2018/07/12 07:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-21962) Distributed Tracing in Spark - posted by "Andrew Ash (JIRA)" <ji...@apache.org> on 2018/07/12 07:45:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24434) Support user-specified driver and executor pod templates - posted by "Anirudh Ramanathan (JIRA)" <ji...@apache.org> on 2018/07/12 07:51:00 UTC, 2 replies.
- [jira] [Created] (SPARK-24793) Make spark-submit more useful with k8s - posted by "Anirudh Ramanathan (JIRA)" <ji...@apache.org> on 2018/07/12 08:05:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24793) Make spark-submit more useful with k8s - posted by "Anirudh Ramanathan (JIRA)" <ji...@apache.org> on 2018/07/12 08:08:01 UTC, 1 replies.
- [jira] [Commented] (SPARK-24793) Make spark-submit more useful with k8s - posted by "Anirudh Ramanathan (JIRA)" <ji...@apache.org> on 2018/07/12 08:09:00 UTC, 7 replies.
- [jira] [Commented] (SPARK-24770) Supporting to convert a column into binary of AVRO format - posted by "Felipe Melo (JIRA)" <ji...@apache.org> on 2018/07/12 08:13:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-23914) High-order function: array_union(x, y) → array - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/07/12 08:42:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23914) High-order function: array_union(x, y) → array - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/07/12 08:45:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24794) DriverWrapper should have both master addresses in -Dspark.master - posted by "Behroz Sikander (JIRA)" <ji...@apache.org> on 2018/07/12 09:22:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24794) DriverWrapper should have both master addresses in -Dspark.master - posted by "Behroz Sikander (JIRA)" <ji...@apache.org> on 2018/07/12 09:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24769) Support for parsing AVRO binary column - posted by "Felipe Melo (JIRA)" <ji...@apache.org> on 2018/07/12 13:36:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-24691) Add new API `supportDataType` in FileFormat - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/12 16:30:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24691) Add new API `supportDataType` in FileFormat - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/12 16:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24764) Add ServiceLoader implementation for SparkHadoopUtil - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/12 16:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-20168) Enable kinesis to start stream from Initial position specified by a timestamp - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/12 17:06:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-20168) Enable kinesis to start stream from Initial position specified by a timestamp - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/12 17:06:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24795) Implement barrier execution mode - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/07/12 17:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24795) Implement barrier execution mode - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/07/12 17:36:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-20894) Error while checkpointing to HDFS - posted by "Robert Reid (JIRA)" <ji...@apache.org> on 2018/07/12 17:44:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24793) Make spark-submit more useful with k8s - posted by "Erik Erlandson (JIRA)" <ji...@apache.org> on 2018/07/12 19:02:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24610) wholeTextFiles broken for small files - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/07/12 20:38:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24610) wholeTextFiles broken for small files - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/07/12 20:38:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24741) Have a built-in AVRO data source implementation - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/12 20:59:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23007) Add schema evolution test suite for file-based data sources - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/12 21:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24796) Support GROUPED_AGG_PANDAS_UDF in Pivot - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/12 23:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24796) Support GROUPED_AGG_PANDAS_UDF in Pivot - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/12 23:53:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-24790) Allow complex aggregate expressions in Pivot - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/12 23:55:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24537) Add array_remove / array_zip / map_from_arrays / array_distinct - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/13 02:42:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24537) Add array_remove / array_zip / map_from_arrays / array_distinct - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/13 02:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24797) Analyzer should respect spark.sql.hive.convertMetastoreOrc/Parquet when build the data source table - posted by "Nan Zhu (JIRA)" <ji...@apache.org> on 2018/07/13 02:45:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24797) Analyzer should respect spark.sql.hive.convertMetastoreOrc/Parquet when build the data source table - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/13 02:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24797) Analyzer should respect spark.sql.hive.convertMetastoreOrc/Parquet when build the data source table - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/13 02:48:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24568) Code refactoring for DataType equalsXXX methods - posted by "Swapnil (JIRA)" <ji...@apache.org> on 2018/07/13 04:50:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24615) Accelerator aware task scheduling for Spark - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/07/13 05:06:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23486) LookupFunctions should not check the same function name more than once - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24795) Implement barrier execution mode - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/13 05:25:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24795) Implement barrier execution mode - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/13 05:25:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24730) Add policy to choose max as global watermark when streaming query has multiple watermarks - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:26:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24397) Add TaskContext.getLocalProperties in Python - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:27:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-24386) implement continuous processing coalesce(1) - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:27:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-24231) Python API: Provide evaluateEachIteration method or equivalent for spark.ml GBTs - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:27:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-24234) create the bottom-of-task RDD with row buffer - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:27:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-24232) Allow referring to kubernetes secrets as env variable - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:27:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-24697) Fix the reported start offsets in streaming query progress - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:27:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-24396) Add Structured Streaming ForeachWriter for python - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:27:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-24453) Fix error recovering from the failure in a no-data batch - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:27:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-24158) Enable no-data micro batches for streaming joins - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:27:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-24662) Structured Streaming should support LIMIT - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:27:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-23966) Refactoring all checkpoint file writing logic in a common interface - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:28:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-24157) Enable no-data micro batches for streaming aggregation and deduplication - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:28:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-24115) improve instrumentation for spark.ml.tuning - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:28:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-24050) StreamingQuery does not calculate input / processing rates in some cases - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:28:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-24137) [K8s] Mount temporary directories in emptydir volumes - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:28:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-24132) Instrumentation improvement for classification - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:28:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-24039) remove restarting iterators hack - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:28:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-24155) Instrumentation improvement for clustering - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:28:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-24094) Change description strings of v2 streaming sources to reflect the change - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:28:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-24038) refactor continuous write exec to its own class - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:28:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-24056) Make consumer creation lazy in Kafka source for Structured streaming - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:28:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-23491) continuous symptom - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:29:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23748) Support select from temp tables - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:29:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23747) Add EpochCoordinator unit tests - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:29:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23827) StreamingJoinExec should ensure that input data is partitioned into specific number of partitions - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:29:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23559) add epoch ID to data writer factory - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:29:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23503) continuous execution should sequence committed epochs - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:29:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23484) Fix possible race condition in KafkaContinuousReader - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:29:01 UTC, 1 replies.
- [jira] [Updated] (SPARK-23454) Add Trigger information to the Structured Streaming programming guide - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:30:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-23362) Migrate Kafka microbatch source to v2 - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23408) Flaky test: StreamingOuterJoinSuite.left outer early state exclusion on right - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23144) Add console sink for continuous queries - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23097) Migrate text socket source to v2 - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:31:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23099) Migrate foreach sink - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:31:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23142) Add documentation for Continuous Processing - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:31:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23143) Add Python support for continuous trigger - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:31:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23092) Migrate MemoryStream to DataSource V2 - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:31:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-23096) Migrate rate source to v2 - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:31:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-23033) disable task-level retry for continuous execution - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:31:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-23004) Structured Streaming raise "llegalStateException: Cannot remove after already committed or aborted" - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:31:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-23052) Migrate Microbatch ConsoleSink to v2 - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:31:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-22884) ML test for StructuredStreaming: spark.ml.clustering - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-22839) Refactor Kubernetes code for configuring driver/executor pods to use consistent and cleaner abstraction - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-22908) add basic continuous kafka source - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-21925) Update trigger interval documentation in docs with behavior change in Spark 2.2 - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:32:01 UTC, 1 replies.
- [jira] [Updated] (SPARK-22018) Catalyst Optimizer does not preserve top-level metadata while collapsing projects - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:32:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-22238) EnsureStatefulOpPartitioning shouldn't ask for the child RDD before planning is completed - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:32:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-22017) watermark evaluation with multi-input stream operators is unspecified - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:32:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-21464) Minimize deprecation warnings caused by ProcessingTime class - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:33:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-21765) Ensure all leaf nodes that are derived from streaming sources have isStreaming=true - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:33:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-21587) Filter pushdown for EventTime Watermark Operator - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:33:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-21696) State Store can't handle corrupted snapshots - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:33:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-20449) Upgrade breeze version to 0.13.1 - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:33:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-19378) StateOperator metrics should still return the total number of rows in state even if there was no data for a trigger - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 05:34:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24798) sortWithinPartitions(xx) will failed in java.lang.NullPointerException - posted by "shengyao piao (JIRA)" <ji...@apache.org> on 2018/07/13 07:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24799) A solution of dealing with data skew in left,right,inner join - posted by "marymwu (JIRA)" <ji...@apache.org> on 2018/07/13 09:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24776) AVRO unit test: use SQLTestUtils and Replace deprecated methods - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/13 11:47:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24776) AVRO unit test: use SQLTestUtils and Replace deprecated methods - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/13 11:47:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-24799) A solution of dealing with data skew in left,right,inner join - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/07/13 12:25:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24498) Add JDK compiler for runtime codegen - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/07/13 12:55:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-24498) Add JDK compiler for runtime codegen - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/07/13 12:58:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24713) AppMatser of spark streaming kafka OOM if there are hundreds of topics consumed - posted by "Cody Koeninger (JIRA)" <ji...@apache.org> on 2018/07/13 13:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24798) sortWithinPartitions(xx) will failed in java.lang.NullPointerException - posted by "mahmoud mehdi (JIRA)" <ji...@apache.org> on 2018/07/13 13:48:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-24798) sortWithinPartitions(xx) will failed in java.lang.NullPointerException - posted by "mahmoud mehdi (JIRA)" <ji...@apache.org> on 2018/07/13 14:15:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-21791) ORC should support column names with dot - posted by "Furcy Pin (JIRA)" <ji...@apache.org> on 2018/07/13 14:48:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24771) Upgrade AVRO version from 1.7.7 to 1.8 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/13 15:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24771) Upgrade AVRO version from 1.7.7 to 1.8 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/13 15:07:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24781) Using a reference from Dataset in Filter/Sort might not work. - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 15:27:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24776) AVRO unit test: use SQLTestUtils and Replace deprecated methods - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 15:57:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24800) Refactor Avro Serializer and Deserializer - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/13 16:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24800) Refactor Avro Serializer and Deserializer - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/13 16:52:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24800) Refactor Avro Serializer and Deserializer - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/13 16:52:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-24776) AVRO unit test: use SQLTestUtils and Replace deprecated methods - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 17:09:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24797) Analyzer should respect spark.sql.hive.convertMetastoreOrc/Parquet when build the data source table - posted by "Nan Zhu (JIRA)" <ji...@apache.org> on 2018/07/13 17:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23528) Add numIter to ClusteringSummary - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/07/13 18:26:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-23528) Add numIter to ClusteringSummary - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/07/13 18:27:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23528) Add numIter to ClusteringSummary - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/07/13 18:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24801) Empty byte[] arrays in spark.network.sasl.SaslEncryption$EncryptedMessage can waste a lot of memory - posted by "Misha Dmitriev (JIRA)" <ji...@apache.org> on 2018/07/13 18:41:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23831) Add org.apache.derby to IsolatedClientLoader - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/13 21:09:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24766) CreateHiveTableAsSelect and InsertIntoHiveDir won't generate decimal column stats in parquet - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/13 21:23:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24802) Optimization Rule Exclusion - posted by "Maryann Xue (JIRA)" <ji...@apache.org> on 2018/07/13 21:31:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24802) Optimization Rule Exclusion - posted by "Maryann Xue (JIRA)" <ji...@apache.org> on 2018/07/13 21:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24802) Optimization Rule Exclusion - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/13 21:36:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24802) Optimization Rule Exclusion - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/13 21:36:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-12850) Support bucket pruning (predicate pushdown for bucketed tables) - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/14 04:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-12850) Support bucket pruning (predicate pushdown for bucketed tables) - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/14 04:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24803) add support for numeric - posted by "wangtao93 (JIRA)" <ji...@apache.org> on 2018/07/14 04:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24803) add support for numeric - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/14 04:42:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24803) add support for numeric - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/14 04:42:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24803) add support for numeric - posted by "wangtao93 (JIRA)" <ji...@apache.org> on 2018/07/14 06:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24804) There are duplicate words in the title in the DatasetSuite - posted by "hantiantian (JIRA)" <ji...@apache.org> on 2018/07/14 06:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24804) There are duplicate words in the title in the DatasetSuite - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/14 07:22:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24804) There are duplicate words in the title in the DatasetSuite - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/14 07:22:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-17091) Convert IN predicate to equivalent Parquet filter - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/14 09:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-17091) Convert IN predicate to equivalent Parquet filter - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/14 09:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24619) DOCO - usage of authenticate.secret between masters/workers not clear - posted by "Divay Jindal (JIRA)" <ji...@apache.org> on 2018/07/14 10:06:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23255) Add user guide and examples for DataFrame image reading functions - posted by "Divay Jindal (JIRA)" <ji...@apache.org> on 2018/07/14 10:35:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24805) Don't ignore files without .avro extension by default - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/07/14 10:52:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24805) Don't ignore files without .avro extension by default - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/14 11:02:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24805) Don't ignore files without .avro extension by default - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/14 11:02:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24806) Brush up generated code so that JDK Java compilers can handle it - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/07/14 14:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24806) Brush up generated code so that JDK Java compilers can handle it - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/14 14:04:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24806) Brush up generated code so that JDK Java compilers can handle it - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/14 14:04:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24807) Adding files/jars twice: output a warning and add a note - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/07/14 15:03:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24807) Adding files/jars twice: output a warning and add a note - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/14 15:09:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24807) Adding files/jars twice: output a warning and add a note - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/14 15:09:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24754) Minhash integer overflow - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/14 21:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24808) Unable to get the SparkEnv.get.metricsSystem on Spark Shell - posted by "Praneeth Ramesh (JIRA)" <ji...@apache.org> on 2018/07/15 01:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24804) There are duplicate words in the title in the DatasetSuite - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/07/15 01:27:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-24804) There are duplicate words in the title in the DatasetSuite - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/07/15 01:30:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24718) Timestamp support pushdown to parquet data source - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/15 03:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24807) Adding files/jars twice: output a warning and add a note - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/15 05:09:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24799) A solution of dealing with data skew in left,right,inner join - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/15 05:17:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24799) A solution of dealing with data skew in left,right,inner join - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/15 05:18:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24295) Purge Structured streaming FileStreamSinkLog metadata compact file data. - posted by "Li Yuanjian (JIRA)" <ji...@apache.org> on 2018/07/15 07:44:00 UTC, 2 replies.
- [jira] [Created] (SPARK-24809) Serializing LongHashedRelation in executor may result in data error - posted by "Lijia Liu (JIRA)" <ji...@apache.org> on 2018/07/15 10:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24809) Serializing LongHashedRelation in executor may result in data error - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/15 12:04:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24809) Serializing LongHashedRelation in executor may result in data error - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/15 12:04:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-24800) Refactor Avro Serializer and Deserializer - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/15 14:08:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24810) Fix paths to resource files in AvroSuite - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/07/15 14:33:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24810) Fix paths to resource files in AvroSuite - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/07/15 14:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24810) Fix paths to resource files in AvroSuite - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/15 14:41:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24810) Fix paths to resource files in AvroSuite - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/15 14:41:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24457) Performance improvement while converting stringToTimestamp in DateTimeUtils - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/15 17:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24811) Add function `from_avro` and `to_avro` - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/15 18:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24812) Last Access Time in the table description is not valid - posted by "Sujith (JIRA)" <ji...@apache.org> on 2018/07/15 18:56:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24811) Add function `from_avro` and `to_avro` - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/15 18:56:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24811) Add function `from_avro` and `to_avro` - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/15 18:56:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24769) Support for parsing AVRO binary column - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/15 19:03:00 UTC, 0 replies.
- [jira] [Issue Comment Deleted] (SPARK-24770) Supporting to convert a column into binary of AVRO format - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/15 19:03:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24770) Supporting to convert a column into binary of AVRO format - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/15 19:03:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24812) Last Access Time in the table description is not valid - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/15 19:37:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24812) Last Access Time in the table description is not valid - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/15 19:37:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24796) Support GROUPED_AGG_PANDAS_UDF in Pivot - posted by "Li Jin (JIRA)" <ji...@apache.org> on 2018/07/15 19:58:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24721) Failed to call PythonUDF whose input is the output of another PythonUDF - posted by "Li Jin (JIRA)" <ji...@apache.org> on 2018/07/15 19:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24624) Can not mix vectorized and non-vectorized UDFs - posted by "Li Jin (JIRA)" <ji...@apache.org> on 2018/07/15 20:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24813) HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/15 21:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24813) HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/15 21:58:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-24813) HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/15 21:58:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24632) Allow 3rd-party libraries to use pyspark.ml abstractions for Java wrappers for persistence - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/07/15 23:47:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24498) Add JDK compiler for runtime codegen - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/16 00:48:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24814) Relationship between catalog and datasources - posted by "Bruce Robbins (JIRA)" <ji...@apache.org> on 2018/07/16 01:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24815) Structured Streaming should support dynamic allocation - posted by "Karthik Palaniappan (JIRA)" <ji...@apache.org> on 2018/07/16 01:23:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24813) HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/16 01:33:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-20220) Add thrift scheduling pool config in scheduling docs - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/16 02:06:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23259) Clean up legacy code around hive external catalog - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/16 03:18:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24676) Project required data from parsed data when csvColumnPruning disabled - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/16 03:23:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24813) HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/16 04:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24816) Improvement data pushdown by repartitionByRange - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/16 05:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24816) SQL interface support repartitionByRange - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/16 05:09:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24816) SQL interface support repartitionByRange - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/16 05:09:00 UTC, 7 replies.
- [jira] [Issue Comment Deleted] (SPARK-21097) Dynamic allocation will preserve cached data - posted by "donglin (JIRA)" <ji...@apache.org> on 2018/07/16 05:16:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24810) Fix paths to resource files in AvroSuite - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/16 06:03:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23874) Upgrade apache/arrow to 0.10.0 - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/16 06:19:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-24558) Driver prints the wrong info in the log when the executor which holds cacheBlock is IDLE.Time-out value displayed is not as per configuration value. - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/16 06:55:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24558) Driver prints the wrong info in the log when the executor which holds cacheBlock is IDLE.Time-out value displayed is not as per configuration value. - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/16 06:57:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24558) Driver prints the wrong info in the log when the executor which holds cacheBlock is IDLE.Time-out value displayed is not as per configuration value. - posted by "sandeep katta (JIRA)" <ji...@apache.org> on 2018/07/16 06:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24549) Support DecimalType push down to the parquet data sources - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/16 07:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24538) ByteArrayDecimalType support push down to parquet data sources - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/16 07:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24538) ByteArrayDecimalType support push down to the data sources - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/16 07:49:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24817) Implement BarrierTaskContext.barrier() - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/07/16 08:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24818) Ensure all the barrier tasks in the same stage are launched together - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/07/16 08:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24819) Fail fast when no enough slots to launch the barrier stage on job submitted - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/07/16 08:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24820) Fail fast when submitted job contains PartitionPruningRDD in a barrier stage - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/07/16 08:22:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24821) Fail fast when submitted job compute on a subset of all the partitions for a barrier stage - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/07/16 08:24:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24822) Python support for barrier execution mode - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/07/16 08:25:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24823) Cancel a job that contains barrier stage(s) if the barrier tasks don't get launched within a configured time - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/07/16 08:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24824) Make Spark task speculation a per-stage config - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/07/16 08:30:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24794) DriverWrapper should have both master addresses in -Dspark.master - posted by "Ecaterina (JIRA)" <ji...@apache.org> on 2018/07/16 09:03:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24816) SQL interface support repartitionByRange - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/16 09:23:00 UTC, 1 replies.
- [jira] [Issue Comment Deleted] (SPARK-24816) SQL interface support repartitionByRange - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/16 09:34:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24812) Last Access Time in the table description is not valid - posted by "Sujith (JIRA)" <ji...@apache.org> on 2018/07/16 10:06:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-20050) Kafka 0.10 DirectStream doesn't commit last processed batch's offset when graceful shutdown - posted by "Sasaki Toru (JIRA)" <ji...@apache.org> on 2018/07/16 12:23:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24182) Improve error message for client mode when AM fails - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/16 12:46:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-15343) NoClassDefFoundError when initializing Spark with YARN - posted by "Antony (JIRA)" <ji...@apache.org> on 2018/07/16 13:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24615) Accelerator aware task scheduling for Spark - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/07/16 14:21:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-20174) Analyzer gives mysterious AnalysisException when posexplode used in withColumn - posted by "Valery Khamenya (JIRA)" <ji...@apache.org> on 2018/07/16 14:53:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-18230) MatrixFactorizationModel.recommendProducts throws NoSuchElement exception when the user does not exist - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/16 14:53:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24529) Add spotbugs into maven build process - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/16 14:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24734) Fix containsNull of Concat for array type. - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/16 15:18:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23901) Data Masking Functions - posted by "Marek Novotny (JIRA)" <ji...@apache.org> on 2018/07/16 16:30:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-23901) Data Masking Functions - posted by "Reynold Xin (JIRA)" <ji...@apache.org> on 2018/07/16 16:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-17557) SQL query on parquet table java.lang.UnsupportedOperationException: org.apache.parquet.column.values.dictionary.PlainValuesDictionary - posted by "Romeo Kienzer (JIRA)" <ji...@apache.org> on 2018/07/16 17:58:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-17557) SQL query on parquet table java.lang.UnsupportedOperationException: org.apache.parquet.column.values.dictionary.PlainValuesDictionary - posted by "Romeo Kienzer (JIRA)" <ji...@apache.org> on 2018/07/16 17:59:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-16617) Upgrade to Avro 1.8.x - posted by "Thomas Omans (JIRA)" <ji...@apache.org> on 2018/07/16 19:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24801) Empty byte[] arrays in spark.network.sasl.SaslEncryption$EncryptedMessage can waste a lot of memory - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/07/16 19:54:00 UTC, 5 replies.
- [jira] [Resolved] (SPARK-23901) Data Masking Functions - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/16 21:38:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-23901) Data Masking Functions - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/16 21:38:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23901) Data Masking Functions - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/16 21:39:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24805) Don't ignore files without .avro extension by default - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/16 21:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24825) [K8S][TEST] Kubernetes integration tests don't trace the maven project dependency structure - posted by "Matt Cheah (JIRA)" <ji...@apache.org> on 2018/07/16 22:31:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24825) [K8S][TEST] Kubernetes integration tests don't trace the maven project dependency structure - posted by "Matt Cheah (JIRA)" <ji...@apache.org> on 2018/07/16 22:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24402) Optimize `In` expression when only one element in the collection or collection is empty - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/16 22:35:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24826) Self-Join not working in Apache Spark 2.2.2 - posted by "Michael Yannakopoulos (JIRA)" <ji...@apache.org> on 2018/07/16 22:42:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24826) Self-Join not working in Apache Spark 2.2.2 - posted by "Michael Yannakopoulos (JIRA)" <ji...@apache.org> on 2018/07/16 22:44:00 UTC, 4 replies.
- [jira] [Created] (SPARK-24827) Some memory waste in History Server by strings in AccumulableInfo objects - posted by "Misha Dmitriev (JIRA)" <ji...@apache.org> on 2018/07/16 22:49:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24615) Accelerator-aware task scheduling for Spark - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/07/17 00:07:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-21481) Add indexOf method in ml.feature.HashingTF similar to mllib.feature.HashingTF - posted by "chenzhiming (JIRA)" <ji...@apache.org> on 2018/07/17 01:14:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-23259) Clean up legacy code around hive external catalog - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/17 01:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-23259) Clean up legacy code around hive external catalog - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/17 01:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-20220) Add thrift scheduling pool config in scheduling docs - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/17 01:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-20220) Add thrift scheduling pool config in scheduling docs - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/17 01:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24644) Pyarrow exception while running pandas_udf on pyspark 2.3.1 - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/17 02:40:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24615) Accelerator-aware task scheduling for Spark - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/07/17 02:45:00 UTC, 23 replies.
- [jira] [Resolved] (SPARK-24798) sortWithinPartitions(xx) will failed in java.lang.NullPointerException - posted by "shengyao piao (JIRA)" <ji...@apache.org> on 2018/07/17 03:04:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24402) Optimize `In` expression when only one element in the collection or collection is empty - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/17 03:37:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-24402) Optimize `In` expression when only one element in the collection or collection is empty - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/17 03:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24568) Code refactoring for DataType equalsXXX methods - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/17 04:37:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24828) Incompatible parquet formats - java.lang.UnsupportedOperationException: org.apache.parquet.column.values.dictionary.PlainValuesDictionary$PlainLongDictionary - posted by "Romeo Kienzer (JIRA)" <ji...@apache.org> on 2018/07/17 05:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24828) Incompatible parquet formats - java.lang.UnsupportedOperationException: org.apache.parquet.column.values.dictionary.PlainValuesDictionary$PlainLongDictionary - posted by "Romeo Kienzer (JIRA)" <ji...@apache.org> on 2018/07/17 05:57:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-24402) Optimize `In` expression when only one element in the collection or collection is empty - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/17 06:04:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24609) PySpark/SparkR doc doesn't explain RandomForestClassifier.featureSubsetStrategy well - posted by "zhengruifeng (JIRA)" <ji...@apache.org> on 2018/07/17 09:06:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24609) PySpark/SparkR doc doesn't explain RandomForestClassifier.featureSubsetStrategy well - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/17 09:13:00 UTC, 2 replies.
- [jira] [Created] (SPARK-24829) CAST AS FLOAT inconsistent with Hive - posted by "zuotingbing (JIRA)" <ji...@apache.org> on 2018/07/17 09:20:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24829) CAST AS FLOAT inconsistent with Hive - posted by "zuotingbing (JIRA)" <ji...@apache.org> on 2018/07/17 09:27:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24829) CAST AS FLOAT inconsistent with Hive - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/17 09:29:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24829) CAST AS FLOAT inconsistent with Hive - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/17 09:29:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24830) Problem with logging on Glassfish - posted by "vadim (JIRA)" <ji...@apache.org> on 2018/07/17 09:56:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24544) Print actual failure cause when look up function failed - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/17 10:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24831) Spark Executor class create new serializer each time - posted by "Izek Greenfield (JIRA)" <ji...@apache.org> on 2018/07/17 10:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24832) Improve inputMetrics's bytesRead update for ColumnarBatch - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/07/17 10:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24832) Improve inputMetrics's bytesRead update for ColumnarBatch - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/07/17 10:40:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24832) Improve inputMetrics's bytesRead update for ColumnarBatch - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/17 10:46:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-23231) Add doc for string indexer ordering to user guide (also to RFormula guide) - posted by "zhengruifeng (JIRA)" <ji...@apache.org> on 2018/07/17 11:00:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-23231) Add doc for string indexer ordering to user guide (also to RFormula guide) - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/17 11:02:00 UTC, 2 replies.
- [jira] [Created] (SPARK-24833) Allow specifying Kubernetes host name aliases in the pod specs - posted by "Rob Vesse (JIRA)" <ji...@apache.org> on 2018/07/17 11:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24828) Incompatible parquet formats - java.lang.UnsupportedOperationException: org.apache.parquet.column.values.dictionary.PlainValuesDictionary$PlainLongDictionary - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/17 13:20:00 UTC, 7 replies.
- [jira] [Created] (SPARK-24834) Utils#nanSafeCompare{Double,Float} functions do not differ from normal java double/float comparison - posted by "Benjamin Duffield (JIRA)" <ji...@apache.org> on 2018/07/17 14:24:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24834) Utils#nanSafeCompare{Double,Float} functions do not differ from normal java double/float comparison - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/17 14:28:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24834) Utils#nanSafeCompare{Double,Float} functions do not differ from normal java double/float comparison - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/17 14:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24305) Avoid serialization of private fields in new collection expressions - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/17 15:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24305) Avoid serialization of private fields in new collection expressions - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/17 15:09:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24833) Allow specifying Kubernetes host name aliases in the pod specs - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/17 15:36:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24833) Allow specifying Kubernetes host name aliases in the pod specs - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/17 15:36:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-9850) Adaptive execution in Spark - posted by "Michail Giannakopoulos (JIRA)" <ji...@apache.org> on 2018/07/17 16:21:01 UTC, 1 replies.
- [jira] [Resolved] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/17 16:27:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/17 16:27:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24402) Optimize `In` expression when only one element in the collection or collection is empty - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/17 17:40:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24070) TPC-DS Performance Tests for Parquet 1.10.0 Upgrade - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/17 18:33:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24071) Micro-benchmark of Parquet Filter Pushdown - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/17 18:35:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24835) col function ignores drop - posted by "Michael Souder (JIRA)" <ji...@apache.org> on 2018/07/17 19:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24836) New option - ignoreExtension - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/07/17 19:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24836) New option - ignoreExtension - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/17 19:24:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24836) New option - ignoreExtension - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/17 19:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24747) Make spark.ml.util.Instrumentation class more flexible - posted by "Joseph K. Bradley (JIRA)" <ji...@apache.org> on 2018/07/17 20:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24837) Add kafka as spark logs/metrics sink - posted by "Sandish Kumar HN (JIRA)" <ji...@apache.org> on 2018/07/17 20:16:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24837) Add kafka as spark logs/metrics sink - posted by "Sandish Kumar HN (JIRA)" <ji...@apache.org> on 2018/07/17 20:17:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24825) [K8S][TEST] Kubernetes integration tests don't trace the maven project dependency structure - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/07/17 20:21:00 UTC, 11 replies.
- [jira] [Commented] (SPARK-24825) [K8S][TEST] Kubernetes integration tests don't trace the maven project dependency structure - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/07/17 20:21:00 UTC, 11 replies.
- [jira] [Updated] (SPARK-24837) Add kafka as spark metrics sink - posted by "Sandish Kumar HN (JIRA)" <ji...@apache.org> on 2018/07/17 20:22:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24536) Query with nonsensical LIMIT hits AssertionError - posted by "Nihar Sheth (JIRA)" <ji...@apache.org> on 2018/07/17 20:33:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-23723) New encoding option for json datasource - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/17 20:48:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24838) Support uncorrelated IN/EXISTS subqueries for more operators - posted by "Qifan Pu (JIRA)" <ji...@apache.org> on 2018/07/17 20:59:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24838) Support uncorrelated IN/EXISTS subqueries for more operators - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/17 21:04:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-24681) Cannot create a view from a table when a nested column name contains ':' - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/17 21:16:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24835) col function ignores drop - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/07/17 21:26:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-24835) col function ignores drop - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/07/17 21:26:00 UTC, 0 replies.
- [jira] [Issue Comment Deleted] (SPARK-24825) [K8S][TEST] Kubernetes integration tests don't trace the maven project dependency structure - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/07/17 22:56:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24839) Incorrect drop of lit column results in cross join. - posted by "marios iliofotou (JIRA)" <ji...@apache.org> on 2018/07/17 23:49:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24839) Incorrect drop of lit column results in cross join. - posted by "marios iliofotou (JIRA)" <ji...@apache.org> on 2018/07/17 23:51:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24839) Incorrect drop of lit() column results in cross join - posted by "marios iliofotou (JIRA)" <ji...@apache.org> on 2018/07/17 23:55:00 UTC, 7 replies.
- [jira] [Assigned] (SPARK-24825) [K8S][TEST] Kubernetes integration tests don't trace the maven project dependency structure - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/18 00:04:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24839) Incorrect drop of lit() column results in cross join - posted by "marios iliofotou (JIRA)" <ji...@apache.org> on 2018/07/18 00:14:00 UTC, 0 replies.
- [jira] [Issue Comment Deleted] (SPARK-24839) Incorrect drop of lit() column results in cross join - posted by "marios iliofotou (JIRA)" <ji...@apache.org> on 2018/07/18 00:14:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24828) Incompatible parquet formats - java.lang.UnsupportedOperationException: org.apache.parquet.column.values.dictionary.PlainValuesDictionary$PlainLongDictionary - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/18 01:28:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-23998) It may be better to add @transient to field 'taskMemoryManager' in class Task, for it is only be set and used in executor side - posted by "eaton (JIRA)" <ji...@apache.org> on 2018/07/18 02:04:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24829) In Spark Thrift Server, CAST AS FLOAT inconsistent with spark-shell or spark-sql - posted by "zuotingbing (JIRA)" <ji...@apache.org> on 2018/07/18 03:16:00 UTC, 3 replies.
- [jira] [Updated] (SPARK-24809) Serializing LongHashedRelation in executor may result in data error - posted by "zenglinxi (JIRA)" <ji...@apache.org> on 2018/07/18 03:40:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24386) implement continuous processing coalesce(1) - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/18 04:05:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24809) Serializing LongHashedRelation in executor may result in data error - posted by "zenglinxi (JIRA)" <ji...@apache.org> on 2018/07/18 04:10:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24840) do not use dummy filter to switch codegen on/off - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/18 05:33:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24840) do not use dummy filter to switch codegen on/off - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/18 05:34:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24840) do not use dummy filter to switch codegen on/off - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/18 05:34:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24828) Incompatible parquet formats - java.lang.UnsupportedOperationException: org.apache.parquet.column.values.dictionary.PlainValuesDictionary$PlainLongDictionary - posted by "Romeo Kienzer (JIRA)" <ji...@apache.org> on 2018/07/18 06:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24576) Upgrade Apache ORC to 1.5.2 - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/18 06:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24841) Memory leak in converting spark dataframe to pandas dataframe - posted by "Piyush Seth (JIRA)" <ji...@apache.org> on 2018/07/18 07:01:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24842) self-join query fails on different letter case for same field - posted by "CHENYANG XU (JIRA)" <ji...@apache.org> on 2018/07/18 09:24:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24843) Spark2 job (in cluster mode) is unable to execute steps in HBase (error# java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/CompatibilityFactory) - posted by "Manish (JIRA)" <ji...@apache.org> on 2018/07/18 09:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24843) Spark2 job (in cluster mode) is unable to execute steps in HBase (error# java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/CompatibilityFactory) - posted by "Manish (JIRA)" <ji...@apache.org> on 2018/07/18 10:02:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24844) spark REST API need to add ipFilter - posted by "daijiacheng (JIRA)" <ji...@apache.org> on 2018/07/18 10:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24843) Spark2 job (in cluster mode) is unable to execute steps in HBase (error# java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/CompatibilityFactory) - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/18 10:34:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24845) spark distribution generate exception while locally worked correctly - posted by "Hossein Vatani (JIRA)" <ji...@apache.org> on 2018/07/18 10:35:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24845) spark distribution generate exception while locally worked correctly - posted by "Hossein Vatani (JIRA)" <ji...@apache.org> on 2018/07/18 11:05:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24536) Query with nonsensical LIMIT hits AssertionError - posted by "Herman van Hovell (JIRA)" <ji...@apache.org> on 2018/07/18 11:08:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24846) Stabilize expression cannonicalization - posted by "Herman van Hovell (JIRA)" <ji...@apache.org> on 2018/07/18 11:12:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24838) Support uncorrelated IN/EXISTS subqueries for more operators - posted by "Herman van Hovell (JIRA)" <ji...@apache.org> on 2018/07/18 11:14:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-18600) BZ2 CRC read error needs better reporting - posted by "Herman van Hovell (JIRA)" <ji...@apache.org> on 2018/07/18 11:27:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23612) Specify formats for individual DateType and TimestampType columns in schemas - posted by "Herman van Hovell (JIRA)" <ji...@apache.org> on 2018/07/18 11:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24847) ScalaReflection#schemaFor occasionally fails to detect schema for Seq of type alias - posted by "Ahmed Mahran (JIRA)" <ji...@apache.org> on 2018/07/18 11:44:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24848) When a stage fails onStageCompleted is called before onTaskEnd - posted by "Yavgeni Hotimsky (JIRA)" <ji...@apache.org> on 2018/07/18 12:34:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24848) When a stage fails onStageCompleted is called before onTaskEnd - posted by "Yavgeni Hotimsky (JIRA)" <ji...@apache.org> on 2018/07/18 12:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23928) High-order function: shuffle(x) → array - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/18 12:52:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24844) spark REST API need to add ipFilter - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/07/18 13:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24844) spark REST API need to add ipFilter - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/07/18 13:22:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24849) Convert StructType to DDL string - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/07/18 13:59:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24849) Convert StructType to DDL string - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/07/18 14:00:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-24804) There are duplicate words in the title in the DatasetSuite - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/18 14:43:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24093) Make some fields of KafkaStreamWriter/InternalRowMicroBatchWriter visible to outside of the classes - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/18 14:44:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24628) Typos of the example code in docs/mllib-data-types.md - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/18 14:47:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24628) Typos of the example code in docs/mllib-data-types.md - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/18 14:47:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24849) Convert StructType to DDL string - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/18 14:49:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24268) DataType in error messages are not coherent - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/18 15:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24850) Query plan string representation grows exponentially on queries with recursive cached datasets - posted by "Onur Satici (JIRA)" <ji...@apache.org> on 2018/07/18 15:39:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24850) Query plan string representation grows exponentially on queries with recursive cached datasets - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/18 15:54:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24850) Query plan string representation grows exponentially on queries with recursive cached datasets - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/18 15:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24846) Stabilize expression cannonicalization - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/18 16:32:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24846) Stabilize expression cannonicalization - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/18 16:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24536) Query with nonsensical LIMIT hits AssertionError - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/18 17:01:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24851) Map a Stage ID to it's Associated Job ID in UI - posted by "Parth Gandhi (JIRA)" <ji...@apache.org> on 2018/07/18 17:20:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-21261) SparkSQL regexpExpressions example - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/18 17:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24852) Have spark.ml training use updated `Instrumentation` APIs. - posted by "Bago Amirbekian (JIRA)" <ji...@apache.org> on 2018/07/18 17:41:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-12126) JDBC datasource processes filters only commonly pushed down. - posted by "Kyle Prifogle (JIRA)" <ji...@apache.org> on 2018/07/18 17:41:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-12449) Pushing down arbitrary logical plans to data sources - posted by "Kyle Prifogle (JIRA)" <ji...@apache.org> on 2018/07/18 17:43:01 UTC, 0 replies.
- [jira] [Commented] (SPARK-24852) Have spark.ml training use updated `Instrumentation` APIs. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/18 17:43:01 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24852) Have spark.ml training use updated `Instrumentation` APIs. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/18 17:43:01 UTC, 2 replies.
- [jira] [Commented] (SPARK-24677) Avoid NoSuchElementException from MedianHeap - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/07/18 18:22:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24677) Avoid NoSuchElementException from MedianHeap - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/07/18 18:23:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24677) TaskSetManager not updating successfulTaskDurations for old stage attempts - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/07/18 18:24:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24677) TaskSetManager not updating successfulTaskDurations for old stage attempts - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/07/18 18:29:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24677) TaskSetManager not updating successfulTaskDurations for old stage attempts - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/07/18 18:30:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24851) Map a Stage ID to it's Associated Job ID in UI - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/18 18:36:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24851) Map a Stage ID to it's Associated Job ID in UI - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/18 18:36:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-12449) Pushing down arbitrary logical plans to data sources - posted by "Kyle Prifogle (JIRA)" <ji...@apache.org> on 2018/07/18 18:45:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24853) Support Column type for withColumn and withColumnRenamed apis - posted by "nirav patel (JIRA)" <ji...@apache.org> on 2018/07/18 18:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-22151) PYTHONPATH not picked up from the spark.yarn.appMasterEnv properly - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/07/18 19:08:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-22151) PYTHONPATH not picked up from the spark.yarn.appMasterEnv properly - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/07/18 19:08:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24852) Have spark.ml training use updated `Instrumentation` APIs. - posted by "Joseph K. Bradley (JIRA)" <ji...@apache.org> on 2018/07/18 20:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24825) [K8S][TEST] Kubernetes integration tests don't trace the maven project dependency structure - posted by "shane knapp (JIRA)" <ji...@apache.org> on 2018/07/18 21:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24129) Add option to pass --build-arg's to docker-image-tool.sh - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/18 21:19:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24129) Add option to pass --build-arg's to docker-image-tool.sh - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/18 21:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23908) High-order function: transform(array, function) → array - posted by "Frederick Reiss (JIRA)" <ji...@apache.org> on 2018/07/18 21:24:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-23908) High-order function: transform(array, function) → array - posted by "Herman van Hovell (JIRA)" <ji...@apache.org> on 2018/07/18 21:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24854) Gather all options into AvroOptions - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/07/18 21:39:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24854) Gather all options into AvroOptions - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/18 21:44:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24854) Gather all options into AvroOptions - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/18 21:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-18186) Migrate HiveUDAFFunction to TypedImperativeAggregate for partial aggregation support - posted by "Parth Gandhi (JIRA)" <ji...@apache.org> on 2018/07/18 21:54:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-18186) Migrate HiveUDAFFunction to TypedImperativeAggregate for partial aggregation support - posted by "Parth Gandhi (JIRA)" <ji...@apache.org> on 2018/07/18 21:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24814) Relationship between catalog and datasources - posted by "Bruce Robbins (JIRA)" <ji...@apache.org> on 2018/07/18 23:25:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-21261) SparkSQL regexpExpressions example - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/18 23:40:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-21261) SparkSQL regexpExpressions example - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/18 23:40:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-21261) SparkSQL regexpExpressions example - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/18 23:40:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24801) Empty byte[] arrays in spark.network.sasl.SaslEncryption$EncryptedMessage can waste a lot of memory - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/18 23:42:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24855) Built-in AVRO support should support specified schema on write - posted by "Brian Lindblom (JIRA)" <ji...@apache.org> on 2018/07/19 00:03:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24855) Built-in AVRO support should support specified schema on write - posted by "Brian Lindblom (JIRA)" <ji...@apache.org> on 2018/07/19 00:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24855) Built-in AVRO support should support specified schema on write - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/07/19 01:09:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-24854) Gather all options into AvroOptions - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/19 01:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24853) Support Column type for withColumn and withColumnRenamed apis - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/19 01:31:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24851) Map a Stage ID to it's Associated Job ID in UI - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/19 02:42:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23357) 'SHOW TABLE EXTENDED LIKE pattern=STRING' add ‘Partitioned’ display similar to hive, and partition is empty, also need to show empty partition field [] - posted by "guoxiaolongzte (JIRA)" <ji...@apache.org> on 2018/07/19 03:31:01 UTC, 0 replies.
- [jira] [Commented] (SPARK-24701) SparkMaster WebUI allow all appids to be shown in detail on port 4040 rather than different ports per app - posted by "guoxiaolongzte (JIRA)" <ji...@apache.org> on 2018/07/19 03:44:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-23967) Description add native sql show in SQL page. - posted by "guoxiaolongzte (JIRA)" <ji...@apache.org> on 2018/07/19 03:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24840) do not use dummy filter to switch codegen on/off - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/19 03:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24856) spark need upgrade Guava for use gRPC - posted by "alibaltschun (JIRA)" <ji...@apache.org> on 2018/07/19 04:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24375) Design sketch: support barrier scheduling in Apache Spark - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/07/19 04:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24857) required the sample code test the spark steaming job in kubernates and write the data in remote hdfs file system - posted by "kumpatla murali krishna (JIRA)" <ji...@apache.org> on 2018/07/19 06:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24858) Avoid unnecessary parquet footer reads - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/19 06:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24858) Avoid unnecessary parquet footer reads - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/19 06:56:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24858) Avoid unnecessary parquet footer reads - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/19 06:56:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24717) Split out min retain version of state for memory in HDFSBackedStateStoreProvider - posted by "Tathagata Das (JIRA)" <ji...@apache.org> on 2018/07/19 07:09:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24701) SparkMaster WebUI allow all appids to be shown in detail on port 4040 rather than different ports per app - posted by "t oo (JIRA)" <ji...@apache.org> on 2018/07/19 07:35:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-23984) PySpark Bindings for K8S - posted by "Ilan Filonenko (JIRA)" <ji...@apache.org> on 2018/07/19 07:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23731) FileSourceScanExec throws NullPointerException in subexpression elimination - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/19 07:53:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23997) Configurable max number of buckets - posted by "Matthias Wolf (JIRA)" <ji...@apache.org> on 2018/07/19 08:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24794) DriverWrapper should have both master addresses in -Dspark.master - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/19 09:02:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24859) Predicates pushdown on outer joins - posted by "Johannes Mayer (JIRA)" <ji...@apache.org> on 2018/07/19 09:46:00 UTC, 3 replies.
- [jira] [Created] (SPARK-24859) Predicates pushdown on outer joins - posted by "Johannes Mayer (JIRA)" <ji...@apache.org> on 2018/07/19 09:46:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-15428) Disable support for multiple streaming aggregations - posted by "Joost Verdoorn (JIRA)" <ji...@apache.org> on 2018/07/19 11:56:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-15428) Disable support for multiple streaming aggregations - posted by "Joost Verdoorn (JIRA)" <ji...@apache.org> on 2018/07/19 11:57:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-11784) Support Timestamp filter pushdown in Parquet datasource - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/19 12:15:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-16854) mapWithState Support for Python - posted by "Joost Verdoorn (JIRA)" <ji...@apache.org> on 2018/07/19 12:29:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24858) Avoid unnecessary parquet footer reads - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/19 14:26:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24615) Accelerator-aware task scheduling for Spark - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/07/19 14:29:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-22151) PYTHONPATH not picked up from the spark.yarn.appMasterEnv properly - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/07/19 14:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-22151) PYTHONPATH not picked up from the spark.yarn.appMasterEnv properly - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/07/19 14:32:00 UTC, 2 replies.
- [jira] [Created] (SPARK-24860) Expose dynamic partition overwrite per write operation - posted by "koert kuipers (JIRA)" <ji...@apache.org> on 2018/07/19 14:41:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24755) Executor loss can cause task to not be resubmitted - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/07/19 14:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24424) Support ANSI-SQL compliant syntax for ROLLUP, CUBE and GROUPING SET - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/19 16:17:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24424) Support ANSI-SQL compliant syntax for ROLLUP, CUBE and GROUPING SET - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/19 16:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24861) create corrected temp directories in RateSourceSuite - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/19 16:23:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24861) create corrected temp directories in RateSourceSuite - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/19 16:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24861) create corrected temp directories in RateSourceSuite - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/19 16:54:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24860) Expose dynamic partition overwrite per write operation - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/19 17:50:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24860) Expose dynamic partition overwrite per write operation - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/19 17:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24374) SPIP: Support Barrier Execution Mode in Apache Spark - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/07/19 17:53:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24192) Invalid Spark URL in local spark session since upgrading from org.apache.spark:spark-sql_2.11:2.2.1 to org.apache.spark:spark-sql_2.11:2.3.0 - posted by "Prabhu Joseph (JIRA)" <ji...@apache.org> on 2018/07/19 19:09:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-15689) Data source API v2 - posted by "Reynold Xin (JIRA)" <ji...@apache.org> on 2018/07/19 19:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24862) Spark Encoder is not consistent to scala case class semantic for multiple argument lists - posted by "Antonio Murgia (JIRA)" <ji...@apache.org> on 2018/07/19 19:52:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-22187) Update unsaferow format for saved state such that we can set timeouts when state is null - posted by "Tathagata Das (JIRA)" <ji...@apache.org> on 2018/07/19 20:18:01 UTC, 0 replies.
- [jira] [Created] (SPARK-24863) Report offset lag as a custom metrics for Kafka structured streaming source - posted by "Arun Mahadevan (JIRA)" <ji...@apache.org> on 2018/07/19 20:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24863) Report offset lag as a custom metrics for Kafka structured streaming source - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/19 20:29:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24863) Report offset lag as a custom metrics for Kafka structured streaming source - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/19 20:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24864) Cannot reference auto-generated column ordinals in a hive-view. - posted by "Abhishek Madav (JIRA)" <ji...@apache.org> on 2018/07/19 21:23:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24846) Stabilize expression cannonicalization - posted by "Herman van Hovell (JIRA)" <ji...@apache.org> on 2018/07/19 21:29:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24864) Cannot reference auto-generated column ordinals in a hive-view. - posted by "Abhishek Madav (JIRA)" <ji...@apache.org> on 2018/07/19 21:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24864) Cannot reference auto-generated column ordinals in a hive view - posted by "Abhishek Madav (JIRA)" <ji...@apache.org> on 2018/07/19 21:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24864) Cannot resolve auto-generated column ordinals in a hive view - posted by "Abhishek Madav (JIRA)" <ji...@apache.org> on 2018/07/19 21:40:00 UTC, 2 replies.
- [jira] [Created] (SPARK-24865) Remove AnalysisBarrier - posted by "Reynold Xin (JIRA)" <ji...@apache.org> on 2018/07/19 21:49:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24865) Remove AnalysisBarrier - posted by "Reynold Xin (JIRA)" <ji...@apache.org> on 2018/07/19 21:53:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24866) Artifactual ROC scores when scaling up Random Forest classifier - posted by "Evan Zamir (JIRA)" <ji...@apache.org> on 2018/07/19 21:58:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24866) Artifactual ROC scores when scaling up Random Forest classifier - posted by "Evan Zamir (JIRA)" <ji...@apache.org> on 2018/07/19 21:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24867) Add AnalysisBarrier to DataFrameWriter - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/19 22:38:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24868) add sequence function in Python - posted by "Huaxin Gao (JIRA)" <ji...@apache.org> on 2018/07/19 23:23:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24868) add sequence function in Python - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/19 23:30:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24868) add sequence function in Python - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/19 23:30:00 UTC, 2 replies.
- [jira] [Created] (SPARK-24869) SaveIntoDataSourceCommand's input Dataset does not use Cached Data - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/19 23:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24869) SaveIntoDataSourceCommand's input Dataset does not use Cached Data - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/19 23:35:00 UTC, 6 replies.
- [jira] [Commented] (SPARK-6459) Warn when Column API is constructing trivially true equality - posted by "nirav patel (JIRA)" <ji...@apache.org> on 2018/07/19 23:42:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24867) Add AnalysisBarrier to DataFrameWriter - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/19 23:51:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-24867) Add AnalysisBarrier to DataFrameWriter - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/19 23:51:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24867) Add AnalysisBarrier to DataFrameWriter - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/19 23:53:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24865) Remove AnalysisBarrier - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/20 00:08:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24865) Remove AnalysisBarrier - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/20 00:08:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-24723) Discuss necessary info and access in barrier mode + YARN - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/07/20 00:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24724) Discuss necessary info and access in barrier mode + Kubernetes - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/07/20 00:12:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24723) Discuss necessary info and access in barrier mode + YARN - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/07/20 00:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24726) Discuss necessary info and access in barrier mode + Standalone - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/07/20 00:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24726) Discuss necessary info and access in barrier mode + Standalone - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/07/20 00:14:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24726) Discuss necessary info and access in barrier mode + Standalone - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/07/20 00:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24523) InterruptedException when closing SparkContext - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/07/20 00:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24847) ScalaReflection#schemaFor occasionally fails to detect schema for Seq of type alias - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/07/20 01:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24870) Cache can't work normally if there are case letters in SQL - posted by "eaton (JIRA)" <ji...@apache.org> on 2018/07/20 02:18:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24870) Cache can't work normally if there are case letters in SQL - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/20 02:20:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24870) Cache can't work normally if there are case letters in SQL - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/20 02:20:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24857) required the sample code test the spark steaming job in kubernates and write the data in remote hdfs file system - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/20 02:59:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24856) spark need upgrade Guava for use gRPC - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/20 03:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24859) Predicates pushdown on outer joins - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/20 03:02:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-24859) Predicates pushdown on outer joins - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/20 03:05:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24037) stateful operators - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/07/20 03:18:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24307) Support sending messages over 2GB from memory - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/07/20 03:19:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24307) Support sending messages over 2GB from memory - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/07/20 03:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24307) Support sending messages over 2GB from memory - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/07/20 03:20:01 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24195) sc.addFile for local:/ path is broken - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/07/20 03:27:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24195) sc.addFile for local:/ path is broken - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/07/20 03:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24871) Refactor Concat and MapConcat to avoid creating concatenator object for each row. - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/07/20 03:51:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24871) Refactor Concat and MapConcat to avoid creating concatenator object for each row. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/20 04:21:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24871) Refactor Concat and MapConcat to avoid creating concatenator object for each row. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/20 04:21:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24861) create corrected temp directories in RateSourceSuite - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/20 05:41:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24864) Cannot resolve auto-generated column ordinals in a hive view - posted by "Dilip Biswal (JIRA)" <ji...@apache.org> on 2018/07/20 06:18:00 UTC, 4 replies.
- [jira] [Comment Edited] (SPARK-24864) Cannot resolve auto-generated column ordinals in a hive view - posted by "Dilip Biswal (JIRA)" <ji...@apache.org> on 2018/07/20 06:24:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24424) Support ANSI-SQL compliant syntax for GROUPING SET - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/20 06:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24424) Support ANSI-SQL compliant syntax for GROUPING SET - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/20 06:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-18188) Add checksum for block of broadcast - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/20 07:56:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23731) FileSourceScanExec throws NullPointerException in subexpression elimination - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/20 08:49:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24872) Remove the symbol “||” of the “OR” operation - posted by "hantiantian (JIRA)" <ji...@apache.org> on 2018/07/20 09:11:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24872) Remove the symbol “||” of the “OR” operation - posted by "hantiantian (JIRA)" <ji...@apache.org> on 2018/07/20 09:17:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-20327) Add CLI support for YARN custom resources, like GPUs - posted by "Szilard Nemeth (JIRA)" <ji...@apache.org> on 2018/07/20 09:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24873) increase switch to shielding frequent interaction reports with yarn - posted by "JieFang.He (JIRA)" <ji...@apache.org> on 2018/07/20 09:27:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24872) Remove the symbol “||” of the “OR” operation - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/20 09:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24872) Remove the symbol “||” of the “OR” operation - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/20 09:34:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24873) increase switch to shielding frequent interaction reports with yarn - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/20 09:44:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24873) increase switch to shielding frequent interaction reports with yarn - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/20 09:44:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-24868) add sequence function in Python - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/20 09:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24873) increase switch to shielding frequent interaction reports with yarn - posted by "JieFang.He (JIRA)" <ji...@apache.org> on 2018/07/20 11:03:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24871) Refactor Concat and MapConcat to avoid creating concatenator object for each row. - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/20 12:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24874) Allow hybrid of both barrier tasks and regular tasks in a stage - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/07/20 12:32:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24875) MulticlassMetrics should offer a more efficient way to compute count by label - posted by "Antoine Galataud (JIRA)" <ji...@apache.org> on 2018/07/20 12:55:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24551) Add Integration tests for Secrets - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/20 12:57:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24551) Add Integration tests for Secrets - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/20 12:57:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23731) FileSourceScanExec throws NullPointerException in subexpression elimination - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/20 13:03:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-23731) FileSourceScanExec throws NullPointerException in subexpression elimination - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/20 13:08:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24876) Remove SerializableSchema and use json format string schema - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/20 13:27:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24876) Simplify schema serialization - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/20 13:29:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24876) Simplify schema serialization - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/20 13:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24876) Simplify schema serialization - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/20 13:34:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24877) Ignore the task completion event from a zombie barrier task - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/07/20 16:18:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23451) Deprecate KMeans computeCost - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/07/20 16:20:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24811) Add function `from_avro` and `to_avro` - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/20 16:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24792) Add API `.avro` in DataFrameReader/DataFrameWriter - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/20 16:27:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24792) Add API `.avro` in DataFrameReader/DataFrameWriter - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/20 16:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24878) Fix reverse function for array type of primitive type containing null. - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/07/20 16:42:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24878) Fix reverse function for array type of primitive type containing null. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/20 16:50:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24878) Fix reverse function for array type of primitive type containing null. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/20 16:50:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24879) NPE in Hive partition filter pushdown for `partCol IN (NULL, ....)` - posted by "William Sheu (JIRA)" <ji...@apache.org> on 2018/07/20 18:41:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24864) Cannot resolve auto-generated column ordinals in a hive view - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/20 18:51:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24852) Have spark.ml training use updated `Instrumentation` APIs. - posted by "Joseph K. Bradley (JIRA)" <ji...@apache.org> on 2018/07/20 19:15:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24862) Spark Encoder is not consistent to scala case class semantic for multiple argument lists - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/07/20 19:38:00 UTC, 3 replies.
- [jira] [Created] (SPARK-24880) Fix the group id for spark-kubernetes-integration-tests - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/07/20 19:53:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24880) Fix the group id for spark-kubernetes-integration-tests - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/20 19:55:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24880) Fix the group id for spark-kubernetes-integration-tests - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/20 19:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24880) Fix the group id for spark-kubernetes-integration-tests - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/07/20 19:56:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-22880) Add option to cascade jdbc truncate if database supports this (PostgreSQL and Oracle) - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/20 20:06:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24879) NPE in Hive partition filter pushdown for `partCol IN (NULL, ....)` - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/20 20:08:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24879) NPE in Hive partition filter pushdown for `partCol IN (NULL, ....)` - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/20 20:08:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24879) NPE in Hive partition filter pushdown for `partCol IN (NULL, ....)` - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/20 20:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23128) A new approach to do adaptive execution in Spark SQL - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/07/20 21:10:00 UTC, 4 replies.
- [jira] [Resolved] (SPARK-24876) Simplify schema serialization - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/20 21:59:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24880) Fix the group id for spark-kubernetes-integration-tests - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/07/20 22:34:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24488) Analyzer throws when generator is aliased multiple times - posted by "Herman van Hovell (JIRA)" <ji...@apache.org> on 2018/07/20 22:47:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24875) MulticlassMetrics should offer a more efficient way to compute count by label - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/07/21 00:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24875) MulticlassMetrics should offer a more efficient way to compute count by label - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/07/21 00:22:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24879) NPE in Hive partition filter pushdown for `partCol IN (NULL, ....)` - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/21 03:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24836) New option - ignoreExtension - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/21 03:06:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-22814) JDBC support date/timestamp type as partitionColumn - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/21 08:18:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-22814) JDBC support date/timestamp type as partitionColumn - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/21 08:18:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24873) increase switch to shielding frequent interaction reports with yarn - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/21 08:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23231) Add doc for string indexer ordering to user guide (also to RFormula guide) - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/21 13:27:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24340) Clean up non-shuffle disk block manager files following executor death - posted by "Li Yuanjian (JIRA)" <ji...@apache.org> on 2018/07/21 13:42:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24340) Clean up non-shuffle disk block manager files following executor death - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/07/21 14:23:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24779) Add sequence / map_concat / map_from_entries / an option in months_between UDF to disable rounding-off - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/21 15:29:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-16203) regexp_extract to return an ArrayType(StringType()) - posted by "Nick Nicolini (JIRA)" <ji...@apache.org> on 2018/07/22 03:22:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-16203) regexp_extract to return an ArrayType(StringType()) - posted by "Nick Nicolini (JIRA)" <ji...@apache.org> on 2018/07/22 03:22:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/07/22 07:27:00 UTC, 5 replies.
- [jira] [Created] (SPARK-24881) New options - compression and compressionLevel - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/07/22 08:27:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24881) New options - compression and compressionLevel - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/22 09:03:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24881) New options - compression and compressionLevel - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/22 09:03:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/07/22 09:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24882) separate responsibilities of the data source v2 read API - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/22 14:45:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24882) separate responsibilities of the data source v2 read API - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/22 14:46:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24339) spark sql can not prune column in transform/map/reduce query - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/22 14:50:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24882) separate responsibilities of the data source v2 read API - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/22 14:50:00 UTC, 9 replies.
- [jira] [Comment Edited] (SPARK-24882) separate responsibilities of the data source v2 read API - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/22 14:50:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-22562) CachedKafkaConsumer unsafe eviction from cache - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/22 14:54:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-16483) Unifying struct fields and columns - posted by "Simeon Simeonov (JIRA)" <ji...@apache.org> on 2018/07/22 17:03:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-23206) Additional Memory Tuning Metrics - posted by "James (JIRA)" <ji...@apache.org> on 2018/07/22 17:03:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24869) SaveIntoDataSourceCommand's input Dataset does not use Cached Data - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/22 17:34:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24883) Remove implicit class AvroDataFrameWriter/AvroDataFrameReader - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/22 18:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24884) Implement regexp_extract_all - posted by "Nick Nicolini (JIRA)" <ji...@apache.org> on 2018/07/22 20:56:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24884) Implement regexp_extract_all - posted by "Nick Nicolini (JIRA)" <ji...@apache.org> on 2018/07/22 20:56:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-22228) Add support for Array so from_json can parse - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/23 01:19:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24885) Rand and Randn expression should produce same result at DataFrame on retries - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/07/23 01:20:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24885) Initialize random seeds for Rand and Randn expression during analysis - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/07/23 01:42:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24885) Rand and Randn expression should produce same result at DataFrame on retries - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/07/23 01:42:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24885) Initialize random seeds for Rand and Randn expression during analysis - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/07/23 01:44:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24853) Support Column type for withColumn and withColumnRenamed apis - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/23 02:10:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24847) ScalaReflection#schemaFor occasionally fails to detect schema for Seq of type alias - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/23 02:14:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24859) Predicates pushdown on outer joins - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/23 02:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24841) Memory leak in converting spark dataframe to pandas dataframe - posted by "Kazuaki Ishizaki (JIRA)" <ji...@apache.org> on 2018/07/23 02:58:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-18492) GeneratedIterator grows beyond 64 KB - posted by "Tang Yu Jie (JIRA)" <ji...@apache.org> on 2018/07/23 03:23:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24886) Increase Jenkins build time - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/23 05:30:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24886) Increase Jenkins build time - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/23 05:37:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24886) Increase Jenkins build time - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/23 05:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24883) Remove implicit class AvroDataFrameWriter/AvroDataFrameReader - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/23 07:05:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24883) Remove implicit class AvroDataFrameWriter/AvroDataFrameReader - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/23 07:05:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24883) Remove implicit class AvroDataFrameWriter/AvroDataFrameReader - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/23 07:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24887) Use SerializableConfiguration in Spark util - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/23 09:29:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24887) Use SerializableConfiguration in Spark util - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/23 09:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24887) Use SerializableConfiguration in Spark util - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/23 09:32:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24888) spark-submit --master spark://host:port --status driver-id does not work - posted by "srinivasan (JIRA)" <ji...@apache.org> on 2018/07/23 11:51:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24888) spark-submit --master spark://host:port --status driver-id does not work - posted by "srinivasan (JIRA)" <ji...@apache.org> on 2018/07/23 11:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24889) dataset.unpersist() doesn't update storage memory stats - posted by "Yuri Bogomolov (JIRA)" <ji...@apache.org> on 2018/07/23 14:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24889) dataset.unpersist() doesn't update storage memory stats - posted by "Yuri Bogomolov (JIRA)" <ji...@apache.org> on 2018/07/23 14:54:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24802) Optimization Rule Exclusion - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/23 15:27:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24887) Use SerializableConfiguration in Spark util - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/23 15:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24855) Built-in AVRO support should support specified schema on write - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/23 16:15:01 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24850) Query plan string representation grows exponentially on queries with recursive cached datasets - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/23 16:54:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24890) Short circuiting the `if` condition when `trueValue` and `falseValue` are the same - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/07/23 17:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24890) Short circuiting the `if` condition when `trueValue` and `falseValue` are the same - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/23 17:34:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24890) Short circuiting the `if` condition when `trueValue` and `falseValue` are the same - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/23 17:34:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24243) Expose exceptions from InProcessAppHandle - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/23 17:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24243) Expose exceptions from InProcessAppHandle - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/23 17:37:00 UTC, 3 replies.
- [jira] [Created] (SPARK-24891) Fix HandleNullInputsForUDF rule. - posted by "Maryann Xue (JIRA)" <ji...@apache.org> on 2018/07/23 18:01:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24892) Simplify `CaseWhen` to `If` when there is only one branch - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/07/23 18:37:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24892) Simplify `CaseWhen` to `If` when there is only one branch - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/23 18:39:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24892) Simplify `CaseWhen` to `If` when there is only one branch - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/23 18:39:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-24891) Fix HandleNullInputsForUDF rule - posted by "Maryann Xue (JIRA)" <ji...@apache.org> on 2018/07/23 18:56:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24893) Remove the entire CaseWhen if all the outputs are semantic equivalence - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/07/23 18:59:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24891) Fix HandleNullInputsForUDF rule - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/23 19:05:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24891) Fix HandleNullInputsForUDF rule - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/23 19:05:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24893) Remove the entire CaseWhen if all the outputs are semantic equivalence - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/23 19:19:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24893) Remove the entire CaseWhen if all the outputs are semantic equivalence - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/23 19:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24814) Relationship between catalog and datasources - posted by "Ryan Blue (JIRA)" <ji...@apache.org> on 2018/07/23 19:55:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24699) Watermark / Append mode should work with Trigger.Once - posted by "Tathagata Das (JIRA)" <ji...@apache.org> on 2018/07/23 20:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24699) Watermark / Append mode should work with Trigger.Once - posted by "Tathagata Das (JIRA)" <ji...@apache.org> on 2018/07/23 20:05:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24339) spark sql can not prune column in transform/map/reduce query - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/23 20:06:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23957) Sorts in subqueries are redundant and can be removed - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/23 21:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24894) Invalid DNS name due to hostname truncation - posted by "Dharmesh Kakadia (JIRA)" <ji...@apache.org> on 2018/07/23 22:55:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24895) Spark 2.4.0 Snapshot artifacts has broken metadata due to mismatched filenames - posted by "Eric Chang (JIRA)" <ji...@apache.org> on 2018/07/23 23:40:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24288) Enable preventing predicate pushdown - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/23 23:45:00 UTC, 4 replies.
- [jira] [Updated] (SPARK-24895) Spark 2.4.0 Snapshot artifacts has broken metadata due to mismatched filenames - posted by "Yin Huai (JIRA)" <ji...@apache.org> on 2018/07/23 23:46:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24895) Spark 2.4.0 Snapshot artifacts has broken metadata due to mismatched filenames - posted by "Yin Huai (JIRA)" <ji...@apache.org> on 2018/07/23 23:49:00 UTC, 11 replies.
- [jira] [Resolved] (SPARK-24594) Introduce metrics for YARN executor allocation problems - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/07/24 01:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24594) Introduce metrics for YARN executor allocation problems - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/07/24 01:34:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-15694) Implement ScriptTransformation in sql/core - posted by "Abdulrahman Alfozan (JIRA)" <ji...@apache.org> on 2018/07/24 01:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-20402) ALS StackOverflowError on Windows - posted by "Tom Lo (JIRA)" <ji...@apache.org> on 2018/07/24 03:09:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24857) required the sample code test the spark steaming job in kubernates and write the data in remote hdfs file system - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/24 04:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24896) Uuid expression should produce different values in each execution under streaming query - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/07/24 04:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24896) Uuid expression should produce different values in each execution under streaming query - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/24 04:42:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24896) Uuid expression should produce different values in each execution under streaming query - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/24 04:42:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24896) Uuid expression should produce different values in each execution under streaming query - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/07/24 04:55:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24870) Cache can't work normally if there are case letters in SQL - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/24 06:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-22499) 64KB JVM bytecode limit problem with least and greatest - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/24 06:41:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24886) Increase Jenkins build time - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/24 06:53:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24738) [HistoryServer] FsHistoryProvider clean outdated event logs at start - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/24 07:17:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24738) [HistoryServer] FsHistoryProvider clean outdated event logs at start - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/24 07:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24897) DAGScheduler should not unregisterMapOutput and increaseEpoch repeatedly for stage fetchFailed - posted by "liupengcheng (JIRA)" <ji...@apache.org> on 2018/07/24 07:18:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24897) DAGScheduler should not unregisterMapOutput and increaseEpoch repeatedly for stage fetchFailed - posted by "liupengcheng (JIRA)" <ji...@apache.org> on 2018/07/24 07:20:00 UTC, 4 replies.
- [jira] [Created] (SPARK-24898) Include configuration parameter in doc - posted by "Riccardo Corbella (JIRA)" <ji...@apache.org> on 2018/07/24 09:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24899) Add example of monotonically_increasing_id standard function to scaladoc - posted by "Jacek Laskowski (JIRA)" <ji...@apache.org> on 2018/07/24 09:34:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24899) Add example of monotonically_increasing_id standard function to scaladoc - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/24 09:52:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24899) Add example of monotonically_increasing_id standard function to scaladoc - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/24 09:52:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24630) SPIP: Support SQLStreaming in Spark - posted by "Genmao Yu (JIRA)" <ji...@apache.org> on 2018/07/24 10:08:00 UTC, 4 replies.
- [jira] [Comment Edited] (SPARK-24630) SPIP: Support SQLStreaming in Spark - posted by "Genmao Yu (JIRA)" <ji...@apache.org> on 2018/07/24 10:08:00 UTC, 5 replies.
- [jira] [Created] (SPARK-24900) speed up sort when the dataset is small - posted by "SongXun (JIRA)" <ji...@apache.org> on 2018/07/24 10:46:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24901) Merge the codegen of RegularHashMap and fastHashMap to reduce compiler maxCodesize when VectorizedHashMap is false - posted by "caoxuewen (JIRA)" <ji...@apache.org> on 2018/07/24 10:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24900) speed up sort when the dataset is small - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/24 10:57:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24900) speed up sort when the dataset is small - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/24 10:57:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/07/24 11:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24902) Add integration tests for PVs - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/07/24 11:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24903) Allow driver container name to be configurable in k8 spark - posted by "Yifei Huang (JIRA)" <ji...@apache.org> on 2018/07/24 11:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24902) Add integration tests for PVs - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/07/24 11:17:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24903) Allow driver container name to be configurable in k8 spark - posted by "Yifei Huang (JIRA)" <ji...@apache.org> on 2018/07/24 11:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24901) Merge the codegen of RegularHashMap and fastHashMap to reduce compiler maxCodesize when VectorizedHashMap is false - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/24 11:18:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24901) Merge the codegen of RegularHashMap and fastHashMap to reduce compiler maxCodesize when VectorizedHashMap is false - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/24 11:18:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24904) Join with broadcasted dataframe causes shuffle of redundant data - posted by "Shay Elbaz (JIRA)" <ji...@apache.org> on 2018/07/24 11:26:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24904) Join with broadcasted dataframe causes shuffle of redundant data - posted by "Shay Elbaz (JIRA)" <ji...@apache.org> on 2018/07/24 11:27:00 UTC, 2 replies.
- [jira] [Created] (SPARK-24905) Spark 2.3 Internal URL env variable - posted by "Björn Wenzel (JIRA)" <ji...@apache.org> on 2018/07/24 12:13:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24905) Spark 2.3 Internal URL env variable - posted by "Björn Wenzel (JIRA)" <ji...@apache.org> on 2018/07/24 12:14:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24906) Enlarge split size for columnar file to ensure the task read enough data - posted by "Jason Guo (JIRA)" <ji...@apache.org> on 2018/07/24 12:26:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24906) Enlarge split size for columnar file to ensure the task read enough data - posted by "Jason Guo (JIRA)" <ji...@apache.org> on 2018/07/24 12:27:00 UTC, 4 replies.
- [jira] [Created] (SPARK-24907) Migrate JDBC data source to DataSource API v2 - posted by "Teng Peng (JIRA)" <ji...@apache.org> on 2018/07/24 12:52:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24907) Migrate JDBC data source to DataSource API v2 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/24 13:07:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24907) Migrate JDBC data source to DataSource API v2 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/24 13:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24906) Enlarge split size for columnar file to ensure the task read enough data - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/07/24 15:00:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-24903) Allow driver container name to be configurable in k8 spark - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/24 15:26:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24903) Allow driver container name to be configurable in k8 spark - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/24 15:26:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24581) Design: BarrierTaskContext.barrier() - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/07/24 15:37:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-18874) First phase: Deferring the correlated predicate pull up to Optimizer phase - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/24 15:54:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24908) [R] remove spaces to make lintr happy - posted by "shane knapp (JIRA)" <ji...@apache.org> on 2018/07/24 17:23:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24908) [R] remove spaces to make lintr happy - posted by "shane knapp (JIRA)" <ji...@apache.org> on 2018/07/24 17:26:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24908) [R] remove spaces to make lintr happy - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/24 17:26:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24908) [R] remove spaces to make lintr happy - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/24 17:26:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-23325) DataSourceV2 readers should always produce InternalRow. - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/24 17:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24895) Spark 2.4.0 Snapshot artifacts has broken metadata due to mismatched filenames - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/24 18:01:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24894) Invalid DNS name due to hostname truncation - posted by "Yinan Li (JIRA)" <ji...@apache.org> on 2018/07/24 18:02:01 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24812) Last Access Time in the table description is not valid - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/24 18:34:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24909) Spark scheduler can hang with fetch failures and executor lost and multiple stage attempts - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/07/24 19:01:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24909) Spark scheduler can hang with fetch failures and executor lost and multiple stage attempts - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/07/24 19:01:01 UTC, 1 replies.
- [jira] [Commented] (SPARK-24909) Spark scheduler can hang with fetch failures and executor lost and multiple stage attempts - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/07/24 19:27:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24909) Spark scheduler can hang when fetch failures, executor lost, task running on lost executor, and multiple stage attempts - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/07/24 19:45:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24909) Spark scheduler can hang when fetch failures, executor lost, task running on lost executor, and multiple stage attempts - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/07/24 20:18:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24910) Spark Bloom Filter Closure Serialization improvement for very high volume of Data - posted by "Himangshu Ranjan Borah (JIRA)" <ji...@apache.org> on 2018/07/24 21:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24911) SHOW CREATE TABLE drops escaping of nested column names - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/07/24 21:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24912) Broadcast join OutOfMemory stack trace obscures actual cause of OOM - posted by "Bruce Robbins (JIRA)" <ji...@apache.org> on 2018/07/24 21:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24911) SHOW CREATE TABLE drops escaping of nested column names - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/24 21:51:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24911) SHOW CREATE TABLE drops escaping of nested column names - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/24 21:51:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24912) Broadcast join OutOfMemory stack trace obscures actual cause of OOM - posted by "Bruce Robbins (JIRA)" <ji...@apache.org> on 2018/07/24 21:58:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24895) Spark 2.4.0 Snapshot artifacts has broken metadata due to mismatched filenames - posted by "Yin Huai (JIRA)" <ji...@apache.org> on 2018/07/24 23:00:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24908) [R] remove spaces to make lintr happy - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/07/24 23:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24913) Make `AssertTrue` and `AssertNotNull` non-deterministic - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/07/24 23:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24914) totalSize is not a good estimate for broadcast joins - posted by "Bruce Robbins (JIRA)" <ji...@apache.org> on 2018/07/25 00:17:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24906) Enlarge split size for columnar file to ensure the task read enough data - posted by "Jason Guo (JIRA)" <ji...@apache.org> on 2018/07/25 01:04:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24297) Change default value for spark.maxRemoteBlockSizeFetchToMem to be < 2GB - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/07/25 01:10:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24297) Change default value for spark.maxRemoteBlockSizeFetchToMem to be < 2GB - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/07/25 01:10:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24906) Enlarge split size for columnar file to ensure the task read enough data - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/25 02:14:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24663) Flaky test: StreamingContextSuite "stop slow receiver gracefully" - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/25 02:26:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-24529) Add spotbugs into maven build process - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/25 02:29:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24529) Add spotbugs into maven build process - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/25 02:29:00 UTC, 0 replies.
- [jira] [Issue Comment Deleted] (SPARK-24663) Flaky test: StreamingContextSuite "stop slow receiver gracefully" - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/25 02:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23622) Flaky Test: HiveClientSuites - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/25 02:40:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24891) Fix HandleNullInputsForUDF rule - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/25 02:42:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-23622) Flaky Test: HiveClientSuites - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/25 02:45:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24914) totalSize is not a good estimate for broadcast joins - posted by "Bruce Robbins (JIRA)" <ji...@apache.org> on 2018/07/25 03:19:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24890) Short circuiting the `if` condition when `trueValue` and `falseValue` are the same - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/25 03:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23957) Sorts in subqueries are redundant and can be removed - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/25 03:48:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-19018) spark csv writer charset support - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/25 06:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-21063) Spark return an empty result from remote hadoop cluster - posted by "nick (JIRA)" <ji...@apache.org> on 2018/07/25 09:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24915) Calling SparkSession.createDataFrame with schema can throw exception - posted by "Stephen Spencer (JIRA)" <ji...@apache.org> on 2018/07/25 09:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24916) Fix type coercion for IN expression with subquery - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/25 09:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24916) Fix type coercion for IN expression with subquery - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/25 09:34:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24916) Fix type coercion for IN expression with subquery - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/25 09:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-19018) spark csv writer charset support - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/25 10:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24904) Join with broadcasted dataframe causes shuffle of redundant data - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/07/25 10:09:00 UTC, 4 replies.
- [jira] [Created] (SPARK-24917) Sending a partition over netty results in 2x memory usage - posted by "Vincent (JIRA)" <ji...@apache.org> on 2018/07/25 11:56:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24917) Sending a partition over netty results in 2x memory usage - posted by "Vincent (JIRA)" <ji...@apache.org> on 2018/07/25 11:59:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-24904) Join with broadcasted dataframe causes shuffle of redundant data - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/07/25 13:29:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-19018) spark csv writer charset support - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/25 15:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24914) totalSize is not a good estimate for broadcast joins - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/07/25 16:00:00 UTC, 2 replies.
- [jira] [Created] (SPARK-24918) Executor Plugin API - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/07/25 16:38:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24918) Executor Plugin API - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/07/25 16:39:00 UTC, 4 replies.
- [jira] [Created] (SPARK-24919) Scala linter rule for sparkContext.hadoopConfiguration - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/07/25 16:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24919) Scala linter rule for sparkContext.hadoopConfiguration - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/25 16:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24919) Scala linter rule for sparkContext.hadoopConfiguration - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/25 16:54:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24920) Spark should allow sharing netty's memory pools across all uses - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/07/25 16:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24920) Spark should share netty's memory pools across all uses - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/07/25 16:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24921) SparkStreaming steadily increasing job generation delay due to apparent URLClassLoader contention - posted by "Tommy S (JIRA)" <ji...@apache.org> on 2018/07/25 17:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24922) Iterative rdd union + reduceByKey operations on small dataset leads to "No space left on device" error on account of lot of shuffle spill. - posted by "Dinesh Dharme (JIRA)" <ji...@apache.org> on 2018/07/25 17:42:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24922) Iterative rdd union + reduceByKey operations on small dataset leads to "No space left on device" error on account of lot of shuffle spill. - posted by "Dinesh Dharme (JIRA)" <ji...@apache.org> on 2018/07/25 18:03:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24849) Convert StructType to DDL string - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/25 18:12:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24911) SHOW CREATE TABLE drops escaping of nested column names - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/25 18:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24915) Calling SparkSession.createDataFrame with schema can throw exception - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/07/25 18:51:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-23146) Support client mode for Kubernetes cluster backend - posted by "Matt Cheah (JIRA)" <ji...@apache.org> on 2018/07/25 19:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24860) Expose dynamic partition overwrite per write operation - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/25 20:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24874) Allow hybrid of both barrier tasks and regular tasks in a stage - posted by "Reynold Xin (JIRA)" <ji...@apache.org> on 2018/07/25 20:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-1137) ZK Persistence Engine crashes if stored data has wrong serialVersionUID - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/25 20:45:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24923) DataSourceV2: Add CTAS and RTAS logical operations - posted by "Ryan Blue (JIRA)" <ji...@apache.org> on 2018/07/25 23:03:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24921) SparkStreaming steadily increasing job generation delay due to apparent URLClassLoader contention - posted by "Tommy S (JIRA)" <ji...@apache.org> on 2018/07/25 23:10:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24923) DataSourceV2: Add CTAS and RTAS logical operations - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/25 23:11:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24923) DataSourceV2: Add CTAS and RTAS logical operations - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/25 23:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24924) Add mapping for built-in Avro data source - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/07/26 00:00:42 UTC, 0 replies.
- [jira] [Commented] (SPARK-24924) Add mapping for built-in Avro data source - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/26 00:05:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24924) Add mapping for built-in Avro data source - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/26 00:05:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-24867) Add AnalysisBarrier to DataFrameWriter - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/26 00:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24916) Fix type coercion for IN expression with subquery - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/26 00:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-12911) Cacheing a dataframe causes array comparisons to fail (in filter / where) after 1.6 - posted by "David Vogelbacher (JIRA)" <ji...@apache.org> on 2018/07/26 00:48:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-24832) When pushdown enabled, input bytesRead metrics is easy to fluctuate from time to time - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/07/26 01:57:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24832) Improve inputMetrics's bytesRead update for ColumnarBatch - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/07/26 01:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24925) input bytesRead metrics fluctuate from time to time - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/07/26 02:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24925) input bytesRead metrics fluctuate from time to time - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/07/26 02:19:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24905) Spark 2.3 Internal URL env variable - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/26 02:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24925) input bytesRead metrics fluctuate from time to time - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/07/26 02:56:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-24288) Enable preventing predicate pushdown - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/26 02:57:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24925) input bytesRead metrics fluctuate from time to time - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/26 03:01:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24921) SparkStreaming steadily increasing job generation delay due to apparent URLClassLoader contention - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/26 03:10:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24926) Ensure numCores is used consistently in all netty configuration (driver and executors) - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/07/26 06:41:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24926) Ensure numCores is used consistently in all netty configuration (driver and executors) - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/07/26 06:41:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24927) The hadoop-provided profile doesn't play well with Snappy-compressed Parquet files - posted by "Cheng Lian (JIRA)" <ji...@apache.org> on 2018/07/26 06:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24927) The hadoop-provided profile doesn't play well with Snappy-compressed Parquet files - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/26 06:55:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-24927) The hadoop-provided profile doesn't play well with Snappy-compressed Parquet files - posted by "Cheng Lian (JIRA)" <ji...@apache.org> on 2018/07/26 07:00:08 UTC, 2 replies.
- [jira] [Assigned] (SPARK-24927) The hadoop-provided profile doesn't play well with Snappy-compressed Parquet files - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/26 07:07:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-24878) Fix reverse function for array type of primitive type containing null. - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/26 07:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23683) FileCommitProtocol.instantiate to require 3-arg constructor for dynamic partition overwrite - posted by "Felix Cheung (JIRA)" <ji...@apache.org> on 2018/07/26 07:31:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-21436) Take advantage of known partioner for distinct on RDDs - posted by "zhengruifeng (JIRA)" <ji...@apache.org> on 2018/07/26 07:38:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-21436) Take advantage of known partioner for distinct on RDDs - posted by "zhengruifeng (JIRA)" <ji...@apache.org> on 2018/07/26 07:38:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24928) spark sql cross join running time too long - posted by "LIFULONG (JIRA)" <ji...@apache.org> on 2018/07/26 08:11:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24924) Add mapping for built-in Avro data source - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/26 08:13:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24924) Add mapping for built-in Avro data source - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/26 08:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24929) Merge script swallow KeyboardInterrupt - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/26 08:29:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24928) spark sql cross join running time too long - posted by "LIFULONG (JIRA)" <ji...@apache.org> on 2018/07/26 08:30:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24929) Merge script swallow KeyboardInterrupt - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/26 08:37:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24929) Merge script swallow KeyboardInterrupt - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/26 08:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24930) Exception information is not accurate when using `LOAD DATA LOCAL INPATH` - posted by "Xiaochen Ouyang (JIRA)" <ji...@apache.org> on 2018/07/26 09:06:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24930) Exception information is not accurate when using `LOAD DATA LOCAL INPATH` - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/26 09:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24930) Exception information is not accurate when using `LOAD DATA LOCAL INPATH` - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/26 09:19:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24930) Exception information is not accurate when using `LOAD DATA LOCAL INPATH` - posted by "Xiaochen Ouyang (JIRA)" <ji...@apache.org> on 2018/07/26 09:22:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-24897) DAGScheduler should not unregisterMapOutput and increaseEpoch repeatedly for stage fetchFailed - posted by "liupengcheng (JIRA)" <ji...@apache.org> on 2018/07/26 10:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24897) DAGScheduler should not unregisterMapOutput and increaseEpoch repeatedly for stage fetchFailed - posted by "liupengcheng (JIRA)" <ji...@apache.org> on 2018/07/26 10:31:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24647) Sink Should Return Writen Offsets For ProgressReporting - posted by "Vaclav Kosar (JIRA)" <ji...@apache.org> on 2018/07/26 10:38:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24527) select column alias should support quotation marks - posted by "ice bai (JIRA)" <ji...@apache.org> on 2018/07/26 10:58:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24931) ExecutorBackend send wrong Reason when executor exits - posted by "ice bai (JIRA)" <ji...@apache.org> on 2018/07/26 11:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24931) CoarseGrainedExecutorBackend send wrong 'Reason' when executor exits which leading to job failed. - posted by "ice bai (JIRA)" <ji...@apache.org> on 2018/07/26 11:15:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24932) Allow update mode for streaming queries with join - posted by "Eric Fu (JIRA)" <ji...@apache.org> on 2018/07/26 11:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24933) SinkProgress should report written rows - posted by "Vaclav Kosar (JIRA)" <ji...@apache.org> on 2018/07/26 12:13:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24928) spark sql cross join running time too long - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/07/26 13:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24934) Should handle missing upper/lower bounds cases in in-memory partition pruning - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/26 13:13:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24934) Should handle missing upper/lower bounds cases in in-memory partition pruning - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/26 13:17:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-24934) Should handle missing upper/lower bounds cases in in-memory partition pruning - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/26 13:17:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24935) Problem with Executing Hive UDF's from Spark 2.2 Onwards - posted by "Parth Gandhi (JIRA)" <ji...@apache.org> on 2018/07/26 14:00:03 UTC, 0 replies.
- [jira] [Created] (SPARK-24936) Better error message when trying a shuffle fetch over 2 GB - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/07/26 14:27:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24937) Datasource partition table should load empty partitions - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/26 14:51:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24937) Datasource partition table should load empty partitions - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/26 14:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24937) Datasource partition table should load empty partitions - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/26 15:00:01 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24937) Datasource partition table should load empty partitions - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/26 15:36:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24934) Complex type and binary type in in-memory partition pruning does not work due to missing upper/lower bounds cases - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/26 17:25:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-24926) Ensure numCores is used consistently in all netty configuration (driver and executors) - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/26 18:00:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-14543) SQL/Hive insertInto has unexpected results - posted by "Ryan Blue (JIRA)" <ji...@apache.org> on 2018/07/26 18:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24795) Implement barrier execution mode - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/26 19:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-23633) Update Pandas UDFs section in sql-programming-guide - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/26 19:24:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-23633) Update Pandas UDFs section in sql-programming-guide - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/26 19:24:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24938) Understand usage of netty's onheap memory use, even with offheap pools - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/07/26 19:25:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24938) Understand usage of netty's onheap memory use, even with offheap pools - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/07/26 19:26:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24801) Empty byte[] arrays in spark.network.sasl.SaslEncryption$EncryptedMessage can waste a lot of memory - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/07/26 19:32:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24939) Support YARN Shared Cache in Spark - posted by "Jonathan Bender (JIRA)" <ji...@apache.org> on 2018/07/26 20:29:00 UTC, 0 replies.
- [jira] [Issue Comment Deleted] (SPARK-24937) Datasource partition table should load empty partitions - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/26 21:06:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24253) DataSourceV2: Add DeleteSupport for delete and overwrite operations - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/26 22:18:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24919) Scala linter rule for sparkContext.hadoopConfiguration - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/26 23:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24940) Coalesce Hint for SQL - posted by "John Zhuge (JIRA)" <ji...@apache.org> on 2018/07/26 23:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24940) Coalesce Hint for SQL - posted by "John Zhuge (JIRA)" <ji...@apache.org> on 2018/07/26 23:56:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24940) Coalesce Hint for SQL Queries - posted by "John Zhuge (JIRA)" <ji...@apache.org> on 2018/07/26 23:58:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-4502) Spark SQL reads unneccesary nested fields from Parquet - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/27 00:31:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24932) Allow update mode for streaming queries with join - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/27 03:06:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24932) Allow update mode for streaming queries with join - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/27 03:06:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24932) Allow update mode for streaming queries with join - posted by "Eric Fu (JIRA)" <ji...@apache.org> on 2018/07/27 03:06:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24801) Empty byte[] arrays in spark.network.sasl.SaslEncryption$EncryptedMessage can waste a lot of memory - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/07/27 03:17:01 UTC, 0 replies.
- [jira] [Created] (SPARK-24941) Add RDDBarrier.coalesce() function - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/07/27 03:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24942) Improve cluster resource management with jobs containing barrier stage - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/07/27 03:46:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24829) In Spark Thrift Server, CAST AS FLOAT inconsistent with spark-shell or spark-sql - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/27 05:30:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24929) Merge script swallow KeyboardInterrupt - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/27 05:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-11083) insert overwrite table failed when beeline reconnect - posted by "readme_kylin (JIRA)" <ji...@apache.org> on 2018/07/27 05:50:02 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24865) Remove AnalysisBarrier - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/27 06:30:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24288) Enable preventing predicate pushdown - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/27 06:48:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24288) Enable preventing predicate pushdown - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/27 06:50:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-20597) KafkaSourceProvider falls back on path as synonym for topic - posted by "Jacek Laskowski (JIRA)" <ji...@apache.org> on 2018/07/27 08:18:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24931) CoarseGrainedExecutorBackend send wrong 'Reason' when executor exits which leading to job failed. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/27 08:18:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24931) CoarseGrainedExecutorBackend send wrong 'Reason' when executor exits which leading to job failed. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/27 08:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24943) Convert a SQL Struct to StructType - posted by "mahmoud mehdi (JIRA)" <ji...@apache.org> on 2018/07/27 09:06:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24943) Convert a SQL Struct to StructType - posted by "mahmoud mehdi (JIRA)" <ji...@apache.org> on 2018/07/27 09:07:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24943) Convert a SQL Struct to StructType - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/27 09:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24941) Add RDDBarrier.coalesce() function - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/27 10:01:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24942) Improve cluster resource management with jobs containing barrier stage - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/27 10:01:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24940) Coalesce Hint for SQL Queries - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/27 10:05:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-24935) Problem with Executing Hive UDF's from Spark 2.2 Onwards - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/27 10:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24935) Problem with Executing Hive UDF's from Spark 2.2 Onwards - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/27 10:10:00 UTC, 3 replies.
- [jira] [Created] (SPARK-24944) SparkUi build problem - posted by "Fabio (JIRA)" <ji...@apache.org> on 2018/07/27 13:19:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24944) SparkUi build problem - posted by "Fabio (JIRA)" <ji...@apache.org> on 2018/07/27 13:20:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24945) Switch to unoVocity 2.7.2 - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/07/27 13:33:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24945) Switch to uniVocity 2.7.2 - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/07/27 13:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24945) Switch to uniVocity 2.7.2 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/27 13:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24945) Switch to uniVocity 2.7.2 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/27 13:48:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24944) SparkUi build problem - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/07/27 13:52:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-23928) High-order function: shuffle(x) → array - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/07/27 14:03:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23928) High-order function: shuffle(x) → array - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/07/27 14:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24946) PySpark - Allow np.Arrays and pd.Series in df.approxQuantile - posted by "Paul Westenthanner (JIRA)" <ji...@apache.org> on 2018/07/27 14:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24947) aggregateAsync and foldAsync for RDD - posted by "Cody Allen (JIRA)" <ji...@apache.org> on 2018/07/27 14:25:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24947) aggregateAsync and foldAsync for RDD - posted by "Cody Allen (JIRA)" <ji...@apache.org> on 2018/07/27 14:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24927) The hadoop-provided profile doesn't play well with Snappy-compressed Parquet files - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/27 16:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24948) SHS filters wrongly some applications due to permission check - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/07/27 16:01:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24921) SparkStreaming steadily increasing job generation delay due to apparent URLClassLoader contention - posted by "Tommy S (JIRA)" <ji...@apache.org> on 2018/07/27 16:06:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24948) SHS filters wrongly some applications due to permission check - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/27 16:09:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24948) SHS filters wrongly some applications due to permission check - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/27 16:09:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24881) New options - compression and compressionLevel - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/27 16:13:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24895) Spark 2.4.0 Snapshot artifacts has broken metadata due to mismatched filenames - posted by "Eric Chang (JIRA)" <ji...@apache.org> on 2018/07/27 17:01:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24949) pyspark.sql.Column breaks the iterable contract - posted by "Daniel Shields (JIRA)" <ji...@apache.org> on 2018/07/27 17:12:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-17984) Add support for numa aware feature - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/27 17:13:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-21960) Spark Streaming Dynamic Allocation should respect spark.executor.instances - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/27 17:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-21960) Spark Streaming Dynamic Allocation should respect spark.executor.instances - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/27 17:20:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-21216) Streaming DataFrames fail to join with Hive tables - posted by "Russell Spitzer (JIRA)" <ji...@apache.org> on 2018/07/27 17:23:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-13343) speculative tasks that didn't commit shouldn't be marked as success - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/07/27 17:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-18381) Wrong date conversion between spark and python for dates before 1583 - posted by "Stephen Brennan (JIRA)" <ji...@apache.org> on 2018/07/27 17:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24817) Implement BarrierTaskContext.barrier() - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/27 18:18:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24817) Implement BarrierTaskContext.barrier() - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/27 18:18:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24950) scala DateTimeUtilsSuite daysToMillis and millisToDays fails w/java 8 181-b13 - posted by "shane knapp (JIRA)" <ji...@apache.org> on 2018/07/27 18:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24950) scala DateTimeUtilsSuite daysToMillis and millisToDays fails w/java 8 181-b13 - posted by "shane knapp (JIRA)" <ji...@apache.org> on 2018/07/27 18:38:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24950) scala DateTimeUtilsSuite daysToMillis and millisToDays fails w/java 8 181-b13 - posted by "shane knapp (JIRA)" <ji...@apache.org> on 2018/07/27 18:42:00 UTC, 8 replies.
- [jira] [Commented] (SPARK-24912) Broadcast join OutOfMemory stack trace obscures actual cause of OOM - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/27 19:08:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24912) Broadcast join OutOfMemory stack trace obscures actual cause of OOM - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/27 19:08:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24702) Unable to cast to calendar interval in spark sql. - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/27 19:36:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24950) scala DateTimeUtilsSuite daysToMillis and millisToDays fails w/java 8 181-b13 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/27 20:47:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-24950) scala DateTimeUtilsSuite daysToMillis and millisToDays fails w/java 8 181-b13 - posted by "Chris Martin (JIRA)" <ji...@apache.org> on 2018/07/27 20:49:00 UTC, 0 replies.
- [jira] [Issue Comment Deleted] (SPARK-24950) scala DateTimeUtilsSuite daysToMillis and millisToDays fails w/java 8 181-b13 - posted by "shane knapp (JIRA)" <ji...@apache.org> on 2018/07/27 20:56:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24951) Table valued functions should throw AnalysisException instead of IllegalArgumentException - posted by "Reynold Xin (JIRA)" <ji...@apache.org> on 2018/07/27 21:03:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23243) Shuffle+Repartition on an RDD could lead to incorrect answers - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/07/27 21:10:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24721) Failed to call PythonUDF whose input is the output of another PythonUDF - posted by "Li Jin (JIRA)" <ji...@apache.org> on 2018/07/27 21:19:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24952) Support LZMA2 compression by Avro datasource - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/07/27 21:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24952) Support LZMA2 compression by Avro datasource - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/27 21:33:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24952) Support LZMA2 compression by Avro datasource - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/27 21:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24953) Prune a branch in `CaseWhen` if previously seen - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/07/27 23:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24953) Prune a branch in `CaseWhen` if previously seen - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/27 23:56:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24953) Prune a branch in `CaseWhen` if previously seen - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/27 23:56:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24954) Fail fast on job submit if run a barrier stage with dynamic resource allocation enabled - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/07/27 23:58:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24955) spark continuing to execute on a task despite not reading all data from a downed machine - posted by "San Tung (JIRA)" <ji...@apache.org> on 2018/07/28 00:17:00 UTC, 2 replies.
- [jira] [Created] (SPARK-24955) spark continuing to execute on a task despite not reading all data from a downed machine - posted by "San Tung (JIRA)" <ji...@apache.org> on 2018/07/28 00:17:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24954) Fail fast on job submit if run a barrier stage with dynamic resource allocation enabled - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/07/28 02:34:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24956) Upgrade maven from 3.3.9 to 3.5.4 - posted by "Kazuaki Ishizaki (JIRA)" <ji...@apache.org> on 2018/07/28 03:44:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24956) Upgrade maven from 3.3.9 to 3.5.4 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/28 03:57:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24956) Upgrade maven from 3.3.9 to 3.5.4 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/28 03:57:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24957) Decimal arithmetic can lead to wrong values using codegen - posted by "David Vogelbacher (JIRA)" <ji...@apache.org> on 2018/07/28 04:27:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24957) Decimal arithmetic can lead to wrong values using codegen - posted by "David Vogelbacher (JIRA)" <ji...@apache.org> on 2018/07/28 04:28:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-24624) Can not mix vectorized and non-vectorized UDFs - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/28 05:42:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24624) Can not mix vectorized and non-vectorized UDFs - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/28 05:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24958) Report executors' process tree total memory information to heartbeat signals - posted by "Reza Safi (JIRA)" <ji...@apache.org> on 2018/07/28 06:46:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24958) Report executors' process tree total memory information to heartbeat signals - posted by "Reza Safi (JIRA)" <ji...@apache.org> on 2018/07/28 06:47:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-24950) scala DateTimeUtilsSuite daysToMillis and millisToDays fails w/java 8 181-b13 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/28 15:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24959) Do not invoke the CSV/JSON parser for empty schema - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/07/28 16:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24959) Do not invoke the CSV/JSON parser for empty schema - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/28 16:29:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24959) Do not invoke the CSV/JSON parser for empty schema - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/28 16:29:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24960) k8s: explicitly expose ports on driver container - posted by "Adelbert Chang (JIRA)" <ji...@apache.org> on 2018/07/28 19:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24960) k8s: explicitly expose ports on driver container - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/28 19:35:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24960) k8s: explicitly expose ports on driver container - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/28 19:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24777) Refactor AVRO read/write benchmark - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/07/28 21:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24961) sort operation causes out of memory - posted by "Markus Breuer (JIRA)" <ji...@apache.org> on 2018/07/28 22:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24957) Decimal arithmetic can lead to wrong values using codegen - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/07/29 10:58:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-24957) Decimal arithmetic can lead to wrong values using codegen - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/29 11:10:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-24956) Upgrade maven from 3.3.9 to 3.5.4 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/29 13:34:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24956) Upgrade maven from 3.3.9 to 3.5.4 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/29 13:35:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24940) Coalesce Hint for SQL Queries - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/29 17:02:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24962) refactor CodeGenerator.createUnsafeArray - posted by "Kazuaki Ishizaki (JIRA)" <ji...@apache.org> on 2018/07/29 17:31:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24962) refactor CodeGenerator.createUnsafeArray - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/29 17:54:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24962) refactor CodeGenerator.createUnsafeArray - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/29 17:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24005) Remove usage of Scala’s parallel collection - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/29 18:29:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24005) Remove usage of Scala’s parallel collection - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/29 18:29:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24809) Serializing LongHashedRelation in executor may result in data error - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/29 20:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24963) Integration tests will fail if they run in a namespace not being the default - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/07/29 20:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24964) Please add OWASP Dependency Check to all comonent builds(pom.xml) - posted by "Albert Baker (JIRA)" <ji...@apache.org> on 2018/07/29 20:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24965) Spark SQL fails when reading a partitioned hive table with different formats per partition - posted by "Kris Geusebroek (JIRA)" <ji...@apache.org> on 2018/07/29 21:07:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24957) Decimal arithmetic can lead to wrong values using codegen - posted by "David Vogelbacher (JIRA)" <ji...@apache.org> on 2018/07/29 21:56:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24965) Spark SQL fails when reading a partitioned hive table with different formats per partition - posted by "Kris Geusebroek (JIRA)" <ji...@apache.org> on 2018/07/29 21:59:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24966) Fix the precedence rule for set operations. - posted by "Dilip Biswal (JIRA)" <ji...@apache.org> on 2018/07/29 23:50:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24966) Fix the precedence rule for set operations. - posted by "Dilip Biswal (JIRA)" <ji...@apache.org> on 2018/07/29 23:51:00 UTC, 3 replies.
- [jira] [Updated] (SPARK-24964) Please add OWASP Dependency Check to all comonent builds(pom.xml) - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/07/30 01:18:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24964) Please add OWASP Dependency Check to all comonent builds(pom.xml) - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/07/30 01:18:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24966) Fix the precedence rule for set operations. - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/30 05:10:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-24934) Complex type and binary type in in-memory partition pruning does not work due to missing upper/lower bounds cases - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/30 05:25:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24967) Use internal.Logging instead for logging - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/30 06:38:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24967) Use internal.Logging instead for logging - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/30 06:40:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24967) Use internal.Logging instead for logging - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/30 06:40:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24949) pyspark.sql.Column breaks the iterable contract - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/30 08:00:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24944) SparkUi build problem - posted by "Fabio (JIRA)" <ji...@apache.org> on 2018/07/30 08:00:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24946) PySpark - Allow np.Arrays and pd.Series in df.approxQuantile - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/30 08:16:00 UTC, 3 replies.
- [jira] [Updated] (SPARK-24946) PySpark - Allow np.Arrays and pd.Series in df.approxQuantile - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/30 08:16:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24951) Table valued functions should throw AnalysisException instead of IllegalArgumentException - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/30 08:17:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24961) sort operation causes out of memory - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/30 08:18:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24955) spark continuing to execute on a task despite not reading all data from a downed machine - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/30 08:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24961) sort operation causes out of memory - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/30 08:19:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24965) Spark SQL fails when reading a partitioned hive table with different formats per partition - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/30 08:22:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24968) Configurable Chunksize in ChunkedByteBufferOutputStream - posted by "Vincent (JIRA)" <ji...@apache.org> on 2018/07/30 08:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24969) SQL: to_date function can't parse date strings in different locales. - posted by "Valentino (JIRA)" <ji...@apache.org> on 2018/07/30 09:36:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24969) SQL: to_date function can't parse date strings in different locales. - posted by "Valentino Pinna (JIRA)" <ji...@apache.org> on 2018/07/30 09:40:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24630) SPIP: Support SQLStreaming in Spark - posted by "Genmao Yu (JIRA)" <ji...@apache.org> on 2018/07/30 10:07:00 UTC, 3 replies.
- [jira] [Created] (SPARK-24970) Spark Kinesis streaming application fails to recover from streaming checkpoint due to ProvisionedThroughputExceededException - posted by "bruce_zhao (JIRA)" <ji...@apache.org> on 2018/07/30 11:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24970) Spark Kinesis streaming application fails to recover from streaming checkpoint due to ProvisionedThroughputExceededException - posted by "bruce_zhao (JIRA)" <ji...@apache.org> on 2018/07/30 11:13:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-24957) Decimal arithmetic can lead to wrong values using codegen - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/30 13:03:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24967) Use internal.Logging instead for logging - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/30 13:15:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24934) Complex type and binary type in in-memory partition pruning does not work due to missing upper/lower bounds cases - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/07/30 13:55:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24965) Spark SQL fails when reading a partitioned hive table with different formats per partition - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/30 14:31:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24771) Upgrade AVRO version from 1.7.7 to 1.8 - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/30 14:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24954) Fail fast on job submit if run a barrier stage with dynamic resource allocation enabled - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/30 14:42:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24954) Fail fast on job submit if run a barrier stage with dynamic resource allocation enabled - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/30 14:42:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-22814) JDBC support date/timestamp type as partitionColumn - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/30 14:43:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24581) Design: BarrierTaskContext.barrier() - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/07/30 14:52:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24582) Design: Barrier execution mode - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/07/30 14:53:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24958) Report executors' process tree total memory information to heartbeat signals - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/30 14:55:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24720) kafka transaction creates Non-consecutive Offsets (due to transaction offset) making streaming fail when failOnDataLoss=true - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/30 15:06:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24821) Fail fast when submitted job compute on a subset of all the partitions for a barrier stage - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/30 15:37:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24821) Fail fast when submitted job compute on a subset of all the partitions for a barrier stage - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/30 15:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24933) SinkProgress should report written rows - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/30 15:48:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24933) SinkProgress should report written rows - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/30 15:48:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24971) remove SupportsDeprecatedScanRow - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/30 16:57:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24971) remove SupportsDeprecatedScanRow - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/30 17:04:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24971) remove SupportsDeprecatedScanRow - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/30 17:04:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24963) Integration tests will fail if they run in a namespace not being the default - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/30 18:42:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24963) Integration tests will fail if they run in a namespace not being the default - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/30 18:42:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24963) Integration tests will fail if they run in a namespace not being the default - posted by "Matt Cheah (JIRA)" <ji...@apache.org> on 2018/07/30 18:43:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24918) Executor Plugin API - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/30 21:20:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24972) PivotFirst could not handle pivot columns of complex types - posted by "Maryann Xue (JIRA)" <ji...@apache.org> on 2018/07/30 22:23:01 UTC, 0 replies.
- [jira] [Created] (SPARK-24973) Add numIter to Python ClusteringSummary - posted by "Huaxin Gao (JIRA)" <ji...@apache.org> on 2018/07/30 22:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24974) Spark put all file's paths into SharedInMemoryCache even for unused partitions. - posted by "andrzej.stankevich@gmail.com (JIRA)" <ji...@apache.org> on 2018/07/30 22:36:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24974) Spark put all file's paths into SharedInMemoryCache even for unused partitions. - posted by "andrzej.stankevich@gmail.com (JIRA)" <ji...@apache.org> on 2018/07/30 22:37:00 UTC, 7 replies.
- [jira] [Assigned] (SPARK-24973) Add numIter to Python ClusteringSummary - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/30 22:42:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24973) Add numIter to Python ClusteringSummary - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/30 22:42:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-15516) Schema merging in driver fails for parquet when merging LongType and IntegerType - posted by "koert kuipers (JIRA)" <ji...@apache.org> on 2018/07/30 22:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24972) PivotFirst could not handle pivot columns of complex types - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/30 23:25:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24972) PivotFirst could not handle pivot columns of complex types - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/30 23:25:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24952) Support LZMA2 compression by Avro datasource - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/31 01:14:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24882) data source v2 API improvement - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/31 01:45:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-24937) Datasource partition table should load empty static partitions - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/31 02:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23633) Update Pandas UDFs section in sql-programming-guide - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/31 02:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24975) Spark history server REST API /api/v1/version returns error 404 - posted by "shanyu zhao (JIRA)" <ji...@apache.org> on 2018/07/31 02:24:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24820) Fail fast when submitted job contains PartitionPruningRDD in a barrier stage - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/31 03:33:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24820) Fail fast when submitted job contains PartitionPruningRDD in a barrier stage - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/31 03:33:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23334) Fix pandas_udf with return type StringType() to handle str type properly in Python 2. - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/31 03:34:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24976) Allow None for Decimal type conversion (specific to Arrow 0.9.0) - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/31 03:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24976) Allow None for Decimal type conversion (specific to Arrow 0.9.0) - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/31 03:43:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24976) Allow None for Decimal type conversion (specific to Arrow 0.9.0) - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/31 03:43:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24976) Allow None for Decimal type conversion (specific to PyArrow 0.9.0) - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/31 03:59:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24972) PivotFirst could not handle pivot columns of complex types - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/31 06:45:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24975) Spark history server REST API /api/v1/version returns error 404 - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/07/31 07:46:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24975) Spark history server REST API /api/v1/version returns error 404 - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/07/31 07:53:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24970) Spark Kinesis streaming application fails to recover from streaming checkpoint due to ProvisionedThroughputExceededException - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/31 08:02:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24970) Spark Kinesis streaming application fails to recover from streaming checkpoint due to ProvisionedThroughputExceededException - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/31 08:02:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24949) pyspark.sql.Column breaks the iterable contract - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/31 08:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24968) Configurable Chunksize in ChunkedByteBufferOutputStream - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/07/31 08:09:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24977) input_file_name() result can't save and use for paritionBy() - posted by "Srinivasarao Padala (JIRA)" <ji...@apache.org> on 2018/07/31 10:04:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24977) input_file_name() result can't save and use for partitionBy() - posted by "Srinivasarao Padala (JIRA)" <ji...@apache.org> on 2018/07/31 10:04:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24977) input_file_name() result can't save and use for partitionBy() - posted by "Srinivasarao Padala (JIRA)" <ji...@apache.org> on 2018/07/31 10:06:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-14540) Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/31 10:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24968) Configurable Chunksize in ChunkedByteBufferOutputStream - posted by "Vincent (JIRA)" <ji...@apache.org> on 2018/07/31 10:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24978) Add spark.sql.fast.hash.aggregate.row.max.capacity to configure the capacity of fast aggregation. - posted by "caoxuewen (JIRA)" <ji...@apache.org> on 2018/07/31 11:21:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24978) Add spark.sql.fast.hash.aggregate.row.max.capacity to configure the capacity of fast aggregation. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/31 11:24:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24978) Add spark.sql.fast.hash.aggregate.row.max.capacity to configure the capacity of fast aggregation. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/31 11:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24816) SQL interface support repartitionByRange - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/07/31 11:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24536) Query with nonsensical LIMIT hits AssertionError - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/07/31 15:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24979) add resolveOperatorsUp - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/31 15:52:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24979) add AnalysisHelper#resolveOperatorsUp - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/31 15:53:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24979) add AnalysisHelper#resolveOperatorsUp - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/31 16:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24979) add AnalysisHelper#resolveOperatorsUp - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/31 16:11:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24917) Sending a partition over netty results in 2x memory usage - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/31 16:24:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24917) Sending a partition over netty results in 2x memory usage - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/31 16:24:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-14540) Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/31 16:58:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-14643) Remove overloaded methods which become ambiguous in Scala 2.12 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/31 16:59:00 UTC, 2 replies.
- [jira] [Created] (SPARK-24980) add support for pandas/arrow etc for python2.7 and pypy builds - posted by "shane knapp (JIRA)" <ji...@apache.org> on 2018/07/31 17:13:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24971) remove SupportsDeprecatedScanRow - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/07/31 17:27:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24951) Table valued functions should throw AnalysisException instead of IllegalArgumentException - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/31 17:58:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24951) Table valued functions should throw AnalysisException instead of IllegalArgumentException - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/31 17:58:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24287) Spark -packages option should support classifier, no-transitive, and custom conf - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/31 18:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24981) ShutdownHook timeout causes job to fail when succeeded when SparkContext stop() not called - posted by "Hieu Tri Huynh (JIRA)" <ji...@apache.org> on 2018/07/31 18:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24981) ShutdownHook timeout causes job to fail when succeeded when SparkContext stop() not called by user program - posted by "Hieu Tri Huynh (JIRA)" <ji...@apache.org> on 2018/07/31 18:23:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24973) Add numIter to Python ClusteringSummary - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/31 18:26:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24773) support reading AVRO logical types - Timestamp with different precisions - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/31 18:33:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24773) support reading AVRO logical types - Timestamp with different precisions - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/31 18:33:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-14643) Remove overloaded methods which become ambiguous in Scala 2.12 - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/07/31 18:35:01 UTC, 4 replies.
- [jira] [Commented] (SPARK-24980) add support for pandas/arrow etc for python2.7 and pypy builds - posted by "shane knapp (JIRA)" <ji...@apache.org> on 2018/07/31 18:37:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24609) PySpark/SparkR doc doesn't explain RandomForestClassifier.featureSubsetStrategy well - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/31 18:38:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24609) PySpark/SparkR doc doesn't explain RandomForestClassifier.featureSubsetStrategy well - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/31 18:38:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-14643) Remove overloaded methods which become ambiguous in Scala 2.12 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/07/31 18:41:01 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24981) ShutdownHook timeout causes job to fail when succeeded when SparkContext stop() not called by user program - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/31 18:43:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24981) ShutdownHook timeout causes job to fail when succeeded when SparkContext stop() not called by user program - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/31 18:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24982) UDAF resolution should not throw java.lang.AssertionError - posted by "Reynold Xin (JIRA)" <ji...@apache.org> on 2018/07/31 18:57:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24982) UDAF resolution should not throw java.lang.AssertionError - posted by "Reynold Xin (JIRA)" <ji...@apache.org> on 2018/07/31 18:59:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23914) High-order function: array_union(x, y) → array - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/31 19:14:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-18057) Update structured streaming kafka from 0.10.0.1 to 2.0.0 - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/07/31 20:16:02 UTC, 0 replies.
- [jira] [Updated] (SPARK-18057) Update structured streaming kafka from 0.10.0.1 to 2.0.0 - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/07/31 20:16:02 UTC, 0 replies.
- [jira] [Commented] (SPARK-24882) data source v2 API improvement - posted by "Ryan Blue (JIRA)" <ji...@apache.org> on 2018/07/31 21:00:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24882) data source v2 API improvement - posted by "Ryan Blue (JIRA)" <ji...@apache.org> on 2018/07/31 21:03:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24982) UDAF resolution should not throw java.lang.AssertionError - posted by "Reynold Xin (JIRA)" <ji...@apache.org> on 2018/07/31 21:03:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24982) UDAF resolution should not throw java.lang.AssertionError - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/31 21:04:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24983) Collapsing multiple project statements with dependent When-Otherwise statements on the same column can OOM the driver - posted by "David Vogelbacher (JIRA)" <ji...@apache.org> on 2018/07/31 21:24:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24983) Collapsing multiple project statements with dependent When-Otherwise statements on the same column can OOM the driver - posted by "David Vogelbacher (JIRA)" <ji...@apache.org> on 2018/07/31 21:25:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24984) Spark Streaming with xml data - posted by "Kavya (JIRA)" <ji...@apache.org> on 2018/07/31 21:42:00 UTC, 0 replies.