You are viewing a plain text version of this content. The canonical link for it is here.

---

- [jira] [Commented] (SPARK-19394) "assertion failed: Expected hostname" on macOS when self-assigned IP contains a percent sign - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/01 00:15:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24976) Allow None for Decimal type conversion (specific to PyArrow 0.9.0) - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/08/01 00:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24976) Allow None for Decimal type conversion (specific to PyArrow 0.9.0) - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/08/01 00:26:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24615) Accelerator-aware task scheduling for Spark - posted by "Erik Erlandson (JIRA)" <ji...@apache.org> on 2018/08/01 00:33:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-24615) Accelerator-aware task scheduling for Spark - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/08/01 00:36:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23874) Upgrade apache/arrow to 0.10.0 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/01 00:49:00 UTC, 10 replies.
- [jira] [Created] (SPARK-24985) Executing SQL with "Full Outer Join" on top of large tables when there is data skew met OOM - posted by "sheperd huang (JIRA)" <ji...@apache.org> on 2018/08/01 01:55:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24986) OOM in BufferHolder during writes to a stream - posted by "Sanket Reddy (JIRA)" <ji...@apache.org> on 2018/08/01 01:58:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24893) Remove the entire CaseWhen if all the outputs are semantic equivalence - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/01 02:32:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24311) Refactor HDFSBackedStateStoreProvider to remove duplicated logic between operations on delta file and snapshot file - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/08/01 04:39:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24951) Table valued functions should throw AnalysisException instead of IllegalArgumentException - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/01 05:27:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24966) Fix the precedence rule for set operations. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/01 05:51:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24966) Fix the precedence rule for set operations. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/01 05:51:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24984) Spark Streaming with xml data - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/01 06:32:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24984) Spark Streaming with xml data - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/01 06:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24980) add support for pandas/arrow etc for python2.7 and pypy builds - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/01 06:34:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-24980) add support for pandas/arrow etc for python2.7 and pypy builds - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/01 06:38:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-23742) Filter out redundant AssociationRules - posted by "yuhao yang (JIRA)" <ji...@apache.org> on 2018/08/01 07:10:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/01 07:12:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24982) UDAF resolution should not throw java.lang.AssertionError - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/01 07:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-13346) Using DataFrames iteratively leads to slow query planning - posted by "Izek Greenfield (JIRA)" <ji...@apache.org> on 2018/08/01 07:32:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24653) Flaky test "JoinSuite.test SortMergeJoin (with spill)" - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/01 07:49:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24653) Flaky test "JoinSuite.test SortMergeJoin (with spill)" - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/01 07:49:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24283) Make standard scaler work without legacy MLlib - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/01 09:09:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24283) Make standard scaler work without legacy MLlib - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/01 09:09:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24987) Kafka Cached Consumer Leaking Consumers - posted by "Yuval Itzchakov (JIRA)" <ji...@apache.org> on 2018/08/01 10:16:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24987) Kafka Cached Consumer Leaking Consumers - posted by "Yuval Itzchakov (JIRA)" <ji...@apache.org> on 2018/08/01 10:17:00 UTC, 7 replies.
- [jira] [Commented] (SPARK-4300) Race condition during SparkWorker shutdown - posted by "liqingan (JIRA)" <ji...@apache.org> on 2018/08/01 10:27:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-4300) Race condition during SparkWorker shutdown - posted by "liqingan (JIRA)" <ji...@apache.org> on 2018/08/01 10:30:04 UTC, 1 replies.
- [jira] [Updated] (SPARK-24987) Kafka Cached Consumer Leaking File Descriptors - posted by "Yuval Itzchakov (JIRA)" <ji...@apache.org> on 2018/08/01 11:01:00 UTC, 6 replies.
- [jira] [Commented] (SPARK-24630) SPIP: Support SQLStreaming in Spark - posted by "Genmao Yu (JIRA)" <ji...@apache.org> on 2018/08/01 12:56:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-24986) OOM in BufferHolder during writes to a stream - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/08/01 13:18:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24971) remove SupportsDeprecatedScanRow - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/01 13:41:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24988) Add a castBySchema method which casts all the values of a DataFrame based on the DataTypes of a StructType - posted by "mahmoud mehdi (JIRA)" <ji...@apache.org> on 2018/08/01 13:56:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24988) Add a castBySchema method which casts all the values of a DataFrame based on the DataTypes of a StructType - posted by "mahmoud mehdi (JIRA)" <ji...@apache.org> on 2018/08/01 13:57:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24821) Fail fast when submitted job compute on a subset of all the partitions for a barrier stage - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/01 14:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24795) Implement barrier execution mode - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/01 14:50:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24909) Spark scheduler can hang when fetch failures, executor lost, task running on lost executor, and multiple stage attempts - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/08/01 14:57:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24988) Add a castBySchema method which casts all the values of a DataFrame based on the DataTypes of a StructType - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/01 15:11:01 UTC, 1 replies.
- [jira] [Created] (SPARK-24989) BlockFetcher should retry while getting OutOfDirectMemoryError - posted by "Li Yuanjian (JIRA)" <ji...@apache.org> on 2018/08/01 16:12:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-24989) BlockFetcher should retry while getting OutOfDirectMemoryError - posted by "Li Yuanjian (JIRA)" <ji...@apache.org> on 2018/08/01 16:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24989) BlockFetcher should retry while getting OutOfDirectMemoryError - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/01 16:26:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24989) BlockFetcher should retry while getting OutOfDirectMemoryError - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/01 16:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24990) merge ReadSupport and ReadSupportWithSchema - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/01 17:26:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24990) merge ReadSupport and ReadSupportWithSchema - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/01 17:38:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24990) merge ReadSupport and ReadSupportWithSchema - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/01 17:38:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-17861) Store data source partitions in metastore and push partition pruning into metastore - posted by "nirav patel (JIRA)" <ji...@apache.org> on 2018/08/01 18:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24632) Allow 3rd-party libraries to use pyspark.ml abstractions for Java wrappers for persistence - posted by "Joseph K. Bradley (JIRA)" <ji...@apache.org> on 2018/08/01 18:23:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24632) Allow 3rd-party libraries to use pyspark.ml abstractions for Java wrappers for persistence - posted by "Joseph K. Bradley (JIRA)" <ji...@apache.org> on 2018/08/01 18:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-19602) Unable to query using the fully qualified column name of the form ( ..) - posted by "Sunitha Kambhampati (JIRA)" <ji...@apache.org> on 2018/08/01 18:43:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-23915) High-order function: array_except(x, y) → array - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/01 18:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23915) High-order function: array_except(x, y) → array - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/01 18:54:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24991) use InternalRow in DataSourceWriter - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/01 19:06:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24991) use InternalRow in DataSourceWriter - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/01 19:12:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24991) use InternalRow in DataSourceWriter - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/01 19:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24957) Decimal arithmetic can lead to wrong values using codegen - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/01 19:29:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24960) k8s: explicitly expose ports on driver container - posted by "Matt Cheah (JIRA)" <ji...@apache.org> on 2018/08/01 21:00:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24937) Datasource partition table should load empty static partitions - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/01 21:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24992) spark should randomize yarn local dir selection - posted by "Hieu Tri Huynh (JIRA)" <ji...@apache.org> on 2018/08/01 22:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24912) Broadcast join OutOfMemory stack trace obscures actual cause of OOM - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/01 22:33:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24914) totalSize is not a good estimate for broadcast joins - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/01 22:37:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24914) totalSize is not a good estimate for broadcast joins - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/01 22:37:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24990) merge ReadSupport and ReadSupportWithSchema - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/01 22:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24957) Decimal arithmetic can lead to wrong values using codegen - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/01 23:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24580) List scenarios to be handled by barrier execution mode properly - posted by "Erik Erlandson (JIRA)" <ji...@apache.org> on 2018/08/01 23:37:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24817) Implement BarrierTaskContext.barrier() - posted by "Erik Erlandson (JIRA)" <ji...@apache.org> on 2018/08/01 23:46:00 UTC, 3 replies.
- [jira] [Created] (SPARK-24993) Make Avro fast again - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/08/02 01:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24993) Make Avro fast again - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 01:29:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24993) Make Avro fast again - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 01:29:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24992) spark should randomize yarn local dir selection - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 02:06:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24992) spark should randomize yarn local dir selection - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 02:06:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23908) High-order function: transform(array, function) → array - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 03:14:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-18057) Update structured streaming kafka from 0.10.0.1 to 2.0.0 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 03:21:00 UTC, 5 replies.
- [jira] [Created] (SPARK-24994) When the data type of the field is converted to other types, it can also support pushdown to parquet - posted by "liuxian (JIRA)" <ji...@apache.org> on 2018/08/02 04:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24995) Flaky tests: FlatMapGroupsWithStateSuite.flatMapGroupsWithState - streaming with processing time timeout - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/08/02 04:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24994) When the data type of the field is converted to other types, it can also support pushdown to parquet - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 04:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24994) When the data type of the field is converted to other types, it can also support pushdown to parquet - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 04:45:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-23698) Spark code contains numerous undefined names in Python 3 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 05:15:00 UTC, 4 replies.
- [jira] [Created] (SPARK-24996) Use DSL to simplify DeclarativeAggregate - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/02 05:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24996) Use DSL to simplify DeclarativeAggregate - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/02 06:00:04 UTC, 0 replies.
- [jira] [Commented] (SPARK-24865) Remove AnalysisBarrier - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 06:09:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 06:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24788) RelationalGroupedDataset.toString throws errors when grouping by UnresolvedAttribute - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 06:28:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24557) ClusteringEvaluator support array input - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/08/02 06:47:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24557) ClusteringEvaluator support array input - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/08/02 06:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24997) Support MINUS ALL - posted by "Dilip Biswal (JIRA)" <ji...@apache.org> on 2018/08/02 06:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24997) Support MINUS ALL - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 06:52:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24997) Support MINUS ALL - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 06:52:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24719) ClusteringEvaluator supports integer type labels - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/08/02 06:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24719) ClusteringEvaluator supports integer type labels - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/08/02 06:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-24998) spark-sql will scan the same table repeatedly when the query likes "From xx SELECT yy INSERT a INSERT b INSERT c ..." - posted by "ice bai (JIRA)" <ji...@apache.org> on 2018/08/02 08:33:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24998) spark-sql will scan the same table repeatedly when the query likes "From xx SELECT yy INSERT a INSERT b INSERT c ..." - posted by "ice bai (JIRA)" <ji...@apache.org> on 2018/08/02 08:35:00 UTC, 6 replies.
- [jira] [Commented] (SPARK-23909) High-order function: filter(array, function) → array - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 08:55:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-23915) High-order function: array_except(x, y) → array - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 09:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24598) SPARK SQL:Datatype overflow conditions gives incorrect result - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 10:35:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-24945) Switch to uniVocity >= 2.7.2 - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/08/02 12:04:00 UTC, 1 replies.
- [jira] [Created] (SPARK-24999) Reduce unnecessary 'new' memory operations - posted by "caoxuewen (JIRA)" <ji...@apache.org> on 2018/08/02 12:06:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24999) Reduce unnecessary 'new' memory operations - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 12:10:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24999) Reduce unnecessary 'new' memory operations - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 12:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24945) Switch to uniVocity >= 2.7.2 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 12:12:01 UTC, 0 replies.
- [jira] [Commented] (SPARK-22600) Fix 64kb limit for deeply nested expressions under wholestage codegen - posted by "Samik R (JIRA)" <ji...@apache.org> on 2018/08/02 12:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24884) Implement regexp_extract_all - posted by "xueyu (JIRA)" <ji...@apache.org> on 2018/08/02 12:38:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-24630) SPIP: Support SQLStreaming in Spark - posted by "Jackey Lee (JIRA)" <ji...@apache.org> on 2018/08/02 13:48:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24996) Use DSL to simplify DeclarativeAggregate - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 13:52:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24996) Use DSL to simplify DeclarativeAggregate - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 13:52:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25000) Identify common interfaces to reduce the code duplication between micro-batch and continuous sources - posted by "Arun Mahadevan (JIRA)" <ji...@apache.org> on 2018/08/02 14:04:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-18057) Update structured streaming kafka from 0.10.0.1 to 2.0.0 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/02 14:12:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-18057) Update structured streaming kafka from 0.10.0.1 to 2.0.0 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/02 14:13:01 UTC, 2 replies.
- [jira] [Assigned] (SPARK-18057) Update structured streaming kafka from 0.10.0.1 to 2.0.0 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 14:13:02 UTC, 1 replies.
- [jira] [Assigned] (SPARK-14540) Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/02 14:18:02 UTC, 0 replies.
- [jira] [Resolved] (SPARK-14540) Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/02 14:18:02 UTC, 0 replies.
- [jira] [Resolved] (SPARK-14220) Build and test Spark against Scala 2.12 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/02 14:20:04 UTC, 0 replies.
- [jira] [Updated] (SPARK-14220) Build and test Spark against Scala 2.12 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/02 14:20:05 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24742) Field Metadata raises NullPointerException in hashCode method - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/02 14:23:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24742) Field Metadata raises NullPointerException in hashCode method - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/02 14:23:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24947) aggregateAsync and foldAsync for RDD - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 14:26:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24947) aggregateAsync and foldAsync for RDD - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 14:26:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-14220) Build and test Spark against Scala 2.12 - posted by "Simeon H.K. Fitch (JIRA)" <ji...@apache.org> on 2018/08/02 15:25:04 UTC, 6 replies.
- [jira] [Issue Comment Deleted] (SPARK-14220) Build and test Spark against Scala 2.12 - posted by "Simeon H.K. Fitch (JIRA)" <ji...@apache.org> on 2018/08/02 15:25:05 UTC, 0 replies.
- [jira] [Commented] (SPARK-14540) Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner - posted by "Simeon H.K. Fitch (JIRA)" <ji...@apache.org> on 2018/08/02 15:28:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24826) Self-Join not working in Apache Spark 2.2.2 - posted by "Joseph Fourny (JIRA)" <ji...@apache.org> on 2018/08/02 15:55:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-24826) Self-Join not working in Apache Spark 2.2.2 - posted by "Joseph Fourny (JIRA)" <ji...@apache.org> on 2018/08/02 15:58:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24434) Support user-specified driver and executor pod templates - posted by "Rob Vesse (JIRA)" <ji...@apache.org> on 2018/08/02 16:16:00 UTC, 23 replies.
- [jira] [Resolved] (SPARK-24598) SPARK SQL:Datatype overflow conditions gives incorrect result - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/02 16:30:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24820) Fail fast when submitted job contains PartitionPruningRDD in a barrier stage - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/08/02 16:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24821) Fail fast when submitted job compute on a subset of all the partitions for a barrier stage - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/08/02 16:37:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24821) Fail fast when submitted job compute on a subset of all the partitions for a barrier stage - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/08/02 16:37:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24820) Fail fast when submitted job contains PartitionPruningRDD in a barrier stage - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/08/02 16:37:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24924) Add mapping for built-in Avro data source - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/08/02 16:38:00 UTC, 34 replies.
- [jira] [Updated] (SPARK-24940) Coalesce Hint for SQL Queries - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/02 16:53:01 UTC, 0 replies.
- [jira] [Created] (SPARK-25001) Remove build warnings in common, core, launcher, mllib, sql - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/02 17:17:02 UTC, 0 replies.
- [jira] [Updated] (SPARK-25001) Handle build warnings in common, core, launcher, mllib, sql - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/02 17:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25002) Avro: revise the output namespace - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/08/02 17:27:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25002) Avro: revise the output record namespace - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/08/02 17:28:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25001) Fix build miscellaneous warnings - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/02 17:32:04 UTC, 0 replies.
- [jira] [Commented] (SPARK-25002) Avro: revise the output record namespace - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 17:35:24 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25002) Avro: revise the output record namespace - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 17:35:43 UTC, 2 replies.
- [jira] [Commented] (SPARK-25001) Fix build miscellaneous warnings - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 17:40:02 UTC, 0 replies.
- [jira] [Created] (SPARK-25003) Pyspark Does not use Spark Sql Extensions - posted by "Russell Spitzer (JIRA)" <ji...@apache.org> on 2018/08/02 18:01:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24988) Add a castBySchema method which casts all the values of a DataFrame based on the DataTypes of a StructType - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/02 18:02:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25004) Add spark.executor.pyspark.memory config to set resource.RLIMIT_AS - posted by "Ryan Blue (JIRA)" <ji...@apache.org> on 2018/08/02 19:26:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25004) Add spark.executor.pyspark.memory config to set resource.RLIMIT_AS - posted by "Ryan Blue (JIRA)" <ji...@apache.org> on 2018/08/02 19:27:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25004) Add spark.executor.pyspark.memory config to set resource.RLIMIT_AS - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 19:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25004) Add spark.executor.pyspark.memory config to set resource.RLIMIT_AS - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 19:34:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-23908) High-order function: transform(array, function) → array - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/02 20:02:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-20964) Make some keywords reserved along with the ANSI/SQL standard - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/02 20:03:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24705) Spark.sql.adaptive.enabled=true is enabled and self-join query - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/02 20:06:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24720) kafka transaction creates Non-consecutive Offsets (due to transaction offset) making streaming fail when failOnDataLoss=true - posted by "Quentin Ambard (JIRA)" <ji...@apache.org> on 2018/08/02 20:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25005) Structured streaming doesn't support kafka transaction (creating empty offset with abort & markers) - posted by "Quentin Ambard (JIRA)" <ji...@apache.org> on 2018/08/02 20:48:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25006) Add optional catalog to TableIdentifier - posted by "Ryan Blue (JIRA)" <ji...@apache.org> on 2018/08/02 20:53:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-23908) High-order function: transform(array, function) → array - posted by "Herman van Hovell (JIRA)" <ji...@apache.org> on 2018/08/02 21:08:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25006) Add optional catalog to TableIdentifier - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 21:40:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25006) Add optional catalog to TableIdentifier - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 21:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25007) Add transform / array_except /array_union / array_shuffle to SparkR - posted by "Huaxin Gao (JIRA)" <ji...@apache.org> on 2018/08/02 21:47:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25007) Add transform / array_except /array_union / array_shuffle to SparkR - posted by "Huaxin Gao (JIRA)" <ji...@apache.org> on 2018/08/02 21:48:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25008) Add memory mode info to showMemoryUsage in TaskMemoryManager - posted by "Ankur Gupta (JIRA)" <ji...@apache.org> on 2018/08/02 21:53:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25001) Fix build miscellaneous warnings - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 22:01:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25009) Standalone Cluster mode application submit is not working - posted by "Devaraj K (JIRA)" <ji...@apache.org> on 2018/08/02 22:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25009) Standalone Cluster mode application submit is not working - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 22:16:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25009) Standalone Cluster mode application submit is not working - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 22:16:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24909) Spark scheduler can hang when fetch failures, executor lost, task running on lost executor, and multiple stage attempts - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 22:27:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-24896) Uuid expression should produce different values in each execution under streaming query - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/08/02 22:37:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24896) Uuid expression should produce different values in each execution under streaming query - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/08/02 22:37:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24909) Spark scheduler can hang when fetch failures, executor lost, task running on lost executor, and multiple stage attempts - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/08/02 22:38:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-22219) Refector "spark.sql.codegen.comments" - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/02 23:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-22219) Refector "spark.sql.codegen.comments" - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/02 23:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25010) Rand/Randn should produce different values for each execution in streaming query - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/08/02 23:28:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24928) spark sql cross join running time too long - posted by "Matthew Normyle (JIRA)" <ji...@apache.org> on 2018/08/02 23:29:00 UTC, 6 replies.
- [jira] [Resolved] (SPARK-21961) Filter out BlockStatuses Accumulators during replaying history logs in Spark History Server - posted by "Ye Zhou (JIRA)" <ji...@apache.org> on 2018/08/02 23:30:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25010) Rand/Randn should produce different values for each execution in streaming query - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 23:45:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25010) Rand/Randn should produce different values for each execution in streaming query - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/02 23:45:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-24773) support reading AVRO logical types - Timestamp with different precisions - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/03 00:33:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24773) support reading AVRO logical types - Timestamp with different precisions - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/03 00:33:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24945) Switch to uniVocity >= 2.7.2 - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/03 00:35:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24945) Switch to uniVocity >= 2.7.2 - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/03 00:35:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25009) Standalone Cluster mode application submit is not working - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/08/03 01:37:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-10413) ML models should support prediction on single instances - posted by "zhengruifeng (JIRA)" <ji...@apache.org> on 2018/08/03 02:08:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24910) Spark Bloom Filter Closure Serialization improvement for very high volume of Data - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/03 03:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24977) input_file_name() result can't save and use for partitionBy() - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/03 03:09:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24977) input_file_name() result can't save and use for partitionBy() - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/03 03:09:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24966) Fix the precedence rule for set operations. - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/03 05:06:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25011) Add PrefixSpan to __all__ - posted by "yuhao yang (JIRA)" <ji...@apache.org> on 2018/08/03 05:16:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23911) High-order function: reduce(array, initialState S, inputFunction, outputFunction) → R - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/08/03 05:23:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24948) SHS filters wrongly some applications due to permission check - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/08/03 05:30:01 UTC, 4 replies.
- [jira] [Resolved] (SPARK-25002) Avro: revise the output record namespace - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/03 05:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24788) RelationalGroupedDataset.toString throws errors when grouping by UnresolvedAttribute - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/03 05:44:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24997) Support MINUS ALL - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/03 05:46:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25011) Add PrefixSpan to __all__ - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/03 07:06:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25009) Standalone Cluster mode application submit is not working - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/08/03 07:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24989) BlockFetcher should retry while getting OutOfDirectMemoryError - posted by "Li Yuanjian (JIRA)" <ji...@apache.org> on 2018/08/03 07:45:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24993) Make Avro fast again - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/08/03 07:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24993) Make Avro fast again - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/08/03 07:54:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25012) dataframe creation results in matcherror - posted by "uwe (JIRA)" <ji...@apache.org> on 2018/08/03 09:42:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24987) Kafka Cached Consumer Leaking File Descriptors - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/03 09:52:02 UTC, 2 replies.
- [jira] [Commented] (SPARK-24987) Kafka Cached Consumer Leaking File Descriptors - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/03 09:52:02 UTC, 3 replies.
- [jira] [Commented] (SPARK-23932) High-order function: zip_with(array, array, function) → array - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/08/03 10:25:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25013) JDBC urls with jdbc:mariadb don't work as expected - posted by "Dieter Vekeman (JIRA)" <ji...@apache.org> on 2018/08/03 10:34:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24998) spark-sql will scan the same table repeatedly when doing multi-insert" - posted by "ice bai (JIRA)" <ji...@apache.org> on 2018/08/03 11:32:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24998) spark-sql will scan the same table repeatedly when doing multi-insert - posted by "ice bai (JIRA)" <ji...@apache.org> on 2018/08/03 11:35:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24772) support reading AVRO logical types - Decimal - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/03 12:08:05 UTC, 2 replies.
- [jira] [Commented] (SPARK-24772) support reading AVRO logical types - Decimal - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/03 12:08:05 UTC, 0 replies.
- [jira] [Commented] (SPARK-23937) High-order function: map_filter(map, function) → MAP - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/08/03 12:29:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24884) Implement regexp_extract_all - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/03 13:40:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25014) When we tried to read kafka topic through spark streaming spark submit is getting failed with Python worker exited unexpectedly (crashed) error - posted by "KARTHIKEYAN RASIPALAYAM DURAIRAJ (JIRA)" <ji...@apache.org> on 2018/08/03 15:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-23937) High-order function: map_filter(map, function) → MAP - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/03 15:23:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-24924) Add mapping for built-in Avro data source - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/03 15:30:00 UTC, 4 replies.
- [jira] [Updated] (SPARK-25014) When we tried to read kafka topic through spark streaming spark submit is getting failed with Python worker exited unexpectedly (crashed) error - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/03 15:48:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25014) When we tried to read kafka topic through spark streaming spark submit is getting failed with Python worker exited unexpectedly (crashed) error - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/03 15:48:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-18057) Update structured streaming kafka from 0.10.0.1 to 2.0.0 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/03 15:49:01 UTC, 0 replies.
- [jira] [Created] (SPARK-25015) Update Hadoop 2.7 to 2.7.7 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/03 15:52:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25015) Update Hadoop 2.7 to 2.7.7 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/03 15:56:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25015) Update Hadoop 2.7 to 2.7.7 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/03 15:56:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25003) Pyspark Does not use Spark Sql Extensions - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/03 15:59:00 UTC, 5 replies.
- [jira] [Assigned] (SPARK-25003) Pyspark Does not use Spark Sql Extensions - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/03 15:59:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25011) Add PrefixSpan to __all__ in fpm.py - posted by "yuhao yang (JIRA)" <ji...@apache.org> on 2018/08/03 16:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-20696) tf-idf document clustering with K-means in Apache Spark putting points into one cluster - posted by "Aditya Kamath (JIRA)" <ji...@apache.org> on 2018/08/03 16:25:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24954) Fail fast on job submit if run a barrier stage with dynamic resource allocation enabled - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/08/03 16:38:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24954) Fail fast on job submit if run a barrier stage with dynamic resource allocation enabled - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/08/03 16:38:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24918) Executor Plugin API - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/08/03 16:54:00 UTC, 16 replies.
- [jira] [Updated] (SPARK-24918) Executor Plugin API - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/08/03 16:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25016) remove Support for hadoop 2.6 - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/08/03 17:01:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25016) remove Support for hadoop 2.6 - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/08/03 17:01:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25017) Add test suite for ContextBarrierState - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/08/03 17:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25018) Use `Co-Authored-By` git trailer in `merge_spark_pr.py` - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/08/03 18:03:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25018) Use `Co-Authored-By` git trailer in `merge_spark_pr.py` - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/03 18:05:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25018) Use `Co-Authored-By` git trailer in `merge_spark_pr.py` - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/03 18:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25019) The published spark sql pom does not exclude the normal version of orc-core - posted by "Yin Huai (JIRA)" <ji...@apache.org> on 2018/08/03 18:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25019) The published spark sql pom does not exclude the normal version of orc-core - posted by "Yin Huai (JIRA)" <ji...@apache.org> on 2018/08/03 18:08:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25020) Unable to Perform Graceful Shutdown in Spark Streaming with Hadoop 2.8 - posted by "Ricky Saltzer (JIRA)" <ji...@apache.org> on 2018/08/03 18:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25021) Add spark.executor.pyspark.memory support to Kubernetes - posted by "Ryan Blue (JIRA)" <ji...@apache.org> on 2018/08/03 18:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25022) Add spark.executor.pyspark.memory support to Mesos - posted by "Ryan Blue (JIRA)" <ji...@apache.org> on 2018/08/03 18:37:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25020) Unable to Perform Graceful Shutdown in Spark Streaming with Hadoop 2.8 - posted by "Ricky Saltzer (JIRA)" <ji...@apache.org> on 2018/08/03 19:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24375) Design sketch: support barrier scheduling in Apache Spark - posted by "Mridul Muralidharan (JIRA)" <ji...@apache.org> on 2018/08/03 19:38:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-21986) QuantileDiscretizer picks wrong split point for data with lots of 0's - posted by "Barry Becker (JIRA)" <ji...@apache.org> on 2018/08/03 20:31:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24983) Collapsing multiple project statements with dependent When-Otherwise statements on the same column can OOM the driver - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/03 20:41:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24983) Collapsing multiple project statements with dependent When-Otherwise statements on the same column can OOM the driver - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/03 20:41:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25023) Clarify Spark security documentation - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/08/03 21:08:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25024) Update mesos documentation to be clear about security supported - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/08/03 21:09:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25024) Update mesos documentation to be clear about security supported - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/08/03 21:12:00 UTC, 7 replies.
- [jira] [Issue Comment Deleted] (SPARK-25024) Update mesos documentation to be clear about security supported - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/08/03 21:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25023) Clarify Spark security documentation - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/08/03 21:12:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24529) Add spotbugs into maven build process - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/03 21:28:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24529) Add spotbugs into maven build process - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/03 21:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24888) spark-submit --master spark://host:port --status driver-id does not work - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/04 00:55:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24888) spark-submit --master spark://host:port --status driver-id does not work - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/04 00:55:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24722) Column-based API for pivoting - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/04 06:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24722) Column-based API for pivoting - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/04 06:19:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24940) Coalesce Hint for SQL Queries - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/04 06:29:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-23909) High-order function: filter(array, function) → array - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/08/04 07:08:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23911) High-order function: aggregate(array, initialState S, inputFunction, outputFunction) → R - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/04 07:11:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-23909) High-order function: filter(array, function) → array - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/08/04 07:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23911) High-order function: aggregate(array, initialState S, inputFunction, outputFunction) → R - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/04 07:12:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25025) Remove the default value of isAll in INTERSECT/EXCEPT - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/04 08:09:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24926) Ensure numCores is used consistently in all netty configuration (driver and executors) - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/04 15:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24926) Ensure numCores is used consistently in all netty configuration (driver and executors) - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/04 15:28:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24926) Ensure numCores is used consistently in all netty configuration (driver and executors) - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/04 15:29:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25001) Fix build miscellaneous warnings - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/04 16:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24940) Coalesce Hint for SQL Queries - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/04 19:07:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24987) Kafka Cached Consumer Leaking File Descriptors - posted by "Cody Koeninger (JIRA)" <ji...@apache.org> on 2018/08/04 19:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24940) Coalesce and Repartition Hint for SQL Queries - posted by "John Zhuge (JIRA)" <ji...@apache.org> on 2018/08/04 19:50:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25026) Binary releases don't contain Kafka integration modules - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/04 19:56:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25015) Update Hadoop 2.7 to 2.7.7 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/04 20:00:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25026) Binary releases don't contain Kafka integration modules - posted by "Cody Koeninger (JIRA)" <ji...@apache.org> on 2018/08/04 20:17:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25026) Binary releases don't contain Kafka integration modules - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/04 20:27:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25027) LegacyAccumulatorWrapper test fails in Scala 2.12 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/04 22:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25025) Remove the default value of isAll in INTERSECT/EXCEPT - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/04 22:29:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25025) Remove the default value of isAll in INTERSECT/EXCEPT - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/04 22:29:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-23911) High-order function: aggregate(array, initialState S, inputFunction, outputFunction) → R - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/08/05 00:00:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24375) Design sketch: support barrier scheduling in Apache Spark - posted by "Mridul Muralidharan (JIRA)" <ji...@apache.org> on 2018/08/05 04:43:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23939) High-order function: transform_keys(map, function) → map - posted by "Neha Patil (JIRA)" <ji...@apache.org> on 2018/08/05 07:08:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25028) AnalyzePartitionCommand failed with NPE if value is null - posted by "Izek Greenfield (JIRA)" <ji...@apache.org> on 2018/08/05 07:26:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24987) Kafka Cached Consumer Leaking File Descriptors - posted by "Yuval Itzchakov (JIRA)" <ji...@apache.org> on 2018/08/05 10:55:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25026) Binary releases should contain some copy of compiled external integration modules - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/05 13:44:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24819) Fail fast when no enough slots to launch the barrier stage on job submitted - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/05 15:59:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24819) Fail fast when no enough slots to launch the barrier stage on job submitted - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/05 15:59:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-23772) Provide an option to ignore column of all null values or empty map/array during JSON schema inference - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/05 20:02:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25019) The published spark sql pom does not exclude the normal version of orc-core - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/08/05 21:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/05 21:13:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/05 21:16:00 UTC, 20 replies.
- [jira] [Assigned] (SPARK-25019) The published spark sql pom does not exclude the normal version of orc-core - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/05 22:06:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/08/05 22:33:00 UTC, 16 replies.
- [jira] [Assigned] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/05 23:04:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-20592) Alter table concatenate is not working as expected. - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/06 02:44:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-24857) required the sample code test the spark steaming job in kubernates and write the data in remote hdfs file system - posted by "kumpatla murali krishna (JIRA)" <ji...@apache.org> on 2018/08/06 06:37:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25013) JDBC urls with jdbc:mariadb don't work as expected - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/08/06 07:06:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-24991) use InternalRow in DataSourceWriter - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/06 07:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-9478) Add sample weights to Random Forest - posted by "Julian King (JIRA)" <ji...@apache.org> on 2018/08/06 08:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24857) required the sample code test the spark steaming job in kubernates and write the data in remote hdfs file system - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/06 08:53:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-16817) Enable storing of shuffle data in Alluxio - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/06 08:59:01 UTC, 0 replies.
- [jira] [Created] (SPARK-25030) SparkSubmit will not return result if the mainClass submitted creates a Timer() - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/08/06 09:29:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25012) dataframe creation results in matcherror - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/08/06 09:50:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-25025) Remove the default value of isAll in INTERSECT/EXCEPT - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/06 10:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25031) The schema of MapType can not be printed correctly - posted by "Hao Ren (JIRA)" <ji...@apache.org> on 2018/08/06 11:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25031) The schema of MapType can not be printed correctly - posted by "Hao Ren (JIRA)" <ji...@apache.org> on 2018/08/06 11:23:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25031) The schema of MapType can not be printed correctly - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/06 11:36:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-25031) The schema of MapType can not be printed correctly - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/06 11:36:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25032) Create table is failing, after dropping the database . It is not falling back to default database - posted by "Ayush Anubhava (JIRA)" <ji...@apache.org> on 2018/08/06 12:12:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25032) Create table is failing, after dropping the database . It is not falling back to default database - posted by "Ayush Anubhava (JIRA)" <ji...@apache.org> on 2018/08/06 12:16:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-23938) High-order function: map_zip_with(map, map, function) → map - posted by "Marek Novotny (JIRA)" <ji...@apache.org> on 2018/08/06 12:30:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-24981) ShutdownHook timeout causes job to fail when succeeded when SparkContext stop() not called by user program - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/08/06 14:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25033) Bump Apache commons.{httpclient, httpcore} - posted by "Fokko Driesprong (JIRA)" <ji...@apache.org> on 2018/08/06 14:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25033) Bump Apache commons.{httpclient, httpcore} - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/06 14:19:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25033) Bump Apache commons.{httpclient, httpcore} - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/06 14:19:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23913) High-order function: array_intersect(x, y) → array - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/08/06 14:30:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24928) spark sql cross join running time too long - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/08/06 14:46:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-24928) spark sql cross join running time too long - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/06 16:30:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25034) possible triple memory consumption in fetchBlockSync() - posted by "Vincent (JIRA)" <ji...@apache.org> on 2018/08/06 16:50:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24882) data source v2 API improvement - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/06 17:16:00 UTC, 8 replies.
- [jira] [Assigned] (SPARK-24882) data source v2 API improvement - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/06 17:16:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-21436) Take advantage of known partioner for distinct on RDDs - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/08/06 17:20:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-21436) Take advantage of known partioner for distinct on RDDs - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/08/06 17:20:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25035) Replication disk-stored blocks should avoid memory mapping - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/08/06 17:23:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25035) Replicating disk-stored blocks should avoid memory mapping - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/08/06 17:46:01 UTC, 0 replies.
- [jira] [Assigned] (SPARK-21436) Take advantage of known partioner for distinct on RDDs - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/06 18:10:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24822) Python support for barrier execution mode - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/06 18:11:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24822) Python support for barrier execution mode - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/06 18:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24229) Upgrade to the latest Apache Thrift 0.10.0 release - posted by "Sushant Pritmani (JIRA)" <ji...@apache.org> on 2018/08/06 18:52:00 UTC, 0 replies.
- [jira] [Issue Comment Deleted] (SPARK-24229) Upgrade to the latest Apache Thrift 0.10.0 release - posted by "Sushant Pritmani (JIRA)" <ji...@apache.org> on 2018/08/06 18:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25036) Scala 2.12 issues: Compilation error with sbt - posted by "Kazuaki Ishizaki (JIRA)" <ji...@apache.org> on 2018/08/06 18:56:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24992) spark should randomize yarn local dir selection - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/08/06 19:00:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25019) The published spark sql pom does not exclude the normal version of orc-core - posted by "Yin Huai (JIRA)" <ji...@apache.org> on 2018/08/06 19:02:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25036) Scala 2.12 issues: Compilation error with sbt - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/06 19:03:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-25036) Scala 2.12 issues: Compilation error with sbt - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/06 19:03:00 UTC, 4 replies.
- [jira] [Assigned] (SPARK-23939) High-order function: transform_keys(map, function) → map - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/06 19:06:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/06 19:40:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-20286) dynamicAllocation.executorIdleTimeout is ignored after unpersist - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/06 20:46:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-20286) dynamicAllocation.executorIdleTimeout is ignored after unpersist - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/06 20:46:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24786) Executors not being released after all cached data is unpersisted - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/06 20:47:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24786) Executors not being released after all cached data is unpersisted - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/06 20:47:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24948) SHS filters wrongly some applications due to permission check - posted by "Mridul Muralidharan (JIRA)" <ji...@apache.org> on 2018/08/06 21:35:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24161) Enable debug package feature on structured streaming - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/08/06 22:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25037) plan.transformAllExpressions doesn't transform expressions in subquery plans - posted by "Chris O'Hara (JIRA)" <ji...@apache.org> on 2018/08/06 23:19:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25037) plan.transformAllExpressions doesn't transform expressions in subquery plans - posted by "Chris O'Hara (JIRA)" <ji...@apache.org> on 2018/08/06 23:20:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25037) plan.transformAllExpressions doesn't transform expressions in nested SubqueryExpression plans - posted by "Chris O'Hara (JIRA)" <ji...@apache.org> on 2018/08/06 23:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25037) plan.transformAllExpressions() doesn't transform expressions in nested SubqueryExpression plans - posted by "Chris O'Hara (JIRA)" <ji...@apache.org> on 2018/08/06 23:23:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-24996) Use DSL to simplify DeclarativeAggregate - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/06 23:49:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-23938) High-order function: map_zip_with(map, map, function) → map - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/06 23:52:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25030) SparkSubmit will not return result if the mainClass submitted creates a Timer() - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/08/07 00:13:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25030) SparkSubmit.doSubmit will not return result if the mainClass submitted creates a Timer() - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/08/07 00:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24906) Adaptively set split size for columnar file to ensure the task read data size fit expectation - posted by "Jason Guo (JIRA)" <ji...@apache.org> on 2018/08/07 00:32:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25038) Accelerate Spark Plan generation when Spark SQL read large amount of data - posted by "Jason Guo (JIRA)" <ji...@apache.org> on 2018/08/07 00:41:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25038) Accelerate Spark Plan generation when Spark SQL read large amount of data - posted by "Jason Guo (JIRA)" <ji...@apache.org> on 2018/08/07 00:50:00 UTC, 12 replies.
- [jira] [Commented] (SPARK-25030) SparkSubmit.doSubmit will not return result if the mainClass submitted creates a Timer() - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/08/07 01:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25028) AnalyzePartitionCommand failed with NPE if value is null - posted by "Achuth Narayan Rajagopal (JIRA)" <ji...@apache.org> on 2018/08/07 01:30:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25012) dataframe creation results in matcherror - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/07 01:48:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25026) Binary releases should contain some copy of compiled external integration modules - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/07 01:59:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25028) AnalyzePartitionCommand failed with NPE if value is null - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/07 02:00:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25037) plan.transformAllExpressions() doesn't transform expressions in nested SubqueryExpression plans - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/07 02:02:00 UTC, 5 replies.
- [jira] [Commented] (SPARK-25038) Accelerate Spark Plan generation when Spark SQL read large amount of data - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/07 02:03:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-24637) Add metrics regarding state and watermark to dropwizard metrics - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/07 02:13:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24637) Add metrics regarding state and watermark to dropwizard metrics - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/07 02:13:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25037) plan.transformAllExpressions() doesn't transform expressions in nested SubqueryExpression plans - posted by "Chris O'Hara (JIRA)" <ji...@apache.org> on 2018/08/07 02:18:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24748) Support for reporting custom metrics via Streaming Query Progress - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/07 02:29:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24748) Support for reporting custom metrics via Streaming Query Progress - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/07 02:29:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25018) Use `Co-Authored-By` git trailer in `merge_spark_pr.py` - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/07 02:32:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25037) plan.transformAllExpressions() doesn't transform expressions in nested SubqueryExpression plans - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/07 02:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25038) Accelerate Spark Plan generation when Spark SQL read large amount of data - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/07 03:27:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-23940) High-order function: transform_values(map, function) → map - posted by "Neha Patil (JIRA)" <ji...@apache.org> on 2018/08/07 03:48:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25039) Binary comparison behavior should refer to Teradata - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/07 04:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25040) Empty string for double and float types should be nulls in JSON - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/07 05:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25040) Empty string for double and float types should be nulls in JSON - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/07 05:29:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25040) Empty string for double and float types should be nulls in JSON - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/07 05:29:00 UTC, 1 replies.
- [jira] [Reopened] (SPARK-24886) Increase Jenkins build time - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/07 05:53:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24886) Increase Jenkins build time - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/07 05:54:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24703) Unable to multiply calendar interval - posted by "Priyanka Garg (JIRA)" <ji...@apache.org> on 2018/08/07 06:05:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24703) Unable to multiply calendar interval - posted by "Priyanka Garg (JIRA)" <ji...@apache.org> on 2018/08/07 06:06:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25010) Rand/Randn should produce different values for each execution in streaming query - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/07 06:30:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24817) Implement BarrierTaskContext.barrier() - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/07 07:08:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24817) Implement BarrierTaskContext.barrier() - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/07 07:08:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25041) genjavadoc-plugin_2.12.6 is not found with sbt in scala-2.12 - posted by "Kazuaki Ishizaki (JIRA)" <ji...@apache.org> on 2018/08/07 07:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24341) Codegen compile error from predicate subquery - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/07 07:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24341) Codegen compile error from predicate subquery - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/07 07:45:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25041) genjavadoc-plugin_2.12.6 is not found with sbt in scala-2.12 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/07 08:06:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25041) genjavadoc-plugin_2.12.6 is not found with sbt in scala-2.12 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/07 08:06:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25041) genjavadoc-plugin_0.10 is not found with sbt in scala-2.12 - posted by "Kazuaki Ishizaki (JIRA)" <ji...@apache.org> on 2018/08/07 08:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24948) SHS filters wrongly some applications due to permission check - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/07 08:32:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24005) Remove usage of Scala’s parallel collection - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/07 09:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24005) Remove usage of Scala’s parallel collection - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/07 09:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24772) support reading AVRO logical types - Decimal - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/07 09:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25042) Flaky test: org.apache.spark.streaming.kafka010.KafkaRDDSuite.compacted topic - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/08/07 10:13:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23928) High-order function: shuffle(x) → array - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/07 10:28:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25034) possible triple memory consumption in fetchBlockSync() - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/07 13:03:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25034) possible triple memory consumption in fetchBlockSync() - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/07 13:03:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-19602) Unable to query using the fully qualified column name of the form ( ..) - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/07 13:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25043) spark-sql should print the appId and master on startup - posted by "Alessandro Bellina (JIRA)" <ji...@apache.org> on 2018/08/07 14:16:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25043) spark-sql should print the appId and master on startup - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/07 14:21:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25043) spark-sql should print the appId and master on startup - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/07 14:21:00 UTC, 2 replies.
- [jira] [Reopened] (SPARK-14220) Build and test Spark against Scala 2.12 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/07 14:40:05 UTC, 0 replies.
- [jira] [Created] (SPARK-25044) Address translation of LMF closure primitive args to Object in Scala 2.12 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/07 14:41:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25044) Address translation of LMF closure primitive args to Object in Scala 2.12 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/07 14:49:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25045) Make `RDDBarrier.mapParititions` similar to `RDD.mapPartitions` - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/08/07 14:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25045) Make `RDDBarrier.mapParititions` similar to `RDD.mapPartitions` - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/07 15:04:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25045) Make `RDDBarrier.mapParititions` similar to `RDD.mapPartitions` - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/07 15:04:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25046) Alter View can excute sql like "ALTER VIEW ... AS INSERT INTO" - posted by "SongXun (JIRA)" <ji...@apache.org> on 2018/08/07 15:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25046) Alter View can excute sql like "ALTER VIEW ... AS INSERT INTO" - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/07 15:32:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25046) Alter View can excute sql like "ALTER VIEW ... AS INSERT INTO" - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/07 15:32:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24979) add AnalysisHelper#resolveOperatorsUp - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/07 15:46:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25047) Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/07 15:47:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24395) Fix Behavior of NOT IN with Literals Containing NULL - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/07 16:06:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24395) Fix Behavior of NOT IN with Literals Containing NULL - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/07 16:06:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25048) Pivoting by multiple columns - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/08/07 16:36:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25048) Pivoting by multiple columns - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/07 16:47:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25048) Pivoting by multiple columns - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/07 16:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25048) Pivoting by multiple columns in Scala/Java - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/08/07 16:57:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25041) genjavadoc-plugin_0.10 is not found with sbt in scala-2.12 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/07 17:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25041) genjavadoc-plugin_0.10 is not found with sbt in scala-2.12 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/07 17:00:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23937) High-order function: map_filter(map, function) → MAP - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/08/07 17:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25049) Support custom schema in `to_avro` - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/08/07 17:46:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25050) Handle more than two types in avro union types - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/08/07 17:47:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25044) Address translation of LMF closure primitive args to Object in Scala 2.12 - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/08/07 18:19:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-25047) Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/08/07 18:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25047) Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/08/07 18:19:00 UTC, 5 replies.
- [jira] [Commented] (SPARK-25044) Address translation of LMF closure primitive args to Object in Scala 2.12 - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/08/07 18:19:00 UTC, 12 replies.
- [jira] [Assigned] (SPARK-23932) High-order function: zip_with(array, array, function) → array - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/07 18:41:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25051) where clause on dataset gives AnalysisException - posted by "MIK (JIRA)" <ji...@apache.org> on 2018/08/07 19:00:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23207) Shuffle+Repartition on an DataFrame could lead to incorrect answers - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/08/07 20:00:00 UTC, 10 replies.
- [jira] [Resolved] (SPARK-25046) Alter View can excute sql like "ALTER VIEW ... AS INSERT INTO" - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/07 21:55:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25052) Is there any possibility that spark structured streaming generate duplicates in the output? - posted by "bharath kumar avusherla (JIRA)" <ji...@apache.org> on 2018/08/07 22:41:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25053) Allow additional port forwarding on Spark on K8S as needed - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/08/07 23:39:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25045) Make `RDDBarrier.mapParititions` similar to `RDD.mapPartitions` - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/08/08 00:33:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25047) Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/08 00:34:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-23935) High-order function: map_entries(map) → array> - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/08 01:20:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-22634) Update Bouncy castle dependency - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/08/08 01:31:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-24251) DataSourceV2: Add AppendData logical operation - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/08 01:57:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24251) DataSourceV2: Add AppendData logical operation - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/08 01:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25051) where clause on dataset gives AnalysisException - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/08 02:14:00 UTC, 10 replies.
- [jira] [Resolved] (SPARK-25052) Is there any possibility that spark structured streaming generate duplicates in the output? - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/08 02:15:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25052) Is there any possibility that spark structured streaming generate duplicates in the output? - posted by "bharath kumar avusherla (JIRA)" <ji...@apache.org> on 2018/08/08 03:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25054) Enable MetricsServlet sink for Executor - posted by "Lantao Jin (JIRA)" <ji...@apache.org> on 2018/08/08 04:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25054) Enable MetricsServlet sink for Executor - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/08 04:31:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25054) Enable MetricsServlet sink for Executor - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/08 04:31:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24948) SHS filters wrongly some applications due to permission check - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/08/08 05:48:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25036) Scala 2.12 issues: Compilation error with sbt - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/08 06:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25028) AnalyzePartitionCommand failed with NPE if value is null - posted by "Izek Greenfield (JIRA)" <ji...@apache.org> on 2018/08/08 09:28:00 UTC, 1 replies.
- [jira] [Reopened] (SPARK-25028) AnalyzePartitionCommand failed with NPE if value is null - posted by "Izek Greenfield (JIRA)" <ji...@apache.org> on 2018/08/08 09:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25028) AnalyzePartitionCommand failed with NPE if value is null - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/08 12:13:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25055) MessageWithHeader transfer ByteBuffer from Netty's CompositeByteBuf many times - posted by "DENG FEI (JIRA)" <ji...@apache.org> on 2018/08/08 12:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24502) flaky test: UnsafeRowSerializerSuite - posted by "Paul Praet (JIRA)" <ji...@apache.org> on 2018/08/08 12:34:00 UTC, 5 replies.
- [jira] [Commented] (SPARK-25055) MessageWithHeader transfer ByteBuffer from Netty's CompositeByteBuf many times - posted by "DENG FEI (JIRA)" <ji...@apache.org> on 2018/08/08 12:37:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24772) support reading AVRO logical types - Date - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/08/08 13:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24774) support reading AVRO logical types - Decimal - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/08/08 13:40:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24774) support reading AVRO logical types - Decimal - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/08 13:42:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24774) support reading AVRO logical types - Decimal - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/08 13:42:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25056) Unify the InConversion and BinaryComparison behaviour when InConversion's list only contains one datatype - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/08 15:35:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25056) Unify the InConversion and BinaryComparison behaviour when InConversion's list only contains one datatype - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/08 15:41:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25056) Unify the InConversion and BinaryComparison behaviour when InConversion's list only contains one datatype - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/08 15:41:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25057) Unable to start spark on master URL - posted by "Shivam Gupta (JIRA)" <ji...@apache.org> on 2018/08/08 15:46:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25058) Use Block.isEmpty/nonEmpty to check whether the code is empty or not. - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/08/08 17:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25058) Use Block.isEmpty/nonEmpty to check whether the code is empty or not. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/08 17:13:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25058) Use Block.isEmpty/nonEmpty to check whether the code is empty or not. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/08 17:13:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25005) Structured streaming doesn't support kafka transaction (creating empty offset with abort & markers) - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/08 17:53:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25005) Structured streaming doesn't support kafka transaction (creating empty offset with abort & markers) - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/08 17:53:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24251) DataSourceV2: Add AppendData logical operation - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/08 18:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23912) High-order function: array_distinct(x) → array - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/08 18:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23050) Structured Streaming with S3 file source duplicates data because of eventual consistency. - posted by "bharath kumar avusherla (JIRA)" <ji...@apache.org> on 2018/08/08 18:51:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-23050) Structured Streaming with S3 file source duplicates data because of eventual consistency. - posted by "bharath kumar avusherla (JIRA)" <ji...@apache.org> on 2018/08/08 18:52:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-23940) High-order function: transform_values(map, function) → map - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/08 19:52:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-19851) Add support for EVERY and ANY (SOME) aggregates - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/08 20:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25059) Exception while executing an action on DataFrame that read Json - posted by "Kunal Goswami (JIRA)" <ji...@apache.org> on 2018/08/08 20:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25059) Exception while executing an action on DataFrame that read Json - posted by "Kunal Goswami (JIRA)" <ji...@apache.org> on 2018/08/08 20:18:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25060) PySpark UDF in case statement is always run - posted by "Ryan Blue (JIRA)" <ji...@apache.org> on 2018/08/08 20:38:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25060) PySpark UDF in case statement is always run - posted by "Ryan Blue (JIRA)" <ji...@apache.org> on 2018/08/08 20:39:00 UTC, 4 replies.
- [jira] [Comment Edited] (SPARK-25060) PySpark UDF in case statement is always run - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/08/08 21:04:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25061) Spark SQL Thrift Server fails to not pick up hiveconf passing parameter - posted by "Zineng Yuan (JIRA)" <ji...@apache.org> on 2018/08/08 21:13:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25061) Spark SQL Thrift Server fails to not pick up hiveconf passing parameter - posted by "Zineng Yuan (JIRA)" <ji...@apache.org> on 2018/08/08 21:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25061) Spark SQL Thrift Server fails to not pick up hiveconf passing parameter - posted by "Zineng Yuan (JIRA)" <ji...@apache.org> on 2018/08/08 21:31:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25051) where clause on dataset gives AnalysisException - posted by "MIK (JIRA)" <ji...@apache.org> on 2018/08/08 21:33:00 UTC, 4 replies.
- [jira] [Created] (SPARK-25062) Clean up BlockLocations in FileStatus objects - posted by "andrzej.stankevich@gmail.com (JIRA)" <ji...@apache.org> on 2018/08/09 01:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25062) Clean up BlockLocations in FileStatus objects - posted by "andrzej.stankevich@gmail.com (JIRA)" <ji...@apache.org> on 2018/08/09 01:41:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-23596) Modify Dataset test harness to include interpreted execution - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/09 04:09:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23596) Modify Dataset test harness to include interpreted execution - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/09 04:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25063) Rename class KnowNotNull to KnownNotNull - posted by "Maryann Xue (JIRA)" <ji...@apache.org> on 2018/08/09 04:26:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25063) Rename class KnowNotNull to KnownNotNull - posted by "Maryann Xue (JIRA)" <ji...@apache.org> on 2018/08/09 04:28:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25063) Rename class KnowNotNull to KnownNotNull - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/09 04:30:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25063) Rename class KnowNotNull to KnownNotNull - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/09 04:30:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25058) Use Block.isEmpty/nonEmpty to check whether the code is empty or not. - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/08/09 05:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25055) MessageWithHeader transfer ByteBuffer from Netty's CompositeByteBuf many times - posted by "DENG FEI (JIRA)" <ji...@apache.org> on 2018/08/09 06:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25064) Total Tasks in WebUI does not match Active+Failed+Complete Tasks - posted by "StanZhai (JIRA)" <ji...@apache.org> on 2018/08/09 07:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25065) Provide a way to add a custom logging configuration file. - posted by "Prashant Sharma (JIRA)" <ji...@apache.org> on 2018/08/09 07:30:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25065) Provide a way to add a custom logging configuration file. - posted by "Prashant Sharma (JIRA)" <ji...@apache.org> on 2018/08/09 07:37:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25066) Provide Spark R image for deploying Spark on kubernetes. - posted by "Prashant Sharma (JIRA)" <ji...@apache.org> on 2018/08/09 07:39:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-25065) Provide a way to add a custom logging configuration file. - posted by "Prashant Sharma (JIRA)" <ji...@apache.org> on 2018/08/09 07:41:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-25064) Total Tasks in WebUI does not match Active+Failed+Complete Tasks - posted by "StanZhai (JIRA)" <ji...@apache.org> on 2018/08/09 07:45:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25064) Total Tasks in WebUI does not match Active+Failed+Complete Tasks - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/09 08:02:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25064) Total Tasks in WebUI does not match Active+Failed+Complete Tasks - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/09 08:02:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25067) Active tasks exceed total cores of an executor in WebUI - posted by "StanZhai (JIRA)" <ji...@apache.org> on 2018/08/09 08:05:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25067) Active tasks exceed total cores of an executor in WebUI - posted by "StanZhai (JIRA)" <ji...@apache.org> on 2018/08/09 08:06:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25068) High-order function: exists(array, function) → boolean - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/08/09 08:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25068) High-order function: exists(array, function) → boolean - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/09 08:29:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-25068) High-order function: exists(array, function) → boolean - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/09 08:29:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25069) Using UnsafeAlignedOffset to make the entire record of 8 byte Items aligned like which is used in UnsafeExternalSorter - posted by "eaton (JIRA)" <ji...@apache.org> on 2018/08/09 09:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25069) Using UnsafeAlignedOffset to make the entire record of 8 byte Items aligned like which is used in UnsafeExternalSorter - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/09 09:17:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25069) Using UnsafeAlignedOffset to make the entire record of 8 byte Items aligned like which is used in UnsafeExternalSorter - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/09 09:17:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25070) BlockFetchingListener#onBlockFetchSuccess throw "java.util.NoSuchElementException: key not found: shuffle_8_68_113" on ShuffleBlockFetcherIterator caused stage hang long time - posted by "DENG FEI (JIRA)" <ji...@apache.org> on 2018/08/09 09:52:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25070) BlockFetchingListener#onBlockFetchSuccess throw "java.util.NoSuchElementException: key not found: shuffle_8_68_113" on ShuffleBlockFetcherIterator caused stage hang long time - posted by "DENG FEI (JIRA)" <ji...@apache.org> on 2018/08/09 09:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24042) High-order function: zip_with_index - posted by "Marek Novotny (JIRA)" <ji...@apache.org> on 2018/08/09 10:09:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24703) Unable to multiply calendar interval - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/09 10:27:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25071) BuildSide is coming not as expected with join queries - posted by "Ayush Anubhava (JIRA)" <ji...@apache.org> on 2018/08/09 11:14:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25071) BuildSide is coming not as expected with join queries - posted by "Ayush Anubhava (JIRA)" <ji...@apache.org> on 2018/08/09 11:30:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-25054) Enable MetricsServlet sink for Executor - posted by "Lantao Jin (JIRA)" <ji...@apache.org> on 2018/08/09 12:01:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-25054) Enable MetricsServlet sink for Executor - posted by "Lantao Jin (JIRA)" <ji...@apache.org> on 2018/08/09 12:01:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25072) PySpark custom Row class can be given extra parameters - posted by "Jan-Willem van der Sijp (JIRA)" <ji...@apache.org> on 2018/08/09 12:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25032) Create table is failing, after dropping the database . It is not falling back to default database - posted by "sandeep katta (JIRA)" <ji...@apache.org> on 2018/08/09 12:16:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-25032) Create table is failing, after dropping the database . It is not falling back to default database - posted by "sandeep katta (JIRA)" <ji...@apache.org> on 2018/08/09 12:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25073) Spark-submit on Yarn Task : When the yarn.nodemanager.resource.memory-mb and/or yarn.scheduler.maximum-allocation-mb is insufficient, Spark always reports an error request to adjust yarn.scheduler.maximum-allocation-mb - posted by "vivek kumar (JIRA)" <ji...@apache.org> on 2018/08/09 12:18:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-12449) Pushing down arbitrary logical plans to data sources - posted by "Johannes Zillmann (JIRA)" <ji...@apache.org> on 2018/08/09 12:27:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-23415) BufferHolderSparkSubmitSuite is flaky - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/09 12:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25074) Implement maxNumConcurrentTasks() in MesosFineGrainedSchedulerBackend - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/08/09 12:33:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23415) BufferHolderSparkSubmitSuite is flaky - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/09 12:33:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25073) Spark-submit on Yarn Task : When the yarn.nodemanager.resource.memory-mb and/or yarn.scheduler.maximum-allocation-mb is insufficient, Spark always reports an error request to adjust yarn.scheduler.maximum-allocation-mb - posted by "vivek kumar (JIRA)" <ji...@apache.org> on 2018/08/09 12:42:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25047) Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/09 13:09:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25075) Build and test Spark against Scala 2.13 - posted by "Guillaume Massé (JIRA)" <ji...@apache.org> on 2018/08/09 13:27:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25075) Build and test Spark against Scala 2.13 - posted by "Guillaume Massé (JIRA)" <ji...@apache.org> on 2018/08/09 13:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25073) Spark-submit on Yarn Task : When the yarn.nodemanager.resource.memory-mb and/or yarn.scheduler.maximum-allocation-mb is insufficient, Spark always reports an error request to adjust yarn.scheduler.maximum-allocation-mb - posted by "Sujith (JIRA)" <ji...@apache.org> on 2018/08/09 13:48:00 UTC, 4 replies.
- [jira] [Created] (SPARK-25076) SQLConf should not be retrieved from a stopped SparkSession - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/09 14:26:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25076) SQLConf should not be retrieved from a stopped SparkSession - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/09 14:34:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25076) SQLConf should not be retrieved from a stopped SparkSession - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/09 14:34:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25063) Rename class KnowNotNull to KnownNotNull - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/09 15:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25077) Delete unused variable in WindowExec - posted by "Li Yuanjian (JIRA)" <ji...@apache.org> on 2018/08/09 15:57:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25077) Delete unused variable in WindowExec - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/09 16:00:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25077) Delete unused variable in WindowExec - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/09 16:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25078) Standalone cluster mode does not work with spark.authenticate.secret - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/08/09 16:03:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25078) Standalone does not work with spark.authenticate.secret and deploy-mode=cluster - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/08/09 16:04:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25059) Exception while executing an action on DataFrame that read Json - posted by "Kazuaki Ishizaki (JIRA)" <ji...@apache.org> on 2018/08/09 16:55:00 UTC, 1 replies.
- [jira] [Reopened] (SPARK-25036) Scala 2.12 issues: Compilation error with sbt - posted by "Kazuaki Ishizaki (JIRA)" <ji...@apache.org> on 2018/08/09 17:05:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25036) Scala 2.12 issues: Compilation error with sbt - posted by "Kazuaki Ishizaki (JIRA)" <ji...@apache.org> on 2018/08/09 17:06:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25036) Scala 2.12 issues: Compilation error with sbt - posted by "Kazuaki Ishizaki (JIRA)" <ji...@apache.org> on 2018/08/09 17:08:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25079) [PYTHON] upgrade python 3.4 -> 3.5 - posted by "shane knapp (JIRA)" <ji...@apache.org> on 2018/08/09 17:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25079) [PYTHON] upgrade python 3.4 -> 3.5 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/09 17:38:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25079) [PYTHON] upgrade python 3.4 -> 3.5 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/09 17:38:00 UTC, 4 replies.
- [jira] [Created] (SPARK-25080) NPE in HiveShim$.toCatalystDecimal(HiveShim.scala:110) - posted by "Andrew K Long (JIRA)" <ji...@apache.org> on 2018/08/09 19:13:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-22236) CSV I/O: does not respect RFC 4180 - posted by "Joe Pallas (JIRA)" <ji...@apache.org> on 2018/08/09 19:43:00 UTC, 6 replies.
- [jira] [Updated] (SPARK-23298) distinct.count on Dataset/DataFrame yields non-deterministic results - posted by "Mateusz Jukiewicz (JIRA)" <ji...@apache.org> on 2018/08/09 20:21:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-25077) Delete unused variable in WindowExec - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/09 20:44:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25076) SQLConf should not be retrieved from a stopped SparkSession - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/09 21:41:01 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25068) High-order function: exists(array, function) → boolean - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/09 21:43:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24950) scala DateTimeUtilsSuite daysToMillis and millisToDays fails w/java 8 181-b13 - posted by "shane knapp (JIRA)" <ji...@apache.org> on 2018/08/09 22:21:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-24950) scala DateTimeUtilsSuite daysToMillis and millisToDays fails w/java 8 181-b13 - posted by "shane knapp (JIRA)" <ji...@apache.org> on 2018/08/09 22:21:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24950) scala DateTimeUtilsSuite daysToMillis and millisToDays fails w/java 8 181-b13 - posted by "shane knapp (JIRA)" <ji...@apache.org> on 2018/08/09 22:21:00 UTC, 4 replies.
- [jira] [Resolved] (SPARK-24950) scala DateTimeUtilsSuite daysToMillis and millisToDays fails w/java 8 181-b13 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/09 22:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25081) Nested spill in ShuffleExternalSorter may access a released memory page - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/08/10 00:02:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25081) Nested spill in ShuffleExternalSorter may access a released memory page - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/08/10 00:06:00 UTC, 12 replies.
- [jira] [Commented] (SPARK-25081) Nested spill in ShuffleExternalSorter may access a released memory page - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/10 00:14:00 UTC, 4 replies.
- [jira] [Assigned] (SPARK-25081) Nested spill in ShuffleExternalSorter may access a released memory page - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/10 00:14:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25082) Documentation for Spark Function expm1 is incomplete - posted by "Alexander Belov (JIRA)" <ji...@apache.org> on 2018/08/10 00:32:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24886) Increase Jenkins build time - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/10 01:14:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25076) SQLConf should not be retrieved from a stopped SparkSession - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/10 01:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25083) remove the type erasure hack in data source scan - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/10 01:57:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25044) Address translation of LMF closure primitive args to Object in Scala 2.12 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/10 01:59:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-23243) Shuffle+Repartition on an RDD could lead to incorrect answers - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/10 02:31:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-25052) Is there any possibility that spark structured streaming generate duplicates in the output? - posted by "bharath kumar avusherla (JIRA)" <ji...@apache.org> on 2018/08/10 03:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23992) ShuffleDependency does not need to be deserialized every time - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/10 04:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/08/10 05:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/10 05:28:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/10 05:28:00 UTC, 12 replies.
- [jira] [Updated] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/10 06:13:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-25067) Active tasks does not match the total cores of an executor in WebUI - posted by "StanZhai (JIRA)" <ji...@apache.org> on 2018/08/10 07:03:00 UTC, 1 replies.
- [jira] [Reopened] (SPARK-24152) SparkR CRAN feasibility check server problem - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/10 07:21:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24127) Support text socket source in continuous mode - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/10 07:54:01 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24127) Support text socket source in continuous mode - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/10 07:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25071) BuildSide is coming not as expected with join queries - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/10 08:51:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-25080) NPE in HiveShim$.toCatalystDecimal(HiveShim.scala:110) - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/10 08:52:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-25080) NPE in HiveShim$.toCatalystDecimal(HiveShim.scala:110) - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/10 08:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25072) PySpark custom Row class can be given extra parameters - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/10 09:03:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-19355) Use map output statistices to improve global limit's parallelism - posted by "Herman van Hovell (JIRA)" <ji...@apache.org> on 2018/08/10 09:34:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25085) Insert overwrite a non-partitioned table can delete table folder - posted by "Rui Li (JIRA)" <ji...@apache.org> on 2018/08/10 09:34:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-24555) logNumExamples in KMeans/BiKM/GMM/AFT/NB - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/10 13:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25086) Incorrect Default Value For "escape" For CSV Files - posted by "David Wilcox (JIRA)" <ji...@apache.org> on 2018/08/10 14:19:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/08/10 15:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25087) update/port all builds to run on ubuntu 16.04 LTS - posted by "shane knapp (JIRA)" <ji...@apache.org> on 2018/08/10 15:47:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24935) Problem with Executing Hive UDF's from Spark 2.2 Onwards - posted by "Parth Gandhi (JIRA)" <ji...@apache.org> on 2018/08/10 15:48:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25087) update/port all builds to run on ubuntu 16.04 LTS - posted by "shane knapp (JIRA)" <ji...@apache.org> on 2018/08/10 15:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24152) SparkR CRAN feasibility check server problem - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/08/10 16:04:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-10816) EventTime based sessionization - posted by "Mike Sukmanowsky (JIRA)" <ji...@apache.org> on 2018/08/10 16:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25088) Rest Server default & doc updates - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/08/10 16:30:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25088) Rest Server default & doc updates - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/10 16:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25088) Rest Server default & doc updates - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/10 16:37:01 UTC, 1 replies.
- [jira] [Commented] (SPARK-25066) Provide Spark R image for deploying Spark on kubernetes. - posted by "Yinan Li (JIRA)" <ji...@apache.org> on 2018/08/10 16:47:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-24152) SparkR CRAN feasibility check server problem - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/08/10 16:54:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25081) Nested spill in ShuffleExternalSorter may access a released memory page - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/08/10 18:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23298) distinct.count on Dataset/DataFrame yields non-deterministic results - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/08/10 18:40:00 UTC, 5 replies.
- [jira] [Commented] (SPARK-25085) Insert overwrite a non-partitioned table can delete table folder - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/10 18:41:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-24908) [R] remove spaces to make lintr happy - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/10 19:53:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24908) [R] remove spaces to make lintr happy - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/10 19:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-20919) Simplification of CachedKafkaConsumer. - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/08/10 20:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25089) remove lintr checks for 2.0 and 2.1 - posted by "shane knapp (JIRA)" <ji...@apache.org> on 2018/08/10 20:35:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25089) remove lintr checks for 2.0 and 2.1 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/10 20:37:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25089) remove lintr checks for 2.0 and 2.1 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/10 20:37:00 UTC, 2 replies.
- [jira] [Issue Comment Deleted] (SPARK-25089) remove lintr checks for 2.0 and 2.1 - posted by "shane knapp (JIRA)" <ji...@apache.org> on 2018/08/10 20:37:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25089) remove lintr checks for 2.0 and 2.1 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/10 20:45:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24699) Watermark / Append mode should work with Trigger.Once - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/08/10 20:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25089) remove lintr checks for 2.0 and 2.1 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/10 23:08:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25090) java.lang.ClassCastException when using a CrossValidator - posted by "Mark Morrisson (JIRA)" <ji...@apache.org> on 2018/08/10 23:34:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25090) java.lang.ClassCastException when using a CrossValidator - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/11 10:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25090) java.lang.ClassCastException when using a CrossValidator - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/11 10:19:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/11 13:40:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24822) Python support for barrier execution mode - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/11 13:46:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25085) Insert overwrite a non-partitioned table can delete table folder - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/11 15:59:00 UTC, 1 replies.
- [jira] [Issue Comment Deleted] (SPARK-25085) Insert overwrite a non-partitioned table can delete table folder - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/11 15:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25091) Spark Thrift Server: UNCACHE TABLE and CLEAR CACHE does not clean up executor memory - posted by "Yunling Cai (JIRA)" <ji...@apache.org> on 2018/08/11 17:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25092) Add RewriteExceptAll and RewriteIntersectAll in the list of nonExcludableRules - posted by "Dilip Biswal (JIRA)" <ji...@apache.org> on 2018/08/11 18:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25092) Add RewriteExceptAll and RewriteIntersectAll in the list of nonExcludableRules - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/11 18:58:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25092) Add RewriteExceptAll and RewriteIntersectAll in the list of nonExcludableRules - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/11 18:58:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25091) Spark Thrift Server: UNCACHE TABLE and CLEAR CACHE does not clean up executor memory - posted by "Yunling Cai (JIRA)" <ji...@apache.org> on 2018/08/11 19:14:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-23654) Cut jets3t as a dependency of spark-core - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/11 21:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23654) Cut jets3t as a dependency of spark-core - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/11 21:44:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24152) SparkR CRAN feasibility check server problem - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/12 01:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24420) Upgrade ASM to 6.x to support JDK9+ - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/12 04:17:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25092) Add RewriteExceptAll and RewriteIntersectAll in the list of nonExcludableRules - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/12 05:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25093) CodeFormatter could avoid creating regex object again and again - posted by "Izek Greenfield (JIRA)" <ji...@apache.org> on 2018/08/12 06:09:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25094) proccesNext() failed to compile size is over 64kb - posted by "Izek Greenfield (JIRA)" <ji...@apache.org> on 2018/08/12 07:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-17368) Scala value classes create encoder problems and break at runtime - posted by "Minh Thai (JIRA)" <ji...@apache.org> on 2018/08/12 08:04:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-17368) Scala value classes create encoder problems and break at runtime - posted by "Minh Thai (JIRA)" <ji...@apache.org> on 2018/08/12 08:22:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24631) Cannot up cast column from bigint to smallint as it may truncate - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/12 11:18:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24631) Cannot up cast column from bigint to smallint as it may truncate - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/12 11:19:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25095) Python support for BarrierTaskContext - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/08/12 12:18:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25094) proccesNext() failed to compile size is over 64kb - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/08/12 13:52:00 UTC, 6 replies.
- [jira] [Assigned] (SPARK-25095) Python support for BarrierTaskContext - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/12 16:09:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25095) Python support for BarrierTaskContext - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/12 16:09:00 UTC, 0 replies.
- [jira] [Issue Comment Deleted] (SPARK-25025) Remove the default value of isAll in INTERSECT/EXCEPT - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/12 17:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25026) Binary releases should contain some copy of compiled external integration modules - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/12 17:06:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24774) support reading AVRO logical types - Decimal - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/13 00:30:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25069) Using UnsafeAlignedOffset to make the entire record of 8 byte Items aligned like which is used in UnsafeExternalSorter - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/13 01:12:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25090) java.lang.ClassCastException when using a CrossValidator - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/13 01:13:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25033) Bump Apache commons.{httpclient, httpcore} - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/13 01:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25086) Incorrect Default Value For "escape" For CSV Files - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/13 02:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25086) Incorrect Default Value For "escape" For CSV Files - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/13 02:01:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25096) Loosen nullability if the cast is force-nullable. - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/08/13 03:27:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25096) Loosen nullability if the cast is force-nullable. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/13 03:33:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25096) Loosen nullability if the cast is force-nullable. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/13 03:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25020) Unable to Perform Graceful Shutdown in Spark Streaming with Hadoop 2.8 - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/08/13 05:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25097) Support prediction on single instance in KMeans/BiKMeans/GMM - posted by "zhengruifeng (JIRA)" <ji...@apache.org> on 2018/08/13 06:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25097) Support prediction on single instance in KMeans/BiKMeans/GMM - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/13 06:17:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25097) Support prediction on single instance in KMeans/BiKMeans/GMM - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/13 06:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-10697) Lift Calculation in Association Rule mining - posted by "Akhil Sakarwal (JIRA)" <ji...@apache.org> on 2018/08/13 06:34:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24581) Design: BarrierTaskContext.barrier() - posted by "zhengruifeng (JIRA)" <ji...@apache.org> on 2018/08/13 06:49:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25098) UDF ‘Cast’ return wrong result when input string starts/ends with special character - posted by "ice bai (JIRA)" <ji...@apache.org> on 2018/08/13 07:24:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25098) UDF ‘Cast’ will return NULL when input string starts/ends with special character - posted by "ice bai (JIRA)" <ji...@apache.org> on 2018/08/13 07:25:00 UTC, 4 replies.
- [jira] [Updated] (SPARK-25098) UDF ‘Cast’ return wrong result when input string starts/ends with special character - posted by "ice bai (JIRA)" <ji...@apache.org> on 2018/08/13 07:25:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25098) ‘Cast’ will return NULL when input string starts/ends with special character - posted by "ice bai (JIRA)" <ji...@apache.org> on 2018/08/13 07:49:00 UTC, 6 replies.
- [jira] [Updated] (SPARK-25098) ‘Cast’ will return NULL when input string starts/ends with special character(s) - posted by "ice bai (JIRA)" <ji...@apache.org> on 2018/08/13 08:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24931) CoarseGrainedExecutorBackend send wrong 'Reason' when executor exits which leading to job failed. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/13 08:20:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25098) ‘Cast’ will return NULL when input string starts/ends with special character(s) - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/13 08:27:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25098) ‘Cast’ will return NULL when input string starts/ends with special character(s) - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/13 08:27:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25099) Generate Avro Binary files in test suite - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/08/13 08:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25099) Generate Avro Binary files in test suite - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/08/13 08:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25099) Generate Avro Binary files in test suite - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/13 08:56:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25099) Generate Avro Binary files in test suite - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/13 08:56:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-25093) CodeFormatter could avoid creating regex object again and again - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/08/13 09:58:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25093) CodeFormatter could avoid creating regex object again and again - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/08/13 09:59:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24710) Information Gain Ratio for decision trees - posted by "Aleksey Zinoviev (JIRA)" <ji...@apache.org> on 2018/08/13 10:04:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25100) Using KryoSerializer and setting registrationRequired true can lead job failed - posted by "deshanxiao (JIRA)" <ji...@apache.org> on 2018/08/13 10:38:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25094) proccesNext() failed to compile size is over 64kb - posted by "Izek Greenfield (JIRA)" <ji...@apache.org> on 2018/08/13 11:21:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25096) Loosen nullability if the cast is force-nullable. - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/13 11:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25101) Creating leaderLatch with id for getting info about spark master nodes from zk - posted by "Yuliya (JIRA)" <ji...@apache.org> on 2018/08/13 11:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25101) Creating leaderLatch with id for getting info about spark master nodes from zk - posted by "Yuliya (JIRA)" <ji...@apache.org> on 2018/08/13 12:14:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24391) to_json/from_json should support arrays of primitives, and more generally all JSON - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/13 12:15:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25101) Creating leaderLatch with id for getting info about spark master nodes from zk - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/13 12:15:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24391) to_json/from_json should support arrays of primitives, and more generally all JSON - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/13 12:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25099) Generate Avro Binary files in test suite - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/13 12:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-22713) OOM caused by the memory contention and memory leak in TaskMemoryManager - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/13 12:57:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-22713) OOM caused by the memory contention and memory leak in TaskMemoryManager - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/13 12:57:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25094) proccesNext() failed to compile size is over 64kb - posted by "Izek Greenfield (JIRA)" <ji...@apache.org> on 2018/08/13 13:04:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25102) Write Spark version information to Parquet file footers - posted by "Zoltan Ivanfi (JIRA)" <ji...@apache.org> on 2018/08/13 13:53:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-22713) OOM caused by the memory contention and memory leak in TaskMemoryManager - posted by "Eyal Farago (JIRA)" <ji...@apache.org> on 2018/08/13 14:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25100) Using KryoSerializer and setting registrationRequired true can lead job failed - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/13 14:56:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25100) Using KryoSerializer and setting registrationRequired true can lead job failed - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/13 14:56:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24954) Fail fast on job submit if run a barrier stage with dynamic resource allocation enabled - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/08/13 15:15:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24941) Add RDDBarrier.coalesce() function - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/08/13 15:20:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24928) spark sql cross join running time too long - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/08/13 15:29:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24410) Missing optimization for Union on bucketed tables - posted by "Eyal Farago (JIRA)" <ji...@apache.org> on 2018/08/13 15:49:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25103) CompletionIterator may delay GC of completed resources - posted by "Eyal Farago (JIRA)" <ji...@apache.org> on 2018/08/13 16:04:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25103) CompletionIterator may delay GC of completed resources - posted by "Eyal Farago (JIRA)" <ji...@apache.org> on 2018/08/13 16:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-22347) UDF is evaluated when 'F.when' condition is false - posted by "Ryan Blue (JIRA)" <ji...@apache.org> on 2018/08/13 16:18:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-23874) Upgrade apache/arrow to 0.10.0 - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/08/13 16:18:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25060) PySpark UDF in case statement is always run - posted by "Ryan Blue (JIRA)" <ji...@apache.org> on 2018/08/13 16:20:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-22347) UDF is evaluated when 'F.when' condition is false - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/13 16:28:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-22347) UDF is evaluated when 'F.when' condition is false - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/13 16:29:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-22347) UDF is evaluated when 'F.when' condition is false - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/13 16:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25104) Validate user specified output schema - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/08/13 17:09:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24736) --py-files not functional for non local URLs. It appears to pass non-local URL's into PYTHONPATH directly. - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/08/13 17:11:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25104) Validate user specified output schema - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/13 17:16:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25104) Validate user specified output schema - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/13 17:16:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24735) Improve exception when mixing up pandas_udf types - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/08/13 17:22:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25105) Importing all of pyspark.sql.functions should bring PandasUDFType in as well - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/08/13 17:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24735) Improve exception when mixing up pandas_udf types - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/08/13 17:56:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-23654) Cut jets3t and bouncy castle as dependencies of spark-core - posted by "Steve Loughran (JIRA)" <ji...@apache.org> on 2018/08/13 18:12:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23654) Cut jets3t as a dependency of spark-core - posted by "Steve Loughran (JIRA)" <ji...@apache.org> on 2018/08/13 18:16:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25105) Importing all of pyspark.sql.functions should bring PandasUDFType in as well - posted by "kevin yu (JIRA)" <ji...@apache.org> on 2018/08/13 18:36:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25106) A new Kafka consumer gets created for every batch - posted by "Alexis Seigneurin (JIRA)" <ji...@apache.org> on 2018/08/13 19:44:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25106) A new Kafka consumer gets created for every batch - posted by "Alexis Seigneurin (JIRA)" <ji...@apache.org> on 2018/08/13 19:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-22905) Fix ChiSqSelectorModel, GaussianMixtureModel save implementation for Row order issues - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/13 20:06:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-650) Add a "setup hook" API for running initialization code on each executor - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/08/13 20:12:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24918) Executor Plugin API - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/08/13 20:16:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23984) PySpark Bindings for K8S - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/13 20:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24156) Enable no-data micro batches for more eager streaming state clean up - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/13 21:44:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25107) Spark 2.2.0 Upgrade Issue : Throwing TreeNodeException: makeCopy, tree: CatalogRelation Errors - posted by "Karan (JIRA)" <ji...@apache.org> on 2018/08/13 22:36:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25107) Spark 2.2.0 Upgrade Issue : Throwing TreeNodeException: makeCopy, tree: CatalogRelation Errors - posted by "Karan (JIRA)" <ji...@apache.org> on 2018/08/13 22:38:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-24771) Upgrade AVRO version from 1.7.7 to 1.8 - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/08/13 22:50:00 UTC, 11 replies.
- [jira] [Commented] (SPARK-24787) Events being dropped at an alarming rate due to hsync being slow for eventLogging - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/08/13 22:54:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-24938) Understand usage of netty's onheap memory use, even with offheap pools - posted by "Nihar Sheth (JIRA)" <ji...@apache.org> on 2018/08/13 23:41:00 UTC, 9 replies.
- [jira] [Commented] (SPARK-16617) Upgrade to Avro 1.8.x - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/14 01:46:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24886) Increase Jenkins build time - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/14 02:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25108) Dataset.show() generates incorrect padding for Unicode Character - posted by "xuejianbest (JIRA)" <ji...@apache.org> on 2018/08/14 02:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25108) Dataset.show() generates incorrect padding for Unicode Character - posted by "xuejianbest (JIRA)" <ji...@apache.org> on 2018/08/14 02:17:00 UTC, 6 replies.
- [jira] [Assigned] (SPARK-25108) Dataset.show() generates incorrect padding for Unicode Character - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/14 02:25:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24356) Duplicate strings in File.path managed by FileSegmentManagedBuffer - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/08/14 03:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25109) spark python should retry reading another datanode if the first one fails to connect - posted by "Yuanbo Liu (JIRA)" <ji...@apache.org> on 2018/08/14 03:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25109) spark python should retry reading another datanode if the first one fails to connect - posted by "Yuanbo Liu (JIRA)" <ji...@apache.org> on 2018/08/14 03:16:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-25086) Incorrect Default Value For "escape" For CSV Files - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/14 03:19:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24006) ExecutorAllocationManager.onExecutorAdded is an O(n) operation - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/14 03:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23308) ignoreCorruptFiles should not ignore retryable IOException - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/14 03:24:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24771) Upgrade AVRO version from 1.7.7 to 1.8 - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/08/14 03:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24771) Upgrade AVRO version from 1.7.7 to 1.8 - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/14 04:19:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25110) make sure Flume streaming connector works with Spark 2.4 - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/14 04:20:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25104) Validate user specified output schema - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/08/14 04:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-22974) CountVectorModel does not attach attributes to output column - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/08/14 05:06:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-22974) CountVectorModel does not attach attributes to output column - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/08/14 05:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25111) increment kinesis client/producer lib versions & aws-sdk to match - posted by "Steve Loughran (JIRA)" <ji...@apache.org> on 2018/08/14 05:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25111) increment kinesis client/producer lib versions & aws-sdk to match - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/14 06:05:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25111) increment kinesis client/producer lib versions & aws-sdk to match - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/14 06:05:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25110) make sure Flume streaming connector works with Spark 2.4 - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/14 06:10:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25112) Spark history cleaner does not work. - posted by "Gu Chao (JIRA)" <ji...@apache.org> on 2018/08/14 06:12:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25051) where clause on dataset gives AnalysisException - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/08/14 08:40:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-25051) where clause on dataset gives AnalysisException - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/14 09:36:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25102) Write Spark version information to Parquet file footers - posted by "Nikita Poberezkin (JIRA)" <ji...@apache.org> on 2018/08/14 10:35:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25113) Add logging to CodeGenerator when any generated method's bytecode size goes above HugeMethodLimit - posted by "Kris Mok (JIRA)" <ji...@apache.org> on 2018/08/14 10:50:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25113) Add logging to CodeGenerator when any generated method's bytecode size goes above HugeMethodLimit - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/14 10:55:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25113) Add logging to CodeGenerator when any generated method's bytecode size goes above HugeMethodLimit - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/14 10:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24411) Adding native Java tests for `isInCollection` - posted by "Aleksei Izmalkin (JIRA)" <ji...@apache.org> on 2018/08/14 11:06:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-23938) High-order function: map_zip_with(map, map, function) → map - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/08/14 12:16:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25114) RecordBinaryComparator may return wrong result when subtraction between two words is divisible by Integer.MAX_VALUE - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/08/14 14:27:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25114) RecordBinaryComparator may return wrong result when subtraction between two words is divisible by Integer.MAX_VALUE - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/08/14 14:27:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25114) RecordBinaryComparator may return wrong result when subtraction between two words is divisible by Integer.MAX_VALUE - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/08/14 14:28:00 UTC, 8 replies.
- [jira] [Assigned] (SPARK-25114) RecordBinaryComparator may return wrong result when subtraction between two words is divisible by Integer.MAX_VALUE - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/14 14:29:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24721) Failed to call PythonUDF whose input is the output of another PythonUDF - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/14 14:31:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24721) Failed to call PythonUDF whose input is the output of another PythonUDF - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/14 14:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24721) Failed to use PythonUDF with literal inputs in filter with data sources - posted by "Li Jin (JIRA)" <ji...@apache.org> on 2018/08/14 15:27:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24721) Failed to use PythonUDF with literal inputs in filter with data sources - posted by "Li Jin (JIRA)" <ji...@apache.org> on 2018/08/14 15:27:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-24721) Failed to use PythonUDF with literal inputs in filter with data sources - posted by "Li Jin (JIRA)" <ji...@apache.org> on 2018/08/14 15:27:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25083) remove the type erasure hack in data source scan - posted by "Ryan Blue (JIRA)" <ji...@apache.org> on 2018/08/14 15:31:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-24561) User-defined window functions with pandas udf (bounded window) - posted by "Li Jin (JIRA)" <ji...@apache.org> on 2018/08/14 15:35:03 UTC, 1 replies.
- [jira] [Commented] (SPARK-25115) Eliminate extra memory copy done when a ByteBuf is used that is backed by > 1 ByteBuffer. - posted by "Norman Maurer (JIRA)" <ji...@apache.org> on 2018/08/14 17:12:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25115) Eliminate extra memory copy done when a ByteBuf is used that is backed by > 1 ByteBuffer. - posted by "Norman Maurer (JIRA)" <ji...@apache.org> on 2018/08/14 17:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25115) Eliminate extra memory copy done when a ByteBuf is used that is backed by > 1 ByteBuffer. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/14 17:20:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-25051) where clause on dataset gives AnalysisException - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/14 17:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25116) Fix the "exit code 1" error when terminating Kafka tests - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/08/14 18:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25117) Add EXEPT ALL and INTERSECT ALL support in R. - posted by "Dilip Biswal (JIRA)" <ji...@apache.org> on 2018/08/14 18:07:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25088) Rest Server default & doc updates - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/14 18:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25116) Fix the "exit code 1" error when terminating Kafka tests - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/14 18:14:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25116) Fix the "exit code 1" error when terminating Kafka tests - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/14 18:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25117) Add EXEPT ALL and INTERSECT ALL support in R. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/14 18:16:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25117) Add EXEPT ALL and INTERSECT ALL support in R. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/14 18:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25043) spark-sql should print the appId and master on startup - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/08/14 18:18:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-21375) Add date and timestamp support to ArrowConverters for toPandas() collection - posted by "Eric Wohlstadter (JIRA)" <ji...@apache.org> on 2018/08/14 18:57:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-25105) Importing all of pyspark.sql.functions should bring PandasUDFType in as well - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/14 19:02:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-24838) Support uncorrelated IN/EXISTS subqueries for more operators - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/14 19:11:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24838) Support uncorrelated IN/EXISTS subqueries for more operators - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/14 19:11:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-23337) withWatermark raises an exception on struct objects - posted by "Aydin Kocas (JIRA)" <ji...@apache.org> on 2018/08/14 21:04:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-16406) Reference resolution for large number of columns should be faster - posted by "antonkulaga (JIRA)" <ji...@apache.org> on 2018/08/14 21:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25118) Need a solution to persist Spark application console outputs when running in shell/yarn client mode - posted by "Ankur Gupta (JIRA)" <ji...@apache.org> on 2018/08/14 21:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25118) Need a solution to persist Spark application console outputs when running in shell/yarn client mode - posted by "Ankur Gupta (JIRA)" <ji...@apache.org> on 2018/08/14 21:20:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-20384) supporting value classes over primitives in DataSets - posted by "Minh Thai (JIRA)" <ji...@apache.org> on 2018/08/14 22:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25119) stages in wrong order within job page DAG chart - posted by "Yunjian Zhang (JIRA)" <ji...@apache.org> on 2018/08/14 22:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25119) stages in wrong order within job page DAG chart - posted by "Yunjian Zhang (JIRA)" <ji...@apache.org> on 2018/08/14 22:49:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25113) Add logging to CodeGenerator when any generated method's bytecode size goes above HugeMethodLimit - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/14 23:41:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25115) Eliminate extra memory copy done when a ByteBuf is used that is backed by > 1 ByteBuffer. - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/08/15 00:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23874) Upgrade apache/arrow to 0.10.0 - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/08/15 00:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25083) remove the type erasure hack in data source scan - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/15 02:22:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25120) EventLogListener may miss driver SparkListenerBlockManagerAdded event - posted by "deshanxiao (JIRA)" <ji...@apache.org> on 2018/08/15 02:29:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25109) spark python should retry reading another datanode if the first one fails to connect - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/15 02:44:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25120) EventLogListener may miss driver SparkListenerBlockManagerAdded event - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/15 02:45:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-25120) EventLogListener may miss driver SparkListenerBlockManagerAdded event - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/15 03:08:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24505) Convert strings in codegen to blocks: Cast and BoundAttribute - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/15 06:34:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24505) Convert strings in codegen to blocks: Cast and BoundAttribute - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/15 06:34:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25121) Support multi-part column name for hint resolution - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/15 06:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25121) Support multi-part column name for hint resolution - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/15 06:55:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-25092) Add RewriteExceptAll, RewriteIntersectAll and RewriteCorrelatedScalarSubquery in the list of nonExcludableRules - posted by "Dilip Biswal (JIRA)" <ji...@apache.org> on 2018/08/15 07:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25122) Deduplication of supports equals code - posted by "Marek Novotny (JIRA)" <ji...@apache.org> on 2018/08/15 08:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25122) Deduplication of supports equals code - posted by "Marek Novotny (JIRA)" <ji...@apache.org> on 2018/08/15 08:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25122) Deduplication of supports equals code - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/15 08:25:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25122) Deduplication of supports equals code - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/15 08:25:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25123) SimpleExprValue may cause the loss of a reference - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/08/15 08:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25123) SimpleExprValue may cause the loss of a reference - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/15 09:11:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25123) SimpleExprValue may cause the loss of a reference - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/15 09:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25124) VectorSizeHint.size is buggy, breaking streaming pipeline - posted by "Timothy Hunter (JIRA)" <ji...@apache.org> on 2018/08/15 09:46:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-9610) Class and instance weighting for ML - posted by "Barry Becker (JIRA)" <ji...@apache.org> on 2018/08/15 15:41:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25088) Rest Server default & doc updates - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/15 15:46:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25111) increment kinesis client/producer lib versions & aws-sdk to match - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/15 17:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25125) Spark SQL percentile_approx takes longer than Hive version for large datasets - posted by "Mir Ali (JIRA)" <ji...@apache.org> on 2018/08/15 17:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25125) Spark SQL percentile_approx takes longer than Hive version for large datasets - posted by "Mir Ali (JIRA)" <ji...@apache.org> on 2018/08/15 17:56:00 UTC, 4 replies.
- [jira] [Created] (SPARK-25126) OrcFileOperator.getFileReader: avoid creating OrcFile.Reader for all orc files - posted by "Rao Fu (JIRA)" <ji...@apache.org> on 2018/08/15 18:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25127) DataSourceV2: Remove SupportsPushDownCatalystFilters - posted by "Ryan Blue (JIRA)" <ji...@apache.org> on 2018/08/15 18:29:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25026) Binary releases should contain some copy of compiled external integration modules - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/15 19:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25128) multiple simultaneous job submissions against k8s backend cause driver pods to hang - posted by "Erik Erlandson (JIRA)" <ji...@apache.org> on 2018/08/15 19:50:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25128) multiple simultaneous job submissions against k8s backend cause driver pods to hang - posted by "Erik Erlandson (JIRA)" <ji...@apache.org> on 2018/08/15 19:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23243) Shuffle+Repartition on an RDD could lead to incorrect answers - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/15 20:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24819) Fail fast when no enough slots to launch the barrier stage on job submitted - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/08/15 20:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25126) OrcFileOperator.getFileReader: avoid creating OrcFile.Reader for all orc files - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/15 20:36:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25126) OrcFileOperator.getFileReader: avoid creating OrcFile.Reader for all orc files - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/15 20:36:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25127) DataSourceV2: Remove SupportsPushDownCatalystFilters - posted by "Ryan Blue (JIRA)" <ji...@apache.org> on 2018/08/15 21:34:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24685) Adjust release scripts to build all versions for older releases - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/08/15 21:44:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24685) Adjust release scripts to build all versions for older releases - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/08/15 21:44:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24938) Understand usage of netty's onheap memory use, even with offheap pools - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/15 22:05:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24685) Adjust release scripts to build all versions for older releases - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/08/15 22:10:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25082) Documentation for Spark Function expm1 is incomplete - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/16 00:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25082) Documentation for Spark Function expm1 is incomplete - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/16 00:16:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-25100) Using KryoSerializer and setting registrationRequired true can lead job failed - posted by "Li Yuanjian (JIRA)" <ji...@apache.org> on 2018/08/16 00:28:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25078) Standalone does not work with spark.authenticate.secret and deploy-mode=cluster - posted by "Bo Meng (JIRA)" <ji...@apache.org> on 2018/08/16 00:29:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25104) Validate user specified output schema - posted by "Li Yuanjian (JIRA)" <ji...@apache.org> on 2018/08/16 00:52:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-16617) Upgrade to Avro 1.8.x - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/16 02:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25126) OrcFileOperator.getFileReader: avoid creating OrcFile.Reader for all orc files - posted by "Rao Fu (JIRA)" <ji...@apache.org> on 2018/08/16 04:27:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-23817) Migrate ORC file format read path to data source V2 - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/08/16 05:26:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-20568) Delete files after processing in structured streaming - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/08/16 05:26:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23817) Migrate ORC file format read path to data source V2 - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/08/16 06:02:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25082) Documentation for Spark Function expm1 is incomplete - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/16 06:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23194) from_json in FAILFAST mode doesn't fail fast, instead it just returns nulls - posted by "Denis Bolshakov (JIRA)" <ji...@apache.org> on 2018/08/16 06:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25129) Revert mapping of com.databricks.spark.avro - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/08/16 06:32:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-23194) from_json in FAILFAST mode doesn't fail fast, instead it just returns nulls - posted by "Denis Bolshakov (JIRA)" <ji...@apache.org> on 2018/08/16 06:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25129) Revert mapping of com.databricks.spark.avro - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/16 06:38:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25129) Revert mapping of com.databricks.spark.avro - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/16 06:38:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23939) High-order function: transform_keys(map, function) → map - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/08/16 08:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25130) Wrong timestamp returned by toPandas - posted by "Anton Daitche (JIRA)" <ji...@apache.org> on 2018/08/16 09:07:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25130) Wrong timestamp returned by toPandas - posted by "Anton Daitche (JIRA)" <ji...@apache.org> on 2018/08/16 09:09:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25130) [Python] Wrong timestamp returned by toPandas - posted by "Anton Daitche (JIRA)" <ji...@apache.org> on 2018/08/16 09:09:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25125) Spark SQL percentile_approx takes longer than Hive version for large datasets - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/08/16 11:37:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25071) BuildSide is coming not as expected with join queries - posted by "Sujith (JIRA)" <ji...@apache.org> on 2018/08/16 12:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25131) Event logs missing applicationAttemptId for SparkListenerApplicationStart - posted by "Ajith S (JIRA)" <ji...@apache.org> on 2018/08/16 13:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25131) Event logs missing applicationAttemptId for SparkListenerApplicationStart - posted by "Ajith S (JIRA)" <ji...@apache.org> on 2018/08/16 13:07:00 UTC, 2 replies.
- [jira] [Issue Comment Deleted] (SPARK-25131) Event logs missing applicationAttemptId for SparkListenerApplicationStart - posted by "Ajith S (JIRA)" <ji...@apache.org> on 2018/08/16 13:08:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25131) Event logs missing applicationAttemptId for SparkListenerApplicationStart - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/16 13:08:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25131) Event logs missing applicationAttemptId for SparkListenerApplicationStart - posted by "Ajith S (JIRA)" <ji...@apache.org> on 2018/08/16 13:08:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25125) Spark SQL percentile_approx takes longer than Hive version for large datasets - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/08/16 13:08:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25132) Spark returns NULL for a column whose Hive metastore schema and Parquet schema are in different letter cases - posted by "Chenxiao Mao (JIRA)" <ji...@apache.org> on 2018/08/16 13:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23932) High-order function: zip_with(array, array, function) → array - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/08/16 14:04:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25132) Spark returns NULL for a column whose Hive metastore schema and Parquet schema are in different letter cases - posted by "Chenxiao Mao (JIRA)" <ji...@apache.org> on 2018/08/16 14:39:00 UTC, 4 replies.
- [jira] [Created] (SPARK-25133) Documentaion: AVRO data source guide - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/08/16 14:40:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25133) Documentaion: AVRO data source guide - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/16 14:43:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25133) Documentaion: AVRO data source guide - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/16 14:43:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25120) EventLogListener may miss driver SparkListenerBlockManagerAdded event - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/16 15:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25134) Csv column pruning with checking of headers throws incorrect error - posted by "koert kuipers (JIRA)" <ji...@apache.org> on 2018/08/16 15:48:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24665) Add SQLConf in PySpark to manage all sql configs - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/16 15:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25134) Csv column pruning with checking of headers throws incorrect error - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/16 16:00:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25134) Csv column pruning with checking of headers throws incorrect error - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/16 16:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-23817) Migrate ORC file format read path to data source V2 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/16 16:54:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25135) insert datasource table may all null when select from view - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/16 18:35:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25135) insert datasource table may all null when select from view - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/16 18:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25135) insert datasource table may all null when select from view - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/16 18:46:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25135) insert datasource table may all null when select from view - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/16 18:46:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-23817) Migrate ORC file format read path to data source V2 - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/08/16 19:01:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23654) Cut jets3t as a dependency of spark-core - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/16 19:35:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25032) Create table is failing, after dropping the database . It is not falling back to default database - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/16 22:03:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25136) unable to use HDFS checkpoint directories after driver restart - posted by "Robert Reid (JIRA)" <ji...@apache.org> on 2018/08/16 22:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25136) unable to use HDFS checkpoint directories after driver restart - posted by "Robert Reid (JIRA)" <ji...@apache.org> on 2018/08/16 22:22:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24555) logNumExamples in KMeans/BiKM/GMM/AFT/NB - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/16 22:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24555) logNumExamples in KMeans/BiKM/GMM/AFT/NB - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/16 22:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25031) The schema of MapType can not be printed correctly - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/16 23:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24299) UI for Structured Streaming Monitoring - posted by "David Winters (JIRA)" <ji...@apache.org> on 2018/08/17 00:13:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25040) Empty string for double and float types should be nulls in JSON - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/17 01:58:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark - posted by "Vijay (JIRA)" <ji...@apache.org> on 2018/08/17 02:38:00 UTC, 10 replies.
- [jira] [Resolved] (SPARK-23940) High-order function: transform_values(map, function) → map - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/08/17 02:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25130) [Python] Wrong timestamp returned by toPandas - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/17 03:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25122) Deduplication of supports equals code - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/17 03:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25137) NumberFormatException` when starting spark-shell from Mac terminal - posted by "Vinod KC (JIRA)" <ji...@apache.org> on 2018/08/17 05:06:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25137) NumberFormatException` when starting spark-shell from Mac terminal - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/17 05:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25137) NumberFormatException` when starting spark-shell from Mac terminal - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/17 05:14:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25138) Spark Shell should show the Scala prompt after initialization is complete - posted by "Kris Mok (JIRA)" <ji...@apache.org> on 2018/08/17 06:22:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25139) PythonRunner#WriterThread released block after TaskRunner finally block which invoke BlockManager#releaseAllLocksForTask - posted by "DENG FEI (JIRA)" <ji...@apache.org> on 2018/08/17 06:28:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25139) PythonRunner#WriterThread released block after TaskRunner finally block which invoke BlockManager#releaseAllLocksForTask - posted by "DENG FEI (JIRA)" <ji...@apache.org> on 2018/08/17 06:29:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25140) Add optional logging to UnsafeProjection.create when it falls back to interpreted mode - posted by "Kris Mok (JIRA)" <ji...@apache.org> on 2018/08/17 06:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25140) Add optional logging to UnsafeProjection.create when it falls back to interpreted mode - posted by "Kris Mok (JIRA)" <ji...@apache.org> on 2018/08/17 06:31:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-25138) Spark Shell should show the Scala prompt after initialization is complete - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/17 06:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25138) Spark Shell should show the Scala prompt after initialization is complete - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/17 06:34:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-25140) Add optional logging to UnsafeProjection.create when it falls back to interpreted mode - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/17 06:35:00 UTC, 4 replies.
- [jira] [Resolved] (SPARK-25138) Spark Shell should show the Scala prompt after initialization is complete - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/08/17 08:34:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25141) Modify tests for higher-order functions to check bind method. - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/08/17 09:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25141) Modify tests for higher-order functions to check bind method. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/17 09:06:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25141) Modify tests for higher-order functions to check bind method. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/17 09:06:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25142) Add error messages when Python worker could not open socket in `_load_from_socket`. - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/08/17 10:33:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25129) Make the mapping of com.databricks.spark.avro to built-in module configurable - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/08/17 10:42:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25142) Add error messages when Python worker could not open socket in `_load_from_socket`. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/17 10:43:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25142) Add error messages when Python worker could not open socket in `_load_from_socket`. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/17 10:43:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25129) Make the mapping of com.databricks.spark.avro to built-in module configurable - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/17 10:48:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25065) Driver and executors pick the wrong logging configuration file. - posted by "Prashant Sharma (JIRA)" <ji...@apache.org> on 2018/08/17 11:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25066) Provide Spark R image for deploying Spark on kubernetes. - posted by "Prashant Sharma (JIRA)" <ji...@apache.org> on 2018/08/17 11:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25143) Support custom map for data sources - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/08/17 12:27:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25143) Support data source name mapping configuration - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/08/17 12:28:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25143) Support data source name mapping configuration - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/17 12:47:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25143) Support data source name mapping configuration - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/17 12:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected - posted by "Ayoub Benali (JIRA)" <ji...@apache.org> on 2018/08/17 12:48:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25145) Buffer size too small on spark.sql query with filterPushdown predicate=True - posted by "Bjørnar Jensen (JIRA)" <ji...@apache.org> on 2018/08/17 13:08:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25146) avg() returns null on some decimals - posted by "Daniel Darabos (JIRA)" <ji...@apache.org> on 2018/08/17 13:08:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25146) avg() returns null on some decimals - posted by "Daniel Darabos (JIRA)" <ji...@apache.org> on 2018/08/17 13:09:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25145) Buffer size too small on spark.sql query with filterPushdown predicate=True - posted by "Bjørnar Jensen (JIRA)" <ji...@apache.org> on 2018/08/17 13:09:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25145) Buffer size too small on spark.sql query with filterPushdown predicate=True - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/08/17 13:17:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-25146) avg() returns null on some decimals - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/08/17 13:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25146) avg() returns null on some decimals - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/08/17 13:24:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/08/17 14:01:00 UTC, 11 replies.
- [jira] [Updated] (SPARK-25117) Add EXEPT ALL and INTERSECT ALL support in R. - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/08/17 14:03:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected - posted by "Ayoub Benali (JIRA)" <ji...@apache.org> on 2018/08/17 14:45:00 UTC, 6 replies.
- [jira] [Assigned] (SPARK-25093) CodeFormatter could avoid creating regex object again and again - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/17 15:11:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25147) GroupedData.apply pandas_udf crashing - posted by "Mike Sukmanowsky (JIRA)" <ji...@apache.org> on 2018/08/17 17:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25148) Executors launched with Spark on K8s client mode should prefix name with spark.app.name - posted by "Timothy Chen (JIRA)" <ji...@apache.org> on 2018/08/17 17:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25124) VectorSizeHint.size is buggy, breaking streaming pipeline - posted by "Huaxin Gao (JIRA)" <ji...@apache.org> on 2018/08/17 17:53:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25149) ParallelPersonalizedPageRank raises an error if vertexIDs are > MaxInt - posted by "Bago Amirbekian (JIRA)" <ji...@apache.org> on 2018/08/17 17:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results - posted by "Nicholas Chammas (JIRA)" <ji...@apache.org> on 2018/08/17 18:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results - posted by "Nicholas Chammas (JIRA)" <ji...@apache.org> on 2018/08/17 18:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results - posted by "Nicholas Chammas (JIRA)" <ji...@apache.org> on 2018/08/17 18:12:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results - posted by "Nicholas Chammas (JIRA)" <ji...@apache.org> on 2018/08/17 18:16:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-25124) VectorSizeHint.size is buggy, breaking streaming pipeline - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/17 18:25:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-23042) Use OneHotEncoderModel to encode labels in MultilayerPerceptronClassifier - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/08/17 18:42:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23042) Use OneHotEncoderModel to encode labels in MultilayerPerceptronClassifier - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/08/17 18:42:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-17916) CSV data source treats empty string as null no matter what nullValue option is - posted by "koert kuipers (JIRA)" <ji...@apache.org> on 2018/08/17 19:54:00 UTC, 5 replies.
- [jira] [Comment Edited] (SPARK-17916) CSV data source treats empty string as null no matter what nullValue option is - posted by "koert kuipers (JIRA)" <ji...@apache.org> on 2018/08/17 19:55:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-24882) data source v2 API improvement - posted by "Ryan Blue (JIRA)" <ji...@apache.org> on 2018/08/17 20:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25149) Personalized Page Rank raises an error if vertexIDs are > MaxInt - posted by "Bago Amirbekian (JIRA)" <ji...@apache.org> on 2018/08/17 20:31:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-25116) Fix the "exit code 1" error when terminating Kafka tests - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/08/17 21:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25151) Apply Apache Commons Pool to KafkaDataConsumer - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/08/17 22:55:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25151) Apply Apache Commons Pool to KafkaDataConsumer - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/08/17 22:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25151) Apply Apache Commons Pool to KafkaDataConsumer - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/08/17 22:55:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24433) Add Spark R support - posted by "Matt Cheah (JIRA)" <ji...@apache.org> on 2018/08/17 23:06:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24433) Add Spark R support - posted by "Matt Cheah (JIRA)" <ji...@apache.org> on 2018/08/17 23:06:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25152) Enable Spark on Kubernetes R Integration Tests - posted by "Matt Cheah (JIRA)" <ji...@apache.org> on 2018/08/17 23:09:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25143) Support data source name mapping configuration - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/08/17 23:17:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25151) Apply Apache Commons Pool to KafkaDataConsumer - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/17 23:22:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25126) avoid creating OrcFile.Reader for all orc files - posted by "Rao Fu (JIRA)" <ji...@apache.org> on 2018/08/17 23:33:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-25126) avoid creating OrcFile.Reader for all orc files - posted by "Rao Fu (JIRA)" <ji...@apache.org> on 2018/08/17 23:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25149) Personalized Page Rank raises an error if vertexIDs are > MaxInt - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/17 23:55:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25149) Personalized Page Rank raises an error if vertexIDs are > MaxInt - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/17 23:55:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-23555) Add BinaryType support for Arrow in PySpark - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/08/18 05:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23555) Add BinaryType support for Arrow in PySpark - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/08/18 05:16:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-21187) Complete support for remaining Spark data types in Arrow Converters - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/08/18 05:23:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25072) PySpark custom Row class can be given extra parameters - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/18 08:44:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25137) NumberFormatException` when starting spark-shell from Mac terminal - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/18 09:20:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25142) Add error messages when Python worker could not open socket in `_load_from_socket`. - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/18 09:25:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24863) Report offset lag as a custom metrics for Kafka structured streaming source - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/18 09:33:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24863) Report offset lag as a custom metrics for Kafka structured streaming source - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/18 09:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-8582) Optimize checkpointing to avoid computing an RDD twice - posted by "V Luong (JIRA)" <ji...@apache.org> on 2018/08/18 09:46:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24432) Add support for dynamic resource allocation - posted by "Chakradhar N R (JIRA)" <ji...@apache.org> on 2018/08/18 10:04:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25153) Improve error messages for columns with dots/periods - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/08/18 14:19:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25153) Improve error messages for columns with dots/periods - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/08/18 14:19:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24959) Do not invoke the CSV/JSON parser for empty schema - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/18 17:36:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24959) Do not invoke the CSV/JSON parser for empty schema - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/18 17:36:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24961) sort operation causes out of memory - posted by "Markus Breuer (JIRA)" <ji...@apache.org> on 2018/08/18 21:09:00 UTC, 6 replies.
- [jira] [Created] (SPARK-25154) Support NOT IN sub-queries inside nested OR conditions. - posted by "Dilip Biswal (JIRA)" <ji...@apache.org> on 2018/08/18 22:15:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25154) Support NOT IN sub-queries inside nested OR conditions. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/18 22:32:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25154) Support NOT IN sub-queries inside nested OR conditions. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/18 22:32:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24961) sort operation causes out of memory - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/08/18 23:30:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25141) Modify tests for higher-order functions to check bind method. - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/08/19 00:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25155) Streaming from storage doesn't work when no directories exists - posted by "Gil Vernik (JIRA)" <ji...@apache.org> on 2018/08/19 04:04:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25155) Streaming from storage doesn't work when no directories exists - posted by "Gil Vernik (JIRA)" <ji...@apache.org> on 2018/08/19 04:42:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25156) Same query returns different result - posted by "Yonghwan Lee (JIRA)" <ji...@apache.org> on 2018/08/19 06:25:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-20924) Unable to call the function registered in the not-current database - posted by "Rajesh Chandramohan (JIRA)" <ji...@apache.org> on 2018/08/19 08:41:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-20924) Unable to call the function registered in the not-current database - posted by "Rajesh Chandramohan (JIRA)" <ji...@apache.org> on 2018/08/19 08:46:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25157) Streaming of image files from directory - posted by "Amit Baghel (JIRA)" <ji...@apache.org> on 2018/08/19 12:43:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25157) Streaming of image files from directory - posted by "Amit Baghel (JIRA)" <ji...@apache.org> on 2018/08/19 12:44:00 UTC, 5 replies.
- [jira] [Updated] (SPARK-25132) Case-insensitive field resolution when reading from Parquet/ORC - posted by "Chenxiao Mao (JIRA)" <ji...@apache.org> on 2018/08/19 12:59:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25156) Same query returns different result - posted by "Yonghwan Lee (JIRA)" <ji...@apache.org> on 2018/08/19 13:24:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-25132) Case-insensitive field resolution when reading from Parquet/ORC - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/19 16:32:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25132) Case-insensitive field resolution when reading from Parquet/ORC - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/19 16:32:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-24647) Sink Should Return Writen Offsets For ProgressReporting - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/19 18:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24647) Sink Should Return Writen Offsets For ProgressReporting - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/19 18:05:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24935) Problem with Executing Hive UDF's from Spark 2.2 Onwards - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/19 19:41:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25152) Enable Spark on Kubernetes R Integration Tests - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/19 21:49:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25152) Enable Spark on Kubernetes R Integration Tests - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/19 21:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-21187) Complete support for remaining Spark data types in Arrow Converters - posted by "Leif Walsh (JIRA)" <ji...@apache.org> on 2018/08/19 22:44:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-21187) Complete support for remaining Spark data types in Arrow Converters - posted by "Leif Walsh (JIRA)" <ji...@apache.org> on 2018/08/19 22:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24434) Support user-specified driver and executor pod templates - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/20 01:25:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25131) Event logs missing applicationAttemptId for SparkListenerApplicationStart - posted by "Ajith S (JIRA)" <ji...@apache.org> on 2018/08/20 02:05:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25145) Buffer size too small on spark.sql query with filterPushdown predicate=True - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/08/20 02:13:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25156) Same query returns different result - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/08/20 02:18:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-25156) Same query returns different result - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/08/20 02:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25156) Same query returns different result - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/08/20 02:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25155) Streaming from storage doesn't work when no directories exists - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/08/20 02:27:00 UTC, 4 replies.
- [jira] [Updated] (SPARK-25134) Csv column pruning with checking of headers throws incorrect error - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/20 02:57:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/20 03:14:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25147) GroupedData.apply pandas_udf crashing - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/20 03:17:00 UTC, 3 replies.
- [jira] [Updated] (SPARK-25158) Executor accidentally exit because ScriptTransformationWriterThread throws TaskKilledException. - posted by "Yang Jie (JIRA)" <ji...@apache.org> on 2018/08/20 06:10:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25158) Executor accidentally exit because ScriptTransformationWriterThread throws TaskKilledException. - posted by "Yang Jie (JIRA)" <ji...@apache.org> on 2018/08/20 06:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25158) Executor accidentally exit because ScriptTransformationWriterThread throws TaskKilledException. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/20 06:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25158) Executor accidentally exit because ScriptTransformationWriterThread throws TaskKilledException. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/20 06:14:00 UTC, 1 replies.
- [jira] [Reopened] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/08/20 06:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/20 06:27:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-23679) uiWebUrl show inproper URL when running on YARN - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/08/20 06:28:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23679) uiWebUrl show inproper URL when running on YARN - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/08/20 06:30:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25159) json schema inference should only trigger one job - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/20 07:29:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23714) Add metrics for cached KafkaConsumer - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/08/20 08:06:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-23714) Add metrics for cached KafkaConsumer - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/08/20 08:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25160) Remove sql configuration spark.sql.avro.outputTimestampType - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/08/20 08:16:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25160) Remove sql configuration spark.sql.avro.outputTimestampType - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/20 08:23:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25160) Remove sql configuration spark.sql.avro.outputTimestampType - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/20 08:23:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25159) json schema inference should only trigger one job - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/20 08:42:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25159) json schema inference should only trigger one job - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/20 08:42:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/08/20 09:33:00 UTC, 27 replies.
- [jira] [Commented] (SPARK-23034) Display tablename for `HiveTableScan` node in UI - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/20 10:52:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25160) Remove sql configuration spark.sql.avro.outputTimestampType - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/20 12:43:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-19498) Discussion: Making MLlib APIs extensible for 3rd party libraries - posted by "Lucas Partridge (JIRA)" <ji...@apache.org> on 2018/08/20 13:03:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-23711) Add fallback to interpreted execution logic - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/20 15:33:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25140) Add optional logging to UnsafeProjection.create when it falls back to interpreted mode - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/20 15:33:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25126) avoid creating OrcFile.Reader for all orc files - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/20 17:10:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-23573) Create linter rule to prevent misuse of SparkContext.hadoopConfiguration in SQL modules - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/20 17:13:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25126) avoid creating OrcFile.Reader for all orc files - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/20 17:14:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25161) Fix several bugs in failure handling of barrier execution mode - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/08/20 17:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25161) Fix several bugs in failure handling of barrier execution mode - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/20 17:29:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25161) Fix several bugs in failure handling of barrier execution mode - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/20 17:29:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25162) Kubernetes 'in-cluster' client mode and value spark.driver.host - posted by "James Carter (JIRA)" <ji...@apache.org> on 2018/08/20 17:56:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25163) Flaky test: o.a.s.util.collection.ExternalAppendOnlyMapSuite.spilling with compression - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/08/20 17:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25162) Kubernetes 'in-cluster' client mode and value of spark.driver.host - posted by "James Carter (JIRA)" <ji...@apache.org> on 2018/08/20 18:02:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25162) Kubernetes 'in-cluster' client mode and value spark.driver.host - posted by "James Carter (JIRA)" <ji...@apache.org> on 2018/08/20 18:02:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25164) Parquet reader builds entire list of columns once for each column - posted by "Bruce Robbins (JIRA)" <ji...@apache.org> on 2018/08/20 19:35:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24834) Utils#nanSafeCompare{Double,Float} functions do not differ from normal java double/float comparison - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/20 20:03:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24639) Add three configs in the doc - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/20 20:04:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24418) Upgrade to Scala 2.11.12 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/20 20:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25165) Cannot parse Hive Struct - posted by "Frank Yin (JIRA)" <ji...@apache.org> on 2018/08/20 20:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24442) Add configuration parameter to adjust the numbers of records and the charters per row before truncation when a user runs.show() - posted by "Andrew K Long (JIRA)" <ji...@apache.org> on 2018/08/20 21:30:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24442) Add configuration parameter to adjust the numbers of records and the charters per row before truncation when a user runs.show() - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/20 21:30:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-23128) A new approach to do adaptive execution in Spark SQL - posted by "Xin Yao (JIRA)" <ji...@apache.org> on 2018/08/20 22:40:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-25134) Csv column pruning with checking of headers throws incorrect error - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/21 02:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25132) Case-insensitive field resolution when reading from Parquet/ORC - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/21 02:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25166) Reduce the number of write operations for shuffle write. - posted by "liuxian (JIRA)" <ji...@apache.org> on 2018/08/21 02:46:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25166) Reduce the number of write operations for shuffle write. - posted by "liuxian (JIRA)" <ji...@apache.org> on 2018/08/21 02:47:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25166) Reduce the number of write operations for shuffle write. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/21 02:53:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25166) Reduce the number of write operations for shuffle write. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/21 02:53:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25165) Cannot parse Hive Struct - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/21 03:01:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25157) Streaming of image files from directory - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/21 03:04:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25165) Cannot parse Hive Struct - posted by "Frank Yin (JIRA)" <ji...@apache.org> on 2018/08/21 03:48:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-23679) uiWebUrl show inproper URL when running on YARN - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/21 04:04:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25167) Minor fixes for R sql tests (tests that fail in development environment) - posted by "Dilip Biswal (JIRA)" <ji...@apache.org> on 2018/08/21 04:41:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25167) Minor fixes for R sql tests (tests that fail in development environment) - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/21 04:42:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25167) Minor fixes for R sql tests (tests that fail in development environment) - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/21 04:42:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25017) Add test suite for ContextBarrierState - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/21 05:29:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25017) Add test suite for ContextBarrierState - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/21 05:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25168) PlanTest.comparePlans may make a supplied resolved plan unresolved. - posted by "Dilip Biswal (JIRA)" <ji...@apache.org> on 2018/08/21 06:42:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25168) PlanTest.comparePlans may make a supplied resolved plan unresolved. - posted by "Dilip Biswal (JIRA)" <ji...@apache.org> on 2018/08/21 06:43:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-25164) Parquet reader builds entire list of columns once for each column - posted by "Bruce Robbins (JIRA)" <ji...@apache.org> on 2018/08/21 06:50:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25169) Multiple DataFrames cannot write to the same folder concurrently - posted by "pin_zhang (JIRA)" <ji...@apache.org> on 2018/08/21 07:26:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25169) Multiple DataFrames cannot write to the same folder concurrently - posted by "pin_zhang (JIRA)" <ji...@apache.org> on 2018/08/21 07:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25170) Add Task Metrics description to the documentation - posted by "Luca Canali (JIRA)" <ji...@apache.org> on 2018/08/21 07:29:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25170) Add Task Metrics description to the documentation - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/21 07:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25170) Add Task Metrics description to the documentation - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/21 07:37:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25171) After restart, StreamingContext is replaying the last successful micro-batch right before the stop - posted by "Haopu Wang (JIRA)" <ji...@apache.org> on 2018/08/21 07:41:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25172) kererbos issue when use jdbc to connect hive server2 on executors - posted by "sun zhiwei (JIRA)" <ji...@apache.org> on 2018/08/21 07:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25173) fail to pass kerberos authentification on executers - posted by "sun zhiwei (JIRA)" <ji...@apache.org> on 2018/08/21 07:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-17025) Cannot persist PySpark ML Pipeline model that includes custom Transformer - posted by "Hadar gorodissky (JIRA)" <ji...@apache.org> on 2018/08/21 08:18:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24985) Executing SQL with "Full Outer Join" on top of large tables when there is data skew met OOM - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/21 08:50:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24985) Executing SQL with "Full Outer Join" on top of large tables when there is data skew met OOM - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/21 08:50:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25174) ApplicationMaster suspends when unregistering itself from RM with extreme large diagnostic message - posted by "Kent Yao (JIRA)" <ji...@apache.org> on 2018/08/21 08:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25174) ApplicationMaster suspends when unregistering itself from RM with extreme large diagnostic message - posted by "Kent Yao (JIRA)" <ji...@apache.org> on 2018/08/21 09:00:04 UTC, 2 replies.
- [jira] [Created] (SPARK-25175) Case-insensitive field resolution when reading from ORC - posted by "Chenxiao Mao (JIRA)" <ji...@apache.org> on 2018/08/21 09:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25175) Case-insensitive field resolution when reading from ORC - posted by "Chenxiao Mao (JIRA)" <ji...@apache.org> on 2018/08/21 09:29:00 UTC, 8 replies.
- [jira] [Commented] (SPARK-24530) Sphinx doesn't render autodoc_docstring_signature correctly (with Python 2?) and pyspark.ml docs are broken - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/21 10:59:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25050) Handle more than two types in avro union types - posted by "Li Yuanjian (JIRA)" <ji...@apache.org> on 2018/08/21 11:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25176) Kryo fails to serialize a parametrised type hierarchy - posted by "Mikhail Pryakhin (JIRA)" <ji...@apache.org> on 2018/08/21 14:17:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25176) Kryo fails to serialize a parametrised type hierarchy - posted by "Mikhail Pryakhin (JIRA)" <ji...@apache.org> on 2018/08/21 14:19:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25177) When dataframe decimal type column having a scale higher than 6, 0 values are shown in scientific notation - posted by "Vinod KC (JIRA)" <ji...@apache.org> on 2018/08/21 14:57:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25177) When dataframe decimal type column having scale higher than 6, 0 values are shown in scientific notation - posted by "Vinod KC (JIRA)" <ji...@apache.org> on 2018/08/21 14:59:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-25177) When dataframe decimal type column having scale higher than 6, 0 values are shown in scientific notation - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/21 15:21:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25177) When dataframe decimal type column having scale higher than 6, 0 values are shown in scientific notation - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/21 15:21:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25161) Fix several bugs in failure handling of barrier execution mode - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/08/21 15:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25172) kererbos issue when use jdbc to connect hive server2 on executors - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/08/21 17:23:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25173) fail to pass kerberos authentification on executers - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/08/21 17:23:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24335) Dataset.map schema not applied in some cases - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/21 17:38:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25178) Use dummy name for xxxHashMapGenerator key/value schema field - posted by "Kris Mok (JIRA)" <ji...@apache.org> on 2018/08/21 18:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25178) Use dummy name for xxxHashMapGenerator key/value schema field - posted by "Kris Mok (JIRA)" <ji...@apache.org> on 2018/08/21 18:12:00 UTC, 4 replies.
- [jira] [Assigned] (SPARK-24296) Support replicating blocks larger than 2 GB - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/08/21 18:27:02 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24296) Support replicating blocks larger than 2 GB - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/08/21 18:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25179) Document the features that require Pyarrow 0.10 - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/21 18:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25179) Document the features that require Pyarrow 0.10 - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/21 18:39:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25179) Document the features that require Pyarrow 0.10 - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/21 18:41:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-6236) Support caching blocks larger than 2G - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/08/21 18:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-22779) ConfigEntry's default value should actually be a value - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/21 19:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25179) Document the features that require Pyarrow 0.10 - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/21 19:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-7768) Make user-defined type (UDT) API public - posted by "Alexander (JIRA)" <ji...@apache.org> on 2018/08/21 19:50:00 UTC, 10 replies.
- [jira] [Created] (SPARK-25180) Spark standalone failure in Utils.doFetchFile() if nslookup of local hostname fails - posted by "Steve Loughran (JIRA)" <ji...@apache.org> on 2018/08/21 21:00:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25180) Spark standalone failure in Utils.doFetchFile() if nslookup of local hostname fails - posted by "Steve Loughran (JIRA)" <ji...@apache.org> on 2018/08/21 21:02:00 UTC, 4 replies.
- [jira] [Comment Edited] (SPARK-25180) Spark standalone failure in Utils.doFetchFile() if nslookup of local hostname fails - posted by "Steve Loughran (JIRA)" <ji...@apache.org> on 2018/08/21 21:04:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25162) Kubernetes 'in-cluster' client mode and value of spark.driver.host - posted by "Yinan Li (JIRA)" <ji...@apache.org> on 2018/08/21 21:18:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-25050) Handle more than two types in avro union types when writing avro files - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/08/21 22:03:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25050) Handle more than two types in avro union types when writing avro files - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/08/21 22:04:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24307) Support sending messages over 2GB from memory - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/21 22:15:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25149) Personalized PageRank raises an error if vertexIDs are > MaxInt - posted by "Joseph K. Bradley (JIRA)" <ji...@apache.org> on 2018/08/21 22:20:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25149) Personalized PageRank raises an error if vertexIDs are > MaxInt - posted by "Joseph K. Bradley (JIRA)" <ji...@apache.org> on 2018/08/21 22:20:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25149) Personalized PageRank raises an error if vertexIDs are > MaxInt - posted by "Joseph K. Bradley (JIRA)" <ji...@apache.org> on 2018/08/21 22:23:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24763) Remove redundant key data from value in streaming aggregation - posted by "Tathagata Das (JIRA)" <ji...@apache.org> on 2018/08/21 22:24:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24763) Remove redundant key data from value in streaming aggregation - posted by "Tathagata Das (JIRA)" <ji...@apache.org> on 2018/08/21 22:24:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-24441) Expose total estimated size of states in HDFSBackedStateStoreProvider - posted by "Tathagata Das (JIRA)" <ji...@apache.org> on 2018/08/21 22:29:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24441) Expose total estimated size of states in HDFSBackedStateStoreProvider - posted by "Tathagata Das (JIRA)" <ji...@apache.org> on 2018/08/21 22:29:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24763) Remove redundant key data from value in streaming aggregation - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/08/21 22:39:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-25168) PlanTest.comparePlans may make a supplied resolved plan unresolved. - posted by "Dilip Biswal (JIRA)" <ji...@apache.org> on 2018/08/21 22:48:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24564) Add test suite for RecordBinaryComparator - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/21 22:52:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25095) Python support for BarrierTaskContext - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/08/21 22:56:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25114) RecordBinaryComparator may return wrong result when subtraction between two words is divisible by Integer.MAX_VALUE - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/21 22:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25181) Block Manager master and slave thread pools are unbounded - posted by "Mukul Murthy (JIRA)" <ji...@apache.org> on 2018/08/21 23:04:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25182) Block Manager master and slave thread pools are unbounded - posted by "Mukul Murthy (JIRA)" <ji...@apache.org> on 2018/08/21 23:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25182) Block Manager master and slave thread pools are unbounded - posted by "Mukul Murthy (JIRA)" <ji...@apache.org> on 2018/08/21 23:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25181) Block Manager master and slave thread pools are unbounded - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/21 23:23:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25181) Block Manager master and slave thread pools are unbounded - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/21 23:23:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25164) Parquet reader builds entire list of columns once for each column - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/08/21 23:30:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25119) stages in wrong order within job page DAG chart - posted by "Yunjian Zhang (JIRA)" <ji...@apache.org> on 2018/08/21 23:31:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-25164) Parquet reader builds entire list of columns once for each column - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/08/21 23:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25183) Spark HiveServer2 registers shutdown hook with JVM, not ShutdownHookManager; race conditions can arise - posted by "Steve Loughran (JIRA)" <ji...@apache.org> on 2018/08/22 00:57:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25127) DataSourceV2: Remove SupportsPushDownCatalystFilters - posted by "Reynold Xin (JIRA)" <ji...@apache.org> on 2018/08/22 01:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23131) Stackoverflow using ML and Kryo serializer - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/22 01:50:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25174) ApplicationMaster suspends when unregistering itself from RM with extreme large diagnostic message - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/22 02:26:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25174) ApplicationMaster suspends when unregistering itself from RM with extreme large diagnostic message - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/22 02:26:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25163) Flaky test: o.a.s.util.collection.ExternalAppendOnlyMapSuite.spilling with compression - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/22 02:47:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25163) Flaky test: o.a.s.util.collection.ExternalAppendOnlyMapSuite.spilling with compression - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/22 02:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25184) Flaky test: FlatMapGroupsWithState "streaming with processing time timeout" - posted by "Tathagata Das (JIRA)" <ji...@apache.org> on 2018/08/22 04:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25184) Flaky test: FlatMapGroupsWithState "streaming with processing time timeout" - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/22 04:57:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25184) Flaky test: FlatMapGroupsWithState "streaming with processing time timeout" - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/22 04:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25185) CBO rowcount statistics doesn't work for partitioned parquet external table - posted by "Amit (JIRA)" <ji...@apache.org> on 2018/08/22 05:05:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25140) Add optional logging to UnsafeProjection.create when it falls back to interpreted mode - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/22 05:19:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25159) json schema inference should only trigger one job - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/22 05:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25159) json schema inference should only trigger one job - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/22 05:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25155) Streaming from storage doesn't work when no directories exists - posted by "Gil Vernik (JIRA)" <ji...@apache.org> on 2018/08/22 05:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25186) Stabilize Data Source V2 API - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/22 05:58:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25187) Revisit the life cycle of ReadSupport instances. - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/22 05:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25188) Add WriteConfig - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/22 06:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25189) CustomMetrics should be created with ScanConfig - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/22 06:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25190) Better operator pushdown API - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/22 06:09:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25191) continuous streaming should only create one ReadSupport instance per-query - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/22 06:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25192) Remove SupportsPushdownCatalystFilter - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/22 06:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25168) PlanTest.comparePlans may make a supplied resolved plan unresolved. - posted by "Dilip Biswal (JIRA)" <ji...@apache.org> on 2018/08/22 06:34:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25093) CodeFormatter could avoid creating regex object again and again - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/22 06:34:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25193) insert overwrite doesn't throw exception when drop old data fails - posted by "chen xiao (JIRA)" <ji...@apache.org> on 2018/08/22 06:46:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25193) insert overwrite doesn't throw exception when drop old data fails - posted by "chen xiao (JIRA)" <ji...@apache.org> on 2018/08/22 06:48:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-24882) data source v2 API improvement - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/22 07:13:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25185) CBO rowcount statistics doesn't work for partitioned parquet external table - posted by "Amit (JIRA)" <ji...@apache.org> on 2018/08/22 07:33:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25192) Remove SupportsPushdownCatalystFilter - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/22 08:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25194) Kubernetes - Define cpu and memory limit to init container - posted by "Daniel Majano (JIRA)" <ji...@apache.org> on 2018/08/22 10:45:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25195) Extending from_json function - posted by "Yuriy Davygora (JIRA)" <ji...@apache.org> on 2018/08/22 12:52:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25195) Extending from_json function - posted by "Yuriy Davygora (JIRA)" <ji...@apache.org> on 2018/08/22 12:57:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25196) Analyze column statistics in cached query - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/08/22 13:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25196) Analyze column statistics in cached query - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/08/22 13:23:00 UTC, 5 replies.
- [jira] [Commented] (SPARK-25091) Spark Thrift Server: UNCACHE TABLE and CLEAR CACHE does not clean up executor memory - posted by "Chao Fang (JIRA)" <ji...@apache.org> on 2018/08/22 13:27:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-7768) Make user-defined type (UDT) API public - posted by "Simeon H.K. Fitch (JIRA)" <ji...@apache.org> on 2018/08/22 14:22:01 UTC, 7 replies.
- [jira] [Created] (SPARK-25197) Read from Path - posted by "Nick Sutcliffe (JIRA)" <ji...@apache.org> on 2018/08/22 14:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25197) Read from java.nio.Path - posted by "Nick Sutcliffe (JIRA)" <ji...@apache.org> on 2018/08/22 15:00:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25187) Revisit the life cycle of ReadSupport instances. - posted by "Ryan Blue (JIRA)" <ji...@apache.org> on 2018/08/22 15:58:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25187) Revisit the life cycle of ReadSupport instances. - posted by "Ryan Blue (JIRA)" <ji...@apache.org> on 2018/08/22 15:58:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25190) Better operator pushdown API - posted by "Ryan Blue (JIRA)" <ji...@apache.org> on 2018/08/22 16:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25188) Add WriteConfig - posted by "Ryan Blue (JIRA)" <ji...@apache.org> on 2018/08/22 16:20:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25198) org.apache.spark.sql.catalyst.parser.ParseException: DataType json is not supported. - posted by "antonkulaga (JIRA)" <ji...@apache.org> on 2018/08/22 17:02:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25105) Importing all of pyspark.sql.functions should bring PandasUDFType in as well - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/08/22 17:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25183) Spark HiveServer2 registers shutdown hook with JVM, not ShutdownHookManager; race conditions can arise - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/22 17:28:02 UTC, 2 replies.
- [jira] [Commented] (SPARK-25183) Spark HiveServer2 registers shutdown hook with JVM, not ShutdownHookManager; race conditions can arise - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/22 17:28:02 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25181) Block Manager master and slave thread pools are unbounded - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/08/22 17:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25199) InferSchema "all Strings" if one of many CSVs is empty - posted by "Neil McGuigan (JIRA)" <ji...@apache.org> on 2018/08/22 18:08:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24442) Add configuration parameter to adjust the numbers of records and the characters per row before truncation when a user runs.show() - posted by "Andrew K Long (JIRA)" <ji...@apache.org> on 2018/08/22 18:08:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25178) Use dummy name for xxxHashMapGenerator key/value schema field - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/22 18:24:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25164) Parquet reader builds entire list of columns once for each column - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/22 18:31:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25200) Allow setting HADOOP_CONF_DIR as a spark property - posted by "Adam Balogh (JIRA)" <ji...@apache.org> on 2018/08/22 18:42:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25199) InferSchema "all Strings" if one of many CSVs is empty - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/22 18:57:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-25199) InferSchema "all Strings" if one of many CSVs is empty - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/22 18:57:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25201) Synchronization performed on AtomicReference in LevelDB class - posted by "Ted Yu (JIRA)" <ji...@apache.org> on 2018/08/22 19:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25184) Flaky test: FlatMapGroupsWithState "streaming with processing time timeout" - posted by "Tathagata Das (JIRA)" <ji...@apache.org> on 2018/08/22 19:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25194) Kubernetes - Define cpu and memory limit to init container - posted by "Yinan Li (JIRA)" <ji...@apache.org> on 2018/08/22 19:30:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25202) SQL Function Split Should Respect Limit Argument - posted by "Parker Hegstrom (JIRA)" <ji...@apache.org> on 2018/08/22 20:38:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25203) spark sql, union all does not propagate child partitioning (when possible) - posted by "Eyal Farago (JIRA)" <ji...@apache.org> on 2018/08/22 20:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25203) spark sql, union all does not propagate child partitioning (when possible) - posted by "Eyal Farago (JIRA)" <ji...@apache.org> on 2018/08/22 20:57:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25195) Extending from_json function - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/08/22 20:58:00 UTC, 6 replies.
- [jira] [Assigned] (SPARK-25119) stages in wrong order within job page DAG chart - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/22 21:06:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25163) Flaky test: o.a.s.util.collection.ExternalAppendOnlyMapSuite.spilling with compression - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/08/22 21:18:01 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25188) Add WriteConfig - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/22 21:28:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25204) rate source test is flaky - posted by "Jose Torres (JIRA)" <ji...@apache.org> on 2018/08/22 22:13:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25204) rate source test is flaky - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/22 22:16:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25204) rate source test is flaky - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/22 22:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24785) Making sure REPL prints Spark UI info and then Welcome message - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/08/22 23:17:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24785) Making sure REPL prints Spark UI info and then Welcome message - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/08/22 23:17:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25186) Stabilize Data Source V2 API - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/22 23:56:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25186) Stabilize Data Source V2 API - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/22 23:56:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25127) DataSourceV2: Remove SupportsPushDownCatalystFilters - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/23 00:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25198) org.apache.spark.sql.catalyst.parser.ParseException: DataType json is not supported. - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/08/23 01:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25178) Directly ship the StructType objects of the keySchema / valueSchema for xxxHashMapGenerator - posted by "Kazuaki Ishizaki (JIRA)" <ji...@apache.org> on 2018/08/23 01:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25202) SQL Function Split Should Respect Limit Argument - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/08/23 01:40:00 UTC, 5 replies.
- [jira] [Comment Edited] (SPARK-25196) Analyze column statistics in cached query - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/08/23 02:29:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25167) Minor fixes for R sql tests (tests that fail in development environment) - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/23 02:58:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25205) typo in spark.network.crypto.keyFactoryIteration - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/08/23 03:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25205) typo in spark.network.crypto.keyFactoryIteration - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/23 03:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25205) typo in spark.network.crypto.keyFactoryIteration - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/23 03:14:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-25192) Remove SupportsPushdownCatalystFilter - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/23 03:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25132) Case-insensitive field resolution when reading from Parquet - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/23 03:27:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-25176) Kryo fails to serialize a parametrised type hierarchy - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/23 03:30:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25197) Read from java.nio.Path - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/23 03:38:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-18112) Spark2.x does not support read data from Hive 2.x metastore - posted by "Leo Gallucci (JIRA)" <ji...@apache.org> on 2018/08/23 05:47:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25133) Documentaion: AVRO data source guide - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/23 05:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25129) Make the mapping of com.databricks.spark.avro to built-in module configurable - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/08/23 06:09:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24811) Add function `from_avro` and `to_avro` - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/23 06:19:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23034) Display tablename for `HiveTableScan` node in UI - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/23 06:28:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25164) Parquet reader builds entire list of columns once for each column - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/23 06:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-13446) Spark need to support reading data from Hive 2.0.0 metastore - posted by "Leo Gallucci (JIRA)" <ji...@apache.org> on 2018/08/23 06:54:01 UTC, 0 replies.
- [jira] [Assigned] (SPARK-23034) Display tablename for `HiveTableScan` node in UI - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/23 06:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25171) After restart, StreamingContext is replaying the last successful micro-batch right before the stop - posted by "Haopu Wang (JIRA)" <ji...@apache.org> on 2018/08/23 07:06:00 UTC, 0 replies.
- [jira] [Issue Comment Deleted] (SPARK-25171) After restart, StreamingContext is replaying the last successful micro-batch right before the stop - posted by "Haopu Wang (JIRA)" <ji...@apache.org> on 2018/08/23 07:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25206) Wrong data may be returned when enable pushdown - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/08/23 07:41:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25206) Wrong data may be returned when enable pushdown - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/08/23 07:46:00 UTC, 8 replies.
- [jira] [Created] (SPARK-25207) Case-insensitve field resolution for filter pushdown when reading Parquet - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/08/23 07:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25207) Case-insensitve field resolution for filter pushdown when reading Parquet - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/23 08:06:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-25207) Case-insensitve field resolution for filter pushdown when reading Parquet - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/23 08:06:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25206) Wrong data may be returned when enable pushdown - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/23 08:42:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-25121) Support multi-part column name for hint resolution - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/23 09:55:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25208) Loosen Cast.forceNullable for DecimalType. - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/08/23 10:51:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25073) Spark-submit on Yarn Task : When the yarn.nodemanager.resource.memory-mb and/or yarn.scheduler.maximum-allocation-mb is insufficient, Spark always reports an error request to adjust yarn.scheduler.maximum-allocation-mb - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/23 10:52:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-25208) Loosen Cast.forceNullable for DecimalType. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/23 10:57:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25208) Loosen Cast.forceNullable for DecimalType. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/23 10:57:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25073) Spark-submit on Yarn Task : When the yarn.nodemanager.resource.memory-mb and/or yarn.scheduler.maximum-allocation-mb is insufficient, Spark always reports an error request to adjust yarn.scheduler.maximum-allocation-mb - posted by "Sujith (JIRA)" <ji...@apache.org> on 2018/08/23 11:29:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25209) Optimization in Dataset.apply for DataFrames - posted by "Bogdan Raducanu (JIRA)" <ji...@apache.org> on 2018/08/23 12:00:03 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25209) Optimization in Dataset.apply for DataFrames - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/23 12:16:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25209) Optimization in Dataset.apply for DataFrames - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/23 12:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25210) spark driver apply task success info cost much time - posted by "wangminfeng (JIRA)" <ji...@apache.org> on 2018/08/23 12:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25211) speculation and fetch failed result in hang of job - posted by "Lijia Liu (JIRA)" <ji...@apache.org> on 2018/08/23 13:27:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25211) speculation and fetch failed result in hang of job - posted by "Lijia Liu (JIRA)" <ji...@apache.org> on 2018/08/23 13:30:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25212) Support Filter in ConvertToLocalRelation - posted by "Bogdan Raducanu (JIRA)" <ji...@apache.org> on 2018/08/23 13:44:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25211) speculation and fetch failed result in hang of job - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/23 13:45:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25211) speculation and fetch failed result in hang of job - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/23 13:45:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25209) Optimization in Dataset.apply for DataFrames - posted by "Bogdan Raducanu (JIRA)" <ji...@apache.org> on 2018/08/23 13:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25126) avoid creating OrcFile.Reader for all orc files - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/23 14:02:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25196) Analyze column statistics in cached query - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/23 14:37:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25208) Loosen Cast.forceNullable for DecimalType. - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/23 14:50:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25212) Support Filter in ConvertToLocalRelation - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/23 15:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25212) Support Filter in ConvertToLocalRelation - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/23 15:12:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25213) DataSourceV2 doesn't seem to produce unsafe rows - posted by "Li Jin (JIRA)" <ji...@apache.org> on 2018/08/23 15:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25213) DataSourceV2 doesn't seem to produce unsafe rows - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/23 15:44:00 UTC, 5 replies.
- [jira] [Commented] (SPARK-24772) support reading AVRO logical types - Date - posted by "Antonio Murgia (JIRA)" <ji...@apache.org> on 2018/08/23 16:15:00 UTC, 0 replies.
- [jira] [Issue Comment Deleted] (SPARK-24772) support reading AVRO logical types - Date - posted by "Antonio Murgia (JIRA)" <ji...@apache.org> on 2018/08/23 16:16:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24768) Have a built-in AVRO data source implementation - posted by "Antonio Murgia (JIRA)" <ji...@apache.org> on 2018/08/23 16:16:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23207) Shuffle+Repartition on an DataFrame could lead to incorrect answers - posted by "Jiang Xingbo (JIRA)" <ji...@apache.org> on 2018/08/23 17:01:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25214) Kafka v2 source may return duplicated records when `failOnDataLoss` is `false` - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/08/23 17:26:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25213) DataSourceV2 doesn't seem to produce unsafe rows - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/23 17:42:12 UTC, 1 replies.
- [jira] [Commented] (SPARK-25200) Allow setting HADOOP_CONF_DIR as a spark property - posted by "Adam Balogh (JIRA)" <ji...@apache.org> on 2018/08/23 18:08:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25215) Make PipelineModel public - posted by "Nicholas Resnick (JIRA)" <ji...@apache.org> on 2018/08/23 18:18:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25214) Kafka v2 source may return duplicated records when `failOnDataLoss` is `false` - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/23 18:19:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-25214) Kafka v2 source may return duplicated records when `failOnDataLoss` is `false` - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/23 18:19:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25214) Kafka v2 source may return duplicated records when `failOnDataLoss` is `false` - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/08/23 18:29:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25216) Provide better error message when a column contains dot and needs backticks quote - posted by "Li Jin (JIRA)" <ji...@apache.org> on 2018/08/23 18:41:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25216) Provide better error message when a column contains dot and needs backticks quote - posted by "Li Jin (JIRA)" <ji...@apache.org> on 2018/08/23 18:41:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25216) Provide better error message when a column contains dot and needs backticks quote - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/23 18:47:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25216) Provide better error message when a column contains dot and needs backticks quote - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/23 18:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24564) Add test suite for RecordBinaryComparator - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/23 19:00:01 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25204) rate source test is flaky - posted by "Tathagata Das (JIRA)" <ji...@apache.org> on 2018/08/23 19:15:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24415) Stage page aggregated executor metrics wrong when failures - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/23 19:58:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24415) Stage page aggregated executor metrics wrong when failures - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/23 19:58:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25217) Error thrown when creating BlockMatrix - posted by "cs5090237 (JIRA)" <ji...@apache.org> on 2018/08/23 20:08:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25218) Potential resource leaks in TransportServer and SocketAuthHelper - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/08/23 20:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25218) Potential resource leaks in TransportServer and SocketAuthHelper - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/23 20:17:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25218) Potential resource leaks in TransportServer and SocketAuthHelper - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/23 20:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24539) HistoryServer does not display metrics from tasks that complete after stage failure - posted by "Ankur Gupta (JIRA)" <ji...@apache.org> on 2018/08/23 21:36:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-8582) Optimize checkpointing to avoid computing an RDD twice - posted by "Baris ERGUN (JIRA)" <ji...@apache.org> on 2018/08/23 21:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25124) VectorSizeHint.size is buggy, breaking streaming pipeline - posted by "Joseph K. Bradley (JIRA)" <ji...@apache.org> on 2018/08/23 23:18:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25219) KMeans Clustering - Text Data - Results are incorrect - posted by "Vasanthkumar Velayudham (JIRA)" <ji...@apache.org> on 2018/08/23 23:40:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24814) Relationship between catalog and datasources - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/24 01:21:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25205) typo in spark.network.crypto.keyFactoryIteration - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/24 01:33:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-23425) load data for hdfs file path with wild card usage is not working properly - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/24 01:56:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23425) load data for hdfs file path with wild card usage is not working properly - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/24 01:56:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25210) spark driver apply task success info cost much time - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/24 02:09:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25210) spark driver apply task success info cost much time - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/24 02:09:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25220) [K8S] Split out node selector config between driver and executors. - posted by "Jonathan A Weaver (JIRA)" <ji...@apache.org> on 2018/08/24 02:14:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25209) Optimization in Dataset.apply for DataFrames - posted by "Herman van Hovell (JIRA)" <ji...@apache.org> on 2018/08/24 02:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25220) [K8S] Split out node selector config between driver and executors. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/24 02:17:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25220) [K8S] Split out node selector config between driver and executors. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/24 02:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25221) [DEPLOY] Consistent trailing whitespace treatment of conf values - posted by "Gera Shegalov (JIRA)" <ji...@apache.org> on 2018/08/24 02:45:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25221) [DEPLOY] Consistent trailing whitespace treatment of conf values - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/24 03:16:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25221) [DEPLOY] Consistent trailing whitespace treatment of conf values - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/24 03:16:00 UTC, 1 replies.
- [jira] [Closed] (SPARK-25210) spark driver apply task success info cost much time - posted by "wangminfeng (JIRA)" <ji...@apache.org> on 2018/08/24 04:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-4502) Spark SQL reads unneccesary nested fields from Parquet - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/24 04:34:03 UTC, 0 replies.
- [jira] [Assigned] (SPARK-4502) Spark SQL reads unneccesary nested fields from Parquet - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/24 04:34:03 UTC, 0 replies.
- [jira] [Commented] (SPARK-25106) A new Kafka consumer gets created for every batch - posted by "Tathagata Das (JIRA)" <ji...@apache.org> on 2018/08/24 05:35:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-25178) Directly ship the StructType objects of the keySchema / valueSchema for xxxHashMapGenerator - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/08/24 06:00:06 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25106) A new Kafka consumer gets created for every batch - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/08/24 07:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25222) Spark on Kubernetes Pod Watcher dumps raw container status - posted by "Rob Vesse (JIRA)" <ji...@apache.org> on 2018/08/24 09:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25222) Spark on Kubernetes Pod Watcher dumps raw container status - posted by "Rob Vesse (JIRA)" <ji...@apache.org> on 2018/08/24 09:29:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25219) KMeans Clustering - Text Data - Results are incorrect - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/08/24 09:50:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25219) KMeans Clustering - Text Data - Results are incorrect - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/08/24 09:55:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-25222) Spark on Kubernetes Pod Watcher dumps raw container status - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/24 10:15:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25223) Use a map to store values for NamedLambdaVariable. - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/08/24 10:18:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25223) Use a map to store values for NamedLambdaVariable. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/24 10:23:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25223) Use a map to store values for NamedLambdaVariable. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/24 10:23:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25195) Extending from_json function - posted by "Yuriy Davygora (JIRA)" <ji...@apache.org> on 2018/08/24 10:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25224) Improvement of Spark SQL ThriftServer memory management - posted by "Dooyoung Hwang (JIRA)" <ji...@apache.org> on 2018/08/24 10:44:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25224) Improvement of Spark SQL ThriftServer memory management - posted by "Dooyoung Hwang (JIRA)" <ji...@apache.org> on 2018/08/24 10:48:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25225) Add support for "List"-Type columns - posted by "Yuriy Davygora (JIRA)" <ji...@apache.org> on 2018/08/24 10:55:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25226) Extend functionality of from_json - posted by "Yuriy Davygora (JIRA)" <ji...@apache.org> on 2018/08/24 10:56:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25227) Extend functionality of to_json - posted by "Yuriy Davygora (JIRA)" <ji...@apache.org> on 2018/08/24 10:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25228) Add executor CPU Time metric - posted by "Luca Canali (JIRA)" <ji...@apache.org> on 2018/08/24 11:49:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25228) Add executor CPU Time metric - posted by "Luca Canali (JIRA)" <ji...@apache.org> on 2018/08/24 11:49:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25228) Add executor CPU Time metric - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/24 11:57:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25228) Add executor CPU Time metric - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/24 11:57:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25224) Improvement of Spark SQL ThriftServer memory management - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/24 12:27:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25224) Improvement of Spark SQL ThriftServer memory management - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/24 12:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25229) ExternalCatalogUtils.prunePartitionsByFilter throw an AnalysisException when partition name contains upper letter - posted by "Xiaochen Ouyang (JIRA)" <ji...@apache.org> on 2018/08/24 13:13:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25229) ExternalCatalogUtils.prunePartitionsByFilter throw an AnalysisException when partition name contains upper letter - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/24 13:22:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25229) ExternalCatalogUtils.prunePartitionsByFilter throw an AnalysisException when partition name contains upper letter - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/24 13:22:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-11215) Add multiple columns support to StringIndexer - posted by "Barry Becker (JIRA)" <ji...@apache.org> on 2018/08/24 13:42:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/24 13:57:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25073) Spark-submit on Yarn Task : When the yarn.nodemanager.resource.memory-mb and/or yarn.scheduler.maximum-allocation-mb is insufficient, Spark always reports an error request to adjust yarn.scheduler.maximum-allocation-mb - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/24 13:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25047) Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/24 14:09:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25230) Upper behaves incorrect for string contains "ß" - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/24 14:20:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25230) Upper behaves incorrect for string contains "ß" - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/24 14:22:00 UTC, 10 replies.
- [jira] [Updated] (SPARK-25230) Upper behavior incorrect for string contains "ß" - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/24 14:57:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25231) Running a Large Job with Speculation On Causes Executor Heartbeats to Time Out on Driver - posted by "Parth Gandhi (JIRA)" <ji...@apache.org> on 2018/08/24 15:15:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25231) Running a Large Job with Speculation On Causes Executor Heartbeats to Time Out on Driver - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/24 15:35:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25231) Running a Large Job with Speculation On Causes Executor Heartbeats to Time Out on Driver - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/24 15:35:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25232) Support Full-Text Search in Spark SQL - posted by "Lijie Xu (JIRA)" <ji...@apache.org> on 2018/08/24 16:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25083) remove the type erasure hack in data source scan - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/24 16:01:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-10795) FileNotFoundException while deploying pyspark job on cluster - posted by "Furcy Pin (JIRA)" <ji...@apache.org> on 2018/08/24 16:28:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25233) Give the user the option of specifying a fixed minimum message per partition per batch when using kafka direct API with backpressure - posted by "Reza Safi (JIRA)" <ji...@apache.org> on 2018/08/24 16:44:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25233) Give the user the option of specifying a fixed minimum message per partition per batch when using kafka direct API with backpressure - posted by "Reza Safi (JIRA)" <ji...@apache.org> on 2018/08/24 16:44:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25234) SparkR:::parallelize doesn't handle integer overflow properly - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/08/24 16:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25234) SparkR:::parallelize doesn't handle integer overflow properly - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/08/24 16:49:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25233) Give the user the option of specifying a fixed minimum message per partition per batch when using kafka direct API with backpressure - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/24 16:52:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-25234) SparkR:::parallelize doesn't handle integer overflow properly - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/08/24 17:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24090) Kubernetes Backend Hotlist for Spark 2.4 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/24 18:02:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24090) Kubernetes Backend Hotlist for Spark 2.4 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/24 18:02:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-19335) Spark should support doing an efficient DataFrame Upsert via JDBC - posted by "drew zoellner (JIRA)" <ji...@apache.org> on 2018/08/24 18:05:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25234) SparkR:::parallelize doesn't handle integer overflow properly - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/24 18:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24391) to_json/from_json should support arrays of primitives, and more generally all JSON - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/24 19:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25235) Merge the REPL code in Scala 2.11 and 2.12 branches - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/08/24 20:29:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25174) ApplicationMaster suspends when unregistering itself from RM with extreme large diagnostic message - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/08/24 20:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25202) SQL Function Split Should Respect Limit Argument - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/24 20:57:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25214) Kafka v2 source may return duplicated records when `failOnDataLoss` is `false` - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/08/24 20:59:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-19094) Plumb through logging/error messages from the JVM to Jupyter PySpark - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/08/24 21:23:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-9636) Treat $SPARK_HOME as write-only - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/08/24 21:24:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25236) Investigate using a logging library inside of PySpark on the workers instead of print - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/08/24 21:26:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25230) Upper behavior incorrect for string contains "ß" - posted by "Nihar Sheth (JIRA)" <ji...@apache.org> on 2018/08/24 21:52:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25234) SparkR:::parallelize doesn't handle integer overflow properly - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/08/24 22:05:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25106) A new Kafka consumer gets created for every batch - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/08/24 22:39:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25124) VectorSizeHint.size is buggy, breaking streaming pipeline - posted by "Joseph K. Bradley (JIRA)" <ji...@apache.org> on 2018/08/24 22:42:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25206) Wrong data may be returned when enable pushdown for Parquet - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/08/24 23:17:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25206) Wrong data may be returned when enable pushdown for Parquet - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/08/24 23:45:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25206) Wrong data may be returned when enable pushdown for Parquet - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/08/24 23:46:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-25206) Wrong data may be returned for Parquet - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/08/25 00:09:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-25223) Use a map to store values for NamedLambdaVariable. - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/08/25 00:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25232) Support Full-Text Search in Spark SQL - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/08/25 01:38:00 UTC, 6 replies.
- [jira] [Resolved] (SPARK-25229) ExternalCatalogUtils.prunePartitionsByFilter throw an AnalysisException when partition name contains upper letter - posted by "Xiaochen Ouyang (JIRA)" <ji...@apache.org> on 2018/08/25 01:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25206) Wrong data may be returned for Parquet - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/08/25 02:15:00 UTC, 17 replies.
- [jira] [Commented] (SPARK-25225) Add support for "List"-Type columns - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/08/25 02:41:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-25206) Wrong data may be returned for Parquet - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/08/25 03:34:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-25232) Support Full-Text Search in Spark SQL - posted by "Lijie Xu (JIRA)" <ji...@apache.org> on 2018/08/25 03:41:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25237) FileScanRdd's inputMetrics is wrong when select the datasource table with limit - posted by "du (JIRA)" <ji...@apache.org> on 2018/08/25 06:55:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25238) Lint-Python: Upgrading to the current version of pycodestyle fails - posted by "cclauss (JIRA)" <ji...@apache.org> on 2018/08/25 06:55:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25237) FileScanRdd's inputMetrics is wrong when select the datasource table with limit - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/25 06:58:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25237) FileScanRdd's inputMetrics is wrong when select the datasource table with limit - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/25 06:58:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25237) FileScanRdd's inputMetrics is wrong when select the datasource table with limit - posted by "du (JIRA)" <ji...@apache.org> on 2018/08/25 06:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25238) Lint-Python: Upgrading to the current version of pycodestyle fails - posted by "cclauss (JIRA)" <ji...@apache.org> on 2018/08/25 07:18:00 UTC, 1 replies.
- [jira] [Issue Comment Deleted] (SPARK-17368) Scala value classes create encoder problems and break at runtime - posted by "Minh Thai (JIRA)" <ji...@apache.org> on 2018/08/25 09:10:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25238) Lint-Python: Upgrading to the current version of pycodestyle fails - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/25 10:03:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25238) Lint-Python: Upgrading to the current version of pycodestyle fails - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/25 10:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25239) Spark Streaming for Kafka should allow uniform batch size per partition for streaming RDD - posted by "Sidhavratha Kumar (JIRA)" <ji...@apache.org> on 2018/08/25 11:54:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25240) Dead-lock in ALTER TABLE RECOVER PARTITIONS - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/08/25 13:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25240) Dead-lock in ALTER TABLE RECOVER PARTITIONS - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/25 13:50:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25240) Dead-lock in ALTER TABLE RECOVER PARTITIONS - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/25 13:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24688) Clarify comments about LabeledPoint as (label, feature) pair rather than (feature, label) - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/25 13:51:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25240) A deadlock in ALTER TABLE RECOVER PARTITIONS - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/08/25 13:55:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-24688) Clarify comments about LabeledPoint as (label, feature) pair rather than (feature, label) - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/25 14:25:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24688) Clarify comments about LabeledPoint as (label, feature) pair rather than (feature, label) - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/25 14:25:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25193) insert overwrite doesn't throw exception when drop old data fails - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/08/25 14:48:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25226) Extend functionality of from_json - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/25 15:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25227) Extend functionality of to_json - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/25 15:08:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25241) Configurable empty values when reading/writing CSV files - posted by "Mario Molina (JIRA)" <ji...@apache.org> on 2018/08/25 17:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25241) Configurable empty values when reading/writing CSV files - posted by "Mario Molina (JIRA)" <ji...@apache.org> on 2018/08/25 17:46:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25241) Configurable empty values when reading/writing CSV files - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/25 18:01:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25241) Configurable empty values when reading/writing CSV files - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/25 18:01:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25242) Suggestion to make sql config setting fluent - posted by "Florence Hope (JIRA)" <ji...@apache.org> on 2018/08/25 18:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25199) InferSchema "all Strings" if one of many CSVs is empty - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/08/25 21:03:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23836) Support returning StructType to the level support in GroupedMap Arrow's "scalar" UDFS (or similar) - posted by "Andrew Malone Melo (JIRA)" <ji...@apache.org> on 2018/08/26 02:23:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25080) NPE in HiveShim$.toCatalystDecimal(HiveShim.scala:110) - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/26 13:37:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23792) Documentation improvements for datetime functions - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/26 13:39:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-23792) Documentation improvements for datetime functions - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/26 13:39:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-10697) Lift Calculation in Association Rule mining - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/26 13:43:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25013) JDBC urls with jdbc:mariadb don't work as expected - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/26 13:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23707) Don't need shuffle exchange with single partition for 'spark.range' - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/26 14:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25243) Use FailureSafeParser in from_json - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/08/26 15:58:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25243) Use FailureSafeParser in from_json - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/26 16:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25243) Use FailureSafeParser in from_json - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/26 16:12:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25244) [Python] Setting `spark.sql.session.timeZone` only partially respected - posted by "Anton Daitche (JIRA)" <ji...@apache.org> on 2018/08/26 17:44:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25244) [Python] Setting `spark.sql.session.timeZone` only partially respected - posted by "Anton Daitche (JIRA)" <ji...@apache.org> on 2018/08/26 17:44:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25245) Explain regarding limiting modification on "spark.sql.shuffle.partitions" for structured streaming - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/08/26 21:17:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25245) Explain regarding limiting modification on "spark.sql.shuffle.partitions" for structured streaming - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/26 21:24:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25245) Explain regarding limiting modification on "spark.sql.shuffle.partitions" for structured streaming - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/26 21:24:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25246) When the spark.eventLog.compress is enabled, the Application is not showing in the History server UI ('incomplete application' page), initially. - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/08/26 21:59:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25246) When the spark.eventLog.compress is enabled, the Application is not showing in the History server UI ('incomplete application' page), initially. - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/08/26 22:00:01 UTC, 1 replies.
- [jira] [Updated] (SPARK-25135) insert datasource table may all null when select from view on parquet - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/08/26 23:34:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-25135) insert datasource table may all null when select from view on parquet - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/08/26 23:39:00 UTC, 3 replies.
- [jira] [Updated] (SPARK-25207) Case-insensitve field resolution for filter pushdown when reading Parquet - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/08/26 23:42:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-24766) CreateHiveTableAsSelect and InsertIntoHiveDir won't generate decimal column stats in parquet - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/08/26 23:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-19355) Use map output statistices to improve global limit's parallelism - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/27 00:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25236) Investigate using a logging library inside of PySpark on the workers instead of print - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/08/27 01:21:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25206) data issue because wrong column is pushdown for parquet - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/08/27 02:22:00 UTC, 4 replies.
- [jira] [Updated] (SPARK-25221) [DEPLOY] Consistent trailing whitespace treatment of conf values - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/08/27 02:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25206) data issue because wrong column is pushdown for parquet - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/08/27 02:27:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25206) data issue because wrong column is pushdown for parquet - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/08/27 02:28:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25206) data issue when - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/08/27 02:49:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25206) data issue when Hive metastore schema and parquet schema have different letter case - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/08/27 02:51:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25206) data issue when Hive metastore schema and parquet schema are in different letter cases - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/08/27 02:53:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-25206) wrong records are returned when Hive metastore schema and parquet schema are in different letter cases - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/08/27 03:00:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-25175) Case-insensitive field resolution when reading from ORC - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/08/27 03:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25247) Make RDDBarrier configurable - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/08/27 03:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25248) Audit barrier APIs for Spark 2.4 - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/08/27 04:20:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25248) Audit barrier APIs for Spark 2.4 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/27 04:24:00 UTC, 1 replies.
- [jira] [Reopened] (SPARK-25175) Case-insensitive field resolution when reading from ORC - posted by "Chenxiao Mao (JIRA)" <ji...@apache.org> on 2018/08/27 05:24:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25175) Case-insensitive field resolution when reading from ORC - posted by "Chenxiao Mao (JIRA)" <ji...@apache.org> on 2018/08/27 06:46:00 UTC, 8 replies.
- [jira] [Updated] (SPARK-25175) Case-insensitive field resolution when reading from ORC - posted by "Chenxiao Mao (JIRA)" <ji...@apache.org> on 2018/08/27 07:09:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25249) Add a unit test for OpenHashMap - posted by "liuxian (JIRA)" <ji...@apache.org> on 2018/08/27 07:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25249) Add a unit test for OpenHashMap - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/27 07:36:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25249) Add a unit test for OpenHashMap - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/27 07:36:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24978) Add spark.sql.fast.hash.aggregate.row.max.capacity to configure the capacity of fast aggregation. - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/27 07:48:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24978) Add spark.sql.fast.hash.aggregate.row.max.capacity to configure the capacity of fast aggregation. - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/27 07:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25226) Extend functionality of from_json to support arrays of differently-typed elements - posted by "Yuriy Davygora (JIRA)" <ji...@apache.org> on 2018/08/27 07:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25227) Extend functionality of to_json to support arrays of differently-typed elements - posted by "Yuriy Davygora (JIRA)" <ji...@apache.org> on 2018/08/27 08:00:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25225) Add support for "List"-Type columns - posted by "Yuriy Davygora (JIRA)" <ji...@apache.org> on 2018/08/27 08:02:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25226) Extend functionality of from_json to support arrays of differently-typed elements - posted by "Yuriy Davygora (JIRA)" <ji...@apache.org> on 2018/08/27 08:08:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-25227) Extend functionality of to_json to support arrays of differently-typed elements - posted by "Yuriy Davygora (JIRA)" <ji...@apache.org> on 2018/08/27 08:13:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24009) spark2.3.0 INSERT OVERWRITE LOCAL DIRECTORY '/home/spark/aaaaab' - posted by "Bang Xiao (JIRA)" <ji...@apache.org> on 2018/08/27 10:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25250) Race condition with tasks running when new attempt for same stage is created leads to other task in the next attempt running on the same partition id retry multiple times - posted by "Parth Gandhi (JIRA)" <ji...@apache.org> on 2018/08/27 15:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25226) Extend functionality of from_json to support arrays of differently-typed elements - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/27 15:24:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25227) Extend functionality of to_json to support arrays of differently-typed elements - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/27 15:25:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25206) wrong records are returned when Hive metastore schema and parquet schema are in different letter cases - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/27 15:39:01 UTC, 7 replies.
- [jira] [Updated] (SPARK-25091) UNCACHE TABLE, CLEAR CACHE, rdd.unpersist() does not clean up executor memory - posted by "Yunling Cai (JIRA)" <ji...@apache.org> on 2018/08/27 16:35:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25091) UNCACHE TABLE, CLEAR CACHE, rdd.unpersist() does not clean up executor memory - posted by "Yunling Cai (JIRA)" <ji...@apache.org> on 2018/08/27 16:42:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25251) Make spark-csv's `quote` and `escape` options conform to RFC 4180 - posted by "Ruslan Dautkhanov (JIRA)" <ji...@apache.org> on 2018/08/27 16:45:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25249) Add a unit test for OpenHashMap - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/27 17:06:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25249) Add a unit test for OpenHashMap - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/27 17:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25252) Support arrays of any types in to_json - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/08/27 17:35:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25252) Support arrays of any types in to_json - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/27 17:36:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25252) Support arrays of any types in to_json - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/27 17:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25253) Refactor pyspark connection & authentication - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/08/27 17:39:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25235) Merge the REPL code in Scala 2.11 and 2.12 branches - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/27 17:58:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25235) Merge the REPL code in Scala 2.11 and 2.12 branches - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/27 17:58:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25250) Race condition with tasks running when new attempt for same stage is created leads to other task in the next attempt running on the same partition id retry multiple times - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/08/27 18:03:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25253) Refactor pyspark connection & authentication - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/27 18:19:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25253) Refactor pyspark connection & authentication - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/27 18:19:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25254) docker-image-tool should allow not building images for R and Python - posted by "Chaoran Yu (JIRA)" <ji...@apache.org> on 2018/08/27 19:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25255) Add getActiveSession to SparkSession in PySpark - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/08/27 19:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25255) Add getActiveSession to SparkSession in PySpark - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/08/27 19:15:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-16281) Implement parse_url SQL function - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/27 20:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25256) Plan mismatch errors in Hive tests in 2.12 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/27 20:55:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24090) Kubernetes Backend Hotlist for Spark 2.4 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/27 20:56:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25257) java.lang.ClassCastException: org.apache.spark.sql.execution.streaming.SerializedOffset cannot be cast to org.apache.spark.sql.sources.v2.reader.streaming.Offset - posted by "Seth Fitzsimmons (JIRA)" <ji...@apache.org> on 2018/08/27 21:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data - posted by "Erik Erlandson (JIRA)" <ji...@apache.org> on 2018/08/27 21:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25250) Race condition with tasks running when new attempt for same stage is created leads to other task in the next attempt running on the same partition id retry multiple times - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/08/27 22:08:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25257) java.lang.ClassCastException: org.apache.spark.sql.execution.streaming.SerializedOffset cannot be cast to org.apache.spark.sql.sources.v2.reader.streaming.Offset - posted by "Seth Fitzsimmons (JIRA)" <ji...@apache.org> on 2018/08/27 22:24:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25257) v2 MicroBatchReaders can't resume from checkpoints - posted by "Seth Fitzsimmons (JIRA)" <ji...@apache.org> on 2018/08/27 22:30:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25257) v2 MicroBatchReaders can't resume from checkpoints - posted by "Seth Fitzsimmons (JIRA)" <ji...@apache.org> on 2018/08/27 22:32:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25258) Upgrade kryo package to version 4.0.2+ - posted by "liupengcheng (JIRA)" <ji...@apache.org> on 2018/08/28 01:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24721) Failed to use PythonUDF with literal inputs in filter with data sources - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/28 02:59:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24721) Failed to use PythonUDF with literal inputs in filter with data sources - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/28 02:59:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25213) DataSourceV2 doesn't seem to produce unsafe rows - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/28 03:00:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24391) from_json should support arrays of primitives, and more generally all JSON - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/28 03:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24391) from_json should support arrays of primitives, and more generally all JSON - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/28 03:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23255) Add user guide and examples for DataFrame image reading functions - posted by "Divay Jindal (JIRA)" <ji...@apache.org> on 2018/08/28 04:02:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-21232) New built-in SQL function - Data_Type - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/28 04:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25251) Make spark-csv's `quote` and `escape` options conform to RFC 4180 - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/28 04:59:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25251) Make spark-csv's `quote` and `escape` options conform to RFC 4180 - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/28 04:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25256) Plan mismatch errors in Hive tests in 2.12 - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/28 05:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-4502) Spark SQL reads unneccesary nested fields from Parquet - posted by "Damian Momot (JIRA)" <ji...@apache.org> on 2018/08/28 05:46:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25258) Upgrade kryo package to version 4.0.2+ - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/28 05:56:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25259) Left/Right join support push down during-join predicates - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/28 06:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25259) Left/Right join support push down during-join predicates - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/28 06:11:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25259) Left/Right join support push down during-join predicates - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/28 06:46:00 UTC, 1 replies.
- [jira] [Issue Comment Deleted] (SPARK-25259) Left/Right join support push down during-join predicates - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/28 07:17:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-25226) Extend functionality of from_json to support arrays of differently-typed elements - posted by "Yuriy Davygora (JIRA)" <ji...@apache.org> on 2018/08/28 07:21:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-20977) NPE in CollectionAccumulator - posted by "howie yu (JIRA)" <ji...@apache.org> on 2018/08/28 07:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25260) Fix namespace handling in SchemaConverters.toAvroType - posted by "Arun Mahadevan (JIRA)" <ji...@apache.org> on 2018/08/28 08:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25260) Fix namespace handling in SchemaConverters.toAvroType - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/28 08:06:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25260) Fix namespace handling in SchemaConverters.toAvroType - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/28 08:06:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25261) Update configuration.md, correct the default units of spark.driver|executor.memory - posted by "huangtengfei (JIRA)" <ji...@apache.org> on 2018/08/28 08:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25261) Update configuration.md, correct the default units of spark.driver|executor.memory - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/28 08:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25261) Update configuration.md, correct the default units of spark.driver|executor.memory - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/28 08:48:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-25102) Write Spark version information to Parquet file footers - posted by "Nikita Poberezkin (JIRA)" <ji...@apache.org> on 2018/08/28 10:44:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24411) Adding native Java tests for `isInCollection` - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/28 11:36:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25102) Write Spark version information to Parquet file footers - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/28 12:40:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25262) Make Spark local dir volumes configurable with Spark on Kubernetes - posted by "Rob Vesse (JIRA)" <ji...@apache.org> on 2018/08/28 13:13:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25091) UNCACHE TABLE, CLEAR CACHE, rdd.unpersist() does not clean up executor memory - posted by "Chao Fang (JIRA)" <ji...@apache.org> on 2018/08/28 13:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25263) Add scheduler integration test for SPARK-24909 - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/08/28 13:48:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23663) Spark Streaming Kafka 010 , fails with "java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access" - posted by "Peter Simon (JIRA)" <ji...@apache.org> on 2018/08/28 14:22:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-23622) Flaky Test: HiveClientSuites - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/08/28 14:44:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25218) Potential resource leaks in TransportServer and SocketAuthHelper - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/08/28 15:37:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25005) Structured streaming doesn't support kafka transaction (creating empty offset with abort & markers) - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/08/28 15:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25262) Make Spark local dir volumes configurable with Spark on Kubernetes - posted by "Rob Vesse (JIRA)" <ji...@apache.org> on 2018/08/28 15:47:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25175) Field resolution should fail if there is ambiguity in case-insensitive mode when reading from ORC - posted by "Chenxiao Mao (JIRA)" <ji...@apache.org> on 2018/08/28 16:16:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25175) Field resolution should fail if there is ambiguity in case-insensitive mode when reading from ORC - posted by "Chenxiao Mao (JIRA)" <ji...@apache.org> on 2018/08/28 16:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25175) Field resolution should fail if there is ambiguity for ORC data source native implementation - posted by "Chenxiao Mao (JIRA)" <ji...@apache.org> on 2018/08/28 16:26:01 UTC, 0 replies.
- [jira] [Commented] (SPARK-25175) Field resolution should fail if there is ambiguity for ORC data source native implementation - posted by "Chenxiao Mao (JIRA)" <ji...@apache.org> on 2018/08/28 16:30:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25262) Make Spark local dir volumes configurable with Spark on Kubernetes - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/28 16:37:01 UTC, 1 replies.
- [jira] [Created] (SPARK-25264) Fix comma-delineated arguments passed into PythonRunner and RRunner - posted by "Ilan Filonenko (JIRA)" <ji...@apache.org> on 2018/08/28 16:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25264) Fix comma-delineated arguments passed into PythonRunner and RRunner - posted by "Ilan Filonenko (JIRA)" <ji...@apache.org> on 2018/08/28 16:58:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25206) wrong records are returned when Hive metastore schema and parquet schema are in different letter cases - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/08/28 17:06:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25264) Fix comma-delineated arguments passed into PythonRunner and RRunner - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/28 17:09:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25264) Fix comma-delineated arguments passed into PythonRunner and RRunner - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/28 17:09:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23997) Configurable max number of buckets - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/28 17:33:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23679) uiWebUrl show inproper URL when running on YARN - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/08/28 17:35:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25119) stages in wrong order within job page DAG chart - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/08/28 17:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25265) Fix memory leak vulnerability in Barrier Execution Mode - posted by "Kousuke Saruta (JIRA)" <ji...@apache.org> on 2018/08/28 17:45:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25266) Fix memory leak vulnerability in Barrier Execution Mode - posted by "Kousuke Saruta (JIRA)" <ji...@apache.org> on 2018/08/28 17:45:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24704) The order of stages in the DAG graph is incorrect - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/08/28 17:48:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25266) Fix memory leak vulnerability in Barrier Execution Mode - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/28 17:51:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25266) Fix memory leak vulnerability in Barrier Execution Mode - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/28 17:51:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25267) Disable ConvertToLocalRelation in the test cases of sql/core and sql/hive - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/28 18:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25267) Disable ConvertToLocalRelation in the test cases of sql/core and sql/hive - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/28 18:13:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-25240) A deadlock in ALTER TABLE RECOVER PARTITIONS - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/28 18:30:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25004) Add spark.executor.pyspark.memory config to set resource.RLIMIT_AS - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/08/28 19:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-20799) Unable to infer schema for ORC/Parquet on S3N when secrets are in the URL - posted by "Steve Loughran (JIRA)" <ji...@apache.org> on 2018/08/28 21:39:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25212) Support Filter in ConvertToLocalRelation - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/28 22:52:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-22357) SparkContext.binaryFiles ignore minPartitions parameter - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/29 00:40:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-22357) SparkContext.binaryFiles ignore minPartitions parameter - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/29 00:40:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25260) Fix namespace handling in SchemaConverters.toAvroType - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/29 01:27:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25266) Fix memory leak in Barrier Execution Mode - posted by "Kousuke Saruta (JIRA)" <ji...@apache.org> on 2018/08/29 01:33:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25253) Refactor pyspark connection & authentication - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/29 01:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-19490) Hive partition columns are case-sensitive - posted by "Harish (JIRA)" <ji...@apache.org> on 2018/08/29 02:19:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-19490) Hive partition columns are case-sensitive - posted by "Harish (JIRA)" <ji...@apache.org> on 2018/08/29 02:20:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25112) Spark history cleaner does not work. - posted by "Gu Chao (JIRA)" <ji...@apache.org> on 2018/08/29 02:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25235) Merge the REPL code in Scala 2.11 and 2.12 branches - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/08/29 04:32:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25268) runParallelPersonalizedPageRank throws serialization Exception - posted by "Bago Amirbekian (JIRA)" <ji...@apache.org> on 2018/08/29 04:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25269) SQL interface support specify StorageLevel when cache table - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/29 06:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25269) SQL interface support specify StorageLevel when cache table - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/29 06:02:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25175) Field resolution should fail if there's ambiguity for ORC native reader - posted by "Chenxiao Mao (JIRA)" <ji...@apache.org> on 2018/08/29 06:29:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25175) Field resolution should fail if there's ambiguity for ORC native reader - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/29 06:47:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25175) Field resolution should fail if there's ambiguity for ORC native reader - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/29 06:47:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25269) SQL interface support specify StorageLevel when cache table - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/29 06:51:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-23030) Decrease memory consumption with toPandas() collection using Arrow - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/29 07:02:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23030) Decrease memory consumption with toPandas() collection using Arrow - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/29 07:03:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25044) Address translation of LMF closure primitive args to Object in Scala 2.12 - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/29 07:25:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25259) Left/Right join support push down during-join predicates - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/29 07:46:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25256) Plan mismatch errors in Hive tests in 2.12 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/29 08:22:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25256) Plan mismatch errors in Hive tests in 2.12 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/29 08:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24716) Refactor ParquetFilters - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/29 10:26:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25265) Fix memory leak vulnerability in Barrier Execution Mode - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/08/29 11:35:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25270) lint-python: Add flake8 to find syntax errors and undefined names - posted by "cclauss (JIRA)" <ji...@apache.org> on 2018/08/29 11:59:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25270) lint-python: Add flake8 to find syntax errors and undefined names - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/29 12:00:05 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25270) lint-python: Add flake8 to find syntax errors and undefined names - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/29 12:01:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25217) Error thrown when creating BlockMatrix - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/08/29 12:12:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25271) Creating parquet table with all the column null throws exception - posted by "shivusondur (JIRA)" <ji...@apache.org> on 2018/08/29 13:09:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25271) Creating parquet table with all the column null throws exception - posted by "shivusondur (JIRA)" <ji...@apache.org> on 2018/08/29 13:11:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-23298) distinct.count on Dataset/DataFrame yields non-deterministic results - posted by "Janne Jaanila (JIRA)" <ji...@apache.org> on 2018/08/29 13:27:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25266) Fix memory leak in Barrier Execution Mode - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/08/29 14:14:00 UTC, 0 replies.
- [jira] [Issue Comment Deleted] (SPARK-25269) SQL interface support specify StorageLevel when cache table - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/29 14:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23997) Configurable max number of buckets - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/29 15:56:00 UTC, 0 replies.
- [jira] [Issue Comment Deleted] (SPARK-25246) When the spark.eventLog.compress is enabled, the Application is not showing in the History server UI ('incomplete application' page), initially. - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/08/29 16:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25267) Disable ConvertToLocalRelation in the test cases of sql/core and sql/hive - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/29 18:12:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25268) runParallelPersonalizedPageRank throws serialization Exception - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/29 18:17:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25268) runParallelPersonalizedPageRank throws serialization Exception - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/29 18:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25272) Show some kind of test output to indicate pyarrow tests were run - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/08/29 20:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25272) Show some kind of test output to indicate pyarrow tests were run - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/08/29 20:21:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25272) Show some kind of test output to indicate pyarrow tests were run - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/08/29 20:45:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25273) How to install testthat = 1.0.2 - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/08/29 20:47:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25273) How to install testthat = 1.0.2 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/29 20:52:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25273) How to install testthat = 1.0.2 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/29 20:52:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25272) Show some kind of test output to indicate pyarrow tests were run - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/29 20:53:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25273) How to install testthat v1.0.2 - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/08/29 21:00:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24005) Remove usage of Scala’s parallel collection - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/29 21:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25274) Improve `toPandas` with Arrow by sending out-of-order record batches - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/08/29 21:06:00 UTC, 0 replies.
- [jira] [Issue Comment Deleted] (SPARK-25272) Show some kind of test output to indicate pyarrow tests were run - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/08/29 21:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25274) Improve `toPandas` with Arrow by sending out-of-order record batches - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/08/29 21:09:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25274) Improve `toPandas` with Arrow by sending out-of-order record batches - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/29 21:59:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25274) Improve toPandas with Arrow by sending out-of-order record batches - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/08/29 22:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25242) Suggestion to make sql config setting fluent - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/29 23:24:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25242) Suggestion to make sql config setting fluent - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/29 23:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24909) Spark scheduler can hang when fetch failures, executor lost, task running on lost executor, and multiple stage attempts - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/08/29 23:33:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25271) Creating parquet table with all the column null throws exception - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/08/30 00:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25275) require memberhip in wheel to run 'su' (in dockerfiles) - posted by "Erik Erlandson (JIRA)" <ji...@apache.org> on 2018/08/30 02:28:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24785) Making sure REPL prints Spark UI info and then Welcome message - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/08/30 02:37:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25276) Redundant constrains when using alias - posted by "Ajith S (JIRA)" <ji...@apache.org> on 2018/08/30 03:35:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25276) Redundant constrains when using alias - posted by "Ajith S (JIRA)" <ji...@apache.org> on 2018/08/30 03:35:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25276) Redundant constrains when using alias - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 03:46:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25276) Redundant constrains when using alias - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 03:46:00 UTC, 0 replies.
- [jira] [Issue Comment Deleted] (SPARK-25271) Creating parquet table with all the column null throws exception - posted by "shivusondur (JIRA)" <ji...@apache.org> on 2018/08/30 06:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25277) YARN applicationMaster metrics should not register static and JVM metrics - posted by "Luca Canali (JIRA)" <ji...@apache.org> on 2018/08/30 07:21:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25277) YARN applicationMaster metrics should not register static and JVM metrics - posted by "Luca Canali (JIRA)" <ji...@apache.org> on 2018/08/30 07:23:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25277) YARN applicationMaster metrics should not register static and JVM metrics - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 07:29:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25278) Number of output rows metric of union of views is multiplied by their occurrences - posted by "Jacek Laskowski (JIRA)" <ji...@apache.org> on 2018/08/30 07:33:00 UTC, 4 replies.
- [jira] [Created] (SPARK-25278) Number of output rows metric of union of views is multiplied by their occurrences - posted by "Jacek Laskowski (JIRA)" <ji...@apache.org> on 2018/08/30 07:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25279) Throw exception: zzcclp java.io.NotSerializableException: org.apache.spark.sql.TypedColumn in Spark-shell when run example of doc - posted by "Zhichao Zhang (JIRA)" <ji...@apache.org> on 2018/08/30 07:37:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-17742) Spark Launcher does not get failed state in Listener - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 07:46:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25280) Add support for USING syntax for DataSourceV2 - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/30 08:42:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25280) Add support for USING syntax for DataSourceV2 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 08:51:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-25280) Add support for USING syntax for DataSourceV2 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 08:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25281) Add tests to check the behavior when the physical schema and logical schema use difference cases - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/08/30 09:04:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25281) Add tests to check the behavior when the physical schema and logical schema use difference cases - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/08/30 09:09:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25282) Fix support for spark-shell with K8s - posted by "Prashant Sharma (JIRA)" <ji...@apache.org> on 2018/08/30 09:55:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25273) How to install testthat v1.0.2 - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/30 12:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25273) How to install testthat v1.0.2 - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/30 12:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25283) A deadlock in UnionRDD - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/08/30 12:27:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-23539) Add support for Kafka headers in Structured Streaming - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 12:30:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-23539) Add support for Kafka headers in Structured Streaming - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 12:30:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25283) A deadlock in UnionRDD - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 12:36:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25283) A deadlock in UnionRDD - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 12:36:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25261) Standardize the default units of spark.driver|executor.memory - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/30 13:51:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25278) Number of output rows metric of union of views is multiplied by their occurrences - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 14:39:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25278) Number of output rows metric of union of views is multiplied by their occurrences - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 14:39:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25275) require memberhip in wheel to run 'su' (in dockerfiles) - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 15:20:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25275) require memberhip in wheel to run 'su' (in dockerfiles) - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 15:20:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25284) Spark UI: make sure skipped stages are updated onJobEnd - posted by "Juliusz Sompolski (JIRA)" <ji...@apache.org> on 2018/08/30 16:40:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25284) Spark UI: make sure skipped stages are updated onJobEnd - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 16:45:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25284) Spark UI: make sure skipped stages are updated onJobEnd - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 16:45:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-22148) TaskSetManager.abortIfCompletelyBlacklisted should not abort when all current executors are blacklisted but dynamic allocation is enabled - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 18:25:01 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25233) Give the user the option of specifying a fixed minimum message per partition per batch when using kafka direct API with backpressure - posted by "Cody Koeninger (JIRA)" <ji...@apache.org> on 2018/08/30 18:28:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23435) R tests should support latest testthat - posted by "Parker Hegstrom (JIRA)" <ji...@apache.org> on 2018/08/30 18:52:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25200) Allow setting HADOOP_CONF_DIR as a spark property - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 19:16:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25285) Add executor task metrics to track the number of tasks started and of tasks successfully completed - posted by "Luca Canali (JIRA)" <ji...@apache.org> on 2018/08/30 19:45:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25285) Add executor task metrics to track the number of tasks started and of tasks successfully completed - posted by "Luca Canali (JIRA)" <ji...@apache.org> on 2018/08/30 19:47:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25285) Add executor task metrics to track the number of tasks started and of tasks successfully completed - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 19:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25285) Add executor task metrics to track the number of tasks started and of tasks successfully completed - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 19:48:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25007) Add shuffle / array_except /array_union / array_shuffle to SparkR - posted by "Huaxin Gao (JIRA)" <ji...@apache.org> on 2018/08/30 20:26:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25007) Add array_intersect / array_except /array_union / array_shuffle to SparkR - posted by "Huaxin Gao (JIRA)" <ji...@apache.org> on 2018/08/30 20:30:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25007) Add array_intersect / array_except /array_union / array_shuffle to SparkR - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 20:38:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25007) Add array_intersect / array_except /array_union / array_shuffle to SparkR - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 20:38:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24411) Adding native Java tests for `isInCollection` - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/08/30 20:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25286) Remove dangerous parmap - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/08/30 20:56:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25286) Remove dangerous parmap - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 21:03:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25286) Remove dangerous parmap - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 21:03:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25275) require memberhip in wheel to run 'su' (in dockerfiles) - posted by "Erik Erlandson (JIRA)" <ji...@apache.org> on 2018/08/30 21:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25287) Check for JIRA_USERNAME and JIRA_PASSWORD up front in merge_spark_pr.py - posted by "Erik Erlandson (JIRA)" <ji...@apache.org> on 2018/08/30 21:25:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25288) Kafka transaction tests are flaky - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/08/30 21:44:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25288) Kafka transaction tests are flaky - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/08/30 21:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25288) Kafka transaction tests are flaky - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 21:49:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25288) Kafka transaction tests are flaky - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 21:49:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25287) Check for JIRA_USERNAME and JIRA_PASSWORD up front in merge_spark_pr.py - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 21:57:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25287) Check for JIRA_USERNAME and JIRA_PASSWORD up front in merge_spark_pr.py - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/30 21:57:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25287) Check for JIRA_USERNAME and JIRA_PASSWORD up front in merge_spark_pr.py - posted by "Erik Erlandson (JIRA)" <ji...@apache.org> on 2018/08/30 22:10:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25255) Add getActiveSession to SparkSession in PySpark - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/31 00:55:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25255) Add getActiveSession to SparkSession in PySpark - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/31 00:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25286) Remove dangerous parmap - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/31 02:02:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24748) Support for reporting custom metrics via Streaming Query Progress - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/31 02:35:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25289) ChiSqSelector max on empty collection - posted by "Marie Beaulieu (JIRA)" <ji...@apache.org> on 2018/08/31 02:58:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25290) BytesToBytesMapOnHeapSuite randomizedStressTest can cause OutOfMemoryError - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/08/31 02:59:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25290) BytesToBytesMapOnHeapSuite randomizedStressTest can cause OutOfMemoryError - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/31 03:09:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25290) BytesToBytesMapOnHeapSuite randomizedStressTest can cause OutOfMemoryError - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/31 03:09:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25256) Plan mismatch errors in Hive tests in 2.12 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/08/31 03:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-19809) NullPointerException on zero-size ORC file - posted by "Shirish Tatikonda (JIRA)" <ji...@apache.org> on 2018/08/31 04:14:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25291) Flakiness of tests in terms of executor memory (SecretsTestSuite) - posted by "Ilan Filonenko (JIRA)" <ji...@apache.org> on 2018/08/31 04:32:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25291) Flakiness of tests in terms of executor memory (SecretsTestSuite) - posted by "Ilan Filonenko (JIRA)" <ji...@apache.org> on 2018/08/31 04:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25282) Fix support for spark-shell with K8s - posted by "Prashant Sharma (JIRA)" <ji...@apache.org> on 2018/08/31 04:37:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25206) wrong records are returned when Hive metastore schema and parquet schema are in different letter cases - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/08/31 04:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25292) Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir - posted by "omkar puttagunta (JIRA)" <ji...@apache.org> on 2018/08/31 04:45:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25293) Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir - posted by "omkar puttagunta (JIRA)" <ji...@apache.org> on 2018/08/31 04:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25021) Add spark.executor.pyspark.memory support to Kubernetes - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/31 04:48:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25021) Add spark.executor.pyspark.memory support to Kubernetes - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/31 04:48:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25293) Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir - posted by "omkar puttagunta (JIRA)" <ji...@apache.org> on 2018/08/31 04:50:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-23789) Shouldn't set hive.metastore.uris before invoking HiveDelegationTokenProvider - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/31 05:37:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-23789) Shouldn't set hive.metastore.uris before invoking HiveDelegationTokenProvider - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/31 05:39:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23789) Shouldn't set hive.metastore.uris before invoking HiveDelegationTokenProvider - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/31 05:39:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25292) Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/31 05:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25293) Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/08/31 05:51:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25294) Add integration test for Kerberos - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/31 06:03:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25294) Add integration test for Kerberos - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/08/31 06:05:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25295) Pod names conflicts in client mode, if previous submission was not a clean shutdown. - posted by "Prashant Sharma (JIRA)" <ji...@apache.org> on 2018/08/31 06:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25295) Pod names conflicts in client mode, if previous submission was not a clean shutdown. - posted by "Prashant Sharma (JIRA)" <ji...@apache.org> on 2018/08/31 06:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24433) Add Spark R support - posted by "Felix Cheung (JIRA)" <ji...@apache.org> on 2018/08/31 06:23:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25288) Kafka transaction tests are flaky - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/08/31 06:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25183) Spark HiveServer2 registers shutdown hook with JVM, not ShutdownHookManager; race conditions can arise - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/08/31 06:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25296) Create ExplainSuite - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/31 07:03:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25296) Create ExplainSuite - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/31 07:09:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25296) Create ExplainSuite - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/31 07:09:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-21786) The 'spark.sql.parquet.compression.codec' configuration doesn't take effect on tables with partition field(s) - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/31 08:42:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-18818) Window...orderBy() should accept an 'ascending' parameter just like DataFrame.orderBy() - posted by "Anna Molchanova (JIRA)" <ji...@apache.org> on 2018/08/31 08:43:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25289) ChiSqSelector max on empty collection - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/31 10:58:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25289) ChiSqSelector max on empty collection - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/31 10:58:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25284) Spark UI: make sure skipped stages are updated onJobEnd - posted by "Juliusz Sompolski (JIRA)" <ji...@apache.org> on 2018/08/31 11:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25207) Case-insensitve field resolution for filter pushdown when reading Parquet - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/08/31 11:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25297) Future for Scala 2.12 will block on a already shutdown ExecutionContext - posted by "Darcy Shen (JIRA)" <ji...@apache.org> on 2018/08/31 11:57:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25297) Future for Scala 2.12 will block on a already shutdown ExecutionContext - posted by "Darcy Shen (JIRA)" <ji...@apache.org> on 2018/08/31 12:02:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25297) Future for Scala 2.12 will block on a already shutdown ExecutionContext - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/31 12:20:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25297) Future for Scala 2.12 will block on a already shutdown ExecutionContext - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/31 12:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25298) spark-tools build failure for Scala 2.12 - posted by "Darcy Shen (JIRA)" <ji...@apache.org> on 2018/08/31 12:42:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24561) User-defined window functions with pandas udf (bounded window) - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/08/31 15:25:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25296) Create ExplainSuite - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/31 16:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25279) Throw exception: zzcclp java.io.NotSerializableException: org.apache.spark.sql.TypedColumn in Spark-shell when run example of doc - posted by "Dilip Biswal (JIRA)" <ji...@apache.org> on 2018/08/31 17:25:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25286) Remove dangerous parmap - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/08/31 17:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25257) v2 MicroBatchReaders can't resume from checkpoints - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/08/31 21:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25283) A deadlock in UnionRDD - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/08/31 21:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23781) Merge YARN and Mesos token renewal code - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/08/31 21:40:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25295) Pod names conflicts in client mode, if previous submission was not a clean shutdown. - posted by "Yinan Li (JIRA)" <ji...@apache.org> on 2018/08/31 21:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25282) Fix support for spark-shell with K8s - posted by "Yinan Li (JIRA)" <ji...@apache.org> on 2018/08/31 21:59:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25264) Fix comma-delineated arguments passed into PythonRunner and RRunner - posted by "Matt Cheah (JIRA)" <ji...@apache.org> on 2018/08/31 22:49:00 UTC, 0 replies.