issues@spark.apache.org, 2018-09

You are viewing a plain text version of this content. The canonical link for it is here.

- [jira] [Created] (SPARK-25299) Use distributed storage for persisting shuffle data - posted by "Matt Cheah (JIRA)" <ji...@apache.org> on 2018/09/01 00:26:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25299) Use distributed storage for persisting shuffle data - posted by "Matt Cheah (JIRA)" <ji...@apache.org> on 2018/09/01 00:28:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25299) Use distributed storage for persisting shuffle data - posted by "Matt Cheah (JIRA)" <ji...@apache.org> on 2018/09/01 00:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25300) Unified the configuration parameter `spark.shuffle.service.enabled` - posted by "liuxian (JIRA)" <ji...@apache.org> on 2018/09/01 03:09:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25300) Unified the configuration parameter `spark.shuffle.service.enabled` - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/01 03:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25300) Unified the configuration parameter `spark.shuffle.service.enabled` - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/01 03:19:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-23466) Remove redundant null checks in generated Java code by GenerateUnsafeProjection - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/09/01 03:22:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25301) When a view uses an UDF from a non default database, Spark analyser throws AnalysisException - posted by "Vinod KC (JIRA)" <ji...@apache.org> on 2018/09/01 05:13:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25301) When a view uses an UDF from a non default database, Spark analyser throws AnalysisException - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/01 05:34:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25301) When a view uses an UDF from a non default database, Spark analyser throws AnalysisException - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/01 05:34:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23253) Only write shuffle temporary index file when there is not an existing one - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/01 06:22:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-23253) Only write shuffle temporary index file when there is not an existing one - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/01 07:06:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25302) ReducedWindowedDStream not using checkpoints for reduced RDDs - posted by "Nikunj Bansal (JIRA)" <ji...@apache.org> on 2018/09/01 08:01:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25303) A DStream that is checkpointed should allow its parent(s) to be removed and not persisted - posted by "Nikunj Bansal (JIRA)" <ji...@apache.org> on 2018/09/01 08:06:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25302) ReducedWindowedDStream not using checkpoints for reduced RDDs - posted by "Nikunj Bansal (JIRA)" <ji...@apache.org> on 2018/09/01 08:08:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-25303) A DStream that is checkpointed should allow its parent(s) to be removed and not persisted - posted by "Nikunj Bansal (JIRA)" <ji...@apache.org> on 2018/09/01 08:12:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-25290) BytesToBytesMapOnHeapSuite randomizedStressTest can cause OutOfMemoryError - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/01 08:30:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25290) BytesToBytesMapOnHeapSuite randomizedStressTest can cause OutOfMemoryError - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/01 08:30:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25279) Throw exception: zzcclp java.io.NotSerializableException: org.apache.spark.sql.TypedColumn in Spark-shell when run example of doc - posted by "Zhichao Zhang (JIRA)" <ji...@apache.org> on 2018/09/01 08:39:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-25297) Future for Scala 2.12 will block on a already shutdown ExecutionContext - posted by "Darcy Shen (JIRA)" <ji...@apache.org> on 2018/09/01 08:50:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24615) Accelerator-aware task scheduling for Spark - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/09/01 12:33:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25289) ChiSqSelector max on empty collection - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/01 13:43:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25289) ChiSqSelector max on empty collection - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/01 13:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25304) enable HiveSparkSubmitSuite SPARK-8489 test for Scala 2.12 - posted by "Darcy Shen (JIRA)" <ji...@apache.org> on 2018/09/01 14:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25304) enable HiveSparkSubmitSuite SPARK-8489 test for Scala 2.12 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/01 14:11:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25304) enable HiveSparkSubmitSuite SPARK-8489 test for Scala 2.12 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/01 14:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-8489) Add regression tests for SPARK-8470 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/01 14:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25298) spark-tools build failure for Scala 2.12 - posted by "Darcy Shen (JIRA)" <ji...@apache.org> on 2018/09/01 14:46:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-20384) supporting value classes over primitives in DataSets - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/01 15:49:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-20384) supporting value classes over primitives in DataSets - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/01 15:49:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25298) spark-tools build failure for Scala 2.12 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/01 15:53:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25305) Respect attribute name in `CollapseProject` - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/09/01 16:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25305) Respect attribute name in `CollapseProject` - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/01 16:32:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25305) Respect attribute name in `CollapseProject` - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/01 16:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25305) Respect attribute name in `CollapseProject` - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/09/01 16:44:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25305) Respect attribute name in `CollapseProject` and `ColumnPruning` - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/09/01 16:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24434) Support user-specified driver and executor pod templates - posted by "Matt Cheah (JIRA)" <ji...@apache.org> on 2018/09/01 18:07:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-17916) CSV data source treats empty string as null no matter what nullValue option is - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/01 19:44:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/09/01 20:09:00 UTC, 21 replies.
- [jira] [Created] (SPARK-25306) Use cache to speed up `createFilter` in ORC - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/01 22:22:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25306) Use cache to speed up `createFilter` in ORC - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/01 22:37:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25306) Use cache to speed up `createFilter` in ORC - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/01 22:37:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25306) Use cache to speed up `createFilter` in ORC - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/01 22:42:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-10697) Lift Calculation in Association Rule mining - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/01 23:09:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-10697) Lift Calculation in Association Rule mining - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/01 23:09:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25307) ArraySort function may return a error in the code generation phase. - posted by "Dilip Biswal (JIRA)" <ji...@apache.org> on 2018/09/02 04:03:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25307) ArraySort function may return a error in the code generation phase. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/02 04:09:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25307) ArraySort function may return a error in the code generation phase. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/02 04:09:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25308) ArrayContains function may return a error in the code generation phase. - posted by "Dilip Biswal (JIRA)" <ji...@apache.org> on 2018/09/02 05:29:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25308) ArrayContains function may return a error in the code generation phase. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/02 05:49:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25308) ArrayContains function may return a error in the code generation phase. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/02 05:49:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25007) Add array_intersect / array_except /array_union / array_shuffle to SparkR - posted by "Felix Cheung (JIRA)" <ji...@apache.org> on 2018/09/02 07:07:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25007) Add array_intersect / array_except /array_union / array_shuffle to SparkR - posted by "Felix Cheung (JIRA)" <ji...@apache.org> on 2018/09/02 07:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25048) Pivoting by multiple columns in Scala/Java - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/02 13:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25309) Sci-kit Learn like Auto Pipeline Parallelization in Spark - posted by "Ravi (JIRA)" <ji...@apache.org> on 2018/09/02 15:02:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25310) ArraysOverlap throws an Exception - posted by "Kazuaki Ishizaki (JIRA)" <ji...@apache.org> on 2018/09/02 15:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25310) ArraysOverlap may throw a CompileException - posted by "Kazuaki Ishizaki (JIRA)" <ji...@apache.org> on 2018/09/02 15:54:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25310) ArraysOverlap may throw a CompileException - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/02 17:31:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25310) ArraysOverlap may throw a CompileException - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/02 17:31:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-20389) Upgrade kryo to fix NegativeArraySizeException - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/02 18:42:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25176) Kryo fails to serialize a parametrised type hierarchy - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/02 18:44:00 UTC, 2 replies.
- [jira] [Issue Comment Deleted] (SPARK-25176) Kryo fails to serialize a parametrised type hierarchy - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/02 18:48:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25265) Fix memory leak vulnerability in Barrier Execution Mode - posted by "Kousuke Saruta (JIRA)" <ji...@apache.org> on 2018/09/02 23:06:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25265) Fix memory leak in Barrier Execution Mode - posted by "Kousuke Saruta (JIRA)" <ji...@apache.org> on 2018/09/02 23:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25135) insert datasource table may all null when select from view on parquet - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/03 01:47:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/03 02:08:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/03 02:08:00 UTC, 11 replies.
- [jira] [Updated] (SPARK-25304) enable HiveSparkSubmitSuite SPARK-8489 test for Scala 2.12 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/03 02:58:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25304) enable HiveSparkSubmitSuite SPARK-8489 test for Scala 2.12 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/03 02:58:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25311) `SPARK_LOCAL_HOSTNAME` unsupport IPV6 when do host checking - posted by "Xiaochen Ouyang (JIRA)" <ji...@apache.org> on 2018/09/03 03:02:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25311) `SPARK_LOCAL_HOSTNAME` unsupport IPV6 when do host checking - posted by "Xiaochen Ouyang (JIRA)" <ji...@apache.org> on 2018/09/03 03:06:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-25301) When a view uses an UDF from a non default database, Spark analyser throws AnalysisException - posted by "Vinod KC (JIRA)" <ji...@apache.org> on 2018/09/03 05:03:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25044) Address translation of LMF closure primitive args to Object in Scala 2.12 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/03 05:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25312) Add description for the conf spark.network.crypto.keyFactoryIterations - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/03 05:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25312) Add description for the conf spark.network.crypto.keyFactoryIterations - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/03 05:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-22357) SparkContext.binaryFiles ignore minPartitions parameter - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/03 05:40:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25311) `SPARK_LOCAL_HOSTNAME` unsupport IPV6 when do host checking - posted by "Xiaochen Ouyang (JIRA)" <ji...@apache.org> on 2018/09/03 06:17:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25303) A DStream that is checkpointed should allow its parent(s) to be removed and not persisted - posted by "Nikunj Bansal (JIRA)" <ji...@apache.org> on 2018/09/03 06:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25313) Fix regression in FileFormatWriter output schema - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/09/03 07:13:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25313) Fix regression in FileFormatWriter output schema - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/09/03 07:13:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25312) Add description for the conf spark.network.crypto.keyFactoryIterations - posted by "Nikita Poberezkin (JIRA)" <ji...@apache.org> on 2018/09/03 07:20:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25313) Fix regression in FileFormatWriter output schema - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/03 07:20:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-25313) Fix regression in FileFormatWriter output schema - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/03 07:20:00 UTC, 14 replies.
- [jira] [Assigned] (SPARK-25312) Add description for the conf spark.network.crypto.keyFactoryIterations - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/03 08:02:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25262) Make Spark local dir volumes configurable with Spark on Kubernetes - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/03 09:10:00 UTC, 6 replies.
- [jira] [Created] (SPARK-25314) Invalid PythonUDF - requires attributes from more than one child - in "on" join condition - posted by "Sergey Bahchissaraitsev (JIRA)" <ji...@apache.org> on 2018/09/03 10:56:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-19728) PythonUDF with multiple parents shouldn't be pushed down when used as a predicate - posted by "Sergey Bahchissaraitsev (JIRA)" <ji...@apache.org> on 2018/09/03 10:57:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25298) spark-tools build failure for Scala 2.12 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/03 12:37:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25298) spark-tools build failure for Scala 2.12 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/03 12:37:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24767) Propagate MDC to spark-submit thread in InProcessAppHandle - posted by "Yifei Huang (JIRA)" <ji...@apache.org> on 2018/09/03 12:45:01 UTC, 0 replies.
- [jira] [Created] (SPARK-25315) setting "auto.offset.reset" to "earliest" has no effect in Structured Streaming with Spark 2.3.1 and Kafka 1.0 - posted by "Zhenhao Li (JIRA)" <ji...@apache.org> on 2018/09/03 13:51:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25279) Throw exception: zzcclp java.io.NotSerializableException: org.apache.spark.sql.TypedColumn in Spark-shell when run example of doc - posted by "Zhichao Zhang (JIRA)" <ji...@apache.org> on 2018/09/03 16:13:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25309) Sci-kit Learn like Auto Pipeline Parallelization in Spark - posted by "Ravi (JIRA)" <ji...@apache.org> on 2018/09/03 17:03:00 UTC, 1 replies.
- [jira] [Closed] (SPARK-21519) Add an option to the JDBC data source to initialize the environment of the remote database session - posted by "Luca Canali (JIRA)" <ji...@apache.org> on 2018/09/03 19:12:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-21829) Enable config to permanently blacklist a list of nodes - posted by "Luca Canali (JIRA)" <ji...@apache.org> on 2018/09/03 19:14:02 UTC, 0 replies.
- [jira] [Closed] (SPARK-22190) Add Spark executor task metrics to Dropwizard metrics - posted by "Luca Canali (JIRA)" <ji...@apache.org> on 2018/09/03 19:14:03 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25117) Add EXEPT ALL and INTERSECT ALL support in R. - posted by "Felix Cheung (JIRA)" <ji...@apache.org> on 2018/09/03 20:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25117) Add EXEPT ALL and INTERSECT ALL support in R. - posted by "Felix Cheung (JIRA)" <ji...@apache.org> on 2018/09/03 20:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25316) Spark error - ERROR ContextCleaner: Error cleaning broadcast 22, Exception thrown in awaitResult: - posted by "Vidya (JIRA)" <ji...@apache.org> on 2018/09/03 22:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25317) MemoryBlock performance regression - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/04 00:24:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25317) MemoryBlock performance regression - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/04 00:24:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25317) MemoryBlock performance regression - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/04 00:24:00 UTC, 9 replies.
- [jira] [Comment Edited] (SPARK-25317) MemoryBlock performance regression - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/04 00:25:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-20395) Update Scala to 2.11.11 and zinc to 0.3.15 - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/04 00:55:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-20395) Update Scala to 2.11.11 and zinc to 0.3.15 - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/04 00:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-20395) Update Scala to 2.11.11 and zinc to 0.3.15 - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/04 01:00:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-20395) Update Scala to 2.11.11 and zinc to 0.3.15 - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/04 01:00:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25293) Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/04 01:41:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25237) FileScanRdd's inputMetrics is wrong when select the datasource table with limit - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/04 02:08:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25318) Add exception handling when wrapping the input stream during the the fetch or stage retry in response to a corrupted block - posted by "Reza Safi (JIRA)" <ji...@apache.org> on 2018/09/04 03:06:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25318) Add exception handling when wrapping the input stream during the the fetch or stage retry in response to a corrupted block - posted by "Reza Safi (JIRA)" <ji...@apache.org> on 2018/09/04 03:07:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25318) Add exception handling when wrapping the input stream during the the fetch or stage retry in response to a corrupted block - posted by "Reza Safi (JIRA)" <ji...@apache.org> on 2018/09/04 03:11:01 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25318) Add exception handling when wrapping the input stream during the the fetch or stage retry in response to a corrupted block - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/04 03:16:01 UTC, 2 replies.
- [jira] [Created] (SPARK-25319) Spark MLlib, GraphX 2.4 QA umbrella - posted by "Weichen Xu (JIRA)" <ji...@apache.org> on 2018/09/04 03:46:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25321) CLONE - ML, Graph 2.3 QA: API: New Scala APIs, docs - posted by "Weichen Xu (JIRA)" <ji...@apache.org> on 2018/09/04 03:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25322) CLONE - ML, Graph 2.3 QA: API: Experimental, DeveloperApi, final, sealed audit - posted by "Weichen Xu (JIRA)" <ji...@apache.org> on 2018/09/04 03:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25320) ML, Graph 2.4 QA: API: Binary incompatible changes - posted by "Weichen Xu (JIRA)" <ji...@apache.org> on 2018/09/04 03:47:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25320) CLONE - ML, Graph 2.3 QA: API: Binary incompatible changes - posted by "Weichen Xu (JIRA)" <ji...@apache.org> on 2018/09/04 03:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25325) CLONE - ML, Graph 2.3 QA: Update user guide for new features & APIs - posted by "Weichen Xu (JIRA)" <ji...@apache.org> on 2018/09/04 03:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25324) CLONE - ML 2.3 QA: API: Java compatibility, docs - posted by "Weichen Xu (JIRA)" <ji...@apache.org> on 2018/09/04 03:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25323) CLONE - ML 2.3 QA: API: Python API coverage - posted by "Weichen Xu (JIRA)" <ji...@apache.org> on 2018/09/04 03:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25326) CLONE - ML, Graph 2.3 QA: Programming guide update and migration guide - posted by "Weichen Xu (JIRA)" <ji...@apache.org> on 2018/09/04 03:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25327) CLONE - Update MLlib, GraphX websites for 2.3 - posted by "Weichen Xu (JIRA)" <ji...@apache.org> on 2018/09/04 03:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25321) ML, Graph 2.4 QA: API: New Scala APIs, docs - posted by "Weichen Xu (JIRA)" <ji...@apache.org> on 2018/09/04 03:48:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25319) Spark MLlib, GraphX 2.4 QA umbrella - posted by "Weichen Xu (JIRA)" <ji...@apache.org> on 2018/09/04 03:48:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-25322) ML, Graph 2.4 QA: API: Experimental, DeveloperApi, final, sealed audit - posted by "Weichen Xu (JIRA)" <ji...@apache.org> on 2018/09/04 03:49:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25323) CLONE - ML 2.3 QA: API: Python API coverage - posted by "Weichen Xu (JIRA)" <ji...@apache.org> on 2018/09/04 03:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25323) ML 2.4 QA: API: Python API coverage - posted by "Weichen Xu (JIRA)" <ji...@apache.org> on 2018/09/04 03:51:01 UTC, 1 replies.
- [jira] [Updated] (SPARK-25325) ML, Graph 2.3 QA: Update user guide for new features & APIs - posted by "Weichen Xu (JIRA)" <ji...@apache.org> on 2018/09/04 03:52:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25324) ML 2.4 QA: API: Java compatibility, docs - posted by "Weichen Xu (JIRA)" <ji...@apache.org> on 2018/09/04 03:52:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25326) ML, Graph 2.4 QA: Programming guide update and migration guide - posted by "Weichen Xu (JIRA)" <ji...@apache.org> on 2018/09/04 03:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25325) ML, Graph 2.4 QA: Update user guide for new features & APIs - posted by "Weichen Xu (JIRA)" <ji...@apache.org> on 2018/09/04 03:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25327) Update MLlib, GraphX websites for 2.4 - posted by "Weichen Xu (JIRA)" <ji...@apache.org> on 2018/09/04 03:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25308) ArrayContains function may return a error in the code generation phase. - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/09/04 04:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25307) ArraySort function may return a error in the code generation phase. - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/09/04 04:41:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25310) ArraysOverlap may throw a CompileException - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/09/04 05:01:01 UTC, 0 replies.
- [jira] [Created] (SPARK-25328) Add a test case for having two columns as the grouping key in group aggregate pandas UDF - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/04 05:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25328) Add a test case for having two columns as the grouping key in group aggregate pandas UDF - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/04 05:56:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-25328) Add an example for having two columns as the grouping key in group aggregate pandas UDF - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/04 06:11:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25329) Support passing Kerberos configuration information - posted by "Dale Richardson (JIRA)" <ji...@apache.org> on 2018/09/04 06:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25328) Add an example for having two columns as the grouping key in group aggregate pandas UDF - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/04 06:12:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-25314) Invalid PythonUDF - requires attributes from more than one child - in "on" join condition - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/04 06:54:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25314) Invalid PythonUDF - requires attributes from more than one child - in "on" join condition - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/04 06:54:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25314) Invalid PythonUDF - requires attributes from more than one child - in "on" join condition - posted by "Sergey Bahchissaraitsev (JIRA)" <ji...@apache.org> on 2018/09/04 07:21:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24962) refactor CodeGenerator.createUnsafeArray - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/04 07:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24962) refactor CodeGenerator.createUnsafeArray - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/04 07:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25330) Permission issue after upgrade hadoop version to 2.7.7 - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/04 08:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25330) Permission issue after upgrade hadoop version to 2.7.7 - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/04 08:11:09 UTC, 5 replies.
- [jira] [Commented] (SPARK-25330) Permission issue after upgrade hadoop version to 2.7.7 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/04 08:45:00 UTC, 10 replies.
- [jira] [Assigned] (SPARK-25330) Permission issue after upgrade hadoop version to 2.7.7 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/04 08:45:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-22666) Spark datasource for image format - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/04 10:04:01 UTC, 0 replies.
- [jira] [Assigned] (SPARK-22666) Spark datasource for image format - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/04 10:04:02 UTC, 2 replies.
- [jira] [Assigned] (SPARK-25328) Add an example for having two columns as the grouping key in group aggregate pandas UDF - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/04 10:08:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24189) Spark Strcutured Streaming not working with the Kafka Transactions - posted by "Binzi Cao (JIRA)" <ji...@apache.org> on 2018/09/04 10:49:01 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24189) Spark Strcutured Streaming not working with the Kafka Transactions - posted by "Binzi Cao (JIRA)" <ji...@apache.org> on 2018/09/04 10:50:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-20168) Enable kinesis to start stream from Initial position specified by a timestamp - posted by "Vladimir Pchelko (JIRA)" <ji...@apache.org> on 2018/09/04 11:04:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-20168) Enable kinesis to start stream from Initial position specified by a timestamp - posted by "Vladimir Pchelko (JIRA)" <ji...@apache.org> on 2018/09/04 11:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25176) Kryo fails to serialize a parametrised type hierarchy - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/04 12:16:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-19355) Use map output statistices to improve global limit's parallelism - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/04 12:29:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-25271) Creating parquet table with all the column null throws exception - posted by "shivusondur (JIRA)" <ji...@apache.org> on 2018/09/04 14:26:01 UTC, 6 replies.
- [jira] [Created] (SPARK-25331) Structured Streaming File Sink duplicates records in case of driver failure - posted by "Mihaly Toth (JIRA)" <ji...@apache.org> on 2018/09/04 14:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25331) Structured Streaming File Sink duplicates records in case of driver failure - posted by "Mihaly Toth (JIRA)" <ji...@apache.org> on 2018/09/04 14:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25331) Structured Streaming File Sink duplicates records in case of driver failure - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/04 14:37:01 UTC, 1 replies.
- [jira] [Commented] (SPARK-25331) Structured Streaming File Sink duplicates records in case of driver failure - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/04 14:37:01 UTC, 5 replies.
- [jira] [Created] (SPARK-25332) Instead of broadcast hash join ,Sort merge join has selected when restart spark-shell/spark-JDBC for hive provider - posted by "Babulal (JIRA)" <ji...@apache.org> on 2018/09/04 16:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25333) Ability to add new columns in the beginning of a Dataset - posted by "Walid Mellouli (JIRA)" <ji...@apache.org> on 2018/09/04 16:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25248) Audit barrier APIs for Spark 2.4 - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/04 16:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25333) Ability to add new columns in the beginning of a Dataset - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/04 17:06:28 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25333) Ability to add new columns in the beginning of a Dataset - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/04 17:07:01 UTC, 1 replies.
- [jira] [Updated] (SPARK-25333) Ability to add new columns in the beginning of a Dataset - posted by "Walid Mellouli (JIRA)" <ji...@apache.org> on 2018/09/04 17:08:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25334) Default SessionCatalog should support UDFs - posted by "Tomasz Gawęda (JIRA)" <ji...@apache.org> on 2018/09/04 17:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25334) Default SessionCatalog doesn't support UDFs - posted by "Tomasz Gawęda (JIRA)" <ji...@apache.org> on 2018/09/04 17:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25334) Default SessionCatalog should support UDFs - posted by "Tomasz Gawęda (JIRA)" <ji...@apache.org> on 2018/09/04 17:12:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24316) Spark sql queries stall for column width more than 6k for parquet based table - posted by "Bruce Robbins (JIRA)" <ji...@apache.org> on 2018/09/04 18:58:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25258) Upgrade kryo package to version 4.0.2 - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/04 19:04:04 UTC, 0 replies.
- [jira] [Commented] (SPARK-25258) Upgrade kryo package to version 4.0.2 - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/04 19:07:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-23131) Kryo raises StackOverflow during serializing GLR model - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/04 19:12:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25333) Ability to add new columns in Dataset in a user-defined position - posted by "Walid Mellouli (JIRA)" <ji...@apache.org> on 2018/09/04 20:58:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25335) Skip Zinc downloading if it's installed in the system - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/04 20:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25335) Skip Zinc downloading if it's installed in the system - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/04 21:00:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-25335) Skip Zinc downloading if it's installed in the system - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/04 21:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25335) Skip Zinc downloading if it's installed in the system - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/04 21:06:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25336) Revert SPARK-24863 and SPARK 24748 - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/09/04 21:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25337) HiveExternalCatalogVersionsSuite + Scala 2.12 = NoSuchMethodError: org.apache.spark.sql.execution.datasources.FileFormat.$init$(Lorg/apache/spark/sql/execution/datasources/FileFormat;) - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/04 21:53:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25336) Revert SPARK-24863 and SPARK-24748 - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/09/04 21:55:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-25336) Revert SPARK-24863 and SPARK-24748 - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/09/04 21:55:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25336) Revert SPARK-24863 and SPARK-24748 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/04 21:55:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24863) Report offset lag as a custom metrics for Kafka structured streaming source - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/04 21:56:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24748) Support for reporting custom metrics via Streaming Query Progress - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/04 21:58:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25297) Future for Scala 2.12 will block on a already shutdown ExecutionContext - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/04 22:02:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25337) HiveExternalCatalogVersionsSuite + Scala 2.12 = NoSuchMethodError: org.apache.spark.sql.execution.datasources.FileFormat.$init$(Lorg/apache/spark/sql/execution/datasources/FileFormat;) - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/04 22:07:00 UTC, 3 replies.
- [jira] [Updated] (SPARK-25337) HiveExternalCatalogVersionsSuite + Scala 2.12 = NoSuchMethodError: org.apache.spark.sql.execution.datasources.FileFormat.$init$(Lorg/apache/spark/sql/execution/datasources/FileFormat;) - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/04 22:07:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25258) Upgrade kryo package to version 4.0.2 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/04 23:19:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25332) Instead of broadcast hash join ,Sort merge join has selected when restart spark-shell/spark-JDBC for hive provider - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/09/05 00:17:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25332) Instead of broadcast hash join ,Sort merge join has selected when restart spark-shell/spark-JDBC for hive provider - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/09/05 00:18:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24256) ExpressionEncoder should support user-defined types as fields of Scala case class and tuple - posted by "Fangshi Li (JIRA)" <ji...@apache.org> on 2018/09/05 01:11:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24256) ExpressionEncoder should support user-defined types as fields of Scala case class and tuple - posted by "Fangshi Li (JIRA)" <ji...@apache.org> on 2018/09/05 01:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-19145) Timestamp to String casting is slowing the query significantly - posted by "Aaron Hiniker (JIRA)" <ji...@apache.org> on 2018/09/05 01:20:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-19145) Timestamp to String casting is slowing the query significantly - posted by "Aaron Hiniker (JIRA)" <ji...@apache.org> on 2018/09/05 01:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25299) Use remote storage for persisting shuffle data - posted by "Matt Cheah (JIRA)" <ji...@apache.org> on 2018/09/05 01:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25299) Use remote storage for persisting shuffle data - posted by "Matt Cheah (JIRA)" <ji...@apache.org> on 2018/09/05 01:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25306) Use cache to speed up `createFilter` in ORC - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/05 02:25:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25306) Avoid skewed filter trees to speed up `createFilter` in ORC - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/05 02:38:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25300) Unified the configuration parameter `spark.shuffle.service.enabled` - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/05 02:45:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-24256) ExpressionEncoder should support user-defined types as fields of Scala case class and tuple - posted by "Fangshi Li (JIRA)" <ji...@apache.org> on 2018/09/05 03:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25091) UNCACHE TABLE, CLEAR CACHE, rdd.unpersist() does not clean up executor memory - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/05 05:12:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25091) UNCACHE TABLE, CLEAR CACHE, rdd.unpersist() does not clean up executor memory - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/05 05:12:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25306) Avoid skewed filter trees to speed up `createFilter` in ORC - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/05 05:17:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25338) Several tests miss calling super.afterAll() in their afterAll() method - posted by "Kazuaki Ishizaki (JIRA)" <ji...@apache.org> on 2018/09/05 05:25:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25336) Revert SPARK-24863 and SPARK-24748 - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/05 05:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25339) Refactor FilterPushdownBenchmark to use main method - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/05 05:46:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-24863) Report offset lag as a custom metrics for Kafka structured streaming source - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/09/05 06:02:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24748) Support for reporting custom metrics via Streaming Query Progress - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/09/05 06:02:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24863) Report offset lag as a custom metrics for Kafka structured streaming source - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/09/05 06:02:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-24748) Support for reporting custom metrics via Streaming Query Progress - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/09/05 06:02:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25338) Several tests miss calling super.afterAll() in their afterAll() method - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/05 06:08:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25338) Several tests miss calling super.afterAll() in their afterAll() method - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/05 06:08:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25339) Refactor FilterPushdownBenchmark to use main method - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/05 06:39:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-25317) MemoryBlock performance regression - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/05 08:57:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-25337) HiveExternalCatalogVersionsSuite + Scala 2.12 = NoSuchMethodError: org.apache.spark.sql.execution.datasources.FileFormat.$init$(Lorg/apache/spark/sql/execution/datasources/FileFormat;) - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/05 09:07:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-17159) Improve FileInputDStream.findNewFiles list performance - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/05 09:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-13446) Spark need to support reading data from Hive 2.0.0 metastore - posted by "t oo (JIRA)" <ji...@apache.org> on 2018/09/05 09:13:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-18112) Spark2.x does not support read data from Hive 2.x metastore - posted by "t oo (JIRA)" <ji...@apache.org> on 2018/09/05 09:18:00 UTC, 24 replies.
- [jira] [Assigned] (SPARK-24889) dataset.unpersist() doesn't update storage memory stats - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/05 10:12:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24889) dataset.unpersist() doesn't update storage memory stats - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/05 10:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24360) Support Hive 3.0 metastore - posted by "t oo (JIRA)" <ji...@apache.org> on 2018/09/05 11:29:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24632) Allow 3rd-party libraries to use pyspark.ml abstractions for Java wrappers for persistence - posted by "Mathew (JIRA)" <ji...@apache.org> on 2018/09/05 11:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23443) Spark with Glue as external catalog - posted by "t oo (JIRA)" <ji...@apache.org> on 2018/09/05 12:22:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25340) Pushes down Sample beneath deterministic Project - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/09/05 13:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25340) Pushes down Sample beneath deterministic Project - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/09/05 13:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25340) Pushes down Sample beneath deterministic Project - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/09/05 13:18:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25228) Add executor CPU Time metric - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/05 14:01:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25228) Add executor CPU Time metric - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/05 14:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25132) Case-insensitive field resolution when reading from Parquet - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/05 15:14:00 UTC, 1 replies.
- [jira] [Closed] (SPARK-25279) Throw exception: zzcclp java.io.NotSerializableException: org.apache.spark.sql.TypedColumn in Spark-shell when run example of doc - posted by "Zhichao Zhang (JIRA)" <ji...@apache.org> on 2018/09/05 16:02:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25279) Throw exception: zzcclp java.io.NotSerializableException: org.apache.spark.sql.TypedColumn in Spark-shell when run example of doc - posted by "Zhichao Zhang (JIRA)" <ji...@apache.org> on 2018/09/05 16:02:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-14922) Alter Table Drop Partition Using Predicate-based Partition Spec - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/05 16:17:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24415) Stage page aggregated executor metrics wrong when failures - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/09/05 16:53:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24415) Stage page aggregated executor metrics wrong when failures - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/09/05 16:55:02 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24539) HistoryServer does not display metrics from tasks that complete after stage failure - posted by "Ankur Gupta (JIRA)" <ji...@apache.org> on 2018/09/05 16:57:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24748) Support for reporting custom metrics via Streaming Query Progress - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/05 16:59:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25341) Support rolling back a shuffle map stage and re-generate the shuffle files - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/05 17:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25342) Support rolling back a result stage - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/05 17:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25343) Extend CSV parsing to Dataset[List[String]] - posted by "Frank Kemmer (JIRA)" <ji...@apache.org> on 2018/09/05 18:06:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25343) Extend CSV parsing to Dataset[List[String]] - posted by "Frank Kemmer (JIRA)" <ji...@apache.org> on 2018/09/05 18:11:00 UTC, 3 replies.
- [jira] [Updated] (SPARK-24360) Support Hive 3.1 metastore - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/05 18:15:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25344) Break large tests.py files into smaller files - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/09/05 18:28:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-22666) Spark datasource for image format - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/05 19:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25345) Deprecate public APIs from ImageSchema - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/05 19:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25346) Document Spark buit-in data sources - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/05 19:06:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25346) Document Spark builtin data sources - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/05 19:07:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25346) Document Spark built-in data sources - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/05 19:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25347) Document image data sources in doc site - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/05 19:08:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25348) Data source for binary files - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/05 19:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25349) Support sample pushdown in Data Source V2 - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/05 19:16:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25345) Deprecate public APIs from ImageSchema - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/05 19:17:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25347) Document image data source in doc site - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/05 19:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25350) Spark Serving - posted by "Mark Hamilton (JIRA)" <ji...@apache.org> on 2018/09/05 19:40:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25350) Spark Serving - posted by "Mark Hamilton (JIRA)" <ji...@apache.org> on 2018/09/05 19:41:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25350) Spark Serving - posted by "Mark Hamilton (JIRA)" <ji...@apache.org> on 2018/09/05 19:46:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24771) Upgrade AVRO version from 1.7.7 to 1.8 - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/09/05 20:11:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-19809) NullPointerException on zero-size ORC file - posted by "Shirish Tatikonda (JIRA)" <ji...@apache.org> on 2018/09/05 20:52:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-21187) Complete support for remaining Spark data types in Arrow Converters - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/09/05 21:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25351) Handle Pandas category type when converting from Python with Arrow - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/09/05 21:10:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25231) Running a Large Job with Speculation On Causes Executor Heartbeats to Time Out on Driver - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/09/05 21:12:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25268) runParallelPersonalizedPageRank throws serialization Exception - posted by "Joseph K. Bradley (JIRA)" <ji...@apache.org> on 2018/09/05 22:22:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-23243) Shuffle+Repartition on an RDD could lead to incorrect answers - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/05 22:38:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25335) Skip Zinc downloading if it's installed in the system - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/05 22:43:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25258) Upgrade kryo package to version 4.0.2 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/05 22:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25176) Kryo fails to serialize a parametrised type hierarchy - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/05 22:51:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23131) Kryo raises StackOverflow during serializing GLR model - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/05 22:51:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-23131) Kryo raises StackOverflow during serializing GLR model - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/05 23:10:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23774) `Cast` to CHAR/VARCHAR should truncate the values - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/05 23:45:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-20901) Feature parity for ORC with Parquet - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/06 00:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25268) runParallelPersonalizedPageRank throws serialization Exception - posted by "Joseph K. Bradley (JIRA)" <ji...@apache.org> on 2018/09/06 00:27:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25330) Permission issue after upgrade hadoop version to 2.7.7 - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/06 01:10:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-25346) Document Spark builtin data sources - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/06 01:34:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25313) Fix regression in FileFormatWriter output schema - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/06 02:40:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-20918) Use FunctionIdentifier as function identifiers in FunctionRegistry - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/06 02:46:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-25337) HiveExternalCatalogVersionsSuite + Scala 2.12 = NoSuchMethodError: org.apache.spark.sql.execution.datasources.FileFormat.$init$(Lorg/apache/spark/sql/execution/datasources/FileFormat;) - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/06 04:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25344) Break large tests.py files into smaller files - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/09/06 04:35:00 UTC, 4 replies.
- [jira] [Assigned] (SPARK-25252) Support arrays of any types in to_json - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/06 04:37:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25252) Support arrays of any types in to_json - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/06 04:38:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25352) Perform ordered global limit when limit number is bigger than topKSortFallbackThreshold - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/09/06 04:43:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25352) Perform ordered global limit when limit number is bigger than topKSortFallbackThreshold - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/06 04:53:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-25352) Perform ordered global limit when limit number is bigger than topKSortFallbackThreshold - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/06 04:53:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-12321) JSON format for logical/physical execution plans - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/06 06:13:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25301) When a view uses an UDF from a non default database, Spark analyser throws AnalysisException - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/06 07:02:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25135) insert datasource table may all null when select from view on parquet - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/06 07:25:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25317) MemoryBlock performance regression - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/06 07:30:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25353) Refactoring executeTake(n: Int) in SparkPlan - posted by "Dooyoung Hwang (JIRA)" <ji...@apache.org> on 2018/09/06 07:46:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25353) Refactoring executeTake(n: Int) in SparkPlan - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/06 08:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25353) Refactoring executeTake(n: Int) in SparkPlan - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/06 08:00:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25343) Extend CSV parsing to Dataset[List[String]] - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/06 08:13:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-14220) Build and test Spark against Scala 2.12 - posted by "Darcy Shen (JIRA)" <ji...@apache.org> on 2018/09/06 08:25:02 UTC, 1 replies.
- [jira] [Updated] (SPARK-25157) Streaming of image files from directory - posted by "Amit Baghel (JIRA)" <ji...@apache.org> on 2018/09/06 08:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25354) Parquet vectorized record reader has unneeded operation in several methods - posted by "SongYadong (JIRA)" <ji...@apache.org> on 2018/09/06 08:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25353) executeTake has been modified to avoid unnecessary deserialization. - posted by "Dooyoung Hwang (JIRA)" <ji...@apache.org> on 2018/09/06 08:33:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25353) executeTake in SparkPlan could deserialize more than necessary. - posted by "Dooyoung Hwang (JIRA)" <ji...@apache.org> on 2018/09/06 08:34:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25354) Parquet vectorized record reader has unneeded operation in several methods - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/06 08:36:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-25354) Parquet vectorized record reader has unneeded operation in several methods - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/06 08:36:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25333) Ability to add new columns in Dataset in a user-defined position - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/06 09:11:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25353) executeTake in SparkPlan could decode rows more than necessary. - posted by "Dooyoung Hwang (JIRA)" <ji...@apache.org> on 2018/09/06 09:26:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-25345) Deprecate public APIs from ImageSchema - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/06 10:03:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25345) Deprecate public APIs from ImageSchema - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/06 10:03:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25355) Support --proxy-user for Spark on K8s - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/09/06 10:23:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25356) Add Parquet block size (row group size) option to SparkSQL configuration - posted by "liuxian (JIRA)" <ji...@apache.org> on 2018/09/06 10:38:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25356) Add Parquet block size (row group size) option to SparkSQL configuration - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/06 10:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25356) Add Parquet block size (row group size) option to SparkSQL configuration - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/06 10:45:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-23670) Memory leak of SparkPlanGraphWrapper in sparkUI - posted by "Michael Spector (JIRA)" <ji...@apache.org> on 2018/09/06 11:07:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-23670) Memory leak of SparkPlanGraphWrapper in sparkUI - posted by "Michael Spector (JIRA)" <ji...@apache.org> on 2018/09/06 11:11:00 UTC, 6 replies.
- [jira] [Commented] (SPARK-25208) Loosen Cast.forceNullable for DecimalType. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/06 11:46:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-17732) ALTER TABLE DROP PARTITION should support comparators - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/06 13:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25128) multiple simultaneous job submissions against k8s backend cause driver pods to hang - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/06 13:19:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25036) Scala 2.12 issues: Compilation error with sbt - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/06 13:33:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24838) Support uncorrelated IN/EXISTS subqueries for more operators - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/06 13:34:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24838) Support uncorrelated IN/EXISTS subqueries for more operators - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/06 13:34:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-14220) Build and test Spark against Scala 2.12 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/06 13:43:04 UTC, 0 replies.
- [jira] [Commented] (SPARK-25027) LegacyAccumulatorWrapper test fails in Scala 2.12 - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/06 13:56:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25357) Abbreviated metadata in DataSourceScanExec results in incomplete information in event log - posted by "Lantao Jin (JIRA)" <ji...@apache.org> on 2018/09/06 14:04:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25357) Abbreviated metadata in DataSourceScanExec results in incomplete location in event log - posted by "Lantao Jin (JIRA)" <ji...@apache.org> on 2018/09/06 14:04:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25357) Abbreviated metadata in DataSourceScanExec results in incomplete information in event log - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/06 14:10:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25357) Abbreviated metadata in DataSourceScanExec results in incomplete information in event log - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/06 14:10:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25027) LegacyAccumulatorWrapper test fails in Scala 2.12 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/06 14:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25108) Dataset.show() generates incorrect padding for Unicode Character - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/06 14:19:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25108) Dataset.show() generates incorrect padding for Unicode Character - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/06 14:19:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25357) Abbreviated simpleString in DataSourceScanExec results in incomplete information in event log - posted by "Lantao Jin (JIRA)" <ji...@apache.org> on 2018/09/06 14:23:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25108) Dataset.show() generates incorrect padding for Unicode Character - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/06 14:39:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-23243) Shuffle+Repartition on an RDD could lead to incorrect answers - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/06 14:45:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25358) MutableProjection supports fallback to an interpreted mode - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/09/06 14:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25358) MutableProjection supports fallback to an interpreted mode - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/06 14:59:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25358) MutableProjection supports fallback to an interpreted mode - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/06 14:59:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25328) Add an example for having two columns as the grouping key in group aggregate pandas UDF - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/09/06 15:20:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25128) multiple simultaneous job submissions against k8s backend cause driver pods to hang - posted by "Erik Erlandson (JIRA)" <ji...@apache.org> on 2018/09/06 15:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25358) MutableProjection supports fallback to an interpreted mode - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/09/06 15:38:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25359) Incorporate pyspark test output into jenkins test report - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/09/06 15:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25360) Parallelized RDDs of Ranges could have known partitioner - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/09/06 16:24:00 UTC, 0 replies.
- [jira] [Issue Comment Deleted] (SPARK-25295) Pod names conflicts in client mode, if previous submission was not a clean shutdown. - posted by "Yinan Li (JIRA)" <ji...@apache.org> on 2018/09/06 16:39:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25268) runParallelPersonalizedPageRank throws serialization Exception - posted by "Joseph K. Bradley (JIRA)" <ji...@apache.org> on 2018/09/06 16:54:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25361) Support for Kinesis Client Library 2.0 - posted by "Cory Locklear (JIRA)" <ji...@apache.org> on 2018/09/06 17:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25072) PySpark custom Row class can be given extra parameters - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/09/06 17:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25072) PySpark custom Row class can be given extra parameters - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/09/06 17:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-22357) SparkContext.binaryFiles ignore minPartitions parameter - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/06 18:23:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25362) Replace Spark Optional class with Java Optional - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/06 21:43:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25222) Spark on Kubernetes Pod Watcher dumps raw container status - posted by "Matt Cheah (JIRA)" <ji...@apache.org> on 2018/09/06 23:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-22387) propagate session configs to data source read/write options - posted by "Dale Richardson (JIRA)" <ji...@apache.org> on 2018/09/06 23:25:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25356) Add Parquet block size (row group size) option to SparkSQL configuration - posted by "liuxian (JIRA)" <ji...@apache.org> on 2018/09/07 01:04:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25036) Scala 2.12 issues: Compilation error with sbt - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/07 02:16:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23098) Migrate Kafka batch source to v2 - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/07 02:29:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-23243) Shuffle+Repartition on an RDD could lead to incorrect answers - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/07 02:55:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25271) Creating parquet table with all the column null throws exception - posted by "shivusondur (JIRA)" <ji...@apache.org> on 2018/09/07 03:43:00 UTC, 4 replies.
- [jira] [Resolved] (SPARK-25343) Extend CSV parsing to Dataset[List[String]] - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/07 03:46:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25359) Incorporate pyspark test output into jenkins test report - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/07 03:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25361) Support for Kinesis Client Library 2.0 - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/07 03:54:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25361) Support for Kinesis Client Library 2.0 - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/07 03:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25330) Permission issue after upgrade hadoop version to 2.7.7 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/07 04:43:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25237) FileScanRdd's inputMetrics is wrong when select the datasource table with limit - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/07 04:46:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25237) FileScanRdd's inputMetrics is wrong when select the datasource table with limit - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/07 04:46:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25363) Schema pruning doesn't work if nested column is used in where clause - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/09/07 05:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25363) Schema pruning doesn't work if nested column is used in where clause - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/09/07 05:06:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-25271) Creating parquet table with all the column null throws exception - posted by "shivusondur (JIRA)" <ji...@apache.org> on 2018/09/07 05:29:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25363) Schema pruning doesn't work if nested column is used in where clause - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/07 05:42:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25365) a better way to handle vector index and sparsity in FeatureHasher implementation ? - posted by "Vincent (JIRA)" <ji...@apache.org> on 2018/09/07 06:24:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25364) a better way to handle vector index and sparsity in FeatureHasher implementation ? - posted by "Vincent (JIRA)" <ji...@apache.org> on 2018/09/07 06:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25365) a better way to handle vector index and sparsity in FeatureHasher implementation ? - posted by "Vincent (JIRA)" <ji...@apache.org> on 2018/09/07 06:28:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25267) Disable ConvertToLocalRelation in the test cases of sql/core and sql/hive - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/07 06:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25366) Zstd and brotil CompressionCodec are not supported for parquet files - posted by "liuxian (JIRA)" <ji...@apache.org> on 2018/09/07 07:23:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25366) Zstd and brotil CompressionCodec are not supported for parquet files - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/07 07:38:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25366) Zstd and brotil CompressionCodec are not supported for parquet files - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/07 07:38:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25367) Hive table created by Spark dataFrame has incompatiable schema in spark and hive - posted by "yy (JIRA)" <ji...@apache.org> on 2018/09/07 08:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25367) Hive table created by Spark dataFrame has incompatiable schema in spark and hive - posted by "yy (JIRA)" <ji...@apache.org> on 2018/09/07 08:51:00 UTC, 6 replies.
- [jira] [Commented] (SPARK-25364) a better way to handle vector index and sparsity in FeatureHasher implementation ? - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/09/07 11:46:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25368) Incorrect predicate pushdown returns in incorrect result - posted by "Lev Katzav (JIRA)" <ji...@apache.org> on 2018/09/07 12:07:00 UTC, 5 replies.
- [jira] [Created] (SPARK-25368) Incorrect predicate pushdown returns in incorrect result - posted by "Lev Katzav (JIRA)" <ji...@apache.org> on 2018/09/07 12:07:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25368) Incorrect predicate pushdown returns incorrect result - posted by "Lev Katzav (JIRA)" <ji...@apache.org> on 2018/09/07 12:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25368) Incorrect predicate pushdown returns wrong result - posted by "Lev Katzav (JIRA)" <ji...@apache.org> on 2018/09/07 12:16:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25369) Replace Java shim functional interfaces like java.api.Function with Java 8 equivalents - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/07 13:42:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24415) Stage page aggregated executor metrics wrong when failures - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/09/07 13:50:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-1239) Improve fetching of map output statuses - posted by "harel gliksman (JIRA)" <ji...@apache.org> on 2018/09/07 15:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25370) Undefined name _exception_message in java_gateway - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/09/07 16:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25370) Undefined name _exception_message in java_gateway - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/09/07 16:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25370) Undefined name _exception_message in java_gateway - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/09/07 16:33:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25270) lint-python: Add flake8 to find syntax errors and undefined names - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/09/07 16:35:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-25015) Update Hadoop 2.7 to 2.7.7 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/07 17:23:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25015) Update Hadoop 2.7 to 2.7.7 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/07 17:24:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25371) Vector Assembler with no input columns throws an exception - posted by "Victor Alor (JIRA)" <ji...@apache.org> on 2018/09/07 17:42:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25371) Vector Assembler with no input columns throws an exception - posted by "Victor Alor (JIRA)" <ji...@apache.org> on 2018/09/07 17:43:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23429) Add executor memory metrics to heartbeat and expose in executors REST API - posted by "Matt Cheah (JIRA)" <ji...@apache.org> on 2018/09/07 17:45:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25371) Vector Assembler with no input columns leads to opaque error - posted by "Victor Alor (JIRA)" <ji...@apache.org> on 2018/09/07 17:45:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25344) Break large tests.py files into smaller files - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/09/07 18:21:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-10399) Off Heap Memory Access for non-JVM libraries (C++) - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/07 19:11:01 UTC, 1 replies.
- [jira] [Commented] (SPARK-23879) Introduce MemoryBlock API instead of Platform API with Object - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/07 19:12:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-23762) UTF8StringBuilder uses MemoryBlock - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/07 19:13:00 UTC, 4 replies.
- [jira] [Created] (SPARK-25372) Deprecate Yarn-specific configs in regards to keytab login for SparkSubmit - posted by "Ilan Filonenko (JIRA)" <ji...@apache.org> on 2018/09/07 21:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25372) Deprecate Yarn-specific configs in regards to keytab login for SparkSubmit - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/07 22:34:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25372) Deprecate Yarn-specific configs in regards to keytab login for SparkSubmit - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/07 22:34:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25373) Support mixed language pipelines on Spark on K8s - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/09/08 00:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25374) SafeProjection supports fallback to an interpreted mode - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/09/08 01:00:00 UTC, 4 replies.
- [jira] [Created] (SPARK-25374) SafeProjection supports fallback to an interpreted mode - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/09/08 01:00:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25374) SafeProjection supports fallback to an interpreted mode - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/09/08 01:01:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25375) Reenable qualified perm. function checks in UDFSuite - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/08 01:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25375) Reenable qualified perm. function checks in UDFSuite - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/08 01:11:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25375) Reenable qualified perm. function checks in UDFSuite - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/08 01:11:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25225) Add support for "List"-Type columns - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/08 05:19:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25376) Scenarios we should handle but missed for barrier execution mode - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/08 05:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25376) Scenarios we should handle but missed for barrier execution mode - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/08 05:55:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25376) Scenarios we should handle but missed in 2.4 for barrier execution mode - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/08 06:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25377) spark sql dataframe cache is invalid - posted by "Iverson Hu (JIRA)" <ji...@apache.org> on 2018/09/08 06:20:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25377) spark sql dataframe cache is invalid - posted by "Iverson Hu (JIRA)" <ji...@apache.org> on 2018/09/08 06:22:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25378) ArrayData.toArray assume UTF8String - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/08 06:55:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25379) Improve ColumnPruning performance - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/09/08 09:05:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25379) Improve ColumnPruning performance - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/09/08 09:06:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25379) Improve ColumnPruning performance - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/08 09:34:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25379) Improve ColumnPruning performance - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/08 09:34:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25368) Incorrect predicate pushdown returns wrong result - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/08 10:49:00 UTC, 4 replies.
- [jira] [Created] (SPARK-25380) Generated plans occupy over 50% of Spark driver memory - posted by "Michael Spector (JIRA)" <ji...@apache.org> on 2018/09/08 13:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25380) Generated plans occupy over 50% of Spark driver memory - posted by "Michael Spector (JIRA)" <ji...@apache.org> on 2018/09/08 13:15:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25380) Generated plans occupy over 50% of Spark driver memory - posted by "Michael Spector (JIRA)" <ji...@apache.org> on 2018/09/08 13:16:00 UTC, 11 replies.
- [jira] [Commented] (SPARK-25378) ArrayData.toArray assume UTF8String - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/08 15:54:00 UTC, 7 replies.
- [jira] [Created] (SPARK-25381) Stratified sampling by Column argument - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/09/08 16:07:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25345) Deprecate readImages APIs from ImageSchema - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/08 16:11:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25345) Deprecate public APIs from ImageSchema - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/08 16:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25382) Remove ImageSchema.readImages in 3.0 - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/08 16:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25383) Image data source supports sample pushdown - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/08 16:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25382) Remove ImageSchema.readImages in 3.0 - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/08 16:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25381) Stratified sampling by Column argument - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/08 16:19:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25381) Stratified sampling by Column argument - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/08 16:19:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-20636) Eliminate unnecessary shuffle with adjacent Window expressions - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/08 18:39:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-20636) Eliminate unnecessary shuffle with adjacent Window expressions - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/08 18:39:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25375) Reenable qualified perm. function checks in UDFSuite - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/08 18:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25384) Removing spark.sql.fromJsonForceNullableSchema - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/09/08 19:38:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25384) Removing spark.sql.fromJsonForceNullableSchema - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/08 19:50:00 UTC, 4 replies.
- [jira] [Assigned] (SPARK-25384) Removing spark.sql.fromJsonForceNullableSchema - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/08 19:50:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25241) Configurable empty values when reading/writing CSV files - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/08 21:26:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-23880) table cache should be lazy and don't trigger any job - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/09 04:04:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25368) Incorrect predicate pushdown returns wrong result - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/09 04:30:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25072) PySpark custom Row class can be given extra parameters - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/09 04:32:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-25021) Add spark.executor.pyspark.memory support to Kubernetes - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/09/09 05:20:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25021) Add spark.executor.pyspark.memory support to Kubernetes - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/09/09 05:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25385) Upgrade fasterxml.jackson.databind.version to 2.7.8 - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/09 11:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25386) Don't need to synchronize the IndexShuffleBlockResolver for each writeIndexFileAndCommit - posted by "Xianyang Liu (JIRA)" <ji...@apache.org> on 2018/09/09 11:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25385) Upgrade jackson version to 2.7.8 - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/09 11:34:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25386) Don't need to synchronize the IndexShuffleBlockResolver for each writeIndexFileAndCommit - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/09 11:35:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25386) Don't need to synchronize the IndexShuffleBlockResolver for each writeIndexFileAndCommit - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/09 11:35:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25386) Don't need to synchronize the IndexShuffleBlockResolver for each writeIndexFileAndCommit call - posted by "Xianyang Liu (JIRA)" <ji...@apache.org> on 2018/09/09 11:36:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25385) Upgrade jackson version to 2.7.8 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/09 12:01:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25385) Upgrade jackson version to 2.7.8 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/09 12:01:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25371) Vector Assembler with no input columns leads to opaque error - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/09 13:14:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25371) Vector Assembler with no input columns leads to opaque error - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/09 13:14:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25387) Malformed CSV causes NPE - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/09/09 15:41:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25387) Malformed CSV causes NPE - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/09 15:54:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25387) Malformed CSV causes NPE - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/09 15:54:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25368) Incorrect predicate pushdown returns wrong result - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/09 16:11:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25368) Incorrect constraint inference returns wrong result - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/09 16:32:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25364) a better way to handle vector index and sparsity in FeatureHasher implementation ? - posted by "Vincent (JIRA)" <ji...@apache.org> on 2018/09/10 00:52:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25366) Zstd and brotli CompressionCodec are not supported for parquet files - posted by "liuxian (JIRA)" <ji...@apache.org> on 2018/09/10 01:30:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25388) checkEvaluation may miss incorrect nullable of DataType in the result - posted by "Kazuaki Ishizaki (JIRA)" <ji...@apache.org> on 2018/09/10 01:48:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25388) checkEvaluation may miss incorrect nullable of DataType in the result - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/10 01:56:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25388) checkEvaluation may miss incorrect nullable of DataType in the result - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/10 01:56:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25175) Field resolution should fail if there's ambiguity for ORC native reader - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/10 02:25:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25175) Field resolution should fail if there's ambiguity for ORC native reader - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/10 02:25:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25175) Field resolution should fail if there's ambiguity for ORC native reader - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/10 02:27:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25367) Spark sql get incompatiable schema as in hive - posted by "yy (JIRA)" <ji...@apache.org> on 2018/09/10 02:56:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25367) Spark sql got incompatiable schema as in hive - posted by "yy (JIRA)" <ji...@apache.org> on 2018/09/10 02:56:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25367) Spark sql get incompatiable column schema as in hive - posted by "yy (JIRA)" <ji...@apache.org> on 2018/09/10 02:57:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25367) Spark sql get incompatiable column schema as in hiveThe column attributes obtained by Spark sql are inconsistent with hive - posted by "yy (JIRA)" <ji...@apache.org> on 2018/09/10 02:58:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25367) The column attributes obtained by Spark sql are inconsistent with hive - posted by "yy (JIRA)" <ji...@apache.org> on 2018/09/10 02:58:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-25021) Add spark.executor.pyspark.memory support to Kubernetes - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/10 03:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24849) Convert StructType to DDL string - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/10 04:17:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24911) SHOW CREATE TABLE drops escaping of nested column names - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/10 04:19:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25389) INSERT OVERWRITE DIRECTORY STORED AS should not generate files with duplicate fields - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/10 05:16:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25389) INSERT OVERWRITE DIRECTORY STORED AS should prevent duplicate fields - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/10 05:27:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25389) INSERT OVERWRITE DIRECTORY STORED AS should prevent duplicate fields - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/10 05:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25389) INSERT OVERWRITE DIRECTORY STORED AS should prevent duplicate fields - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/10 05:32:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25390) finalize the abstraction of data source V2 API - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 05:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25391) Make behaviors consistent when converting parquet hive table to parquet data source - posted by "Chenxiao Mao (JIRA)" <ji...@apache.org> on 2018/09/10 05:46:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25391) Make behaviors consistent when converting parquet hive table to parquet data source - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/10 05:52:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25391) Make behaviors consistent when converting parquet hive table to parquet data source - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/10 05:53:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25276) OutOfMemoryError: GC overhead limit exceeded when using alias - posted by "Ajith S (JIRA)" <ji...@apache.org> on 2018/09/10 06:17:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25392) [Spark Job History]Inconsistent behaviour for pool details in spark web UI and history server page - posted by "ABHISHEK KUMAR GUPTA (JIRA)" <ji...@apache.org> on 2018/09/10 06:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24999) Reduce unnecessary 'new' memory operations - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 07:12:01 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24999) Reduce unnecessary 'new' memory operations - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 07:12:01 UTC, 0 replies.
- [jira] [Commented] (SPARK-25377) spark sql dataframe cache is invalid - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/10 08:56:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25367) The column attributes obtained by Spark sql are inconsistent with hive - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/10 08:58:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25365) a better way to handle vector index and sparsity in FeatureHasher implementation ? - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/10 09:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25393) Parsing CSV strings in a column - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/09/10 09:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25393) Parsing CSV strings in a column - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/10 09:17:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25393) Parsing CSV strings in a column - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/10 09:17:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25357) Add metadata to SparkPlanInfo to dump more information like file path to event log - posted by "Lantao Jin (JIRA)" <ji...@apache.org> on 2018/09/10 10:05:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25278) Number of output rows metric of union of views is multiplied by their occurrences - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 11:44:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25278) Number of output rows metric of union of views is multiplied by their occurrences - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 11:45:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25153) Improve error messages for columns with dots/periods - posted by "Fernando Díaz (JIRA)" <ji...@apache.org> on 2018/09/10 11:58:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25102) Write Spark version information to Parquet file footers - posted by "Zoltan Ivanfi (JIRA)" <ji...@apache.org> on 2018/09/10 11:59:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25278) Number of output rows metric of union of views is multiplied by their occurrences - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/10 12:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25394) Expose App status metrics as Source - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/09/10 13:38:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25220) [K8S] Split out node selector config between driver and executors. - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:41:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25220) [K8S] Split out node selector config between driver and executors. - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:42:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25036) Scala 2.12 issues: Compilation error with sbt - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:43:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24958) Report executors' process tree total memory information to heartbeat signals - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:44:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24958) Report executors' process tree total memory information to heartbeat signals - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25394) Expose App status metrics as Source - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/10 13:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25394) Expose App status metrics as Source - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/10 13:45:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24656) SparkML Transformers and Estimators with multiple columns - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:45:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24656) SparkML Transformers and Estimators with multiple columns - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:45:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24647) Sink Should Return Writen Offsets For ProgressReporting - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:46:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24647) Sink Should Return Writen Offsets For ProgressReporting - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24550) Add support for Kubernetes specific metrics - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:47:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24550) Add support for Kubernetes specific metrics - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25394) Expose App status metrics as Source - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/09/10 13:48:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24498) Add JDK compiler for runtime codegen - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:48:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24498) Add JDK compiler for runtime codegen - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:48:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24429) Add support for spark.driver.extraJavaOptions in cluster mode for Spark on K8s - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24429) Add support for spark.driver.extraJavaOptions in cluster mode for Spark on K8s - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24253) DataSourceV2: Add DeleteSupport for delete and overwrite operations - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24353) Add support for pod affinity/anti-affinity - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:50:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24353) Add support for pod affinity/anti-affinity - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24253) DataSourceV2: Add DeleteSupport for delete and overwrite operations - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:51:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24252) DataSourceV2: Add catalog support - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:54:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24252) DataSourceV2: Add catalog support - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24225) Support closing AutoClosable objects in MemoryStore so Broadcast Variables can be released properly - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24225) Support closing AutoClosable objects in MemoryStore so Broadcast Variables can be released properly - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24156) Enable no-data micro batches for more eager streaming state clean up - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24091) Internally used ConfigMap prevents use of user-specified ConfigMaps carrying Spark configs files - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:56:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24156) Enable no-data micro batches for more eager streaming state clean up - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:56:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24091) Internally used ConfigMap prevents use of user-specified ConfigMaps carrying Spark configs files - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23977) Add commit protocol binding to Hadoop 3.1 PathOutputCommitter mechanism - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23977) Add commit protocol binding to Hadoop 3.1 PathOutputCommitter mechanism - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23906) Add UDF trunc(numeric) - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:02:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23906) Add UDF trunc(numeric) - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:02:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-23899) Built-in SQL Function Improvement - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:05:02 UTC, 0 replies.
- [jira] [Commented] (SPARK-23899) Built-in SQL Function Improvement - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:05:02 UTC, 1 replies.
- [jira] [Updated] (SPARK-23712) Investigate replacing Code Generated UnsafeRowJoiner with an Interpreted version - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:06:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23712) Investigate replacing Code Generated UnsafeRowJoiner with an Interpreted version - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:06:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23648) extend hint syntax to support any expression for R - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23648) extend hint syntax to support any expression for R - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23647) extend hint syntax to support any expression for Python - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:08:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23647) extend hint syntax to support any expression for Python - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23597) Audit Spark SQL code base for non-interpreted expressions - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:10:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-23580) Interpreted mode fallback should be implemented for all expressions & projections - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:11:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-23483) Feature parity for Python vs Scala APIs - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:13:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-23171) Reduce the time costs of the rule runs that do not change the plans - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23200) Reset configuration when restarting from checkpoints - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:17:00 UTC, 7 replies.
- [jira] [Commented] (SPARK-23160) Add more window sql tests - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23160) Add more window sql tests - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23171) Reduce the time costs of the rule runs that do not change the plans - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23153) Support application dependencies in submission client's local file system - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23153) Support application dependencies in submission client's local file system - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-22798) Add multiple column support to PySpark StringIndexer - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:20:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-22798) Add multiple column support to PySpark StringIndexer - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:20:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-22796) Add multiple column support to PySpark QuantileDiscretizer - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-22796) Add multiple column support to PySpark QuantileDiscretizer - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-20715) MapStatuses shouldn't be redundantly stored in both ShuffleMapStage and MapOutputTracker - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/10 14:25:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-22632) Fix the behavior of timestamp values for R's DataFrame to respect session timezone - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:26:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-22055) Port release scripts - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:29:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-22055) Port release scripts - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:29:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-22054) Allow release managers to inject their keys - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-22054) Allow release managers to inject their keys - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-21972) Allow users to control input data persistence in ML Estimators via a handlePersistence ml.Param - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-21972) Allow users to control input data persistence in ML Estimators via a handlePersistence ml.Param - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:31:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-21940) Support timezone for timestamps in SparkR - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-21940) Support timezone for timestamps in SparkR - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-21395) Spark SQL hive-thriftserver doesn't register operation log before execute sql statement - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-21395) Spark SQL hive-thriftserver doesn't register operation log before execute sql statement - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-21320) Make sure all expressions support interpreted evaluation - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:35:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-21320) Make sure all expressions support interpreted evaluation - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:35:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25395) Remove Spark Optional Java API - posted by "Mario Molina (JIRA)" <ji...@apache.org> on 2018/09/10 14:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-21291) R bucketBy partitionBy API - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-21291) R bucketBy partitionBy API - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 14:54:00 UTC, 8 replies.
- [jira] [Commented] (SPARK-25395) Remove Spark Optional Java API - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/10 15:07:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25395) Remove Spark Optional Java API - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/10 15:07:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25376) Scenarios we should handle but missed in 2.4 for barrier execution mode - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/09/10 15:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25396) Read array of JSON objects via an Iterator - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/09/10 16:29:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25378) ArrayData.toArray(StringType) assume UTF8String in 2.4 - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/10 16:30:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25396) Read array of JSON objects via an Iterator - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/09/10 16:31:00 UTC, 4 replies.
- [jira] [Updated] (SPARK-25396) Read array of JSON objects via an Iterator - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/09/10 16:34:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-21542) Helper functions for custom Python Persistence - posted by "Peter Knight (JIRA)" <ji...@apache.org> on 2018/09/10 16:56:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-23425) load data for hdfs file path with wild card usage is not working properly - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/09/10 17:43:00 UTC, 4 replies.
- [jira] [Created] (SPARK-25397) SparkSession.conf fails when given default value with Python 3 - posted by "Joseph K. Bradley (JIRA)" <ji...@apache.org> on 2018/09/10 17:46:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25091) UNCACHE TABLE, CLEAR CACHE, rdd.unpersist() does not clean up executor memory - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/09/10 17:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25397) SparkSession.conf fails when given default value with Python 3 - posted by "Joseph K. Bradley (JIRA)" <ji...@apache.org> on 2018/09/10 17:50:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-25397) SparkSession.conf fails when given default value with Python 3 - posted by "Joseph K. Bradley (JIRA)" <ji...@apache.org> on 2018/09/10 17:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25395) Remove Spark Optional Java API - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/09/10 17:50:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23425) load data for hdfs file path with wild card usage is not working properly - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/09/10 17:51:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-12417) Orc bloom filter options are not propagated during file write in spark - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/10 18:23:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-12417) Orc bloom filter options are not propagated during file write in spark - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/10 18:24:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-23672) Document Support returning lists in Arrow UDFs - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/09/10 18:37:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23672) Document Support returning lists in Arrow UDFs - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/09/10 18:37:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23986) CompileException when using too many avg aggregation after joining - posted by "Dmitry Zanozin (JIRA)" <ji...@apache.org> on 2018/09/10 19:47:00 UTC, 4 replies.
- [jira] [Comment Edited] (SPARK-23986) CompileException when using too many avg aggregation after joining - posted by "Dmitry Zanozin (JIRA)" <ji...@apache.org> on 2018/09/10 19:48:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25398) Minor bugs from comparing unrelated types - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/10 19:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25398) Minor bugs from comparing unrelated types - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/10 20:08:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25398) Minor bugs from comparing unrelated types - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/10 20:08:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25399) Reusing execution threads from continuous processing for microbatch streaming can result in correctness issues - posted by "Mukul Murthy (JIRA)" <ji...@apache.org> on 2018/09/10 21:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25399) Reusing execution threads from continuous processing for microbatch streaming can result in correctness issues - posted by "Mukul Murthy (JIRA)" <ji...@apache.org> on 2018/09/10 21:27:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-25399) Reusing execution threads from continuous processing for microbatch streaming can result in correctness issues - posted by "Mukul Murthy (JIRA)" <ji...@apache.org> on 2018/09/10 21:27:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25400) Increase timeouts in schedulerIntegrationSuite - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/09/10 21:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25400) Increase timeouts in schedulerIntegrationSuite - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/09/10 22:05:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-25400) Increase timeouts in schedulerIntegrationSuite - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/10 22:07:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-13587) Support virtualenv in PySpark - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/10 23:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25072) PySpark custom Row class can be given extra parameters - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/10 23:52:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25399) Reusing execution threads from continuous processing for microbatch streaming can result in correctness issues - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/10 23:59:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-25184) Flaky test: FlatMapGroupsWithState "streaming with processing time timeout" - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 00:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24882) data source v2 API improvement - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/11 02:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-22632) Fix the behavior of timestamp values for R's DataFrame to respect session timezone - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 03:54:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-20715) MapStatuses shouldn't be redundantly stored in both ShuffleMapStage and MapOutputTracker - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 04:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23515) JsonProtocol.sparkEventToJson can OOM when jsonifying an event - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 05:08:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25401) Reorder the required ordering to match the table's output ordering for bucket join - posted by "Wang, Gang (JIRA)" <ji...@apache.org> on 2018/09/11 06:16:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23207) Shuffle+Repartition on an DataFrame could lead to incorrect answers - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/09/11 06:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25402) Null handling in BooleanSimplification - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/11 06:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25402) Null handling in BooleanSimplification - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/11 07:09:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25402) Null handling in BooleanSimplification - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/11 07:09:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25392) [Spark Job History]Inconsistent behaviour for pool details in spark web UI and history server page - posted by "sandeep katta (JIRA)" <ji...@apache.org> on 2018/09/11 08:57:00 UTC, 7 replies.
- [jira] [Created] (SPARK-25403) Broadcast join is changing to sort merge join , after spark-beeline session restarts. - posted by "Ayush Anubhava (JIRA)" <ji...@apache.org> on 2018/09/11 09:18:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25321) ML, Graph 2.4 QA: API: New Scala APIs, docs - posted by "Weichen Xu (JIRA)" <ji...@apache.org> on 2018/09/11 10:00:00 UTC, 7 replies.
- [jira] [Created] (SPARK-25404) Staging path may not on the expected place when table path contains the stagingDir string - posted by "Jinhua Fu (JIRA)" <ji...@apache.org> on 2018/09/11 10:44:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25404) Staging path may not on the expected place when table path contains the stagingDir string - posted by "Jinhua Fu (JIRA)" <ji...@apache.org> on 2018/09/11 10:49:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25241) Configurable empty values when reading/writing CSV files - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/11 12:52:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25241) Configurable empty values when reading/writing CSV files - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/11 12:52:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25403) Broadcast join is changing to sort merge join , after spark-beeline session restarts. - posted by "Ayush Anubhava (JIRA)" <ji...@apache.org> on 2018/09/11 13:06:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25386) Don't need to synchronize the IndexShuffleBlockResolver for each writeIndexFileAndCommit call - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/11 13:56:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-21076) R dapply doesn't return array or raw columns when array have different length - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:02:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-21076) R dapply doesn't return array or raw columns when array have different length - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:02:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-20971) Purge the metadata log for FileStreamSource - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:04:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-20971) Purge the metadata log for FileStreamSource - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:04:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-20712) [SPARK 2.1 REGRESSION][SQL] Spark can't read Hive table when column type has length greater than 4000 bytes - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-20602) Adding LBFGS optimizer and Squared_hinge loss for LinearSVC - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:05:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-20602) Adding LBFGS optimizer and Squared_hinge loss for LinearSVC - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:06:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-20319) Already quoted identifiers are getting wrapped with additional quotes - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:06:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-20007) Make SparkR apply() functions robust to workers that return empty data.frame - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-20184) performance regression for complex/long sql when enable whole stage codegen - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:08:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-20007) Make SparkR apply() functions robust to workers that return empty data.frame - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-19952) Remove specialized catalog related analysis exceptions - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:10:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-19952) Remove specialized catalog related analysis exceptions - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-19903) Watermark metadata is lost when using resolved attributes - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:11:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-19842) Informational Referential Integrity Constraints Support in Spark - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-19489) Stable serialization format for external & native code integration - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:12:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-19242) SHOW CREATE TABLE should generate new syntax to create hive table - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:13:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-19241) remove hive generated table properties if they are not useful in Spark - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:13:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-19084) conditional function: field - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:14:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-19027) estimate size of object buffer for object hash aggregate - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:14:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-19084) conditional function: field - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-18570) Consider supporting other R formula operators - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-18570) Consider supporting other R formula operators - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-19014) support complex aggregate buffer in HashAggregateExec - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-18569) Support R formula arithmetic - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:16:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-18543) SaveAsTable(CTAS) using overwrite could change table definition - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:16:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-18569) Support R formula arithmetic - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:16:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-18455) General support for correlated subquery processing - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:17:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-18245) Improving support for bucketed table - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-18388) Running aggregation on many columns throws SOE - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:18:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-18388) Running aggregation on many columns throws SOE - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-18134) SQL: MapType in Group BY and Joins not working - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-18084) write.partitionBy() does not recognize nested columns that select() can access - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:20:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-18084) write.partitionBy() does not recognize nested columns that select() can access - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:20:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25392) [Spark Job History]Inconsistent behaviour for pool details in spark web UI and history server page - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/11 14:21:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-17939) Spark-SQL Nullability: Optimizations vs. Enforcement Clarification - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-17939) Spark-SQL Nullability: Optimizations vs. Enforcement Clarification - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:21:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-16483) Unifying struct fields and columns - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-16483) Unifying struct fields and columns - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-17915) Prepare ColumnVector implementation for UnsafeData - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-16452) basic INFORMATION_SCHEMA support - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:23:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-16412) Generate Java code that gets an array in each column of CachedBatch when DataFrame.cache() is called - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:24:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25405) Saving RDD with new Hadoop API file as a Sequence File too restrictive - posted by "Marcin Gasior (JIRA)" <ji...@apache.org> on 2018/09/11 14:24:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-16390) Dataset API improvements - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-16323) Avoid unnecessary cast when doing integral divide - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:27:00 UTC, 3 replies.
- [jira] [Updated] (SPARK-16323) Avoid unnecessary cast when doing integral divide - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:27:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-16275) Implement all the Hive fallback functions - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:28:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-16217) Support SELECT INTO statement - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:28:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-16217) Support SELECT INTO statement - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:29:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-16011) SQL metrics include duplicated attempts - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:30:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-16196) Optimize in-memory scan performance using ColumnarBatches - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:30:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-16011) SQL metrics include duplicated attempts - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-15867) Use bucket files for TABLESAMPLE BUCKET - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-16011) SQL metrics include duplicated attempts - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-15867) Use bucket files for TABLESAMPLE BUCKET - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-15694) Implement ScriptTransformation in sql/core - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-15693) Write schema definition out for file-based data sources to avoid schema inference - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:34:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-15691) Refactor and improve Hive support - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:34:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-15690) Fast single-node (single-process) in-memory shuffle - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-15690) Fast single-node (single-process) in-memory shuffle - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-15420) Repartition and sort before Parquet writes - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:36:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-15380) Generate code that stores a float/double value in each column from ColumnarBatch when DataFrame.cache() is used - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:37:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-14922) Alter Table Drop Partition Using Predicate-based Partition Spec - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:38:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-14098) Generate Java code to build CachedColumnarBatch and get values from CachedColumnarBatch when DataFrame.cache() is called - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-13682) Finalize the public API for FileFormat - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:40:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-13682) Finalize the public API for FileFormat - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:40:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-12978) Skip unnecessary final group-by when input data already clustered with group-by keys - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:44:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-8000) SQLContext.read.load() should be able to auto-detect input data - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:45:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-9576) DataFrame API improvement umbrella ticket (in Spark 2.x) - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:46:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-7768) Make user-defined type (UDT) API public - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:46:01 UTC, 0 replies.
- [jira] [Commented] (SPARK-7768) Make user-defined type (UDT) API public - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:47:01 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-7768) Make user-defined type (UDT) API public - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/11 14:48:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25406) Incorrect usage of withSQLConf method in Parquet schema pruning test suite masks failing tests - posted by "Michael Allman (JIRA)" <ji...@apache.org> on 2018/09/11 14:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25406) Incorrect usage of withSQLConf method in Parquet schema pruning test suite masks failing tests - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/11 15:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25406) Incorrect usage of withSQLConf method in Parquet schema pruning test suite masks failing tests - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/11 15:20:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-25406) Incorrect usage of withSQLConf method in Parquet schema pruning test suite masks failing tests - posted by "Michael Allman (JIRA)" <ji...@apache.org> on 2018/09/11 15:49:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25407) Spark throws a `ParquetDecodingException` when attempting to read a field from a complex type in certain cases of schema merging - posted by "Michael Allman (JIRA)" <ji...@apache.org> on 2018/09/11 16:00:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25389) INSERT OVERWRITE DIRECTORY STORED AS should prevent duplicate fields - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/11 16:00:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25407) Spark throws a `ParquetDecodingException` when attempting to read a field from a complex type in certain cases of schema merging - posted by "Michael Allman (JIRA)" <ji...@apache.org> on 2018/09/11 16:01:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25221) [DEPLOY] Consistent trailing whitespace treatment of conf values - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/09/11 16:30:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25221) [DEPLOY] Consistent trailing whitespace treatment of conf values - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/09/11 16:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-19903) Watermark metadata is lost when using resolved attributes - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/09/11 16:59:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24889) dataset.unpersist() doesn't update storage memory stats - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/09/11 17:47:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25164) Parquet reader builds entire list of columns once for each column - posted by "Ruslan Dautkhanov (JIRA)" <ji...@apache.org> on 2018/09/11 18:59:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-25164) Parquet reader builds entire list of columns once for each column - posted by "Ruslan Dautkhanov (JIRA)" <ji...@apache.org> on 2018/09/11 19:00:02 UTC, 1 replies.
- [jira] [Commented] (SPARK-15815) Hang while enable blacklistExecutor and DynamicExecutorAllocator - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/11 19:27:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-15815) Hang while enable blacklistExecutor and DynamicExecutorAllocator - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/11 19:28:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25398) Minor bugs from comparing unrelated types - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/11 19:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23820) Allow the long form of call sites to be recorded in the log - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/11 19:54:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-23820) Allow the long form of call sites to be recorded in the log - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/11 19:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25170) Add Task Metrics description to the documentation - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/11 19:59:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-23820) Allow the long form of call sites to be recorded in the log - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/11 20:03:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-23820) Allow the long form of call sites to be recorded in the log - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/11 20:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25408) Move to idiomatic Java 8 - posted by "Fokko Driesprong (JIRA)" <ji...@apache.org> on 2018/09/11 20:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25408) Move to idiomatic Java 8 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/11 20:48:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25408) Move to idiomatic Java 8 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/11 20:48:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25409) Speed up Spark History at start if there are tens of thousands of applications. - posted by "Rong Tang (JIRA)" <ji...@apache.org> on 2018/09/11 22:01:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25409) Speed up Spark History at start if there are tens of thousands of applications. - posted by "Rong Tang (JIRA)" <ji...@apache.org> on 2018/09/11 22:03:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25399) Reusing execution threads from continuous processing for microbatch streaming can result in correctness issues - posted by "Tathagata Das (JIRA)" <ji...@apache.org> on 2018/09/11 22:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24572) "eager execution" for R shell, IDE - posted by "Weiqiang Zhuang (JIRA)" <ji...@apache.org> on 2018/09/11 22:57:00 UTC, 3 replies.
- [jira] [Updated] (SPARK-25395) Replace Spark Optional class with Java Optional - posted by "Mario Molina (JIRA)" <ji...@apache.org> on 2018/09/11 23:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25409) Speed up Spark History at start if there are tens of thousands of applications. - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/12 00:29:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-19489) Stable serialization format for external & native code integration - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/12 00:32:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-19489) Stable serialization format for external & native code integration - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/12 00:32:01 UTC, 0 replies.
- [jira] [Created] (SPARK-25410) Spark executor on YARN does not include memoryOverhead when starting an ExecutorRunnable - posted by "Anbang Hu (JIRA)" <ji...@apache.org> on 2018/09/12 00:49:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25410) Spark executor on YARN does not include memoryOverhead when starting an ExecutorRunnable - posted by "Anbang Hu (JIRA)" <ji...@apache.org> on 2018/09/12 00:59:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25354) Parquet vectorized record reader has unneeded operation in several methods - posted by "SongYadong (JIRA)" <ji...@apache.org> on 2018/09/12 01:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25411) Implement range partition in Spark - posted by "Wang, Gang (JIRA)" <ji...@apache.org> on 2018/09/12 02:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25238) Lint-Python: Upgrading to the current version of pycodestyle fails - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/12 03:24:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-23483) Feature parity for Python vs Scala APIs - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/12 03:28:00 UTC, 1 replies.
- [jira] [Reopened] (SPARK-23483) Feature parity for Python vs Scala APIs - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/12 03:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-23483) Feature parity for Python vs Scala APIs - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/12 03:30:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25378) ArrayData.toArray(StringType) assume UTF8String in 2.4 - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/12 03:42:00 UTC, 8 replies.
- [jira] [Resolved] (SPARK-25410) Spark executor on YARN does not include memoryOverhead when starting an ExecutorRunnable - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/09/12 04:51:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25385) Upgrade jackson version to 2.7.8 - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/12 04:56:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25412) FeatureHasher would change the value of output feature - posted by "Vincent (JIRA)" <ji...@apache.org> on 2018/09/12 05:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25412) FeatureHasher would change the value of output feature - posted by "Vincent (JIRA)" <ji...@apache.org> on 2018/09/12 05:46:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25413) [2.3.2.rc5 Blocker] Precision Value is going for toss when Avg is done - posted by "sandeep katta (JIRA)" <ji...@apache.org> on 2018/09/12 08:31:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25413) [2.3.2.rc5 Blocker] Precision Value is going for toss when Avg is done - posted by "sandeep katta (JIRA)" <ji...@apache.org> on 2018/09/12 08:33:00 UTC, 4 replies.
- [jira] [Assigned] (SPARK-25413) [2.3.2.rc5 Blocker] Precision Value is going for toss when Avg is done - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/12 08:34:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25413) [2.3.2.rc5 Blocker] Precision Value is going for toss when Avg is done - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/12 08:34:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25414) The numInputRows metrics can be incorrect for streaming self-join - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/12 10:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25414) The numInputRows metrics can be incorrect for streaming self-join - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/12 11:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25414) The numInputRows metrics can be incorrect for streaming self-join - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/12 11:14:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-20799) Unable to infer schema for ORC/Parquet on S3N when secrets are in the URL - posted by "Steve Loughran (JIRA)" <ji...@apache.org> on 2018/09/12 11:43:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-20153) Support Multiple aws credentials in order to access multiple Hive on S3 table in spark application - posted by "Steve Loughran (JIRA)" <ji...@apache.org> on 2018/09/12 11:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25371) Vector Assembler with no input columns leads to opaque error - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/12 12:36:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24627) [Spark2.3.0] After HDFS Token expire kinit not able to submit job using beeline - posted by "Ayush Anubhava (JIRA)" <ji...@apache.org> on 2018/09/12 12:53:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24627) [Spark2.3.0] After HDFS Token expire kinit not able to submit job using beeline - posted by "Ayush Anubhava (JIRA)" <ji...@apache.org> on 2018/09/12 12:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25352) Perform ordered global limit when limit number is bigger than topKSortFallbackThreshold - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/12 14:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25295) Pod names conflicts in client mode, if previous submission was not a clean shutdown. - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/09/12 15:30:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25363) Schema pruning doesn't work if nested column is used in where clause - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/09/12 17:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-20799) Unable to infer schema for ORC/Parquet on S3N when secrets are in the URL - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/12 19:41:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-20799) Unable to infer schema for ORC/Parquet on S3N when secrets are in the URL - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/12 19:41:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-20350) Apply Complementation Laws during boolean expression simplification - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/12 19:43:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25295) Pod names conflicts in client mode, if previous submission was not a clean shutdown. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/12 19:59:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25415) Make plan change log in RuleExecutor configurable by SQLConf - posted by "Maryann Xue (JIRA)" <ji...@apache.org> on 2018/09/12 21:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25416) ArrayPosition may return incorrect result when right expression is downcasted. - posted by "Dilip Biswal (JIRA)" <ji...@apache.org> on 2018/09/12 21:14:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-25416) ArrayPosition function may return incorrect result when right expression is implicitly downcasted. - posted by "Dilip Biswal (JIRA)" <ji...@apache.org> on 2018/09/12 21:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25415) Make plan change log in RuleExecutor configurable by SQLConf - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/12 21:37:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25415) Make plan change log in RuleExecutor configurable by SQLConf - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/12 21:37:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25417) ArrayContains function may return incorrect result when right expression is implicitly down casted - posted by "Dilip Biswal (JIRA)" <ji...@apache.org> on 2018/09/12 22:10:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25417) ArrayContains function may return incorrect result when right expression is implicitly down casted - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/12 22:29:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25417) ArrayContains function may return incorrect result when right expression is implicitly down casted - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/12 22:29:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25416) ArrayPosition function may return incorrect result when right expression is implicitly downcasted. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/12 22:31:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25416) ArrayPosition function may return incorrect result when right expression is implicitly downcasted. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/12 22:31:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-23012) Support for predicate pushdown and partition pruning when left joining large Hive tables - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/13 00:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25291) Flakiness of tests in terms of executor memory (SecretsTestSuite) - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/09/13 00:33:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-25291) Flakiness of tests in terms of executor memory (SecretsTestSuite) - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/09/13 00:42:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-23820) Allow the long form of call sites to be recorded in the log - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/13 01:47:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25387) Malformed CSV causes NPE - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/13 01:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25357) Add metadata to SparkPlanInfo to dump more information like file path to event log - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/13 02:00:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25402) Null handling in BooleanSimplification - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/13 02:02:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25357) Add metadata to SparkPlanInfo to dump more information like file path to event log - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/13 02:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25415) Make plan change log in RuleExecutor configurable by SQLConf - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/13 04:58:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25415) Make plan change log in RuleExecutor configurable by SQLConf - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/13 04:58:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25295) Pod names conflicts in client mode, if previous submission was not a clean shutdown. - posted by "Yinan Li (JIRA)" <ji...@apache.org> on 2018/09/13 05:09:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25418) The metadata of DataSource table should not include Hive-generated storage properties. - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/09/13 05:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25418) The metadata of DataSource table should not include Hive-generated storage properties. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/13 05:29:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25418) The metadata of DataSource table should not include Hive-generated storage properties. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/13 05:29:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24538) ByteArrayDecimalType support push down to parquet data sources - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/13 07:01:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-20937) Describe spark.sql.parquet.writeLegacyFormat property in Spark SQL, DataFrames and Datasets Guide - posted by "Sergei (JIRA)" <ji...@apache.org> on 2018/09/13 07:13:00 UTC, 4 replies.
- [jira] [Created] (SPARK-25419) Parquet predicate pushdown improvement - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/13 07:41:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24538) ByteArrayDecimalType support push down to parquet data sources - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/13 07:42:00 UTC, 3 replies.
- [jira] [Updated] (SPARK-23727) Support DATE predict push down in parquet - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/13 07:44:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24706) Support ByteType and ShortType pushdown to parquet - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/13 07:46:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24638) StringStartsWith support push down - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/13 07:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24549) Support DecimalType push down to the parquet data sources - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/13 07:48:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24718) Timestamp support pushdown to parquet data source - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/13 07:49:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24716) Refactor ParquetFilters - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/13 07:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25419) Parquet predicate pushdown improvement - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/13 07:49:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-17091) Convert IN predicate to equivalent Parquet filter - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/13 07:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25207) Case-insensitve field resolution for filter pushdown when reading Parquet - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/13 07:55:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25412) FeatureHasher would change the value of output feature - posted by "Nick Pentreath (JIRA)" <ji...@apache.org> on 2018/09/13 07:59:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25378) ArrayData.toArray(StringType) assume UTF8String in 2.4 - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/09/13 08:00:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24549) Support DecimalType push down to the parquet data sources - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/13 08:15:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-24549) Support DecimalType push down to the parquet data sources - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/13 08:15:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-24538) ByteArrayDecimalType support push down to parquet data sources - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/13 08:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24538) ByteArrayDecimalType support push down to parquet data sources - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/13 08:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25420) Dataset.count() every time is different. - posted by "huanghuai (JIRA)" <ji...@apache.org> on 2018/09/13 08:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25420) Dataset.count() every time is different. - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/09/13 08:42:00 UTC, 5 replies.
- [jira] [Commented] (SPARK-25420) Dataset.count() every time is different. - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/09/13 08:43:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-25420) Dataset.count() every time is different. - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/09/13 08:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25421) Abstract an output path field in trait DataWritingCommand - posted by "Lantao Jin (JIRA)" <ji...@apache.org> on 2018/09/13 10:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25421) Abstract an output path field in trait DataWritingCommand - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/13 11:09:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25421) Abstract an output path field in trait DataWritingCommand - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/13 11:09:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25404) Staging path may not on the expected place when table path contains the stagingDir string - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/13 11:51:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25404) Staging path may not on the expected place when table path contains the stagingDir string - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/13 11:51:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25402) Null handling in BooleanSimplification - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/13 13:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25422) flaky test: org.apache.spark.DistributedSuite.caching on disk, replicated (encryption = on) (with replication as stream) - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/13 14:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25422) flaky test: org.apache.spark.DistributedSuite.caching on disk, replicated (encryption = on) (with replication as stream) - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/13 14:34:00 UTC, 8 replies.
- [jira] [Updated] (SPARK-25407) Spark throws a `ParquetDecodingException` when attempting to read a field from a complex type in certain cases of schema merging - posted by "Michael Allman (JIRA)" <ji...@apache.org> on 2018/09/13 14:50:01 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25170) Add Task Metrics description to the documentation - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/13 15:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25170) Add Task Metrics description to the documentation - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/13 15:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25423) Output "dataFilters" in DataSourceScanExec.toString - posted by "Maryann Xue (JIRA)" <ji...@apache.org> on 2018/09/13 17:03:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25406) Incorrect usage of withSQLConf method in Parquet schema pruning test suite masks failing tests - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/09/13 17:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25423) Output "dataFilters" in DataSourceScanExec.metadata - posted by "Maryann Xue (JIRA)" <ji...@apache.org> on 2018/09/13 17:15:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-25424) Window duration and slide duration with negative values should fail fast - posted by "Raghav Kumar Gautam (JIRA)" <ji...@apache.org> on 2018/09/13 17:32:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25424) Window duration and slide duration with negative values should fail fast - posted by "Raghav Kumar Gautam (JIRA)" <ji...@apache.org> on 2018/09/13 17:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25424) Window duration and slide duration with negative values should fail fast - posted by "Raghav Kumar Gautam (JIRA)" <ji...@apache.org> on 2018/09/13 17:34:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-25338) Several tests miss calling super.afterAll() in their afterAll() method - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/13 18:36:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25400) Increase timeouts in schedulerIntegrationSuite - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/13 19:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25425) Extra options must overwrite sessions options - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/09/13 20:16:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25053) Allow additional port forwarding on Spark on K8S as needed - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/09/13 22:03:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-23200) Reset configuration when restarting from checkpoints - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/09/14 00:45:00 UTC, 5 replies.
- [jira] [Updated] (SPARK-23200) Reset configuration when restarting from checkpoints - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/14 00:56:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25293) Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir - posted by "omkar puttagunta (JIRA)" <ji...@apache.org> on 2018/09/14 01:58:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25293) Dataframe write to csv saves part files in outputDireotry/task-xx/part-xxx instead of directly saving in outputDir - posted by "omkar puttagunta (JIRA)" <ji...@apache.org> on 2018/09/14 02:04:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25414) make it clear that the numRows metrics should be counted for each scan of the source - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/14 02:19:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25426) Handles subexpression elimination config inside CodeGeneratorWithInterpretedFallback - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/09/14 02:23:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25427) Add BloomFilter creation test cases - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/14 05:11:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25418) The metadata of DataSource table should not include Hive-generated storage properties. - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/14 05:24:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25427) Add BloomFilter creation test cases - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/14 05:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25428) Support plain Kerberos Authentication with Spark - posted by "Shruti Gumma (JIRA)" <ji...@apache.org> on 2018/09/14 06:02:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25429) SparkListenerBus inefficient due to 'LiveStageMetrics#accumulatorIds:Array[Long]' data structure - posted by "DENG FEI (JIRA)" <ji...@apache.org> on 2018/09/14 06:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25429) SparkListenerBus inefficient due to 'LiveStageMetrics#accumulatorIds:Array[Long]' data structure - posted by "DENG FEI (JIRA)" <ji...@apache.org> on 2018/09/14 07:48:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-25374) SafeProjection supports fallback to an interpreted mode - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/09/14 08:04:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25430) Add map parameter for withColumnRenamed - posted by "Goun Na (JIRA)" <ji...@apache.org> on 2018/09/14 08:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25430) Add map parameter for withColumnRenamed - posted by "Goun Na (JIRA)" <ji...@apache.org> on 2018/09/14 08:50:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25431) Fix function examples and unify the format of the functions results. - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/09/14 09:27:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25431) Fix function examples and unify the format of the example results. - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/09/14 09:35:00 UTC, 6 replies.
- [jira] [Updated] (SPARK-25426) Remove the duplicate fallback logic in UnsafeProjection - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/09/14 10:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25430) Add map parameter for withColumnRenamed - posted by "Goun Na (JIRA)" <ji...@apache.org> on 2018/09/14 10:58:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-21652) Optimizer cannot reach a fixed point on certain queries - posted by "Pengfei Chang (JIRA)" <ji...@apache.org> on 2018/09/14 11:09:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-21652) Optimizer cannot reach a fixed point on certain queries - posted by "Pengfei Chang (JIRA)" <ji...@apache.org> on 2018/09/14 11:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24410) Missing optimization for Union on bucketed tables - posted by "Eyal Farago (JIRA)" <ji...@apache.org> on 2018/09/14 11:38:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25431) Fix function examples and unify the format of the example results. - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/09/14 13:45:00 UTC, 3 replies.
- [jira] [Updated] (SPARK-23899) Built-in SQL Function Improvement - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/14 14:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25432) Consider if using standard getOrCreate from PySpark into JVM SparkSession would simplify code - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/09/14 16:33:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25431) Fix function examples and unify the format of the example results. - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/14 16:55:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-25431) Fix function examples and unify the format of the example results. - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/14 16:55:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25433) Add support for PEX in PySpark - posted by "Fabian Höring (JIRA)" <ji...@apache.org> on 2018/09/14 17:17:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25433) Add support for PEX in PySpark - posted by "Fabian Höring (JIRA)" <ji...@apache.org> on 2018/09/14 17:26:00 UTC, 15 replies.
- [jira] [Updated] (SPARK-19480) Higher order functions in SQL - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/14 20:28:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25246) When the spark.eventLog.compress is enabled, the Application is not showing in the History server UI ('incomplete application' page), initially. - posted by "Devaraj K (JIRA)" <ji...@apache.org> on 2018/09/14 21:18:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-14948) Exception when joining DataFrames derived form the same DataFrame - posted by "Ashish Shrowty (JIRA)" <ji...@apache.org> on 2018/09/14 21:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24233) Union Operation on Read of Dataframe does NOT produce correct result - posted by "smohr003 (JIRA)" <ji...@apache.org> on 2018/09/14 22:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25238) Lint-Python: Upgrading to the current version of pycodestyle fails - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/15 01:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25238) Lint-Python: Upgrading to the current version of pycodestyle fails - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/15 01:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25434) failed to locate the winutils binary in the hadoop binary path - posted by "WEI PENG (JIRA)" <ji...@apache.org> on 2018/09/15 01:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25434) failed to locate the winutils binary in the hadoop binary path - posted by "WEI PENG (JIRA)" <ji...@apache.org> on 2018/09/15 01:37:00 UTC, 3 replies.
- [jira] [Updated] (SPARK-25434) failed to locate the winutils binary in the hadoop binary path - posted by "WEI PENG (JIRA)" <ji...@apache.org> on 2018/09/15 01:42:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23367) Include python document style checking - posted by "Rekha Joshi (JIRA)" <ji...@apache.org> on 2018/09/15 03:00:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25435) df = sqlContext.read.json("examples/src/main/resources/people.json") - posted by "WEI PENG (JIRA)" <ji...@apache.org> on 2018/09/15 04:44:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25435) df = sqlContext.read.json("examples/src/main/resources/people.json") - posted by "WEI PENG (JIRA)" <ji...@apache.org> on 2018/09/15 04:45:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25435) df = sqlContext.read.json("examples/src/main/resources/people.json") - posted by "WEI PENG (JIRA)" <ji...@apache.org> on 2018/09/15 04:46:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25436) Bump master branch version to 2.5.0-SNAPSHOT - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/15 05:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25437) Using OpenHashMap replace HashMap improve Encoder Performance - posted by "wangjiaochun (JIRA)" <ji...@apache.org> on 2018/09/15 06:04:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25425) Extra options must overwrite sessions options - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/15 07:19:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-25427) Add BloomFilter creation test cases - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/15 08:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25438) Fix FilterPushdownBenchmark to use the same memory assumption - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/15 09:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-15041) adding mode strategy for ml.feature.Imputer for categorical features - posted by "Manu Zhang (JIRA)" <ji...@apache.org> on 2018/09/15 09:23:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25438) Fix FilterPushdownBenchmark to use the same memory assumption - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/15 09:25:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25438) Fix FilterPushdownBenchmark to use the same memory assumption - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/15 09:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25439) [TESTS][SQL] TPCHQuerySuite customer.c_nationkey should be bigint instead of string - posted by "Nicolas Poggi (JIRA)" <ji...@apache.org> on 2018/09/15 14:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25439) [TESTS][SQL] TPCHQuerySuite customer.c_nationkey should be bigint instead of string - posted by "Nicolas Poggi (JIRA)" <ji...@apache.org> on 2018/09/15 15:04:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25440) Dump query execution info to a file - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/09/15 15:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25439) [TESTS][SQL] TPCHQuerySuite customer.c_nationkey should be bigint instead of string - posted by "Nicolas Poggi (JIRA)" <ji...@apache.org> on 2018/09/15 15:56:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25439) [TESTS][SQL] TPCHQuerySuite customer.c_nationkey should be bigint instead of string - posted by "Nicolas Poggi (JIRA)" <ji...@apache.org> on 2018/09/15 16:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25441) calculate term frequency in CountVectorizer() - posted by "Xinyong Tian (JIRA)" <ji...@apache.org> on 2018/09/15 16:17:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25439) TPCHQuerySuite customer.c_nationkey should be bigint instead of string - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/15 20:24:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25426) Remove the duplicate fallback logic in UnsafeProjection - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/15 23:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25436) Bump master branch version to 2.5.0-SNAPSHOT - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/15 23:25:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25425) Extra options must overwrite sessions options - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/16 00:39:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25425) Extra options must overwrite sessions options - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/16 00:39:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-25431) Fix function examples and unify the format of the example results. - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/16 00:42:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25438) Fix FilterPushdownBenchmark to use the same memory assumption - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/16 00:50:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25425) Extra options must overwrite sessions options - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/16 00:53:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-22017) watermark evaluation with multi-input stream operators is unspecified - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/16 01:52:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-22018) Catalyst Optimizer does not preserve top-level metadata while collapsing projects - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/16 01:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-22956) Union Stream Failover Cause `IllegalStateException` - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/16 01:56:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-22238) EnsureStatefulOpPartitioning shouldn't ask for the child RDD before planning is completed - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/16 01:57:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-23503) continuous execution should sequence committed epochs - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/16 02:02:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-23748) Support select from temp tables - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/16 02:48:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25439) TPCHQuerySuite customer.c_nationkey should be bigint instead of string - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/16 03:09:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25434) failed to locate the winutils binary in the hadoop binary path - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/16 03:45:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25434) failed to locate the winutils binary in the hadoop binary path - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/16 03:45:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24479) Register StreamingQueryListener in Spark Conf - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/16 04:06:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25442) Support STS to run in K8S deployment with spark deployment mode as cluster - posted by "Suryanarayana Garlapati (JIRA)" <ji...@apache.org> on 2018/09/16 05:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25442) Support STS to run in K8S deployment with spark deployment mode as cluster - posted by "Suryanarayana Garlapati (JIRA)" <ji...@apache.org> on 2018/09/16 05:55:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-25391) Make behaviors consistent when converting parquet hive table to parquet data source - posted by "Chenxiao Mao (JIRA)" <ji...@apache.org> on 2018/09/16 06:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24315) Multiple streaming jobs detected error causing job failure - posted by "Joey (JIRA)" <ji...@apache.org> on 2018/09/16 07:28:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-25380) Generated plans occupy over 50% of Spark driver memory - posted by "Nir Hedvat (JIRA)" <ji...@apache.org> on 2018/09/16 11:22:00 UTC, 1 replies.
- [jira] [Issue Comment Deleted] (SPARK-25153) Improve error messages for columns with dots/periods - posted by "Fernando Díaz (JIRA)" <ji...@apache.org> on 2018/09/16 14:07:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25423) Output "dataFilters" in DataSourceScanExec.metadata - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/17 00:12:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25423) Output "dataFilters" in DataSourceScanExec.metadata - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/17 00:12:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-25420) Dataset.count() every time is different. - posted by "huanghuai (JIRA)" <ji...@apache.org> on 2018/09/17 01:47:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25429) SparkListenerBus inefficient due to 'LiveStageMetrics#accumulatorIds:Array[Long]' data structure - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/17 01:55:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25433) Add support for PEX in PySpark - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/17 02:13:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-25437) Using OpenHashMap replace HashMap improve Encoder Performance - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/17 02:14:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-25437) Using OpenHashMap replace HashMap improve Encoder Performance - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/17 02:14:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-25434) failed to locate the winutils binary in the hadoop binary path - posted by "WEI PENG (JIRA)" <ji...@apache.org> on 2018/09/17 03:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25435) df = sqlContext.read.json("examples/src/main/resources/people.json") - posted by "WEI PENG (JIRA)" <ji...@apache.org> on 2018/09/17 03:25:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-25435) df = sqlContext.read.json("examples/src/main/resources/people.json") - posted by "WEI PENG (JIRA)" <ji...@apache.org> on 2018/09/17 03:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25443) fix issues when building docs with release scripts in docker - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/17 04:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23874) Upgrade apache/arrow to 0.10.0 - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/17 05:06:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24768) Have a built-in AVRO data source implementation - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/17 05:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24768) Have a built-in AVRO data source implementation - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/17 05:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25444) Refactor GenArrayData.genCodeToCreateArrayData() method - posted by "Kazuaki Ishizaki (JIRA)" <ji...@apache.org> on 2018/09/17 05:27:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-25391) Make behaviors consistent when converting parquet hive table to parquet data source - posted by "Chenxiao Mao (JIRA)" <ji...@apache.org> on 2018/09/17 05:50:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-21914) Running examples as tests in SQL builtin function documentation - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/17 06:01:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-21291) R bucketBy partitionBy API - posted by "Felix Cheung (JIRA)" <ji...@apache.org> on 2018/09/17 06:08:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25445) publish a scala 2.12 build with Spark 2.4 - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/17 10:58:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25445) publish a scala 2.12 build with Spark 2.4 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/17 11:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24151) CURRENT_DATE, CURRENT_TIMESTAMP incorrectly resolved as column names when caseSensitive is enabled - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/17 11:02:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25445) publish a scala 2.12 build with Spark 2.4 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/17 11:02:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25444) Refactor GenArrayData.genCodeToCreateArrayData() method - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/17 11:14:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25444) Refactor GenArrayData.genCodeToCreateArrayData() method - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/17 11:14:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24654) Update, fix LICENSE and NOTICE, and specialize for source vs binary - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/17 11:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25427) Add BloomFilter creation test cases - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/17 11:37:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25433) Add support for PEX in PySpark - posted by "Fabian Höring (JIRA)" <ji...@apache.org> on 2018/09/17 11:41:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25443) fix issues when building docs with release scripts in docker - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/17 12:14:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25443) fix issues when building docs with release scripts in docker - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/17 12:14:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25446) Add schema_of_json() to R - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/09/17 12:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25447) Support JSON options by schema_of_json - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/09/17 12:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25447) Support JSON options by schema_of_json - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/17 12:52:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25447) Support JSON options by schema_of_json - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/17 12:52:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-23580) Interpreted mode fallback should be implemented for all expressions & projections - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/17 12:55:01 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-23580) Interpreted mode fallback should be implemented for all expressions & projections - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/17 12:58:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only - posted by "ABHISHEK KUMAR GUPTA (JIRA)" <ji...@apache.org> on 2018/09/17 14:09:01 UTC, 0 replies.
- [jira] [Commented] (SPARK-25426) Remove the duplicate fallback logic in UnsafeProjection - posted by "Li Yuanjian (JIRA)" <ji...@apache.org> on 2018/09/17 14:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23829) spark-sql-kafka source in spark 2.3 causes reading stream failure frequently - posted by "Gabor Somogyi (JIRA)" <ji...@apache.org> on 2018/09/17 14:22:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25291) Flakiness of tests in terms of executor memory (SecretsTestSuite) - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/17 14:41:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24800) Refactor Avro Serializer and Deserializer - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/17 16:03:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25433) Add support for PEX in PySpark - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/17 16:59:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25302) ReducedWindowedDStream not using checkpoints for reduced RDDs - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/17 16:59:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25303) A DStream that is checkpointed should allow its parent(s) to be removed and not persisted - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/17 17:00:01 UTC, 1 replies.
- [jira] [Assigned] (SPARK-23906) Add UDF trunc(numeric) - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/17 17:00:01 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25442) Support STS to run in K8S deployment with spark deployment mode as cluster - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/17 17:00:01 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25430) Add map parameter for withColumnRenamed - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/17 17:00:01 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25429) SparkListenerBus inefficient due to 'LiveStageMetrics#accumulatorIds:Array[Long]' data structure - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/17 17:00:01 UTC, 1 replies.
- [jira] [Commented] (SPARK-25440) Dump query execution info to a file - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/17 17:00:01 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25424) Window duration and slide duration with negative values should fail fast - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/17 17:00:01 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25440) Dump query execution info to a file - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/17 17:00:01 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25339) Refactor FilterPushdownBenchmark to use main method - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/17 17:11:01 UTC, 2 replies.
- [jira] [Resolved] (SPARK-25423) Output "dataFilters" in DataSourceScanExec.metadata - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/17 18:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-16323) Avoid unnecessary cast when doing integral divide - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/17 18:35:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-16323) Avoid unnecessary cast when doing integral divide - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/17 18:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-20074) Make buffer size in unsafe external sorter configurable - posted by "Kevin English (JIRA)" <ji...@apache.org> on 2018/09/17 19:40:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-20760) Memory Leak of RDD blocks - posted by "Sandish Kumar HN (JIRA)" <ji...@apache.org> on 2018/09/17 20:15:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-22036) BigDecimal multiplication sometimes returns null - posted by "Bruce Robbins (JIRA)" <ji...@apache.org> on 2018/09/17 20:19:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25449) Don't send zero accumulators in heartbeats - posted by "Mukul Murthy (JIRA)" <ji...@apache.org> on 2018/09/17 21:32:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25409) Speed up Spark History at start if there are tens of thousands of applications. - posted by "Rong Tang (JIRA)" <ji...@apache.org> on 2018/09/17 22:13:01 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25443) fix issues when building docs with release scripts in docker - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/18 02:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25450) PushProjectThroughUnion rule uses the same exprId for project expressions in each Union child, causing mistakes in constant propagation - posted by "Maryann Xue (JIRA)" <ji...@apache.org> on 2018/09/18 02:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25450) PushProjectThroughUnion rule uses the same exprId for project expressions in each Union child, causing mistakes in constant propagation - posted by "Maryann Xue (JIRA)" <ji...@apache.org> on 2018/09/18 02:54:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25444) Refactor GenArrayData.genCodeToCreateArrayData() method - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/09/18 03:47:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25230) Upper behavior incorrect for string contains "ß" - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/18 04:47:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25321) ML, Graph 2.4 QA: API: New Scala APIs, docs - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/18 05:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25450) PushProjectThroughUnion rule uses the same exprId for project expressions in each Union child, causing mistakes in constant propagation - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/18 05:43:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24151) CURRENT_DATE, CURRENT_TIMESTAMP incorrectly resolved as column names when caseSensitive is enabled - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/18 06:21:00 UTC, 0 replies.
- [jira] [Issue Comment Deleted] (SPARK-20937) Describe spark.sql.parquet.writeLegacyFormat property in Spark SQL, DataFrames and Datasets Guide - posted by "Sergei (JIRA)" <ji...@apache.org> on 2018/09/18 06:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25451) Stages page doesn't show the right number of the total tasks - posted by "zuotingbing (JIRA)" <ji...@apache.org> on 2018/09/18 08:45:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25451) Stages page doesn't show the right number of the total tasks - posted by "zuotingbing (JIRA)" <ji...@apache.org> on 2018/09/18 08:46:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-25451) Stages page doesn't show the right number of the total tasks - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/18 09:27:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25451) Stages page doesn't show the right number of the total tasks - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/18 09:27:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-23081) Add colRegex API to PySpark - posted by "Darrell Taylor (JIRA)" <ji...@apache.org> on 2018/09/18 10:26:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-18185) Should fix INSERT OVERWRITE TABLE of Datasource tables with dynamic partitions - posted by "Deepanker (JIRA)" <ji...@apache.org> on 2018/09/18 11:14:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-20236) Overwrite a partitioned data source table should only overwrite related partitions - posted by "Deepanker (JIRA)" <ji...@apache.org> on 2018/09/18 11:15:01 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-18185) Should fix INSERT OVERWRITE TABLE of Datasource tables with dynamic partitions - posted by "Deepanker (JIRA)" <ji...@apache.org> on 2018/09/18 11:16:00 UTC, 5 replies.
- [jira] [Comment Edited] (SPARK-20236) Overwrite a partitioned data source table should only overwrite related partitions - posted by "Deepanker (JIRA)" <ji...@apache.org> on 2018/09/18 11:18:00 UTC, 4 replies.
- [jira] [Created] (SPARK-25452) Query with clause is giving unexpected result in case of float coloumn - posted by "Ayush Anubhava (JIRA)" <ji...@apache.org> on 2018/09/18 11:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25452) Query with clause is giving unexpected result in case of float coloumn - posted by "Ayush Anubhava (JIRA)" <ji...@apache.org> on 2018/09/18 11:21:00 UTC, 4 replies.
- [jira] [Updated] (SPARK-25411) Implement range partition in Spark - posted by "Wang, Gang (JIRA)" <ji...@apache.org> on 2018/09/18 11:29:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-25452) Query with clause is giving unexpected result in case of float coloumn - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/18 11:36:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-25452) Query with clause is giving unexpected result in case of float coloumn - posted by "Ayush Anubhava (JIRA)" <ji...@apache.org> on 2018/09/18 12:40:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25452) Query with where clause is giving unexpected result in case of float column - posted by "Ayush Anubhava (JIRA)" <ji...@apache.org> on 2018/09/18 12:57:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25453) OracleIntegrationSuite IllegalArgumentException: Timestamp format must be yyyy-mm-dd hh:mm:ss[.fffffffff] - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/18 13:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25453) OracleIntegrationSuite IllegalArgumentException: Timestamp format must be yyyy-mm-dd hh:mm:ss[.fffffffff] - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/18 13:19:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25454) Division between operands with negative scale can cause precision loss - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/09/18 13:45:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25455) Spark bundles jackson library version, which is vulnerable - posted by "Madhusudan N (JIRA)" <ji...@apache.org> on 2018/09/18 14:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25456) PythonForeachWriterSuite failing - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/09/18 14:11:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24777) Add write benchmark for AVRO - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/09/18 14:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25457) IntegralDivide (div) should not always return long - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/09/18 14:21:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25445) publish a scala 2.12 build with Spark 2.4 - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/18 14:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25458) Support FOR ALL COLUMNS in ANALYZE TABLE - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/18 15:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25458) Support FOR ALL COLUMNS in ANALYZE TABLE - posted by "Dilip Biswal (JIRA)" <ji...@apache.org> on 2018/09/18 15:47:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-25291) Flakiness of tests in terms of executor memory (SecretsTestSuite) - posted by "Yinan Li (JIRA)" <ji...@apache.org> on 2018/09/18 18:50:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25456) PythonForeachWriterSuite failing - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/09/18 21:35:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25456) PythonForeachWriterSuite failing - posted by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/09/18 21:35:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25419) Parquet predicate pushdown improvement - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/18 22:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24626) Parallelize size calculation in Analyze Table command - posted by "Reynold Xin (JIRA)" <ji...@apache.org> on 2018/09/18 23:02:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24626) Parallelize size calculation in Analyze Table command - posted by "Reynold Xin (JIRA)" <ji...@apache.org> on 2018/09/18 23:02:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25454) Division between operands with negative scale can cause precision loss - posted by "Bruce Robbins (JIRA)" <ji...@apache.org> on 2018/09/19 00:13:00 UTC, 4 replies.
- [jira] [Resolved] (SPARK-19724) create a managed table with an existed default location should throw an exception - posted by "Reynold Xin (JIRA)" <ji...@apache.org> on 2018/09/19 00:41:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25459) Add viewOriginalText back to CatalogTable - posted by "Zheyuan Zhao (JIRA)" <ji...@apache.org> on 2018/09/19 01:41:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25460) DataSourceV2: Structured Streaming does not respect SessionConfigSupport - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/19 04:45:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25461) PySpark Pandas UDF outputs incorrect results when input columns contain None - posted by "Chongyuan Xiang (JIRA)" <ji...@apache.org> on 2018/09/19 04:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23200) Reset configuration when restarting from checkpoints - posted by "Yinan Li (JIRA)" <ji...@apache.org> on 2018/09/19 05:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25460) DataSourceV2: Structured Streaming does not respect SessionConfigSupport - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/19 05:41:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-25452) Query with where clause is giving unexpected result in case of float column - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/19 06:15:00 UTC, 2 replies.
- [jira] [Moved] (SPARK-25462) hive on spark - got a weird output when count(*) from this script - posted by "Gu Yuchen (JIRA)" <ji...@apache.org> on 2018/09/19 06:46:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-25462) hive on spark - got a weird output when count(*) from this script - posted by "Gu Yuchen (JIRA)" <ji...@apache.org> on 2018/09/19 06:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25462) hive on spark - got a weird output when count(*) from this script - posted by "Gu Yuchen (JIRA)" <ji...@apache.org> on 2018/09/19 06:48:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25463) Make sure single expression can parse sort order - posted by "Herman van Hovell (JIRA)" <ji...@apache.org> on 2018/09/19 09:20:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25462) hive on spark - got a weird output when count(*) from this script - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/09/19 11:06:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25462) hive on spark - got a weird output when count(*) from this script - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/09/19 11:07:00 UTC, 0 replies.
- ***UNCHECKED*** [jira] [Commented] (SPARK-20937) Describe spark.sql.parquet.writeLegacyFormat property in Spark SQL, DataFrames and Datasets Guide - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/09/19 11:23:02 UTC, 0 replies.
- ***UNCHECKED*** [jira] [Created] (SPARK-25464) Dropping database can remove the hive warehouse directory contents - posted by "Sushanta Sen (JIRA)" <ji...@apache.org> on 2018/09/19 11:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25464) Dropping database can remove the hive warehouse directory contents - posted by "Sushanta Sen (JIRA)" <ji...@apache.org> on 2018/09/19 11:49:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24777) Add write benchmark for AVRO - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/09/19 11:52:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25464) Dropping database can remove the hive warehouse directory contents - posted by "sandeep katta (JIRA)" <ji...@apache.org> on 2018/09/19 11:53:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-25358) MutableProjection supports fallback to an interpreted mode - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/19 11:56:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25465) Refactor Parquet test suites in project Hive - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/09/19 12:02:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25466) Documentation does not specify how to set fafka consumer cache capacity for SS - posted by "Patrick McGloin (JIRA)" <ji...@apache.org> on 2018/09/19 13:26:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25466) Documentation does not specify how to set fafka consumer cache capacity for SS - posted by "Patrick McGloin (JIRA)" <ji...@apache.org> on 2018/09/19 13:27:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25467) Python date/datetime objects in dataframes increment by 1 day when converted to JSON - posted by "David V. Hill (JIRA)" <ji...@apache.org> on 2018/09/19 14:25:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25467) Python date/datetime objects in dataframes increment by 1 day when converted to JSON - posted by "David V. Hill (JIRA)" <ji...@apache.org> on 2018/09/19 14:30:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25468) Highlight current page index in the history server - posted by "Dhruve Ashar (JIRA)" <ji...@apache.org> on 2018/09/19 16:31:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25468) Highlight current page index in the history server - posted by "Dhruve Ashar (JIRA)" <ji...@apache.org> on 2018/09/19 16:31:00 UTC, 0 replies.
- ***UNCHECKED*** [jira] [Updated] (SPARK-25468) Highlight current page index in the history server - posted by "Dhruve Ashar (JIRA)" <ji...@apache.org> on 2018/09/19 16:32:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25414) make it clear that the numRows metrics should be counted for each scan of the source - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/19 16:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25469) Eval method of Concat expression should call pattern matching only once - posted by "Marek Novotny (JIRA)" <ji...@apache.org> on 2018/09/19 17:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25470) Eval method of Concat expression should call pattern matching only once - posted by "Marek Novotny (JIRA)" <ji...@apache.org> on 2018/09/19 17:42:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-15420) Repartition and sort before Parquet writes - posted by "Ryan Blue (JIRA)" <ji...@apache.org> on 2018/09/19 18:31:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-15420) Repartition and sort before Parquet writes - posted by "Ryan Blue (JIRA)" <ji...@apache.org> on 2018/09/19 18:31:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25449) Don't send zero accumulators in heartbeats - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/09/19 18:43:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24360) Support Hive 3.1 metastore - posted by "t oo (JIRA)" <ji...@apache.org> on 2018/09/19 21:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25471) Fix tests for Python 3.6 with Pandas 0.23+ - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/09/19 21:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25471) Fix tests for Python 3.6 with Pandas 0.23+ - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/09/19 21:36:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25472) Structured Streaming query.stop() doesn't always stop gracefully - posted by "Burak Yavuz (JIRA)" <ji...@apache.org> on 2018/09/19 21:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24523) InterruptedException when closing SparkContext - posted by "Umayr Hassan (JIRA)" <ji...@apache.org> on 2018/09/19 22:32:00 UTC, 12 replies.
- [jira] [Updated] (SPARK-24523) InterruptedException when closing SparkContext - posted by "Umayr Hassan (JIRA)" <ji...@apache.org> on 2018/09/19 22:33:00 UTC, 4 replies.
- [jira] [Updated] (SPARK-25021) Add spark.executor.pyspark.memory support to Kubernetes - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/09/19 22:40:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24309) AsyncEventQueue should handle an interrupt from a Listener - posted by "Umayr Hassan (JIRA)" <ji...@apache.org> on 2018/09/19 23:30:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25472) Structured Streaming query.stop() doesn't always stop gracefully - posted by "Burak Yavuz (JIRA)" <ji...@apache.org> on 2018/09/20 00:24:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-14352) approxQuantile should support multi columns - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/09/20 01:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25471) Fix tests for Python 3.6 with Pandas 0.23+ - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/20 01:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-14352) approxQuantile should support multi columns - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/09/20 01:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-17602) PySpark - Performance Optimization Large Size of Broadcast Variable - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/09/20 01:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25467) Python date/datetime objects in dataframes increment by 1 day when converted to JSON - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/09/20 01:35:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-23715) from_utc_timestamp returns incorrect results for some UTC date/time values - posted by "Reynold Xin (JIRA)" <ji...@apache.org> on 2018/09/20 01:43:00 UTC, 11 replies.
- [jira] [Commented] (SPARK-20598) Iterative checkpoints do not get removed from HDFS - posted by "holdenk (JIRA)" <ji...@apache.org> on 2018/09/20 01:43:00 UTC, 0 replies.
- [jira] [Issue Comment Deleted] (SPARK-25437) Using OpenHashMap replace HashMap improve Encoder Performance - posted by "Kazuaki Ishizaki (JIRA)" <ji...@apache.org> on 2018/09/20 02:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25432) Consider if using standard getOrCreate from PySpark into JVM SparkSession would simplify code - posted by "Kazuaki Ishizaki (JIRA)" <ji...@apache.org> on 2018/09/20 02:16:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25457) IntegralDivide (div) should not always return long - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/20 02:25:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25457) IntegralDivide (div) should not always return long - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/20 02:25:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25473) PySpark ForeachWriter test fails on Python 3.6 and mocOS High Serria - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/20 03:01:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25473) PySpark ForeachWriter test fails on Python 3.6 and macOS High Serria - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/20 03:03:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25470) Eval method of Concat expression should call pattern matching only once - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/20 03:36:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25469) Eval method of Concat expression should call pattern matching only once - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/20 03:36:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-10816) EventTime based sessionization - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/09/20 04:02:00 UTC, 18 replies.
- [jira] [Resolved] (SPARK-23648) extend hint syntax to support any expression for R - posted by "Felix Cheung (JIRA)" <ji...@apache.org> on 2018/09/20 04:29:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-10816) EventTime based sessionization - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/09/20 04:30:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25474) Size in bytes of the query is coming in EB in case of parquet datasource - posted by "Ayush Anubhava (JIRA)" <ji...@apache.org> on 2018/09/20 04:35:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25339) Refactor FilterPushdownBenchmark to use main method - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/20 04:37:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25339) Refactor FilterPushdownBenchmark to use main method - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/20 05:24:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25475) Refactor all benchmark to save the result as a separate file - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/20 05:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25474) Size in bytes of the query is coming in EB in case of parquet datasource - posted by "sandeep katta (JIRA)" <ji...@apache.org> on 2018/09/20 05:33:00 UTC, 5 replies.
- [jira] [Updated] (SPARK-25475) Refactor all benchmark to save the result as a separate file - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/20 05:33:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25475) Refactor all benchmark to save the result as a separate file - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/20 05:35:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25476) Refactor AggregateBenchmark to use main method - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/20 07:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25476) Refactor AggregateBenchmark to use main method - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/20 07:46:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25477) “INSERT OVERWRITE LOCAL DIRECTORY”， the data files allocated on the non-driver node will not be written to the specified output directory - posted by "hantiantian (JIRA)" <ji...@apache.org> on 2018/09/20 07:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25457) IntegralDivide (div) should not always return long - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/09/20 07:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-18364) Expose metrics for YarnShuffleService - posted by "Marek Simunek (JIRA)" <ji...@apache.org> on 2018/09/20 08:15:00 UTC, 5 replies.
- [jira] [Created] (SPARK-25478) Refactor CompressionSchemeBenchmark to use main method - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/20 08:38:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25479) Refactor DatasetBenchmark to use main method - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/20 09:46:01 UTC, 0 replies.
- [jira] [Created] (SPARK-25480) Dynamic partitioning + saveAsTable with multiple partition columns create empty directory - posted by "Daniel Mateus Pires (JIRA)" <ji...@apache.org> on 2018/09/20 10:00:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25469) Eval methods of Concat, Reverse and ElementAt should use pattern matching only once - posted by "Marek Novotny (JIRA)" <ji...@apache.org> on 2018/09/20 10:00:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25480) Dynamic partitioning + saveAsTable with multiple partition columns create empty directory - posted by "Daniel Mateus Pires (JIRA)" <ji...@apache.org> on 2018/09/20 10:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25480) Dynamic partitioning + saveAsTable with multiple partition columns create empty directory - posted by "Daniel Mateus Pires (JIRA)" <ji...@apache.org> on 2018/09/20 10:02:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-25469) Eval methods of Concat, Reverse and ElementAt should use pattern matching only once - posted by "Marek Novotny (JIRA)" <ji...@apache.org> on 2018/09/20 10:20:00 UTC, 4 replies.
- [jira] [Created] (SPARK-25481) Refactor ColumnarBatchBenchmark to use main method - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/09/20 10:44:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25481) Refactor ColumnarBatchBenchmark to use main method - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/09/20 11:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25482) Fast equal can not check reuseSubquery when apply rule about ReuseSubquery - posted by "GuangWeiHong (JIRA)" <ji...@apache.org> on 2018/09/20 11:09:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25482) Fast equal can not check reuseSubquery when apply rule about ReuseSubquery - posted by "GuangWeiHong (JIRA)" <ji...@apache.org> on 2018/09/20 11:13:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25483) Refactor UnsafeArrayDataBenchmark to use main method - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/20 12:14:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-19355) Use map output statistices to improve global limit's parallelism - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/20 12:21:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25460) DataSourceV2: Structured Streaming does not respect SessionConfigSupport - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/20 12:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25484) Refactor ExternalAppendOnlyUnsafeRowArrayBenchmark - posted by "Chenxiao Mao (JIRA)" <ji...@apache.org> on 2018/09/20 12:32:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25485) Refactor UnsafeProjectionBenchmark to use main method - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/09/20 12:33:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25417) ArrayContains function may return incorrect result when right expression is implicitly down casted - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/20 12:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25486) Refactor SortBenchmark to use main method - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/09/20 13:30:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25487) Refactor PrimitiveArrayBenchmark - posted by "Chenxiao Mao (JIRA)" <ji...@apache.org> on 2018/09/20 13:39:00 UTC, 0 replies.
- [jira] [Issue Comment Deleted] (SPARK-25474) Size in bytes of the query is coming in EB in case of parquet datasource - posted by "sandeep katta (JIRA)" <ji...@apache.org> on 2018/09/20 13:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25488) Refactor MiscBenchmark to use main method - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/20 15:08:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25489) Refactor UDTSerializationBenchmark - posted by "Chenxiao Mao (JIRA)" <ji...@apache.org> on 2018/09/20 15:10:02 UTC, 0 replies.
- [jira] [Commented] (SPARK-23682) Memory issue with Spark structured streaming - posted by "Sahil Aggarwal (JIRA)" <ji...@apache.org> on 2018/09/20 15:20:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25490) Refactor KryoBenchmark - posted by "Chenxiao Mao (JIRA)" <ji...@apache.org> on 2018/09/20 15:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25491) pandas_udf fails when using ArrayType(ArrayType(DoubleType())) - posted by "Ofer Fridman (JIRA)" <ji...@apache.org> on 2018/09/20 15:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25492) Refactor WideSchemaBenchmark to use main method - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/20 16:04:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25487) Refactor PrimitiveArrayBenchmark - posted by "Chenxiao Mao (JIRA)" <ji...@apache.org> on 2018/09/20 16:46:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25489) Refactor UDTSerializationBenchmark - posted by "Chenxiao Mao (JIRA)" <ji...@apache.org> on 2018/09/20 16:48:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25450) PushProjectThroughUnion rule uses the same exprId for project expressions in each Union child, causing mistakes in constant propagation - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/20 17:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25381) Stratified sampling by Column argument - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/20 17:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25422) flaky test: org.apache.spark.DistributedSuite.caching on disk, replicated (encryption = on) (with replication as stream) - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/20 18:16:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25473) PySpark ForeachWriter test fails on Python 3.6 and macOS High Serria - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/20 18:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25473) PySpark ForeachWriter test fails on Python 3.6 and macOS High Serria - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/20 18:16:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-25487) Refactor PrimitiveArrayBenchmark - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/20 18:46:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24918) Executor Plugin API - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/09/20 19:02:01 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24918) Executor Plugin API - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/09/20 19:02:01 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25474) Size in bytes of the query is coming in EB in case of parquet datasource - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/20 19:12:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25481) Refactor ColumnarBatchBenchmark to use main method - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/20 19:26:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-10816) EventTime based sessionization - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/20 19:31:01 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-25246) When the spark.eventLog.compress is enabled, the Application is not showing in the History server UI ('incomplete application' page), initially. - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/09/20 19:36:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25488) Refactor MiscBenchmark to use main method - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/20 19:39:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-10816) EventTime based sessionization - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/09/20 19:59:00 UTC, 9 replies.
- [jira] [Commented] (SPARK-24347) df.alias() in python API should not clear metadata by default - posted by "Axel Magnuson (JIRA)" <ji...@apache.org> on 2018/09/20 20:46:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25493) CRLF Line Separators don't work in multiline CSVs - posted by "Justin Uang (JIRA)" <ji...@apache.org> on 2018/09/20 20:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25493) CRLF Line Separators don't work in multiline CSVs - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/20 20:56:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25493) CRLF Line Separators don't work in multiline CSVs - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/20 20:56:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24572) "eager execution" for R shell, IDE - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/20 20:59:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25459) Add viewOriginalText back to CatalogTable - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/20 21:18:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25459) Add viewOriginalText back to CatalogTable - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/20 21:18:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25479) Refactor DatasetBenchmark to use main method - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/20 21:52:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25366) Document Zstd and brotli CompressionCodec requirements for Parquet files - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/20 21:54:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25366) Document Zstd and brotli CompressionCodec requirements for Parquet files - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/20 21:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25366) Document Zstd and brotli CompressionCodec requirements for Parquet files - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/20 21:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25118) Need a solution to persist Spark application console outputs when running in shell/yarn client mode - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/20 22:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25118) Need a solution to persist Spark application console outputs when running in shell/yarn client mode - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/20 22:12:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25472) Structured Streaming query.stop() doesn't always stop gracefully - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/20 22:48:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-25472) Structured Streaming query.stop() doesn't always stop gracefully - posted by "Burak Yavuz (JIRA)" <ji...@apache.org> on 2018/09/20 22:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25469) Eval methods of Concat, Reverse and ElementAt should use pattern matching only once - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/20 23:01:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25494) Upgrade Spark's use of Janino to 3.0.10 - posted by "Kris Mok (JIRA)" <ji...@apache.org> on 2018/09/20 23:13:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25494) Upgrade Spark's use of Janino to 3.0.10 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/20 23:15:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25494) Upgrade Spark's use of Janino to 3.0.10 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/20 23:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25495) FetchedData.reset doesn't reset _nextOffsetInFetchedData and _offsetAfterPoll - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/09/21 00:15:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25495) FetchedData.reset doesn't reset _nextOffsetInFetchedData and _offsetAfterPoll - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 00:24:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25495) FetchedData.reset doesn't reset _nextOffsetInFetchedData and _offsetAfterPoll - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 00:24:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25465) Refactor Parquet test suites in project Hive - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 00:36:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25465) Refactor Parquet test suites in project Hive - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 00:36:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-24777) Add write benchmark for AVRO - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/21 00:43:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25453) OracleIntegrationSuite IllegalArgumentException: Timestamp format must be yyyy-mm-dd hh:mm:ss[.fffffffff] - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 01:05:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25321) ML, Graph 2.4 QA: API: New Scala APIs, docs - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 01:35:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-14681) Provide label/impurity stats for spark.ml decision tree nodes - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 01:36:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-23715) from_utc_timestamp returns incorrect results for some UTC date/time values - posted by "Reynold Xin (JIRA)" <ji...@apache.org> on 2018/09/21 01:53:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-23715) from_utc_timestamp returns incorrect results for some UTC date/time values - posted by "Reynold Xin (JIRA)" <ji...@apache.org> on 2018/09/21 01:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25496) Deprecate from_utc_timestamp and to_utc_timestamp - posted by "Reynold Xin (JIRA)" <ji...@apache.org> on 2018/09/21 01:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23549) Spark SQL unexpected behavior when comparing timestamp to date - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 02:04:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25489) Refactor UDTSerializationBenchmark - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 02:12:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25497) limit operation within whole stage codegen should not consume all the inputs - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/21 02:37:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25497) limit operation within whole stage codegen should not consume all the inputs - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/21 02:38:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-24717) Split out min retain version of state for memory in HDFSBackedStateStoreProvider - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/09/21 04:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24717) Split out min retain version of state for memory in HDFSBackedStateStoreProvider - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/09/21 04:50:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25498) Fix SQLQueryTestSuite failures when the interpreter mode enabled - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/09/21 05:09:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25498) Fix SQLQueryTestSuite failures when the interpreter mode enabled - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 05:11:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25498) Fix SQLQueryTestSuite failures when the interpreter mode enabled - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 05:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25499) Refactor BenchmarkBase and Benchmark - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/09/21 05:14:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25494) Upgrade Spark's use of Janino to 3.0.10 - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/21 05:18:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25499) Refactor BenchmarkBase and Benchmark - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 05:19:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25499) Refactor BenchmarkBase and Benchmark - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 05:19:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-12978) Skip unnecessary final group-by when input data already clustered with group-by keys - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/21 05:37:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-16196) Optimize in-memory scan performance using ColumnarBatches - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/21 05:38:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-20184) performance regression for complex/long sql when enable whole stage codegen - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/21 05:38:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-19355) Use map output statistices to improve global limit's parallelism - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 05:39:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-24441) Expose total estimated size of states in HDFSBackedStateStoreProvider - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/09/21 05:41:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-22187) Update unsaferow format for saved state such that we can set timeouts when state is null - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/09/21 05:42:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24999) Reduce unnecessary 'new' memory operations - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/09/21 05:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25204) rate source test is flaky - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/09/21 05:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-15693) Write schema definition out for file-based data sources to avoid schema inference - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/21 05:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25487) Refactor PrimitiveArrayBenchmark - posted by "Kazuaki Ishizaki (JIRA)" <ji...@apache.org> on 2018/09/21 06:11:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25384) Removing spark.sql.fromJsonForceNullableSchema - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/21 06:23:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25384) Clarify fromJsonForceNullableSchema will be removed in Spark 3.0 - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/21 06:23:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25384) Clarify fromJsonForceNullableSchema will be removed in Spark 3.0 - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/21 06:23:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-21318) The exception message thrown by `lookupFunction` is ambiguous. - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/21 06:26:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25271) Creating parquet table with all the column null throws exception - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 06:28:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-19724) create a managed table with an existed default location should throw an exception - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 06:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-22739) Additional Expression Support for Objects - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/21 06:40:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-22739) Additional Expression Support for Objects - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/21 06:40:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-22231) Support of map, filter, withColumn, dropColumn in nested list of structures - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/21 06:42:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-22386) Data Source V2 improvements - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/21 06:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-15117) Generate code that get a value in each compressed column from CachedBatch when DataFrame.cache() is called - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/21 06:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25471) Fix tests for Python 3.6 with Pandas 0.23+ - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/09/21 07:14:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25363) Schema pruning doesn't work if nested column is used in where clause - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/09/21 07:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25241) Configurable empty values when reading/writing CSV files - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/09/21 07:15:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-24699) Watermark / Append mode should work with Trigger.Once - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/09/21 07:16:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24763) Remove redundant key data from value in streaming aggregation - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/09/21 07:16:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23672) Document Support returning lists in Arrow UDFs - posted by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/09/21 07:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25454) Division between operands with negative scale can cause precision loss - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 07:29:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-25466) Documentation does not specify how to set fafka consumer cache capacity for SS - posted by "Gabor Somogyi (JIRA)" <ji...@apache.org> on 2018/09/21 09:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-20885) JDBC predicate pushdown uses hardcoded date format - posted by "Chenxiao Mao (JIRA)" <ji...@apache.org> on 2018/09/21 09:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25464) Dropping database can remove the hive warehouse directory contents - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 09:21:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25500) Specify configmap and secrets in Spark driver and executor pods in Kubernetes - posted by "Abhishek Rao (JIRA)" <ji...@apache.org> on 2018/09/21 09:37:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25469) Eval methods of Concat, Reverse and ElementAt should use pattern matching only once - posted by "Takeshi Yamamuro (JIRA)" <ji...@apache.org> on 2018/09/21 09:40:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25500) Specify configmap and secrets in Spark driver and executor pods in Kubernetes - posted by "Abhishek Rao (JIRA)" <ji...@apache.org> on 2018/09/21 09:42:00 UTC, 4 replies.
- [jira] [Created] (SPARK-25501) Kafka delegation token support - posted by "Gabor Somogyi (JIRA)" <ji...@apache.org> on 2018/09/21 09:47:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25501) Kafka delegation token support - posted by "Gabor Somogyi (JIRA)" <ji...@apache.org> on 2018/09/21 09:51:00 UTC, 11 replies.
- [jira] [Created] (SPARK-25502) [Spark Job History] Empty Page when page number exceeds the reatinedTask size - posted by "ABHISHEK KUMAR GUPTA (JIRA)" <ji...@apache.org> on 2018/09/21 09:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25502) [Spark Job History] Empty Page when page number exceeds the reatinedTask size - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/09/21 09:53:00 UTC, 5 replies.
- [jira] [Created] (SPARK-25503) [Spark Job History] Total task message in stage page is ambiguous - posted by "ABHISHEK KUMAR GUPTA (JIRA)" <ji...@apache.org> on 2018/09/21 10:04:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25503) [Spark Job History] Total task message in stage page is ambiguous - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/09/21 10:05:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25504) [Spark Job History]If the number of tasks exceeds spark.ui.retainedTask value, then stage page of UI should display upto the value set in the retainedTask. - posted by "ABHISHEK KUMAR GUPTA (JIRA)" <ji...@apache.org> on 2018/09/21 10:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25504) [Spark Job History]If the number of tasks exceeds spark.ui.retainedTask value, then stage page of UI should display upto the value set in the retainedTask. - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/09/21 10:34:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-25486) Refactor SortBenchmark to use main method - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 10:47:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25468) Highlight current page index in the history server - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 11:15:01 UTC, 2 replies.
- [jira] [Assigned] (SPARK-25468) Highlight current page index in the history server - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 11:15:01 UTC, 2 replies.
- [jira] [Assigned] (SPARK-25482) Fast equal can not check reuseSubquery when apply rule about ReuseSubquery - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 13:29:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25482) Fast equal can not check reuseSubquery when apply rule about ReuseSubquery - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 13:29:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-24355) Improve Spark shuffle server responsiveness to non-ChunkFetch requests - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/09/21 14:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24355) Improve Spark shuffle server responsiveness to non-ChunkFetch requests - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/09/21 14:08:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24355) Improve Spark shuffle server responsiveness to non-ChunkFetch requests - posted by "Thomas Graves (JIRA)" <ji...@apache.org> on 2018/09/21 14:09:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-22739) Additional Expression Support for Objects - posted by "Aleksander Eskilson (JIRA)" <ji...@apache.org> on 2018/09/21 14:11:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25499) Refactor BenchmarkBase and Benchmark - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/21 14:22:01 UTC, 0 replies.
- [jira] [Created] (SPARK-25505) The output order of grouping columns in Pivot is different from the input order - posted by "Maryann Xue (JIRA)" <ji...@apache.org> on 2018/09/21 14:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25506) Spark CSV multiline with CRLF - posted by "eugen yushin (JIRA)" <ji...@apache.org> on 2018/09/21 14:51:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25505) The output order of grouping columns in Pivot is different from the input order - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 15:42:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25505) The output order of grouping columns in Pivot is different from the input order - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 15:42:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-25485) Refactor UnsafeProjectionBenchmark to use main method - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 15:44:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25507) Update documents for the new features in 2.4 release - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/21 15:51:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25179) Document the features that require Pyarrow 0.10 - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/21 15:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24499) Documentation improvement of Spark core and SQL - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/21 15:53:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-18082) Locality Sensitive Hashing (LSH) - SignRandomProjection - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/21 16:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25508) Refactor OrcReadBenchmark to use main method - posted by "yucai (JIRA)" <ji...@apache.org> on 2018/09/21 16:20:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23779) TaskMemoryManager and UnsafeSorter use MemoryBlock - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 16:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23763) OffHeapColumnVector uses MemoryBlock - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 16:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-20937) Describe spark.sql.parquet.writeLegacyFormat property in Spark SQL, DataFrames and Datasets Guide - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 16:58:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-25483) Refactor UnsafeArrayDataBenchmark to use main method - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 16:59:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25409) Speed up Spark History at start if there are tens of thousands of applications. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 16:59:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25478) Refactor CompressionSchemeBenchmark to use main method - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 16:59:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-25492) Refactor WideSchemaBenchmark to use main method - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 16:59:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25476) Refactor AggregateBenchmark to use main method - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 16:59:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25477) “INSERT OVERWRITE LOCAL DIRECTORY”， the data files allocated on the non-driver node will not be written to the specified output directory - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 17:00:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25449) Don't send zero accumulators in heartbeats - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 17:00:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25477) “INSERT OVERWRITE LOCAL DIRECTORY”， the data files allocated on the non-driver node will not be written to the specified output directory - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 17:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25449) Don't send zero accumulators in heartbeats - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 17:00:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25374) SafeProjection supports fallback to an interpreted mode - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 17:00:01 UTC, 1 replies.
- [jira] [Created] (SPARK-25509) SHS V2 cannot enabled in Windows, because POSIX permissions is not support. - posted by "Rong Tang (JIRA)" <ji...@apache.org> on 2018/09/21 17:14:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25509) SHS V2 cannot enabled in Windows, because POSIX permissions is not support. - posted by "Rong Tang (JIRA)" <ji...@apache.org> on 2018/09/21 17:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25509) SHS V2 cannot enabled in Windows, because POSIX permissions is not support. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 17:17:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25509) SHS V2 cannot enabled in Windows, because POSIX permissions is not support. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 17:17:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25409) Speed up Spark History at start if there are tens of thousands of applications. - posted by "Rong Tang (JIRA)" <ji...@apache.org> on 2018/09/21 17:29:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24519) MapStatus has 2000 hardcoded - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 17:35:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25510) Create new BenchmarkWithCodegen trait doesn't extends SparkFunSuite - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/21 17:36:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25510) Create new trait replace BenchmarkWithCodegen - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/21 17:47:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25510) Create new trait replace BenchmarkWithCodegen - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 17:55:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25510) Create new trait replace BenchmarkWithCodegen - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/21 17:55:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25321) ML, Graph 2.4 QA: API: New Scala APIs, docs - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/21 20:06:01 UTC, 1 replies.
- [jira] [Reopened] (SPARK-25321) ML, Graph 2.4 QA: API: New Scala APIs, docs - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/21 20:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25320) ML, Graph 2.4 QA: API: Binary incompatible changes - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/21 20:12:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25320) ML, Graph 2.4 QA: API: Binary incompatible changes - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/21 20:13:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25320) ML, Graph 2.4 QA: API: Binary incompatible changes - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/21 20:13:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25323) ML 2.4 QA: API: Python API coverage - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/21 20:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25324) ML 2.4 QA: API: Java compatibility, docs - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/21 20:16:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25324) ML 2.4 QA: API: Java compatibility, docs - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/21 20:16:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25323) ML 2.4 QA: API: Python API coverage - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/21 20:17:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25327) Update MLlib, GraphX websites for 2.4 - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/21 20:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25327) Update MLlib, GraphX websites for 2.4 - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/21 20:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25322) ML, Graph 2.4 QA: API: Experimental, DeveloperApi, final, sealed audit - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/21 20:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25325) ML, Graph 2.4 QA: Update user guide for new features & APIs - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/21 20:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25326) ML, Graph 2.4 QA: Programming guide update and migration guide - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/21 20:21:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25319) Spark MLlib, GraphX 2.4 QA umbrella - posted by "Xiangrui Meng (JIRA)" <ji...@apache.org> on 2018/09/21 20:21:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-24523) InterruptedException when closing SparkContext - posted by "Umayr Hassan (JIRA)" <ji...@apache.org> on 2018/09/21 21:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25511) Map with "null" key not working in spark 2.3 - posted by "Ravi Shankar (JIRA)" <ji...@apache.org> on 2018/09/21 22:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25351) Handle Pandas category type when converting from Python with Arrow - posted by "Pooja Gadige (JIRA)" <ji...@apache.org> on 2018/09/21 23:40:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25511) Map with "null" key not working in spark 2.3 - posted by "Ravi Shankar (JIRA)" <ji...@apache.org> on 2018/09/22 02:20:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25497) limit operation within whole stage codegen should not consume all the inputs - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/22 10:14:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24018) Spark-without-hadoop package fails to create or read parquet files with snappy compression - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/22 11:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25511) Map with "null" key not working in spark 2.3 - posted by "Michal Šenkýř (JIRA)" <ji...@apache.org> on 2018/09/22 12:15:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-25503) [Spark Job History] Total task message in stage page is ambiguous - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/22 13:59:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-25502) [Spark Job History] Empty Page when page number exceeds the reatinedTask size - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/22 14:35:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25512) Using RowNumbers in SparkR Dataframe - posted by "Asif Khan (JIRA)" <ji...@apache.org> on 2018/09/22 14:41:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25512) Using RowNumbers in SparkR Dataframe - posted by "Asif Khan (JIRA)" <ji...@apache.org> on 2018/09/22 14:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24486) Slow performance reading ArrayType columns - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/22 15:58:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25465) Refactor Parquet test suites in project Hive - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/22 16:47:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24794) DriverWrapper should have both master addresses in -Dspark.master - posted by "Behroz Sikander (JIRA)" <ji...@apache.org> on 2018/09/22 19:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-17952) SparkSession createDataFrame method throws exception for nested JavaBeans - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/22 19:12:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-17952) SparkSession createDataFrame method throws exception for nested JavaBeans - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/22 19:13:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25513) Read zipped CSV and JSON files - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/09/22 20:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25513) Read zipped CSV and JSON files - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/22 20:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25513) Read zipped CSV and JSON files - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/22 20:20:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-25480) Dynamic partitioning + saveAsTable with multiple partition columns create empty directory - posted by "Christopher Burns (JIRA)" <ji...@apache.org> on 2018/09/23 02:55:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25473) PySpark ForeachWriter test fails on Python 3.6 and macOS High Serria - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/23 03:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25506) Spark CSV multiline with CRLF - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/23 05:42:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25491) pandas_udf fails when using ArrayType(ArrayType(DoubleType())) - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/23 05:46:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25491) pandas_udf(GROUPED_MAP) fails when using ArrayType(ArrayType(DoubleType())) - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/23 05:47:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25512) Using RowNumbers in SparkR Dataframe - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/23 05:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25491) pandas_udf(GROUPED_MAP) fails when using ArrayType(ArrayType(DoubleType())) - posted by "Ofer Fridman (JIRA)" <ji...@apache.org> on 2018/09/23 05:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25513) Read zipped CSV and JSON files - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/09/23 08:30:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24486) Slow performance reading ArrayType columns - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/23 08:39:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/09/23 11:26:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/09/23 11:29:00 UTC, 2 replies.
- [jira] [Issue Comment Deleted] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/09/23 11:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24869) SaveIntoDataSourceCommand's input Dataset does not use Cached Data - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/23 11:50:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24869) SaveIntoDataSourceCommand's input Dataset does not use Cached Data - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/23 11:50:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25504) [Spark Job History]If the number of tasks exceeds spark.ui.retainedTask value, then stage page of UI should display upto the value set in the retainedTask. - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/09/23 12:45:00 UTC, 0 replies.
- [jira] [Issue Comment Deleted] (SPARK-25504) [Spark Job History]If the number of tasks exceeds spark.ui.retainedTask value, then stage page of UI should display upto the value set in the retainedTask. - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/09/23 12:50:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/09/23 12:52:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25502) [Spark Job History] Empty Page when page number exceeds the reatinedTask size - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/09/23 13:01:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25489) Refactor UDTSerializationBenchmark - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/23 20:36:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-20845) Support specification of column names in INSERT INTO - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/23 21:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-20845) Support specification of column names in INSERT INTO - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/23 21:00:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25455) Spark bundles jackson library version, which is vulnerable - posted by "Hajime Osako (JIRA)" <ji...@apache.org> on 2018/09/23 22:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25250) Race condition with tasks running when new attempt for same stage is created leads to other task in the next attempt running on the same partition id retry multiple times - posted by "Parth Gandhi (JIRA)" <ji...@apache.org> on 2018/09/23 22:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23985) predicate push down doesn't work with simple compound partition spec - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/24 01:02:00 UTC, 5 replies.
- [jira] [Commented] (SPARK-20712) [SPARK 2.1 REGRESSION][SQL] Spark can't read Hive table when column type has length greater than 4000 bytes - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/24 03:11:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-23039) Fix the bug in alter table set location. - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/24 03:21:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25478) Refactor CompressionSchemeBenchmark to use main method - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/24 03:49:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25500) Specify configmap and secrets in Spark driver and executor pods in Kubernetes - posted by "Yinan Li (JIRA)" <ji...@apache.org> on 2018/09/24 05:52:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-18818) Window...orderBy() should accept an 'ascending' parameter just like DataFrame.orderBy() - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/24 06:14:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-18818) Window...orderBy() should accept an 'ascending' parameter just like DataFrame.orderBy() - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/24 06:14:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-23985) predicate push down doesn't work with simple compound partition spec - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/24 07:08:00 UTC, 4 replies.
- [jira] [Updated] (SPARK-23985) predicate push down doesn't work with simple compound partition spec - posted by "Ohad Raviv (JIRA)" <ji...@apache.org> on 2018/09/24 07:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25514) Pretty JSON - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/09/24 08:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25514) Pretty JSON - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/24 08:58:01 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25514) Pretty JSON - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/24 08:58:01 UTC, 1 replies.
- [jira] [Commented] (SPARK-17636) Parquet filter push down doesn't handle struct fields - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/24 09:17:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25515) Add a config property for disabling auto deletion of PODS for debugging. - posted by "Prashant Sharma (JIRA)" <ji...@apache.org> on 2018/09/24 09:19:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25515) Add a config property for disabling auto deletion of PODS for debugging. - posted by "Prashant Sharma (JIRA)" <ji...@apache.org> on 2018/09/24 09:20:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25515) Add a config property for disabling auto deletion of PODS for debugging. - posted by "Prashant Sharma (JIRA)" <ji...@apache.org> on 2018/09/24 09:28:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-21548) Support insert into serial columns of table - posted by "Mihaly Toth (JIRA)" <ji...@apache.org> on 2018/09/24 09:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25500) Specify configmap and secrets in Spark driver and executor pods in Kubernetes - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/24 11:18:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-21318) The exception message thrown by `lookupFunction` is ambiguous. - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/24 13:36:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-21318) The exception message thrown by `lookupFunction` is ambiguous. - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/24 13:36:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25416) ArrayPosition function may return incorrect result when right expression is implicitly downcasted. - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/24 13:46:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25460) DataSourceV2: Structured Streaming does not respect SessionConfigSupport - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/24 15:51:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25502) [Spark Job History] Empty Page when page number exceeds the reatinedTask size - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/24 16:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25432) Consider if using standard getOrCreate from PySpark into JVM SparkSession would simplify code - posted by "Bryan Cutler (JIRA)" <ji...@apache.org> on 2018/09/24 17:27:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-21291) R bucketBy partitionBy API - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/24 17:59:01 UTC, 2 replies.
- [jira] [Commented] (SPARK-25461) PySpark Pandas UDF outputs incorrect results when input columns contain None - posted by "Stu (Michael Stewart) (JIRA)" <ji...@apache.org> on 2018/09/24 18:09:00 UTC, 3 replies.
- [jira] [Created] (SPARK-25516) spark-history and spark-shuffle-service scripts can not run in docker image - posted by "Richard Kugler (JIRA)" <ji...@apache.org> on 2018/09/24 18:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25516) spark-history and spark-shuffle-service scripts can not run in docker image - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/24 18:53:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25516) spark-history and spark-shuffle-service scripts can not run in docker image - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/24 18:54:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25517) Spark DataFrame option inferSchema="true", dataFormat=MM/dd/yyyy, fails to detect date type from the csv file while reading - posted by "Manoranjan Kumar (JIRA)" <ji...@apache.org> on 2018/09/24 18:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25517) Spark DataFrame option inferSchema="true", dataFormat=MM/dd/yyyy, fails to detect date type from the csv file while reading - posted by "Manoranjan Kumar (JIRA)" <ji...@apache.org> on 2018/09/24 18:58:00 UTC, 4 replies.
- [jira] [Resolved] (SPARK-25516) spark-history and spark-shuffle-service scripts can not run in docker image - posted by "Richard Kugler (JIRA)" <ji...@apache.org> on 2018/09/24 19:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25514) Generating pretty JSON by to_json - posted by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/09/24 20:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24324) Pandas Grouped Map UserDefinedFunction mixes column labels - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/24 20:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25518) Spark kafka delegation token supported - posted by "Mingjie Tang (JIRA)" <ji...@apache.org> on 2018/09/24 21:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25519) ArrayRemove function may return incorrect result when right expression is implicitly downcasted. - posted by "Dilip Biswal (JIRA)" <ji...@apache.org> on 2018/09/24 21:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25519) ArrayRemove function may return incorrect result when right expression is implicitly downcasted. - posted by "Dilip Biswal (JIRA)" <ji...@apache.org> on 2018/09/24 21:19:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25502) [Spark Job History] Empty Page when page number exceeds the reatinedTask size - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/09/24 21:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25518) Spark kafka delegation token supported - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/09/24 21:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23907) Support regr_* functions - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/24 21:39:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25519) ArrayRemove function may return incorrect result when right expression is implicitly downcasted. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/24 21:43:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25519) ArrayRemove function may return incorrect result when right expression is implicitly downcasted. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/24 21:43:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25517) Spark DataFrame option inferSchema="true", dataFormat=MM/dd/yyyy, fails to detect date type from the csv file while reading - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/25 02:38:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25517) Spark DataFrame option inferSchema="true", dataFormat=MM/dd/yyyy, fails to detect date type from the csv file while reading - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/25 02:38:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25503) [Spark Job History] Total task message in stage page is ambiguous - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/25 03:06:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25519) ArrayRemove function may return incorrect result when right expression is implicitly downcasted. - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/25 04:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25520) The state of executors is KILLED on standalone - posted by "AKSonic (JIRA)" <ji...@apache.org> on 2018/09/25 06:17:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25520) The state of executors is KILLED on standalone - posted by "AKSonic (JIRA)" <ji...@apache.org> on 2018/09/25 06:17:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25520) The state of executors is KILLED on standalone - posted by "AKSonic (JIRA)" <ji...@apache.org> on 2018/09/25 06:19:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25521) Job id showing null when Job is finished. - posted by "Babulal (JIRA)" <ji...@apache.org> on 2018/09/25 06:28:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25521) Job id showing null when Job is finished. - posted by "Babulal (JIRA)" <ji...@apache.org> on 2018/09/25 06:30:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-25521) Job id showing null when Job is finished. - posted by "Sujith (JIRA)" <ji...@apache.org> on 2018/09/25 06:36:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25521) Job id showing null when Job is finished. - posted by "Sujith (JIRA)" <ji...@apache.org> on 2018/09/25 06:40:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25521) Job id showing null when insert into command Job is finished. - posted by "Babulal (JIRA)" <ji...@apache.org> on 2018/09/25 06:41:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25467) Python date/datetime objects in dataframes increment by 1 day when converted to JSON - posted by "Aleksandr Koriagin (JIRA)" <ji...@apache.org> on 2018/09/25 07:16:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25206) wrong records are returned when Hive metastore schema and parquet schema are in different letter cases - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/09/25 08:25:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25522) Improve type promotion for input arguments of elementAt function - posted by "Dilip Biswal (JIRA)" <ji...@apache.org> on 2018/09/25 08:31:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25522) Improve type promotion for input arguments of elementAt function - posted by "Dilip Biswal (JIRA)" <ji...@apache.org> on 2018/09/25 08:37:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-25522) Improve type promotion for input arguments of elementAt function - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/25 09:00:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25522) Improve type promotion for input arguments of elementAt function - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/25 09:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25523) Multithreading executive sparkSession.read().jdbc(url, table, properties) problem - posted by "huanghuai (JIRA)" <ji...@apache.org> on 2018/09/25 10:00:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only - posted by "ABHISHEK KUMAR GUPTA (JIRA)" <ji...@apache.org> on 2018/09/25 10:09:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25524) Spark datasource for image/libsvm document - posted by "Weichen Xu (JIRA)" <ji...@apache.org> on 2018/09/25 10:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25524) Spark datasource for image/libsvm user guide - posted by "Weichen Xu (JIRA)" <ji...@apache.org> on 2018/09/25 10:12:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25411) Implement range partition in Spark - posted by "Wang, Gang (JIRA)" <ji...@apache.org> on 2018/09/25 10:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25526) SparkSQL over REST API not JDBC - posted by "t oo (JIRA)" <ji...@apache.org> on 2018/09/25 11:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25525) Do not update conf for existing SparkContext in SparkSession.getOrCreate. - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/09/25 11:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25525) Do not update conf for existing SparkContext in SparkSession.getOrCreate. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/25 11:39:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25525) Do not update conf for existing SparkContext in SparkSession.getOrCreate. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/25 11:39:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25527) Job stuck waiting for last stage to start - posted by "Ran Haim (JIRA)" <ji...@apache.org> on 2018/09/25 12:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24064) [Spark SQL] Create table using csv does not support binary column Type - posted by "Gururaj Shetty (JIRA)" <ji...@apache.org> on 2018/09/25 13:39:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25500) Specify configmap and secrets in Spark driver and executor pods in Kubernetes - posted by "Abhishek Rao (JIRA)" <ji...@apache.org> on 2018/09/25 15:06:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25390) finalize the abstraction of data source V2 API - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/25 15:33:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25390) data source V2 API refactoring - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/25 15:33:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25528) data source V2 read side API refactoring - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/25 15:35:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25529) data source V2 read side API refactoring - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/25 15:35:00 UTC, 0 replies.
- [jira] [Deleted] (SPARK-25529) data source V2 read side API refactoring - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/25 15:36:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25528) data source V2 read side API refactoring - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/25 15:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25530) data source v2 write side API refactoring - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/25 15:38:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25189) CustomMetrics should be created with ScanConfig - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/25 15:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25523) Multi thread execute sparkSession.read().jdbc(url, table, properties) problem - posted by "huanghuai (JIRA)" <ji...@apache.org> on 2018/09/25 15:44:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25531) new write APIs for data source v2 - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/25 15:58:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24251) DataSourceV2: Add AppendData logical operation - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/25 15:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24923) DataSourceV2: Add CTAS and RTAS logical operations - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/25 16:04:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23521) SPIP: Standardize SQL logical plans with DataSourceV2 - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/25 16:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25531) new write APIs for data source v2 - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/25 16:08:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25532) A stable and efficient row representation - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/25 16:23:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25527) Job stuck waiting for last stage to start - posted by "Li Yuanjian (JIRA)" <ji...@apache.org> on 2018/09/25 16:27:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-23521) SPIP: Standardize SQL logical plans with DataSourceV2 - posted by "Ryan Blue (JIRA)" <ji...@apache.org> on 2018/09/25 16:56:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25528) data source V2 read side API refactoring - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/25 17:03:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25528) data source V2 read side API refactoring - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/25 17:03:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-25486) Refactor SortBenchmark to use main method - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/25 18:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-17636) Parquet filter push down doesn't handle struct fields - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/09/25 18:28:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-17636) Parquet filter push down doesn't handle struct fields - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/09/25 18:28:02 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25495) FetchedData.reset doesn't reset _nextOffsetInFetchedData and _offsetAfterPoll - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/09/25 18:44:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25533) Inconsistent message of Completed Jobs in the JobUI, when there are failed jobs, compared to spark2.2 - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/09/25 19:20:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25533) Inconsistent message of Completed Jobs in the JobUI, when there are failed jobs, compared to spark2.2 - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/09/25 19:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25533) Inconsistent message of Completed Jobs in the JobUI, when there are failed jobs, compared to spark2.2 - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/09/25 19:21:00 UTC, 4 replies.
- [jira] [Updated] (SPARK-25533) Inconsistent message for Completed Jobs in the JobUI, when there are failed jobs, compared to spark2.2 - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/09/25 20:59:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25534) Make `SupportWithSQLConf` trait - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/25 21:31:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25534) Make `SupportWithSQLConf` trait - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/25 21:32:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25534) Make `SupportWithSQLConf` trait - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/25 21:34:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-25534) Make `SupportWithSQLConf` trait - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/25 21:34:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-25533) Inconsistent message for Completed Jobs in the JobUI, when there are failed jobs, compared to spark2.2 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/25 22:02:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25533) Inconsistent message for Completed Jobs in the JobUI, when there are failed jobs, compared to spark2.2 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/25 22:02:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25102) Write Spark version information to Parquet file footers - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/25 23:28:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25535) Work around bad error checking in commons-crypto - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/09/26 00:02:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25535) Work around bad error checking in commons-crypto - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/09/26 00:14:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-23839) consider bucket join in cost-based JoinReorder rule - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/26 00:19:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25422) flaky test: org.apache.spark.DistributedSuite.caching on disk, replicated (encryption = on) (with replication as stream) - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/26 00:47:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25501) Kafka delegation token support - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/26 01:24:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25534) Make `SQLHelper` trait - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/26 01:34:00 UTC, 1 replies.
- [jira] [Issue Comment Deleted] (SPARK-25534) Make `SQLHelper` trait - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/26 01:35:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-21291) R bucketBy partitionBy API - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/26 01:39:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25514) Generating pretty JSON by to_json - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/26 01:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25514) Generating pretty JSON by to_json - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/26 01:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25511) Map with "null" key not working in spark 2.3 - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/26 01:59:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-25511) Map with "null" key not working in spark 2.3 - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/26 02:00:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25526) SparkSQL over REST API not JDBC - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/26 02:10:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25526) SparkSQL over REST API not JDBC - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/26 02:14:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25526) SparkSQL over REST API not JDBC - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/26 02:15:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-25526) SparkSQL over REST API not JDBC - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/26 02:15:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-25518) Spark kafka delegation token supported - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/26 02:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25517) Spark DataFrame option inferSchema="true", dataFormat=MM/dd/yyyy, fails to detect date type from the csv file while reading - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/26 02:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25536) executorSource.METRIC read wrong record in Executor.scala Line444 - posted by "ZhuoerXu (JIRA)" <ji...@apache.org> on 2018/09/26 03:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25537) spark.pyspark.driver.python when set in code doesnt work - posted by "Venkat Sambath (JIRA)" <ji...@apache.org> on 2018/09/26 05:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25536) executorSource.METRIC read wrong record in Executor.scala Line444 - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/09/26 05:31:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-25537) spark.pyspark.driver.python when set in code doesnt work - posted by "Venkat Sambath (JIRA)" <ji...@apache.org> on 2018/09/26 05:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25538) incorrect row counts after distinct() - posted by "Steven Rand (JIRA)" <ji...@apache.org> on 2018/09/26 05:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25534) Make `SQLHelper` trait - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/26 06:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25539) Update lz4-java to get speed improvement - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/26 06:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25540) Make HiveContext in PySpark behave as the same as Scala. - posted by "Takuya Ueshin (JIRA)" <ji...@apache.org> on 2018/09/26 06:33:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25539) Update lz4-java to get speed improvement - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/26 06:37:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25539) Update lz4-java to get speed improvement - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/26 06:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25541) CaseInsensitiveMap should be serializable after '-' or 'filterKeys' - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/09/26 06:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25542) Flaky test: OpenHashMapSuite - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/26 06:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25540) Make HiveContext in PySpark behave as the same as Scala. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/26 06:48:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25540) Make HiveContext in PySpark behave as the same as Scala. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/26 06:48:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-25541) CaseInsensitiveMap should be serializable after '-' or 'filterKeys' - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/26 06:50:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25541) CaseInsensitiveMap should be serializable after '-' or 'filterKeys' - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/26 06:50:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-23622) Flaky Test: HiveClientSuites - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/26 06:57:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-23622) Flaky Test: HiveClientSuites - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/26 06:57:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25536) executorSource.METRIC read wrong record in Executor.scala Line444 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/26 07:17:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-25536) executorSource.METRIC read wrong record in Executor.scala Line444 - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/09/26 07:19:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25538) incorrect row counts after distinct() - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/09/26 07:43:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25538) incorrect row counts after distinct() - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/09/26 07:45:00 UTC, 8 replies.
- [jira] [Updated] (SPARK-25527) Job stuck waiting for last stage to start - posted by "Ran Haim (JIRA)" <ji...@apache.org> on 2018/09/26 08:12:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25461) PySpark Pandas UDF outputs incorrect results when input columns contain None - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/09/26 08:43:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25539) Update lz4-java to get speed improvement - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/26 09:44:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25543) Confusing log messages at DEBUG level, in K8s mode. - posted by "Prashant Sharma (JIRA)" <ji...@apache.org> on 2018/09/26 09:56:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-16859) History Server storage information is missing - posted by "t oo (JIRA)" <ji...@apache.org> on 2018/09/26 10:41:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-16859) History Server storage information is missing - posted by "t oo (JIRA)" <ji...@apache.org> on 2018/09/26 10:44:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24440) When use constant as column we may get wrong answer versus impala - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/09/26 11:25:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25541) CaseInsensitiveMap should be serializable after '-' or 'filterKeys' - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/26 11:43:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23401) Improve test cases for all supported types and unsupported types - posted by "Aleksandr Koriagin (JIRA)" <ji...@apache.org> on 2018/09/26 13:03:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-25379) Improve ColumnPruning performance - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/26 13:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25544) Slow/failed convergence in Spark ML models due to internal predictor scaling - posted by "Andrew Crosby (JIRA)" <ji...@apache.org> on 2018/09/26 13:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25544) Slow/failed convergence in Spark ML models due to internal predictor scaling - posted by "Andrew Crosby (JIRA)" <ji...@apache.org> on 2018/09/26 13:49:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-20937) Describe spark.sql.parquet.writeLegacyFormat property in Spark SQL, DataFrames and Datasets Guide - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/26 14:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25545) CSV loading with DROPMALFORMED mode doesn't correctly drop rows that do not confirm to non-nullable schema fields - posted by "Steven Bakhtiari (JIRA)" <ji...@apache.org> on 2018/09/26 15:27:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25545) CSV loading with DROPMALFORMED mode doesn't correctly drop rows that do not confirm to non-nullable schema fields - posted by "Steven Bakhtiari (JIRA)" <ji...@apache.org> on 2018/09/26 15:33:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-25509) SHS V2 cannot enabled in Windows, because POSIX permissions is not support. - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/26 15:41:01 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25318) Add exception handling when wrapping the input stream during the the fetch or stage retry in response to a corrupted block - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/09/26 16:31:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25535) Work around bad error checking in commons-crypto - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/26 17:30:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25536) executorSource.METRIC read wrong record in Executor.scala Line444 - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/26 17:38:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25546) RDDInfo uses SparkEnv before it may have been initialized - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/09/26 18:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25546) RDDInfo uses SparkEnv before it may have been initialized - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/26 18:20:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25546) RDDInfo uses SparkEnv before it may have been initialized - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/26 18:20:00 UTC, 1 replies.
- [jira] [Issue Comment Deleted] (SPARK-25546) RDDInfo uses SparkEnv before it may have been initialized - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/09/26 18:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-18492) GeneratedIterator grows beyond 64 KB - posted by "David Spies (JIRA)" <ji...@apache.org> on 2018/09/26 18:27:01 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-18492) GeneratedIterator grows beyond 64 KB - posted by "David Spies (JIRA)" <ji...@apache.org> on 2018/09/26 18:51:01 UTC, 0 replies.
- [jira] [Created] (SPARK-25547) Pluggable jdbc connection factory - posted by "Frank Sauer (JIRA)" <ji...@apache.org> on 2018/09/26 21:13:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25547) Pluggable jdbc connection factory - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/26 21:17:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25547) Pluggable jdbc connection factory - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/26 21:17:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-24285) Flaky test: ContinuousSuite.query without test harness - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/26 23:13:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25372) Deprecate Yarn-specific configs in regards to keytab login for SparkSubmit - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/09/27 00:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25454) Division between operands with negative scale can cause precision loss - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/27 00:49:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25454) Division between operands with negative scale can cause precision loss - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/27 01:03:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-25454) Division between operands with negative scale can cause precision loss - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/27 01:03:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25540) Make HiveContext in PySpark behave as the same as Scala. - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/27 01:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25548) In the PruneFileSourcePartitions optimizer, replace the nonPartitionOps field with true in the And(partitionOps, nonPartitionOps) to make the partition can be pruned - posted by "eaton (JIRA)" <ji...@apache.org> on 2018/09/27 01:59:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25548) In the PruneFileSourcePartitions optimizer, replace the nonPartitionOps field with true in the And(partitionOps, nonPartitionOps) to make the partition can be pruned - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/27 02:00:04 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25548) In the PruneFileSourcePartitions optimizer, replace the nonPartitionOps field with true in the And(partitionOps, nonPartitionOps) to make the partition can be pruned - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/27 02:01:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-25541) CaseInsensitiveMap should be serializable after '-' operator - posted by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2018/09/27 03:00:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24341) Codegen compile error from predicate subquery - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/27 03:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25549) High level API to collect RDD statistics - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/09/27 03:29:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25549) High level API to collect RDD statistics - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/09/27 03:29:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25481) Refactor ColumnarBatchBenchmark to use main method - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/27 03:42:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25536) executorSource.METRIC read wrong record in Executor.scala Line444 - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/27 04:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25525) Do not update conf for existing SparkContext in SparkSession.getOrCreate. - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/27 04:38:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25540) Make HiveContext in PySpark behave as the same as Scala. - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/27 04:39:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-18112) Spark2.x does not support read data from Hive 2.x metastore - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/27 04:43:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25468) Highlight current page index in the history server - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/27 05:04:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23002) SparkUI inconsistent driver hostname compare with other executors - posted by "Adam Wang (JIRA)" <ji...@apache.org> on 2018/09/27 06:13:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-23002) SparkUI inconsistent driver hostname compare with other executors - posted by "Adam Wang (JIRA)" <ji...@apache.org> on 2018/09/27 06:16:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25485) Refactor UnsafeProjectionBenchmark to use main method - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/27 06:30:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25282) Fix support for spark-shell with K8s - posted by "Prashant Sharma (JIRA)" <ji...@apache.org> on 2018/09/27 06:41:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25282) Fix support for spark-shell with K8s - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/27 07:01:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25522) Improve type promotion for input arguments of elementAt function - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/27 07:06:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25282) Fix support for spark-shell with K8s - posted by "Prashant Sharma (JIRA)" <ji...@apache.org> on 2018/09/27 07:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25543) Confusing log messages at DEBUG level, in K8s mode. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/27 07:08:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25543) Confusing log messages at DEBUG level, in K8s mode. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/27 07:08:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25550) [Spark Job History] Environment Page of Spark Job History UI showing wrong value for spark.ui.retainedJobs - posted by "ABHISHEK KUMAR GUPTA (JIRA)" <ji...@apache.org> on 2018/09/27 07:13:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25314) Invalid PythonUDF - requires attributes from more than one child - in "on" join condition - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/27 07:16:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25550) [Spark Job History] Environment Page of Spark Job History UI showing wrong value for spark.ui.retainedJobs - posted by "ABHISHEK KUMAR GUPTA (JIRA)" <ji...@apache.org> on 2018/09/27 07:16:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25550) [Spark Job History] Environment Page of Spark Job History UI showing wrong value for spark.ui.retainedJobs - posted by "ABHISHEK KUMAR GUPTA (JIRA)" <ji...@apache.org> on 2018/09/27 07:17:00 UTC, 4 replies.
- [jira] [Assigned] (SPARK-25458) Support FOR ALL COLUMNS in ANALYZE TABLE - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/27 07:32:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25550) [Spark Job History] Environment Page of Spark Job History UI showing wrong value for spark.ui.retainedJobs - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/27 07:36:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25523) Multi thread execute sparkSession.read().jdbc(url, table, properties) problem - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/27 09:16:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25524) Spark datasource for image/libsvm user guide - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/27 09:18:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25545) CSV loading with DROPMALFORMED mode doesn't correctly drop rows that do not confirm to non-nullable schema fields - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/27 09:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25551) Remove unused InSubquery expression - posted by "Marco Gaido (JIRA)" <ji...@apache.org> on 2018/09/27 09:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25551) Remove unused InSubquery expression - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/27 09:34:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25551) Remove unused InSubquery expression - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/27 09:34:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-23401) Improve test cases for all supported types and unsupported types - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/27 10:07:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25542) Flaky test: OpenHashMapSuite - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/27 10:12:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25542) Flaky test: OpenHashMapSuite - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/27 10:12:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-19950) nullable ignored when df.load() is executed for file-based data source - posted by "Steven Bakhtiari (JIRA)" <ji...@apache.org> on 2018/09/27 10:13:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-19950) nullable ignored when df.load() is executed for file-based data source - posted by "Steven Bakhtiari (JIRA)" <ji...@apache.org> on 2018/09/27 10:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25552) Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more memory - posted by "Nuno Azevedo (JIRA)" <ji...@apache.org> on 2018/09/27 10:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25552) Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more memory - posted by "Nuno Azevedo (JIRA)" <ji...@apache.org> on 2018/09/27 10:19:00 UTC, 8 replies.
- [jira] [Resolved] (SPARK-25551) Remove unused InSubquery expression - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/27 11:35:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25553) Add EmptyInterpolatedStringChecker to scalastyle-config.xml - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/27 12:23:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-21436) Take advantage of known partioner for distinct on RDDs - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/27 12:59:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-21436) Take advantage of known partioner for distinct on RDDs - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/27 13:00:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-21743) top-most limit should not cause memory leak - posted by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/27 13:08:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25553) Add EmptyInterpolatedStringChecker to scalastyle-config.xml - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/27 13:21:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25553) Add EmptyInterpolatedStringChecker to scalastyle-config.xml - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/27 13:21:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-25553) Add EmptyInterpolatedStringChecker to scalastyle-config.xml - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/27 14:08:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25554) Avro logical types get ignored in SchemaConverters.toSqlType - posted by "Yanan Li (JIRA)" <ji...@apache.org> on 2018/09/27 14:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25555) Generic constructs for windowing and support for custom windows - posted by "Arun Mahadevan (JIRA)" <ji...@apache.org> on 2018/09/27 16:17:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25546) RDDInfo uses SparkEnv before it may have been initialized - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/27 16:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25392) [Spark Job History]Inconsistent behaviour for pool details in spark web UI and history server page - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/27 17:34:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25533) Inconsistent message for Completed Jobs in the JobUI, when there are failed jobs, compared to spark2.2 - posted by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/09/27 17:39:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25521) Job id showing null when insert into command Job is finished. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/27 18:00:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25521) Job id showing null when insert into command Job is finished. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/27 18:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25556) Predicate Pushdown for Nested fields - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/09/27 18:01:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-17636) Parquet predicate pushdown for nested fields - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/09/27 18:02:01 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25556) Predicate Pushdown for Nested fields - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/09/27 18:03:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25557) ORC predicate pushdown for nested fields - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/09/27 18:04:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25558) Creating predicates for nested fields in DataSource Strategy - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/09/27 18:06:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25558) Creating predicates for nested fields in DataSource Strategy - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/09/27 18:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25558) Creating predicates for nested fields in DataSource Strategy - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/09/27 18:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25559) Just remove the unsupported predicates in Parquet - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/09/27 18:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25558) Pushdown predicates for nested fields in DataSource Strategy - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/09/27 18:30:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25558) Pushdown predicates for nested fields in DataSource Strategy - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/27 18:33:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25558) Pushdown predicates for nested fields in DataSource Strategy - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/27 18:33:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25557) ORC predicate pushdown for nested fields - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/27 18:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24724) Discuss necessary info and access in barrier mode + Kubernetes - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/09/27 19:06:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24724) Discuss necessary info and access in barrier mode + Kubernetes - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/09/27 19:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24579) SPIP: Standardize Optimized Data Exchange between Spark and DL/AI frameworks - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/09/27 19:35:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24579) SPIP: Standardize Optimized Data Exchange between Spark and DL/AI frameworks - posted by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/09/27 19:36:00 UTC, 3 replies.
- [jira] [Updated] (SPARK-25559) Just remove the unsupported predicates in Parquet - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/09/27 20:23:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25560) Allow Function Injection in SparkSessionExtensions - posted by "Russell Spitzer (JIRA)" <ji...@apache.org> on 2018/09/27 22:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25556) Predicate Pushdown for Nested fields - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/27 22:19:00 UTC, 1 replies.
- [jira] [Issue Comment Deleted] (SPARK-25556) Predicate Pushdown for Nested fields - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/09/27 23:21:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25559) Just remove the unsupported predicates in Parquet - posted by "DB Tsai (JIRA)" <ji...@apache.org> on 2018/09/27 23:22:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25561) HiveClient.getPartitionsByFilter throws an exception if Hive retries directSql - posted by "Karthik Manamcheri (JIRA)" <ji...@apache.org> on 2018/09/27 23:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25561) HiveClient.getPartitionsByFilter throws an exception if Hive retries directSql - posted by "Karthik Manamcheri (JIRA)" <ji...@apache.org> on 2018/09/27 23:45:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-25459) Add viewOriginalText back to CatalogTable - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/28 01:10:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-24630) SPIP: Support SQLStreaming in Spark - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/28 02:01:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-24630) SPIP: Support SQLStreaming in Spark - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/28 02:01:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25560) Allow Function Injection in SparkSessionExtensions - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/28 02:08:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25560) Allow Function Injection in SparkSessionExtensions - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/28 02:08:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25562) The Spark add audit log - posted by "yinghua_zh (JIRA)" <ji...@apache.org> on 2018/09/28 02:41:01 UTC, 0 replies.
- [jira] [Updated] (SPARK-22565) Session-based windowing - posted by "Li Yuanjian (JIRA)" <ji...@apache.org> on 2018/09/28 03:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-22565) Session-based windowing - posted by "Li Yuanjian (JIRA)" <ji...@apache.org> on 2018/09/28 03:21:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-22565) Session-based windowing - posted by "Li Yuanjian (JIRA)" <ji...@apache.org> on 2018/09/28 03:24:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25563) Spark application hangs - posted by "devinduan (JIRA)" <ji...@apache.org> on 2018/09/28 03:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25563) Spark application hangs If container allocate on lost Nodemanager - posted by "devinduan (JIRA)" <ji...@apache.org> on 2018/09/28 03:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25564) LiveExecutor misses the OutputBytes metrics - posted by "Lantao Jin (JIRA)" <ji...@apache.org> on 2018/09/28 07:09:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25564) Add output bytes metrics for each Executor - posted by "Lantao Jin (JIRA)" <ji...@apache.org> on 2018/09/28 07:10:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25505) The output order of grouping columns in Pivot is different from the input order - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/28 07:11:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25505) The output order of grouping columns in Pivot is different from the input order - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/28 07:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25554) Avro logical types get ignored in SchemaConverters.toSqlType - posted by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2018/09/28 08:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25564) Add output bytes metrics for each Executor - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/28 08:10:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25564) Add output bytes metrics for each Executor - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/28 08:10:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25565) Add scala style checker to check add Locale.ROOT to .toLowerCase and .toUpperCase for internal calls - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/28 08:25:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25565) Add scala style checker to check add Locale.ROOT to .toLowerCase and .toUpperCase for internal calls - posted by "Yuming Wang (JIRA)" <ji...@apache.org> on 2018/09/28 08:25:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-21774) The rule PromoteStrings cast string to a wrong data type - posted by "ice bai (JIRA)" <ji...@apache.org> on 2018/09/28 09:00:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25508) Refactor OrcReadBenchmark to use main method - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/28 09:02:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25508) Refactor OrcReadBenchmark to use main method - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/28 09:02:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25565) Add scala style checker to check add Locale.ROOT to .toLowerCase and .toUpperCase for internal calls - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/28 09:05:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-23194) from_json in FAILFAST mode doesn't fail fast, instead it just returns nulls - posted by "Daniel Mateus Pires (JIRA)" <ji...@apache.org> on 2018/09/28 10:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25565) Add scala style checker to check add Locale.ROOT to .toLowerCase and .toUpperCase for internal calls - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/28 10:22:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25566) [Spark Job History] SQL UI Page does not support Pagination - posted by "ABHISHEK KUMAR GUPTA (JIRA)" <ji...@apache.org> on 2018/09/28 11:04:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25566) [Spark Job History] SQL UI Page does not support Pagination - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/09/28 11:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25567) [Spark Job History] Table listing in SQL Tab not display Sort Icon - posted by "ABHISHEK KUMAR GUPTA (JIRA)" <ji...@apache.org> on 2018/09/28 11:16:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25567) [Spark Job History] Table listing in SQL Tab not display Sort Icon - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/09/28 11:17:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-17159) Improve FileInputDStream.findNewFiles list performance - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/28 14:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-17159) Improve FileInputDStream.findNewFiles list performance - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/28 14:17:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25553) Add EmptyInterpolatedStringChecker to scalastyle-config.xml - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/28 14:27:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-21514) Hive has updated with new support for S3 and InsertIntoHiveTable.scala should update also - posted by "Nick Orka (JIRA)" <ji...@apache.org> on 2018/09/28 15:19:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-20937) Describe spark.sql.parquet.writeLegacyFormat property in Spark SQL, DataFrames and Datasets Guide - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/28 15:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23717) Leverage docker support in Hadoop 3 - posted by "Eric Yang (JIRA)" <ji...@apache.org> on 2018/09/28 16:33:01 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-23717) Leverage docker support in Hadoop 3 - posted by "Eric Yang (JIRA)" <ji...@apache.org> on 2018/09/28 16:34:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25561) HiveClient.getPartitionsByFilter throws an exception if Hive retries directSql - posted by "Michael Allman (JIRA)" <ji...@apache.org> on 2018/09/28 17:09:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results - posted by "Nicholas Chammas (JIRA)" <ji...@apache.org> on 2018/09/28 18:59:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results - posted by "Peter Toth (JIRA)" <ji...@apache.org> on 2018/09/28 19:29:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23285) Allow spark.executor.cores to be fractional - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/28 20:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25568) Continue to update the remaining accumulators when failing to update one accumulator - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/09/28 20:52:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25568) Continue to update the remaining accumulators when failing to update one accumulator - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/09/28 20:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25568) Continue to update the remaining accumulators when failing to update one accumulator - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/28 20:56:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25568) Continue to update the remaining accumulators when failing to update one accumulator - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/28 20:57:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25542) Flaky test: OpenHashMapSuite - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/28 21:34:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25542) Flaky test: OpenHashMapSuite - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/28 21:34:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25569) Failing a Spark job when an accumulator cannot be updated - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/09/28 21:47:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25458) Support FOR ALL COLUMNS in ANALYZE TABLE - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/28 22:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25429) SparkListenerBus inefficient due to 'LiveStageMetrics#accumulatorIds:Array[Long]' data structure - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/28 22:09:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25449) Don't send zero accumulators in heartbeats - posted by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2018/09/28 23:35:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25570) Replace 2.3.1 with 2.3.2 in HiveExternalCatalogVersionsSuite - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/29 00:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25570) Replace 2.3.1 with 2.3.2 in HiveExternalCatalogVersionsSuite - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/29 00:17:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25570) Replace 2.3.1 with 2.3.2 in HiveExternalCatalogVersionsSuite - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/29 00:17:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-25559) Just remove the unsupported predicates in Parquet - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/29 00:48:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25570) Replace 2.3.1 with 2.3.2 in HiveExternalCatalogVersionsSuite - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/29 03:46:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25571) Add withColumnsRenamed method to Dataset - posted by "Chaerim Yeo (JIRA)" <ji...@apache.org> on 2018/09/29 04:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25571) Add withColumnsRenamed method to Dataset - posted by "Chaerim Yeo (JIRA)" <ji...@apache.org> on 2018/09/29 04:17:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25572) SparkR to skip tests because Java 10 - posted by "Felix Cheung (JIRA)" <ji...@apache.org> on 2018/09/29 05:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25572) SparkR tests failed on CRAN on Java 10 - posted by "Felix Cheung (JIRA)" <ji...@apache.org> on 2018/09/29 05:14:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25572) SparkR to skip tests because Java 10 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/29 05:14:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25572) SparkR to skip tests because Java 10 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/29 05:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-25572) SparkR tests failed on CRAN on Java 10 - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/29 05:15:00 UTC, 2 replies.
- [jira] [Created] (SPARK-25573) Combine resolveExpression and resolve in the rule ResolveReferences - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/29 06:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25574) Add an option `keepQuotes` for parsing csv file - posted by "liuxian (JIRA)" <ji...@apache.org> on 2018/09/29 07:44:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25574) Add an option `keepQuotes` for parsing csv file - posted by "liuxian (JIRA)" <ji...@apache.org> on 2018/09/29 07:45:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25574) Add an option `keepQuotes` for parsing csv file - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/29 07:57:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25574) Add an option `keepQuotes` for parsing csv file - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/29 07:57:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25447) Support JSON options by schema_of_json - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/29 09:55:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25048) Pivoting by multiple columns in Scala/Java - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/29 13:52:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25048) Pivoting by multiple columns in Scala/Java - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/29 13:52:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25571) Add withColumnsRenamed method to Dataset - posted by "Chaerim Yeo (JIRA)" <ji...@apache.org> on 2018/09/29 14:11:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25571) Add withColumnsRenamed method to Dataset - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/29 14:13:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25508) Refactor OrcReadBenchmark to use main method - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/29 16:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25571) Add withColumnsRenamed method to Dataset - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/29 17:27:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has. - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/09/29 18:00:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has. - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/09/29 18:00:00 UTC, 1 replies.
- [jira] [Created] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has. - posted by "shahid (JIRA)" <ji...@apache.org> on 2018/09/29 18:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has. - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/29 18:45:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-25572) SparkR tests failed on CRAN on Java 10 - posted by "Felix Cheung (JIRA)" <ji...@apache.org> on 2018/09/29 21:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25568) Continue to update the remaining accumulators when failing to update one accumulator - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/30 01:24:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25576) Fix lint failure in 2.2 - posted by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/09/30 01:31:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25501) Kafka delegation token support - posted by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/09/30 02:33:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25565) Add scala style checker to check add Locale.ROOT to .toLowerCase and .toUpperCase for internal calls - posted by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2018/09/30 06:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-21569) Internal Spark class needs to be kryo-registered - posted by "Shaofeng SHI (JIRA)" <ji...@apache.org> on 2018/09/30 06:37:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25523) Multi thread execute sparkSession.read().jdbc(url, table, properties) problem - posted by "huanghuai (JIRA)" <ji...@apache.org> on 2018/09/30 10:04:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25577) Add an on-off switch to display the executor additional columns - posted by "Lantao Jin (JIRA)" <ji...@apache.org> on 2018/09/30 10:05:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25577) Add an on-off switch to display the executor additional columns - posted by "Lantao Jin (JIRA)" <ji...@apache.org> on 2018/09/30 10:06:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-25577) Add an on-off switch to display the executor additional columns - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/30 10:13:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25577) Add an on-off switch to display the executor additional columns - posted by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/30 10:13:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-23429) Add executor memory metrics to heartbeat and expose in executors REST API - posted by "Edwina Lu (JIRA)" <ji...@apache.org> on 2018/09/30 16:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-25578) Update to Scala 2.12.7 - posted by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/09/30 20:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25543) Confusing log messages at DEBUG level, in K8s mode. - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/30 21:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-25543) Confusing log messages at DEBUG level, in K8s mode. - posted by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/09/30 21:31:00 UTC, 0 replies.