You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ma...@apache.org on 2015/12/16 00:03:47 UTC

[2/3] spark git commit: Update branch-1.6 for 1.6.0 release

http://git-wip-us.apache.org/repos/asf/spark/blob/80d26171/CHANGES.txt
----------------------------------------------------------------------
diff --git a/CHANGES.txt b/CHANGES.txt
new file mode 100644
index 0000000..ff59371
--- /dev/null
+++ b/CHANGES.txt
@@ -0,0 +1,34172 @@
+Spark Change Log
+----------------
+
+Release 1.6.0
+
+  [STREAMING][MINOR] Fix typo in function name of StateImpl
+  jerryshao <ss...@hortonworks.com>
+  2015-12-15 09:41:40 -0800
+  Commit: 23c8846, github.com/apache/spark/pull/10305
+
+  [SPARK-12327] Disable commented code lintr temporarily
+  Shivaram Venkataraman <sh...@cs.berkeley.edu>
+  2015-12-14 16:13:55 -0800
+  Commit: 352a0c8, github.com/apache/spark/pull/10300
+
+  [MINOR][DOC] Fix broken word2vec link
+  BenFradet <be...@gmail.com>
+  2015-12-14 13:50:30 +0000
+  Commit: c0f0f6c, github.com/apache/spark/pull/10282
+
+  [SPARK-12275][SQL] No plan for BroadcastHint in some condition
+  yucai <yu...@intel.com>
+  2015-12-13 23:08:21 -0800
+  Commit: 94ce502, github.com/apache/spark/pull/10265
+
+  [SPARK-12281][CORE] Fix a race condition when reporting ExecutorState in the shutdown hook
+  Shixiong Zhu <sh...@databricks.com>
+  2015-12-13 22:06:39 -0800
+  Commit: fbf16da, github.com/apache/spark/pull/10269
+
+  [SPARK-12267][CORE] Store the remote RpcEnv address to send the correct disconnetion message
+  Shixiong Zhu <sh...@databricks.com>
+  2015-12-12 21:58:55 -0800
+  Commit: d7e3bfd, github.com/apache/spark/pull/10261
+
+  [SPARK-12199][DOC] Follow-up: Refine example code in ml-features.md
+  Xusen Yin <yi...@gmail.com>
+  2015-12-12 17:47:01 -0800
+  Commit: e05364b, github.com/apache/spark/pull/10193
+
+  [SPARK-11193] Use Java ConcurrentHashMap instead of SynchronizedMap trait in order to avoid ClassCastException due to KryoSerializer in KinesisReceiver
+  Jean-Baptiste Onofré <jb...@apache.org>
+  2015-12-12 08:51:52 +0000
+  Commit: 2679fce, github.com/apache/spark/pull/10203
+
+  [SPARK-12158][SPARKR][SQL] Fix 'sample' functions that break R unit test cases
+  gatorsmile <ga...@gmail.com>
+  2015-12-11 20:55:16 -0800
+  Commit: 47461fe, github.com/apache/spark/pull/10160
+
+  [SPARK-12298][SQL] Fix infinite loop in DataFrame.sortWithinPartitions
+  Ankur Dave <an...@gmail.com>
+  2015-12-11 19:07:48 -0800
+  Commit: 03d8015, github.com/apache/spark/pull/10271
+
+  [SPARK-11978][ML] Move dataset_example.py to examples/ml and rename to dataframe_example.py
+  Yanbo Liang <yb...@gmail.com>
+  2015-12-11 18:02:24 -0800
+  Commit: c2f2046, github.com/apache/spark/pull/9957
+
+  [SPARK-12217][ML] Document invalid handling for StringIndexer
+  BenFradet <be...@gmail.com>
+  2015-12-11 15:43:00 -0800
+  Commit: 75531c7, github.com/apache/spark/pull/10257
+
+  [SPARK-11497][MLLIB][PYTHON] PySpark RowMatrix Constructor Has Type Erasure Issue
+  Mike Dusenberry <mw...@us.ibm.com>
+  2015-12-11 14:21:33 -0800
+  Commit: bfcc8cf, github.com/apache/spark/pull/9458
+
+  [SPARK-11964][DOCS][ML] Add in Pipeline Import/Export Documentation
+  anabranch <wa...@gmail.com>, Bill Chambers <wc...@ischool.berkeley.edu>
+  2015-12-11 12:55:56 -0800
+  Commit: 2ddd104, github.com/apache/spark/pull/10179
+
+  [SPARK-12146][SPARKR] SparkR jsonFile should support multiple input files
+  Yanbo Liang <yb...@gmail.com>
+  2015-12-11 11:47:35 -0800
+  Commit: f05bae4, github.com/apache/spark/pull/10145
+
+  Preparing development version 1.6.0-SNAPSHOT
+  Patrick Wendell <pw...@gmail.com>
+  2015-12-11 11:25:09 -0800
+  Commit: 2e45231
+
+  Preparing Spark release v1.6.0-rc2
+  Patrick Wendell <pw...@gmail.com>
+  2015-12-11 11:25:03 -0800
+  Commit: 23f8dfd
+
+  [SPARK-12258] [SQL] passing null into ScalaUDF (follow-up)
+  Davies Liu <da...@databricks.com>
+  2015-12-11 11:15:53 -0800
+  Commit: eec3660, github.com/apache/spark/pull/10266
+
+  Preparing development version 1.6.0-SNAPSHOT
+  Patrick Wendell <pw...@gmail.com>
+  2015-12-10 18:45:42 -0800
+  Commit: 250249e
+
+  Preparing Spark release v1.6.0-rc2
+  Patrick Wendell <pw...@gmail.com>
+  2015-12-10 18:45:36 -0800
+  Commit: 3e39925
+
+  [SPARK-12258][SQL] passing null into ScalaUDF
+  Davies Liu <da...@databricks.com>
+  2015-12-10 17:22:18 -0800
+  Commit: d09af2c, github.com/apache/spark/pull/10249
+
+  [STREAMING][DOC][MINOR] Update the description of direct Kafka stream doc
+  jerryshao <ss...@hortonworks.com>
+  2015-12-10 15:31:46 -0800
+  Commit: 5d3722f, github.com/apache/spark/pull/10246
+
+  [SPARK-12155][SPARK-12253] Fix executor OOM in unified memory management
+  Andrew Or <an...@databricks.com>
+  2015-12-10 15:30:08 -0800
+  Commit: c247b6a, github.com/apache/spark/pull/10240
+
+  [SPARK-12251] Document and improve off-heap memory configurations
+  Josh Rosen <jo...@databricks.com>
+  2015-12-10 15:29:04 -0800
+  Commit: 9870e5c, github.com/apache/spark/pull/10237
+
+  [SPARK-12212][ML][DOC] Clarifies the difference between spark.ml, spark.mllib and mllib in the documentation.
+  Timothy Hunter <ti...@databricks.com>
+  2015-12-10 12:50:46 -0800
+  Commit: d0307de, github.com/apache/spark/pull/10234
+
+  [SPARK-12250][SQL] Allow users to define a UDAF without providing details of its inputSchema
+  Yin Huai <yh...@databricks.com>
+  2015-12-10 12:03:29 -0800
+  Commit: 594fafc, github.com/apache/spark/pull/10236
+
+  [SPARK-12012][SQL][BRANCH-1.6] Show more comprehensive PhysicalRDD metadata when visualizing SQL query plan
+  Cheng Lian <li...@databricks.com>
+  2015-12-10 10:19:44 -0800
+  Commit: e541f70, github.com/apache/spark/pull/10250
+
+  [SPARK-12234][SPARKR] Fix ```subset``` function error when only set ```select``` argument
+  Yanbo Liang <yb...@gmail.com>
+  2015-12-10 10:18:58 -0800
+  Commit: 93ef246, github.com/apache/spark/pull/10217
+
+  [SPARK-11602][MLLIB] Refine visibility for 1.6 scala API audit
+  Yuhao Yang <hh...@gmail.com>
+  2015-12-10 10:15:50 -0800
+  Commit: e65c885, github.com/apache/spark/pull/9939
+
+  [SPARK-12198][SPARKR] SparkR support read.parquet and deprecate parquetFile
+  Yanbo Liang <yb...@gmail.com>
+  2015-12-10 09:44:53 -0800
+  Commit: b7b9f77, github.com/apache/spark/pull/10191
+
+  [SPARK-12242][SQL] Add DataFrame.transform method
+  Reynold Xin <rx...@databricks.com>
+  2015-12-10 22:23:10 +0800
+  Commit: f939c71, github.com/apache/spark/pull/10226
+
+  [SPARK-12136][STREAMING] rddToFileName does not properly handle prefix and suffix parameters
+  bomeng <bm...@us.ibm.com>, Bo Meng <me...@bos-macbook-pro.usca.ibm.com>
+  2015-12-10 12:53:53 +0000
+  Commit: b5e5812, github.com/apache/spark/pull/10185
+
+  [SPARK-12244][SPARK-12245][STREAMING] Rename trackStateByKey to mapWithState and change tracking function signature
+  Tathagata Das <ta...@gmail.com>
+  2015-12-09 20:47:15 -0800
+  Commit: f6d8661, github.com/apache/spark/pull/10224
+
+  [SPARK-11796] Fix httpclient and httpcore depedency issues related to docker-client
+  Mark Grover <mg...@cloudera.com>
+  2015-12-09 18:37:35 -0800
+  Commit: 699f497, github.com/apache/spark/pull/9876
+
+  [SPARK-11678][SQL][DOCS] Document basePath in the programming guide.
+  Yin Huai <yh...@databricks.com>
+  2015-12-09 18:09:36 -0800
+  Commit: 9fe8dc9, github.com/apache/spark/pull/10211
+
+  [SPARK-12165][ADDENDUM] Fix outdated comments on unroll test
+  Andrew Or <an...@databricks.com>
+  2015-12-09 17:24:04 -0800
+  Commit: d86a88d, github.com/apache/spark/pull/10229
+
+  [SPARK-12211][DOC][GRAPHX] Fix version number in graphx doc for migration from 1.1
+  Andrew Ray <ra...@gmail.com>
+  2015-12-09 17:16:01 -0800
+  Commit: 9bc6a27, github.com/apache/spark/pull/10206
+
+  [SPARK-11551][DOC] Replace example code in ml-features.md using include_example
+  Xusen Yin <yi...@gmail.com>, somideshmukh <so...@us.ibm.com>
+  2015-12-09 12:00:48 -0800
+  Commit: bfb4201, github.com/apache/spark/pull/10219
+
+  [SPARK-11824][WEBUI] WebUI does not render descriptions with 'bad' HTML, throws console error
+  Sean Owen <so...@cloudera.com>
+  2015-12-09 19:47:38 +0000
+  Commit: ee0a6e7, github.com/apache/spark/pull/10159
+
+  [SPARK-12165][SPARK-12189] Fix bugs in eviction of storage memory by execution
+  Josh Rosen <jo...@databricks.com>, Andrew Or <an...@databricks.com>
+  2015-12-09 11:39:59 -0800
+  Commit: 05e441e, github.com/apache/spark/pull/10170
+
+  [SPARK-10299][ML] word2vec should allow users to specify the window size
+  Holden Karau <ho...@us.ibm.com>, Holden Karau <ho...@pigscanfly.ca>
+  2015-12-09 16:45:13 +0000
+  Commit: acd4624, github.com/apache/spark/pull/8513
+
+  [SPARK-12031][CORE][BUG] Integer overflow when do sampling
+  uncleGen <hu...@gmail.com>
+  2015-12-09 15:09:40 +0000
+  Commit: b5a76b4, github.com/apache/spark/pull/10023
+
+  [SPARK-12222] [CORE] Deserialize RoaringBitmap using Kryo serializer throw Buffer underflow exception
+  Fei Wang <wa...@huawei.com>
+  2015-12-08 21:32:31 -0800
+  Commit: 0be792a, github.com/apache/spark/pull/10213
+
+  [SPARK-11343][ML] Documentation of float and double prediction/label columns in RegressionEvaluator
+  Dominik Dahlem <do...@gmail.combination>
+  2015-12-08 18:54:10 -0800
+  Commit: 9e82273, github.com/apache/spark/pull/9598
+
+  [SPARK-8517][ML][DOC] Reorganizes the spark.ml user guide
+  Timothy Hunter <ti...@databricks.com>
+  2015-12-08 18:40:21 -0800
+  Commit: b1d5a78, github.com/apache/spark/pull/10207
+
+  [SPARK-12069][SQL] Update documentation with Datasets
+  Michael Armbrust <mi...@databricks.com>
+  2015-12-08 15:58:35 -0800
+  Commit: 2a5e4d1, github.com/apache/spark/pull/10060
+
+  [SPARK-12187] *MemoryPool classes should not be fully public
+  Andrew Or <an...@databricks.com>
+  2015-12-08 14:34:15 -0800
+  Commit: 25249d1, github.com/apache/spark/pull/10182
+
+  [SPARK-12159][ML] Add user guide section for IndexToString transformer
+  BenFradet <be...@gmail.com>
+  2015-12-08 12:45:34 -0800
+  Commit: 3e31e7e, github.com/apache/spark/pull/10166
+
+  [SPARK-11605][MLLIB] ML 1.6 QA: API: Java compatibility, docs
+  Yuhao Yang <hh...@gmail.com>
+  2015-12-08 11:46:26 -0800
+  Commit: 7e45feb, github.com/apache/spark/pull/10102
+
+  [SPARK-12205][SQL] Pivot fails Analysis when aggregate is UnresolvedFunction
+  Andrew Ray <ra...@gmail.com>
+  2015-12-08 10:52:17 -0800
+  Commit: 9145bfb, github.com/apache/spark/pull/10202
+
+  [SPARK-10393] use ML pipeline in LDA example
+  Yuhao Yang <hh...@gmail.com>, yuhaoyang <yu...@zhanglipings-iMac.local>
+  2015-12-08 10:29:51 -0800
+  Commit: 1c8451b, github.com/apache/spark/pull/8551
+
+  [SPARK-12188][SQL] Code refactoring and comment correction in Dataset APIs
+  gatorsmile <ga...@gmail.com>
+  2015-12-08 10:25:57 -0800
+  Commit: be0fe9b, github.com/apache/spark/pull/10184
+
+  [SPARK-12195][SQL] Adding BigDecimal, Date and Timestamp into Encoder
+  gatorsmile <ga...@gmail.com>
+  2015-12-08 10:15:58 -0800
+  Commit: 9eeb0f2, github.com/apache/spark/pull/10188
+
+  [SPARK-12201][SQL] add type coercion rule for greatest/least
+  Wenchen Fan <we...@databricks.com>
+  2015-12-08 10:13:40 -0800
+  Commit: 8ef33aa, github.com/apache/spark/pull/10196
+
+  [SPARK-11652][CORE] Remote code execution with InvokerTransformer
+  Sean Owen <so...@cloudera.com>
+  2015-12-08 14:34:47 +0000
+  Commit: c8f9eb7, github.com/apache/spark/pull/10198
+
+  [SPARK-11551][DOC][EXAMPLE] Revert PR #10002
+  Cheng Lian <li...@databricks.com>
+  2015-12-08 19:18:59 +0800
+  Commit: 8a791a3, github.com/apache/spark/pull/10200
+
+  [SPARK-12166][TEST] Unset hadoop related environment in testing
+  Jeff Zhang <zj...@apache.org>
+  2015-12-08 11:05:06 +0000
+  Commit: 870f435, github.com/apache/spark/pull/10172
+
+  [SPARK-12103][STREAMING][KAFKA][DOC] document that K means Key and V …
+  cody koeninger <co...@koeninger.org>
+  2015-12-08 11:02:35 +0000
+  Commit: c9e5274, github.com/apache/spark/pull/10132
+
+  [SPARK-11958][SPARK-11957][ML][DOC] SQLTransformer user guide and example code
+  Yanbo Liang <yb...@gmail.com>
+  2015-12-07 23:50:57 -0800
+  Commit: 5c82169, github.com/apache/spark/pull/10006
+
+  [SPARK-10259][ML] Add @since annotation to ml.classification
+  Takahashi Hiroshi <ta...@lab.ntt.co.jp>
+  2015-12-07 23:46:55 -0800
+  Commit: 8652fc0, github.com/apache/spark/pull/8534
+
+  [SPARK-11551][DOC][EXAMPLE] Replace example code in ml-features.md using include_example
+  Xusen Yin <yi...@gmail.com>, somideshmukh <so...@us.ibm.com>
+  2015-12-07 23:26:34 -0800
+  Commit: 3c683ed, github.com/apache/spark/pull/10002
+
+  [SPARK-12160][MLLIB] Use SQLContext.getOrCreate in MLlib
+  Joseph K. Bradley <jo...@databricks.com>
+  2015-12-07 16:37:09 -0800
+  Commit: 115bfbd, github.com/apache/spark/pull/10161
+
+  [SPARK-12184][PYTHON] Make python api doc for pivot consistant with scala doc
+  Andrew Ray <ra...@gmail.com>
+  2015-12-07 15:01:00 -0800
+  Commit: cdeb89b, github.com/apache/spark/pull/10176
+
+  [SPARK-11963][DOC] Add docs for QuantileDiscretizer
+  Xusen Yin <yi...@gmail.com>
+  2015-12-07 13:16:47 -0800
+  Commit: c8aa5f2, github.com/apache/spark/pull/9962
+
+  [SPARK-11932][STREAMING] Partition previous TrackStateRDD if partitioner not present
+  Tathagata Das <ta...@gmail.com>
+  2015-12-07 11:03:59 -0800
+  Commit: 539914f, github.com/apache/spark/pull/9988
+
+  [SPARK-12132] [PYSPARK] raise KeyboardInterrupt inside SIGINT handler
+  Davies Liu <da...@databricks.com>
+  2015-12-07 11:00:25 -0800
+  Commit: fed4538, github.com/apache/spark/pull/10134
+
+  [SPARK-12034][SPARKR] Eliminate warnings in SparkR test cases.
+  Sun Rui <ru...@intel.com>
+  2015-12-07 10:38:17 -0800
+  Commit: 3f230f7, github.com/apache/spark/pull/10030
+
+  [SPARK-12106][STREAMING][FLAKY-TEST] BatchedWAL test transiently flaky when Jenkins load is high
+  Burak Yavuz <br...@gmail.com>
+  2015-12-07 00:21:55 -0800
+  Commit: c54b698, github.com/apache/spark/pull/10110
+
+  [SPARK-12138][SQL] Escape \u in the generated comments of codegen
+  gatorsmile <ga...@gmail.com>
+  2015-12-06 11:15:02 -0800
+  Commit: 82a71ab, github.com/apache/spark/pull/10155
+
+  [SPARK-12048][SQL] Prevent to close JDBC resources twice
+  gcc <sp...@condor.rhaag.ip>
+  2015-12-06 16:27:40 +0000
+  Commit: c8747a9, github.com/apache/spark/pull/10101
+
+  [SPARK-12044][SPARKR] Fix usage of isnan, isNaN
+  Yanbo Liang <yb...@gmail.com>
+  2015-12-05 22:51:05 -0800
+  Commit: 2feac49, github.com/apache/spark/pull/10037
+
+  [SPARK-12115][SPARKR] Change numPartitions() to getNumPartitions() to be consistent with Scala/Python
+  Yanbo Liang <yb...@gmail.com>
+  2015-12-05 16:39:01 -0800
+  Commit: 04dfaa6, github.com/apache/spark/pull/10123
+
+  [SPARK-11715][SPARKR] Add R support corr for Column Aggregration
+  felixcheung <fe...@hotmail.com>
+  2015-12-05 16:00:12 -0800
+  Commit: 664694b, github.com/apache/spark/pull/9680
+
+  [SPARK-11774][SPARKR] Implement struct(), encode(), decode() functions in SparkR.
+  Sun Rui <ru...@intel.com>
+  2015-12-05 15:49:51 -0800
+  Commit: 57d1640, github.com/apache/spark/pull/9804
+
+  [SPARK-12058][STREAMING][KINESIS][TESTS] fix Kinesis python tests
+  Burak Yavuz <br...@gmail.com>
+  2015-12-04 12:08:42 -0800
+  Commit: 39d5cc8, github.com/apache/spark/pull/10050
+
+  [SPARK-12089] [SQL] Fix memory corrupt due to freeing a page being referenced
+  Nong <no...@cloudera.com>
+  2015-12-04 10:01:20 -0800
+  Commit: 3fd757c, github.com/apache/spark/pull/10142
+
+  [SPARK-12122][STREAMING] Prevent batches from being submitted twice after recovering StreamingContext from checkpoint
+  Tathagata Das <ta...@gmail.com>
+  2015-12-04 01:42:29 -0800
+  Commit: 8f784b8, github.com/apache/spark/pull/10127
+
+  [SPARK-12104][SPARKR] collect() does not handle multiple columns with same name.
+  Sun Rui <ru...@intel.com>
+  2015-12-03 21:11:10 -0800
+  Commit: 2d7c4f6, github.com/apache/spark/pull/10118
+
+  [SPARK-12056][CORE] Create a TaskAttemptContext only after calling setConf.
+  Anderson de Andrade <ad...@verticalscope.com>
+  2015-12-03 16:37:00 -0800
+  Commit: 9e8a8f7, github.com/apache/spark/pull/10046
+
+  [SPARK-12019][SPARKR] Support character vector for sparkR.init(), check param and fix doc
+  felixcheung <fe...@hotmail.com>
+  2015-12-03 13:25:20 -0800
+  Commit: 355bd72, github.com/apache/spark/pull/10034
+
+  [FLAKY-TEST-FIX][STREAMING][TEST] Make sure StreamingContexts are shutdown after test
+  Tathagata Das <ta...@gmail.com>
+  2015-12-03 12:00:09 -0800
+  Commit: b1a27d6, github.com/apache/spark/pull/10124
+
+  [SPARK-12107][EC2] Update spark-ec2 versions
+  Nicholas Chammas <ni...@gmail.com>
+  2015-12-03 11:59:10 -0800
+  Commit: 9d698fc, github.com/apache/spark/pull/10109
+
+  [MINOR][ML] Use coefficients replace weights
+  Yanbo Liang <yb...@gmail.com>
+  2015-12-03 11:37:34 -0800
+  Commit: e0577f5, github.com/apache/spark/pull/10065
+
+  [SPARK-12108] Make event logs smaller
+  Andrew Or <an...@databricks.com>
+  2015-12-03 11:09:29 -0800
+  Commit: bf8b95f, github.com/apache/spark/pull/10115
+
+  [SPARK-12101][CORE] Fix thread pools that cannot cache tasks in Worker and AppClient
+  Shixiong Zhu <sh...@databricks.com>
+  2015-12-03 11:06:25 -0800
+  Commit: 4c84f6e, github.com/apache/spark/pull/10108
+
+  [SPARK-12059][CORE] Avoid assertion error when unexpected state transition met in Master
+  jerryshao <ss...@hortonworks.com>
+  2015-12-03 11:05:12 -0800
+  Commit: 8865d87, github.com/apache/spark/pull/10091
+
+  [SPARK-12116][SPARKR][DOCS] document how to workaround function name conflicts with dplyr
+  felixcheung <fe...@hotmail.com>
+  2015-12-03 09:22:21 -0800
+  Commit: f7ae62c, github.com/apache/spark/pull/10119
+
+  [DOCUMENTATION][KAFKA] fix typo in kafka/OffsetRange.scala
+  microwishing <we...@kaiyuandao.com>
+  2015-12-03 16:09:05 +0000
+  Commit: 84cbed1, github.com/apache/spark/pull/10121
+
+  [DOCUMENTATION][MLLIB] typo in mllib doc
+  Jeff Zhang <zj...@apache.org>
+  2015-12-03 15:36:28 +0000
+  Commit: 93b69ec, github.com/apache/spark/pull/10093
+
+  [SPARK-12088][SQL] check connection.isClosed before calling connection…
+  Huaxin Gao <hu...@oc0558782468.ibm.com>
+  2015-12-03 08:42:21 +0000
+  Commit: 5826096, github.com/apache/spark/pull/10095
+
+  [SPARK-12109][SQL] Expressions's simpleString should delegate to its toString.
+  Yin Huai <yh...@databricks.com>
+  2015-12-03 11:21:24 +0800
+  Commit: 6674fd8, github.com/apache/spark/pull/10111
+
+  [SPARK-12082][FLAKY-TEST] Increase timeouts in NettyBlockTransferSecuritySuite
+  Josh Rosen <jo...@databricks.com>
+  2015-12-03 11:12:02 +0800
+  Commit: 6914ee9, github.com/apache/spark/pull/10113
+
+  [SPARK-12000] do not specify arg types when reference a method in ScalaDoc
+  Xiangrui Meng <me...@databricks.com>
+  2015-12-02 17:19:31 -0800
+  Commit: 656d44e, github.com/apache/spark/pull/10114
+
+  [SPARK-12093][SQL] Fix the error of comment in DDLParser
+  Yadong Qi <qi...@gmail.com>
+  2015-12-03 08:48:49 +0800
+  Commit: cb142fd, github.com/apache/spark/pull/10096
+
+  [SPARK-10266][DOCUMENTATION, ML] Fixed @Since annotation for ml.tunning
+  Yu ISHIKAWA <yu...@gmail.com>, Ehsan M.Kermani <eh...@gmail.com>
+  2015-12-02 14:15:54 -0800
+  Commit: 911259e, github.com/apache/spark/pull/9338
+
+  Preparing development version 1.6.0-SNAPSHOT
+  Patrick Wendell <pw...@gmail.com>
+  2015-12-02 09:54:15 -0800
+  Commit: 5d915fe
+
+  Preparing Spark release v1.6.0-rc1
+  Patrick Wendell <pw...@gmail.com>
+  2015-12-02 09:54:10 -0800
+  Commit: bf52584
+
+  [SPARK-12094][SQL] Prettier tree string for TreeNode
+  Cheng Lian <li...@databricks.com>
+  2015-12-02 09:36:12 -0800
+  Commit: f449a40, github.com/apache/spark/pull/10099
+
+  [SPARK-3580][CORE] Add Consistent Method To Get Number of RDD Partitions Across Different Languages
+  Jeroen Schot <je...@surfsara.nl>
+  2015-12-02 09:40:07 +0000
+  Commit: d79dd97, github.com/apache/spark/pull/9767
+
+  [SPARK-12090] [PYSPARK] consider shuffle in coalesce()
+  Davies Liu <da...@databricks.com>
+  2015-12-01 22:41:48 -0800
+  Commit: c47a737, github.com/apache/spark/pull/10090
+
+  [SPARK-11949][SQL] Check bitmasks to set nullable property
+  Liang-Chi Hsieh <vi...@appier.com>
+  2015-12-01 21:51:33 -0800
+  Commit: 3c4938e, github.com/apache/spark/pull/10067
+
+  [SPARK-12087][STREAMING] Create new JobConf for every batch in saveAsHadoopFiles
+  Tathagata Das <ta...@gmail.com>
+  2015-12-01 21:04:52 -0800
+  Commit: 1f42295, github.com/apache/spark/pull/10088
+
+  [SPARK-12077][SQL] change the default plan for single distinct
+  Davies Liu <da...@databricks.com>
+  2015-12-01 20:17:12 -0800
+  Commit: a5743af, github.com/apache/spark/pull/10075
+
+  [SPARK-12081] Make unified memory manager work with small heaps
+  Andrew Or <an...@databricks.com>
+  2015-12-01 19:51:12 -0800
+  Commit: 84c44b5, github.com/apache/spark/pull/10081
+
+  [SPARK-8414] Ensure context cleaner periodic cleanups
+  Andrew Or <an...@databricks.com>
+  2015-12-01 19:36:34 -0800
+  Commit: 72da2a2, github.com/apache/spark/pull/10070
+
+  [SPARK-11596][SQL] In TreeNode's argString, if a TreeNode is not a child of the current TreeNode, we should only return the simpleString.
+  Yin Huai <yh...@databricks.com>
+  2015-12-01 17:18:45 -0800
+  Commit: 1b3db96, github.com/apache/spark/pull/10079
+
+  [SPARK-11352][SQL] Escape */ in the generated comments.
+  Yin Huai <yh...@databricks.com>
+  2015-12-01 16:24:04 -0800
+  Commit: 14eadf9, github.com/apache/spark/pull/10072
+
+  [SPARK-11788][SQL] surround timestamp/date value with quotes in JDBC data source
+  Huaxin Gao <hu...@oc0558782468.ibm.com>
+  2015-12-01 15:32:57 -0800
+  Commit: 1135430, github.com/apache/spark/pull/9872
+
+  [SPARK-11328][SQL] Improve error message when hitting this issue
+  Nong Li <no...@databricks.com>, Nong Li <no...@gmail.com>
+  2015-12-01 15:30:21 -0800
+  Commit: f1122dd, github.com/apache/spark/pull/10080
+
+  [SPARK-12075][SQL] Speed up HiveComparisionTest by avoiding / speeding up TestHive.reset()
+  Josh Rosen <jo...@databricks.com>
+  2015-12-02 07:29:45 +0800
+  Commit: d77bf0b, github.com/apache/spark/pull/10055
+
+  [SPARK-12002][STREAMING][PYSPARK] Fix python direct stream checkpoint recovery issue
+  jerryshao <ss...@hortonworks.com>, Shixiong Zhu <sh...@databricks.com>
+  2015-12-01 15:26:10 -0800
+  Commit: 012de2c, github.com/apache/spark/pull/10017
+
+  [SPARK-11961][DOC] Add docs of ChiSqSelector
+  Xusen Yin <yi...@gmail.com>
+  2015-12-01 15:21:53 -0800
+  Commit: 5647774, github.com/apache/spark/pull/9965
+
+  Revert "[SPARK-12060][CORE] Avoid memory copy in JavaSerializerInstance.serialize"
+  Shixiong Zhu <sh...@databricks.com>
+  2015-12-01 15:16:07 -0800
+  Commit: 21909b8
+
+  [SPARK-12004] Preserve the RDD partitioner through RDD checkpointing
+  Tathagata Das <ta...@gmail.com>
+  2015-12-01 14:08:36 -0800
+  Commit: 81db8d0, github.com/apache/spark/pull/9983
+
+  [SPARK-12030] Fix Platform.copyMemory to handle overlapping regions.
+  Nong Li <no...@databricks.com>
+  2015-12-01 12:59:53 -0800
+  Commit: 1cf9d38, github.com/apache/spark/pull/10068
+
+  [SPARK-12065] Upgrade Tachyon from 0.8.1 to 0.8.2
+  Josh Rosen <jo...@databricks.com>
+  2015-12-01 11:49:20 -0800
+  Commit: ab2a124, github.com/apache/spark/pull/10054
+
+  [SPARK-11821] Propagate Kerberos keytab for all environments
+  woj-i <wo...@gmail.com>
+  2015-12-01 11:05:45 -0800
+  Commit: 99dc133, github.com/apache/spark/pull/9859
+
+  [SPARK-12046][DOC] Fixes various ScalaDoc/JavaDoc issues
+  Cheng Lian <li...@databricks.com>
+  2015-12-01 10:21:31 -0800
+  Commit: 843a31a, github.com/apache/spark/pull/10063
+
+  [SPARK-11905][SQL] Support Persist/Cache and Unpersist in Dataset APIs
+  gatorsmile <ga...@gmail.com>, xiaoli <li...@gmail.com>, Xiao Li <xi...@Xiaos-MacBook-Pro.local>
+  2015-12-01 10:38:59 -0800
+  Commit: 40769b4, github.com/apache/spark/pull/9889
+
+  [SPARK-11954][SQL] Encoder for JavaBeans
+  Wenchen Fan <we...@databricks.com>
+  2015-12-01 10:35:12 -0800
+  Commit: 88bbce0, github.com/apache/spark/pull/9937
+
+  [SPARK-11856][SQL] add type cast if the real type is different but compatible with encoder schema
+  Wenchen Fan <we...@databricks.com>
+  2015-12-01 10:24:53 -0800
+  Commit: 74a2306, github.com/apache/spark/pull/9840
+
+  [SPARK-12068][SQL] use a single column in Dataset.groupBy and count will fail
+  Wenchen Fan <we...@databricks.com>
+  2015-12-01 10:22:55 -0800
+  Commit: 6e3e3c6, github.com/apache/spark/pull/10059
+
+  [SPARK-12060][CORE] Avoid memory copy in JavaSerializerInstance.serialize
+  Shixiong Zhu <sh...@databricks.com>
+  2015-12-01 09:45:55 -0800
+  Commit: 9b99b2b, github.com/apache/spark/pull/10051
+
+  [SPARK-11949][SQL] Set field nullable property for GroupingSets to get correct results for null values
+  Liang-Chi Hsieh <vi...@appier.com>
+  2015-12-01 07:42:37 -0800
+  Commit: add4e63, github.com/apache/spark/pull/10038
+
+  [SPARK-12018][SQL] Refactor common subexpression elimination code
+  Liang-Chi Hsieh <vi...@appier.com>
+  2015-11-30 20:56:42 -0800
+  Commit: 1aa39bd, github.com/apache/spark/pull/10009
+
+  [HOTFIX][SPARK-12000] Add missing quotes in Jekyll API docs plugin.
+  Josh Rosen <jo...@databricks.com>
+  2015-11-30 17:15:47 -0800
+  Commit: 86a46ce
+
+  [SPARK-12049][CORE] User JVM shutdown hook can cause deadlock at shutdown
+  Sean Owen <so...@cloudera.com>
+  2015-11-30 17:33:09 -0800
+  Commit: 2fc3fce, github.com/apache/spark/pull/10042
+
+  [SPARK-12007][NETWORK] Avoid copies in the network lib's RPC layer.
+  Marcelo Vanzin <va...@cloudera.com>
+  2015-11-30 17:22:05 -0800
+  Commit: ef6f8c2, github.com/apache/spark/pull/9987
+
+  [SPARK-12037][CORE] initialize heartbeatReceiverRef before calling startDriverHeartbeat
+  CodingCat <zh...@gmail.com>
+  2015-11-30 17:19:26 -0800
+  Commit: a4e13482, github.com/apache/spark/pull/10032
+
+  [SPARK-12000] Fix API doc generation issues
+  Josh Rosen <jo...@databricks.com>, Timothy Hunter <ti...@databricks.com>
+  2015-11-30 16:37:27 -0800
+  Commit: 43ffa03, github.com/apache/spark/pull/10048.
+
+  fix Maven build
+  Davies Liu <da...@gmail.com>
+  2015-11-30 15:42:10 -0800
+  Commit: 4361517
+
+  [SPARK-11960][MLLIB][DOC] User guide for streaming tests
+  Feynman Liang <fe...@gmail.com>
+  2015-11-30 15:38:44 -0800
+  Commit: ebf87eb, github.com/apache/spark/pull/10005
+
+  [SPARK-11975][ML] Remove duplicate mllib example (DT/RF/GBT in Java/Python)
+  Yanbo Liang <yb...@gmail.com>
+  2015-11-30 15:01:08 -0800
+  Commit: a387cef, github.com/apache/spark/pull/9954
+
+  [SPARK-11689][ML] Add user guide and example code for LDA under spark.ml
+  Yuhao Yang <hh...@gmail.com>
+  2015-11-30 14:56:51 -0800
+  Commit: 1562ef1, github.com/apache/spark/pull/9974
+
+  [SPARK-12053][CORE] EventLoggingListener.getLogPath needs 4 parameters
+  Teng Qiu <te...@gmail.com>
+  2015-12-01 07:27:32 +0900
+  Commit: a8c6d8a, github.com/apache/spark/pull/10044
+
+  [MINOR][DOCS] fixed list display in ml-ensembles
+  BenFradet <be...@gmail.com>
+  2015-11-30 13:02:08 -0800
+  Commit: 0978ec1, github.com/apache/spark/pull/10025
+
+  [SPARK-11700] [SQL] Remove thread local SQLContext  in SparkPlan
+  Davies Liu <da...@databricks.com>
+  2015-11-30 10:32:13 -0800
+  Commit: 32911de, github.com/apache/spark/pull/9990
+
+  [SPARK-11989][SQL] Only use commit in JDBC data source if the underlying database supports transactions
+  CK50 <ch...@oracle.com>, Christian Kurz <ch...@oracle.com>
+  2015-11-30 20:08:49 +0800
+  Commit: a589736, github.com/apache/spark/pull/9973
+
+  [SPARK-12023][BUILD] Fix warnings while packaging spark with maven.
+  Prashant Sharma <sc...@gmail.com>
+  2015-11-30 10:11:27 +0000
+  Commit: 33cd171, github.com/apache/spark/pull/10014
+
+  [DOC] Explicitly state that top maintains the order of elements
+  Wieland Hoffmann <th...@gmail.com>
+  2015-11-30 09:32:48 +0000
+  Commit: aaf835f, github.com/apache/spark/pull/10013
+
+  [MINOR][BUILD] Changed the comment to reflect the plugin project is there to support SBT pom reader only.
+  Prashant Sharma <sc...@gmail.com>
+  2015-11-30 09:30:58 +0000
+  Commit: e965392, github.com/apache/spark/pull/10012
+
+  [SPARK-11859][MESOS] SparkContext accepts invalid Master URLs in the form zk://host:port for a multi-master Mesos cluster using ZooKeeper
+  toddwan <ta...@outlook.com>
+  2015-11-30 09:26:29 +0000
+  Commit: 12d97b0, github.com/apache/spark/pull/9886
+
+  [SPARK-12039] [SQL] Ignore HiveSparkSubmitSuite's "SPARK-9757 Persist Parquet relation with decimal column".
+  Yin Huai <yh...@databricks.com>
+  2015-11-29 19:02:15 -0800
+  Commit: a4a2a7d, github.com/apache/spark/pull/10035
+
+  [SPARK-12024][SQL] More efficient multi-column counting.
+  Herman van Hovell <hv...@questtec.nl>
+  2015-11-29 14:13:11 -0800
+  Commit: abd3151, github.com/apache/spark/pull/10015
+
+  [SPARK-11781][SPARKR] SparkR has problem in inferring type of raw type.
+  Sun Rui <ru...@intel.com>
+  2015-11-29 11:08:26 -0800
+  Commit: 5601d8f, github.com/apache/spark/pull/9769
+
+  [SPARK-9319][SPARKR] Add support for setting column names, types
+  felixcheung <fe...@hotmail.com>
+  2015-11-28 21:16:21 -0800
+  Commit: 06da5fd, github.com/apache/spark/pull/9654
+
+  [SPARK-12029][SPARKR] Improve column functions signature, param check, tests, fix doc and add examples
+  felixcheung <fe...@hotmail.com>
+  2015-11-28 21:02:05 -0800
+  Commit: 2503a43, github.com/apache/spark/pull/10019
+
+  [SPARK-12028] [SQL] get_json_object returns an incorrect result when the value is null literals
+  gatorsmile <ga...@gmail.com>
+  2015-11-27 22:44:08 -0800
+  Commit: 2ecc0f2, github.com/apache/spark/pull/10018
+
+  [SPARK-12020][TESTS][TEST-HADOOP2.0] PR builder cannot trigger hadoop 2.0 test
+  Yin Huai <yh...@databricks.com>
+  2015-11-27 15:11:13 -0800
+  Commit: 47c2c8c, github.com/apache/spark/pull/10010
+
+  [SPARK-12021][STREAMING][TESTS] Fix the potential dead-lock in StreamingListenerSuite
+  Shixiong Zhu <sh...@databricks.com>
+  2015-11-27 11:50:18 -0800
+  Commit: 9966357, github.com/apache/spark/pull/10011
+
+  [SPARK-12025][SPARKR] Rename some window rank function names for SparkR
+  Yanbo Liang <yb...@gmail.com>
+  2015-11-27 11:48:01 -0800
+  Commit: dfc98fa, github.com/apache/spark/pull/10016
+
+  [SPARK-11997] [SQL] NPE when save a DataFrame as parquet and partitioned by long column
+  Dilip Biswal <db...@us.ibm.com>
+  2015-11-26 21:04:40 -0800
+  Commit: bb3fe0a, github.com/apache/spark/pull/10001
+
+  [SPARK-11778][SQL] add regression test
+  Huaxin Gao <hu...@oc0558782468.ibm.com>
+  2015-11-26 19:17:46 -0800
+  Commit: d2a5a49, github.com/apache/spark/pull/9890
+
+  [SPARK-11917][PYSPARK] Add SQLContext#dropTempTable to PySpark
+  Jeff Zhang <zj...@apache.org>
+  2015-11-26 19:15:22 -0800
+  Commit: 5c3a9df, github.com/apache/spark/pull/9903
+
+  [SPARK-11881][SQL] Fix for postgresql fetchsize > 0
+  mariusvniekerk <ma...@gmail.com>
+  2015-11-26 19:13:16 -0800
+  Commit: 6c31c20, github.com/apache/spark/pull/9861
+
+  [SPARK-12011][SQL] Stddev/Variance etc should support columnName as arguments
+  Yanbo Liang <yb...@gmail.com>
+  2015-11-26 19:00:36 -0800
+  Commit: 29f3a2f, github.com/apache/spark/pull/9994
+
+  [SPARK-11996][CORE] Make the executor thread dump work again
+  Shixiong Zhu <sh...@databricks.com>
+  2015-11-26 18:56:22 -0800
+  Commit: c1bde2a, github.com/apache/spark/pull/9976
+
+  doc typo: "classificaion" -> "classification"
+  muxator <mu...@users.noreply.github.com>
+  2015-11-26 18:52:20 -0800
+  Commit: fc35fb3, github.com/apache/spark/pull/10008
+
+  [SPARK-11973][SQL] Improve optimizer code readability.
+  Reynold Xin <rx...@databricks.com>
+  2015-11-26 18:47:54 -0800
+  Commit: f18de5a, github.com/apache/spark/pull/9995
+
+  [SPARK-11998][SQL][TEST-HADOOP2.0] When downloading Hadoop artifacts from maven, we need to try to download the version that is used by Spark
+  Yin Huai <yh...@databricks.com>
+  2015-11-26 16:20:08 -0800
+  Commit: 64813b7, github.com/apache/spark/pull/9979
+
+  [SPARK-11863][SQL] Unable to resolve order by if it contains mixture of aliases and real columns
+  Dilip Biswal <db...@us.ibm.com>, Wenchen Fan <we...@databricks.com>
+  2015-11-26 11:31:28 -0800
+  Commit: ce90bbe, github.com/apache/spark/pull/9961
+
+  [SPARK-12005][SQL] Work around VerifyError in HyperLogLogPlusPlus.
+  Marcelo Vanzin <va...@cloudera.com>
+  2015-11-26 01:15:05 -0800
+  Commit: 5e89f16, github.com/apache/spark/pull/9985
+
+  [SPARK-11973] [SQL] push filter through aggregation with alias and literals
+  Davies Liu <da...@databricks.com>
+  2015-11-26 00:19:42 -0800
+  Commit: 24e62b3, github.com/apache/spark/pull/9959
+
+  [SPARK-11999][CORE] Fix the issue that ThreadUtils.newDaemonCachedThreadPool doesn't cache any task
+  Shixiong Zhu <sh...@databricks.com>
+  2015-11-25 23:31:21 -0800
+  Commit: 0df6bec, github.com/apache/spark/pull/9978
+
+  [SPARK-11980][SPARK-10621][SQL] Fix json_tuple and add test cases for
+  gatorsmile <ga...@gmail.com>
+  2015-11-25 23:24:33 -0800
+  Commit: 7e7f262, github.com/apache/spark/pull/9977
+
+  [SPARK-12003] [SQL] remove the prefix for name after expanded star
+  Davies Liu <da...@databricks.com>
+  2015-11-25 21:25:20 -0800
+  Commit: d40bf9a, github.com/apache/spark/pull/9984
+
+  Fix Aggregator documentation (rename present to finish).
+  Reynold Xin <rx...@databricks.com>
+  2015-11-25 13:45:41 -0800
+  Commit: 3997397
+
+  [SPARK-11866][NETWORK][CORE] Make sure timed out RPCs are cleaned up.
+  Marcelo Vanzin <va...@cloudera.com>
+  2015-11-25 12:58:18 -0800
+  Commit: cd86d8c, github.com/apache/spark/pull/9917
+
+  [SPARK-11935][PYSPARK] Send the Python exceptions in TransformFunction and TransformFunctionSerializer to Java
+  Shixiong Zhu <sh...@databricks.com>
+  2015-11-25 11:47:21 -0800
+  Commit: 849ddb6, github.com/apache/spark/pull/9922
+
+  [SPARK-10558][CORE] Fix wrong executor state in Master
+  jerryshao <ss...@hortonworks.com>
+  2015-11-25 11:42:53 -0800
+  Commit: b4cf318, github.com/apache/spark/pull/8714
+
+  [SPARK-11880][WINDOWS][SPARK SUBMIT] bin/load-spark-env.cmd loads spark-env.cmd from wrong directory
+  wangt <wa...@gmail.com>
+  2015-11-25 11:41:05 -0800
+  Commit: 7b720bf, github.com/apache/spark/pull/9863
+
+  [SPARK-10864][WEB UI] app name is hidden if window is resized
+  Alex Bozarth <aj...@us.ibm.com>
+  2015-11-25 11:39:00 -0800
+  Commit: 97317d3, github.com/apache/spark/pull/9874
+
+  [DOCUMENTATION] Fix minor doc error
+  Jeff Zhang <zj...@apache.org>
+  2015-11-25 11:37:42 -0800
+  Commit: 448208d, github.com/apache/spark/pull/9956
+
+  [MINOR] Remove unnecessary spaces in `include_example.rb`
+  Yu ISHIKAWA <yu...@gmail.com>
+  2015-11-25 11:35:52 -0800
+  Commit: 685b9c2, github.com/apache/spark/pull/9960
+
+  [SPARK-11969] [SQL] [PYSPARK] visualization of SQL query for pyspark
+  Davies Liu <da...@databricks.com>
+  2015-11-25 11:11:39 -0800
+  Commit: c7db01b, github.com/apache/spark/pull/9949
+
+  [SPARK-11974][CORE] Not all the temp dirs had been deleted when the JVM exits
+  Zhongshuai Pei <pe...@huawei.com>
+  2015-11-25 10:37:34 -0800
+  Commit: d514521, github.com/apache/spark/pull/9951
+
+  [SPARK-11984][SQL][PYTHON] Fix typos in doc for pivot for scala and python
+  felixcheung <fe...@hotmail.com>
+  2015-11-25 10:36:35 -0800
+  Commit: 204f360, github.com/apache/spark/pull/9967
+
+  [SPARK-11956][CORE] Fix a few bugs in network lib-based file transfer.
+  Marcelo Vanzin <va...@cloudera.com>
+  2015-11-25 09:47:20 -0800
+  Commit: 400f66f, github.com/apache/spark/pull/9941
+
+  [SPARK-11762][NETWORK] Account for active streams when couting outstanding requests.
+  Marcelo Vanzin <va...@cloudera.com>
+  2015-11-23 10:45:23 -0800
+  Commit: c8f26d2, github.com/apache/spark/pull/9747
+
+  [SPARK-10666][SPARK-6880][CORE] Use properties from ActiveJob associated with a Stage
+  Mark Hamstra <ma...@gmail.com>, Imran Rashid <ir...@cloudera.com>
+  2015-11-25 09:34:34 -0600
+  Commit: 2aeee56, github.com/apache/spark/pull/6291
+
+  [SPARK-11860][PYSAPRK][DOCUMENTATION] Invalid argument specification …
+  Jeff Zhang <zj...@apache.org>
+  2015-11-25 13:49:58 +0000
+  Commit: 4971eaa, github.com/apache/spark/pull/9901
+
+  [SPARK-11686][CORE] Issue WARN when dynamic allocation is disabled due to spark.dynamicAllocation.enabled and spark.executor.instances both set
+  Ashwin Swaroop <Ashwin Swaroop>
+  2015-11-25 13:41:14 +0000
+  Commit: a986a3b, github.com/apache/spark/pull/9926
+
+  [SPARK-11981][SQL] Move implementations of methods back to DataFrame from Queryable
+  Reynold Xin <rx...@databricks.com>
+  2015-11-25 01:03:18 -0800
+  Commit: 9978966, github.com/apache/spark/pull/9964
+
+  [SPARK-11970][SQL] Adding JoinType into JoinWith and support Sample in Dataset API
+  gatorsmile <ga...@gmail.com>
+  2015-11-25 01:02:36 -0800
+  Commit: 007eb4a, github.com/apache/spark/pull/9921
+
+  [SPARK-11979][STREAMING] Empty TrackStateRDD cannot be checkpointed and recovered from checkpoint file
+  Tathagata Das <ta...@gmail.com>
+  2015-11-24 23:13:01 -0800
+  Commit: 7f030aa, github.com/apache/spark/pull/9958
+
+  [SPARK-11140][CORE] Transfer files using network lib when using NettyRpcEnv - 1.6.version.
+  Marcelo Vanzin <va...@cloudera.com>
+  2015-11-24 21:48:51 -0800
+  Commit: 68bcb9b, github.com/apache/spark/pull/9947
+
+  [SPARK-10621][SQL] Consistent naming for functions in SQL, Python, Scala
+  Reynold Xin <rx...@databricks.com>
+  2015-11-24 21:30:53 -0800
+  Commit: 486db87, github.com/apache/spark/pull/9948
+
+  [STREAMING][FLAKY-TEST] Catch execution context race condition in `FileBasedWriteAheadLog.close()`
+  Burak Yavuz <br...@gmail.com>
+  2015-11-24 20:58:47 -0800
+  Commit: b181126, github.com/apache/spark/pull/9953
+
+  [SPARK-11947][SQL] Mark deprecated methods with "This will be removed in Spark 2.0."
+  Reynold Xin <rx...@databricks.com>
+  2015-11-24 18:58:55 -0800
+  Commit: 862d788f, github.com/apache/spark/pull/9930
+
+  [SPARK-11967][SQL] Consistent use of varargs for multiple paths in DataFrameReader
+  Reynold Xin <rx...@databricks.com>
+  2015-11-24 18:16:07 -0800
+  Commit: 4464fa2, github.com/apache/spark/pull/9945
+
+  Added a line of comment to explain why the extra sort exists in pivot.
+  Reynold Xin <rx...@databricks.com>
+  2015-11-24 14:51:01 -0800
+  Commit: 36a99f9
+
+  [SPARK-11914][SQL] Support coalesce and repartition in Dataset APIs
+  gatorsmile <ga...@gmail.com>
+  2015-11-24 15:54:10 -0800
+  Commit: 6d8c4c6, github.com/apache/spark/pull/9899
+
+  [SPARK-11783][SQL] Fixes execution Hive client when using remote Hive metastore
+  Cheng Lian <li...@databricks.com>
+  2015-11-24 14:59:14 -0800
+  Commit: 3f15ad7, github.com/apache/spark/pull/9895
+
+  [SPARK-11805] free the array in UnsafeExternalSorter during spilling
+  Davies Liu <da...@databricks.com>
+  2015-11-24 14:33:28 -0800
+  Commit: 0155693, github.com/apache/spark/pull/9793
+
+  [SPARK-11946][SQL] Audit pivot API for 1.6.
+  Reynold Xin <rx...@databricks.com>
+  2015-11-24 12:54:37 -0800
+  Commit: 3f40af5, github.com/apache/spark/pull/9929
+
+  [SPARK-11872] Prevent the call to SparkContext#stop() in the listener bus's thread
+  tedyu <yu...@gmail.com>
+  2015-11-24 12:22:33 -0800
+  Commit: 0419fd3, github.com/apache/spark/pull/9852
+
+  [SPARK-11926][SQL] unify GetStructField and GetInternalRowField
+  Wenchen Fan <we...@databricks.com>
+  2015-11-24 11:09:01 -0800
+  Commit: 927070d, github.com/apache/spark/pull/9909
+
+  [SPARK-11847][ML] Model export/import for spark.ml: LDA
+  Yuhao Yang <hh...@gmail.com>
+  2015-11-24 09:56:17 -0800
+  Commit: af86c38, github.com/apache/spark/pull/9894
+
+  [SPARK-11521][ML][DOC] Document that Logistic, Linear Regression summaries ignore weight col
+  Joseph K. Bradley <jo...@databricks.com>
+  2015-11-24 09:54:55 -0800
+  Commit: 70febe2, github.com/apache/spark/pull/9927
+
+  [SPARK-11952][ML] Remove duplicate ml examples
+  Yanbo Liang <yb...@gmail.com>
+  2015-11-24 09:52:53 -0800
+  Commit: 6914b75, github.com/apache/spark/pull/9933
+
+  [SPARK-11942][SQL] fix encoder life cycle for CoGroup
+  Wenchen Fan <we...@databricks.com>
+  2015-11-24 09:28:39 -0800
+  Commit: 3cb1b6d, github.com/apache/spark/pull/9928
+
+  [SPARK-11818][REPL] Fix ExecutorClassLoader to lookup resources from …
+  Jungtaek Lim <ka...@gmail.com>
+  2015-11-24 09:20:09 -0800
+  Commit: 8951285, github.com/apache/spark/pull/9812
+
+  [SPARK-11043][SQL] BugFix:Set the operator log in the thrift server.
+  huangzhaowei <ca...@gmail.com>
+  2015-11-24 23:24:49 +0800
+  Commit: f1f2cee, github.com/apache/spark/pull/9056
+
+  [SPARK-11906][WEB UI] Speculation Tasks Cause ProgressBar UI Overflow
+  Forest Fang <fo...@outlook.com>
+  2015-11-24 09:03:32 +0000
+  Commit: 17ea951, github.com/apache/spark/pull/9896
+
+  [SPARK-11897][SQL] Add @scala.annotations.varargs to sql functions
+  Xiu Guo <xg...@gmail.com>
+  2015-11-24 00:07:40 -0800
+  Commit: e1b0a23, github.com/apache/spark/pull/9918
+
+  [SPARK-10707][SQL] Fix nullability computation in union output
+  Mikhail Bautin <mb...@gmail.com>
+  2015-11-23 22:26:08 -0800
+  Commit: 21e6392, github.com/apache/spark/pull/9308
+
+  [SPARK-11933][SQL] Rename mapGroup -> mapGroups and flatMapGroup -> flatMapGroups.
+  Reynold Xin <rx...@databricks.com>
+  2015-11-23 22:22:15 -0800
+  Commit: 2561976, github.com/apache/spark/pull/9919
+
+  Updated sql programming guide to include jdbc fetch size
+  Stephen Samuel <sa...@sksamuel.com>
+  2015-11-23 19:52:12 -0800
+  Commit: 4904e10, github.com/apache/spark/pull/9377
+
+  [SPARK-10560][PYSPARK][MLLIB][DOCS] Make StreamingLogisticRegressionWithSGD Python API equal to Scala one
+  Bryan Cutler <bj...@us.ibm.com>
+  2015-11-23 17:11:51 -0800
+  Commit: 159d631, github.com/apache/spark/pull/9141
+
+  [SPARK-9866][SQL] Speed up VersionsSuite by using persistent Ivy cache
+  Josh Rosen <jo...@databricks.com>
+  2015-11-23 16:33:26 -0800
+  Commit: 696fc33, github.com/apache/spark/pull/9624
+
+  [SPARK-11865][NETWORK] Avoid returning inactive client in TransportClientFactory.
+  Marcelo Vanzin <va...@cloudera.com>
+  2015-11-23 13:51:43 -0800
+  Commit: 8cfe8b8, github.com/apache/spark/pull/9853
+
+  [SPARK-11910][STREAMING][DOCS] Update twitter4j dependency version
+  Luciano Resende <lr...@apache.org>
+  2015-11-23 13:46:34 -0800
+  Commit: 16a2745, github.com/apache/spark/pull/9892
+
+  [SPARK-11836][SQL] udf/cast should not create new SQLContext
+  Davies Liu <da...@databricks.com>
+  2015-11-23 13:44:30 -0800
+  Commit: 460f593, github.com/apache/spark/pull/9914
+
+  [SPARK-4424] Remove spark.driver.allowMultipleContexts override in tests
+  Josh Rosen <jo...@databricks.com>
+  2015-11-23 13:19:10 -0800
+  Commit: d12e17a, github.com/apache/spark/pull/9865
+
+  [SPARK-11837][EC2] python3 compatibility for launching ec2 m3 instances
+  Mortada Mehyar <mo...@gmail.com>
+  2015-11-23 12:03:15 -0800
+  Commit: 49a6b48, github.com/apache/spark/pull/9797
+
+  [SPARK-11920][ML][DOC] ML LinearRegression should use correct dataset in examples and user guide doc
+  Yanbo Liang <yb...@gmail.com>
+  2015-11-23 11:51:29 -0800
+  Commit: 99938db, github.com/apache/spark/pull/9905
+
+  [SPARK-7173][YARN] Add label expression support for application master
+  jerryshao <ss...@hortonworks.com>
+  2015-11-23 10:41:17 -0800
+  Commit: 7db3610, github.com/apache/spark/pull/9800
+
+  [SPARK-11913][SQL] support typed aggregate with complex buffer schema
+  Wenchen Fan <we...@databricks.com>
+  2015-11-23 10:39:33 -0800
+  Commit: f10f1a1, github.com/apache/spark/pull/9898
+
+  [SPARK-11921][SQL] fix `nullable` of encoder schema
+  Wenchen Fan <we...@databricks.com>
+  2015-11-23 10:15:40 -0800
+  Commit: bd94793, github.com/apache/spark/pull/9906
+
+  [SPARK-11894][SQL] fix isNull for GetInternalRowField
+  Wenchen Fan <we...@databricks.com>
+  2015-11-23 10:13:59 -0800
+  Commit: 092a9c8, github.com/apache/spark/pull/9904
+
+  [SPARK-11628][SQL] support column datatype of char(x) to recognize HiveChar
+  Xiu Guo <xg...@gmail.com>, Xiu Guo <gu...@us.ibm.com>
+  2015-11-23 08:53:40 -0800
+  Commit: 9ce4e97, github.com/apache/spark/pull/9612
+
+  [SPARK-11902][ML] Unhandled case in VectorAssembler#transform
+  BenFradet <be...@gmail.com>
+  2015-11-22 22:05:01 -0800
+  Commit: bad93d9, github.com/apache/spark/pull/9885
+
+  [SPARK-11912][ML] ml.feature.PCA minor refactor
+  Yanbo Liang <yb...@gmail.com>
+  2015-11-22 21:56:07 -0800
+  Commit: d482dce, github.com/apache/spark/pull/9897
+
+  [SPARK-11835] Adds a sidebar menu to MLlib's documentation
+  Timothy Hunter <ti...@databricks.com>
+  2015-11-22 21:51:42 -0800
+  Commit: 7f9d335, github.com/apache/spark/pull/9826
+
+  [SPARK-6791][ML] Add read/write for CrossValidator and Evaluators
+  Joseph K. Bradley <jo...@databricks.com>
+  2015-11-22 21:48:48 -0800
+  Commit: 835b548, github.com/apache/spark/pull/9848
+
+  [SPARK-11895][ML] rename and refactor DatasetExample under mllib/examples
+  Xiangrui Meng <me...@databricks.com>
+  2015-11-22 21:45:46 -0800
+  Commit: a36d9bc, github.com/apache/spark/pull/9873
+
+  Preparing development version 1.6.0-SNAPSHOT
+  Patrick Wendell <pw...@gmail.com>
+  2015-11-22 11:41:24 -0800
+  Commit: fc4b88f
+
+  Preparing Spark release v1.6.0-preview2
+  Patrick Wendell <pw...@gmail.com>
+  2015-11-22 11:41:18 -0800
+  Commit: 3083814
+
+  Preparing development version 1.6.0-SNAPSHOT
+  Patrick Wendell <pw...@gmail.com>
+  2015-11-22 10:59:59 -0800
+  Commit: 9d10ba7
+
+  Preparing Spark release v1.6.0-preview1
+  Patrick Wendell <pw...@gmail.com>
+  2015-11-22 10:59:54 -0800
+  Commit: f836941
+
+  [SPARK-11908][SQL] Add NullType support to RowEncoder
+  Liang-Chi Hsieh <vi...@appier.com>
+  2015-11-22 10:36:47 -0800
+  Commit: b004a10, github.com/apache/spark/pull/9891
+
+  [SPARK-11899][SQL] API audit for GroupedDataset.
+  Reynold Xin <rx...@databricks.com>
+  2015-11-21 15:00:37 -0800
+  Commit: 8c718a5, github.com/apache/spark/pull/9880
+
+  [SPARK-11901][SQL] API audit for Aggregator.
+  Reynold Xin <rx...@databricks.com>
+  2015-11-21 00:54:18 -0800
+  Commit: 0554718, github.com/apache/spark/pull/9882
+
+  [SPARK-11900][SQL] Add since version for all encoders
+  Reynold Xin <rx...@databricks.com>
+  2015-11-21 00:10:13 -0800
+  Commit: 7016b08, github.com/apache/spark/pull/9881
+
+  [SPARK-11819][SQL][FOLLOW-UP] fix scala 2.11 build
+  Wenchen Fan <we...@databricks.com>
+  2015-11-20 23:31:19 -0800
+  Commit: 95dfac0, github.com/apache/spark/pull/9879
+
+  Revert "[SPARK-11689][ML] Add user guide and example code for LDA under spark.ml"
+  Xiangrui Meng <me...@databricks.com>
+  2015-11-20 16:52:20 -0800
+  Commit: 33d856d
+
+  [HOTFIX] Fix Java Dataset Tests
+  Michael Armbrust <mi...@databricks.com>
+  2015-11-20 16:02:03 -0800
+  Commit: 285e401
+
+  Preparing development version 1.6.0-SNAPSHOT
+  Patrick Wendell <pw...@gmail.com>
+  2015-11-20 15:43:08 -0800
+  Commit: d409afd
+
+  Preparing Spark release v1.6.0-preview1
+  Patrick Wendell <pw...@gmail.com>
+  2015-11-20 15:43:02 -0800
+  Commit: 7582425
+
+  [SPARK-11890][SQL] Fix compilation for Scala 2.11
+  Michael Armbrust <mi...@databricks.com>
+  2015-11-20 15:38:04 -0800
+  Commit: e0bb4e0, github.com/apache/spark/pull/9871
+
+  [SPARK-11889][SQL] Fix type inference for GroupedDataset.agg in REPL
+  Michael Armbrust <mi...@databricks.com>
+  2015-11-20 15:36:30 -0800
+  Commit: 7e06d51, github.com/apache/spark/pull/9870
+
+  [SPARK-11787][SPARK-11883][SQL][FOLLOW-UP] Cleanup for this patch.
+  Nong Li <no...@databricks.com>
+  2015-11-20 15:30:53 -0800
+  Commit: 7437a7f, github.com/apache/spark/pull/9845
+
+  [SPARK-11549][DOCS] Replace example code in mllib-evaluation-metrics.md using include_example
+  Vikas Nelamangala <vi...@Vikass-MacBook-Pro.local>
+  2015-11-20 15:18:41 -0800
+  Commit: 1dde971, github.com/apache/spark/pull/9689
+
+  [SPARK-11636][SQL] Support classes defined in the REPL with Encoders
+  Michael Armbrust <mi...@databricks.com>, Yin Huai <yh...@databricks.com>
+  2015-11-20 15:17:17 -0800
+  Commit: 0665fb5, github.com/apache/spark/pull/9825
+
+  [SPARK-11756][SPARKR] Fix use of aliases - SparkR can not output help information for SparkR:::summary correctly
+  felixcheung <fe...@hotmail.com>
+  2015-11-20 15:10:55 -0800
+  Commit: 11a11f0, github.com/apache/spark/pull/9750
+
+  [SPARK-11716][SQL] UDFRegistration just drops the input type when re-creating the UserDefinedFunction
+  Jean-Baptiste Onofré <jb...@apache.org>, Yin Huai <yh...@databricks.com>
+  2015-11-20 14:45:40 -0800
+  Commit: b9b0e17, github.com/apache/spark/pull/9868
+
+  [SPARK-11887] Close PersistenceEngine at the end of PersistenceEngineSuite tests
+  Josh Rosen <jo...@databricks.com>
+  2015-11-20 14:31:26 -0800
+  Commit: fbe6888, github.com/apache/spark/pull/9864
+
+  [SPARK-11870][STREAMING][PYSPARK] Rethrow the exceptions in TransformFunction and TransformFunctionSerializer
+  Shixiong Zhu <sh...@databricks.com>
+  2015-11-20 14:23:01 -0800
+  Commit: 0c23dd5, github.com/apache/spark/pull/9847
+
+  [SPARK-11724][SQL] Change casting between int and timestamp to consistently treat int in seconds.
+  Nong Li <no...@databricks.com>, Nong Li <no...@gmail.com>, Yin Huai <yh...@databricks.com>
+  2015-11-20 14:19:34 -0800
+  Commit: 9c8e179, github.com/apache/spark/pull/9685
+
+  [SPARK-11650] Reduce RPC timeouts to speed up slow AkkaUtilsSuite test
+  Josh Rosen <jo...@databricks.com>
+  2015-11-20 13:17:35 -0800
+  Commit: 6fc9687, github.com/apache/spark/pull/9869
+
+  [SPARK-11819][SQL] nice error message for missing encoder
+  Wenchen Fan <we...@databricks.com>
+  2015-11-20 12:04:42 -0800
+  Commit: ff156a3, github.com/apache/spark/pull/9810
+
+  [SPARK-11817][SQL] Truncating the fractional seconds to prevent inserting a NULL
+  Liang-Chi Hsieh <vi...@appier.com>
+  2015-11-20 11:43:45 -0800
+  Commit: 119f92b, github.com/apache/spark/pull/9834
+
+  [SPARK-11876][SQL] Support printSchema in DataSet API
+  gatorsmile <ga...@gmail.com>
+  2015-11-20 11:20:47 -0800
+  Commit: 3662b9f, github.com/apache/spark/pull/9855
+
+  [SPARK-11689][ML] Add user guide and example code for LDA under spark.ml
+  Yuhao Yang <hh...@gmail.com>
+  2015-11-20 09:57:09 -0800
+  Commit: 92d3563, github.com/apache/spark/pull/9722
+
+  [SPARK-11852][ML] StandardScaler minor refactor
+  Yanbo Liang <yb...@gmail.com>
+  2015-11-20 09:55:53 -0800
+  Commit: b11aa17, github.com/apache/spark/pull/9839
+
+  [SPARK-11877] Prevent agg. fallback conf. from leaking across test suites
+  Josh Rosen <jo...@databricks.com>
+  2015-11-20 00:46:29 -0800
+  Commit: eab90d3, github.com/apache/spark/pull/9857
+
+  [SPARK-11867] Add save/load for kmeans and naive bayes
+  Xusen Yin <yi...@gmail.com>
+  2015-11-19 23:43:18 -0800
+  Commit: 1ce6394, github.com/apache/spark/pull/9849
+
+  [SPARK-11869][ML] Clean up TempDirectory properly in ML tests
+  Joseph K. Bradley <jo...@databricks.com>
+  2015-11-19 23:42:24 -0800
+  Commit: 60d9375, github.com/apache/spark/pull/9851
+
+  [SPARK-11875][ML][PYSPARK] Update doc for PySpark HasCheckpointInterval
+  Yanbo Liang <yb...@gmail.com>
+  2015-11-19 22:14:01 -0800
+  Commit: 0a878ad, github.com/apache/spark/pull/9856
+
+  [SPARK-11829][ML] Add read/write to estimators under ml.feature (II)
+  Yanbo Liang <yb...@gmail.com>
+  2015-11-19 22:02:17 -0800
+  Commit: d7b3d57, github.com/apache/spark/pull/9838
+
+  [SPARK-11846] Add save/load for AFTSurvivalRegression and IsotonicRegression
+  Xusen Yin <yi...@gmail.com>
+  2015-11-19 22:01:02 -0800
+  Commit: 4774897, github.com/apache/spark/pull/9836
+
+  [SPARK-11544][SQL][TEST-HADOOP1.0] sqlContext doesn't use PathFilter
+  Dilip Biswal <db...@us.ibm.com>
+  2015-11-19 19:46:10 -0800
+  Commit: a936fa5, github.com/apache/spark/pull/9830
+
+  [SPARK-11864][SQL] Improve performance of max/min
+  Davies Liu <da...@databricks.com>
+  2015-11-19 17:14:10 -0800
+  Commit: 8b34fb0, github.com/apache/spark/pull/9846
+
+  [SPARK-11845][STREAMING][TEST] Added unit test to verify TrackStateRDD is correctly checkpointed
+  Tathagata Das <ta...@gmail.com>
+  2015-11-19 16:50:08 -0800
+  Commit: 19ea30d, github.com/apache/spark/pull/9831
+
+  [SPARK-4134][CORE] Lower severity of some executor loss logs.
+  Marcelo Vanzin <va...@cloudera.com>
+  2015-11-19 16:49:18 -0800
+  Commit: ff34975, github.com/apache/spark/pull/9780
+
+  [SPARK-11275][SQL] Incorrect results when using rollup/cube
+  Andrew Ray <ra...@gmail.com>
+  2015-11-19 15:11:30 -0800
+  Commit: 70d4edd, github.com/apache/spark/pull/9815
+
+  [SPARK-11746][CORE] Use cache-aware method dependencies
+  hushan <hu...@xiaomi.com>
+  2015-11-19 14:56:00 -0800
+  Commit: baae1cc, github.com/apache/spark/pull/9691
+
+  [SPARK-11828][CORE] Register DAGScheduler metrics source after app id is known.
+  Marcelo Vanzin <va...@cloudera.com>
+  2015-11-19 14:53:58 -0800
+  Commit: d087aca, github.com/apache/spark/pull/9820
+
+  [SPARK-11799][CORE] Make it explicit in executor logs that uncaught e…
+  Srinivasa Reddy Vundela <vs...@cloudera.com>
+  2015-11-19 14:51:40 -0800
+  Commit: 6a88251, github.com/apache/spark/pull/9809
+
+  [SPARK-11831][CORE][TESTS] Use port 0 to avoid port conflicts in tests
+  Shixiong Zhu <sh...@databricks.com>
+  2015-11-19 14:49:25 -0800
+  Commit: a4a71b0, github.com/apache/spark/pull/9841
+
+  [SPARK-11858][SQL] Move sql.columnar into sql.execution.
+  Reynold Xin <rx...@databricks.com>
+  2015-11-19 14:48:18 -0800
+  Commit: ea1a51f, github.com/apache/spark/pull/9842
+
+  [SPARK-11812][PYSPARK] invFunc=None works properly with python's reduceByKeyAndWindow
+  David Tolpin <da...@gmail.com>
+  2015-11-19 13:57:23 -0800
+  Commit: abe3930, github.com/apache/spark/pull/9775
+
+  [SPARK-11778][SQL] parse table name before it is passed to lookupRelation
+  Huaxin Gao <hu...@oc0558782468.ibm.com>
+  2015-11-19 13:08:01 -0800
+  Commit: fdffc40, github.com/apache/spark/pull/9773
+
+  [SPARK-11750][SQL] revert SPARK-11727 and code clean up
+  Wenchen Fan <we...@databricks.com>
+  2015-11-19 12:54:25 -0800
+  Commit: b8069a2, github.com/apache/spark/pull/9726
+
+  [SPARK-11848][SQL] Support EXPLAIN in DataSet APIs
+  gatorsmile <ga...@gmail.com>
+  2015-11-19 12:46:36 -0800
+  Commit: 6021852, github.com/apache/spark/pull/9832
+
+  [SPARK-11633][SQL] LogicalRDD throws TreeNode Exception : Failed to Copy Node
+  gatorsmile <ga...@gmail.com>
+  2015-11-19 12:45:04 -0800
+  Commit: 5f86c00, github.com/apache/spark/pull/9762
+
+  [SPARK-11830][CORE] Make NettyRpcEnv bind to the specified host
+  zsxwing <zs...@gmail.com>, Shixiong Zhu <sh...@databricks.com>
+  2015-11-19 11:57:50 -0800
+  Commit: 9b5dc5c, github.com/apache/spark/pull/9821
+
+  [SPARK-11840][SQL] Restore the 1.5's behavior of planning a single distinct aggregation.
+  Yin Huai <yh...@databricks.com>
+  2015-11-19 11:02:17 -0800
+  Commit: e12ab57, github.com/apache/spark/pull/9828
+
+  [SPARK-11849][SQL] Analyzer should replace current_date and current_timestamp with literals
+  Reynold Xin <rx...@databricks.com>
+  2015-11-19 10:48:04 -0800
+  Commit: 0c970fd, github.com/apache/spark/pull/9833
+
+  [SPARK-11339][SPARKR] Document the list of functions in R base package that are masked by functions with same name in SparkR
+  felixcheung <fe...@hotmail.com>
+  2015-11-18 23:32:49 -0800
+  Commit: eb1ba1e, github.com/apache/spark/pull/9785
+
+  [SPARK-11842][ML] Small cleanups to existing Readers and Writers
+  Joseph K. Bradley <jo...@databricks.com>
+  2015-11-18 21:44:01 -0800
+  Commit: 6731dd6, github.com/apache/spark/pull/9829
+
+  [SPARK-11614][SQL] serde parameters should be set only when all params are ready
+  navis.ryu <na...@apache.org>
+  2015-11-18 19:37:14 -0800
+  Commit: 59eaec2, github.com/apache/spark/pull/9580
+
+  [SPARK-11816][ML] fix some style issue in ML/MLlib examples
+  Yuhao Yang <hh...@gmail.com>
+  2015-11-18 18:49:46 -0800
+  Commit: 4b4a6bf, github.com/apache/spark/pull/9808
+
+  Revert "[SPARK-11544][SQL] sqlContext doesn't use PathFilter"
+  Yin Huai <yh...@databricks.com>
+  2015-11-18 18:41:40 -0800
+  Commit: 19f4f26
+
+  [SPARK-11787][SQL] Improve Parquet scan performance when using flat schemas.
+  Nong Li <no...@databricks.com>
+  2015-11-18 18:38:45 -0800
+  Commit: cfdd8a1, github.com/apache/spark/pull/9774
+
+  [SPARK-11833][SQL] Add Java tests for Kryo/Java Dataset encoders
+  Reynold Xin <rx...@databricks.com>
+  2015-11-18 18:34:36 -0800
+  Commit: f383c5a, github.com/apache/spark/pull/9823
+
+  [SPARK-11839][ML] refactor save/write traits
+  Xiangrui Meng <me...@databricks.com>
+  2015-11-18 18:34:01 -0800
+  Commit: b0954b5, github.com/apache/spark/pull/9827
+
+  [SPARK-11636][SQL] Support classes defined in the REPL with Encoders
+  Michael Armbrust <mi...@databricks.com>
+  2015-11-18 16:48:09 -0800
+  Commit: 08e819c, github.com/apache/spark/pull/9602
+
+  [SPARK-11791] Fix flaky test in BatchedWriteAheadLogSuite
+  Burak Yavuz <br...@gmail.com>
+  2015-11-18 16:19:00 -0800
+  Commit: 3cc1889, github.com/apache/spark/pull/9790
+
+  [SPARK-11814][STREAMING] Add better default checkpoint duration
+  Tathagata Das <ta...@gmail.com>
+  2015-11-18 16:08:06 -0800
+  Commit: 6d6fe80, github.com/apache/spark/pull/9805
+
+  [SPARK-11495] Fix potential socket / file handle leaks that were found via static analysis
+  Josh Rosen <jo...@databricks.com>
+  2015-11-18 16:00:35 -0800
+  Commit: 6913cfe, github.com/apache/spark/pull/9455
+
+  [SPARK-10930] History "Stages" page "duration" can be confusing
+  Derek Dagit <de...@yahoo-inc.com>
+  2015-11-18 15:56:54 -0800
+  Commit: 7b13003, github.com/apache/spark/pull/9051
+
+  [SPARK-11649] Properly set Akka frame size in SparkListenerSuite test
+  Josh Rosen <jo...@databricks.com>
+  2015-11-18 15:55:41 -0800
+  Commit: 226de55, github.com/apache/spark/pull/9822
+
+  [SPARK-6787][ML] add read/write to estimators under ml.feature (1)
+  Xiangrui Meng <me...@databricks.com>
+  2015-11-18 15:47:49 -0800
+  Commit: dc1e237, github.com/apache/spark/pull/9798
+
+  [SPARK-11810][SQL] Java-based encoder for opaque types in Datasets.
+  Reynold Xin <rx...@databricks.com>
+  2015-11-18 15:42:07 -0800
+  Commit: d9945bc, github.com/apache/spark/pull/9802
+
+  [HOTFIX] Build break from backporting SPARK-11692
+  Michael Armbrust <mi...@databricks.com>
+  2015-11-18 15:41:22 -0800
+  Commit: f1aaf8c
+
+  [EXAMPLE][MINOR] Add missing awaitTermination in click stream example
+  jerryshao <ss...@hortonworks.com>
+  2015-11-16 17:02:21 -0800
+  Commit: 92496b5, github.com/apache/spark/pull/9730
+
+  [SPARK-11717] Ignore R session and history files from git
+  Lewuathe <le...@me.com>
+  2015-11-12 20:09:42 -0800
+  Commit: 24cf704, github.com/apache/spark/pull/9681
+
+  [SPARK-11692][SQL] Support for Parquet logical types, JSON and  BSON (embedded types)
+  hyukjinkwon <gu...@gmail.com>, Hyukjin Kwon <gu...@gmail.com>
+  2015-11-16 21:59:33 +0800
+  Commit: e822425, github.com/apache/spark/pull/9658
+
+  [SPARK-11544][SQL] sqlContext doesn't use PathFilter
+  Dilip Biswal <db...@us.ibm.com>
+  2015-11-18 14:05:18 -0800
+  Commit: e8390e1, github.com/apache/spark/pull/9652
+
+  [SPARK-11820][ML][PYSPARK] PySpark LiR & LoR should support weightCol
+  Yanbo Liang <yb...@gmail.com>
+  2015-11-18 13:32:06 -0800
+  Commit: 464b2d4, github.com/apache/spark/pull/9811
+
+  [SPARK-11684][R][ML][DOC] Update SparkR glm API doc, user guide and example codes
+  Yanbo Liang <yb...@gmail.com>
+  2015-11-18 13:30:29 -0800
+  Commit: 03c2d20, github.com/apache/spark/pull/9727
+
+  [SPARK-11813][MLLIB] Avoid serialization of vocab in Word2Vec
+  Yuhao Yang <hh...@gmail.com>
+  2015-11-18 13:25:15 -0800
+  Commit: 18e308b, github.com/apache/spark/pull/9803
+
+  [SPARK-6789][ML] Add Readable, Writable support for spark.ml ALS, ALSModel
+  Joseph K. Bradley <jo...@databricks.com>
+  2015-11-18 13:16:31 -0800
+  Commit: 23b8c22, github.com/apache/spark/pull/9786
+
+  [SPARK-6790][ML] Add spark.ml LinearRegression import/export
+  Wenjian Huang <ne...@163.com>, Joseph K. Bradley <jo...@databricks.com>
+  2015-11-18 13:06:25 -0800
+  Commit: bcc6813, github.com/apache/spark/pull/9814
+
+  [SPARK-11720][SQL][ML] Handle edge cases when count = 0 or 1 for Stats function
+  JihongMa <li...@gmail.com>
+  2015-11-18 13:03:37 -0800
+  Commit: 39c8a99, github.com/apache/spark/pull/9705
+
+  [SPARK-10745][CORE] Separate configs between shuffle and RPC
+  Shixiong Zhu <sh...@databricks.com>
+  2015-11-18 12:53:22 -0800
+  Commit: 34a7767, github.com/apache/spark/pull/9481
+
+  [SPARK-11809] Switch the default Mesos mode to coarse-grained mode
+  Reynold Xin <rx...@databricks.com>
+  2015-11-18 12:50:29 -0800
+  Commit: ad14455, github.com/apache/spark/pull/9795
+
+  [SPARK-4557][STREAMING] Spark Streaming foreachRDD Java API method should accept a VoidFunction<...>
+  Bryan Cutler <bj...@us.ibm.com>
+  2015-11-18 12:09:54 -0800
+  Commit: c130b86, github.com/apache/spark/pull/9488
+
+  [SPARK-11739][SQL] clear the instantiated SQLContext
+  Davies Liu <da...@databricks.com>
+  2015-11-18 11:53:28 -0800
+  Commit: 899106c, github.com/apache/spark/pull/9706
+
+  [SPARK-11792] [SQL] [FOLLOW-UP] Change SizeEstimation to KnownSizeEstimation and make estimatedSize return Long instead of Option[Long]
+  Yin Huai <yh...@databricks.com>
+  2015-11-18 11:49:12 -0800
+  Commit: 26c17a5, github.com/apache/spark/pull/9813
+
+  [MINOR][BUILD] Ignore ensime cache
+  Jakob Odersky <jo...@gmail.com>
+  2015-11-18 11:35:41 -0800
+  Commit: 656e1cc, github.com/apache/spark/pull/9708
+
+  [SPARK-11795][SQL] combine grouping attributes into a single NamedExpression
+  Wenchen Fan <we...@databricks.com>
+  2015-11-18 10:33:17 -0800
+  Commit: 7e90893, github.com/apache/spark/pull/9792
+
+  [SPARK-11725][SQL] correctly handle null inputs for UDF
+  Wenchen Fan <we...@databricks.com>
+  2015-11-18 10:23:12 -0800
+  Commit: 285792b, github.com/apache/spark/pull/9770
+
+  [SPARK-11803][SQL] fix Dataset self-join
+  Wenchen Fan <we...@databricks.com>
+  2015-11-18 10:15:50 -0800
+  Commit: ad2ebe4, github.com/apache/spark/pull/9806
+
+  [SPARK-11195][CORE] Use correct classloader for TaskResultGetter
+  Hurshal Patel <hp...@gmail.com>
+  2015-11-18 09:28:59 -0800
+  Commit: a72abeb, github.com/apache/spark/pull/9779
+
+  [SPARK-11773][SPARKR] Implement collection functions in SparkR.
+  Sun Rui <ru...@intel.com>
+  2015-11-18 08:41:45 -0800
+  Commit: 8ac518c, github.com/apache/spark/pull/9764
+
+  [SPARK-11281][SPARKR] Add tests covering the issue.
+  zero323 <ma...@gmail.com>
+  2015-11-18 08:32:03 -0800
+  Commit: 99c2e86, github.com/apache/spark/pull/9743
+
+  [SPARK-11804] [PYSPARK] Exception raise when using Jdbc predicates opt…
+  Jeff Zhang <zj...@apache.org>
+  2015-11-18 08:18:54 -0800
+  Commit: 3bd13ee, github.com/apache/spark/pull/9791
+
+  rmse was wrongly calculated
+  Viveka Kulharia <vi...@iitk.ac.in>
+  2015-11-18 09:10:15 +0000
+  Commit: 48bfe3f, github.com/apache/spark/pull/9771
+
+  [SPARK-11652][CORE] Remote code execution with InvokerTransformer
+  Sean Owen <so...@cloudera.com>
+  2015-11-18 08:59:20 +0000
+  Commit: 34ded83, github.com/apache/spark/pull/9731
+
+  [SPARK-6541] Sort executors by ID (numeric)
+  Jean-Baptiste Onofré <jb...@apache.org>
+  2015-11-18 08:57:58 +0000
+  Commit: 04938d9, github.com/apache/spark/pull/9165
+
+  [SPARK-10946][SQL] JDBC - Use Statement.executeUpdate instead of PreparedStatement.executeUpdate for DDLs
+  somideshmukh <so...@us.ibm.com>
+  2015-11-18 08:51:01 +0000
+  Commit: 5da7d41, github.com/apache/spark/pull/9733
+
+  [SPARK-11792][SQL] SizeEstimator cannot provide a good size estimation of UnsafeHashedRelations
+  Yin Huai <yh...@databricks.com>
+  2015-11-18 00:42:52 -0800
+  Commit: 0eb8213, github.com/apache/spark/pull/9788
+
+  [SPARK-11802][SQL] Kryo-based encoder for opaque types in Datasets
+  Reynold Xin <rx...@databricks.com>
+  2015-11-18 00:09:29 -0800
+  Commit: 8ac8374, github.com/apache/spark/pull/9789
+
+  [SPARK-10186][SQL][FOLLOW-UP] simplify test
+  Wenchen Fan <we...@databricks.com>
+  2015-11-17 23:51:05 -0800
+  Commit: 1b75cd6, github.com/apache/spark/pull/9783
+
+  [SPARK-11728] Replace example code in ml-ensembles.md using include_example
+  Xusen Yin <yi...@gmail.com>
+  2015-11-17 23:44:06 -0800
+  Commit: 47e5832, github.com/apache/spark/pull/9716
+
+  [SPARK-11643] [SQL] parse year with leading zero
+  Davies Liu <da...@databricks.com>
+  2015-11-17 23:14:05 -0800
+  Commit: dbb2ea0, github.com/apache/spark/pull/9701
+
+  [SPARK-7013][ML][TEST] Add unit test for spark.ml StandardScaler
+  RoyGaoVLIS <ro...@zju.edu.cn>
+  2015-11-17 23:00:49 -0800
+  Commit: 3f63f08, github.com/apache/spark/pull/6665
+
+  [SPARK-11761] Prevent the call to StreamingContext#stop() in the listener bus's thread
+  tedyu <yu...@gmail.com>
+  2015-11-17 22:47:53 -0800
+  Commit: 737f071, github.com/apache/spark/pull/9741
+
+  [SPARK-11755][R] SparkR should export "predict"
+  Yanbo Liang <yb...@gmail.com>
+  2015-11-17 22:13:15 -0800
+  Commit: c13f723, github.com/apache/spark/pull/9732
+
+  [SPARK-11797][SQL] collect, first, and take should use encoders for serialization
+  Reynold Xin <rx...@databricks.com>
+  2015-11-17 21:40:58 -0800
+  Commit: 6bb613c, github.com/apache/spark/pull/9787
+
+  [SPARK-11737] [SQL] Fix serialization of UTF8String with Kyro
+  Davies Liu <da...@databricks.com>
+  2015-11-17 19:50:02 -0800
+  Commit: cb8dbf6, github.com/apache/spark/pull/9704
+
+  [SPARK-11583] [CORE] MapStatus Using RoaringBitmap More Properly
+  Kent Yao <ya...@hotmail.com>, Davies Liu <da...@databricks.com>, Charles Allen <ch...@allen-net.com>
+  2015-11-17 19:44:29 -0800
+  Commit: 9a1ae6a, github.com/apache/spark/pull/9746
+
+  [SPARK-11016] Move RoaringBitmap to explicit Kryo serializer
+  Davies Liu <da...@databricks.com>, Charles Allen <ch...@allen-net.com>
+  2015-11-17 19:39:39 -0800
+  Commit: eddc7a5, github.com/apache/spark/pull/9748
+
+  [SPARK-11793][SQL] Dataset should set the resolved encoders internally for maps.
+  Reynold Xin <rx...@databricks.com>
+  2015-11-17 19:02:44 -0800
+  Commit: 683e34e, github.com/apache/spark/pull/9784
+
+  [SPARK-9065][STREAMING][PYSPARK] Add MessageHandler for Kafka Python API
+  Shixiong Zhu <sh...@databricks.com>, jerryshao <sa...@intel.com>, jerryshao <ss...@hortonworks.com>
+  2015-11-17 16:57:52 -0800
+  Commit: a7fcc31, github.com/apache/spark/pull/7410
+
+  [SPARK-11726] Throw exception on timeout when waiting for REST server response
+  Jacek Lewandowski <le...@gmail.com>
+  2015-11-17 15:57:43 -0800
+  Commit: 3133d8b, github.com/apache/spark/pull/9692
+
+  [SPARK-11771][YARN][TRIVIAL] maximum memory in yarn is controlled by two params have both in error msg
+  Holden Karau <ho...@us.ibm.com>
+  2015-11-17 15:51:03 -0800
+  Commit: 7e17ce5, github.com/apache/spark/pull/9758
+
+  [SPARK-11790][STREAMING][TESTS] Increase the connection timeout
+  Shixiong Zhu <sh...@databricks.com>
+  2015-11-17 15:47:39 -0800
+  Commit: 3471244, github.com/apache/spark/pull/9778
+
+  [MINOR] Correct comments in JavaDirectKafkaWordCount
+  Rohan Bhanderi <ro...@sjsu.edu>
+  2015-11-17 15:45:39 -0800
+  Commit: 89a2ddf, github.com/apache/spark/pull/9781
+
+  [SPARK-9552] Add force control for killExecutors to avoid false killing for those busy executors
+  Grace <ji...@intel.com>, Andrew Or <an...@databricks.com>, Jie Huang <ji...@intel.com>
+  2015-11-17 15:43:35 -0800
+  Commit: 33ae9c7, github.com/apache/spark/pull/7888
+
+  [SPARK-11764][ML] make Param.jsonEncode/jsonDecode support Vector
+  Xiangrui Meng <me...@databricks.com>
+  2015-11-17 14:04:49 -0800
+  Commit: 78dc07c, github.com/apache/spark/pull/9776
+
+  [SPARK-11740][STREAMING] Fix the race condition of two checkpoints in a batch
+  Shixiong Zhu <sh...@databricks.com>
+  2015-11-17 14:48:29 -0800
+  Commit: fa9d56f, github.com/apache/spark/pull/9707
+
+  [SPARK-11786][CORE] Tone down messages from akka error monitor.
+  Marcelo Vanzin <va...@cloudera.com>
+  2015-11-17 14:23:28 -0800
+  Commit: 1a5dfb7, github.com/apache/spark/pull/9772
+
+  [SPARK-11763][ML] Add save,load to LogisticRegression Estimator
+  Joseph K. Bradley <jo...@databricks.com>
+  2015-11-17 14:03:49 -0800
+  Commit: a529427, github.com/apache/spark/pull/9749
+
+  [SPARK-11729] Replace example code in ml-linear-methods.md using include_example
+  Xusen Yin <yi...@gmail.com>
+  2015-11-17 13:59:59 -0800
+  Commit: c0ada5b, github.com/apache/spark/pull/9713
+
+  [SPARK-11732] Removes some MiMa false positives
+  Timothy Hunter <ti...@databricks.com>
+  2015-11-17 20:51:20 +0000
+  Commit: b468f81, github.com/apache/spark/pull/9697
+
+  [SPARK-11767] [SQL] limit the size of caced batch
+  Davies Liu <da...@databricks.com>
+  2015-11-17 12:50:01 -0800
+  Commit: 5047e67, github.com/apache/spark/pull/9760
+
+  [SPARK-11769][ML] Add save, load to all basic Transformers
+  Joseph K. Bradley <jo...@databricks.com>
+  2015-11-17 12:43:56 -0800
+  Commit: e7f9016, github.com/apache/spark/pull/9755
+
+  [SPARK-10186][SQL] support postgre array type in JDBCRDD
+  Wenchen Fan <we...@databricks.com>
+  2015-11-17 11:29:02 -0800
+  Commit: 88431fb, github.com/apache/spark/pull/9662
+
+  [SPARK-8658][SQL][FOLLOW-UP] AttributeReference's equals method compares all the members
+  gatorsmile <ga...@gmail.com>
+  2015-11-17 11:23:54 -0800
+  Commit: 933f025, github.com/apache/spark/pull/9761
+
+  [SPARK-11089][SQL] Adds option for disabling multi-session in Thrift server
+  Cheng Lian <li...@databricks.com>
+  2015-11-17 11:17:52 -0800
+  Commit: 167ea61, github.com/apache/spark/pull/9740
+
+  [SPARK-11679][SQL] Invoking method " apply(fields: java.util.List[StructField])" in "StructType" gets ClassCastException
+  mayuanwen <ma...@qiyi.com>
+  2015-11-17 11:15:46 -0800
+  Commit: a3f0c77, github.com/apache/spark/pull/9649
+
+  [SPARK-11766][MLLIB] add toJson/fromJson to Vector/Vectors
+  Xiangrui Meng <me...@databricks.com>
+  2015-11-17 10:17:16 -0800
+  Commit: d07a7e1, github.com/apache/spark/pull/9751
+
+  [SPARK-11695][CORE] Set s3a credentials
+  Chris Bannister <ch...@swiftkey.com>
+  2015-11-17 10:03:46 -0800
+  Commit: 0f39c2d, github.com/apache/spark/pull/9663
+
+  [SPARK-11744][LAUNCHER] Fix print version throw exception when using pyspark shell
+  jerryshao <ss...@hortonworks.com>
+  2015-11-17 10:01:33 -0800
+  Commit: ba1a190, github.com/apache/spark/pull/9721
+
+  [SPARK-11191][SQL][FOLLOW-UP] Cleans up unnecessary anonymous HiveFunctionRegistry
+  Cheng Lian <li...@databricks.com>
+  2015-11-17 18:11:08 +0800
+  Commit: c049fa4, github.com/apache/spark/pull/9737
+
+  [SPARK-11694][SQL] Backports #9754
+  hyukjinkwon <gu...@gmail.com>, HyukjinKwon <gu...@gmail.com>
+  2015-11-17 22:50:54 +0800
+  Commit: 62ad81a, github.com/apache/spark/pull/9763
+
+  [SPARK-11779][DOCS] Fix reference to deprecated MESOS_NATIVE_LIBRARY
+  Philipp Hoffmann <ma...@philipphoffmann.de>
+  2015-11-17 14:13:13 +0000
+  Commit: 29f18b7, github.com/apache/spark/pull/9768
+
+  [SPARK-11751] Doc describe error in the "Spark Streaming Programming Guide" page
+  yangping.wu <wy...@163.com>
+  2015-11-17 14:11:34 +0000
+  Commit: b1a2abb, github.com/apache/spark/pull/9734
+
+  [MINOR] [SQL] Fix randomly generated ArrayData in RowEncoderSuite
+  Liang-Chi Hsieh <vi...@appier.com>
+  2015-11-16 23:16:17 -0800
+  Commit: 2ae1fa0, github.com/apache/spark/pull/9757
+
+  [SPARK-11447][SQL] change NullType to StringType during binaryComparison between NullType and StringType
+  Kevin Yu <qy...@us.ibm.com>
+  2015-11-16 22:54:29 -0800
+  Commit: 113410c, github.com/apache/spark/pull/9720
+
+  [SPARK-11768][SPARK-9196][SQL] Support now function in SQL (alias for current_timestamp).
+  Reynold Xin <rx...@databricks.com>
+  2015-11-16 20:47:46 -0800
+  Commit: 07ac8e9, github.com/apache/spark/pull/9753
+
+  Preparing development version 1.6.0-SNAPSHOT
+  Patrick Wendell <pw...@gmail.com>
+  2015-11-16 18:43:49 -0800
+  Commit: 5a6f404
+
+  Preparing Spark release v1.6.0-preview
+  Patrick Wendell <pw...@gmail.com>
+  2015-11-16 18:43:43 -0800
+  Commit: 31db361
+
+  [SPARK-11617][NETWORK] Fix leak in TransportFrameDecoder.
+  Marcelo Vanzin <va...@cloudera.com>
+  2015-11-16 17:28:11 -0800
+  Commit: e12ecfa, github.com/apache/spark/pull/9619
+
+  [SPARK-11612][ML] Pipeline and PipelineModel persistence
+  Joseph K. Bradley <jo...@databricks.com>
+  2015-11-16 17:12:39 -0800
+  Commit: 505ecee, github.com/apache/spark/pull/9674
+
+  [SPARK-11710] Document new memory management model
+  Andrew Or <an...@databricks.com>
+  2015-11-16 17:00:18 -0800
+  Commit: 32a69e4, github.com/apache/spark/pull/9676
+
+  [SPARK-11480][CORE][WEBUI] Wrong callsite is displayed when using AsyncRDDActions#takeAsync
+  Kousuke Saruta <sa...@oss.nttdata.co.jp>
+  2015-11-16 16:59:16 -0800
+  Commit: e4abfe9, github.com/apache/spark/pull/9437
+
+  [SPARKR][HOTFIX] Disable flaky SparkR package build test
+  Shivaram Venkataraman <sh...@cs.berkeley.edu>
+  2015-11-16 16:57:50 -0800
+  Commit: bb044ec, github.com/apache/spark/pull/9744
+
+  [SPARK-11625][SQL] add java test for typed aggregate
+  Wenchen Fan <we...@databricks.com>
+  2015-11-16 15:32:49 -0800
+  Commit: 4f8c7e1, github.com/apache/spark/pull/9591
+
+  [SPARK-8658][SQL] AttributeReference's equals method compares all the members
+  gatorsmile <ga...@gmail.com>
+  2015-11-16 15:22:12 -0800
+  Commit: e042780, github.com/apache/spark/pull/9216
+
+  [SPARK-11553][SQL] Primitive Row accessors should not convert null to default value
+  Bartlomiej Alberski <ba...@allegrogroup.com>
+  2015-11-16 15:14:38 -0800
+  Commit: 6c8e0c0, github.com/apache/spark/pull/9642
+
+  [SPARK-11742][STREAMING] Add the failure info to the batch lists
+  Shixiong Zhu <sh...@databricks.com>
+  2015-11-16 15:06:06 -0800
+  Commit: 3bd72ea, github.com/apache/spark/pull/9711
+
+  Revert "[SPARK-11271][SPARK-11016][CORE] Use Spark BitSet instead of RoaringBitmap to reduce memory usage"
+  Davies Liu <da...@gmail.com>
+  2015-11-16 14:50:38 -0800
+  Commit: 64439f7
+
+  [SPARK-11390][SQL] Query plan with/without filterPushdown indistinguishable
+  Zee Chen <ze...@us.ibm.com>
+  2015-11-16 14:21:28 -0800
+  Commit: 90d71bf, github.com/apache/spark/pull/9679
+
+  [SPARK-11754][SQL] consolidate `ExpressionEncoder.tuple` and `Encoders.tuple`
+  Wenchen Fan <we...@databricks.com>
+  2015-11-16 12:45:34 -0800
+  Commit: fbe65c5, github.com/apache/spark/pull/9729
+
+  [SPARK-11718][YARN][CORE] Fix explicitly killed executor dies silently issue
+  jerryshao <ss...@hortonworks.com>
+  2015-11-16 11:43:18 -0800
+  Commit: 38fe092, github.com/apache/spark/pull/9684
+
+  [SPARK-6328][PYTHON] Python API for StreamingListener
+  Daniel Jalova <dj...@us.ibm.com>
+  2015-11-16 11:29:27 -0800
+  Commit: c83177d, github.com/apache/spark/pull/9186
+
+  [SPARK-11731][STREAMING] Enable batching on Driver WriteAheadLog by default
+  Burak Yavuz <br...@gmail.com>
+  2015-11-16 11:21:17 -0800
+  Commit: 38673d7, github.com/apache/spark/pull/9695
+
+  [SPARK-11044][SQL] Parquet writer version fixed as version1
+  hyukjinkwon <gu...@gmail.com>, HyukjinKwon <gu...@gmail.com>
+  2015-11-16 21:30:10 +0800
+  Commit: f14fb29, github.com/apache/spark/pull/9060
+
+  [SPARK-11743] [SQL] Add UserDefinedType support to RowEncoder
+  Liang-Chi Hsieh <vi...@appier.com>
+  2015-11-16 09:03:42 -0800
+  Commit: 1887fa2, github.com/apache/spark/pull/9712
+
+  [SPARK-11752] [SQL] fix timezone problem for DateTimeUtils.getSeconds
+  Wenchen Fan <we...@databricks.com>
+  2015-11-16 08:58:40 -0800
+  Commit: 949c9b7, github.com/apache/spark/pull/9728
+
+  [SPARK-11522][SQL] input_file_name() returns "" for external tables
+  xin Wu <xi...@us.ibm.com>
+  2015-11-16 08:10:48 -0800
+  Commit: c37ed52, github.com/apache/spark/pull/9542
+
+  [SPARK-11745][SQL] Enable more JSON parsing options
+  Reynold Xin <rx...@databricks.com>
+  2015-11-16 00:06:14 -0800
+  Commit: a0f9cd7, github.com/apache/spark/pull/9724
+
+  Revert "[SPARK-11572] Exit AsynchronousListenerBus thread when stop() is called"
+  Josh Rosen <jo...@databricks.com>
+  2015-11-15 22:39:45 -0800
+  Commit: 053c63e
+
+  [SPARK-9928][SQL] Removal of LogicalLocalTable
+  gatorsmile <ga...@gmail.com>
+  2015-11-15 21:10:46 -0800
+  Commit: eced276, github.com/apache/spark/pull/9717
+
+  [SPARK-10500][SPARKR] sparkr.zip cannot be created if /R/lib is unwritable
+  Sun Rui <ru...@intel.com>
+  2015-11-15 19:29:09 -0800
+  Commit: b56aaa9, github.com/apache/spark/pull/9390
+
+  [SPARK-11086][SPARKR] Use dropFactors column-wise instead of nested loop when createDataFrame
+  zero323 <ma...@gmail.com>
+  2015-11-15 19:15:27 -0800
+  Commit: d981bfc, github.com/apache/spark/pull/9099
+
+  [SPARK-10181][SQL] Do kerberos login for credentials during hive client initialization
+  Yu Gao <yg...@us.ibm.com>, gaoyu <ga...@gaoyu-macbookpro.roam.corp.google.com>, Yu Gao <cr...@gmail.com>
+  2015-11-15 14:53:59 -0800
+  Commit: 2f0f8bb, github.com/apache/spark/pull/9272
+
+  [SPARK-11738] [SQL] Making ArrayType orderable
+  Yin Huai <yh...@databricks.com>
+  2015-11-15 13:59:59 -0800
+  Commit: 84f457a, github.com/apache/spark/pull/9718
+
+  [SPARK-11672][ML] set active SQLContext in JavaDefaultReadWriteSuite
+  Xiangrui Meng <me...@databricks.com>
+  2015-11-15 13:23:05 -0800
+  Commit: 07af782, github.com/apache/spark/pull/9719
+
+  [SPARK-11734][SQL] Rename TungstenProject -> Project, TungstenSort -> Sort
+  Reynold Xin <rx...@databricks.com>
+  2015-11-15 10:33:53 -0800
+  Commit: 6f98d47, github.com/apache/spark/pull/9700
+
+  [SPARK-11736][SQL] Add monotonically_increasing_id to function registry.
+  Yin Huai <yh...@databricks.com>
+  2015-11-14 21:04:18 -0800
+  Commit: 4a11e2d, github.com/apache/spark/pull/9703
+
+  Typo in comment: use 2 seconds instead of 1
+  Rohan Bhanderi <ro...@sjsu.edu>
+  2015-11-14 13:38:53 +0000
+  Commit: 927acb1, github.com/apache/spark/pull/9714
+
+  [SPARK-11573] Correct 'reflective access of structural type member meth…
+  Gábor Lipták <gl...@gmail.com>
+  2015-11-14 12:02:02 +0000
+  Commit: d5a7ff1, github.com/apache/spark/pull/9550
+
+  [MINOR][DOCS] typo in docs/configuration.md
+  Kai Jiang <ji...@gmail.com>
+  2015-11-14 11:59:37 +0000
+  Commit: 5153356, github.com/apache/spark/pull/9715
+
+  [SPARK-11694][SQL] Parquet logical types are not being tested properly
+  hyukjinkwon <gu...@gmail.com>, Hyukjin Kwon <gu...@gmail.com>
+  2015-11-14 18:36:01 +0800
+  Commit: 47a9186, github.com/apache/spark/pull/9660
+
+  [SPARK-7970] Skip closure cleaning for SQL operations
+  nitin goyal <ni...@guavus.com>, nitin.goyal <ni...@guavus.com>
+  2015-11-13 18:09:08 -0800
+  Commit: bcc8710, github.com/apache/spark/pull/9253
+
+  [MINOR][ML] remove MLlibTestsSparkContext from ImpuritySuite
+  Xiangrui Meng <me...@databricks.com>
+  2015-11-13 13:19:04 -0800
+  Commit: 6efe8b5, github.com/apache/spark/pull/9698
+
+  [SPARK-11336] Add links to example codes
+  Xusen Yin <yi...@gmail.com>
+  2015-11-13 13:14:25 -0800
+  Commit: ffd23ba, github.com/apache/spark/pull/9320
+
+  [SPARK-11672][ML] Set active SQLContext in MLlibTestSparkContext.beforeAll
+  Xiangrui Meng <me...@databricks.com>
+  2015-11-13 13:09:28 -0800
+  Commit: 58ab347, github.com/apache/spark/pull/9694
+
+  [SPARK-11727][SQL] Split ExpressionEncoder into FlatEncoder and ProductEncoder
+  Wenchen Fan <we...@databricks.com>
+  2015-11-13 11:25:33 -0800
+  Commit: 8757221, github.com/apache/spark/pull/9693
+
+  [SPARK-11654][SQL][FOLLOW-UP] fix some mistakes and clean up
+  Wenchen Fan <we...@databricks.com>
+  2015-11-13 11:13:09 -0800
+  Commit: 3035e9d, github.com/apache/spark/pull/9688
+
+  [SPARK-11690][PYSPARK] Add pivot to python api
+  Andrew Ray <ra...@gmail.com>
+  2015-11-13 10:31:17 -0800
+  Commit: 6459a67, github.com/apache/spark/pull/9653
+
+  [SPARK-11723][ML][DOC] Use LibSVM data source rather than MLUtils.loadLibSVMFile to load DataFrame
+  Yanbo Liang <yb...@gmail.com>
+  2015-11-13 08:43:05 -0800
+  Commit: 4a1bcb2, github.com/apache/spark/pull/9690
+
+  [SPARK-11445][DOCS] Replaced example code in mllib-ensembles.md using include_example
+  Rishabh Bhardwaj <rb...@gmail.com>
+  2015-11-13 08:36:46 -0800
+  Commit: 98c614d, github.com/apache/spark/pull/9407
+
+  [SPARK-11678][SQL] Partition discovery should stop at the root path of the table.
+  Yin Huai <yh...@databricks.com>
+  2015-11-13 18:36:56 +0800
+  Commit: 9fa9ad0, github.com/apache/spark/pull/9651
+
+  [SPARK-11706][STREAMING] Fix the bug that Streaming Python tests cannot report failures
+  Shixiong Zhu <sh...@databricks.com>
+  2015-11-13 00:30:27 -0800
+  Commit: c3da2bd, github.com/apache/spark/pull/9669
+
+  [SPARK-8029] Robust shuffle writer
+  Davies Liu <da...@databricks.com>
+  2015-11-12 22:44:57 -0800
+  Commit: aff44f9, github.com/apache/spark/pull/PR
+
+  [SPARK-11629][ML][PYSPARK][DOC] Python example code for Multilayer Perceptron Classification
+  Yanbo Liang <yb...@gmail.com>
+  2015-11-12 21:29:43 -0800
+  Commit: 55faab5, github.com/apache/spark/pull/9594
+
+  [SPARK-11263][SPARKR] lintr Throws Warnings on Commented Code in Documentation
+  felixcheung <fe...@hotmail.com>
+  2015-11-12 20:02:49 -0800
+  Commit: ea9f7c5, github.com/apache/spark/pull/9463
+
+  [SPARK-11672][ML] flaky spark.ml read/write tests
+  Xiangrui Meng <me...@databricks.com>
+  2015-11-12 20:01:13 -0800
+  Commit: 874cd29, github.com/apache/spark/pull/9677
+
+  Preparing development version 1.6.0-SNAPSHOT
+  Patrick Wendell <pw...@gmail.com>
+  2015-11-12 19:10:48 -0800
+  Commit: 46a536e
+
+  Preparing Spark release v1.6-snapshot0-test
+  Patrick Wendell <pw...@gmail.com>
+  2015-11-12 19:10:42 -0800
+  Commit: 609d6e8
+
+  [SPARK-11681][STREAMING] Correctly update state timestamp even when state is not updated
+  Tathagata Das <ta...@gmail.com>
+  2015-11-12 19:02:49 -0800
+  Commit: 966fe1f, github.com/apache/spark/pull/9648
+
+  [SPARK-11419][STREAMING] Parallel recovery for FileBasedWriteAheadLog + minor recovery tweaks
+  Burak Yavuz <br...@gmail.com>
+  2015-11-12 18:03:23 -0800
+  Commit: 199e4cb, github.com/apache/spark/pull/9373
+
+  [SPARK-11663][STREAMING] Add Java API for trackStateByKey
+  Shixiong Zhu <sh...@databricks.com>
+  2015-11-12 17:48:43 -0800
+  Commit: 05666e0, github.com/apache/spark/pull/9636
+
+  [SPARK-11654][SQL] add reduce to GroupedDataset
+  Michael Armbrust <mi...@databricks.com>, Wenchen Fan <we...@databricks.com>
+  2015-11-12 17:20:30 -0800
+  Commit: 6c1bf19, github.com/apache/spark/pull/9673
+
+  [SPARK-11712][ML] Make spark.ml LDAModel be abstract
+  Joseph K. Bradley <jo...@databricks.com>
+  2015-11-12 17:03:19 -0800
+  Commit: f061d25, github.com/apache/spark/pull/9678
+
+  [SPARK-11709] include creation site info in SparkContext.assertNotStopped error message
+  Xiangrui Meng <me...@databricks.com>
+  2015-11-12 16:43:04 -0800
+  Commit: 838f956, github.com/apache/spark/pull/9675
+
+  [SPARK-11671] documentation code example typo
+  Chris Snow <ch...@gmail.com>
+  2015-11-12 15:42:30 -0800
+  Commit: 3df6238, github.com/apache/spark/pull/9639
+
+  [SPARK-11658] simplify documentation for PySpark combineByKey
+  Chris Snow <ch...@gmail.com>
+  2015-11-12 15:50:47 -0800
+  Commit: 0dd6c29, github.com/apache/spark/pull/9640
+
+  [SPARK-11667] Update dynamic allocation docs to reflect supported cluster managers
+  Andrew Or <an...@databricks.com>
+  2015-11-12 15:48:42 -0800
+  Commit: 7828857, github.com/apache/spark/pull/9637
+
+  [SPARK-11670] Fix incorrect kryo buffer default value in docs
+  Andrew Or <an...@databricks.com>
+  2015-11-12 15:47:29 -0800
+  Commit: a98cac2, github.com/apache/spark/pull/9638
+
+  [SPARK-2533] Add locality levels on stage summary view
+  Jean-Baptiste Onofré <jb...@apache.org>
+  2015-11-12 15:46:21 -0800
+  Commit: 0695917, github.com/apache/spark/pull/9487
+
+  [SPARK-11290][STREAMING][TEST-MAVEN] Fix the test for maven build
+  Shixiong Zhu <sh...@databricks.com>
+  2015-11-12 14:52:03 -0800
+  Commit: 340ca9e, github.com/apache/spark/pull/9668
+
+  [SPARK-11655][CORE] Fix deadlock in handling of launcher stop().
+  Marcelo Vanzin <va...@cloudera.com>
+  2015-11-12 14:29:16 -0800
+  Commit: f5c66d1, github.com/apache/spark/pull/9633
+
+  [SPARK-11420] Updating Stddev support via Imperative Aggregate
+  JihongMa <li...@gmail.com>
+  2015-11-12 13:47:34 -0800
+  Commit: 6853ba6, github.com/apache/spark/pull/9380
+
+  [SPARK-10113][SQL] Explicit error message for unsigned Parquet logical types
+  hyukjinkwon <gu...@gmail.com>
+  2015-11-12 12:29:50 -0800
+  Commit: 68fa5c7, github.com/apache/spark/pull/9646
+
+  [SPARK-11191][SQL] Looks up temporary function using execution Hive client
+  Cheng Lian <li...@databricks.com>
+  2015-11-12 12:17:51 -0800
+  Commit: ecf027e, github.com/apache/spark/pull/9664
+
+  Fixed error in scaladoc of convertToCanonicalEdges
+  Gaurav Kumar <ga...@gmail.com>
+  2015-11-12 12:14:00 -0800
+  Commit: 4aacbe9, github.com/apache/spark/pull/9666
+
+  [BUILD][MINOR] Remove non-exist yarnStable module in Sbt project
+  jerryshao <ss...@hortonworks.com>
+  2015-11-12 17:23:24 +0100
+  Commit: c3a0c77, github.com/apache/spark/pull/9625
+
+  [SPARK-11673][SQL] Remove the normal Project physical operator (and keep TungstenProject)
+  Reynold Xin <rx...@databricks.com>
+  2015-11-12 08:14:08 -0800
+  Commit: ed04876, github.com/apache/spark/pull/9643
+
+  [SPARK-11661][SQL] Still pushdown filters returned by unhandledFilters.
+  Yin Huai <yh...@databricks.com>
+  2015-11-12 16:47:00 +0800
+  Commit: 8390641, github.com/apache/spark/pull/9634
+
+  [SPARK-11674][ML] add private val after @transient in Word2VecModel
+  Xiangrui Meng <me...@databricks.com>
+  2015-11-11 21:01:14 -0800
+  Commit: 57f281c, github.com/apache/spark/pull/9644
+
+  [SPARK-11396] [SQL] add native implementation of datetime function to_unix_timestamp
+  Daoyuan Wang <da...@intel.com>
+  2015-11-11 20:36:21 -0800
+  Commit: e903147, github.com/apache/spark/pull/9347
+
+  [SPARK-11675][SQL] Remove shuffle hash joins.
+  Reynold Xin <rx...@databricks.com>
+  2015-11-11 19:32:52 -0800
+  Commit: 990f8ce, github.com/apache/spark/pull/9645
+
+  [MINOR] License header formatting fix
+  Marc Prud'hommeaux <mw...@cornell.edu>
+  2015-11-10 16:57:08 -0800
+  Commit: 2823504, github.com/apache/spark/pull/9312
+
+  [MINOR] Fix typo in AggregationQuerySuite.scala
+  Forest Fang <sa...@users.noreply.github.com>
+  2015-11-10 16:55:58 -0800
+  Commit: 0c50ac5, github.com/apache/spark/pull/9357
+
+  [SPARK-11598] [SQL] enable tests for ShuffledHashOuterJoin
+  Davies Liu <da...@databricks.com>
+  2015-11-09 23:28:32 -0800
+  Commit: 78674d3, github.com/apache/spark/pull/9573
+
+  [SPARK-8992][SQL] Add pivot to dataframe api
+  Andrew Ray <ra...@gmail.com>
+  2015-11-11 16:23:24 -0800
+  Commit: 5940fc7, github.com/apache/spark/pull/7841
+
+  [SPARK-11672][ML] disable spark.ml read/write tests
+  Xiangrui Meng <me...@databricks.com>
+  2015-11-11 15:41:36 -0800
+  Commit: 4151afb, github.com/apache/spark/pull/9641
+
+  [SPARK-10827] replace volatile with Atomic* in AppClient.scala.
+  Reynold Xin <rx...@databricks.com>
+  2015-11-11 15:30:21 -0800
+  Commit: fdb7774, github.com/apache/spark/pull/9611
+
+  [SPARK-11647] Attempt to reduce time/flakiness of Thriftserver CLI and SparkSubmit tests
+  Josh Rosen <jo...@databricks.com>
+  2015-11-11 14:30:38 -0800
+  Commit: e046c68, github.com/apache/spark/pull/9623
+
+  [SPARK-11335][STREAMING] update kafka direct python docs on how to get the offset ranges for a KafkaRDD
+  Nick Evans <me...@nicolasevans.org>
+  2015-11-11 13:29:30 -0800
+  Commit: f7c6c95, github.com/apache/spark/pull/9289
+
+  [SPARK-11645][SQL] Remove OpenHashSet for the old aggregate.
+  Reynold Xin <rx...@databricks.com>
+  2015-11-11 12:48:51 -0800
+  Commit: d6d3181, github.com/apache/spark/pull/9621
+
+  [SPARK-11644][SQL] Remove the option to turn off unsafe and codegen.
+  Reynold Xin <rx...@databricks.com>
+  2015-11-11 12:47:02 -0800
+  Commit: c227180, github.com/apache/spark/pull/9618
+
+  [SPARK-11639][STREAMING][FLAKY-TEST] Implement BlockingWriteAheadLog for testing the BatchedWriteAheadLog
+  Burak Yavuz <brkyvz@gmail

<TRUNCATED>

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org