You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by we...@apache.org on 2020/06/16 08:36:58 UTC
[spark] branch master updated (fe68e95 -> f0e6d0e)
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from fe68e95 [SPARK-24634][SS][FOLLOWUP] Rename the variable from "numLateInputs" to "numRowsDroppedByWatermark"
add f0e6d0e [SPARK-31710][SQL] Fail casting numeric to timestamp by default
No new revisions were added by this update.
Summary of changes:
docs/sql-migration-guide.md | 2 +
python/pyspark/sql/dataframe.py | 5 +-
python/pyspark/sql/functions.py | 13 +++
python/pyspark/sql/tests/test_dataframe.py | 2 +-
.../spark/sql/catalyst/expressions/Cast.scala | 13 ++-
.../catalyst/expressions/datetimeExpressions.scala | 2 +-
.../org/apache/spark/sql/internal/SQLConf.scala | 12 +++
.../spark/sql/catalyst/expressions/CastSuite.scala | 99 ++++++++++++++--------
.../scala/org/apache/spark/sql/functions.scala | 9 ++
.../resources/sql-tests/inputs/udf/udf-window.sql | 16 ++--
.../src/test/resources/sql-tests/inputs/window.sql | 16 ++--
.../sql-tests/results/udf/udf-window.sql.out | 16 ++--
.../resources/sql-tests/results/window.sql.out | 16 ++--
.../org/apache/spark/sql/DateFunctionsSuite.scala | 4 +-
.../spark/sql/StatisticsCollectionSuite.scala | 3 +-
.../streaming/MicroBatchExecutionSuite.scala | 4 +-
.../streaming/sources/ForeachWriterSuite.scala | 6 +-
.../sql/streaming/EventTimeWatermarkSuite.scala | 40 ++++-----
.../spark/sql/streaming/FileStreamSinkSuite.scala | 2 +-
.../streaming/FlatMapGroupsWithStateSuite.scala | 7 +-
.../sql/streaming/StreamingAggregationSuite.scala | 2 +-
.../streaming/StreamingDeduplicationSuite.scala | 10 +--
.../spark/sql/streaming/StreamingJoinSuite.scala | 35 ++++----
.../hive/execution/HiveCompatibilitySuite.scala | 6 ++
...ull testing-0-6a01a94ef1b0d29152c88cd3083fd70b} | 0
...tamp cast #3-0-732ed232ac592c5e7f7c913a88874fd2 | 1 -
...tamp cast #4-0-6d2da5cfada03605834e38bc4075bc79 | 1 -
.../spark/sql/hive/execution/HiveQuerySuite.scala | 27 +++---
.../spark/sql/hive/execution/HiveUDFSuite.scala | 4 +-
.../spark/sql/hive/execution/SQLQuerySuite.scala | 10 +--
30 files changed, 233 insertions(+), 150 deletions(-)
rename sql/hive/src/test/resources/golden/{constant null testing-0-237a6af90a857da1efcbe98f6bbbf9d6 => constant null testing-0-6a01a94ef1b0d29152c88cd3083fd70b} (100%)
delete mode 100644 sql/hive/src/test/resources/golden/timestamp cast #3-0-732ed232ac592c5e7f7c913a88874fd2
delete mode 100644 sql/hive/src/test/resources/golden/timestamp cast #4-0-6d2da5cfada03605834e38bc4075bc79
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org