You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2022/03/12 04:20:00 UTC
[beam] branch nightly-refs/heads/master updated (03af085 -> c1db5fe)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 03af085 Add a StatefulDoFn test that sets event time timer within allowed lateness (#16922)
add 9e0aa6b Merge pull request #17056 from [BEAM-14076] [SnowflakeIO] Add support for GEOGRAPHY column
add 1aba87d [BEAM-13981] Remove Spark Runner specific code for event logging
add eea81f4 Merge pull request #17073: [BEAM-13981] Remove Spark Runner specific code for event logging
add 48dcb7a [BEAM-2766] Support null key/values in HadoopFormatIO
add 32aed30 [BEAM-2766] Fix checkstyle
add c1db5fe Merge pull request #17074: [BEAM-2766] Support null key/values in HadoopFormatIO
No new revisions were added by this update.
Summary of changes:
.../beam/runners/spark/SparkPipelineRunner.java | 17 -----
.../org/apache/beam/runners/spark/SparkRunner.java | 22 +-----
.../runners/spark/metrics/SparkBeamMetric.java | 10 ---
.../beam/runners/spark/util/SparkCommon.java | 79 ----------------------
.../beam/runners/spark/util/SparkCompat.java | 61 -----------------
.../beam/sdk/io/hadoop/format/HadoopFormatIO.java | 2 +-
.../io/hadoop/format/HadoopFormatIOReadTest.java | 49 ++++++++++++++
.../sdk/io/snowflake/data/SnowflakeDataType.java | 2 +
.../SnowflakeGeography.java} | 12 ++--
.../snowflake/data/geospatial}/package-info.java | 4 +-
sdks/python/apache_beam/io/snowflake.py | 73 +++++++++++---------
11 files changed, 101 insertions(+), 230 deletions(-)
delete mode 100644 runners/spark/src/main/java/org/apache/beam/runners/spark/util/SparkCommon.java
copy sdks/java/io/snowflake/src/main/java/org/apache/beam/sdk/io/snowflake/data/{numeric/SnowflakeFloat.java => geospatial/SnowflakeGeography.java} (78%)
copy {runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/provisioning => sdks/java/io/snowflake/src/main/java/org/apache/beam/sdk/io/snowflake/data/geospatial}/package-info.java (89%)