You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/01/31 19:13:59 UTC

Build failed in Jenkins: beam_BiqQueryIO_Batch_Performance_Test_Java #272

See <https://builds.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java/272/display/redirect?page=changes>

Changes:

[mzobii.baig] Beam-2535 : Pursue pull request 4700 with manual apply changes from

[mzobii.baig] Beam-2535 : Pursue pull request 4700 with manual apply changes from

[mzobii.baig] Beam-2535 : Pursue pull request 4700 with manual apply changes from

[mzobii.baig] Beam-2535 : Replace timeStamp with outputTimeStamp

[mzobii.baig] Beam-2535 : Apply Spotless

[mzobii.baig] Beam-2535 : Pass outputTimestamp param in onTimer method

[mzobii.baig] Beam-2535 : Minor changed

[rehman.muradali] [BEAM-2535] : Add Commit State in ParDoEvaluator

[rehman.muradali] [BEAM-2535] : Add outputTimestamp in compare method, Revert

[mzobii.baig] Beam-2535 : Modifying default minimum target and GC time

[rehman.muradali] BEAM-2535 : Removal of extra lines

[mzobii.baig] Beam-2535 : Proposed changes

[mzobii.baig] Beam-2535 : Added original PR watermark hold functionality.

[rehman.muradali] [BEAM-2535] Apply Spotless

[kirillkozlov] Updated the cost model to favor IO with push-down

[kirillkozlov] BigQueryFilter numSupported method

[mzobii.baig] [Beam-2535] Variable renaming and added output timestamp in

[mzobii.baig] Beam-2535 : Apply Spotless

[mzobii.baig] [Beam-2535] Modify test case

[mzobii.baig] [Beam-2535] Added comments

[mzobii.baig] [Beam-2535] Apply Spotless

[mzobii.baig] [Beam-2535] Set Processing Time with outputTimestamp

[mzobii.baig] [Beam-2535] Minor renaming

[rehman.muradali] [BEAM-2535] Revert Processing Time, Addition of OutputTimestamp

[rehman.muradali] [BEAM-2535] Revert TimerReceiver outputTimestamp

[kirillkozlov] Modify AggregateProjectMergeRule to have a condition

[ehudm] [BEAM-8269] Convert from_callable type hints to Beam types

[kirillkozlov] SpotlesApply

[kirillkozlov] Test for a query with a predicate

[kirillkozlov] A list of visited nodes should be unique per onMatch invocation

[rehman.muradali] [BEAM-2535] Revert TimerReceiver outputTimestamp

[kirillkozlov] Make sure all nodes are explored

[dcavazos] [BEAM-7390] Add code snippet for Min

[dcavazos] [BEAM-7390] Add code snippet for Mean

[dcavazos] [BEAM-7390] Add code snippet for Max

[rehman.muradali] [BEAM-2535] Making OnTimer compatible

[rehman.muradali] [BEAM-2535] Making OnTimer compatible

[nielm] Add limit on number of mutated rows to batching/sorting stages.

[kirillkozlov] Add a new Jenkins job for SQL perf tests

[kirillkozlov] Test boilerplate

[rehman.muradali] Adding OutputTimestamp in Timer Object

[rehman.muradali] Apply Spotless and checkstyle

[kirillkozlov] Table proxy to add TimeMonitor after the IO

[kirillkozlov] Tests for direct_read w/o push-down and default methods

[mzobii.baig] [Beam-2535] Added watermark functionality for the dataflow runner

[suztomo] [BEAM-8865] Updating Javadoc of FileIO example

[kirillkozlov] Update SQL BigQuery doc

[kenn] Use more informative assertions in some py tests

[echauchot] [BEAM-8830] flatten: better detect empty collections

[mzobii.baig] [Beam-2535] Used boolean instead boxed type

[kirillkozlov] Cleanup

[dcavazos] [BEAM-7390] Add code snippet for GroupByKey

[dcavazos] [BEAM-7390] Add code snippet for Sum

[kcweaver] Version Flink job server container images

[kcweaver] [BEAM-8337] publish Flink job server container images

[kcweaver] [BEAM-8870] Skip test_sdf_with_watermark_tracking for Spark

[kcweaver] [BEAM-8870] Cache environment in spark_runner_test.

[kamil.wasilewski] Strict equality comparision for the version of tensorflow dependency

[kamil.wasilewski] Extract installChicagoTaxiExampleRequirements step

[mzobii.baig] [Beam-2535] Modify required watermark hold functionality

[kamil.wasilewski] Look up log level values using `getattr`

[kirillkozlov] Monitor total number of fields read from an IO

[kcweaver] [BEAM-8139] Test Spark portable job jar.

[kcweaver] [BEAM-8139] Add main method to SparkPipelineRunner.

[kcweaver] [BEAM-8139] Add beam_PostCommit_PortableJar_Spark.

[echauchot] [BEAM-8830] Fix empty dataset creation: use the beam coder wrapper that

[heejong] [BEAM-8903] handling --jar_packages experimental flag in PortableRunner

[github] Changing _BatchSizeEstimator defaults to match BatchElements defaults

[suztomo] [BEAM-8911] New Guava version: 25.1-jre

[ningk] [BEAM-7926] Data-centric Interactive Part1

[ehudm] Fix _get_args for typing.Tuple in Py3.5.2

[kcweaver] Don't override default for environment_cache_millis

[zyichi] [BEAM-8886] Add a mongodb io dataflow integration test

[kcweaver] Add FlinkMiniClusterEntryPoint for testing the uber jar submission

[kcweaver] [BEAM-8512] Add integration tests for flink_runner.py.

[ehudm] [BEAM-3713] pytest migration: py27-gcp-pytest

[sunjincheng121] [BEAM-8929] Remove unnecessary exception handling in

[suztomo] BEAM-8693 com.google.cloud.datastore:datastore-v1-proto-client 1.6.3

[suztomo] google_cloud_bigquery is not declaring google_http_client_jackson

[github] Changing RowAsDictJsonCoder implementation for efficiency (#10300)

[github] Merge pull request #10151: [BEAM-7116] Remove use of KV in Schema

[ningk] [BEAM-8837] Fix pcoll_visualization tests

[chadrik] Pass artifact and provision endpoints to external workers from python

[suztomo] Commons-codec dependency in extensions/sql

[kcweaver] Get Flink version numbers from subdirectories

[suztomo] Adding joda_time dependency

[kcweaver] Warn if Flink versions can't be listed.

[suztomo] Commons_lang3 and jackson_databind dependency

[pabloem] [BEAM-8335] Adds support for multi-output TestStream (#9953)

[apilloud] [BEAM-8362] Don't use toString() for accessing Enum Types

[heejong] [BEAM-8905] matching Java PCollectionTuple translation naming convention

[heejong] [BEAM-8904] properly update output pcollections from expanded transforms

[kcweaver] Build mini cluster jar excluding unwanted classes.

[kcweaver] Rename to testFlinkUberJarPyX.Y

[kcweaver] Increase timeout on beam_PostCommit_PortableJar_Flink.

[echauchot] [BEAM-8894] exclude FlattenWithHeterogeneousCoders category because

[chamikara] [BEAM-8575] Test DoFn context params (#10130)

[github] Add an ML section to python SDK overview (#10233)

[michal.walenia] [BEAM-8947] Change Flink docker image names in Jenkins jobs to match

[echauchot] [BEAM-8830] Exclude failing SDF tests

[kamil.wasilewski] [BEAM-1440] Provide functions for waiting for BQ job and exporting

[kamil.wasilewski] [BEAM-1440] Create _BigQuerySource that implements iobase.BoundedSource

[kamil.wasilewski] [BEAM-1440] Reorganised BigQuery read IT tests

[kamil.wasilewski] [BEAM-1440] Create postCommitIT jobs running on Flink Runner

[kamil.wasilewski] [BEAM-1440] Convert strings to bytes on Python 3 if field type is BYTES

[kamil.wasilewski] [BEAM-1440]: Support RECORD fields in coder

[kamil.wasilewski] [BEAM-1440] Remove json files after reading

[kamil.wasilewski] [BEAM-1440] Marked classes as private

[kamil.wasilewski] [BEAM-1440] Do not force to create temp dataset when using dry run

[lostluck] [BEAM-8920] Go SDK: faster transforms/filter.Distinct with CombinePerKey

[echauchot] [BEAM-8025] Under load we get a NoHostAvailable exception at cluster

[ehudm] [BEAM-3713] pytest migration: py27-cython-pytest

[aaltay] [BEAM-8811] Upgrade Beam pipeline diagrams in docs (#10200)

[bhulette] [BEAM-8933] Update BigQuery proto dependency (#10334)

[pabloem] [BEAM-7746] Add python type hints (part 1) (#9915)

[ningk] Use explicitly named dictionary when watching local scope variables in

[heejong] [BEAM-8943] SDK harness servers don't shut down properly when SDK

[github] [BEAM-8955] Exclude AvroSchemaTest for Spark Runner (#10358)

[relax] attach values so we don't iterate over everything to verify types

[github] [BEAM-8786] Fixes a link in readme

[echauchot] [BEAM-8025] Remove temporary folder rule because it suppresses files on

[echauchot] [BEAM-8025] Disable auto compaction on Cassandra node to avoid race

[echauchot] [BEAM-5192] Migrate ElasticsearchIO to v7

[echauchot] [BEAM-5192] Minor change of ESIO public configuration API:

[pawel.pasterz] [BEAM-8946] Publish collection size of data written during MongoDBIOIT

[lukasz.gajowy] [BEAM-5495] Add possibility of scanning the classpath without

[lukasz.gajowy] [BEAM-5495] Enable injecting custom resources detection algorithms.

[lukasz.gajowy] [BEAM-5495] Move PipelineResources to

[chamikara] Merge pull request #10347: [BEAM-8885] PubsubGrpcClient doesn't respect

[kenn] [BEAM-8917] jsr305 dependency declaration for Nullable class (#10324)

[xinyuliu.us] [BEAM-8342]: upgrade to samza 1.3.0 (#10357)

[aaltay] Make model_pcollection snippet self-contained (#10343)

[pabloem] Merge pull request #10050 from [BEAM-8575] Add streaming test case for

[github] Run beam_CancelStaleDataflowJobs every 4 hours.

[robinyqiu] BeamZetaSqlCalcRel prototype

[tvalentyn] [BEAM-8575] Added a unit test to test Combine works with sessions.

[github] [GoSDK] Improve StateChannel resilience. (#10363)

[ehudm] [BEAM-3713] pytest migration: py3x-{gcp,cython}

[tweise] [BEAM-8273] Expand portability environment documentation (#10116)

[valentyn] Install SDK after tarball is generated to avoid a race in proto stubs

[kamil.wasilewski] [BEAM-8671] Add Python 3.7 support for LoadTestBuilder

[kamil.wasilewski] [BEAM-8671] Add ParDo test running on Python 3.7

[mxm] [BEAM-8962] Add option to disable the metric container accumulator

[younghoono] [BEAM-7970] Improved error help in Go PROTOBUF.md

[suztomo] Declare JSR305 dependency as 'shadow'

[ningk] Avoid patching test pcoll data and use real logic to produce test data.

[robertwb] Fixed instructions and the example of running Interactive Beam on Flink.

[lukasz.gajowy] [BEAM-5495] Remove unneded and deprecated code

[lukasz.gajowy] [BEAM-5495] Use ClassGraph to detect classpath resources

[github] [BEAM-8446] Retrying BQ query on timeouts (#9855)

[thw] [BEAM-8816] Option to load balance bundle processing w/ multiple SDK

[ehudm] Fix cleanPython race with :clean

[pabloem] Removing LINT.If/LINT.Then statement

[bhulette] [BEAM-8801] PubsubMessageToRow should not check useFlatSchema() in

[robertwb] [BEAM-8575] To test state backed iterable coder in py sdk. (#10143)

[robertwb] [BEAM-8575] Added two unit tests in CombineTest class to test

[daniel.o.programmer] [BEAM-7970] Rebuild Go protos with new protobuf version

[robinyqiu] Fix bug in SingleRowScanConverter

[aaltay] [BEAM-7390] Add code snippet for Latest (#10166)

[robinyqiu] Use BeamBigQuerySqlDialect

[boyuanz] [BEAM-8536] Migrate using requested_execution_time to

[pabloem] Initialize logging configuration in Pipeline object

[daniel.o.programmer] [BEAM-7970] Touch-up on Go protobuf generation instructions.

[chamikara] Merge pull request #10383: [BEAM-8575] Added a unit test to test that

[kamil.wasilewski] [BEAM-8979] Remove mypy-protobuf dependency

[echauchot] [BEAM-5192] Fix missing ifs for ES7 specificities.

[echauchot] [BEAM-5192] Remove unneeded transitive dependencies, upgrade ES and

[echauchot] [BEAM-5192] Disable MockHttpTransport plugin to enabe http dialog to

[mikhail] Update release docs

[relax] Merge pull request #10311: [BEAM-8810] Detect stuck commits in

[kcweaver] Import freezegun for Python time testing.

[kcweaver] Allow message stream to yield duplicates.

[mikhail] Blogpost stub

[kcweaver] [BEAM-8891] Create and submit Spark portable jar in Python.

[kcweaver] [BEAM-8296] containerize spark job server

[robinyqiu] Address comments

[github] [GoSDK] Make data channel splits idempotent (#10406)

[pabloem] Initialize logging configuration in PipelineOptions object.

[rehman.muradali] EarliestTimestamp Fix for outputTimestamp

[lukasz.gajowy] [BEAM-5495] Make PipelineResourcesDetectorAbstractFactory an inner

[lukasz.gajowy] [BEAM-5495] Change detect() return type to List

[lukasz.gajowy] [BEAM-5495] Minor docs and test fixes

[mxm] [BEAM-8959] Invert metrics flag in Flink Runner

[lukasz.gajowy] [BEAM-5495] Re-add test verifying order of resources detection

[echauchot] [BEAM-5192] Fix util class, elasticsearch changed their json output of

[mikhail] Add blogpost file

[tysonjh] CachingShuffleBatchReader use bytes to limit size.

[mikhail] Add blogpost highlights

[github] Update release guide for cherry picks (#10399)

[heejong] [BEAM-8902] parameterize input type of Java external transform

[lukasz.gajowy] [BEAM-5495] Prevent nested jar scanning (jarfiles in jarfiles)

[ehudm] Dicts are not valid DoFn.process return values

[github] Update release notes version to correct one.

[valentyn] Sickbay VR tests that don't pass

[chamikara] Makes environment ID a top level attribute of PTransform.

[angoenka] [BEAM-8944] Change to use single thread in py sdk bundle progress report

[ehudm] [BEAM-8525] Support Const base in binary_subscr

[aaltay] [BEAM-8335] Background caching job (#10405)

[ehudm] Do not perform test on Py2.7

[ehudm] Light cleanup of opcodes.py

[chamikara] Setting environment ID for ParDo and Combine transforms

[pawel.pasterz] [BEAM-8978] Publish table size of data written during HadoopFormatIOIT

[echauchot] [BEAM-5192] Set a custom json serializer for document metadata to be

[echauchot] [BEAM-5192] Remove testWritePartialUpdateWithErrors because triggering

[sunjincheng121] [BEAM-7949] Add time-based cache threshold support in the data service

[mxm] [BEAM-8996] Auto-generate pipeline options documentation for FlinkRunner

[mxm] Regenerate Flink options table with the latest master

[mxm] [BEAM-8996] Improvements to the Flink runner page

[ehudm] Upgrade parameterized version to 0.7.0+

[kawaigin] [BEAM-8977] Resolve test flakiness

[dpcollins] Modify PubsubClient to use the proto message throughout.

[lukecwik] [BEAM-9004] Migrate org.mockito.Matchers#anyString to

[suztomo] GenericJsonAssert

[suztomo] Refactoring with assertEqualsAsJson

[chamikara] Fixes Go formatting.

[robertwb] [BEAM-8335] Add a TestStreamService Python Implementation (#10120)

[lukecwik] Minor cleanup of tests using TestStream. (#10188)

[pabloem] [BEAM-2572] Python SDK S3 Filesystem (#9955)

[github] [BEAM-8974] Wait for log messages to be processed before checking them.

[sunjincheng121] [BEAM-7949] Introduce PeriodicThread for time-based cache threshold

[github] Merge pull request #10356: [BEAM-7274] Infer a Beam Schema from a

[echauchot] [BEAM-9019] Improve Encoders: replace as much as possible of catalyst

[lukecwik] [BEAM-8623] Add status_endpoint field to provision api ProvisionInfo

[github] [BEAM-8999] Respect timestamp combiners in PGBKCVOperation. (#10425)

[github] Update dataflow container images to beam-master-20191220 (#10448)

[zyichi] [BEAM-8824] Add support to allow specify window allowed_lateness in

[chamikara] Adds documentation for environment_id fields.

[lukecwik] [BEAM-8846] Update documentation about stream observers and factories,

[apilloud] [BEAM-9023] Upgrade to ZetaSQL 2019.12.1

[lukecwik] [BEAM-7951] Allow runner to configure customization WindowedValue coder.

[chamikara] Sets missing environmentId in several locations.

[bhulette] [BEAM-8988] RangeTracker for _CustomBigQuerySource (#10412)

[ehudm] Set TMPDIR for tox environments

[robinyqiu] Address comments

[robinyqiu] Address comments

[kcweaver] Refactor shared uber jar generation code into common subclass.

[sunjincheng121] [BEAM-8935] Fail fast if sdk harness startup failed.

[echauchot] [BEAM-5192] use <= and >= in version specific code instead of == to be

[relax] Merge pull request #10444: [BEAM-9010] Proper TableRow size calculation

[github] Merge pull request #10449: [BEAM-7274] Implement the Protobuf schema

[sunjincheng121] [BEAM-9030] Bump grpc to 1.26.0

[github] Python example parameters fix

[bhulette] [BEAM-9026] Clean up RuntimeValueProvider.runtime_options (#10457)

[kirillkozlov] Fix BytesValue unparsing

[kirillkozlov] Fix floating point literals

[kirillkozlov] Fix string literals

[kirillkozlov] Add null check for SqlTypeFamily

[kirillkozlov] ZetaSqlCalcRule should be disaled by defualt

[kirillkozlov] spotles

[ehudm] [BEAM-9025] Update Dataflow Java container worker

[heejong] [BEAM-9034] Update environment_id for ExternalTransform in Python SDK

[sunjincheng121] [BEAM-9030] Update the dependencies to make sure the dependency linkage

[mxm] [BEAM-8962] Report Flink metric accumulator only when pipeline ends

[github] Revert "[BEAM-8932]  Modify PubsubClient to use the proto message

[ehudm] junitxml_report: Add failure tag support

[github] Catch __module__ is None.

[relax] Merge pull request #10422: [BEAM-2535] TimerData signature update

[rehman.muradali] Rebase TimerData PR

[udim] [BEAM-9012] Change __init__ hints so they work with pytype (#10466)

[github] [BEAM-9039] Fix race on reading channel readErr. (#10456)

[lcwik] [BEAM-5605] Increase precision of fraction used during splitting.

[github] [BEAM-8487] Convert forward references to Any (#9888)

[lukecwik] [BEAM-9020] LengthPrefixUnknownCodersTest to avoid relying on

[lukecwik] [BEAM-7951] Improve the docs for beam_runner_api.proto and

[sunjincheng121] [BEAM-9006] Improve ProcessManager for shutdown hook handling.

[kamil.wasilewski] [BEAM-8671] Fix Python 3.7 ParDo test job name

[github] [BEAM-5600] Add unimplemented split API to Runner side SDF libraries.

[github] [BEAM-5605] Fix type used to describe channel splits to match type used

[github] [BEAM-5605] Ensure that split calls are routed to the active bundle

[suztomo] protobuf 3.11.1

[jeff] BEAM-8745 More fine-grained controls for the size of a BigQuery Load job

[kcweaver] Make Spark REST URL a separate pipeline option.

[kirillkozlov] Address comments

[aaltay] [BEAM-8335] On Unbounded Source change (#10442)

[aaltay] [BEAM-9013] TestStream fix for DataflowRunner (#10445)

[angoenka] [BEAM-8575] Refactor test_do_fn_with_windowing_in_finish_bundle to work

[sunjincheng121] [BEAM-9055] Unify the config names of Fn Data API across languages.

[rehman.muradali] onTimer/setTimer signature updates

[sunjincheng121] fixup

[davidsabater] [BEAM-9053] Improve error message when unable to get the correct

[mxm] [BEAM-8577] Initialize FileSystems during Coder deserialization in

[github] Update _posts_2019-12-16-beam-2.17.0.md

[github] Cleanup formatting.

[suztomo] google_auth_version 0.19.0

[github] Update release date.

[lcwik] [BEAM-9059] Migrate PTransformTranslation to use string constants

[iemejia] [BEAM-5546] Update commons-codec to version 1.14

[iemejia] [BEAM-8701] Remove unused commons-io_1x dependency

[iemejia] [BEAM-8701] Update commons-io to version 2.6

[iemejia] [BEAM-5544] Update cassandra-all dependency to version 3.11.5

[iemejia] [BEAM-8749] Update cassandra-driver-mapping to version 3.8.0

[mxm] Rename FlinkClassloading to Workarounds

[mxm] [BEAM-9060] Restore stdout/stderr in case Flink's

[echauchot] Fix link in javadoc to accumulators

[github] Restrict the upper bound for pyhamcrest, since new version does not work

[apilloud] [BEAM-9027] [SQL] Fix ZetaSQL Byte Literals

[github] [BEAM-9058] Fix line-too-long exclusion regex and re-enable

[altay] Readability/Lint fixes

[hannahjiang] BEAM-8780 reuse RC images instead of recreate images

[iemejia] [BEAM-8716] Update commons-csv to version 1.7

[iemejia] [BEAM-9041] Add missing equals methods for GenericRecord <-> Row

[iemejia] [BEAM-9042] Fix RowToGenericRecordFn Avro schema serialization

[iemejia] [BEAM-9042] Update SchemaCoder doc with info about functions requiring

[iemejia] [BEAM-9042] Test serializability and equality of Row<->GenericRecord

[tvalentyn] [BEAM-9062] Improve assertion error for equal_to (#10504)

[iemejia] [BEAM-8717] Update commons-lang3 to version 3.9

[iemejia] [BEAM-8717] Make non core modules use only the repackaged commons-lang3

[chamikara] [BEAM-8960]: Add an option for user to opt out of using insert id for

[ehudm] Small fixes to verify_release_build.sh

[kirillkozlov] Metric name should not be constant

[36090911+boyuanzz] [BEAM-8932] [BEAM-9036] Revert reverted commit to use PubsubMessage as

[sunjincheng121] fixup

[github] Update ParDoTest.java

[echauchot] [BEAM-9065] Reset MetricsContainerStepMapAccumulator upon initialization

[rehman.muradali] Apply spotless

[rehman.muradali] Compilation Fix PardoTest

[rehman.muradali] Reverting outputTimestamp validation

[rehman.muradali] CheckStyle Fix

[rehman.muradali] Adding Category to exclude Flink Runner

[jkai] [BEAM-8496] remove SDF translators in flink streaming transform

[github] Fix blogpost typo (#10532)

[kcweaver] [BEAM-9070] tests use absolute paths for job server jars

[12602502+Ardagan] Fix headings in downloads.md

[github] Add # pytype: skip-file before first import statement in each py file

[apilloud] [BEAM-9027] Unparse DOY/DOW/WEEK Enums properly for ZetaSQL

[33895511+aromanenko-dev] [BEAM-8953] Extend ParquetIO read builders for AvroParquetReader

[brad.g.west] [BEAM-9078] Pass total_size to storage.Upload

[hannahjiang] BEAM-7861 add direct_running_mode option

[github] [BEAM-9075] Disable JoinCommuteRule for ZetaSQL planner (#10542)

[bhulette] [BEAM-9075] add a test case. (#10545)

[12602502+Ardagan] [BEAM-8821] Document Python SDK 2.17.0 deps (#10212)

[kirillkozlov] Missing commit

[hannahjiang] [BEAM-7861] rephrase direct_running_mode option checking

[kcweaver] [BEAM-8337] Hard-code Flink versions.

[kamil.wasilewski] [BEAM-8108] Allow run_chicago.sh to take variable argument number

[kamil.wasilewski] [BEAM-8108] Use _ReadFromBigQuery transform

[kamil.wasilewski] [BEAM-8108] Create Jenkins job that runs Chicago Taxi Example on Flink

[kamil.wasilewski] [BEAM-8108] Rewrite Python print statement in dataproc init action

[echauchot] [BEAM-9019] Remove BeamCoderWrapper to avoid extra object allocation and

[lukecwik] [BEAM-8624] Implement Worker Status FnService in Dataflow runner

[github] [BEAM-5605] Add support for executing pair with restriction, split

[github] Update release guide with extended information.

[github] Add link to mass comment script

[github] Fix typo

[kcweaver] fix indentation

[kcweaver] Update release guide

[ankurgoenka] [BEAM-9002] Add test_flatten_same_pcollections to fnapi runner

[lostluck] [BEAM-9080] Support KVs in the Go SDK's Partition

[github] Rephrasing lull logging to avoid alarming users (#10446)

[github] Address comments

[robertwb] [BEAM-8575] Added counter tests for CombineFn (#10190)

[github] [BEAM-8490] Fix instance_to_type for empty containers (#9894)

[apilloud] [BEAM-8630] Use column numbers for BeamZetaSqlCalRel

[apilloud] [BEAM-9027] Backport BigQuerySqlDialect fixes

[robertwb] [BEAM-8575] Test hot-key fanout with accumulation modes. (#10159)

[github] [BEAM-9059] Use string constants in PTransformTranslation instead of

[hannahjiang] [BEAM-9084] cleaning up docker image tag

[iemejia] [BEAM-5086] Update kudu-client to version 1.11.1

[iemejia] [BEAM-8956] Begin unifying contributor instructions into a single

[pawel.pasterz] [BEAM-7115] Fix metrics being incorrectly gathered

[mxm] Remove incorrectly tagged test annotation from test case

[mxm] [BEAM-6008] Propagate errors during pipeline execution in Java's

[github] Tighten language and remove distracting link

[pabloem] [BEAM-7390] Add code snippet for Top (#10179)

[bhulette] [BEAM-8993] [SQL] MongoDB predicate push down. (#10417)

[valentyn] Add version guards to requirements file for integration tests.

[lukecwik] [BEAM-8740] Remove unused dependency from Spark runner (#10564)

[robertwb] [BEAM-6587] Remove hacks due to missing common string coder.

[robertwb] Automatically convert to with pipeline syntax.

[robertwb] Quick pass through failed auto-conversions.

[robertwb] Automatic conversion of more pipelines.

[robertwb] Fix lint and tests due to autoconversion.

[robertwb] A couple more conversions.

[robertwb] Fix lint and tests due to autoconversion.

[robertwb] Return non-None result for Dataflow dry run.

[robertwb] Fix lint and tests due to autoconversion.

[hannahjiang] [BEAM-9084] fix Java spotless

[kirillkozlov] Update data source for SQL performance tests

[github] [BEAM-5605] Add support for channel splitting to the gRPC read "source"

[github] [BEAM-5605] Add support for additional parameters to SplittableDofn

[chadrik] [BEAM-7746] Address changes in code since annotations were introduced

[chadrik] [BEAM-7746]  Typing fixes that require runtime code changes

[chadrik] [BEAM-7746] Avoid creating attributes dynamically, so that they can be

[chadrik] [BEAM-7746] Bugfix: coder id is expected to be str in python3

[chadrik] [BEAM-7746] Explicitly unpack tuple to avoid inferring unbounded tuple

[chadrik] [BEAM-7746] Generate files with protobuf urns as part of gen_protos

[chadrik] [BEAM-7746] Move name and coder to base StateSpec class

[chadrik] [BEAM-7746] Remove reference to missing attribute in

[chadrik] [BEAM-7746] Non-Optional arguments cannot default to None

[chadrik] [BEAM-7746] Avoid reusing variables with different data types

[chadrik] [BEAM-7746] Add StateHandler abstract base class

[chadrik] [BEAM-7746] Add TODO about fixing assignment to

[chadrik] [BEAM-7746] Fix functions that were defined twice

[chadrik] [BEAM-7746] Fix tests that have the same name

[kamil.wasilewski] [BEAM-8939] A bash script that cancels stale dataflow jobs

[iemejia] [BEAM-9040] Add skipQueries option to skip queries in a Nexmark suite

[iemejia] [BEAM-9040] Add Spark Structured Streaming Runner to Nexmark PostCommit

[valentyn] Switch to unittest.SkipTest instead of using nose.

[mxm] [BEAM-6008] Make sure to end stream only after sending all messages and

[chamikara] Sets the correct coder when clustering is enabled for the

[robertwb] Always initalize output processor on construction.

[github] [Go SDK Doc] Update Dead Container Link (#10585)

[github] Merge pull request #10582 for [INFRA-19670] Add .asf.yaml for Github

[chadrik] [BEAM-7746] Fix a typing issue where SourceBase was assumed to have a

[marek.simunek] [BEAM-9123] HadoopResourceId returns wrong directoryName bugfix

[iemejia] [website] Added security page

[iemejia] [website] Update the 2.17.0 release blog post to include security issues

[boyuanz] Moving to 2.20.0-SNAPSHOT on master branch.

[github] Update twine install details.

[crites] Changes watermark advance from 1001 to 1000 since Dataflow TestStream

[lukecwik] [BEAM-8676] sdks/java: gax and grpc upgrades (#10554)

[lukecwik] [BEAM-9030] Migrate Beam to use beam-vendor-grpc-1_26_0 (#10578)

[lcwik] [BEAM-9030] Align version of protoc/protoc-gen-grpc-java to vendored

[kirillkozlov] Create initial DataStoreV1Table

[kirillkozlov] Added tests

[kirillkozlov] Implement getTableStatistics

[kirillkozlov] buildIOWriter

[kirillkozlov] Read other types

[kirillkozlov] Better conversion, support complex types

[kirillkozlov] Store DataStore key as VARBINARY

[kirillkozlov] Wrap DoFns in PTransforms

[kirillkozlov] Table property for specifying key field

[kirillkozlov] JavaDoc

[kirillkozlov] Infer schema for RowToEntity

[kirillkozlov] Better conversion performance

[kirillkozlov] Mark Table as `Internal` and `Experimental`

[kmj] Update BQ Storage API documentation

[kirillkozlov] Review changes

[boyuanz] Exclude testOutputTimestamp from flink streaming tests.

[lukecwik] [BEAM-7951] Supports multiple inputs/outputs for wire coder settings.

[mxm] [BEAM-9116] Limit the number of past invocations stored in JobService

[kirillkozlov] Add IT that does not rely on SQL

[lukecwik] [BEAM-9124] Linkage Checker 1.1.2 to use Maven Central HTTPS URL

[robertwb] lint, reviewer comments

[relax] Merge pull request #10316: [BEAM-6857] Support Dynamic Timers

[robertwb] lint

[github] Merge pull request #10577 from Adding Python test for ReadFromBigQuery

[kirillkozlov] fix style

[github] [BEAM-9127] Fix output type declaration in xlang wordcount. (#10605)

[robertwb] fix merge

[apilloud] [BEAM-9140] Upgrade to ZetaSQL 2020.01.1

[angoenka] [BEAM-8625] Implement servlet for exposing sdk harness statuses in Da…

[iemejia] [BEAM-9143] Make RedisIO code follow standard Beam conventions

[iemejia] [BEAM-9143] Add withOutputParallelization to RedisIO.Read/ReadAll

[suztomo] Beam's own TimestampConversion

[suztomo] Link in Javadoc

[ehudm] Migrate HDFS IT to use tox env.

[ehudm] Fix for py2

[lukecwik] [BEAM-8695] Upgrade google-http-client to 1.34.0 (#10614)

[rohde.samuel] Make apply_TestStream not a test b/c Nose thinks it is a test

[chamikara] [BEAM-7246] Add Google Spanner IO Read on Python SDK (#9606)

[boyuanz] [BEAM-9151] Fix misconfigured legacy dataflow tests.

[hannahjiang] [BEAM-7861] update documentation

[github] Merge pull request #10622: [BEAM=6857] Fix timermap test to not use

[sunjincheng121] [BEAM-9153] Fix release guide heading level

[kamil.wasilewski] Report status code 0 when no stale jobs are found

[hsuryawirawan] Update to Python 3.7 and upgrade to Beam v2.17.0

[hsuryawirawan] Change "Built-in IOs" task type to "theory"

[hsuryawirawan] Remove "run_common_tests()" in all tests.py to make it work with Python

[hsuryawirawan] Update the course on Stepik

[hsuryawirawan] Add back the license header

[github] Fix typo in 2017-02-13-stateful-processing.md

[github] cleanup typo

[github] [BEAM-9120] Make WordCountsMatcher extend

[github] Revert "Merge pull request #10582 for [INFRA-19670] Add .asf.yaml for

[angoenka] [BEAM-9122] Add uses_keyed_state step property in python dataflow run…

[iambruceactor] added more meetups

[github] [BEAM-9120] Make BigqueryMatcher extend TypeSafeMatcher<TableAndQuery>

[github] [BEAM-9120] Make FileChecksumMatcher extend TypeSafeMatcher<ShardedFile>

[pabloem] Merge pull request #10459 from [BEAM-9029]Fix two bugs in Python SDK S3

[lcwik] [BEAM-3419] Support iterable on Dataflow runner when using the unified

[ehudm] [BEAM-9168] Temporary fix for RunnerAPIPTransformHolder usage

[keijiy] Fix comments on bigquery.py * beam.io.gcp.WriteToBigQuery ->

[github] Merge pull request #10534: Beam-2535: Support timer output timestamps in

[github] [BEAM-8992]  ignore Go Vet failures. (#10661)

[github] [BEAM-4725] Preallocate CoGBK value buffers (#10660)

[kirillkozlov] Use custom escape method

[github] typehint fixes to DoOutputsTuple (#10494)

[chadrik] [BEAM-7746] Silence a bunch of errors about "Cannot instantiate abstract

[github] [BEAM-3419, BEAM-9173] Add TODO comment

[github] [BEAM-9167] Reduce Go SDK metric overhead (#10654)

[iemejia] [BEAM-9172] Add missing parameter to Nexmark CI execution for Flink

[github] Chnage dataflow container version

[kcweaver] [DO NOT MERGE][BEAM-9177] Update Flink runner webpage for 2.18

[suztomo] Google-cloud-clients to use 2019 versions

[hannahjiang] [BEAM-9084] cleaning up docker image tag

[iemejia] Make Spark use of batch based invocation in Nexmark CI jobs cleaner

[kirillkozlov] Inline, link JIRA

[ehudm] Update beam website for 2.18.0

[apilloud] [BEAM-9027] Unparse LIKE as binary operator

[github] Blog post for release 2.18.0 (#10575)

[kcweaver] Update Beam version chart

[kcweaver] upgrade auto-value to version 1.7

[kcweaver] [BEAM-9149] Add SQL query parameters to public API and enable positional

[lcwik] [BEAM-8298] Fully specify the necessary details to support side input

[bhulette] [BEAM-9072] [SQL] Primitive types should fall through (#10681)

[elias.djurfeldt] Added valueprovider support for Datastore query namespaces

[iemejia] [BEAM-9170] Unify Jenkins job names related to Java 11 testing

[github] Add a minor comment.

[aaltay] Bump tensorflow from 1.14.0 to 1.15.0 in /sdks/python/container (#10392)

[robinyqiu] Turn on BeamZetaSqlCalcRel

[github] [BEAM-9093] Log invalid overwrites in pipeline options (#10613)

[github] [BEAM-8492] Allow None, Optional return hints for DoFn.process and

[chadrik] [BEAM-7746] Introduce a protocol to handle various types of partitioning

[pawel.pasterz] [BEAM-8941] Implement simple DSL for load tests

[iemejia] [website] Add warning on Beam 2.18.0 blog post for Avro 1.9.0 users

[iemejia] [BEAM-6957] Enable Counter/Distribution metrics tests for Portable Spark

[github] [BEAM-9183, BEAM-9026] Initialize and cleanup the state of

[tvalentyn] [BEAM-9184] Add ToSet combiner (#10636)

[kcweaver] [BEAM-9200] fix portable jar test version property

[github] Fixing Lint

[github] [BEAM-9201] Release scripts fixes: run_rc_validation.sh,

[altay] Change Dataflow Python containers

[angoenka] [BEAM-8626] Implement status fn api handler in python sdk (#10598)

[tvalentyn] [BEAM-9186] Allow injection of custom equality function. (#10637)

[iemejia] [BEAM-9204] Refactor HBaseUtils methods to depend on Ranges

[iemejia] [BEAM-9204] Fix HBase SplitRestriction to be based on provided Range

[echauchot] [BEAM-9205] Add ValidatesRunner annotation to the MetricsPusherTest

[echauchot] [BEAM-9205] Fix validatesRunner tests configuration in spark module

[jbonofre] [BEAM-7427] Refactore JmsCheckpointMark to be usage via Coder

[iemejia] [BEAM-7427] Adjust JmsIO access levels and other minor fixes

[robertwb] Only cache first page of paginated state.

[robertwb] Perform bundle-level caching if no cache token is given.

[robertwb] [BEAM-8298] Support side input cache tokens.

[pabloem] Merge pull request #10346 from [BEAM-7926] Data-centric Interactive

[chamikara] Fix Spanner auth endpoints

[chadrik] [BEAM-7746] Stop automatically creating staticmethods in register_urn

[robertwb] fix continuation token iter

[robertwb] lint for side input tokens

[mxm] [BEAM-9161] Ensure non-volatile access of field variables by processing

[github] Merge pull request #10680 from Indefinite retries to wait for a BQ Load

[robinyqiu] Cleanup ZetaSQLQueryPlanner and ExpressionConverter code

[robertwb] Fix state cache test.

[robertwb] TODO about two-level caching.

[robertwb] CachingStateHandler unit test.

[chamikara] Fixes an issue where FileBasedSink may suppress exceptions.

[github] [BEAM-7847] enabled to generate SDK docs with Python3 (#10141)

[ankurgoenka] [BEAM-9220] Adding argument use_runner_v2 for dataflow unified worker

[github] "Upgrade" google-cloud-spanner version to 1.13.0

[suztomo] Linkage Checker 1.1.3

[github] Removing none instead of bare return

[michal.walenia] [BEAM-9226] Set max age of 3h for Dataproc Flink clusters

[robertwb] [BEAM-9227] Defer bounded source size estimation to the workers.

[github] [BEAM-8042] [ZetaSQL] Fix aggregate column reference (#10649)

[robertwb] test lint

[robertwb] Fix extending non-list.

[robertwb] Fix some missing (but unused) output_processor constructor arguments.

[robertwb] Fix flink counters test.

[github] [BEAM-8590] Support unsubscripted native types (#10042)

[github] Revert "[BEAM-9226] Set max age of 3h for Dataproc Flink clusters"

[mxm] [BEAM-9132] Avoid logging misleading error messages during pipeline

[github] [BEAM-8889] Cleanup Beam to GCS connector interfacing code so it uses


------------------------------------------
[...truncated 199.30 KB...]
  No history is available.
Custom actions are attached to task ':sdks:java:harness:shadowJar'.

> Task :sdks:java:core:shadowTestJar
Build cache key for task ':sdks:java:core:shadowTestJar' is 633c2af65b7c42ce6a8e0febb1a34895
Caching disabled for task ':sdks:java:core:shadowTestJar': Caching has not been enabled for the task
Task ':sdks:java:core:shadowTestJar' is not up-to-date because:
  No history is available.
*******************
GRADLE SHADOW STATS

Total Jars: 5 (includes project)
Total Time: 1.901s [1901ms]
Average Time/Jar: 0.3802s [380.2ms]
*******************
:sdks:java:core:shadowTestJar (Thread[Execution worker for ':' Thread 7,5,main]) completed. Took 3.507 secs.
:sdks:java:extensions:google-cloud-platform-core:compileTestJava (Thread[Execution worker for ':' Thread 7,5,main]) started.

> Task :sdks:java:extensions:google-cloud-platform-core:compileTestJava FROM-CACHE
Build cache key for task ':sdks:java:extensions:google-cloud-platform-core:compileTestJava' is 108df7d6165c9e9fe49d5634dd550066
Task ':sdks:java:extensions:google-cloud-platform-core:compileTestJava' is not up-to-date because:
  No history is available.
Origin for org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@658d5531: {executionTime=8788, hostName=apache-beam-jenkins-3, operatingSystem=Linux, buildInvocationId=vkzzwk5vf5dafjl2nh7zspu45m, creationTime=1580426930024, identity=:sdks:java:extensions:google-cloud-platform-core:compileTestJava, type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution, userName=jenkins, gradleVersion=5.2.1, rootPath=/home/jenkins/jenkins-slave/workspace/beam_PreCommit_JavaPortabilityApi_Commit/src}
Unpacked trees for task ':sdks:java:extensions:google-cloud-platform-core:compileTestJava' from cache.
:sdks:java:extensions:google-cloud-platform-core:compileTestJava (Thread[Execution worker for ':' Thread 7,5,main]) completed. Took 0.436 secs.
:sdks:java:extensions:google-cloud-platform-core:testClasses (Thread[Execution worker for ':' Thread 7,5,main]) started.

> Task :sdks:java:extensions:google-cloud-platform-core:testClasses UP-TO-DATE
Skipping task ':sdks:java:extensions:google-cloud-platform-core:testClasses' as it has no actions.
:sdks:java:extensions:google-cloud-platform-core:testClasses (Thread[Execution worker for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:google-cloud-platform-core:testJar (Thread[Execution worker for ':' Thread 7,5,main]) started.

> Task :sdks:java:extensions:google-cloud-platform-core:testJar
Build cache key for task ':sdks:java:extensions:google-cloud-platform-core:testJar' is c513d91ccb06b52d0c128bc31974282f
Caching disabled for task ':sdks:java:extensions:google-cloud-platform-core:testJar': Caching has not been enabled for the task
Task ':sdks:java:extensions:google-cloud-platform-core:testJar' is not up-to-date because:
  No history is available.
:sdks:java:extensions:google-cloud-platform-core:testJar (Thread[Execution worker for ':' Thread 7,5,main]) completed. Took 0.012 secs.

> Task :sdks:java:harness:shadowJar
*******************
GRADLE SHADOW STATS

Total Jars: 56 (includes project)
Total Time: 9.63s [9630ms]
Average Time/Jar: 0.1719642857143s [171.9642857143ms]
*******************
:sdks:java:harness:shadowJar (Thread[Execution worker for ':' Thread 8,5,main]) completed. Took 10.212 secs.
:runners:java-fn-execution:compileJava (Thread[Execution worker for ':' Thread 8,5,main]) started.

> Task :runners:java-fn-execution:compileJava FROM-CACHE
Build cache key for task ':runners:java-fn-execution:compileJava' is 247595ad741d6c2fec5af3795807e637
Task ':runners:java-fn-execution:compileJava' is not up-to-date because:
  No history is available.
Origin for org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@5d99cf31: {executionTime=17232, hostName=apache-beam-jenkins-3, operatingSystem=Linux, buildInvocationId=anqjhqc7rrhahdewsv7sivr34u, creationTime=1580496855988, identity=:runners:java-fn-execution:compileJava, type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution, userName=jenkins, gradleVersion=5.2.1, rootPath=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go/src}
Unpacked trees for task ':runners:java-fn-execution:compileJava' from cache.
:runners:java-fn-execution:compileJava (Thread[Execution worker for ':' Thread 8,5,main]) completed. Took 2.864 secs.
:runners:java-fn-execution:classes (Thread[Execution worker for ':' Thread 8,5,main]) started.

> Task :runners:java-fn-execution:classes UP-TO-DATE
Skipping task ':runners:java-fn-execution:classes' as it has no actions.
:runners:java-fn-execution:classes (Thread[Execution worker for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:runners:java-fn-execution:jar (Thread[Execution worker for ':' Thread 4,5,main]) started.

> Task :runners:java-fn-execution:jar
Build cache key for task ':runners:java-fn-execution:jar' is fbbf150e40511ecc36689fd0c25e5b19
Caching disabled for task ':runners:java-fn-execution:jar': Caching has not been enabled for the task
Task ':runners:java-fn-execution:jar' is not up-to-date because:
  No history is available.
:runners:java-fn-execution:jar (Thread[Execution worker for ':' Thread 4,5,main]) completed. Took 0.049 secs.
:runners:direct-java:compileJava (Thread[Execution worker for ':' Thread 4,5,main]) started.
:runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava (Thread[Execution worker for ':' Thread 7,5,main]) started.

> Task :runners:direct-java:compileJava FROM-CACHE
Build cache key for task ':runners:direct-java:compileJava' is 4646893deb6e56e7d2e1d2b727e344a6
Task ':runners:direct-java:compileJava' is not up-to-date because:
  No history is available.
Origin for org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@6763b691: {executionTime=7947, hostName=apache-beam-jenkins-3, operatingSystem=Linux, buildInvocationId=qmd7rf2grva4zhtd3x2pxyyvwq, creationTime=1580480647198, identity=:runners:direct-java:compileJava, type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution, userName=jenkins, gradleVersion=5.2.1, rootPath=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/src}
Unpacked trees for task ':runners:direct-java:compileJava' from cache.
:runners:direct-java:compileJava (Thread[Execution worker for ':' Thread 4,5,main]) completed. Took 0.077 secs.
:runners:direct-java:classes (Thread[Execution worker for ':' Thread 4,5,main]) started.

> Task :runners:direct-java:classes UP-TO-DATE
Skipping task ':runners:direct-java:classes' as it has no actions.
:runners:direct-java:classes (Thread[Execution worker for ':' Thread 4,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowJar (Thread[Execution worker for ':' Thread 4,5,main]) started.

> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava FROM-CACHE
file or directory '<https://builds.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java/ws/src/runners/google-cloud-dataflow-java/worker/legacy-worker/src/main/java',> not found
Build cache key for task ':runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava' is d51e7651a9cbcb5f84a1a3e12e41f2ec
Task ':runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava' is not up-to-date because:
  No history is available.
Origin for org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@4be9fd7f: {executionTime=16761, hostName=apache-beam-jenkins-3, operatingSystem=Linux, buildInvocationId=ackutydznfegrjcbpqukzqixb4, creationTime=1580497394688, identity=:runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava, type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution, userName=jenkins, gradleVersion=5.2.1, rootPath=/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_TFRecordIOIT/src}
Unpacked trees for task ':runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava' from cache.
:runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava (Thread[Execution worker for ':' Thread 7,5,main]) completed. Took 0.261 secs.
:runners:google-cloud-dataflow-java:worker:legacy-worker:classes (Thread[Execution worker for ':' Thread 7,5,main]) started.

> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:worker:legacy-worker:classes' as it has no actions.
:runners:google-cloud-dataflow-java:worker:legacy-worker:classes (Thread[Execution worker for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar (Thread[Execution worker for ':' Thread 7,5,main]) started.

> Task :runners:direct-java:shadowJar
Build cache key for task ':runners:direct-java:shadowJar' is 857eb24d8bcc31d8c7b45f27e0e5611e
Caching disabled for task ':runners:direct-java:shadowJar': Caching has not been enabled for the task
Task ':runners:direct-java:shadowJar' is not up-to-date because:
  No history is available.
Custom actions are attached to task ':runners:direct-java:shadowJar'.
*******************
GRADLE SHADOW STATS

Total Jars: 6 (includes project)
Total Time: 0.623s [623ms]
Average Time/Jar: 0.1038333333333s [103.8333333333ms]
*******************
:runners:direct-java:shadowJar (Thread[Execution worker for ':' Thread 4,5,main]) completed. Took 0.836 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution worker for ':' Thread 4,5,main]) started.

> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is e7f6288f6e2848059b517922c51a787b
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
  No history is available.
Origin for org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@220114ad: {executionTime=13939, hostName=apache-beam-jenkins-3, operatingSystem=Linux, buildInvocationId=ackutydznfegrjcbpqukzqixb4, creationTime=1580497392839, identity=:sdks:java:io:google-cloud-platform:compileTestJava, type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution, userName=jenkins, gradleVersion=5.2.1, rootPath=/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_TFRecordIOIT/src}
Unpacked trees for task ':sdks:java:io:google-cloud-platform:compileTestJava' from cache.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution worker for ':' Thread 4,5,main]) completed. Took 0.272 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution worker for ':' Thread 4,5,main]) started.

> Task :sdks:java:io:google-cloud-platform:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution worker for ':' Thread 4,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Daemon worker,5,main]) started.

> Task :sdks:java:io:google-cloud-platform:testJar
Build cache key for task ':sdks:java:io:google-cloud-platform:testJar' is ffb9a4a6b446130b3842498944a23c9e
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar': Caching has not been enabled for the task
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
  No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Daemon worker,5,main]) completed. Took 0.059 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Daemon worker,5,main]) started.
:sdks:java:io:bigquery-io-perf-tests:compileTestJava (Thread[Execution worker for ':',5,main]) started.

> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is c6d4a3ed3854a67c5fed6971e768db31
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
  No history is available.
Origin for org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@3291d1bf: {executionTime=7570, hostName=apache-beam-jenkins-3, operatingSystem=Linux, buildInvocationId=ackutydznfegrjcbpqukzqixb4, creationTime=1580497400562, identity=:runners:google-cloud-dataflow-java:compileTestJava, type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution, userName=jenkins, gradleVersion=5.2.1, rootPath=/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_TFRecordIOIT/src}
Unpacked trees for task ':runners:google-cloud-dataflow-java:compileTestJava' from cache.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Daemon worker,5,main]) completed. Took 0.128 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Daemon worker,5,main]) started.

> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Daemon worker,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Daemon worker,5,main]) started.

> Task :runners:google-cloud-dataflow-java:testJar
Build cache key for task ':runners:google-cloud-dataflow-java:testJar' is f6484f50c48d0e919b73c6f9f545994a
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar': Caching has not been enabled for the task
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
  No history is available.
:runners:google-cloud-dataflow-java:testJar (Thread[Daemon worker,5,main]) completed. Took 0.029 secs.

> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar
Build cache key for task ':runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar' is 71e690087d45e8b7bb797dfa116c77f7
Caching disabled for task ':runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar': Caching has not been enabled for the task
Task ':runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar' is not up-to-date because:
  No history is available.
Custom actions are attached to task ':runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar'.
*******************
GRADLE SHADOW STATS

Total Jars: 16 (includes project)
Total Time: 4.287s [4287ms]
Average Time/Jar: 0.2679375s [267.9375ms]
*******************
:runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar (Thread[Execution worker for ':' Thread 7,5,main]) completed. Took 5.15 secs.

> Task :sdks:java:io:bigquery-io-perf-tests:compileTestJava
Build cache key for task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava' is 665405cc118f81fecd1b3980fb8a7c92
Task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava' is not up-to-date because:
  No history is available.
All input files are considered out-of-date for incremental task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava'.
Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments.
Compiling with error-prone compiler
Created classpath snapshot for incremental compilation in 1.566 secs. 1572 duplicate classes found in classpath (see all with --debug).
Packing task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava'
:sdks:java:io:bigquery-io-perf-tests:compileTestJava (Thread[Execution worker for ':',5,main]) completed. Took 4.259 secs.
:sdks:java:io:bigquery-io-perf-tests:testClasses (Thread[Execution worker for ':',5,main]) started.

> Task :sdks:java:io:bigquery-io-perf-tests:testClasses
Skipping task ':sdks:java:io:bigquery-io-perf-tests:testClasses' as it has no actions.
:sdks:java:io:bigquery-io-perf-tests:testClasses (Thread[Execution worker for ':',5,main]) completed. Took 0.0 secs.
:sdks:java:io:bigquery-io-perf-tests:integrationTest (Thread[Execution worker for ':',5,main]) started.
Gradle Test Executor 1 started executing tests.

> Task :sdks:java:io:bigquery-io-perf-tests:integrationTest
Build cache key for task ':sdks:java:io:bigquery-io-perf-tests:integrationTest' is 42b0e85707cca5cd2a4611bfd00c42af
Task ':sdks:java:io:bigquery-io-perf-tests:integrationTest' is not up-to-date because:
  Task.upToDateWhen is false.
Custom actions are attached to task ':sdks:java:io:bigquery-io-perf-tests:integrationTest'.
Starting process 'Gradle Test Executor 1'. Working directory: <https://builds.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java/ws/src/sdks/java/io/bigquery-io-perf-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--project=apache-beam-testing","--tempLocation=gs://temp-storage-for-perf-tests/loadtests","--tempRoot=gs://temp-storage-for-perf-tests/loadtests","--writeMethod=FILE_LOADS","--testBigQueryDataset=beam_performance","--testBigQueryTable=bqio_write_10GB_java","--metricsBigQueryDataset=beam_performance","--metricsBigQueryTable=bqio_10GB_results_java_batch","--sourceOptions={\"numRecords\":\"10485760\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"1024\"}","--runner=DataflowRunner","--maxNumWorkers=5","--numWorkers=5","--autoscalingAlgorithm=NONE","--workerHarnessContainerImage=","--dataflowWorkerJar=${dataflowWorkerJar}"] -Djava.security.manager=worker.org.gradle.process.internal.worker.child.BootstrapSecurityManager -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/5.2.1/workerMain/gradle-worker.jar worker.org.gradle.process.internal.worker.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'

org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT STANDARD_ERROR
    SLF4J: Class path contains multiple SLF4J bindings.
    SLF4J: Found binding in [jar:<https://builds.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java/ws/src/runners/google-cloud-dataflow-java/worker/legacy-worker/build/libs/beam-runners-google-cloud-dataflow-java-legacy-worker-2.20.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
    SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.25/bccda40ebc8067491b32a88f49615a747d20082d/slf4j-jdk14-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
    SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
    SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]

Gradle Test Executor 1 finished executing tests.

> Task :sdks:java:io:bigquery-io-perf-tests:integrationTest FAILED

org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT > classMethod FAILED
    java.lang.NullPointerException: Name is null
        at java.lang.Enum.valueOf(Enum.java:236)
        at org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT$WriteFormat.valueOf(BigQueryIOIT.java:261)
        at org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT.setup(BigQueryIOIT.java:106)

1 test completed, 1 failed
Finished generating test XML results (0.013 secs) into: <https://builds.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java/ws/src/sdks/java/io/bigquery-io-perf-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.025 secs) into: <https://builds.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java/ws/src/sdks/java/io/bigquery-io-perf-tests/build/reports/tests/integrationTest>
:sdks:java:io:bigquery-io-perf-tests:integrationTest (Thread[Execution worker for ':',5,main]) completed. Took 3.814 secs.

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:java:io:bigquery-io-perf-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java/ws/src/sdks/java/io/bigquery-io-perf-tests/build/reports/tests/integrationTest/index.html>

* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 49s
80 actionable tasks: 53 executed, 27 from cache

Publishing build scan...
https://gradle.com/s/smk2bghakuwo4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org