You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/01/10 01:03:00 UTC
Build failed in Jenkins:
beam_SQLBigQueryIO_Batch_Performance_Test_Java #9
See <https://builds.apache.org/job/beam_SQLBigQueryIO_Batch_Performance_Test_Java/9/display/redirect?page=changes>
Changes:
[mzobii.baig] Beam-2535 : Pursue pull request 4700 with manual apply changes from
[mzobii.baig] Beam-2535 : Pursue pull request 4700 with manual apply changes from
[mzobii.baig] Beam-2535 : Pursue pull request 4700 with manual apply changes from
[mzobii.baig] Beam-2535 : Replace timeStamp with outputTimeStamp
[mzobii.baig] Beam-2535 : Apply Spotless
[mzobii.baig] Beam-2535 : Pass outputTimestamp param in onTimer method
[mzobii.baig] Beam-2535 : Minor changed
[rehman.muradali] [BEAM-2535] : Add Commit State in ParDoEvaluator
[rehman.muradali] [BEAM-2535] : Add outputTimestamp in compare method, Revert
[mzobii.baig] Beam-2535 : Modifying default minimum target and GC time
[rehman.muradali] BEAM-2535 : Removal of extra lines
[mzobii.baig] Beam-2535 : Proposed changes
[mzobii.baig] Beam-2535 : Added original PR watermark hold functionality.
[rehman.muradali] [BEAM-2535] Apply Spotless
[ehudm] [BEAM-8662] Remove Py3 annotations support from
[kirillkozlov] Updated the cost model to favor IO with push-down
[kirillkozlov] BigQueryFilter numSupported method
[mzobii.baig] [Beam-2535] Variable renaming and added output timestamp in
[mzobii.baig] Beam-2535 : Apply Spotless
[mzobii.baig] [Beam-2535] Modify test case
[mzobii.baig] [Beam-2535] Added comments
[mzobii.baig] [Beam-2535] Apply Spotless
[mzobii.baig] [Beam-2535] Set Processing Time with outputTimestamp
[mzobii.baig] [Beam-2535] Minor renaming
[chadrik] Make local job service accessible from external machines
[rehman.muradali] [BEAM-2535] Revert Processing Time, Addition of OutputTimestamp
[rehman.muradali] [BEAM-2535] Revert TimerReceiver outputTimestamp
[kirillkozlov] Modify AggregateProjectMergeRule to have a condition
[ehudm] [BEAM-8269] Convert from_callable type hints to Beam types
[kirillkozlov] SpotlesApply
[kirillkozlov] Test for a query with a predicate
[kirillkozlov] A list of visited nodes should be unique per onMatch invocation
[rehman.muradali] [BEAM-2535] Revert TimerReceiver outputTimestamp
[kirillkozlov] Make sure all nodes are explored
[dcavazos] [BEAM-7390] Add code snippet for Mean
[dcavazos] [BEAM-7390] Add code snippet for Max
[sniemitz] [BEAM-8809] Make the constructor for AvroWriteRequest public
[rehman.muradali] [BEAM-2535] Making OnTimer compatible
[rehman.muradali] [BEAM-2535] Making OnTimer compatible
[kirillkozlov] MongoDb project push-down, needs tests
[kirillkozlov] Add tests for MongoDb project push-down
[kirillkozlov] Added cleanup for tests
[nielm] Add limit on number of mutated rows to batching/sorting stages.
[kirillkozlov] Add a new Jenkins job for SQL perf tests
[kirillkozlov] Test boilerplate
[rehman.muradali] Adding OutputTimestamp in Timer Object
[rehman.muradali] Apply Spotless and checkstyle
[kirillkozlov] Table proxy to add TimeMonitor after the IO
[kirillkozlov] Tests for direct_read w/o push-down and default methods
[kirillkozlov] rebase
[mzobii.baig] [Beam-2535] Added watermark functionality for the dataflow runner
[suztomo] [BEAM-8865] Updating Javadoc of FileIO example
[github] [BEAM-8481] Revert the increase in Postcommit timeout
[lcwik] [BEAM-4287] Add trySplit API to Java restriction tracker matching Python
[kirillkozlov] Update SQL BigQuery doc
[kenn] Use more informative assertions in some py tests
[echauchot] [BEAM-8830] flatten: better detect empty collections
[mzobii.baig] [Beam-2535] Used boolean instead boxed type
[lcwik] fixup!
[kirillkozlov] Cleanup
[dcavazos] [BEAM-7390] Add code snippet for GroupByKey
[dcavazos] [BEAM-7390] Add code snippet for Sample
[kcweaver] Version Flink job server container images
[kcweaver] [BEAM-8337] publish Flink job server container images
[github] Add a comment on RLock perf issues
[lcwik] fixup!
[kcweaver] [BEAM-8870] Skip test_sdf_with_watermark_tracking for Spark
[kcweaver] [BEAM-8870] Cache environment in spark_runner_test.
[rohde.samuel] fix assert equals_to_per_window to actually assert window's existence
[robertwb] [BEAM-8882] Implement Impulse() for BundleBasedRunner.
[kamil.wasilewski] Strict equality comparision for the version of tensorflow dependency
[kamil.wasilewski] Extract installChicagoTaxiExampleRequirements step
[mzobii.baig] [Beam-2535] Modify required watermark hold functionality
[kamil.wasilewski] Look up log level values using `getattr`
[kirillkozlov] Monitor total number of fields read from an IO
[kcweaver] [BEAM-8139] Test Spark portable job jar.
[kcweaver] [BEAM-8139] Add main method to SparkPipelineRunner.
[kcweaver] [BEAM-8139] Add beam_PostCommit_PortableJar_Spark.
[wenjialiu] [BEAM-8575] test_flatten_no_pcollection raises an exception and should
[ehudm] Moving to 2.19.0-SNAPSHOT on master branch.
[chadrik] Provide methods to override bind and service addresses independently
[chadrik] Fix lint
[chamikara] [BEAM-8884] Fix mongodb splitVector command result type issue (#10282)
[robertwb] [BEAM-8882] Make Create fn-api agnostic.
[github] Merge pull request #10247: [BEAM-7274] In preparation for
[robertwb] [BEAM-8882] Fully specify types for Create composite.
[robertwb] [BEAM-8882] Make Read fn-api agnostic.
[robertwb] [BEAM-8882] Cleanup always-on use_sdf_bounded_source option.
[robertwb] [BEAM-8882] Annotate ParDo and CombineValues operations with proto
[robertwb] [BEAM-8882] Unconditionally populate pipeline_proto_coder_id.
[lgajowy] [BEAM-6627] Add size reporting to JdbcIOIT (#10267)
[echauchot] [BEAM-8830] Fix empty dataset creation: use the beam coder wrapper that
[iemejia] [BEAM-8861] Disallow self-signed certificates by default in
[pabloem] Reactivating test while preventing timeouts.
[kirillkozlov] Check last executed query
[github] Merge pull request #10278: [BEAM-7274] Support recursive type
[lcwik] [BEAM-4287] Fix to use the residual instead of the current restriction
[kcweaver] [BEAM-8835] Stage artifacts to BEAM-PIPELINE dir in zip
[robertwb] Fix [BEAM-8581] and [BEAM-8582]
[heejong] [BEAM-8903] handling --jar_packages experimental flag in PortableRunner
[thw] [BEAM-8815] Define the no artifacts retrieval token in proto
[kcweaver] [BEAM-8835] Check for leading slash in zip file paths.
[github] Changing _BatchSizeEstimator defaults to match BatchElements defaults
[robertwb] [BEAM-8882] Fix overly-sensitive tests.
[robertwb] Fix sdf tests from create.
[robertwb] [BEAM-8882] Avoid attaching unrecognized properties.
[robertwb] [BEAM-8882] Accommodations for JRH.
[robertwb] Minor cleanup.
[github] [BEAM-8882] Fully populate log messages. (#10292)
[github] [BEAM-3865] Stronger trigger tests. (#10192)
[suztomo] [BEAM-8911] New Guava version: 25.1-jre
[pabloem] Merge pull request #10236 from [BEAM-8335] Add method to
[bhulette] [BEAM-8427] Add MongoDB to SQL documentation (#10273)
[ningk] [BEAM-7926] Data-centric Interactive Part1
[ehudm] Fix _get_args for typing.Tuple in Py3.5.2
[kcweaver] Don't override default for environment_cache_millis
[zyichi] [BEAM-8886] Add a mongodb io dataflow integration test
[kcweaver] Add FlinkMiniClusterEntryPoint for testing the uber jar submission
[kcweaver] [BEAM-8512] Add integration tests for flink_runner.py.
[ehudm] [BEAM-3713] pytest migration: py27-gcp-pytest
[michal.walenia] [BEAM-8895] Add BigQuery table name sanitization to BigQueryIOIT
[michal.walenia] [BEAM-8918] Split batch BQIOIT into avro and json using tests
[sunjincheng121] [BEAM-8929] Remove unnecessary exception handling in
[suztomo] BEAM-8693 com.google.cloud.datastore:datastore-v1-proto-client 1.6.3
[suztomo] google_cloud_bigquery is not declaring google_http_client_jackson
[github] Changing RowAsDictJsonCoder implementation for efficiency (#10300)
[github] Merge pull request #10151: [BEAM-7116] Remove use of KV in Schema
[ningk] [BEAM-8837] Fix pcoll_visualization tests
[chadrik] Pass artifact and provision endpoints to external workers from python
[suztomo] Commons-codec dependency in extensions/sql
[kcweaver] Get Flink version numbers from subdirectories
[suztomo] Adding joda_time dependency
[kcweaver] Warn if Flink versions can't be listed.
[suztomo] Commons_lang3 and jackson_databind dependency
[pabloem] [BEAM-8335] Adds support for multi-output TestStream (#9953)
[apilloud] [BEAM-8362] Don't use toString() for accessing Enum Types
[heejong] [BEAM-8905] matching Java PCollectionTuple translation naming convention
[heejong] [BEAM-8904] properly update output pcollections from expanded transforms
[kcweaver] Build mini cluster jar excluding unwanted classes.
[kcweaver] Rename to testFlinkUberJarPyX.Y
[kcweaver] Increase timeout on beam_PostCommit_PortableJar_Flink.
[echauchot] [BEAM-8894] exclude FlattenWithHeterogeneousCoders category because
[chamikara] [BEAM-8575] Test DoFn context params (#10130)
[github] Add an ML section to python SDK overview (#10233)
[michal.walenia] [BEAM-8947] Change Flink docker image names in Jenkins jobs to match
[echauchot] [BEAM-8830] Exclude failing SDF tests
[kamil.wasilewski] [BEAM-1440] Provide functions for waiting for BQ job and exporting
[kamil.wasilewski] [BEAM-1440] Create _BigQuerySource that implements iobase.BoundedSource
[kamil.wasilewski] [BEAM-1440] Reorganised BigQuery read IT tests
[kamil.wasilewski] [BEAM-1440] Create postCommitIT jobs running on Flink Runner
[kamil.wasilewski] [BEAM-1440] Convert strings to bytes on Python 3 if field type is BYTES
[kamil.wasilewski] [BEAM-1440]: Support RECORD fields in coder
[kamil.wasilewski] [BEAM-1440] Remove json files after reading
[kamil.wasilewski] [BEAM-1440] Marked classes as private
[kamil.wasilewski] [BEAM-1440] Do not force to create temp dataset when using dry run
[lostluck] [BEAM-8920] Go SDK: faster transforms/filter.Distinct with CombinePerKey
[echauchot] [BEAM-8025] Under load we get a NoHostAvailable exception at cluster
[ehudm] [BEAM-3713] pytest migration: py27-cython-pytest
[aaltay] [BEAM-8811] Upgrade Beam pipeline diagrams in docs (#10200)
[bhulette] [BEAM-8933] Update BigQuery proto dependency (#10334)
[pabloem] [BEAM-7746] Add python type hints (part 1) (#9915)
[ningk] Use explicitly named dictionary when watching local scope variables in
[heejong] [BEAM-8943] SDK harness servers don't shut down properly when SDK
[github] [BEAM-8955] Exclude AvroSchemaTest for Spark Runner (#10358)
[relax] attach values so we don't iterate over everything to verify types
[github] [BEAM-8786] Fixes a link in readme
[echauchot] [BEAM-8025] Remove temporary folder rule because it suppresses files on
[echauchot] [BEAM-8025] Disable auto compaction on Cassandra node to avoid race
[echauchot] [BEAM-5192] Migrate ElasticsearchIO to v7
[echauchot] [BEAM-5192] Minor change of ESIO public configuration API:
[pawel.pasterz] [BEAM-8946] Publish collection size of data written during MongoDBIOIT
[lukasz.gajowy] [BEAM-5495] Add possibility of scanning the classpath without
[lukasz.gajowy] [BEAM-5495] Enable injecting custom resources detection algorithms.
[lukasz.gajowy] [BEAM-5495] Move PipelineResources to
[chamikara] Merge pull request #10347: [BEAM-8885] PubsubGrpcClient doesn't respect
[kenn] [BEAM-8917] jsr305 dependency declaration for Nullable class (#10324)
[xinyuliu.us] [BEAM-8342]: upgrade to samza 1.3.0 (#10357)
[aaltay] Make model_pcollection snippet self-contained (#10343)
[pabloem] Merge pull request #10050 from [BEAM-8575] Add streaming test case for
[github] Run beam_CancelStaleDataflowJobs every 4 hours.
[robinyqiu] BeamZetaSqlCalcRel prototype
[tvalentyn] [BEAM-8575] Added a unit test to test Combine works with sessions.
[github] [GoSDK] Improve StateChannel resilience. (#10363)
[ehudm] [BEAM-3713] pytest migration: py3x-{gcp,cython}
[tweise] [BEAM-8273] Expand portability environment documentation (#10116)
[kamil.wasilewski] [BEAM-8671] Add Python 3.7 support for LoadTestBuilder
[kamil.wasilewski] [BEAM-8671] Add ParDo test running on Python 3.7
[mxm] [BEAM-8962] Add option to disable the metric container accumulator
[younghoono] [BEAM-7970] Improved error help in Go PROTOBUF.md
[suztomo] Declare JSR305 dependency as 'shadow'
[ningk] Avoid patching test pcoll data and use real logic to produce test data.
[robertwb] Fixed instructions and the example of running Interactive Beam on Flink.
[lukasz.gajowy] [BEAM-5495] Remove unneded and deprecated code
[lukasz.gajowy] [BEAM-5495] Use ClassGraph to detect classpath resources
[github] [BEAM-8446] Retrying BQ query on timeouts (#9855)
[thw] [BEAM-8816] Option to load balance bundle processing w/ multiple SDK
[ehudm] Fix cleanPython race with :clean
[pabloem] Removing LINT.If/LINT.Then statement
[bhulette] [BEAM-8801] PubsubMessageToRow should not check useFlatSchema() in
[robertwb] [BEAM-8575] To test state backed iterable coder in py sdk. (#10143)
[robertwb] [BEAM-8575] Added two unit tests in CombineTest class to test
[daniel.o.programmer] [BEAM-7970] Rebuild Go protos with new protobuf version
[robinyqiu] Fix bug in SingleRowScanConverter
[aaltay] [BEAM-7390] Add code snippet for Latest (#10166)
[robinyqiu] Use BeamBigQuerySqlDialect
[boyuanz] [BEAM-8536] Migrate using requested_execution_time to
[pabloem] Initialize logging configuration in Pipeline object
[daniel.o.programmer] [BEAM-7970] Touch-up on Go protobuf generation instructions.
[chamikara] Merge pull request #10383: [BEAM-8575] Added a unit test to test that
[kamil.wasilewski] [BEAM-8979] Remove mypy-protobuf dependency
[echauchot] [BEAM-5192] Fix missing ifs for ES7 specificities.
[echauchot] [BEAM-5192] Remove unneeded transitive dependencies, upgrade ES and
[echauchot] [BEAM-5192] Disable MockHttpTransport plugin to enabe http dialog to
[mikhail] Update release docs
[relax] Merge pull request #10311: [BEAM-8810] Detect stuck commits in
[kcweaver] Import freezegun for Python time testing.
[kcweaver] Allow message stream to yield duplicates.
[mikhail] Blogpost stub
[kcweaver] [BEAM-8891] Create and submit Spark portable jar in Python.
[kcweaver] [BEAM-8296] containerize spark job server
[robinyqiu] Address comments
[github] [GoSDK] Make data channel splits idempotent (#10406)
[pabloem] Initialize logging configuration in PipelineOptions object.
[rehman.muradali] EarliestTimestamp Fix for outputTimestamp
[lukasz.gajowy] [BEAM-5495] Make PipelineResourcesDetectorAbstractFactory an inner
[lukasz.gajowy] [BEAM-5495] Change detect() return type to List
[lukasz.gajowy] [BEAM-5495] Minor docs and test fixes
[mxm] [BEAM-8959] Invert metrics flag in Flink Runner
[lukasz.gajowy] [BEAM-5495] Re-add test verifying order of resources detection
[echauchot] [BEAM-5192] Fix util class, elasticsearch changed their json output of
[mikhail] Add blogpost file
[tysonjh] CachingShuffleBatchReader use bytes to limit size.
[mikhail] Add blogpost highlights
[github] Update release guide for cherry picks (#10399)
[heejong] [BEAM-8902] parameterize input type of Java external transform
[lukasz.gajowy] [BEAM-5495] Prevent nested jar scanning (jarfiles in jarfiles)
[ehudm] Dicts are not valid DoFn.process return values
[github] Update release notes version to correct one.
[valentyn] Sickbay VR tests that don't pass
[chamikara] Makes environment ID a top level attribute of PTransform.
[angoenka] [BEAM-8944] Change to use single thread in py sdk bundle progress report
[aaltay] [BEAM-8335] Background caching job (#10405)
[chamikara] Setting environment ID for ParDo and Combine transforms
[pawel.pasterz] [BEAM-8978] Publish table size of data written during HadoopFormatIOIT
[echauchot] [BEAM-5192] Set a custom json serializer for document metadata to be
[echauchot] [BEAM-5192] Remove testWritePartialUpdateWithErrors because triggering
[sunjincheng121] [BEAM-7949] Add time-based cache threshold support in the data service
[mxm] [BEAM-8996] Auto-generate pipeline options documentation for FlinkRunner
[mxm] Regenerate Flink options table with the latest master
[mxm] [BEAM-8996] Improvements to the Flink runner page
[ehudm] Upgrade parameterized version to 0.7.0+
[kawaigin] [BEAM-8977] Resolve test flakiness
[dpcollins] Modify PubsubClient to use the proto message throughout.
[lukecwik] [BEAM-9004] Migrate org.mockito.Matchers#anyString to
[suztomo] GenericJsonAssert
[suztomo] Refactoring with assertEqualsAsJson
[chamikara] Fixes Go formatting.
[robertwb] [BEAM-8335] Add a TestStreamService Python Implementation (#10120)
[lukecwik] Minor cleanup of tests using TestStream. (#10188)
[pabloem] [BEAM-2572] Python SDK S3 Filesystem (#9955)
[github] [BEAM-8974] Wait for log messages to be processed before checking them.
[sunjincheng121] [BEAM-7949] Introduce PeriodicThread for time-based cache threshold
[github] Merge pull request #10356: [BEAM-7274] Infer a Beam Schema from a
[echauchot] [BEAM-9019] Improve Encoders: replace as much as possible of catalyst
[lukecwik] [BEAM-8623] Add status_endpoint field to provision api ProvisionInfo
[github] [BEAM-8999] Respect timestamp combiners in PGBKCVOperation. (#10425)
[github] Update dataflow container images to beam-master-20191220 (#10448)
[zyichi] [BEAM-8824] Add support to allow specify window allowed_lateness in
[chamikara] Adds documentation for environment_id fields.
[lukecwik] [BEAM-8846] Update documentation about stream observers and factories,
[apilloud] [BEAM-9023] Upgrade to ZetaSQL 2019.12.1
[lukecwik] [BEAM-7951] Allow runner to configure customization WindowedValue coder.
[chamikara] Sets missing environmentId in several locations.
[bhulette] [BEAM-8988] RangeTracker for _CustomBigQuerySource (#10412)
[ehudm] Set TMPDIR for tox environments
[robinyqiu] Address comments
[robinyqiu] Address comments
[kcweaver] Refactor shared uber jar generation code into common subclass.
[sunjincheng121] [BEAM-8935] Fail fast if sdk harness startup failed.
[echauchot] [BEAM-5192] use <= and >= in version specific code instead of == to be
[relax] Merge pull request #10444: [BEAM-9010] Proper TableRow size calculation
[github] Merge pull request #10449: [BEAM-7274] Implement the Protobuf schema
[sunjincheng121] [BEAM-9030] Bump grpc to 1.26.0
[github] Python example parameters fix
[bhulette] [BEAM-9026] Clean up RuntimeValueProvider.runtime_options (#10457)
[kirillkozlov] Fix BytesValue unparsing
[kirillkozlov] Fix floating point literals
[kirillkozlov] Fix string literals
[kirillkozlov] Add null check for SqlTypeFamily
[kirillkozlov] ZetaSqlCalcRule should be disaled by defualt
[kirillkozlov] spotles
[ehudm] [BEAM-9025] Update Dataflow Java container worker
[heejong] [BEAM-9034] Update environment_id for ExternalTransform in Python SDK
[sunjincheng121] [BEAM-9030] Update the dependencies to make sure the dependency linkage
[mxm] [BEAM-8962] Report Flink metric accumulator only when pipeline ends
[github] Revert "[BEAM-8932] Modify PubsubClient to use the proto message
[github] Catch __module__ is None.
[relax] Merge pull request #10422: [BEAM-2535] TimerData signature update
[rehman.muradali] Rebase TimerData PR
[udim] [BEAM-9012] Change __init__ hints so they work with pytype (#10466)
[github] [BEAM-9039] Fix race on reading channel readErr. (#10456)
[lcwik] [BEAM-5605] Increase precision of fraction used during splitting.
[github] [BEAM-8487] Convert forward references to Any (#9888)
[lukecwik] [BEAM-9020] LengthPrefixUnknownCodersTest to avoid relying on
[lukecwik] [BEAM-7951] Improve the docs for beam_runner_api.proto and
[sunjincheng121] [BEAM-9006] Improve ProcessManager for shutdown hook handling.
[kamil.wasilewski] [BEAM-8671] Fix Python 3.7 ParDo test job name
[github] [BEAM-5600] Add unimplemented split API to Runner side SDF libraries.
[github] [BEAM-5605] Fix type used to describe channel splits to match type used
[github] [BEAM-5605] Ensure that split calls are routed to the active bundle
[suztomo] protobuf 3.11.1
[kcweaver] Make Spark REST URL a separate pipeline option.
[kirillkozlov] Address comments
[aaltay] [BEAM-8335] On Unbounded Source change (#10442)
[aaltay] [BEAM-9013] TestStream fix for DataflowRunner (#10445)
[angoenka] [BEAM-8575] Refactor test_do_fn_with_windowing_in_finish_bundle to work
[sunjincheng121] [BEAM-9055] Unify the config names of Fn Data API across languages.
[rehman.muradali] onTimer/setTimer signature updates
[sunjincheng121] fixup
[davidsabater] [BEAM-9053] Improve error message when unable to get the correct
[mxm] [BEAM-8577] Initialize FileSystems during Coder deserialization in
[github] Update _posts_2019-12-16-beam-2.17.0.md
[github] Cleanup formatting.
[github] Update release date.
[lcwik] [BEAM-9059] Migrate PTransformTranslation to use string constants
[iemejia] [BEAM-5546] Update commons-codec to version 1.14
[iemejia] [BEAM-8701] Remove unused commons-io_1x dependency
[iemejia] [BEAM-8701] Update commons-io to version 2.6
[iemejia] [BEAM-5544] Update cassandra-all dependency to version 3.11.5
[iemejia] [BEAM-8749] Update cassandra-driver-mapping to version 3.8.0
[mxm] Rename FlinkClassloading to Workarounds
[mxm] [BEAM-9060] Restore stdout/stderr in case Flink's
[echauchot] Fix link in javadoc to accumulators
[github] Restrict the upper bound for pyhamcrest, since new version does not work
[apilloud] [BEAM-9027] [SQL] Fix ZetaSQL Byte Literals
[github] [BEAM-9058] Fix line-too-long exclusion regex and re-enable
[altay] Readability/Lint fixes
[hannahjiang] BEAM-8780 reuse RC images instead of recreate images
[iemejia] [BEAM-8716] Update commons-csv to version 1.7
[iemejia] [BEAM-9041] Add missing equals methods for GenericRecord <-> Row
[iemejia] [BEAM-9042] Fix RowToGenericRecordFn Avro schema serialization
[iemejia] [BEAM-9042] Update SchemaCoder doc with info about functions requiring
[iemejia] [BEAM-9042] Test serializability and equality of Row<->GenericRecord
[tvalentyn] [BEAM-9062] Improve assertion error for equal_to (#10504)
[iemejia] [BEAM-8717] Update commons-lang3 to version 3.9
[iemejia] [BEAM-8717] Make non core modules use only the repackaged commons-lang3
[chamikara] [BEAM-8960]: Add an option for user to opt out of using insert id for
[ehudm] Small fixes to verify_release_build.sh
[kirillkozlov] Metric name should not be constant
[36090911+boyuanzz] [BEAM-8932] [BEAM-9036] Revert reverted commit to use PubsubMessage as
[sunjincheng121] fixup
[github] Update ParDoTest.java
[rehman.muradali] Apply spotless
[rehman.muradali] Compilation Fix PardoTest
[rehman.muradali] Reverting outputTimestamp validation
[rehman.muradali] CheckStyle Fix
[rehman.muradali] Adding Category to exclude Flink Runner
[jkai] [BEAM-8496] remove SDF translators in flink streaming transform
[github] Fix blogpost typo (#10532)
[12602502+Ardagan] Fix headings in downloads.md
[github] Add # pytype: skip-file before first import statement in each py file
[33895511+aromanenko-dev] [BEAM-8953] Extend ParquetIO read builders for AvroParquetReader
[brad.g.west] [BEAM-9078] Pass total_size to storage.Upload
[github] [BEAM-9075] Disable JoinCommuteRule for ZetaSQL planner (#10542)
[bhulette] [BEAM-9075] add a test case. (#10545)
[12602502+Ardagan] [BEAM-8821] Document Python SDK 2.17.0 deps (#10212)
[kirillkozlov] Missing commit
------------------------------------------
[...truncated 225.51 KB...]
:runners:google-cloud-dataflow-java:classes (Thread[Execution worker for ':' Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:classes
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[Execution worker for ':' Thread 5,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution worker for ':' Thread 5,5,main]) started.
> Task :sdks:java:core:compileTestJava FROM-CACHE
Unpacked trees for task ':sdks:java:core:compileTestJava' from cache.
:sdks:java:core:compileTestJava (Thread[Execution worker for ':' Thread 3,5,main]) completed. Took 2.406 secs.
:sdks:java:core:testClasses (Thread[Execution worker for ':' Thread 3,5,main]) started.
> Task :sdks:java:core:testClasses
Skipping task ':sdks:java:core:testClasses' as it has no actions.
:sdks:java:core:testClasses (Thread[Execution worker for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:core:shadowTestJar (Thread[Execution worker for ':' Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Build cache key for task ':runners:google-cloud-dataflow-java:jar' is 7001bcf0992d3975fe202297b8b6611a
Caching disabled for task ':runners:google-cloud-dataflow-java:jar': Caching has not been enabled for the task
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution worker for ':' Thread 5,5,main]) completed. Took 0.063 secs.
> Task :sdks:java:harness:shadowJar
Build cache key for task ':sdks:java:harness:shadowJar' is a177d7ca1cc9128f5c6517ea65af512c
Caching disabled for task ':sdks:java:harness:shadowJar': Caching has not been enabled for the task
Task ':sdks:java:harness:shadowJar' is not up-to-date because:
No history is available.
Custom actions are attached to task ':sdks:java:harness:shadowJar'.
> Task :sdks:java:core:shadowTestJar
Build cache key for task ':sdks:java:core:shadowTestJar' is 96e672eddf13a7260250d03a8c83d23e
Caching disabled for task ':sdks:java:core:shadowTestJar': Caching has not been enabled for the task
Task ':sdks:java:core:shadowTestJar' is not up-to-date because:
No history is available.
*******************
GRADLE SHADOW STATS
Total Jars: 5 (includes project)
Total Time: 1.889s [1889ms]
Average Time/Jar: 0.3778s [377.8ms]
*******************
:sdks:java:core:shadowTestJar (Thread[Execution worker for ':' Thread 3,5,main]) completed. Took 3.467 secs.
:sdks:java:extensions:google-cloud-platform-core:compileTestJava (Thread[Execution worker for ':' Thread 3,5,main]) started.
:sdks:java:core:jar (Thread[Execution worker for ':' Thread 9,5,main]) started.
> Task :sdks:java:extensions:google-cloud-platform-core:compileTestJava FROM-CACHE
Build cache key for task ':sdks:java:extensions:google-cloud-platform-core:compileTestJava' is 7479e81246cae648b88dc4269c491086
Task ':sdks:java:extensions:google-cloud-platform-core:compileTestJava' is not up-to-date because:
No history is available.
Origin for org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@4bee82d7: {executionTime=5942, hostName=apache-beam-jenkins-14, operatingSystem=Linux, buildInvocationId=mgocltqzg5dwnbtwcg2ffgqnta, creationTime=1578593216294, identity=:sdks:java:extensions:google-cloud-platform-core:compileTestJava, type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution, userName=jenkins, gradleVersion=5.2.1, rootPath=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_SQL/src}
Unpacked trees for task ':sdks:java:extensions:google-cloud-platform-core:compileTestJava' from cache.
:sdks:java:extensions:google-cloud-platform-core:compileTestJava (Thread[Execution worker for ':' Thread 3,5,main]) completed. Took 0.336 secs.
:sdks:java:extensions:google-cloud-platform-core:testClasses (Thread[Execution worker for ':' Thread 3,5,main]) started.
> Task :sdks:java:extensions:google-cloud-platform-core:testClasses UP-TO-DATE
Skipping task ':sdks:java:extensions:google-cloud-platform-core:testClasses' as it has no actions.
:sdks:java:extensions:google-cloud-platform-core:testClasses (Thread[Execution worker for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:google-cloud-platform-core:testJar (Thread[Execution worker for ':' Thread 3,5,main]) started.
> Task :sdks:java:extensions:google-cloud-platform-core:testJar
Build cache key for task ':sdks:java:extensions:google-cloud-platform-core:testJar' is c513d91ccb06b52d0c128bc31974282f
Caching disabled for task ':sdks:java:extensions:google-cloud-platform-core:testJar': Caching has not been enabled for the task
Task ':sdks:java:extensions:google-cloud-platform-core:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:google-cloud-platform-core:testJar (Thread[Execution worker for ':' Thread 3,5,main]) completed. Took 0.013 secs.
> Task :sdks:java:core:jar
Build cache key for task ':sdks:java:core:jar' is 4f4c40de3c5fec827bd7b295200639db
Caching disabled for task ':sdks:java:core:jar': Caching has not been enabled for the task
Task ':sdks:java:core:jar' is not up-to-date because:
No history is available.
:sdks:java:core:jar (Thread[Execution worker for ':' Thread 9,5,main]) completed. Took 0.401 secs.
> Task :sdks:java:harness:shadowJar
*******************
GRADLE SHADOW STATS
Total Jars: 56 (includes project)
Total Time: 7.531s [7531ms]
Average Time/Jar: 0.1344821428571s [134.4821428571ms]
*******************
:sdks:java:harness:shadowJar (Thread[Execution worker for ':' Thread 8,5,main]) completed. Took 8.045 secs.
:runners:java-fn-execution:compileJava (Thread[Execution worker for ':' Thread 8,5,main]) started.
> Task :runners:java-fn-execution:compileJava FROM-CACHE
Build cache key for task ':runners:java-fn-execution:compileJava' is a1436db84bf91e2f8656182468edc05d
Task ':runners:java-fn-execution:compileJava' is not up-to-date because:
No history is available.
Origin for org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@5cfbcb23: {executionTime=17289, hostName=apache-beam-jenkins-14, operatingSystem=Linux, buildInvocationId=g5oiy63ofbcqthobsrt7o6ivhu, creationTime=1578578408317, identity=:runners:java-fn-execution:compileJava, type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution, userName=jenkins, gradleVersion=5.2.1, rootPath=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_VR_Spark/src}
Unpacked trees for task ':runners:java-fn-execution:compileJava' from cache.
:runners:java-fn-execution:compileJava (Thread[Execution worker for ':' Thread 8,5,main]) completed. Took 2.546 secs.
:runners:java-fn-execution:classes (Thread[Execution worker for ':' Thread 8,5,main]) started.
> Task :runners:java-fn-execution:classes UP-TO-DATE
Skipping task ':runners:java-fn-execution:classes' as it has no actions.
:runners:java-fn-execution:classes (Thread[Execution worker for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:runners:java-fn-execution:jar (Thread[Execution worker for ':' Thread 8,5,main]) started.
> Task :runners:java-fn-execution:jar
Build cache key for task ':runners:java-fn-execution:jar' is 9b2fde7a71340ff959185beec15c5306
Caching disabled for task ':runners:java-fn-execution:jar': Caching has not been enabled for the task
Task ':runners:java-fn-execution:jar' is not up-to-date because:
No history is available.
:runners:java-fn-execution:jar (Thread[Execution worker for ':' Thread 8,5,main]) completed. Took 0.053 secs.
:runners:direct-java:compileJava (Thread[Execution worker for ':' Thread 8,5,main]) started.
:runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava (Thread[Execution worker for ':' Thread 9,5,main]) started.
> Task :runners:direct-java:compileJava FROM-CACHE
Build cache key for task ':runners:direct-java:compileJava' is 69b73221b092cc14656ab76b377d38d3
Task ':runners:direct-java:compileJava' is not up-to-date because:
No history is available.
Origin for org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@69ee413c: {executionTime=9104, hostName=apache-beam-jenkins-14, operatingSystem=Linux, buildInvocationId=bznqopm3wzc5tdrelygpzsep6a, creationTime=1578578680490, identity=:runners:direct-java:compileJava, type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution, userName=jenkins, gradleVersion=5.2.1, rootPath=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java11_Examples_Dataflow_Portability/src}
Unpacked trees for task ':runners:direct-java:compileJava' from cache.
:runners:direct-java:compileJava (Thread[Execution worker for ':' Thread 8,5,main]) completed. Took 0.098 secs.
:runners:direct-java:classes (Thread[Execution worker for ':' Thread 8,5,main]) started.
> Task :runners:direct-java:classes UP-TO-DATE
Skipping task ':runners:direct-java:classes' as it has no actions.
:runners:direct-java:classes (Thread[Execution worker for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:runners:direct-java:shadowJar (Thread[Execution worker for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava FROM-CACHE
file or directory '<https://builds.apache.org/job/beam_SQLBigQueryIO_Batch_Performance_Test_Java/ws/src/runners/google-cloud-dataflow-java/worker/legacy-worker/src/main/java',> not found
Build cache key for task ':runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava' is ccf020b2d656ecbad945a6b7a82ae852
Task ':runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava' is not up-to-date because:
No history is available.
Origin for org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@6e2e69b4: {executionTime=15365, hostName=apache-beam-jenkins-14, operatingSystem=Linux, buildInvocationId=gojclkvr2rdpdk5ztpwnuxbfw4, creationTime=1578594280086, identity=:runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava, type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution, userName=jenkins, gradleVersion=5.2.1, rootPath=/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_TextIOIT_HDFS/src}
Unpacked trees for task ':runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava' from cache.
:runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava (Thread[Execution worker for ':' Thread 9,5,main]) completed. Took 0.391 secs.
:runners:google-cloud-dataflow-java:worker:legacy-worker:classes (Thread[Execution worker for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:classes UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:worker:legacy-worker:classes' as it has no actions.
:runners:google-cloud-dataflow-java:worker:legacy-worker:classes (Thread[Execution worker for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar (Thread[Execution worker for ':' Thread 9,5,main]) started.
> Task :runners:direct-java:shadowJar
Build cache key for task ':runners:direct-java:shadowJar' is 3f9bb11bcbdaf7c3430b451606d9fb43
Caching disabled for task ':runners:direct-java:shadowJar': Caching has not been enabled for the task
Task ':runners:direct-java:shadowJar' is not up-to-date because:
No history is available.
Custom actions are attached to task ':runners:direct-java:shadowJar'.
*******************
GRADLE SHADOW STATS
Total Jars: 6 (includes project)
Total Time: 0.605s [605ms]
Average Time/Jar: 0.10083333333330001s [100.8333333333ms]
*******************
:runners:direct-java:shadowJar (Thread[Execution worker for ':' Thread 8,5,main]) completed. Took 0.862 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution worker for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 67e8b82b215fce64d289937be3a6c6e7
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Origin for org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@389f00f7: {executionTime=12534, hostName=apache-beam-jenkins-14, operatingSystem=Linux, buildInvocationId=mgocltqzg5dwnbtwcg2ffgqnta, creationTime=1578593231931, identity=:sdks:java:io:google-cloud-platform:compileTestJava, type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution, userName=jenkins, gradleVersion=5.2.1, rootPath=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_SQL/src}
Unpacked trees for task ':sdks:java:io:google-cloud-platform:compileTestJava' from cache.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution worker for ':' Thread 8,5,main]) completed. Took 0.277 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution worker for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution worker for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution worker for ':',5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Build cache key for task ':sdks:java:io:google-cloud-platform:testJar' is 3fefe5617a950f18c7c292ac7e9c2c24
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar': Caching has not been enabled for the task
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution worker for ':',5,main]) completed. Took 0.055 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution worker for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 9d026d27a0b4d12a72a603a966341ea0
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Origin for org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@69a862c9: {executionTime=9168, hostName=apache-beam-jenkins-14, operatingSystem=Linux, buildInvocationId=gojclkvr2rdpdk5ztpwnuxbfw4, creationTime=1578594275312, identity=:runners:google-cloud-dataflow-java:compileTestJava, type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution, userName=jenkins, gradleVersion=5.2.1, rootPath=/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_TextIOIT_HDFS/src}
Unpacked trees for task ':runners:google-cloud-dataflow-java:compileTestJava' from cache.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution worker for ':',5,main]) completed. Took 0.146 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution worker for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution worker for ':',5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution worker for ':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Build cache key for task ':runners:google-cloud-dataflow-java:testJar' is 1cacc66943bba255bb6ad08d76366b0b
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar': Caching has not been enabled for the task
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution worker for ':',5,main]) completed. Took 0.027 secs.
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar
Build cache key for task ':runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar' is 722c81a7c46a98cab03a68564c2eba0f
Caching disabled for task ':runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar': Caching has not been enabled for the task
Task ':runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar' is not up-to-date because:
No history is available.
Custom actions are attached to task ':runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar'.
*******************
GRADLE SHADOW STATS
Total Jars: 16 (includes project)
Total Time: 3.337s [3337ms]
Average Time/Jar: 0.2085625s [208.5625ms]
*******************
:runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar (Thread[Execution worker for ':' Thread 9,5,main]) completed. Took 4.213 secs.
> Task :sdks:java:io:parquet:compileJava
Resource missing. [HTTP GET: https://oss.sonatype.org/content/repositories/staging/net/minidev/json-smart/2.3-SNAPSHOT/maven-metadata.xml]
> Task :sdks:java:io:parquet:compileJava FAILED
:sdks:java:io:parquet:compileJava (Thread[Execution worker for ':' Thread 10,5,main]) completed. Took 1 mins 35.303 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:parquet:compileJava'.
> Could not resolve all files for configuration ':sdks:java:io:parquet:compileClasspath'.
> Could not resolve net.minidev:json-smart:[1.3.1,2.3].
Required by:
project :sdks:java:io:parquet > org.apache.hadoop:hadoop-common:2.8.5 > org.apache.hadoop:hadoop-auth:2.8.5 > com.nimbusds:nimbus-jose-jwt:4.41.1
> Could not resolve net.minidev:json-smart:2.3-SNAPSHOT.
> Unable to load Maven meta-data from https://oss.sonatype.org/content/repositories/staging/net/minidev/json-smart/2.3-SNAPSHOT/maven-metadata.xml.
> Could not get resource 'https://oss.sonatype.org/content/repositories/staging/net/minidev/json-smart/2.3-SNAPSHOT/maven-metadata.xml'.
> Could not GET 'https://oss.sonatype.org/content/repositories/staging/net/minidev/json-smart/2.3-SNAPSHOT/maven-metadata.xml'.
> Read timed out
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 0s
92 actionable tasks: 62 executed, 30 from cache
Publishing build scan...
https://gradle.com/s/zyk6ok6bydvay
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_SQLBigQueryIO_Batch_Performance_Test_Java #10
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_SQLBigQueryIO_Batch_Performance_Test_Java/10/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org