You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/05/17 09:00:12 UTC
Build failed in Jenkins:
beam_PostCommit_Python_ValidatesRunner_Dataflow #1678
See <https://builds.apache.org/job/beam_PostCommit_Python_ValidatesRunner_Dataflow/1678/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam1 (beam) in workspace <https://builds.apache.org/job/beam_PostCommit_Python_ValidatesRunner_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 9ba58eea7bbaffdb16f849836cf51c1f59282d06 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 9ba58eea7bbaffdb16f849836cf51c1f59282d06
Commit message: "Merge pull request #5290: [BEAM-3983] Restore BigQuery SQL Support with copied enums"
> git rev-list --no-walk 9ba58eea7bbaffdb16f849836cf51c1f59282d06 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PostCommit_Python_ValidatesRunner_Dataflow] $ /bin/bash -xe /tmp/jenkins8421426120633844769.sh
+ cd src
+ bash sdks/python/run_validatesrunner.sh
bash: sdks/python/run_validatesrunner.sh: No such file or directory
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user kmj@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Build failed in Jenkins:
beam_PostCommit_Python_ValidatesRunner_Dataflow #1682
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_ValidatesRunner_Dataflow/1682/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam1 (beam) in workspace <https://builds.apache.org/job/beam_PostCommit_Python_ValidatesRunner_Dataflow/ws/>
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://builds.apache.org/job/beam_PostCommit_Python_ValidatesRunner_Dataflow/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/*
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 6af4561d32ae96d60c4aa3257ec56494cb9be154 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 6af4561d32ae96d60c4aa3257ec56494cb9be154
Commit message: "Merge pull request #5666: Fix ValidatesRunner_Apex #5604"
> git rev-list --no-walk 6af4561d32ae96d60c4aa3257ec56494cb9be154 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PostCommit_Python_ValidatesRunner_Dataflow] $ /bin/bash -xe /tmp/jenkins7780963483394217457.sh
+ cd src
+ bash sdks/python/run_validatesrunner.sh
bash: sdks/python/run_validatesrunner.sh: No such file or directory
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user amaliujia@163.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user ringwalt@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user robinyq@rodete-desktop-imager.corp.google.com
Not sending mail to unregistered user kmj@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user ajamato@ajamato-linux0.sea.corp.google.com
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user fvoichick@gmail.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user jhsueh@opengov.com
Not sending mail to unregistered user kpeterson@nestlabs.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Python_ValidatesRunner_Dataflow #1681
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_ValidatesRunner_Dataflow/1681/display/redirect?page=changes>
Changes:
[kpeterson] Allow a GCP project to be explicitly set for a load job, instead of
[aljoscha.krettek] Move _CreateSource to its own package to make it pickelable
[github] Undefined names: import MetricKey, MetricName
[herohde] Add Go integration tests
[matthias] Futurize metrics subpackage
[robbe.sneyders] Add py27-lint3 test to gradle.build
[timrobertson100] Fix error-prone warnings for io/hadoop-common
[kedin] [SQL] Add support for DQL to PubsubJsonTable
[timrobertson100] Fix error-prone and some static analysis warnings in
[kpeterson] Adding a ValueProvider interface.
[kpeterson] Fixing checkstyle error.
[kedin] [SQL] Add integration test for Pubsub Json Table DLQ
[ringwalt] Improve the TaggedOutput error when a tuple is passed as a tag.
[lukasz.gajowy] [BEAM-214] Add ParquetIO
[lukasz.gajowy] [BEAM-214] Add gradle build in ParquetIO
[lukasz.gajowy] [BEAM-214] Refactore the reads to leverage FileIO
[lukasz.gajowy] [BEAM-214] Use Parquet 1.10.0 version in ParquetIO.Sink
[lukasz.gajowy] [BEAM-214] Add ParquetIOIT
[lukasz.gajowy] [BEAM-214] Update ReadFn to an non deprecated, newest Parquet API
[lukasz.gajowy] [BEAM-214] Simplify the IO by removing redundant PTransforms
[lukasz.gajowy] [BEAM-214] Implement writing slices of bytes in BeamOutputStream
[apilloud] [BEAM-3733] [SQL] Use saffron.properties for charset
[Pablo] [BEAM-4331] Disable integrationTest task caching
[tgroh] Add a new DockerEnvironmentFactory Constructor
[Pablo] Fixing Seed Job
[samuelw] [BEAM-3776] Fix issue with merging late windows where a watermark hold
[Pablo] Add future dependency to the Dockerfile
[apilloud] [SQL] Add jdbc:beam:
[apilloud] [SQL] Use CalciteConnection as context
[axelmagn] Create jobsubmission package for job management.
[axelmagn] Add Job Invocation Interfaces
[axelmagn] Add in-memory implementation of JobService
[Pablo] Remove stale TODO comments for adding archetype to java precommit
[Pablo] Upgrade Gradle shadowJar plugin to latest.
[github] Mention adding a reviewer in PR template. (#5397)
[kedin] Fix Maven build
[rober] Update generated protos in Go SDK
[herohde] Invoke Go Dataflow integration tests from post-commit
[herohde] Add the Go SDK to the README
[timrobertson100] [BEAM-4342] Enforce ErrorProne analysis in hadoop IO, and static
[timrobertson100] [BEAM-4340] Enforce ErrorProne analysis in file-based-io-tests
[timrobertson100] [BEAM-4341] Enforce ErrorProne analysis in google-cloud-platform IO
[timrobertson100] [BEAM-4335] Enforce ErrorProne analysis in amazon-web-services IO
[timrobertson100] [BEAM-4339] Enforce ErrorProne analysis in elasticsearch IO
[timrobertson100] [BEAM-4355] Enforce ErrorProne analysis in XML IO
[timrobertson100] [BEAM-4338] Enforce ErrorProne analysis in common IO
[timrobertson100] [BEAM-4337] Enforce ErrorProne analysis in cassandra IO
[timrobertson100] [BEAM-4355] Reduces scope of findbugs annotations to build time only
[timrobertson100] [BEAM-4353] Enforce ErrorProne analysis in solr IO
[timrobertson100] [BEAM-4345] Enforce ErrorProne analysis in JDBC IO
[timrobertson100] [BEAM-4336] Enforce ErrorProne analysis in AMQP IO
[timrobertson100] [BEAM-4347] Enforce ErrorProne analysis in kafka IO
[dariusz.aniszewski] [BEAM-4041] Increase timeout for getting K8s LoadBalancer external IP
[timrobertson100] [BEAM-4346] Enforce ErrorProne analysis in JMS IO
[timrobertson100] [BEAM-4352] Enforce ErrorProne analysis in Redis IO
[lcwik] [BEAM-4271] Support side inputs for ExecutableStage and provide runner
[daniel.o.programmer] [BEAM-2937] Add new Combine URNs.
[tgroh] Update worker_id Documentation
[robbe.sneyders] Futurize internal subpackage
[dariusz.aniszewski] fixed typo
[mariagh] Add validation for streaming wordcount (streaming_wordcount_debugging)
[Pablo] Increasing the concurrent test execution count (#5408)
[tgroh] Add a Default RemoteEnvironment Implementation
[sidhom] Require explicit IdGenerator for all DockerEnvironmentFactory
[sidhom] [BEAM-4148] Add pluggable UrlFactory to ServerFactory
[sidhom] [BEAM-4267] Docker-based JobBundleFactory
[tgroh] Add a Window-only State Context
[lcwik] Address Ben's comments.
[github] Make hash function in Coder base class more conservative.
[github] updated right documentation for HCatalogIO.write
[sidhom] Fix DataStreamsTest checkstyle error
[ankurgoenka] Updating python container version to beam-master-20180518
[wcn] Fix the test to properly run.
[ankurgoenka] Reverting fnapi container version
[ankurgoenka] Copyting dependency.py and dependency_test.py
[ankurgoenka] reformatting code
[ankurgoenka] Introducing classes
[ankurgoenka] gruping public and non public methods
[ankurgoenka] Renaming method and updating reference for file_copy and file_download
[ankurgoenka] Removing Google specific code and unused code in stager.
[ankurgoenka] Removing reference to Google/GCS/Dataflow and restructuring a bit of
[ankurgoenka] Fixing Stager Tests
[ankurgoenka] Making dependency.py use stager.py and fixing dependency_test.py test
[ankurgoenka] Moving stager to portability
[ankurgoenka] Removing stage_job_resources from dependencies.py and other minor
[ankurgoenka] Merging filehandler in stager
[ankurgoenka] renaming GCSStager to _ParameterizedStager
[ankurgoenka] Making a few methods static and moving code around
[ankurgoenka] Applying changes from rebase
[szewinho] HDFS large cluster configuration. Jenkins job updated to use large
[ankurgoenka] Fixing lint
[iemejia] [BEAM-4343] Enforce ErrorProne analysis in HBaseIO
[iemejia] [BEAM-4344] Enforce ErrorProne analysis in the HCatalogIO
[tgroh] Add a BundleFactoryOutputReceiverFactory
[tgroh] Add a DirectJobBundleFactory
[tgroh] Fix Copyright Headers in sdks/java/fn-execution
[yifanzou] rollback BEAM-3256 add archetype testing to gradle build PreCommits
[ankurgoenka] Adding ArtifactStagingFileHandler to push files to staging server
[ankurgoenka] Adding filesystem based artifact service to ULR job service
[ankurgoenka] Adding context manager to ArtifactStagingFileHandler
[ankurgoenka] Converting ArtifactServiceFileHandler to PortableStager based on
[ankurgoenka] Simplifying numeric constants
[ekirpichov] [BEAM-4375] Replaces usage of JUnit runners that do not work well with
[matthias] Futurize options subpackage
[szewinho] [BEAM-4065] Basic performance tests analysis added.
[szewinho] Fixed typo in env name, added unit tests for create report logic, slack
[szewinho] Jenkins job will run tests before executing script. Extended testing of
[timrobertson100] [BEAM-4347] Improve ErrorProne analysis in kafka IO
[timrobertson100] [BEAM-4348] Enforce ErrorProne analysis in kinesis IO
[timrobertson100] [BEAM-4349] Enforce ErrorProne analysis in mongodb IO
[timrobertson100] [BEAM-4351] Enforce ErrorProne analysis in mqtt IO
[lcwik] [BEAM-4060] Add the pom.xml and pom.properties file to the artifact when
[github] [BEAM-1755] Add a directory with build-specific scripts to clear up the
[ankurgoenka] Logging and naming changes
[ankurgoenka] Enhancing test cases
[tgroh] Add an InProcessEnvironmentFactory
[timrobertson100] [BEAM-4348] Removes double-checked locking to aid readability
[ankurgoenka] Updating the dostring
[tgroh] Update InProcessManagedChannelFactory
[tgroh] Add a RemoteStageEvaluatorFactory
[timrobertson100] [BEAM-4354] Enforce ErrorProne analysis in tika IO
[iemejia] Fix build with Maven (Again!)
[lukasz.gajowy] [BEAM-214] Apply reviewer's suggestions
[timrobertson100] [BEAM-4347] Minor changes following PR review
[timrobertson100] [BEAM-4347] Correction of typo following PR review
[tgroh] Use WindowOnlyContext in ReduceFnContextFactory
[tgroh] Update GroupAlsoByWindowEvaluatorFactory
[tgroh] Move InProcessEnvironmentFactory to java-fn-execution
[klk] Autoformat sdks/java/extensions/sql
[klk] Add spotless config to global gradle file
[klk] Activate spotless for SQL module
[boyuanz] Solve BEAM-4393: Missing copyright notices for shaded packages
[iemejia] Remove repeated GCPIO dependency in SQL module (Again!)
[iemejia] Enforce error-prone in ParquetIO, fix missing javadoc and refine deps
[katarzyna.kucharczyk] Replaced created datetime to jenkins build id in kubernetes namespace.
[schroederc] Use ElementEncoders for beam.Create
[boyuanz] Change bulid rules of sdks/java/harness to make harness as a uber-jar
[robertwb] Slowly ramp up wait time in state sampler.
[tgroh] Move the Local Artifact Services to the DirectRunner
[tgroh] Migrate the ReferenceRunnerJobServer to runners-direct
[tgroh] Fix License Headers
[schroederc] Add test case for proto oneof fields in create_test.go
[tgroh] Add a test to show Flatten Execution
[apilloud] [SQL] Fix transitive dependencies
[apilloud] [SQL] Run tests against actual jar
[boyuanz] [BEAM-4393]: Copy root repo's LICENSE & NOTICE into shadowJar
[herohde] Tweak Go integration test driver
[tgroh] Update Docker Command
[iemejia] [BEAM-4306] Enforce ErrorProne analysis in apex runner
[daniel.o.programmer] [BEAM-4406] Updating Java portable environment major version.
[daniel.o.programmer] [BEAM-4406] Updating Python portable environment major version.
[ehudm] Add a custom _url_dirname for local filesystems.
[tgroh] Add a Portable TransformEvaluatorRegistry
[tgroh] Consistent Parameter Order in Evaluator Factories
[tgroh] Make ImmutableExecutableStage Public
[iemejia] Fix broken build (again third time this week yay!)
[jbonofre] Fix Maven parent version in ParquetIO
[iemejia] [BEAM-4312] Enforce ErrorProne analysis in gearpump runner
[iemejia] [BEAM-4307] Enforce ErrorProne analysis in
[iemejia] [BEAM-4308] Enforce ErrorProne analysis in runners-core-java
[ammons] Say that merging windows are not supported in Distinct.java.
[lcwik] [BEAM-4411] Update Jackson version to latest to pick up security fixes.
[kenn] Implement UNNEST operator for SQL
[iemejia] [BEAM-4317] Enforce ErrorProne analysis in runners/reference/java
[iemejia] Refine dependencies, make new ones explicit and minor maven plugins
[iemejia] [BEAM-4323] Enforce ErrorProne analysis in sketching extensions
[iemejia] [BEAM-4324] Enforce ErrorProne analysis in sorter extensions
[iemejia] [BEAM-4321] Enforce ErrorProne analysis in join-library extensions
[kenn] Add equals, hashCode, and structuralValue to Nexmark model objects
[thw] [BEAM-4297] Streaming executable stage translation and operator for
[thw] [BEAM-4297] Add serialization test and make output mapping stable.
[timrobertson100] [BEAM-4389] Enable partial updates in ElasticsearchIO
[kenn] Force load of Calcite JDBC driver (avoids internal error)
[kenn] Explicitly load Beam JDBC driver before test
[iemejia] [BEAM-3813] Support (de)serialization of S3 encryption options via JSON
[Pablo] [BEAM-4426]: Addressed DataflowDistributionAccumulatorTest failure on
[aaltay] Support installing Beam SDK from a wheel distribution in SDK containers.
[cademarkegard] fix errorprone annotations and enable failOnWarning
[iemejia] Update postgres version to 42.2.2 (Java 8)
[coheigea] Update README to include virtualenv in the build instructions
[iemejia] [BEAM-4356] Enforce ErrorProne analysis in nexmark
[kenn] Finish RowType -> Schema rename
[kenn] Add convenience aliases for nullary type constructors
[kenn] Add MAP field support to Schema.Builder
[kenn] Add static factories for array, row, map types
[kenn] Schema fields are non-null by default
[kenn] TestUtils.RowsBuilder to use FieldType instead of TypeName
[kenn] Clean up CalciteUtils conversions a bit
[Pablo] enable failOnWarning for build-tools
[apilloud] Run everything with shadowJar
[apilloud] guava is on kinesis public API
[apilloud] Fix direct runner shadow config
[kenn] Add more field conveniences to Schema.Builder
[kenn] Remove extraneous RowSqlTypes
[Pablo] [BEAM-4322] Enforce ErrorProne analysis in protobuf extensions project
[apilloud] Run test on shadowJar on a flag
[kenn] Remove Schema.TypeName.type()
[kenn] Remove unsafe builder methods from FieldType
[apilloud] [SQL] Build mega jar for JDBC
[apilloud] [SQL] JDBC Class Loader IT
[ankurgoenka] proto changes to support artifact_staging_id
[ankurgoenka] Doc changes
[ankurgoenka] Renaming artifact_staging_id to staging_session_token
[ankurgoenka] Fixing python code for staging_session_token proto changes
[coheigea] Avoid fully qualified class names, when there is an existing (static)
[coheigea] Fixing ErrorProne MissingOverrides warnings
[kedin] [SQL] Fix PubsubsJsonIT
[apilloud] [SQL] Init compiler factory with JDBC class loader
[Pablo] clean generated files prior to lint
[ankurgoenka] Fixing java code for staging_session_token proto changes
[ankurgoenka] Go proto update
[amaliujia] Add LIKE operator to Beam SQL.
[kedin] [SQL] Replace planner.compilePipeline() with sqlEnv.parseQuery()
[kedin] [SQL] Add sqlEnv.executeDdl()
[kedin] [SQL] Make planner package-private
[kedin] [SQL] Add factory methods to BeamSqlEnv
[kedin] [SQL] Rename ReadOnlyTableProvider
[coheigea] Fixing some ErrorProne warnings
[github] print() is a function in Python 3
[cademarkegard] [BEAM-4303] Enforce ErrorProne analysis in examples project
[boyuanz] Address BEAM-4328: :beam-sdks-java-io-google-cloud-platform:test failure
[kedin] [SQL] Wrap SQL parsing exceptions in ParseException
[tgroh] Add an abstraction for State and Timers
[tgroh] DirectRunner Cleanups
[tgroh] Link up the Portable DirectRunner
[tgroh] Reuse ID Generators across Environments
[aromanenko.dev] [BEAM-4421] Fix for issue with reading s3 files using ParquetIO
[github] Fix flaky comparison in log_handler_test.py
[tgroh] Use the Current Users Container as the Environment
[tgroh] Enable Docker in the PortableDirectRunner
[tgroh] Move DirectJobBundleFactory to fn-execution
[tgroh] Cleanups to the PortableDirectRunner
[tgroh] Cleanups and Wiring for the ReferenceRunnerJobService
[amyrvold] [BEAM-4253] Update dataflow worker to fix ParDoTest fails in Dataflow
[kedin] [SQL] Add ParseException to sqlEnv.explain()
[kedin] [SQL] Add integration tests for BigQuery writes
[kedin] Add TestBigQuery rule
[tgroh] Use an UnsupportedArtifactRetrievalService
[altay] Move assert_that's new keyword argument to the end
[jhsueh] [BEAM-4320] Enforce ErrorProne analysis in jackson extensions project
[iemejia] [BEAM-4310] Enforce ErrorProne analysis in
[relax] Now that Dataflow is updated, we can finish updating tests and usages to
[szewinho] [BEAM-3214] Add integration test for HBaseIO.
[iemejia] [BEAM-4137] Remove MongoDB specific options from
[ankurgoenka] Code review comments fixes
[ajamato] Add new metrics protos based on s.apache.org/beam-fn-api-metrics
[amaliujia] Address comments: 1. Use SqlFunction.like to implement like operator. 2.
[apilloud] [SQL] Use AutoService for jdbc
[apilloud] [SQL] AutoService for TableProvider
[apilloud] [SQL] Don't cache IT results
[apilloud] [SQL] Test that TextIO and Direct Runner work
[apilloud] [SQL] Add context class loader hack
[rober] [BEAM-4276] Add combiner lifting support to Go SDK
[rober] fixup! Address comments.
[herohde] [BEAM-4474] Ensure unbounded Dataflow jobs are submitted as streaming
[herohde] Fix build break due to artifact staging change
[relax] Add a test with ReferenceRunner
[github] [BEAM-4480] Fixed deprecated method invoking
[lcwik] [BEAM-4481] Remove duplicate definitions of dependencies.
[herohde] [BEAM-4475] Add container boot code to Go precommit
[herohde] [BEAM-4475] Add Go submodule build to Go precommit
[axelmagn] Fix ProvisionInfo in DockerJobBundleFactory
[github] Improve default value for experiments set in RuntimeValueProvider
[cademarkegard] [BEAM-4326] Enforce ErrorProne analysis in the fn-execution project
[alan] [BEAM-4423] Mark pull requests stale after 60 days; close 7 days after
[jbonofre] Moving to 2.6.0-SNAPSHOT on master branch
[lukasz.gajowy] [BEAM-4415] Add jenkins job for HDFS ParquetIOIT
[lukasz.gajowy] [BEAM-4137] Extract file-related options from IOTestPipelineOptions
[lukasz.gajowy] [BEAM-4137] Extract postgres related options from IOTestPipelineOptions
[timrobertson100] [BEAM-4311] Enforce ErrorProne analysis in Flink runner
[github] [BEAM-4517] Add maven status in README
[jiangkai] add expression boolean casting
[coheigea] Removing extraneous whitespace around the equals operator
[katarzyna.kucharczyk] Changed a namespace to parsed job name with current job number.
[jiangkai] add boolean type for agg function
[jiangkai] support EXISTS operator
[github] Update Environments.java
[github] Remove unneeded collection import.
[github] Combine immutability type fixes. (#3)
[github] fixup!
[lcwik] BEAM-3876 avoid NPE if checkpoint is null in an unbounded source
[lcwik] testing npe fix and exception rethrow in unit tests
[lcwik] Update https://github.com/apache/beam/pull/4894 to correspond with
[github] [BEAM-4276] Add missing scope line
[lcwik] [BEAM-4517] Add PyPI status badge.
[aljoscha.krettek] [BEAM-3905] Update Flink Runner to Flink 1.5.0
[kedin] [SQL] Manually read rows in TestBigQuery
[robertwb] [BEAM-3981] Cleanup of coders futurization.
[robertwb] Use ByteCountingOutputStream for estimate_size.
[kedin] Add polling assertion support to TestBigQuery
[kedin] [SQL] Add Pubsub to BigQuery E2E integration test
[sidhom] Add reference to ArtifactSourcePool implementation
[sidhom] Clean up FlinkExecutableStageFunction and tests
[sidhom] [BEAM-4523] Implement batch flink executable stage context
[kedin] [SQL] Delete BeamSql
[kedin] [SQL] Rename QueryTransform to SqlTransform
[robertwb] Reject unknown arguments in WindowInto.
[kenn] Suppress immutability warning caused by LoadingCache in enum instance
[kenn] Make BeamSqlExpression for operators, use it for string operators
[ekirpichov] Add retrieval_token to GetManifestRequest
[ekirpichov] Refactor code that accesses staging_token
[ekirpichov] Regenerate go protobufs
[kenn] Replace project and filter with calc
[kenn] Disable CalcRemoveRule
[szewinho] Improve consistency of hadoop and hbase scripts, fix shellcheck issues
[iemejia] Fix build (missed auto service for SQL) and model-fn-execution on Flink
[iemejia] [BEAM-4318] Enforce ErrorProne analysis in Spark runner
[wcn] Encode position ids.
[robertwb] Explain why module namespace is modified in Cython codepath.
[apilloud] [SQL] Make getString more generic
[ankurgoenka] Beam File System based Artifact Staging Service
[ankurgoenka] BeamFileSystemArtifactStagingService Tests
[ankurgoenka] Enhancing test case and error handling.
[ankurgoenka] Enhancing testcases and incorporating review comments.
[ankurgoenka] Review comments Fix
[ankurgoenka] Rebasing
[apilloud] [SQL] Support unquoted table types
[herohde] Remove new Go precommit dependencies due to failures
[klk] [SQL] Separate assertions for each expression in ExpressionChecker
[klk] Remove StringOperatorsTest in favor of SQL syntax tests
[Pablo] Upgrade Gradle to version 4.8
[ehudm] Remove with_attributes keyword from ReadFromPubSub.
[swegner] Use new DSL methods for generated POM metadata
[lcwik] [BEAM-4540] Migrate junit/hamcrest to provided scope.
[swegner] [BEAM-925] Fix FindBugs violations in Dataflow Runner and re-enable
[swegner] [BEAM-4313] Fix ErrorProne warnings and enable validation in Dataflow
[ankurgoenka] Followup PR for #5591
[swegner] Add support for pre-commit trigger paths
[swegner] Set path triggers for existing pre-commit test jobs
[rober] Add graph.Fn encoding functions.
[robinyq] Defer calling formatTimestamp() to achieve better performance
[ccy] [BEAM-4549] Use per-pipeline unique ids for side inputs in
[altay] Explain experimental/deprecated from users perspective.
[jiangkai] call SqlFunctions in numeric type conversion
[github] Update Dockerfile for new setup.py changes.
[robbe.sneyders] Futurize utils subpackage
[iemejia] [BEAM-4551] Update spark runner to Spark version 2.3.1
[iemejia] Fix maven build error on sdks/java/io/google-cloud-platform module
[robinyq] Throws exception directly instead of calling checkState()
[github] Remove GPL findbugs dependency (#5609)
[lcwik] Clean-up BeamFnDataBufferingOutboundObserver since Dataflow has migrated
[jiangkai] unit test for BuildExpression literal casting
[aaltay] Futurize portability subpackage (#5385)
[altay] Futurize unpackaged files
[altay] resolved six.string_types equivalency
[altay] Futurize testing subpackage
[altay] Futurize tools subpackage
[altay] Remove old_div
[swegner] Revert "Merge pull request #5611: [BEAM-4445] Filter pre-commit
[robertwb] [BEAM-4546] Implement hot key fanout for combiners.
[robertwb] Use discaring mode for first level of combine.
[echauchot] [BEAM-4283] Export nexmark query execution times to BigQuery
[echauchot] [BEAM-4283] Make BigQueryIO Services classes public and experimental and
[echauchot] [BEAM-4283] Fix PerfsToBigQueryTest and serialization issue in
[fvoichick] Fixed link to nonexistent IsBounded.apply method
[fvoichick] Fixed documentation of default window size in example code
[fvoichick] Fixed inappropriate Javadoc comments
[aaltay] [BEAM-4333] Add integration tests for python mobile games (#5630)
[kedin] [SQL] Make field names case-sensitive
[robertwb] Suppress warning.
[robertwb] Implement BeamFileSystemArtifactSource
[robertwb] Add job submission capabilities to Flink runner.
[robertwb] Update to new JobInvoker/Invocation interface.
[robertwb] Remove references to Flink distributed file cache.
[robertwb] A bit more documentation.
[robertwb] Address comments on Flink code.
[kirpichov] Removed some dead code, fixed some warnings
[kirpichov] Adds tracing of watermarks in direct runner
[kirpichov] Fixes typo in class name
[kirpichov] Simplifies GBK expansion code a bit
[kirpichov] Fixes bug: Processes values arriving for a GBK key sequentially
[kirpichov] Introduces BundleProgressHandler.
[swegner] Fix ErrorProne violations in direct runner and enable failOnWarnings
[robertwb] Remove trailing whitespace.
[kirpichov] [BEAM-4473,BEAM-4281] Makes ReferenceRunner use a Direct stream observer
[ccy] [BEAM-4549] Revert #5623
[kirpichov] [BEAM-4291] Implements distributed artifact retrieval
[kirpichov] Deletes ArtifactSource
[thw] Fix Flink runner Maven build.
[ccy] [BEAM-4549] Fix side inputs for streaming pipelines on Dataflow
[Pablo] Improving state sampler Cython annotations.
[Pablo] Adding msecs tracking to side inputs iterator
[Pablo] Adding the sampling thread to side input microbench.
[Pablo] Adding flag to mask change
[Pablo] Fixing all lint raising-format-tuple warnings.
[github] Make build_rules.gradle version of shadow match build.gradle
[ehudm] Increase Jenkins build retention from 14 to 30 days.
[iemejia] Fix Maven build 7
[thw] Fix ValidatesRunner_Apex #5604
------------------------------------------
Started by GitHub push by iemejia
[EnvInject] - Loading node environment variables.
Building remotely on beam10 (beam) in workspace <https://builds.apache.org/job/beam_PostCommit_Python_ValidatesRunner_Dataflow/ws/>
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://builds.apache.org/job/beam_PostCommit_Python_ValidatesRunner_Dataflow/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/*
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 6af4561d32ae96d60c4aa3257ec56494cb9be154 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 6af4561d32ae96d60c4aa3257ec56494cb9be154
Commit message: "Merge pull request #5666: Fix ValidatesRunner_Apex #5604"
> git rev-list --no-walk 7e42515b777f63b623739d807396c1b5a0f7ec18 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PostCommit_Python_ValidatesRunner_Dataflow] $ /bin/bash -xe /tmp/jenkins5820390058189249203.sh
+ cd src
+ bash sdks/python/run_validatesrunner.sh
bash: sdks/python/run_validatesrunner.sh: No such file or directory
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user amaliujia@163.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user ringwalt@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user robinyq@rodete-desktop-imager.corp.google.com
Not sending mail to unregistered user kmj@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user ajamato@ajamato-linux0.sea.corp.google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user fvoichick@gmail.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user kpeterson@nestlabs.com
Not sending mail to unregistered user jhsueh@opengov.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Python_ValidatesRunner_Dataflow #1680
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_ValidatesRunner_Dataflow/1680/display/redirect?page=changes>
Changes:
[tgroh] Add an IdGenerator class to java/fn-execution
------------------------------------------
Started by GitHub push by tgroh
[EnvInject] - Loading node environment variables.
Building remotely on beam1 (beam) in workspace <https://builds.apache.org/job/beam_PostCommit_Python_ValidatesRunner_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 7e42515b777f63b623739d807396c1b5a0f7ec18 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 7e42515b777f63b623739d807396c1b5a0f7ec18
Commit message: "Merge pull request #5394: Add an IdGenerator class to java/fn-execution"
> git rev-list --no-walk 9ba58eea7bbaffdb16f849836cf51c1f59282d06 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PostCommit_Python_ValidatesRunner_Dataflow] $ /bin/bash -xe /tmp/jenkins7692429894769284885.sh
+ cd src
+ bash sdks/python/run_validatesrunner.sh
bash: sdks/python/run_validatesrunner.sh: No such file or directory
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user kmj@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Build failed in Jenkins:
beam_PostCommit_Python_ValidatesRunner_Dataflow #1679
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_ValidatesRunner_Dataflow/1679/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam1 (beam) in workspace <https://builds.apache.org/job/beam_PostCommit_Python_ValidatesRunner_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 9ba58eea7bbaffdb16f849836cf51c1f59282d06 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 9ba58eea7bbaffdb16f849836cf51c1f59282d06
Commit message: "Merge pull request #5290: [BEAM-3983] Restore BigQuery SQL Support with copied enums"
> git rev-list --no-walk 9ba58eea7bbaffdb16f849836cf51c1f59282d06 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PostCommit_Python_ValidatesRunner_Dataflow] $ /bin/bash -xe /tmp/jenkins5030907006716426680.sh
+ cd src
+ bash sdks/python/run_validatesrunner.sh
bash: sdks/python/run_validatesrunner.sh: No such file or directory
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user kmj@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk