You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/07/11 18:21:18 UTC

Build failed in Jenkins: beam_PreCommit_GoPortable_Cron #494

See <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/494/display/redirect?page=changes>

Changes:

[veblush] Integration

[veblush] Pass credentials to gcsio

[veblush] Update by review


------------------------------------------
[...truncated 577.62 KB...]
timestamp {
  seconds: 1626027667
  nanos: 599100313
}
message: "DataSource: 1 elements in 1864812 ns"
instruction_id: "bundle_132"
log_location: "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232"

INFO:apache_beam.runners.portability.fn_api_runner.fn_runner:Running (e34)+(e35)
INFO:root:severity: INFO
timestamp {
  seconds: 1626027667
  nanos: 609564973
}
message: "DataSource: 1 elements in 1801052 ns"
instruction_id: "bundle_133"
log_location: "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232"

WARNING:root:severity: WARN
timestamp {
  seconds: 1626027667
  nanos: 612156772
}
message: "forcing DataChannel[localhost:37295] reconnection on port {localhost:37295} due to EOF"
instruction_id: "bundle_121"
log_location: "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/datamgr.go>:118"

WARNING:root:severity: WARN
timestamp {
  seconds: 1626027667
  nanos: 612178369
}
message: "DataChannel.read localhost:37295 closed"
instruction_id: "bundle_121"
log_location: "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/datamgr.go>:258"

Error response from daemon: manifest for apache/beam_go_sdk:dev not found
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Waiting for docker to start up. Current status is running
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Docker container is running. container_id = b'033bf4d5c6d0a241d4b6acaa19cc4561e85067a6261dd5ce252db6afd66cc9be', worker_id = worker_37
INFO:root:severity: INFO
timestamp {
  seconds: 1626027670
  nanos: 774143048
}
message: "Connecting via grpc @ localhost:42365 ..."
log_location: "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:506"

INFO:root:severity: INFO
timestamp {
  seconds: 1626027670
  nanos: 774826712
}
message: "Connecting via grpc @ localhost:40905 ..."
log_location: "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:506"

INFO:apache_beam.runners.portability.fn_api_runner.fn_runner:Running (((e12)+(e13))+(e15_keyed2))+(n15_keyede15_2/Write)
INFO:root:severity: INFO
timestamp {
  seconds: 1626027671
  nanos: 635920440
}
message: "Connecting via grpc @ localhost:41007 ..."
instruction_id: "bundle_134"
log_location: "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:506"

INFO:root:severity: INFO
timestamp {
  seconds: 1626027671
  nanos: 640564941
}
message: "DataSource: 1 elements in 4628845 ns"
instruction_id: "bundle_134"
log_location: "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232"

INFO:root:severity: INFO
timestamp {
  seconds: 1626027671
  nanos: 640600935
}
message: "DataSink: 3 elements in 3793835 ns"
instruction_id: "bundle_134"
log_location: "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84"

INFO:apache_beam.runners.portability.fn_api_runner.fn_runner:Running (((e6)+(e7))+(e9_keyed2))+(n8_keyede9_2/Write)
INFO:root:severity: INFO
timestamp {
  seconds: 1626027671
  nanos: 661913805
}
message: "DataSource: 1 elements in 232950 ns"
instruction_id: "bundle_135"
log_location: "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232"

INFO:root:severity: INFO
timestamp {
  seconds: 1626027671
  nanos: 661928210
}
message: "DataSink: 3 elements in 245206 ns"
instruction_id: "bundle_135"
log_location: "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84"

INFO:apache_beam.runners.portability.fn_api_runner.fn_runner:Running ((e1)+(e2))+(n2/Write)
INFO:root:severity: INFO
timestamp {
  seconds: 1626027671
  nanos: 690748149
}
message: "DataSource: 1 elements in 40277 ns"
instruction_id: "bundle_136"
log_location: "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232"

INFO:root:severity: INFO
timestamp {
  seconds: 1626027671
  nanos: 690762039
}
message: "DataSink: 6 elements in 52192 ns"
instruction_id: "bundle_136"
log_location: "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84"

INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fb8a1172c40> for environment WWhuByYyOvbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.32.0.dev')
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Attempting to pull image apache/beam_java8_sdk:2.32.0.dev
INFO:apache_beam.runners.portability.local_job_service:Successfully completed job in 9.120019674301147 seconds.
Error response from daemon: manifest for apache/beam_java8_sdk:2.32.0.dev not found
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Unable to pull image apache/beam_java8_sdk:2.32.0.dev, defaulting to local image if it exists
Unable to find image 'apache/beam_java8_sdk:2.32.0.dev' locally
docker: Error response from daemon: manifest for apache/beam_java8_sdk:2.32.0.dev not found.
See 'docker run --help'.
WARNING:root:severity: WARN
timestamp {
  seconds: 1626027673
  nanos: 629164336
}
message: "forcing DataChannel[localhost:41007] reconnection on port {localhost:41007} due to EOF"
instruction_id: "bundle_134"
log_location: "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/datamgr.go>:118"

WARNING:root:severity: WARN
timestamp {
  seconds: 1626027673
  nanos: 629217358
}
message: "DataChannel.read localhost:41007 closed"
instruction_id: "bundle_134"
log_location: "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/datamgr.go>:258"

ERROR:apache_beam.runners.portability.local_job_service:Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/local_job_service.py",> line 272, in _run_job
    result = fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 206, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 384, in run_stages
    stage_results = self._run_stage(
  File "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 602, in _run_stage
    bundle_context_manager.extract_bundle_inputs_and_outputs())
  File "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py",> line 868, in extract_bundle_inputs_and_outputs
    data_api_service_descriptor = self.data_api_service_descriptor()
  File "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py",> line 786, in data_api_service_descriptor
    return self.worker_handlers[0].data_api_service_descriptor()
  File "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py",> line 778, in worker_handlers
    self.execution_context.worker_handler_manager.get_worker_handlers(
  File "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py",> line 898, in get_worker_handlers
    worker_handler.start_worker()
  File "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py",> line 758, in start_worker
    self._container_id = subprocess.check_output([
  File "/usr/lib/python3.8/subprocess.py", line 411, in check_output
    return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
  File "/usr/lib/python3.8/subprocess.py", line 512, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['docker', 'run', '-d', '--network=host', 'apache/beam_java8_sdk:2.32.0.dev', '--id=worker_38', '--logging_endpoint=localhost:40905', '--control_endpoint=localhost:42365', '--artifact_endpoint=localhost:42365', '--provision_endpoint=localhost:42365']' returned non-zero exit status 125.
Exception in thread Thread-592:
Traceback (most recent call last):
  File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.8/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/local_job_service.py",> line 272, in _run_job
    result = fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 206, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 384, in run_stages
    stage_results = self._run_stage(
  File "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 602, in _run_stage
    bundle_context_manager.extract_bundle_inputs_and_outputs())
  File "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py",> line 868, in extract_bundle_inputs_and_outputs
    data_api_service_descriptor = self.data_api_service_descriptor()
  File "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py",> line 786, in data_api_service_descriptor
    return self.worker_handlers[0].data_api_service_descriptor()
  File "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py",> line 778, in worker_handlers
    self.execution_context.worker_handler_manager.get_worker_handlers(
  File "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py",> line 898, in get_worker_handlers
    worker_handler.start_worker()
  File "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py",> line 758, in start_worker
    self._container_id = subprocess.check_output([
  File "/usr/lib/python3.8/subprocess.py", line 411, in check_output
    return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
  File "/usr/lib/python3.8/subprocess.py", line 512, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['docker', 'run', '-d', '--network=host', 'apache/beam_java8_sdk:2.32.0.dev', '--id=worker_38', '--logging_endpoint=localhost:40905', '--control_endpoint=localhost:42365', '--artifact_endpoint=localhost:42365', '--provision_endpoint=localhost:42365']' returned non-zero exit status 125.

if [[ "$RUNNER" == "dataflow" ]]; then
  # Delete the container locally and remotely
  docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
  gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"

  if [[ -n "$TEST_EXPANSION_ADDR" || -n "$IO_EXPANSION_ADDR" ]]; then
    # Delete the java cross-language container locally and remotely
    docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
    gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
  fi

  # Clean up tempdir
  rm -rf $TMPDIR
fi

exit $TEST_EXIT_CODE
exit_background_processes

> Task :sdks:go:test:ulrValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/go/test/build.gradle'> line: 148

* What went wrong:
Execution failed for task ':sdks:go:test:ulrValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 17m 5s
110 actionable tasks: 89 executed, 17 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/zfvt7n5a5ovbc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PreCommit_GoPortable_Cron #495

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/495/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org