You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/09/15 12:17:56 UTC
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#269
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/269/display/redirect?page=changes>
Changes:
[dhuntsperger] updated Maven-to-Gradle conversion step in Java quickstart
[noreply] [BEAM-10913] - Updating Grafana from v6.7.3 to v8.1.2 (#15503)
[noreply] [BEAM-12876] Adding doc and glossary entry for resource hints (#15499)
------------------------------------------
[...truncated 22.57 KB...]
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631704485535120440/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631704485535120440/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0915100339",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/15 11:14:47 Submitted job: 2021-09-15_04_14_46-13511110388335200605
2021/09/15 11:14:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-15_04_14_46-13511110388335200605?project=apache-beam-testing
2021/09/15 11:14:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-15_04_14_46-13511110388335200605
2021/09/15 11:14:47 Job state: JOB_STATE_PENDING ...
2021/09/15 11:15:17 Job still running ...
2021/09/15 11:15:47 Job still running ...
2021/09/15 11:16:17 Job still running ...
2021/09/15 11:16:47 Job still running ...
2021/09/15 11:17:17 Job still running ...
2021/09/15 11:17:47 Job still running ...
2021/09/15 11:18:17 Job still running ...
2021/09/15 11:18:47 Job still running ...
2021/09/15 11:19:17 Job still running ...
2021/09/15 11:19:47 Job still running ...
2021/09/15 11:20:17 Job still running ...
2021/09/15 11:20:47 Job still running ...
2021/09/15 11:21:17 Job still running ...
2021/09/15 11:21:47 Job still running ...
2021/09/15 11:22:17 Job still running ...
2021/09/15 11:22:47 Job still running ...
2021/09/15 11:23:17 Job still running ...
2021/09/15 11:23:47 Job still running ...
2021/09/15 11:24:17 Job still running ...
2021/09/15 11:24:48 Job still running ...
2021/09/15 11:25:18 Job still running ...
2021/09/15 11:25:48 Job still running ...
2021/09/15 11:26:18 Job still running ...
2021/09/15 11:26:48 Job still running ...
2021/09/15 11:27:18 Job still running ...
2021/09/15 11:27:48 Job still running ...
2021/09/15 11:28:18 Job still running ...
2021/09/15 11:28:48 Job still running ...
2021/09/15 11:29:18 Job still running ...
2021/09/15 11:29:48 Job still running ...
2021/09/15 11:30:18 Job still running ...
2021/09/15 11:30:48 Job still running ...
2021/09/15 11:31:18 Job still running ...
2021/09/15 11:31:48 Job still running ...
2021/09/15 11:32:18 Job still running ...
2021/09/15 11:32:48 Job still running ...
2021/09/15 11:33:19 Job still running ...
2021/09/15 11:33:49 Job still running ...
2021/09/15 11:34:19 Job still running ...
2021/09/15 11:34:49 Job still running ...
2021/09/15 11:35:19 Job still running ...
2021/09/15 11:35:49 Job still running ...
2021/09/15 11:36:19 Job still running ...
2021/09/15 11:36:49 Job still running ...
2021/09/15 11:37:19 Job still running ...
2021/09/15 11:37:49 Job still running ...
2021/09/15 11:38:19 Job still running ...
2021/09/15 11:38:49 Job still running ...
2021/09/15 11:39:19 Job still running ...
2021/09/15 11:39:49 Job still running ...
2021/09/15 11:40:19 Job still running ...
2021/09/15 11:40:49 Job still running ...
2021/09/15 11:41:19 Job still running ...
2021/09/15 11:41:49 Job still running ...
2021/09/15 11:42:19 Job still running ...
2021/09/15 11:42:50 Job still running ...
2021/09/15 11:43:20 Job still running ...
2021/09/15 11:43:50 Job still running ...
2021/09/15 11:44:20 Job still running ...
2021/09/15 11:44:50 Job still running ...
2021/09/15 11:45:20 Job still running ...
2021/09/15 11:45:50 Job still running ...
2021/09/15 11:46:20 Job still running ...
2021/09/15 11:46:50 Job still running ...
2021/09/15 11:47:20 Job still running ...
2021/09/15 11:47:50 Job still running ...
2021/09/15 11:48:20 Job still running ...
2021/09/15 11:48:50 Job still running ...
2021/09/15 11:49:20 Job still running ...
2021/09/15 11:49:50 Job still running ...
2021/09/15 11:50:20 Job still running ...
2021/09/15 11:50:50 Job still running ...
2021/09/15 11:51:21 Job still running ...
2021/09/15 11:51:51 Job still running ...
2021/09/15 11:52:21 Job still running ...
2021/09/15 11:52:51 Job still running ...
2021/09/15 11:53:21 Job still running ...
2021/09/15 11:53:51 Job still running ...
2021/09/15 11:54:21 Job still running ...
2021/09/15 11:54:51 Job still running ...
2021/09/15 11:55:21 Job still running ...
2021/09/15 11:55:51 Job still running ...
2021/09/15 11:56:21 Job still running ...
2021/09/15 11:56:51 Job still running ...
2021/09/15 11:57:21 Job still running ...
2021/09/15 11:57:51 Job still running ...
2021/09/15 11:58:21 Job still running ...
2021/09/15 11:58:51 Job still running ...
2021/09/15 11:59:21 Job still running ...
2021/09/15 11:59:51 Job still running ...
2021/09/15 12:00:21 Job still running ...
2021/09/15 12:00:52 Job still running ...
2021/09/15 12:01:22 Job still running ...
2021/09/15 12:01:52 Job still running ...
2021/09/15 12:02:22 Job still running ...
2021/09/15 12:02:52 Job still running ...
2021/09/15 12:03:22 Job still running ...
2021/09/15 12:03:52 Job still running ...
2021/09/15 12:04:22 Job still running ...
2021/09/15 12:04:52 Job still running ...
2021/09/15 12:05:22 Job still running ...
2021/09/15 12:05:52 Job still running ...
2021/09/15 12:06:22 Job still running ...
2021/09/15 12:06:52 Job still running ...
2021/09/15 12:07:22 Job still running ...
2021/09/15 12:07:52 Job still running ...
2021/09/15 12:08:22 Job still running ...
2021/09/15 12:08:52 Job still running ...
2021/09/15 12:09:22 Job still running ...
2021/09/15 12:09:53 Job still running ...
2021/09/15 12:10:23 Job still running ...
2021/09/15 12:10:53 Job still running ...
2021/09/15 12:11:23 Job still running ...
2021/09/15 12:11:53 Job still running ...
2021/09/15 12:12:23 Job still running ...
2021/09/15 12:12:53 Job still running ...
2021/09/15 12:13:23 Job still running ...
2021/09/15 12:13:53 Job still running ...
2021/09/15 12:14:23 Job still running ...
2021/09/15 12:14:53 Job still running ...
2021/09/15 12:15:23 Job still running ...
2021/09/15 12:15:53 Job still running ...
2021/09/15 12:16:23 Job still running ...
2021/09/15 12:16:53 Job still running ...
2021/09/15 12:17:23 Job still running ...
2021/09/15 12:17:53 Failed to execute job: job 2021-09-15_04_14_46-13511110388335200605 failed
panic: Failed to execute job: job 2021-09-15_04_14_46-13511110388335200605 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112b048, 0xc00003e0b0, 0x101d3e1, 0x19, 0xc000321e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 3m 36s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/3cop2aedhw3ro
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#296
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/296/display/redirect?page=changes>
Changes:
[rogan.o.morrow] [BEAM-12875] Register file systems in SparkExecutableStageFunction
[rogelio.hernandez] [BEAM-12371][BEAM-12373] Fixed page navigation
[Kyle Weaver] [BEAM-12694] Include datetime in dicom test dataset name.
[noreply] [BEAM-12960] Add extra context for structural DoFn ProcessElement error
[noreply] Release 2.33 documentation update (#15543)
[noreply] Merge pull request #15441 from [BEAM-8823] Make FnApiRunner work by
------------------------------------------
[...truncated 18.54 KB...]
payload: "ChdvZmZzZXRyYW5nZS5SZXN0cmljdGlvbhJTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24atAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdEVuYxJlCBYiUwgaSk9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vcGtnL2JlYW0vaW8vcnRyYWNrZXJzL29mZnNldHJhbmdlLlJlc3RyaWN0aW9uKgYIFBICCAgqBAgZQAEitAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdERlYxJlCBYiBggUEgIICCpTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24qBAgZQAE="
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/12 11:15:01 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1634037300596548722/model
2021/10/12 11:15:01 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-1012100352"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634037300596548722/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634037300596548722/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-1012100352",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/12 11:15:01 Submitted job: 2021-10-12_04_15_01-13962106904389709770
2021/10/12 11:15:01 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-12_04_15_01-13962106904389709770?project=apache-beam-testing
2021/10/12 11:15:01 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-12_04_15_01-13962106904389709770
2021/10/12 11:15:01 Job state: JOB_STATE_PENDING ...
2021/10/12 11:15:31 Job still running ...
2021/10/12 11:16:02 Job still running ...
2021/10/12 11:16:32 Job still running ...
2021/10/12 11:17:02 Job still running ...
2021/10/12 11:17:32 Job still running ...
2021/10/12 11:18:02 Job still running ...
2021/10/12 11:18:32 Failed to execute job: job 2021-10-12_04_15_01-13962106904389709770 failed
panic: Failed to execute job: job 2021-10-12_04_15_01-13962106904389709770 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112f708, 0xc00003e0b0, 0x1020dc1, 0x19, 0xc0000d1e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 11s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/bhps37o26rw5a
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#295
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/295/display/redirect>
Changes:
------------------------------------------
[...truncated 19.20 KB...]
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/11 11:14:56 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633950895401131603/model
2021/10/11 11:14:56 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-1011100351"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633950895401131603/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633950895401131603/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-1011100351",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/11 11:14:56 Submitted job: 2021-10-11_04_14_56-4175217374610309183
2021/10/11 11:14:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-11_04_14_56-4175217374610309183?project=apache-beam-testing
2021/10/11 11:14:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-11_04_14_56-4175217374610309183
2021/10/11 11:14:56 Job state: JOB_STATE_PENDING ...
2021/10/11 11:15:26 Job still running ...
2021/10/11 11:15:56 Job still running ...
2021/10/11 11:16:26 Job still running ...
2021/10/11 11:16:56 Job still running ...
2021/10/11 11:17:27 Job still running ...
2021/10/11 11:17:57 Job still running ...
2021/10/11 11:18:27 Job still running ...
2021/10/11 11:18:57 Job still running ...
2021/10/11 11:19:27 Job still running ...
2021/10/11 11:19:57 Job still running ...
2021/10/11 11:20:27 Failed to execute job: job 2021-10-11_04_14_56-4175217374610309183 failed
panic: Failed to execute job: job 2021-10-11_04_14_56-4175217374610309183 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112f5c8, 0xc00003e0b0, 0x1020dc1, 0x19, 0xc0001e1e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 6s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/s367boi66wn26
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#294
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/294/display/redirect>
Changes:
------------------------------------------
[...truncated 18.50 KB...]
urn: "beam:go:coder:custom:v1"
payload: "ChdvZmZzZXRyYW5nZS5SZXN0cmljdGlvbhJTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24atAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdEVuYxJlCBYiUwgaSk9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vcGtnL2JlYW0vaW8vcnRyYWNrZXJzL29mZnNldHJhbmdlLlJlc3RyaWN0aW9uKgYIFBICCAgqBAgZQAEitAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdERlYxJlCBYiBggUEgIICCpTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24qBAgZQAE="
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/10 11:15:01 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633864501025100760/model
2021/10/10 11:15:01 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-1010100353"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633864501025100760/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633864501025100760/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-1010100353",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/10 11:15:02 Submitted job: 2021-10-10_04_15_01-17832283686921085508
2021/10/10 11:15:02 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-10_04_15_01-17832283686921085508?project=apache-beam-testing
2021/10/10 11:15:02 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-10_04_15_01-17832283686921085508
2021/10/10 11:15:02 Job state: JOB_STATE_PENDING ...
2021/10/10 11:15:32 Job still running ...
2021/10/10 11:16:02 Job still running ...
2021/10/10 11:16:32 Job still running ...
2021/10/10 11:17:02 Job still running ...
2021/10/10 11:17:32 Job still running ...
2021/10/10 11:18:02 Failed to execute job: job 2021-10-10_04_15_01-17832283686921085508 failed
panic: Failed to execute job: job 2021-10-10_04_15_01-17832283686921085508 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112f5c8, 0xc00003e0b0, 0x1020dc1, 0x19, 0xc0004f1e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 42s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/gjkbhfxknvlo2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#293
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/293/display/redirect?page=changes>
Changes:
[noreply] fixing test link
[Brian Hulette] Add DataFrame changes to CHANGES.md
[stranniknm] [BEAM-12964]: add code editor component
[stranniknm] [BEAM-12966]: load initial example on page load
[stranniknm] [BEAM-12964]: fix editor scrolling
[stranniknm] [BEAM-12964]: add dark theme support
[stranniknm] [BEAM-12964]: add licence to example repository file
[stranniknm] [BEAM-12964]: extract playground page providers
[stranniknm] [BEAM-12964]: refactor styles
[noreply] fix linter issues
[Brian Hulette] Don't use run_pytest.sh for pyarrow tests
[Brian Hulette] Fail in run_pytest.sh if -m is specified
[noreply] [BEAM-10913] - Forcing update of YAML file by running kubectl apply
[noreply] [BEAM-10955] Flink Java Runner test flake: Could not find Flink job
[noreply] [BEAM-10114] Bump Pub/Sub Lite version (#15640)
------------------------------------------
[...truncated 18.51 KB...]
payload: "ChdvZmZzZXRyYW5nZS5SZXN0cmljdGlvbhJTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24atAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdEVuYxJlCBYiUwgaSk9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vcGtnL2JlYW0vaW8vcnRyYWNrZXJzL29mZnNldHJhbmdlLlJlc3RyaWN0aW9uKgYIFBICCAgqBAgZQAEitAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdERlYxJlCBYiBggUEgIICCpTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24qBAgZQAE="
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/09 11:14:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633778093214198587/model
2021/10/09 11:14:53 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-1009100346"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633778093214198587/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633778093214198587/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-1009100346",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/09 11:14:54 Submitted job: 2021-10-09_04_14_53-17719339443995367904
2021/10/09 11:14:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-09_04_14_53-17719339443995367904?project=apache-beam-testing
2021/10/09 11:14:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-09_04_14_53-17719339443995367904
2021/10/09 11:14:54 Job state: JOB_STATE_PENDING ...
2021/10/09 11:15:24 Job still running ...
2021/10/09 11:15:54 Job still running ...
2021/10/09 11:16:24 Job still running ...
2021/10/09 11:16:54 Job still running ...
2021/10/09 11:17:24 Job still running ...
2021/10/09 11:17:54 Job still running ...
2021/10/09 11:18:24 Failed to execute job: job 2021-10-09_04_14_53-17719339443995367904 failed
panic: Failed to execute job: job 2021-10-09_04_14_53-17719339443995367904 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112f5c8, 0xc000120000, 0x1020dc1, 0x19, 0xc000403e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 4s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/v5dqnmq7izmk2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#292
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/292/display/redirect?page=changes>
Changes:
[Udi Meiri] Release script fixes
[noreply] [BEAM-13015] Remove the overhead of SpecMonitoringInfoValidator
[noreply] Minor: Replace generic external.py links in multi-language documentation
[noreply] Revert "[BEAM-12993] Update to Debezium 1.7.0.Final (#15636)"
[kawaigin] Updated screendiff integration test golden screenshots.
[noreply] [BEAM-12769] Few fixes related to Java Class Lookup based cross-language
------------------------------------------
[...truncated 18.47 KB...]
payload: "ChdvZmZzZXRyYW5nZS5SZXN0cmljdGlvbhJTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24atAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdEVuYxJlCBYiUwgaSk9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vcGtnL2JlYW0vaW8vcnRyYWNrZXJzL29mZnNldHJhbmdlLlJlc3RyaWN0aW9uKgYIFBICCAgqBAgZQAEitAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdERlYxJlCBYiBggUEgIICCpTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24qBAgZQAE="
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/08 11:14:52 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633691692373657621/model
2021/10/08 11:14:52 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-1008100356"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633691692373657621/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633691692373657621/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-1008100356",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/08 11:14:53 Submitted job: 2021-10-08_04_14_52-3925558103516293262
2021/10/08 11:14:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-08_04_14_52-3925558103516293262?project=apache-beam-testing
2021/10/08 11:14:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-08_04_14_52-3925558103516293262
2021/10/08 11:14:53 Job state: JOB_STATE_PENDING ...
2021/10/08 11:15:23 Job still running ...
2021/10/08 11:15:53 Job still running ...
2021/10/08 11:16:23 Job still running ...
2021/10/08 11:16:53 Job still running ...
2021/10/08 11:17:23 Job still running ...
2021/10/08 11:17:53 Job still running ...
2021/10/08 11:18:23 Failed to execute job: job 2021-10-08_04_14_52-3925558103516293262 failed
panic: Failed to execute job: job 2021-10-08_04_14_52-3925558103516293262 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112f5c8, 0xc00003e0b0, 0x1020dc1, 0x19, 0xc00042fe80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 3s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/ay5bjmulemccy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#291
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/291/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Restore "Default to Runner v2 for Python Streaming jobs. (#15140)"
[stefan.istrate] Fix "too many pings" errors.
[stefan.istrate] Increase keepalive timeout to 5 minutes.
[david.prieto] [BEAM-12950] Not delete orphaned files to avoid missing events
[david.prieto] [BEAM-12950] Add Bug fix description to CHANGES.md
[david.prieto] [BEAM-12950] fix linter issues
[Robert Bradshaw] Dead letter option.
[Robert Bradshaw] Guard setup.py logic with __main__ condition.
[stefan.istrate] Fix yapf complaints.
[Robert Bradshaw] Avoid incompatible setting.
[aydar.zaynutdinov] [BEAM-12969] [Playground]
[david.prieto] [BEAN-12950] Skip unit test
[noreply] [BEAM-12909][BEAM-12849] Add support for running spark3 nexmark queries
[Robert Bradshaw] Add the ability to use subprocesses with the dead letter queue.
[Robert Bradshaw] Support multi-output DoFns.
[noreply] Merge pull request #15510 from [BEAM-12883] Add coder for
[Robert Bradshaw] multi-output fix
[Robert Bradshaw] Add thresholding to dead letter pattern.
[Robert Bradshaw] treshold test fixes
[Robert Bradshaw] Better naming, documentation.
[noreply] [BEAM-12482] Ensure that we ignore schema update options when loading
[Kyle Weaver] Moving to 2.35.0-SNAPSHOT on master branch.
[Kyle Weaver] Add 2.35.0 section to changelog.
[noreply] Fix email links in the contact page
------------------------------------------
[...truncated 18.52 KB...]
payload: "ChdvZmZzZXRyYW5nZS5SZXN0cmljdGlvbhJTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24atAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdEVuYxJlCBYiUwgaSk9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vcGtnL2JlYW0vaW8vcnRyYWNrZXJzL29mZnNldHJhbmdlLlJlc3RyaWN0aW9uKgYIFBICCAgqBAgZQAEitAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdERlYxJlCBYiBggUEgIICCpTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24qBAgZQAE="
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/07 11:14:56 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633605295733001274/model
2021/10/07 11:14:56 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-1007100337"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633605295733001274/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633605295733001274/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-1007100337",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/07 11:14:56 Submitted job: 2021-10-07_04_14_56-6595573178799899900
2021/10/07 11:14:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-07_04_14_56-6595573178799899900?project=apache-beam-testing
2021/10/07 11:14:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-07_04_14_56-6595573178799899900
2021/10/07 11:14:56 Job state: JOB_STATE_PENDING ...
2021/10/07 11:15:26 Job still running ...
2021/10/07 11:15:56 Job still running ...
2021/10/07 11:16:27 Job still running ...
2021/10/07 11:16:57 Job still running ...
2021/10/07 11:17:27 Job still running ...
2021/10/07 11:17:57 Job still running ...
2021/10/07 11:18:27 Failed to execute job: job 2021-10-07_04_14_56-6595573178799899900 failed
panic: Failed to execute job: job 2021-10-07_04_14_56-6595573178799899900 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112f5c8, 0xc00003e0b0, 0x1020dc1, 0x19, 0xc00042be80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 5s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/6okmu7t4t75tg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#290
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/290/display/redirect?page=changes>
Changes:
[noreply] Only stage the single (fat) jar when auto-starting expansion service.
[noreply] Disable samza counters (#15659)
[noreply] Merge pull request #15614 from [BEAM-12953] [Playground] Create protobuf
[noreply] [BEAM-11831] Parially Revert "[BEAM-11805] Replace user-agent for
[kawaigin] [BEAM-10708] Enable submit beam_sql built jobs to Dataflow
[noreply] Merge pull request #15602 from [BEAM-10917] Add support for BigQuery
------------------------------------------
[...truncated 19.21 KB...]
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/06 11:14:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633518893484298094/model
2021/10/06 11:14:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-1006100357"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633518893484298094/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633518893484298094/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-1006100357",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/06 11:14:54 Submitted job: 2021-10-06_04_14_54-590770535139267453
2021/10/06 11:14:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-06_04_14_54-590770535139267453?project=apache-beam-testing
2021/10/06 11:14:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-06_04_14_54-590770535139267453
2021/10/06 11:14:54 Job state: JOB_STATE_PENDING ...
2021/10/06 11:15:24 Job still running ...
2021/10/06 11:15:54 Job still running ...
2021/10/06 11:16:24 Job still running ...
2021/10/06 11:16:54 Job still running ...
2021/10/06 11:17:24 Job still running ...
2021/10/06 11:17:54 Job still running ...
2021/10/06 11:18:24 Job still running ...
2021/10/06 11:18:55 Job still running ...
2021/10/06 11:19:25 Job still running ...
2021/10/06 11:19:55 Job still running ...
2021/10/06 11:20:26 Failed to execute job: job 2021-10-06_04_14_54-590770535139267453 failed
panic: Failed to execute job: job 2021-10-06_04_14_54-590770535139267453 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112f5c8, 0xc000120000, 0x1020dc1, 0x19, 0xc0004ebe80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 6s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/4tcuqmnn3okqy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#289
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/289/display/redirect?page=changes>
Changes:
[danthev] Switch hintNumWorkers to ValueProvider, switch firstInstant to side
[noreply] [BEAM-11516] Upgrade to pylint 2.11.1, fix warnings (#15612)
[noreply] [BEAM-12979, BEAM-11097] Change cache to store ReStreams, clean up to…
[noreply] [BEAM-3304, BEAM-12513] Trigger changes and Windowing. (#15644)
[noreply] Merge pull request #15618 from [BEAM-12968] [Playground] Create README
[noreply] Merge pull request #15626 from [BEAM-12963] [Playground] Create base
[noreply] Merge pull request #15566 from [BEAM-12925] Correct behavior retrieving
[noreply] [BEAM-12911] Update schema translation (Java, Python) to log more
[noreply] Update CHANGES.md for JdbcIO breaking change (#15651)
[noreply] [BEAM-12513] Add Go SDK metrics content to BPG. (#15650)
[noreply] [BEAM-12996] Improve Error Logging in ConfigBuilder (#15646)
[noreply] [BEAM-13000] Disable Reshuffle Translation in Samza Portable Mode
------------------------------------------
[...truncated 18.51 KB...]
payload: "ChdvZmZzZXRyYW5nZS5SZXN0cmljdGlvbhJTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24atAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdEVuYxJlCBYiUwgaSk9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vcGtnL2JlYW0vaW8vcnRyYWNrZXJzL29mZnNldHJhbmdlLlJlc3RyaWN0aW9uKgYIFBICCAgqBAgZQAEitAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdERlYxJlCBYiBggUEgIICCpTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24qBAgZQAE="
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/05 11:15:01 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633432500657481590/model
2021/10/05 11:15:01 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-1005100401"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633432500657481590/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633432500657481590/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-1005100401",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/05 11:15:01 Submitted job: 2021-10-05_04_15_01-1391294363501727904
2021/10/05 11:15:01 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-05_04_15_01-1391294363501727904?project=apache-beam-testing
2021/10/05 11:15:01 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-05_04_15_01-1391294363501727904
2021/10/05 11:15:01 Job state: JOB_STATE_PENDING ...
2021/10/05 11:15:31 Job still running ...
2021/10/05 11:16:01 Job still running ...
2021/10/05 11:16:32 Job still running ...
2021/10/05 11:17:02 Job still running ...
2021/10/05 11:17:32 Job still running ...
2021/10/05 11:18:02 Job still running ...
2021/10/05 11:18:32 Failed to execute job: job 2021-10-05_04_15_01-1391294363501727904 failed
panic: Failed to execute job: job 2021-10-05_04_15_01-1391294363501727904 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112f5c8, 0xc00003e0b0, 0x1020dc1, 0x19, 0xc00042fe80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 10s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/hn62kxpvy6suc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#288
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/288/display/redirect>
Changes:
------------------------------------------
[...truncated 18.46 KB...]
payload: "ChdvZmZzZXRyYW5nZS5SZXN0cmljdGlvbhJTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24atAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdEVuYxJlCBYiUwgaSk9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vcGtnL2JlYW0vaW8vcnRyYWNrZXJzL29mZnNldHJhbmdlLlJlc3RyaWN0aW9uKgYIFBICCAgqBAgZQAEitAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdERlYxJlCBYiBggUEgIICCpTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24qBAgZQAE="
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/04 11:14:46 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633346086160469416/model
2021/10/04 11:14:46 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-1004100355"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633346086160469416/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633346086160469416/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-1004100355",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/04 11:14:47 Submitted job: 2021-10-04_04_14_46-1762997541186464589
2021/10/04 11:14:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-04_04_14_46-1762997541186464589?project=apache-beam-testing
2021/10/04 11:14:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-04_04_14_46-1762997541186464589
2021/10/04 11:14:47 Job state: JOB_STATE_PENDING ...
2021/10/04 11:15:17 Job still running ...
2021/10/04 11:15:47 Job still running ...
2021/10/04 11:16:17 Job still running ...
2021/10/04 11:16:47 Job still running ...
2021/10/04 11:17:17 Job still running ...
2021/10/04 11:17:47 Job still running ...
2021/10/04 11:18:17 Failed to execute job: job 2021-10-04_04_14_46-1762997541186464589 failed
panic: Failed to execute job: job 2021-10-04_04_14_46-1762997541186464589 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112f028, 0xc00003e0b0, 0x1020a61, 0x19, 0xc000403e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 57s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/fctgjelhailom
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#287
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/287/display/redirect>
Changes:
------------------------------------------
[...truncated 18.49 KB...]
payload: "ChdvZmZzZXRyYW5nZS5SZXN0cmljdGlvbhJTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24atAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdEVuYxJlCBYiUwgaSk9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vcGtnL2JlYW0vaW8vcnRyYWNrZXJzL29mZnNldHJhbmdlLlJlc3RyaWN0aW9uKgYIFBICCAgqBAgZQAEitAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdERlYxJlCBYiBggUEgIICCpTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24qBAgZQAE="
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/03 12:24:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633263876471256709/model
2021/10/03 12:24:37 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-1003065552"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633263876471256709/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633263876471256709/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-1003065552",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/03 12:24:37 Submitted job: 2021-10-03_05_24_37-70373646255020920
2021/10/03 12:24:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-03_05_24_37-70373646255020920?project=apache-beam-testing
2021/10/03 12:24:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-03_05_24_37-70373646255020920
2021/10/03 12:24:37 Job state: JOB_STATE_PENDING ...
2021/10/03 12:25:07 Job still running ...
2021/10/03 12:25:37 Job still running ...
2021/10/03 12:26:07 Job still running ...
2021/10/03 12:26:37 Job still running ...
2021/10/03 12:27:07 Job still running ...
2021/10/03 12:27:37 Job still running ...
2021/10/03 12:28:07 Failed to execute job: job 2021-10-03_05_24_37-70373646255020920 failed
panic: Failed to execute job: job 2021-10-03_05_24_37-70373646255020920 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112f028, 0xc000120000, 0x1020a61, 0x19, 0xc0003e5e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 9s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/z3nz6dhaxdl3w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#286
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/286/display/redirect?page=changes>
Changes:
[noreply] Switching to innerText and removing alerts
[noreply] [BEAM-12993] Update to Debezium 1.7.0.Final (#15636)
[noreply] Minor: Fix `Iterable[SplitResultResidual]` type errors (#15634)
[noreply] [BEAM-11217] Implemented metrics filtering (#15482)
[noreply] [BEAM-12513] Schemas and Coders (#15632)
------------------------------------------
[...truncated 18.47 KB...]
payload: "ChdvZmZzZXRyYW5nZS5SZXN0cmljdGlvbhJTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24atAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdEVuYxJlCBYiUwgaSk9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vcGtnL2JlYW0vaW8vcnRyYWNrZXJzL29mZnNldHJhbmdlLlJlc3RyaWN0aW9uKgYIFBICCAgqBAgZQAEitAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdERlYxJlCBYiBggUEgIICCpTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24qBAgZQAE="
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/02 11:15:02 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633173302358318312/model
2021/10/02 11:15:02 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-1002100359"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633173302358318312/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633173302358318312/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-1002100359",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/02 11:15:03 Submitted job: 2021-10-02_04_15_02-9627982381726063492
2021/10/02 11:15:03 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-02_04_15_02-9627982381726063492?project=apache-beam-testing
2021/10/02 11:15:03 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-02_04_15_02-9627982381726063492
2021/10/02 11:15:03 Job state: JOB_STATE_PENDING ...
2021/10/02 11:15:33 Job still running ...
2021/10/02 11:16:03 Job still running ...
2021/10/02 11:16:33 Job still running ...
2021/10/02 11:17:03 Job still running ...
2021/10/02 11:17:33 Job still running ...
2021/10/02 11:18:03 Job still running ...
2021/10/02 11:18:33 Failed to execute job: job 2021-10-02_04_15_02-9627982381726063492 failed
panic: Failed to execute job: job 2021-10-02_04_15_02-9627982381726063492 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112f028, 0xc00003e0b0, 0x1020a61, 0x19, 0xc0004cfe80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 15s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/sis5wo3hpq2di
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#285
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/285/display/redirect?page=changes>
Changes:
[stranniknm] [BEAM-12951]: Create initial structure for Playground application
[dpcollins] [BEAM-12908] Change to use PubsubSignal for information propagation so
[Robert Bradshaw] Preserve more types in transform replacement.
[rohde.samuel] Fix BEAM-12984
[Robert Bradshaw] Update test to reflect preserved type hint.
[noreply] Update Beam glossary (#15619)
[noreply] [BEAM-11985] Python Bigtable - Implement IO Request Count metrics
[noreply] [BEAM-9918] Make TryCrossLanguage match non Try API (#15633)
[noreply] [BEAM-12957] Add support for pyarrow 5.x (#15588)
------------------------------------------
[...truncated 19.17 KB...]
key: "c6"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/01 11:14:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633086892994218664/model
2021/10/01 11:14:53 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-1001100515"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633086892994218664/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633086892994218664/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-1001100515",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/01 11:14:54 Submitted job: 2021-10-01_04_14_53-5651610954395688475
2021/10/01 11:14:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-01_04_14_53-5651610954395688475?project=apache-beam-testing
2021/10/01 11:14:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-01_04_14_53-5651610954395688475
2021/10/01 11:14:54 Job state: JOB_STATE_PENDING ...
2021/10/01 11:15:25 Job still running ...
2021/10/01 11:15:55 Job still running ...
2021/10/01 11:16:25 Job still running ...
2021/10/01 11:16:55 Job still running ...
2021/10/01 11:17:25 Job still running ...
2021/10/01 11:17:55 Job still running ...
2021/10/01 11:18:25 Job still running ...
2021/10/01 11:18:55 Job still running ...
2021/10/01 11:19:25 Job still running ...
2021/10/01 11:19:55 Job still running ...
2021/10/01 11:20:25 Job still running ...
2021/10/01 11:20:55 Failed to execute job: job 2021-10-01_04_14_53-5651610954395688475 failed
panic: Failed to execute job: job 2021-10-01_04_14_53-5651610954395688475 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112db48, 0xc00003e0b0, 0x101f761, 0x19, 0xc0003e7e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 34s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/yxa2nokrktqck
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#284
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/284/display/redirect?page=changes>
Changes:
[kileysok] Update windmill state map to resolve *IfAbsent methods immediately
[samuelw] [BEAM-12942] Validate pubsub messages before they are published in
[clairem] [BEAM-12628] make useReflectApi default to true
[noreply] [BEAM-12856] Change hard-coded limits for reading from a UnboundedReader
[piotr.szczepanik] [BEAM-12356] Fixed last non-cached usage of DatasetService in BigQuery
[noreply] [BEAM-12977] Translates Reshuffle in Portable Mode with Samza native
[noreply] [BEAM-12982] Help users debug which JvmInitializer is running and when.
------------------------------------------
[...truncated 18.53 KB...]
payload: "ChdvZmZzZXRyYW5nZS5SZXN0cmljdGlvbhJTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24atAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdEVuYxJlCBYiUwgaSk9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vcGtnL2JlYW0vaW8vcnRyYWNrZXJzL29mZnNldHJhbmdlLlJlc3RyaWN0aW9uKgYIFBICCAgqBAgZQAEitAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdERlYxJlCBYiBggUEgIICCpTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24qBAgZQAE="
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/30 11:14:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633000493164883996/model
2021/09/30 11:14:53 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0930100334"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633000493164883996/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633000493164883996/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0930100334",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/30 11:14:54 Submitted job: 2021-09-30_04_14_53-8850826655689767929
2021/09/30 11:14:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-30_04_14_53-8850826655689767929?project=apache-beam-testing
2021/09/30 11:14:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-30_04_14_53-8850826655689767929
2021/09/30 11:14:54 Job state: JOB_STATE_PENDING ...
2021/09/30 11:15:24 Job still running ...
2021/09/30 11:15:54 Job still running ...
2021/09/30 11:16:24 Job still running ...
2021/09/30 11:16:54 Job still running ...
2021/09/30 11:17:24 Job still running ...
2021/09/30 11:17:54 Job still running ...
2021/09/30 11:18:24 Failed to execute job: job 2021-09-30_04_14_53-8850826655689767929 failed
panic: Failed to execute job: job 2021-09-30_04_14_53-8850826655689767929 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112db48, 0xc00003e0b0, 0x101f761, 0x19, 0xc0005f3e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 4s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/p6ae27lyw33r6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#283
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/283/display/redirect?page=changes>
Changes:
[chamikaramj] Sets the correct coder in 'ConstantTableDestinations' when using BQ
[Luke Cwik] [BEAM-12974] Migrate off of deprecated package for MockitoJUnitRunner
[noreply] [BEAM-12593] Verify DataFrame API on pandas 1.3 (with container update)
[noreply] [BEAM-12973] Print Go Test and Script info. (#15604)
[noreply] [BEAM-10913] - Installing and persisting Grafana plugin in kubernetes
[noreply] [BEAM-11129] Add namespace and key to portable display data (#15564)
[noreply] [BEAM-12906] Add a `dataframe` extra for installing a pandas version
------------------------------------------
[...truncated 18.53 KB...]
payload: "ChdvZmZzZXRyYW5nZS5SZXN0cmljdGlvbhJTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24atAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdEVuYxJlCBYiUwgaSk9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vcGtnL2JlYW0vaW8vcnRyYWNrZXJzL29mZnNldHJhbmdlLlJlc3RyaWN0aW9uKgYIFBICCAgqBAgZQAEitAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdERlYxJlCBYiBggUEgIICCpTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24qBAgZQAE="
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/29 11:14:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632914094038901352/model
2021/09/29 11:14:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0929100345"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632914094038901352/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632914094038901352/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0929100345",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/29 11:14:55 Submitted job: 2021-09-29_04_14_54-3370104279983408672
2021/09/29 11:14:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-29_04_14_54-3370104279983408672?project=apache-beam-testing
2021/09/29 11:14:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-29_04_14_54-3370104279983408672
2021/09/29 11:14:55 Job state: JOB_STATE_PENDING ...
2021/09/29 11:15:25 Job still running ...
2021/09/29 11:15:55 Job still running ...
2021/09/29 11:16:25 Job still running ...
2021/09/29 11:16:56 Job still running ...
2021/09/29 11:17:26 Job still running ...
2021/09/29 11:17:56 Job still running ...
2021/09/29 11:18:26 Failed to execute job: job 2021-09-29_04_14_54-3370104279983408672 failed
panic: Failed to execute job: job 2021-09-29_04_14_54-3370104279983408672 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112db48, 0xc00003e0b0, 0x101f761, 0x19, 0xc000743e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 5s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/zmd6gs67mwbu4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#282
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/282/display/redirect?page=changes>
Changes:
[Andrew Pilloud] [BEAM-12691] FieldAccessDescriptor for BeamCalcRel
[aydar.zaynutdinov] Init basic go backend structure
[noreply] Update container tags used by unreleased SDKs.
[aydar.zaynutdinov] Add .gitkeep file as an exclusion
[yileiyang] Remove encoding= from the json.loads call.
[noreply] [BEAM-12798] Add configurable combiner packing limit (#15391)
[noreply] [BEAM-12926] Translates Reshuffle with Samza native repartition operator
[noreply] [BEAM-11007] Allow nbconvert 6.x (#15595)
[noreply] [BEAM-12945] Fix crashes when importing the DataFrame API with pandas
[noreply] [BEAM-12611] Capture a greater proporition of logs associated to an
------------------------------------------
[...truncated 18.64 KB...]
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e5"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/28 11:14:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632827687392583181/model
2021/09/28 11:14:47 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0928100355"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632827687392583181/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632827687392583181/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0928100355",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/28 11:14:48 Submitted job: 2021-09-28_04_14_47-477669027523843060
2021/09/28 11:14:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-28_04_14_47-477669027523843060?project=apache-beam-testing
2021/09/28 11:14:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-28_04_14_47-477669027523843060
2021/09/28 11:14:48 Job state: JOB_STATE_PENDING ...
2021/09/28 11:15:18 Job still running ...
2021/09/28 11:15:48 Job still running ...
2021/09/28 11:16:18 Job still running ...
2021/09/28 11:16:48 Job still running ...
2021/09/28 11:17:19 Job still running ...
2021/09/28 11:17:49 Job still running ...
2021/09/28 11:18:19 Job still running ...
2021/09/28 11:18:49 Failed to execute job: job 2021-09-28_04_14_47-477669027523843060 failed
panic: Failed to execute job: job 2021-09-28_04_14_47-477669027523843060 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112db48, 0xc00003e0b0, 0x101f761, 0x19, 0xc0003dfe80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 28s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/3zugapmfvy5jg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#281
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/281/display/redirect>
Changes:
------------------------------------------
[...truncated 18.50 KB...]
payload: "ChdvZmZzZXRyYW5nZS5SZXN0cmljdGlvbhJTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24atAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdEVuYxJlCBYiUwgaSk9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vcGtnL2JlYW0vaW8vcnRyYWNrZXJzL29mZnNldHJhbmdlLlJlc3RyaWN0aW9uKgYIFBICCAgqBAgZQAEitAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdERlYxJlCBYiBggUEgIICCpTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24qBAgZQAE="
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e5"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/27 11:14:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632741289101836604/model
2021/09/27 11:14:49 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0927100351"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632741289101836604/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632741289101836604/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0927100351",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/27 11:14:50 Submitted job: 2021-09-27_04_14_49-14884495899760744431
2021/09/27 11:14:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-27_04_14_49-14884495899760744431?project=apache-beam-testing
2021/09/27 11:14:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-27_04_14_49-14884495899760744431
2021/09/27 11:14:50 Job state: JOB_STATE_PENDING ...
2021/09/27 11:15:20 Job still running ...
2021/09/27 11:15:50 Job still running ...
2021/09/27 11:16:20 Job still running ...
2021/09/27 11:16:50 Job still running ...
2021/09/27 11:17:20 Job still running ...
2021/09/27 11:17:50 Job still running ...
2021/09/27 11:18:20 Failed to execute job: job 2021-09-27_04_14_49-14884495899760744431 failed
panic: Failed to execute job: job 2021-09-27_04_14_49-14884495899760744431 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112db48, 0xc000120000, 0x101f761, 0x19, 0xc00055fe80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 1s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/4hupbbx7wipai
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#280
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/280/display/redirect>
Changes:
------------------------------------------
[...truncated 18.50 KB...]
payload: "ChdvZmZzZXRyYW5nZS5SZXN0cmljdGlvbhJTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24atAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdEVuYxJlCBYiUwgaSk9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vcGtnL2JlYW0vaW8vcnRyYWNrZXJzL29mZnNldHJhbmdlLlJlc3RyaWN0aW9uKgYIFBICCAgqBAgZQAEitAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdERlYxJlCBYiBggUEgIICCpTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24qBAgZQAE="
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/26 11:14:46 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632654886349022864/model
2021/09/26 11:14:46 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0926100354"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632654886349022864/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632654886349022864/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0926100354",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/26 11:14:47 Submitted job: 2021-09-26_04_14_46-7446876943935994245
2021/09/26 11:14:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-26_04_14_46-7446876943935994245?project=apache-beam-testing
2021/09/26 11:14:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-26_04_14_46-7446876943935994245
2021/09/26 11:14:47 Job state: JOB_STATE_PENDING ...
2021/09/26 11:15:17 Job still running ...
2021/09/26 11:15:47 Job still running ...
2021/09/26 11:16:17 Job still running ...
2021/09/26 11:16:47 Job still running ...
2021/09/26 11:17:18 Job still running ...
2021/09/26 11:17:48 Job still running ...
2021/09/26 11:18:18 Failed to execute job: job 2021-09-26_04_14_46-7446876943935994245 failed
panic: Failed to execute job: job 2021-09-26_04_14_46-7446876943935994245 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112db48, 0xc000120000, 0x101f761, 0x19, 0xc00042be80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 59s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/x7gxeo5x3bc5i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#279
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/279/display/redirect?page=changes>
Changes:
[Robert Bradshaw] [BEAM-12934] Use environment capabilities to determine length prefixing.
[Brian Hulette] Add missing comma
[ryanthompson591] Update tensorflow to version 2.6.0
[zhoufek] [BEAM-9487] Fix incorrected Repeatedly.may_finish implementation
[noreply] Cleanup use of futures. (#15043)
[noreply] Go Lint fix for wordcount and metrics (#15580)
[Brian Hulette] Fix whitespace lint
[noreply] [BEAM-3304] Snippets for trigger in BPG (#15409)
[noreply] [BEAM-12832] Add Go SDK xlang info to programming guide. (#15447)
[noreply] [BEAM-11097] Add SideInputCache to StateReader (#15563)
[Robert Bradshaw] Revert "Avoid apiary submission of job graph when it is not needed.
[noreply] [BEAM-12769] Java-emulating external transform. (#15546)
[noreply] [BEAM-12913] Pass query priority from ReadAllFromBigQuery (#15584)
[noreply] [BEAM-11982] Java Spanner - Implement IO Request Count metrics (#15493)
------------------------------------------
[...truncated 18.50 KB...]
payload: "ChdvZmZzZXRyYW5nZS5SZXN0cmljdGlvbhJTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24atAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdEVuYxJlCBYiUwgaSk9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vcGtnL2JlYW0vaW8vcnRyYWNrZXJzL29mZnNldHJhbmdlLlJlc3RyaWN0aW9uKgYIFBICCAgqBAgZQAEitAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdERlYxJlCBYiBggUEgIICCpTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24qBAgZQAE="
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e5"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/25 11:14:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632568492716409390/model
2021/09/25 11:14:53 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0925100341"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632568492716409390/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632568492716409390/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0925100341",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/25 11:14:54 Submitted job: 2021-09-25_04_14_53-3779366872363563776
2021/09/25 11:14:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-25_04_14_53-3779366872363563776?project=apache-beam-testing
2021/09/25 11:14:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-25_04_14_53-3779366872363563776
2021/09/25 11:14:54 Job state: JOB_STATE_PENDING ...
2021/09/25 11:15:24 Job still running ...
2021/09/25 11:15:54 Job still running ...
2021/09/25 11:16:24 Job still running ...
2021/09/25 11:16:54 Job still running ...
2021/09/25 11:17:24 Job still running ...
2021/09/25 11:17:54 Job still running ...
2021/09/25 11:18:24 Failed to execute job: job 2021-09-25_04_14_53-3779366872363563776 failed
panic: Failed to execute job: job 2021-09-25_04_14_53-3779366872363563776 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112db48, 0xc00003e0b0, 0x101f761, 0x19, 0xc0002d3e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 5s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/fiwzxtrsr2nag
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#278
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/278/display/redirect?page=changes>
Changes:
[noreply] Avoid setting empty builders in proto setters
[Brian Hulette] Add back 'more' break
[Robert Bradshaw] Fix some website logos.
[chuck.yang] Run BigQuery queries with batch priority
[chuck.yang] Allow changing query priority in ReadFromBigQuery
[chuck.yang] Update CHANGES
[kawaigin] Implicitly watch and track anonymous pipeline and PCollections
[chamikaramj] Reject requests when parameter names cannot be validated unless
[chamikaramj] Updates error message
[alexander.chermenin] [BEAM-10822] Fixed typo in BigqueryClient
[zyichi] [BEAM-12898] Minor fix to Kubernetes.groovy postBuildScript.
[noreply] [BEAM-12869] Bump tensorflow from 2.5.0 to 2.5.1 in
[noreply] [BEAM-12946] Fix SmallestPerKey, add unit testing (#15567)
[zyichi] [BEAM-12908] Sickbay pubsublite.ReadWriteIT
[noreply] Relocate Go SDK breaking change note out of template into 2.33.0.
------------------------------------------
[...truncated 18.48 KB...]
payload: "ChdvZmZzZXRyYW5nZS5SZXN0cmljdGlvbhJTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24atAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdEVuYxJlCBYiUwgaSk9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vcGtnL2JlYW0vaW8vcnRyYWNrZXJzL29mZnNldHJhbmdlLlJlc3RyaWN0aW9uKgYIFBICCAgqBAgZQAEitAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdERlYxJlCBYiBggUEgIICCpTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24qBAgZQAE="
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/24 11:15:05 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632482104659778756/model
2021/09/24 11:15:05 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0924100407"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632482104659778756/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632482104659778756/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0924100407",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/24 11:15:08 Submitted job: 2021-09-24_04_15_05-6952245740880410203
2021/09/24 11:15:08 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-24_04_15_05-6952245740880410203?project=apache-beam-testing
2021/09/24 11:15:08 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-24_04_15_05-6952245740880410203
2021/09/24 11:15:08 Job state: JOB_STATE_PENDING ...
2021/09/24 11:15:38 Job still running ...
2021/09/24 11:16:08 Job still running ...
2021/09/24 11:16:39 Job still running ...
2021/09/24 11:17:09 Job still running ...
2021/09/24 11:17:39 Job still running ...
2021/09/24 11:18:09 Job still running ...
2021/09/24 11:18:39 Failed to execute job: job 2021-09-24_04_15_05-6952245740880410203 failed
panic: Failed to execute job: job 2021-09-24_04_15_05-6952245740880410203 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112c0a8, 0xc00003e0b0, 0x101dfa1, 0x19, 0xc000317e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 16s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/6egdy6mst6554
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#277
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/277/display/redirect?page=changes>
Changes:
[kileysok] Add MapState and SetState support
[Kyle Weaver] [BEAM-12898] Use new postbuildscript dsl in Flink load tests
[Kyle Weaver] run postbuild regardless of test result
[Kyle Weaver] spotless
[noreply] Merge pull request #15487 from [BEAM-12812] - Run Github Actions on GCP
[noreply] [BEAM-11097] Add SideInputCache to harness control type (#15530)
[kawaigin] Updated interactive integration test golden screenshots.
[noreply] Revert PR 15487 (BEAM-12812) (#15554)
[zyichi] [BEAM-12898] Trying out solution suggestion for JENKINS-66189 to solve
[noreply] [BEAM-12383] Adding Go SDK and Kafka IO to Gradle cross-language test
------------------------------------------
[...truncated 18.51 KB...]
payload: "ChdvZmZzZXRyYW5nZS5SZXN0cmljdGlvbhJTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24atAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdEVuYxJlCBYiUwgaSk9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vcGtnL2JlYW0vaW8vcnRyYWNrZXJzL29mZnNldHJhbmdlLlJlc3RyaWN0aW9uKgYIFBICCAgqBAgZQAEitAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdERlYxJlCBYiBggUEgIICCpTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24qBAgZQAE="
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/23 11:14:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632395693123392041/model
2021/09/23 11:14:53 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0923100357"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632395693123392041/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632395693123392041/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0923100357",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/23 11:14:54 Submitted job: 2021-09-23_04_14_53-10187885339219027751
2021/09/23 11:14:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-23_04_14_53-10187885339219027751?project=apache-beam-testing
2021/09/23 11:14:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-23_04_14_53-10187885339219027751
2021/09/23 11:14:54 Job state: JOB_STATE_PENDING ...
2021/09/23 11:15:24 Job still running ...
2021/09/23 11:15:54 Job still running ...
2021/09/23 11:16:24 Job still running ...
2021/09/23 11:16:54 Job still running ...
2021/09/23 11:17:24 Job still running ...
2021/09/23 11:17:54 Job still running ...
2021/09/23 11:18:25 Failed to execute job: job 2021-09-23_04_14_53-10187885339219027751 failed
panic: Failed to execute job: job 2021-09-23_04_14_53-10187885339219027751 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112c0a8, 0xc000120000, 0x101dfa1, 0x19, 0xc0003fbe80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 5s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/ja3csifg44w56
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#276
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/276/display/redirect?page=changes>
Changes:
[noreply] [BEAM-12919] Removed IBM Streams from runner matrix (#15542)
[danthev] Fix 2.32.0 release notes.
[noreply] [BEAM-12258] Re-throw exception from forked thread in
[kawaigin] [BEAM-10708] Added an example notebook for beam_sql magic
[noreply] Add a timeout for BQ streaming_insert RPCS (#15541)
[noreply] Merge pull request #15537 from [BEAM-12908] Add a sleep to the IT after
------------------------------------------
[...truncated 18.48 KB...]
payload: "ChdvZmZzZXRyYW5nZS5SZXN0cmljdGlvbhJTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24atAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdEVuYxJlCBYiUwgaSk9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vcGtnL2JlYW0vaW8vcnRyYWNrZXJzL29mZnNldHJhbmdlLlJlc3RyaWN0aW9uKgYIFBICCAgqBAgZQAEitAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdERlYxJlCBYiBggUEgIICCpTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24qBAgZQAE="
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/22 11:14:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632309289057339163/model
2021/09/22 11:14:49 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0922100355"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632309289057339163/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632309289057339163/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0922100355",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/22 11:14:50 Submitted job: 2021-09-22_04_14_49-14313715333402677014
2021/09/22 11:14:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-22_04_14_49-14313715333402677014?project=apache-beam-testing
2021/09/22 11:14:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-22_04_14_49-14313715333402677014
2021/09/22 11:14:50 Job state: JOB_STATE_PENDING ...
2021/09/22 11:15:20 Job still running ...
2021/09/22 11:15:50 Job still running ...
2021/09/22 11:16:20 Job still running ...
2021/09/22 11:16:50 Job still running ...
2021/09/22 11:17:20 Job still running ...
2021/09/22 11:17:50 Job still running ...
2021/09/22 11:18:20 Failed to execute job: job 2021-09-22_04_14_49-14313715333402677014 failed
panic: Failed to execute job: job 2021-09-22_04_14_49-14313715333402677014 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112b048, 0xc000120000, 0x101d3e1, 0x19, 0xc00044be80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 0s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/gicrxll4y7i7q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#275
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/275/display/redirect?page=changes>
Changes:
[chamikaramj] Python support for directly using Java transforms using constructor and
[chamikaramj] Fixes yapf
[chamikaramj] Fixes lint
[chamikaramj] Addressing reviewer comments
[chamikaramj] Adds support for a field name format that will be ignored at expansion
[danthev] Fix flaky test.
[danthev] Fix lint errors.
[Robert Bradshaw] Additional CoGBK tests.
[chamikaramj] Addresses reviewer comments
[chamikaramj] Use correct ignore field prefix in Python side
[noreply] [BEAM-12803] Update deprecated use of _field_types (#15539)
[Robert Bradshaw] Move CoGBK tests into appropreate module.
------------------------------------------
[...truncated 18.55 KB...]
payload: "ChdvZmZzZXRyYW5nZS5SZXN0cmljdGlvbhJTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24atAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdEVuYxJlCBYiUwgaSk9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vcGtnL2JlYW0vaW8vcnRyYWNrZXJzL29mZnNldHJhbmdlLlJlc3RyaWN0aW9uKgYIFBICCAgqBAgZQAEitAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdERlYxJlCBYiBggUEgIICCpTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24qBAgZQAE="
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/21 11:14:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632222890646740501/model
2021/09/21 11:14:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0921100339"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632222890646740501/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632222890646740501/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0921100339",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/21 11:14:51 Submitted job: 2021-09-21_04_14_51-10236767448089881857
2021/09/21 11:14:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-21_04_14_51-10236767448089881857?project=apache-beam-testing
2021/09/21 11:14:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-21_04_14_51-10236767448089881857
2021/09/21 11:14:51 Job state: JOB_STATE_PENDING ...
2021/09/21 11:15:22 Job still running ...
2021/09/21 11:15:52 Job still running ...
2021/09/21 11:16:22 Job still running ...
2021/09/21 11:16:52 Job still running ...
2021/09/21 11:17:22 Job still running ...
2021/09/21 11:17:52 Job still running ...
2021/09/21 11:18:22 Failed to execute job: job 2021-09-21_04_14_51-10236767448089881857 failed
panic: Failed to execute job: job 2021-09-21_04_14_51-10236767448089881857 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112b048, 0xc000120000, 0x101d3e1, 0x19, 0xc0005e7e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 2s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/4wepdvgrepj7q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#274
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/274/display/redirect>
Changes:
------------------------------------------
[...truncated 19.19 KB...]
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/20 11:14:55 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632136494554247875/model
2021/09/20 11:14:55 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0920100356"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632136494554247875/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632136494554247875/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0920100356",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/20 11:14:55 Submitted job: 2021-09-20_04_14_55-633473300493483655
2021/09/20 11:14:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-20_04_14_55-633473300493483655?project=apache-beam-testing
2021/09/20 11:14:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-20_04_14_55-633473300493483655
2021/09/20 11:14:55 Job state: JOB_STATE_PENDING ...
2021/09/20 11:15:26 Job still running ...
2021/09/20 11:15:56 Job still running ...
2021/09/20 11:16:26 Job still running ...
2021/09/20 11:16:56 Job still running ...
2021/09/20 11:17:26 Job still running ...
2021/09/20 11:17:56 Job still running ...
2021/09/20 11:18:26 Job still running ...
2021/09/20 11:18:56 Job still running ...
2021/09/20 11:19:26 Job still running ...
2021/09/20 11:19:56 Job still running ...
2021/09/20 11:20:26 Job still running ...
2021/09/20 11:20:56 Job still running ...
2021/09/20 11:21:26 Failed to execute job: job 2021-09-20_04_14_55-633473300493483655 failed
panic: Failed to execute job: job 2021-09-20_04_14_55-633473300493483655 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112b048, 0xc000120000, 0x101d3e1, 0x19, 0xc0005f5e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 5s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/ya7yc3doda4pc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#273
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/273/display/redirect>
Changes:
------------------------------------------
[...truncated 18.42 KB...]
payload: "ChdvZmZzZXRyYW5nZS5SZXN0cmljdGlvbhJTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24atAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdEVuYxJlCBYiUwgaSk9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vcGtnL2JlYW0vaW8vcnRyYWNrZXJzL29mZnNldHJhbmdlLlJlc3RyaWN0aW9uKgYIFBICCAgqBAgZQAEitAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdERlYxJlCBYiBggUEgIICCpTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24qBAgZQAE="
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/19 11:14:50 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632050090023392045/model
2021/09/19 11:14:50 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0919100329"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632050090023392045/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632050090023392045/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0919100329",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/19 11:14:51 Submitted job: 2021-09-19_04_14_50-10413115864790787394
2021/09/19 11:14:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-19_04_14_50-10413115864790787394?project=apache-beam-testing
2021/09/19 11:14:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-19_04_14_50-10413115864790787394
2021/09/19 11:14:51 Job state: JOB_STATE_PENDING ...
2021/09/19 11:15:21 Job still running ...
2021/09/19 11:15:51 Job still running ...
2021/09/19 11:16:21 Job still running ...
2021/09/19 11:16:51 Job still running ...
2021/09/19 11:17:21 Job still running ...
2021/09/19 11:17:51 Job still running ...
2021/09/19 11:18:21 Failed to execute job: job 2021-09-19_04_14_50-10413115864790787394 failed
panic: Failed to execute job: job 2021-09-19_04_14_50-10413115864790787394 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112b048, 0xc000120000, 0x101d3e1, 0x19, 0xc000499e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 2s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/qciddpbycnij6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#272
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/272/display/redirect?page=changes>
Changes:
[samuelw] [BEAM-12740] Add option to CreateOptions to avoid GetObjectMetadata for
[noreply] Minor: Prune docker volumes in Inventory job(#15532)
------------------------------------------
[...truncated 18.48 KB...]
payload: "ChdvZmZzZXRyYW5nZS5SZXN0cmljdGlvbhJTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24atAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdEVuYxJlCBYiUwgaSk9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vcGtnL2JlYW0vaW8vcnRyYWNrZXJzL29mZnNldHJhbmdlLlJlc3RyaWN0aW9uKgYIFBICCAgqBAgZQAEitAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdERlYxJlCBYiBggUEgIICCpTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24qBAgZQAE="
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/18 11:14:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1631963690532534001/model
2021/09/18 11:14:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0918100334"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631963690532534001/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631963690532534001/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0918100334",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/18 11:14:51 Submitted job: 2021-09-18_04_14_51-5789209218735333539
2021/09/18 11:14:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-18_04_14_51-5789209218735333539?project=apache-beam-testing
2021/09/18 11:14:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-18_04_14_51-5789209218735333539
2021/09/18 11:14:51 Job state: JOB_STATE_PENDING ...
2021/09/18 11:15:21 Job still running ...
2021/09/18 11:15:51 Job still running ...
2021/09/18 11:16:22 Job still running ...
2021/09/18 11:16:52 Job still running ...
2021/09/18 11:17:22 Job still running ...
2021/09/18 11:17:52 Job still running ...
2021/09/18 11:18:22 Failed to execute job: job 2021-09-18_04_14_51-5789209218735333539 failed
panic: Failed to execute job: job 2021-09-18_04_14_51-5789209218735333539 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112b048, 0xc000120000, 0x101d3e1, 0x19, 0xc00055de80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 2s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/pirtxibtti4v6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#271
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/271/display/redirect?page=changes>
Changes:
[randomstep] [BEAM-12899] Upgrade Gradle to version 6.9.x
[noreply] [BEAM-12701] Added extra parameter in to_csv for DeferredFrame to name
[zyichi] [BEAM-12603] Add retries to FnApiRunnerTest due to flakiness of grpc
[noreply] [BEAM-12535] add dataframes notebook (#15470)
------------------------------------------
[...truncated 18.51 KB...]
payload: "ChdvZmZzZXRyYW5nZS5SZXN0cmljdGlvbhJTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24atAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdEVuYxJlCBYiUwgaSk9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vcGtnL2JlYW0vaW8vcnRyYWNrZXJzL29mZnNldHJhbmdlLlJlc3RyaWN0aW9uKgYIFBICCAgqBAgZQAEitAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdERlYxJlCBYiBggUEgIICCpTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24qBAgZQAE="
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/17 11:14:50 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1631877289624561089/model
2021/09/17 11:14:50 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0917100358"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631877289624561089/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631877289624561089/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0917100358",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/17 11:14:50 Submitted job: 2021-09-17_04_14_50-7422762725720941137
2021/09/17 11:14:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-17_04_14_50-7422762725720941137?project=apache-beam-testing
2021/09/17 11:14:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-17_04_14_50-7422762725720941137
2021/09/17 11:14:51 Job state: JOB_STATE_PENDING ...
2021/09/17 11:15:21 Job still running ...
2021/09/17 11:15:51 Job still running ...
2021/09/17 11:16:21 Job still running ...
2021/09/17 11:16:51 Job still running ...
2021/09/17 11:17:21 Job still running ...
2021/09/17 11:17:51 Job still running ...
2021/09/17 11:18:41 Failed to execute job: job 2021-09-17_04_14_50-7422762725720941137 failed
panic: Failed to execute job: job 2021-09-17_04_14_50-7422762725720941137 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112b048, 0xc00003e0b0, 0x101d3e1, 0x19, 0xc0003f9e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 21s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/n5vzu2z245k5c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch
#270
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/270/display/redirect?page=changes>
Changes:
[noreply] [BEAM-12153] revert "implement GroupByKey with CombinePerKey with
[noreply] [BEAM-12845] Add AWS services as a runtime dependency to Spark Job
[dpcollins] [BEAM-12882] - fix test that is flaky when jenkins is overloaded
[noreply] [BEAM-12885] Enable NeedsRunner Tests for Samza Portable Runner (#15512)
[noreply] [BEAM-12100][BEAM-10379][BEAM-9514][BEAM-12647][BEAM-12099]
[noreply] [BEAM-12543] Fix DataFrrame typo (#15509)
[noreply] [BEAM-12794] Remove obsolete uses of sys.exc_info. (#15507)
[noreply] [BEAM-11666] flake on RecordingManagerTest (#15118)
[kawaigin] [BEAM-10708] Introspect beam_sql output
[noreply] Minor: Restore "Bugfix" section in CHANGES.md (#15516)
[Kyle Weaver] [BEAM-10459] Unignore numeric aggregation tests.
[ajamato] [BEAM-12898] Disable Flink Load tests which are leading Dataproc
------------------------------------------
[...truncated 22.48 KB...]
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631790889107225327/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631790889107225327/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0916100345",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/16 11:14:50 Submitted job: 2021-09-16_04_14_49-1172656732887704935
2021/09/16 11:14:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-16_04_14_49-1172656732887704935?project=apache-beam-testing
2021/09/16 11:14:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-16_04_14_49-1172656732887704935
2021/09/16 11:14:50 Job state: JOB_STATE_PENDING ...
2021/09/16 11:15:20 Job still running ...
2021/09/16 11:15:50 Job still running ...
2021/09/16 11:16:20 Job still running ...
2021/09/16 11:16:50 Job still running ...
2021/09/16 11:17:20 Job still running ...
2021/09/16 11:17:50 Job still running ...
2021/09/16 11:18:20 Job still running ...
2021/09/16 11:18:50 Job still running ...
2021/09/16 11:19:20 Job still running ...
2021/09/16 11:19:50 Job still running ...
2021/09/16 11:20:21 Job still running ...
2021/09/16 11:20:51 Job still running ...
2021/09/16 11:21:21 Job still running ...
2021/09/16 11:21:51 Job still running ...
2021/09/16 11:22:21 Job still running ...
2021/09/16 11:22:51 Job still running ...
2021/09/16 11:23:21 Job still running ...
2021/09/16 11:23:51 Job still running ...
2021/09/16 11:24:21 Job still running ...
2021/09/16 11:24:51 Job still running ...
2021/09/16 11:25:21 Job still running ...
2021/09/16 11:25:51 Job still running ...
2021/09/16 11:26:21 Job still running ...
2021/09/16 11:26:51 Job still running ...
2021/09/16 11:27:22 Job still running ...
2021/09/16 11:27:52 Job still running ...
2021/09/16 11:28:22 Job still running ...
2021/09/16 11:28:52 Job still running ...
2021/09/16 11:29:22 Job still running ...
2021/09/16 11:29:52 Job still running ...
2021/09/16 11:30:22 Job still running ...
2021/09/16 11:30:52 Job still running ...
2021/09/16 11:31:22 Job still running ...
2021/09/16 11:31:52 Job still running ...
2021/09/16 11:32:22 Job still running ...
2021/09/16 11:32:52 Job still running ...
2021/09/16 11:33:22 Job still running ...
2021/09/16 11:33:53 Job still running ...
2021/09/16 11:34:23 Job still running ...
2021/09/16 11:34:53 Job still running ...
2021/09/16 11:35:23 Job still running ...
2021/09/16 11:35:53 Job still running ...
2021/09/16 11:36:23 Job still running ...
2021/09/16 11:36:53 Job still running ...
2021/09/16 11:37:23 Job still running ...
2021/09/16 11:37:53 Job still running ...
2021/09/16 11:38:23 Job still running ...
2021/09/16 11:38:54 Job still running ...
2021/09/16 11:39:24 Job still running ...
2021/09/16 11:39:54 Job still running ...
2021/09/16 11:40:24 Job still running ...
2021/09/16 11:40:54 Job still running ...
2021/09/16 11:41:24 Job still running ...
2021/09/16 11:41:54 Job still running ...
2021/09/16 11:42:24 Job still running ...
2021/09/16 11:42:54 Job still running ...
2021/09/16 11:43:24 Job still running ...
2021/09/16 11:43:54 Job still running ...
2021/09/16 11:44:24 Job still running ...
2021/09/16 11:44:54 Job still running ...
2021/09/16 11:45:24 Job still running ...
2021/09/16 11:45:54 Job still running ...
2021/09/16 11:46:24 Job still running ...
2021/09/16 11:46:54 Job still running ...
2021/09/16 11:47:24 Job still running ...
2021/09/16 11:47:55 Job still running ...
2021/09/16 11:48:25 Job still running ...
2021/09/16 11:48:55 Job still running ...
2021/09/16 11:49:25 Job still running ...
2021/09/16 11:49:55 Job still running ...
2021/09/16 11:50:25 Job still running ...
2021/09/16 11:50:55 Job still running ...
2021/09/16 11:51:25 Job still running ...
2021/09/16 11:51:55 Job still running ...
2021/09/16 11:52:25 Job still running ...
2021/09/16 11:52:55 Job still running ...
2021/09/16 11:53:25 Job still running ...
2021/09/16 11:53:55 Job still running ...
2021/09/16 11:54:25 Job still running ...
2021/09/16 11:54:55 Job still running ...
2021/09/16 11:55:25 Job still running ...
2021/09/16 11:55:55 Job still running ...
2021/09/16 11:56:25 Job still running ...
2021/09/16 11:56:55 Job still running ...
2021/09/16 11:57:25 Job still running ...
2021/09/16 11:57:55 Job still running ...
2021/09/16 11:58:25 Job still running ...
2021/09/16 11:58:55 Job still running ...
2021/09/16 11:59:25 Job still running ...
2021/09/16 11:59:55 Job still running ...
2021/09/16 12:00:26 Job still running ...
2021/09/16 12:00:56 Job still running ...
2021/09/16 12:01:26 Job still running ...
2021/09/16 12:01:56 Job still running ...
2021/09/16 12:02:26 Job still running ...
2021/09/16 12:02:56 Job still running ...
2021/09/16 12:03:26 Job still running ...
2021/09/16 12:03:56 Job still running ...
2021/09/16 12:04:26 Job still running ...
2021/09/16 12:04:56 Job still running ...
2021/09/16 12:05:26 Job still running ...
2021/09/16 12:05:56 Job still running ...
2021/09/16 12:06:26 Job still running ...
2021/09/16 12:06:56 Job still running ...
2021/09/16 12:07:26 Job still running ...
2021/09/16 12:07:57 Job still running ...
2021/09/16 12:08:27 Job still running ...
2021/09/16 12:08:57 Job still running ...
2021/09/16 12:09:27 Job still running ...
2021/09/16 12:09:57 Job still running ...
2021/09/16 12:10:27 Job still running ...
2021/09/16 12:10:57 Job still running ...
2021/09/16 12:11:27 Job still running ...
2021/09/16 12:11:57 Job still running ...
2021/09/16 12:12:27 Job still running ...
2021/09/16 12:12:57 Job still running ...
2021/09/16 12:13:27 Job still running ...
2021/09/16 12:13:57 Job still running ...
2021/09/16 12:14:27 Job still running ...
2021/09/16 12:14:57 Job still running ...
2021/09/16 12:15:27 Job still running ...
2021/09/16 12:15:58 Job still running ...
2021/09/16 12:16:28 Job still running ...
2021/09/16 12:16:58 Job still running ...
2021/09/16 12:17:28 Job still running ...
2021/09/16 12:17:58 Job still running ...
2021/09/16 12:18:28 Failed to execute job: job 2021-09-16_04_14_49-1172656732887704935 failed
panic: Failed to execute job: job 2021-09-16_04_14_49-1172656732887704935 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112b048, 0xc000120000, 0x101d3e1, 0x19, 0xc0000f3e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 4m 7s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/mtumeauymbcqy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org