You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/05/03 10:19:42 UTC
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #499
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/499/display/redirect?page=changes>
Changes:
[yathu] [BEAM-14375] Fix Java Wordcount Dataflow postcommit
[Robert Bradshaw] Allow arithmetic between deferred scalars.
[noreply] [BEAM-14390] Set user-agent when pulling licenses to avoid 403s (#17521)
[noreply] [BEAM-8688] Upgrade GCSIO to 2.2.6 (#17486)
[noreply] [BEAM-14253] patch SubscriptionPartitionLoader to work around a dataflow
[noreply] Add website link log to notify user of pre-build workflow. (#17498)
[noreply] [BEAM-11105] Add timestamp observing watermark estimation (#17476)
[noreply] Merge pull request #17487 from Adding user-agent to GCS client in Python
[noreply] [BEAM-10265] Display error message if trying to infer recursive schema
[noreply] [BEAM-12575] Upgraded ipykernel from v5 to v6 (#17526)
[noreply] [BEAM-11105] Add docs + CHANGES.md entry for Go Watermark Estimation
[noreply] Merge pull request #17380 from [BEAM-14314][BEAM-9532] Add last_updated
------------------------------------------
[...truncated 17.71 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651572878913216548/****\022@d3274d4a0ed4ad37465faa13319515ddde5ba80f38ba7bf56e0bf6ca45f03ffb"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/03 10:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651572878913216548/model
2022/05/03 10:14:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0428110920"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651572878913216548/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651572878913216548/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0428110920",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/05/03 10:14:40 Submitted job: 2022-05-03_03_14_39-5735440478104037852
2022/05/03 10:14:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-03_03_14_39-5735440478104037852?project=apache-beam-testing
2022/05/03 10:14:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-03_03_14_39-5735440478104037852
2022/05/03 10:14:40 Job state: JOB_STATE_PENDING ...
2022/05/03 10:15:10 Job still running ...
2022/05/03 10:15:40 Job still running ...
2022/05/03 10:16:10 Job still running ...
2022/05/03 10:16:40 Job still running ...
2022/05/03 10:17:10 Job still running ...
2022/05/03 10:17:40 Job still running ...
2022/05/03 10:18:10 Job still running ...
2022/05/03 10:18:40 Job still running ...
2022/05/03 10:19:10 Job still running ...
2022/05/03 10:19:40 Failed to execute job: job 2022-05-03_03_14_39-5735440478104037852 failed
panic: Failed to execute job: job 2022-05-03_03_14_39-5735440478104037852 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x122e048, 0xc0000480c0, 0x110b251, 0x19, 0xc00033fe78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/5wmhztp64b2ta
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_LoadTests_Go_GBK_Dataflow_Batch #503
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/503/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #502
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/502/display/redirect?page=changes>
Changes:
[zyichi] Move master readme.md to 2.40.0
[noreply] [BEAM-14173] Fix Go Loadtests on Dataflow & partial fix for Flink
------------------------------------------
[...truncated 17.87 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.40.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651770359940525884/****\022@d5e3302be53953788970a45089f4c84e179c393666cc6a221e16c83b8609a7ea"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/05 17:06:00 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651770359940525884/model
2022/05/05 17:06:00 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0505150310"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.40.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651770359940525884/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.40.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651770359940525884/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.40.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.40.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0505150310",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/05/05 17:06:01 Submitted job: 2022-05-05_10_06_00-5280983618146128895
2022/05/05 17:06:01 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-05_10_06_00-5280983618146128895?project=apache-beam-testing
2022/05/05 17:06:01 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-05_10_06_00-5280983618146128895
2022/05/05 17:06:01 Job state: JOB_STATE_PENDING ...
2022/05/05 17:06:31 Job still running ...
2022/05/05 17:07:01 Job still running ...
2022/05/05 17:07:31 Job still running ...
2022/05/05 17:08:01 Job still running ...
2022/05/05 17:08:31 Job still running ...
2022/05/05 17:09:01 Job still running ...
2022/05/05 17:09:31 Job still running ...
2022/05/05 17:10:01 Job still running ...
2022/05/05 17:10:31 Job still running ...
2022/05/05 17:11:01 Failed to execute job: job 2022-05-05_10_06_00-5280983618146128895 failed
panic: Failed to execute job: job 2022-05-05_10_06_00-5280983618146128895 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1231ac8, 0xc000120000, 0x110e7c4, 0x19, 0xc000445e78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 20s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/7dzf33qxlt6um
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #501
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/501/display/redirect?page=changes>
Changes:
[Heejong Lee] [BEAM-9245] Unable to pull datatore Entity which contains dict
[bulat.safiullin] [BEAM-14382] [Website] add banner container for with css, images, html
[Jan Lukavský] [BEAM-14196] add test verifying output watermark propagation in bundle
[Jan Lukavský] [BEAM-14196] Fix FlinkRunner mid-bundle output watermark handling
[nielm] [BEAM-14405] Fix NPE when ProjectID is not specified in a template
[bulat.safiullin] [BEAM-14382] change mobile banner img, add padding to banner section
[ahmedabualsaud] fix test decotrator typo
[noreply] Merge pull request #17440 from [BEAM-14329] Enable exponential backoff
[noreply] [BEAM-11104] Fix output forwarding issue for ProcessContinuations
[noreply] re-add testing package to pydoc (#17524)
[Heejong Lee] add test
[noreply] [BEAM-14250] Amended the workaround (#17531)
[noreply] [BEAM-11104] Fix broken split result validation (#17546)
[noreply] Fixed a SQL and screenshots in the Beam SQL blog (#17545)
[noreply] Merge pull request #17417: [BEAM-14388] Address some performance
[noreply] [BEAM-14386] [Flink] Support for scala 2.12 (#17512)
[noreply] [BEAM-14294] Worker changes to support trivial Batched DoFns (#17384)
[zyichi] Moving to 2.40.0-SNAPSHOT on master branch.
[noreply] [BEAM-14048] [CdapIO] Add ConfigWrapper for building CDAP PluginConfigs
------------------------------------------
[...truncated 17.66 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.40.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651745682185912279/****\022@69432aee790707f01f5db56364a6c14676b5f0a8d05487850b8dad0ff4e3e4ce"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/05 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651745682185912279/model
2022/05/05 10:14:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0505100250"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.40.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651745682185912279/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.40.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651745682185912279/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.40.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.40.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0505100250",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/05/05 10:14:43 Submitted job: 2022-05-05_03_14_43-4748960088116013041
2022/05/05 10:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-05_03_14_43-4748960088116013041?project=apache-beam-testing
2022/05/05 10:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-05_03_14_43-4748960088116013041
2022/05/05 10:14:43 Job state: JOB_STATE_PENDING ...
2022/05/05 10:15:13 Job still running ...
2022/05/05 10:15:43 Job still running ...
2022/05/05 10:16:13 Job still running ...
2022/05/05 10:16:43 Job still running ...
2022/05/05 10:17:13 Job still running ...
2022/05/05 10:17:43 Failed to execute job: job 2022-05-05_03_14_43-4748960088116013041 failed
panic: Failed to execute job: job 2022-05-05_03_14_43-4748960088116013041 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1231a68, 0xc000120000, 0x110e764, 0x19, 0xc00040fe78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 20s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/am77tcufz7a4e
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #500
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/500/display/redirect?page=changes>
Changes:
[noreply] fix: JDBC config schema fields order
[Brian Hulette] Revert "Merge pull request #17255 from kileys/test-revert"
[Brian Hulette] BEAM-14231: bypass schema cache for
[noreply] [BEAM-13657] Follow up update version warning in __init__ (#17493)
[noreply] Merge pull request #17431 from [BEAM-14273] Add integration tests for BQ
[noreply] Merge pull request #17205 from [BEAM-14145] [Website] add carousel to
[noreply] [BEAM-14064] fix es io windowing (#17112)
[noreply] [BEAM-13670] Upgraded ipython from v7 to v8 (#17529)
[noreply] [BEAM-11104] Enable ProcessContinuation return values, add unit test
[Robert Bradshaw] [BEAM-14403] Allow Prime to be used with legacy workers.
[noreply] [BEAM-11106] Support drain in Go SDK (#17432)
[noreply] add __Init__ to inference. (#17514)
------------------------------------------
[...truncated 17.64 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651659279750722512/****\022@d766422b0dc71d2a087cb20896017c6b19fac3763be4352964a8ac35fbeaf558"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/04 10:14:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651659279750722512/model
2022/05/04 10:14:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0428110920"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651659279750722512/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651659279750722512/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0428110920",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/05/04 10:14:41 Submitted job: 2022-05-04_03_14_40-10883133014636012091
2022/05/04 10:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-04_03_14_40-10883133014636012091?project=apache-beam-testing
2022/05/04 10:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-04_03_14_40-10883133014636012091
2022/05/04 10:14:41 Job state: JOB_STATE_PENDING ...
2022/05/04 10:15:11 Job still running ...
2022/05/04 10:15:41 Job still running ...
2022/05/04 10:16:11 Job still running ...
2022/05/04 10:16:41 Job still running ...
2022/05/04 10:17:11 Job still running ...
2022/05/04 10:17:41 Job still running ...
2022/05/04 10:18:11 Job still running ...
2022/05/04 10:18:41 Job still running ...
2022/05/04 10:19:11 Job still running ...
2022/05/04 10:19:42 Failed to execute job: job 2022-05-04_03_14_40-10883133014636012091 failed
panic: Failed to execute job: job 2022-05-04_03_14_40-10883133014636012091 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1231a68, 0xc000120000, 0x110e764, 0x19, 0xc00087fe78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/nojhwy2wmgvce
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org