You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/09/10 11:18:11 UTC
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #266
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/266/display/redirect?page=changes>
Changes:
[ruwan.lambrichts] Clarify additional_bq_parameters argument
[kawaigin] [BEAM-10708] Support streaming cache in beam_sql magic
[noreply] Fix broken 'differences from pandas' link
[noreply] Added GroupBy row in Aggregation table.
[Luke Cwik] [BEAM-12769] Fix typo in test class name, CLass -> Class
[Etienne Chauchot] [BEAM-5172] Temporary ignore testSplit and testSizes tests waiting for a
[samuelw] [BEAM-12740] Remove matching to filter files when renaming gcs files in
[noreply] [BEAM-3304] Helper functions for triggers (#15430)
[esert] Bump a throttling counter on BigQueryRead retries due to
[noreply] [BEAM-5097] Increment counter for "small words" in go SDK example
------------------------------------------
[...truncated 22.06 KB...]
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631268895535188693/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631268895535188693/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0910100247",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/10 10:14:57 Submitted job: 2021-09-10_03_14_56-1668469640378762026
2021/09/10 10:14:57 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-10_03_14_56-1668469640378762026?project=apache-beam-testing
2021/09/10 10:14:57 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-10_03_14_56-1668469640378762026
2021/09/10 10:14:57 Job state: JOB_STATE_PENDING ...
2021/09/10 10:15:27 Job still running ...
2021/09/10 10:15:57 Job still running ...
2021/09/10 10:16:27 Job still running ...
2021/09/10 10:16:57 Job still running ...
2021/09/10 10:17:27 Job still running ...
2021/09/10 10:17:57 Job still running ...
2021/09/10 10:18:27 Job still running ...
2021/09/10 10:18:57 Job still running ...
2021/09/10 10:19:27 Job still running ...
2021/09/10 10:19:57 Job still running ...
2021/09/10 10:20:27 Job still running ...
2021/09/10 10:20:57 Job still running ...
2021/09/10 10:21:27 Job still running ...
2021/09/10 10:21:57 Job still running ...
2021/09/10 10:22:27 Job still running ...
2021/09/10 10:22:57 Job still running ...
2021/09/10 10:23:27 Job still running ...
2021/09/10 10:23:57 Job still running ...
2021/09/10 10:24:27 Job still running ...
2021/09/10 10:24:57 Job still running ...
2021/09/10 10:25:27 Job still running ...
2021/09/10 10:25:58 Job still running ...
2021/09/10 10:26:28 Job still running ...
2021/09/10 10:26:58 Job still running ...
2021/09/10 10:27:28 Job still running ...
2021/09/10 10:27:58 Job still running ...
2021/09/10 10:28:28 Job still running ...
2021/09/10 10:28:58 Job still running ...
2021/09/10 10:29:28 Job still running ...
2021/09/10 10:29:58 Job still running ...
2021/09/10 10:30:28 Job still running ...
2021/09/10 10:30:58 Job still running ...
2021/09/10 10:31:29 Job still running ...
2021/09/10 10:31:59 Job still running ...
2021/09/10 10:32:29 Job still running ...
2021/09/10 10:32:59 Job still running ...
2021/09/10 10:33:29 Job still running ...
2021/09/10 10:33:59 Job still running ...
2021/09/10 10:34:29 Job still running ...
2021/09/10 10:34:59 Job still running ...
2021/09/10 10:35:29 Job still running ...
2021/09/10 10:35:59 Job still running ...
2021/09/10 10:36:29 Job still running ...
2021/09/10 10:36:59 Job still running ...
2021/09/10 10:37:29 Job still running ...
2021/09/10 10:37:59 Job still running ...
2021/09/10 10:38:29 Job still running ...
2021/09/10 10:38:59 Job still running ...
2021/09/10 10:39:30 Job still running ...
2021/09/10 10:40:00 Job still running ...
2021/09/10 10:40:30 Job still running ...
2021/09/10 10:41:00 Job still running ...
2021/09/10 10:41:30 Job still running ...
2021/09/10 10:42:00 Job still running ...
2021/09/10 10:42:30 Job still running ...
2021/09/10 10:43:00 Job still running ...
2021/09/10 10:43:30 Job still running ...
2021/09/10 10:44:01 Job still running ...
2021/09/10 10:44:31 Job still running ...
2021/09/10 10:45:01 Job still running ...
2021/09/10 10:45:31 Job still running ...
2021/09/10 10:46:01 Job still running ...
2021/09/10 10:46:31 Job still running ...
2021/09/10 10:47:01 Job still running ...
2021/09/10 10:47:31 Job still running ...
2021/09/10 10:48:01 Job still running ...
2021/09/10 10:48:31 Job still running ...
2021/09/10 10:49:01 Job still running ...
2021/09/10 10:49:31 Job still running ...
2021/09/10 10:50:02 Job still running ...
2021/09/10 10:50:32 Job still running ...
2021/09/10 10:51:02 Job still running ...
2021/09/10 10:51:32 Job still running ...
2021/09/10 10:52:02 Job still running ...
2021/09/10 10:52:32 Job still running ...
2021/09/10 10:53:02 Job still running ...
2021/09/10 10:53:32 Job still running ...
2021/09/10 10:54:02 Job still running ...
2021/09/10 10:54:32 Job still running ...
2021/09/10 10:55:02 Job still running ...
2021/09/10 10:55:32 Job still running ...
2021/09/10 10:56:03 Job still running ...
2021/09/10 10:56:33 Job still running ...
2021/09/10 10:57:03 Job still running ...
2021/09/10 10:57:33 Job still running ...
2021/09/10 10:58:03 Job still running ...
2021/09/10 10:58:33 Job still running ...
2021/09/10 10:59:03 Job still running ...
2021/09/10 10:59:33 Job still running ...
2021/09/10 11:00:03 Job still running ...
2021/09/10 11:00:33 Job still running ...
2021/09/10 11:01:03 Job still running ...
2021/09/10 11:01:33 Job still running ...
2021/09/10 11:02:03 Job still running ...
2021/09/10 11:02:33 Job still running ...
2021/09/10 11:03:03 Job still running ...
2021/09/10 11:03:34 Job still running ...
2021/09/10 11:04:04 Job still running ...
2021/09/10 11:04:34 Job still running ...
2021/09/10 11:05:04 Job still running ...
2021/09/10 11:05:34 Job still running ...
2021/09/10 11:06:04 Job still running ...
2021/09/10 11:06:34 Job still running ...
2021/09/10 11:07:04 Job still running ...
2021/09/10 11:07:34 Job still running ...
2021/09/10 11:08:04 Job still running ...
2021/09/10 11:08:35 Job still running ...
2021/09/10 11:09:05 Job still running ...
2021/09/10 11:09:35 Job still running ...
2021/09/10 11:10:05 Job still running ...
2021/09/10 11:10:35 Job still running ...
2021/09/10 11:11:05 Job still running ...
2021/09/10 11:11:35 Job still running ...
2021/09/10 11:12:06 Job still running ...
2021/09/10 11:12:36 Job still running ...
2021/09/10 11:13:06 Job still running ...
2021/09/10 11:13:36 Job still running ...
2021/09/10 11:14:06 Job still running ...
2021/09/10 11:14:36 Job still running ...
2021/09/10 11:15:06 Job still running ...
2021/09/10 11:15:36 Job still running ...
2021/09/10 11:16:06 Job still running ...
2021/09/10 11:16:36 Job still running ...
2021/09/10 11:17:06 Job still running ...
2021/09/10 11:17:37 Job still running ...
2021/09/10 11:18:07 Failed to execute job: job 2021-09-10_03_14_56-1668469640378762026 failed
panic: Failed to execute job: job 2021-09-10_03_14_56-1668469640378762026 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112af68, 0xc00003e0b0, 0x101d16b, 0x19, 0xc000407e90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 3m 45s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/4iru55vupqyfg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_LoadTests_Go_GBK_Dataflow_Batch #503
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/503/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #502
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/502/display/redirect?page=changes>
Changes:
[zyichi] Move master readme.md to 2.40.0
[noreply] [BEAM-14173] Fix Go Loadtests on Dataflow & partial fix for Flink
------------------------------------------
[...truncated 17.87 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.40.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651770359940525884/****\022@d5e3302be53953788970a45089f4c84e179c393666cc6a221e16c83b8609a7ea"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/05 17:06:00 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651770359940525884/model
2022/05/05 17:06:00 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0505150310"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.40.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651770359940525884/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.40.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651770359940525884/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.40.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.40.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0505150310",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/05/05 17:06:01 Submitted job: 2022-05-05_10_06_00-5280983618146128895
2022/05/05 17:06:01 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-05_10_06_00-5280983618146128895?project=apache-beam-testing
2022/05/05 17:06:01 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-05_10_06_00-5280983618146128895
2022/05/05 17:06:01 Job state: JOB_STATE_PENDING ...
2022/05/05 17:06:31 Job still running ...
2022/05/05 17:07:01 Job still running ...
2022/05/05 17:07:31 Job still running ...
2022/05/05 17:08:01 Job still running ...
2022/05/05 17:08:31 Job still running ...
2022/05/05 17:09:01 Job still running ...
2022/05/05 17:09:31 Job still running ...
2022/05/05 17:10:01 Job still running ...
2022/05/05 17:10:31 Job still running ...
2022/05/05 17:11:01 Failed to execute job: job 2022-05-05_10_06_00-5280983618146128895 failed
panic: Failed to execute job: job 2022-05-05_10_06_00-5280983618146128895 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1231ac8, 0xc000120000, 0x110e7c4, 0x19, 0xc000445e78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 20s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/7dzf33qxlt6um
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #501
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/501/display/redirect?page=changes>
Changes:
[Heejong Lee] [BEAM-9245] Unable to pull datatore Entity which contains dict
[bulat.safiullin] [BEAM-14382] [Website] add banner container for with css, images, html
[Jan Lukavský] [BEAM-14196] add test verifying output watermark propagation in bundle
[Jan Lukavský] [BEAM-14196] Fix FlinkRunner mid-bundle output watermark handling
[nielm] [BEAM-14405] Fix NPE when ProjectID is not specified in a template
[bulat.safiullin] [BEAM-14382] change mobile banner img, add padding to banner section
[ahmedabualsaud] fix test decotrator typo
[noreply] Merge pull request #17440 from [BEAM-14329] Enable exponential backoff
[noreply] [BEAM-11104] Fix output forwarding issue for ProcessContinuations
[noreply] re-add testing package to pydoc (#17524)
[Heejong Lee] add test
[noreply] [BEAM-14250] Amended the workaround (#17531)
[noreply] [BEAM-11104] Fix broken split result validation (#17546)
[noreply] Fixed a SQL and screenshots in the Beam SQL blog (#17545)
[noreply] Merge pull request #17417: [BEAM-14388] Address some performance
[noreply] [BEAM-14386] [Flink] Support for scala 2.12 (#17512)
[noreply] [BEAM-14294] Worker changes to support trivial Batched DoFns (#17384)
[zyichi] Moving to 2.40.0-SNAPSHOT on master branch.
[noreply] [BEAM-14048] [CdapIO] Add ConfigWrapper for building CDAP PluginConfigs
------------------------------------------
[...truncated 17.66 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.40.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651745682185912279/****\022@69432aee790707f01f5db56364a6c14676b5f0a8d05487850b8dad0ff4e3e4ce"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/05 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651745682185912279/model
2022/05/05 10:14:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0505100250"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.40.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651745682185912279/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.40.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651745682185912279/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.40.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.40.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0505100250",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/05/05 10:14:43 Submitted job: 2022-05-05_03_14_43-4748960088116013041
2022/05/05 10:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-05_03_14_43-4748960088116013041?project=apache-beam-testing
2022/05/05 10:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-05_03_14_43-4748960088116013041
2022/05/05 10:14:43 Job state: JOB_STATE_PENDING ...
2022/05/05 10:15:13 Job still running ...
2022/05/05 10:15:43 Job still running ...
2022/05/05 10:16:13 Job still running ...
2022/05/05 10:16:43 Job still running ...
2022/05/05 10:17:13 Job still running ...
2022/05/05 10:17:43 Failed to execute job: job 2022-05-05_03_14_43-4748960088116013041 failed
panic: Failed to execute job: job 2022-05-05_03_14_43-4748960088116013041 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1231a68, 0xc000120000, 0x110e764, 0x19, 0xc00040fe78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 20s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/am77tcufz7a4e
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #500
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/500/display/redirect?page=changes>
Changes:
[noreply] fix: JDBC config schema fields order
[Brian Hulette] Revert "Merge pull request #17255 from kileys/test-revert"
[Brian Hulette] BEAM-14231: bypass schema cache for
[noreply] [BEAM-13657] Follow up update version warning in __init__ (#17493)
[noreply] Merge pull request #17431 from [BEAM-14273] Add integration tests for BQ
[noreply] Merge pull request #17205 from [BEAM-14145] [Website] add carousel to
[noreply] [BEAM-14064] fix es io windowing (#17112)
[noreply] [BEAM-13670] Upgraded ipython from v7 to v8 (#17529)
[noreply] [BEAM-11104] Enable ProcessContinuation return values, add unit test
[Robert Bradshaw] [BEAM-14403] Allow Prime to be used with legacy workers.
[noreply] [BEAM-11106] Support drain in Go SDK (#17432)
[noreply] add __Init__ to inference. (#17514)
------------------------------------------
[...truncated 17.64 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651659279750722512/****\022@d766422b0dc71d2a087cb20896017c6b19fac3763be4352964a8ac35fbeaf558"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/04 10:14:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651659279750722512/model
2022/05/04 10:14:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0428110920"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651659279750722512/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651659279750722512/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0428110920",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/05/04 10:14:41 Submitted job: 2022-05-04_03_14_40-10883133014636012091
2022/05/04 10:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-04_03_14_40-10883133014636012091?project=apache-beam-testing
2022/05/04 10:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-04_03_14_40-10883133014636012091
2022/05/04 10:14:41 Job state: JOB_STATE_PENDING ...
2022/05/04 10:15:11 Job still running ...
2022/05/04 10:15:41 Job still running ...
2022/05/04 10:16:11 Job still running ...
2022/05/04 10:16:41 Job still running ...
2022/05/04 10:17:11 Job still running ...
2022/05/04 10:17:41 Job still running ...
2022/05/04 10:18:11 Job still running ...
2022/05/04 10:18:41 Job still running ...
2022/05/04 10:19:11 Job still running ...
2022/05/04 10:19:42 Failed to execute job: job 2022-05-04_03_14_40-10883133014636012091 failed
panic: Failed to execute job: job 2022-05-04_03_14_40-10883133014636012091 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1231a68, 0xc000120000, 0x110e764, 0x19, 0xc00087fe78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/nojhwy2wmgvce
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #499
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/499/display/redirect?page=changes>
Changes:
[yathu] [BEAM-14375] Fix Java Wordcount Dataflow postcommit
[Robert Bradshaw] Allow arithmetic between deferred scalars.
[noreply] [BEAM-14390] Set user-agent when pulling licenses to avoid 403s (#17521)
[noreply] [BEAM-8688] Upgrade GCSIO to 2.2.6 (#17486)
[noreply] [BEAM-14253] patch SubscriptionPartitionLoader to work around a dataflow
[noreply] Add website link log to notify user of pre-build workflow. (#17498)
[noreply] [BEAM-11105] Add timestamp observing watermark estimation (#17476)
[noreply] Merge pull request #17487 from Adding user-agent to GCS client in Python
[noreply] [BEAM-10265] Display error message if trying to infer recursive schema
[noreply] [BEAM-12575] Upgraded ipykernel from v5 to v6 (#17526)
[noreply] [BEAM-11105] Add docs + CHANGES.md entry for Go Watermark Estimation
[noreply] Merge pull request #17380 from [BEAM-14314][BEAM-9532] Add last_updated
------------------------------------------
[...truncated 17.71 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651572878913216548/****\022@d3274d4a0ed4ad37465faa13319515ddde5ba80f38ba7bf56e0bf6ca45f03ffb"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/03 10:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651572878913216548/model
2022/05/03 10:14:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0428110920"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651572878913216548/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651572878913216548/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0428110920",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/05/03 10:14:40 Submitted job: 2022-05-03_03_14_39-5735440478104037852
2022/05/03 10:14:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-03_03_14_39-5735440478104037852?project=apache-beam-testing
2022/05/03 10:14:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-03_03_14_39-5735440478104037852
2022/05/03 10:14:40 Job state: JOB_STATE_PENDING ...
2022/05/03 10:15:10 Job still running ...
2022/05/03 10:15:40 Job still running ...
2022/05/03 10:16:10 Job still running ...
2022/05/03 10:16:40 Job still running ...
2022/05/03 10:17:10 Job still running ...
2022/05/03 10:17:40 Job still running ...
2022/05/03 10:18:10 Job still running ...
2022/05/03 10:18:40 Job still running ...
2022/05/03 10:19:10 Job still running ...
2022/05/03 10:19:40 Failed to execute job: job 2022-05-03_03_14_39-5735440478104037852 failed
panic: Failed to execute job: job 2022-05-03_03_14_39-5735440478104037852 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x122e048, 0xc0000480c0, 0x110b251, 0x19, 0xc00033fe78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/5wmhztp64b2ta
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #498
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/498/display/redirect?page=changes>
Changes:
[noreply] [BEAM-11105] Add manual watermark estimation (#17475)
------------------------------------------
[...truncated 17.57 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651486471958308263/****\022@8e1b4e734558eb3232ce336c1248294e83431eaa80a62b1107910de9ac24cdb2"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/02 10:14:32 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651486471958308263/model
2022/05/02 10:14:32 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0428110920"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651486471958308263/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651486471958308263/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0428110920",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/05/02 10:14:33 Submitted job: 2022-05-02_03_14_32-6512839335185940481
2022/05/02 10:14:33 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-02_03_14_32-6512839335185940481?project=apache-beam-testing
2022/05/02 10:14:33 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-02_03_14_32-6512839335185940481
2022/05/02 10:14:33 Job state: JOB_STATE_PENDING ...
2022/05/02 10:15:03 Job still running ...
2022/05/02 10:15:33 Job still running ...
2022/05/02 10:16:03 Job still running ...
2022/05/02 10:16:33 Job still running ...
2022/05/02 10:17:03 Job still running ...
2022/05/02 10:17:33 Job still running ...
2022/05/02 10:18:03 Job still running ...
2022/05/02 10:18:34 Job still running ...
2022/05/02 10:19:04 Job still running ...
2022/05/02 10:19:34 Failed to execute job: job 2022-05-02_03_14_32-6512839335185940481 failed
panic: Failed to execute job: job 2022-05-02_03_14_32-6512839335185940481 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x120a8a8, 0xc0000480c0, 0x10e7eee, 0x19, 0xc0003ffe78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 12s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/a27yok7kxo44c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #497
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/497/display/redirect?page=changes>
Changes:
[noreply] Revert "Improvement to Seed job configuration to launch against PRs
[ilion.beyst] Minor: fix typo
[noreply] Merge pull request #17422 from [BEAM-14344]: remove tracing from
------------------------------------------
[...truncated 17.65 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651400069749517579/****\022@228c544e4b7d6d1e7d2921751bd6bdb52fb7d3c87d23de1f7e3d0486ac384666"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/01 10:14:30 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651400069749517579/model
2022/05/01 10:14:30 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0428110920"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651400069749517579/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651400069749517579/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0428110920",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/05/01 10:14:30 Submitted job: 2022-05-01_03_14_30-15038427463710332215
2022/05/01 10:14:30 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-01_03_14_30-15038427463710332215?project=apache-beam-testing
2022/05/01 10:14:30 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-01_03_14_30-15038427463710332215
2022/05/01 10:14:30 Job state: JOB_STATE_PENDING ...
2022/05/01 10:15:01 Job still running ...
2022/05/01 10:15:31 Job still running ...
2022/05/01 10:16:01 Job still running ...
2022/05/01 10:16:31 Job still running ...
2022/05/01 10:17:01 Job still running ...
2022/05/01 10:17:31 Job still running ...
2022/05/01 10:18:01 Job still running ...
2022/05/01 10:18:31 Job still running ...
2022/05/01 10:19:01 Job still running ...
2022/05/01 10:19:31 Failed to execute job: job 2022-05-01_03_14_30-15038427463710332215 failed
panic: Failed to execute job: job 2022-05-01_03_14_30-15038427463710332215 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1209588, 0xc000120000, 0x10e6e1c, 0x19, 0xc0005c5e78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 8s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/o44wcpmqsnroy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #496
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/496/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Add element weighting parameter to BatchElements.
[Robert Bradshaw] Clearer test.
[noreply] Revert "Merge pull request #17260 from [BEAM-13229] [Website] bug side
[noreply] [BEAM-14001] Add missing test cases to existing suites in exec package
[noreply] [BEAM-14243] Add staticcheck to Github Actions Precommits (#17479)
[noreply] [BEAM-14368][BEAM-13984]Change model loading from constructor to
[noreply] [BEAM-13983] changed file name from sklearn_loader to sklearn_inference
[noreply] Add SQL in Notebooks blog post (#17481)
[noreply] Merge pull request #17404: [BEAM-13990] support date and timestamp
------------------------------------------
[...truncated 17.61 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651313682584612348/****\022@228c544e4b7d6d1e7d2921751bd6bdb52fb7d3c87d23de1f7e3d0486ac384666"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/30 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651313682584612348/model
2022/04/30 10:14:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0428110920"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651313682584612348/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651313682584612348/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0428110920",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/30 10:14:43 Submitted job: 2022-04-30_03_14_43-865874495203774760
2022/04/30 10:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-30_03_14_43-865874495203774760?project=apache-beam-testing
2022/04/30 10:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-30_03_14_43-865874495203774760
2022/04/30 10:14:43 Job state: JOB_STATE_PENDING ...
2022/04/30 10:15:13 Job still running ...
2022/04/30 10:15:44 Job still running ...
2022/04/30 10:16:14 Job still running ...
2022/04/30 10:16:44 Job still running ...
2022/04/30 10:17:14 Job still running ...
2022/04/30 10:17:44 Failed to execute job: job 2022-04-30_03_14_43-865874495203774760 failed
panic: Failed to execute job: job 2022-04-30_03_14_43-865874495203774760 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1209588, 0xc0000480c0, 0x10e6e1c, 0x19, 0xc00056be78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 20s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/k742amgc6u23k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #495
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/495/display/redirect?page=changes>
Changes:
[ihr] Update Java katas to Beam 2.38
[noreply] [BEAM-14369] Fix "target/options: no such file or directory" error while
[noreply] [BEAM-14351] Inherit from Coder. (#17437)
[noreply] [BEAM-14297] Enable nullable key and value arrays for xlang kafka io
[noreply] Merge pull request #17444 from [BEAM-14310] [Website] bug home
[noreply] Merge pull request #17388 from [BEAM-14311] [Website] Home Page
[noreply] [BEAM-14376] Typo in method description doc
[noreply] Add default classpath when not present (#17491)
[thiagotnunes] fix: update javadocs for ChangeStreamMetrics
[noreply] Merge pull request #17443 from [BEAM-12164]: use the end timestamp for
[noreply] Merge pull request #17260 from [BEAM-13229] [Website] bug side nav
[noreply] [BEAM-14351] Fix the template and move the announcement to the next
------------------------------------------
[...truncated 17.65 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651227276943319292/****\022@228c544e4b7d6d1e7d2921751bd6bdb52fb7d3c87d23de1f7e3d0486ac384666"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/29 10:14:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651227276943319292/model
2022/04/29 10:14:37 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0428110920"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651227276943319292/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651227276943319292/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0428110920",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/29 10:14:38 Submitted job: 2022-04-29_03_14_37-18171854532606500240
2022/04/29 10:14:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-29_03_14_37-18171854532606500240?project=apache-beam-testing
2022/04/29 10:14:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-29_03_14_37-18171854532606500240
2022/04/29 10:14:38 Job state: JOB_STATE_PENDING ...
2022/04/29 10:15:08 Job still running ...
2022/04/29 10:15:38 Job still running ...
2022/04/29 10:16:08 Job still running ...
2022/04/29 10:16:38 Job still running ...
2022/04/29 10:17:08 Job still running ...
2022/04/29 10:17:38 Failed to execute job: job 2022-04-29_03_14_37-18171854532606500240 failed
panic: Failed to execute job: job 2022-04-29_03_14_37-18171854532606500240 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1209588, 0xc000120000, 0x10e6e1c, 0x19, 0xc00044be78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 16s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/dunbd4b3m4l72
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #494
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/494/display/redirect?page=changes>
Changes:
[nick.caballero] [BEAM-14363] Fixes WatermarkParameters builder for Kinesis
[noreply] [BEAM-11104] Add Checkpointing split to Go SDK (#17386)
[noreply] Merge pull request #17226 from [BEAM-14204] [Playground] Tests for
[noreply] [BEAM-13015, BEAM-14184] Address unbounded number of messages being
[noreply] Improvement to Seed job configuration to launch against PRs (#17468)
[noreply] [BEAM-13983] Small changes to sklearn runinference (#17459)
[chamikaramj] Renames ExternalPythonTransform to PythonExternalTransform
------------------------------------------
[...truncated 17.70 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651140879170173611/****\022@228c544e4b7d6d1e7d2921751bd6bdb52fb7d3c87d23de1f7e3d0486ac384666"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/28 10:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651140879170173611/model
2022/04/28 10:14:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0428000303"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651140879170173611/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651140879170173611/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0428000303",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/28 10:14:40 Submitted job: 2022-04-28_03_14_39-10004262055355952387
2022/04/28 10:14:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-28_03_14_39-10004262055355952387?project=apache-beam-testing
2022/04/28 10:14:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-28_03_14_39-10004262055355952387
2022/04/28 10:14:40 Job state: JOB_STATE_PENDING ...
2022/04/28 10:15:10 Job still running ...
2022/04/28 10:15:40 Job still running ...
2022/04/28 10:16:10 Job still running ...
2022/04/28 10:16:40 Job still running ...
2022/04/28 10:17:10 Job still running ...
2022/04/28 10:17:40 Job still running ...
2022/04/28 10:18:10 Job still running ...
2022/04/28 10:18:41 Job still running ...
2022/04/28 10:19:11 Job still running ...
2022/04/28 10:19:41 Failed to execute job: job 2022-04-28_03_14_39-10004262055355952387 failed
panic: Failed to execute job: job 2022-04-28_03_14_39-10004262055355952387 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1209588, 0xc000120000, 0x10e6e1c, 0x19, 0xc0003ffe78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 18s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/q3bujxaby7vws
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #493
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/493/display/redirect?page=changes>
Changes:
[msbukal] FhirIO: use .search() or .searchType instead of .setResourceType()
[noreply] Remove unnecessary decorator from RunInference interface (#17463)
[noreply] [BEAM-13590] Minor deprecated warning fix (#17453)
[noreply] [BEAM-12164]: fix the negative throughput issue (#17461)
[noreply] Updated goldens for the screen diff integration tests (#17467)
[noreply] fixes copy by value error for bytes.Buffer in Error (#17469)
[noreply] Merge pull request #17354 from [BEAM-14170] - Create a test that runs
[noreply] Merge pull request #17447 from [BEAM-14357] Fix
[noreply] [BEAM-14324, BEAM-14325] Staticcheck cleanup in test files (#17393)
[noreply] BEAM-14187 Fix NPE (#17454)
[noreply] [BEAM-11105] Stateful watermark estimation (#17374)
[noreply] [BEAM-14304] implement parquetio to read/write parquet files (#17347)
------------------------------------------
[...truncated 17.67 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651054480905275410/****\022@1a8cbf0d1eec68004ef3d2259969cc9225c3ae810d67e5f51a826bd24e620942"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/27 10:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651054480905275410/model
2022/04/27 10:14:41 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0427100252"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651054480905275410/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651054480905275410/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0427100252",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/27 10:14:42 Submitted job: 2022-04-27_03_14_41-4546868229711315500
2022/04/27 10:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-27_03_14_41-4546868229711315500?project=apache-beam-testing
2022/04/27 10:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-27_03_14_41-4546868229711315500
2022/04/27 10:14:42 Job state: JOB_STATE_PENDING ...
2022/04/27 10:15:12 Job still running ...
2022/04/27 10:15:42 Job still running ...
2022/04/27 10:16:12 Job still running ...
2022/04/27 10:16:42 Job still running ...
2022/04/27 10:17:13 Job still running ...
2022/04/27 10:17:43 Job still running ...
2022/04/27 10:18:13 Job still running ...
2022/04/27 10:18:43 Job still running ...
2022/04/27 10:19:13 Job still running ...
2022/04/27 10:19:43 Failed to execute job: job 2022-04-27_03_14_41-4546868229711315500 failed
panic: Failed to execute job: job 2022-04-27_03_14_41-4546868229711315500 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1208188, 0xc000120000, 0x10e5d1c, 0x19, 0xc0007d5e78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 20s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/eub3wuizqtxzq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #492
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/492/display/redirect?page=changes>
Changes:
[Heejong Lee] [BEAM-14343] Allow expansion service override in ExternalPythonTransform
[Heejong Lee] update
[Heejong Lee] allows remote host
[Heejong Lee] improve compatibility with python rowcoder
[ahmedabualsaud] added tempLocation to test pipeline options
[ahmedabualsaud] using tempRoot for temp bucket location
[ahmedabualsaud] small fixes
[noreply] [BEAM-14320] Update programming-guide w/Java GroupByKey example (#17369)
[noreply] Minor: Fix release script for `current` symlinks (#17457)
[noreply] Minor: fix typo (#17452)
[noreply] Change return type for PytorchInferenceRunner (#17460)
[noreply] [BEAM-13608] JmsIO dynamic topics feature (#17163)
[Heejong Lee] add test
------------------------------------------
[...truncated 17.38 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650968075452734331/****\022@d5227fb8580dab9ef4f7a9c2283df6593f46e843f8a6eb662cb5fda78b2283c1"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/26 10:14:36 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650968075452734331/model
2022/04/26 10:14:36 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0426100248"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650968075452734331/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650968075452734331/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0426100248",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/26 10:14:36 Submitted job: 2022-04-26_03_14_36-4488797451829970442
2022/04/26 10:14:36 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-26_03_14_36-4488797451829970442?project=apache-beam-testing
2022/04/26 10:14:36 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-26_03_14_36-4488797451829970442
2022/04/26 10:14:36 Job state: JOB_STATE_PENDING ...
2022/04/26 10:15:06 Job still running ...
2022/04/26 10:15:36 Job still running ...
2022/04/26 10:16:06 Job still running ...
2022/04/26 10:16:37 Job still running ...
2022/04/26 10:17:07 Job still running ...
2022/04/26 10:17:37 Job still running ...
2022/04/26 10:18:07 Job still running ...
2022/04/26 10:18:37 Job still running ...
2022/04/26 10:19:07 Job still running ...
2022/04/26 10:19:37 Failed to execute job: job 2022-04-26_03_14_36-4488797451829970442 failed
panic: Failed to execute job: job 2022-04-26_03_14_36-4488797451829970442 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202f68, 0xc000120000, 0x10e17e5, 0x19, 0xc000631e78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 14s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ltdbzuw7gaygu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #491
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/491/display/redirect>
Changes:
------------------------------------------
[...truncated 17.36 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650881676131203195/****\022@d5227fb8580dab9ef4f7a9c2283df6593f46e843f8a6eb662cb5fda78b2283c1"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/25 10:14:36 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650881676131203195/model
2022/04/25 10:14:36 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0425100237"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650881676131203195/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650881676131203195/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0425100237",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/25 10:14:37 Submitted job: 2022-04-25_03_14_36-14684707291423957406
2022/04/25 10:14:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-25_03_14_36-14684707291423957406?project=apache-beam-testing
2022/04/25 10:14:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-25_03_14_36-14684707291423957406
2022/04/25 10:14:37 Job state: JOB_STATE_PENDING ...
2022/04/25 10:15:07 Job still running ...
2022/04/25 10:15:37 Job still running ...
2022/04/25 10:16:07 Job still running ...
2022/04/25 10:16:37 Job still running ...
2022/04/25 10:17:07 Job still running ...
2022/04/25 10:17:37 Failed to execute job: job 2022-04-25_03_14_36-14684707291423957406 failed
panic: Failed to execute job: job 2022-04-25_03_14_36-14684707291423957406 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202f68, 0xc000120000, 0x10e17e5, 0x19, 0xc00028de78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 14s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/x2p3eexvwt6le
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #490
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/490/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13953] added documentation for BQ Storage Write API (#17391)
------------------------------------------
[...truncated 17.40 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650795276233105459/****\022@d5227fb8580dab9ef4f7a9c2283df6593f46e843f8a6eb662cb5fda78b2283c1"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/24 10:14:36 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650795276233105459/model
2022/04/24 10:14:36 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0424100238"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650795276233105459/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650795276233105459/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0424100238",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/24 10:14:37 Submitted job: 2022-04-24_03_14_36-5315818999145448678
2022/04/24 10:14:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-24_03_14_36-5315818999145448678?project=apache-beam-testing
2022/04/24 10:14:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-24_03_14_36-5315818999145448678
2022/04/24 10:14:37 Job state: JOB_STATE_PENDING ...
2022/04/24 10:15:07 Job still running ...
2022/04/24 10:15:37 Job still running ...
2022/04/24 10:16:07 Job still running ...
2022/04/24 10:16:37 Job still running ...
2022/04/24 10:17:07 Job still running ...
2022/04/24 10:17:37 Job still running ...
2022/04/24 10:18:07 Job still running ...
2022/04/24 10:18:37 Job still running ...
2022/04/24 10:19:07 Job still running ...
2022/04/24 10:19:38 Failed to execute job: job 2022-04-24_03_14_36-5315818999145448678 failed
panic: Failed to execute job: job 2022-04-24_03_14_36-5315818999145448678 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202f68, 0xc000120000, 0x10e17e5, 0x19, 0xc000427e78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 14s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/r36k2b3lcpfwi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #489
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/489/display/redirect?page=changes>
Changes:
[Andrew Pilloud] [BEAM-14321] SQL passes Null for Null aggregates
[noreply] Create apache-hop-with-dataflow.md
[noreply] Add files via upload
[noreply] Delete website/www/site/content/en/blog/apache-hop-with-dataflow
[noreply] Add files via upload
[Andrew Pilloud] [BEAM-14348] Upgrade to ZetaSQL 2022.04.1
[Andrew Pilloud] [BEAM-13735] Enable ZetaSQL tests for Java 17
[noreply] Update apache-hop-with-dataflow.md
[noreply] Update apache-hop-with-dataflow.md
[noreply] Update apache-hop-with-dataflow.md
[danielamartinmtz] Moved up get-credentials instruction for getting the kubeconfig file
[noreply] [BEAM-13657] Add python 3.6 update to CHANGES.md (#17435)
[noreply] Merge pull request #17438: [BEAM-8127] The GCP module to declare
[noreply] Merge pull request #17428: [BEAM-14326] Make sure BigQuery daemon thread
[noreply] [BEAM-14301] Add lint:ignore to noescape() func (#17355)
[noreply] [BEAM-14286] Remove unused vars in harness package (#17392)
[noreply] [BEAM-14327] Convert Results to QueryResults directly (#17398)
[noreply] [BEAM-14302] Simplify boolean check in fn.go (#17399)
[noreply] [BEAM-13983] Sklearn Loader for RunInference (#17368)
[noreply] Update authors.yml
[noreply] [BEAM-14358] add retry to connect to testcontainer (#17449)
[noreply] [BEAM-13106] Bump flink docs to 1.14 (#17430)
------------------------------------------
[...truncated 17.34 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650708880987327506/****\022@d5227fb8580dab9ef4f7a9c2283df6593f46e843f8a6eb662cb5fda78b2283c1"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/23 10:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650708880987327506/model
2022/04/23 10:14:41 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0423100247"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650708880987327506/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650708880987327506/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0423100247",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/23 10:14:42 Submitted job: 2022-04-23_03_14_41-13310528930982567675
2022/04/23 10:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-23_03_14_41-13310528930982567675?project=apache-beam-testing
2022/04/23 10:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-23_03_14_41-13310528930982567675
2022/04/23 10:14:42 Job state: JOB_STATE_PENDING ...
2022/04/23 10:15:12 Job still running ...
2022/04/23 10:15:42 Job still running ...
2022/04/23 10:16:12 Job still running ...
2022/04/23 10:16:42 Job still running ...
2022/04/23 10:17:12 Job still running ...
2022/04/23 10:17:43 Failed to execute job: job 2022-04-23_03_14_41-13310528930982567675 failed
panic: Failed to execute job: job 2022-04-23_03_14_41-13310528930982567675 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202f68, 0xc000120000, 0x10e17e5, 0x19, 0xc000417e78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/or2uf66prz7pg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #488
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/488/display/redirect?page=changes>
Changes:
[mmack] [BEAM-14335] Spotless Spark sources
[mmack] [BEAM-14345] Force paranamer 2.8 for Spark Hadoop version tests to avoid
[noreply] BEAM-13582 Fixing broken links in the documentation (#17300)
[kamil.bregula] Revert "[BEAM-14300] Fix Java precommit failure"
[kamil.bregula] Revert "Merge pull request #17223 from [BEAM-14215] Improve argument
[noreply] [BEAM-13657] Sunset python 3.6 (#17252)
[noreply] Removes unsupported Python 3.6 from the release validation script
[noreply] [BEAM-13984] Implement RunInference for PyTorch (#17196)
[noreply] [BEAM-13945] add json type support for java bigquery connector (#17209)
[noreply] [BEAM-14346] Fix incorrect error case index in ret2() (#17425)
[noreply] [BEAM-14342] Fix wrong default buffer type in fn_runner (#17420)
[noreply] Updates opencensus-api dependency to the latest version - 0.31.0
[noreply] [BEAM-14306] Add unit testing to pane coder (#17370)
[noreply] Updated the dep and golden for screen diff integration tests (#17442)
------------------------------------------
[...truncated 17.37 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650622481416444787/****\022@3a4cbf3600490040a5fec86a009479d6e8a1446c1bf27308ed57924bbe115df4"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/22 10:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650622481416444787/model
2022/04/22 10:14:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0422100253"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650622481416444787/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650622481416444787/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0422100253",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/22 10:14:42 Submitted job: 2022-04-22_03_14_42-6805910100148431205
2022/04/22 10:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-22_03_14_42-6805910100148431205?project=apache-beam-testing
2022/04/22 10:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-22_03_14_42-6805910100148431205
2022/04/22 10:14:42 Job state: JOB_STATE_PENDING ...
2022/04/22 10:15:13 Job still running ...
2022/04/22 10:15:43 Job still running ...
2022/04/22 10:16:13 Job still running ...
2022/04/22 10:16:43 Job still running ...
2022/04/22 10:17:13 Job still running ...
2022/04/22 10:17:43 Failed to execute job: job 2022-04-22_03_14_42-6805910100148431205 failed
panic: Failed to execute job: job 2022-04-22_03_14_42-6805910100148431205 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202fa8, 0xc000120000, 0x10e17e5, 0x19, 0xc0004d1e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 21s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/otpyzep6gqcvu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #487
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/487/display/redirect?page=changes>
Changes:
[vachan] Annotating Read API tests.
[bulat.safiullin] [BEAM-14247] [Website] add image
[bulat.safiullin] [BEAM-14247] [Website] center image
[mattcasters] BEAM-1857 : CHANGES.md entry for 2.38.0
[mmack] [BEAM-14323] Improve IDE integration of Spark cross version builds
[noreply] [BEAM-14112] Fixed ReadFromBigQuery with Interactive Beam (#17306)
[noreply] Update .asf.yaml (#17409)
[noreply] [BEAM-14336] Sickbay flight delays test - dataset seems to be missing
[noreply] [BEAM-14338] Update watermark unit tests to use time.Time.Equals()
[noreply] [BEAM-14328] Tweaks to "Differences from pandas" page (#17413)
[Andrew Pilloud] [BEAM-14253] Disable broken test pending Dataflow fix
[yiru] fix: BigQuery Storage Connector trace id population missing bracket
[noreply] [BEAM-14330] Temporarily disable the clusters auto-cleanup (#17400)
[noreply] Update Beam website to release 2.38.0 (#17378)
[noreply] [BEAM-14213] Add API and construction time validation for Batched DoFns
[noreply] Minor: Update release guide regarding archive.apache.org (#17419)
[noreply] [BEAM-14017] beam_PreCommit_CommunityMetrics_Cron test failing (#17396)
------------------------------------------
[...truncated 17.28 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650536068770250889/****\022@4d222538e22f0fc5062c68be506100b4c690107fad0a1e4b53d593943d41a979"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/21 10:14:29 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650536068770250889/model
2022/04/21 10:14:29 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0421100305"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650536068770250889/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650536068770250889/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0421100305",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/21 10:14:29 Submitted job: 2022-04-21_03_14_29-13176856425987507621
2022/04/21 10:14:29 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-21_03_14_29-13176856425987507621?project=apache-beam-testing
2022/04/21 10:14:29 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-21_03_14_29-13176856425987507621
2022/04/21 10:14:29 Job state: JOB_STATE_PENDING ...
2022/04/21 10:14:59 Job still running ...
2022/04/21 10:15:30 Job still running ...
2022/04/21 10:16:00 Job still running ...
2022/04/21 10:16:30 Job still running ...
2022/04/21 10:17:00 Job still running ...
2022/04/21 10:17:30 Failed to execute job: job 2022-04-21_03_14_29-13176856425987507621 failed
panic: Failed to execute job: job 2022-04-21_03_14_29-13176856425987507621 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202f28, 0xc000120000, 0x10e17e5, 0x19, 0xc000443e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 8s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/squahlukcpqtc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #486
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/486/display/redirect?page=changes>
Changes:
[andyye333] Change func to PTransform
[noreply] Populate actual dataflow job id to bigquery write trace id (#17130)
[relax] mark static thread as a daemon thread
[noreply] [BEAM-13866] Add miscellaneous exec unit tests (#17363)
------------------------------------------
[...truncated 17.40 KB...]
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650449675670543170/****\022@4d222538e22f0fc5062c68be506100b4c690107fad0a1e4b53d593943d41a979"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/20 10:14:36 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650449675670543170/model
2022/04/20 10:14:36 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0420100239"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650449675670543170/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650449675670543170/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0420100239",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/20 10:14:36 Submitted job: 2022-04-20_03_14_36-18156406884419495368
2022/04/20 10:14:36 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-20_03_14_36-18156406884419495368?project=apache-beam-testing
2022/04/20 10:14:36 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-20_03_14_36-18156406884419495368
2022/04/20 10:14:36 Job state: JOB_STATE_PENDING ...
2022/04/20 10:15:06 Job still running ...
2022/04/20 10:15:37 Job still running ...
2022/04/20 10:16:07 Job still running ...
2022/04/20 10:16:37 Job still running ...
2022/04/20 10:17:07 Job still running ...
2022/04/20 10:17:37 Job still running ...
2022/04/20 10:18:07 Job still running ...
2022/04/20 10:18:37 Job still running ...
2022/04/20 10:19:07 Job still running ...
2022/04/20 10:19:37 Job still running ...
2022/04/20 10:20:08 Failed to execute job: job 2022-04-20_03_14_36-18156406884419495368 failed
panic: Failed to execute job: job 2022-04-20_03_14_36-18156406884419495368 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202f28, 0xc0000480c0, 0x10e17e5, 0x19, 0xc0004d5e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 47s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/byvawt2gjw5lk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #485
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/485/display/redirect?page=changes>
Changes:
[Heejong Lee] [BEAM-14251] add output_coder_override to ExpansionRequest
[Heejong Lee] remove null
[rarokni] [BEAM-14307] Fix Slow Side input pattern bug in sample
[Heejong Lee] better error msg
[Heejong Lee] update from comments
[noreply] [BEAM-14316] Introducing KafkaIO.Read implementation compatibility
[noreply] [BEAM-14290] Address staticcheck warnings in the reflectx package
[noreply] [BEAM-14302] Simply bools in fn.go, genx_test.go (#17356)
[noreply] Merge pull request #17382: [BEAM-12356] Close DatasetService leak as
------------------------------------------
[...truncated 17.38 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650363278918381490/****\022@4d222538e22f0fc5062c68be506100b4c690107fad0a1e4b53d593943d41a979"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/19 10:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650363278918381490/model
2022/04/19 10:14:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0419100246"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650363278918381490/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650363278918381490/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0419100246",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/19 10:14:40 Submitted job: 2022-04-19_03_14_39-10762265482278810311
2022/04/19 10:14:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-19_03_14_39-10762265482278810311?project=apache-beam-testing
2022/04/19 10:14:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-19_03_14_39-10762265482278810311
2022/04/19 10:14:40 Job state: JOB_STATE_PENDING ...
2022/04/19 10:15:10 Job still running ...
2022/04/19 10:15:40 Job still running ...
2022/04/19 10:16:10 Job still running ...
2022/04/19 10:16:40 Job still running ...
2022/04/19 10:17:10 Job still running ...
2022/04/19 10:17:40 Failed to execute job: job 2022-04-19_03_14_39-10762265482278810311 failed
panic: Failed to execute job: job 2022-04-19_03_14_39-10762265482278810311 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202f28, 0xc0000480c0, 0x10e17e5, 0x19, 0xc000425e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 18s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/l3oavomb2bf6k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #484
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/484/display/redirect>
Changes:
------------------------------------------
[...truncated 17.40 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650276873334395439/****\022@fbd883d0cd8077aa758484662e074ca8d3bfb25eef6678fa961d3d8b44296f38"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/18 10:14:34 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650276873334395439/model
2022/04/18 10:14:34 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0418100241"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650276873334395439/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650276873334395439/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0418100241",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/18 10:14:34 Submitted job: 2022-04-18_03_14_34-4223699733439530592
2022/04/18 10:14:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-18_03_14_34-4223699733439530592?project=apache-beam-testing
2022/04/18 10:14:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-18_03_14_34-4223699733439530592
2022/04/18 10:14:34 Job state: JOB_STATE_PENDING ...
2022/04/18 10:15:04 Job still running ...
2022/04/18 10:15:34 Job still running ...
2022/04/18 10:16:04 Job still running ...
2022/04/18 10:16:34 Job still running ...
2022/04/18 10:17:05 Job still running ...
2022/04/18 10:17:35 Failed to execute job: job 2022-04-18_03_14_34-4223699733439530592 failed
panic: Failed to execute job: job 2022-04-18_03_14_34-4223699733439530592 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202f28, 0xc0000480c0, 0x10e17e5, 0x19, 0xc0005d1e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 14s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/baxhzgeqyfhq4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #483
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/483/display/redirect>
Changes:
------------------------------------------
[...truncated 17.46 KB...]
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650190473191071286/****\022@fbd883d0cd8077aa758484662e074ca8d3bfb25eef6678fa961d3d8b44296f38"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/17 10:14:33 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650190473191071286/model
2022/04/17 10:14:33 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0417100245"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650190473191071286/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650190473191071286/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0417100245",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/17 10:14:34 Submitted job: 2022-04-17_03_14_33-3285411550073730087
2022/04/17 10:14:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-17_03_14_33-3285411550073730087?project=apache-beam-testing
2022/04/17 10:14:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-17_03_14_33-3285411550073730087
2022/04/17 10:14:34 Job state: JOB_STATE_PENDING ...
2022/04/17 10:15:04 Job still running ...
2022/04/17 10:15:35 Job still running ...
2022/04/17 10:16:05 Job still running ...
2022/04/17 10:16:35 Job still running ...
2022/04/17 10:17:05 Job still running ...
2022/04/17 10:17:35 Job still running ...
2022/04/17 10:18:05 Job still running ...
2022/04/17 10:18:35 Job still running ...
2022/04/17 10:19:05 Job still running ...
2022/04/17 10:19:35 Job still running ...
2022/04/17 10:20:05 Failed to execute job: job 2022-04-17_03_14_33-3285411550073730087 failed
panic: Failed to execute job: job 2022-04-17_03_14_33-3285411550073730087 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202f28, 0xc000120000, 0x10e17e5, 0x19, 0xc000407e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 44s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/b67ndavy4v4wu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #482
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/482/display/redirect?page=changes>
Changes:
[pandiana] BigQueryServicesImpl: reduce number of threads spawned by
[noreply] [BEAM-13204] Fix website bug where code tabs do not appear if the
------------------------------------------
[...truncated 17.41 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650104076010616927/****\022@fbd883d0cd8077aa758484662e074ca8d3bfb25eef6678fa961d3d8b44296f38"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/16 10:14:36 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650104076010616927/model
2022/04/16 10:14:36 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0416100241"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650104076010616927/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650104076010616927/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0416100241",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/16 10:14:37 Submitted job: 2022-04-16_03_14_36-13122598132845091065
2022/04/16 10:14:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-16_03_14_36-13122598132845091065?project=apache-beam-testing
2022/04/16 10:14:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-16_03_14_36-13122598132845091065
2022/04/16 10:14:37 Job state: JOB_STATE_PENDING ...
2022/04/16 10:15:07 Job still running ...
2022/04/16 10:15:37 Job still running ...
2022/04/16 10:16:07 Job still running ...
2022/04/16 10:16:37 Job still running ...
2022/04/16 10:17:07 Job still running ...
2022/04/16 10:17:37 Job still running ...
2022/04/16 10:18:07 Failed to execute job: job 2022-04-16_03_14_36-13122598132845091065 failed
panic: Failed to execute job: job 2022-04-16_03_14_36-13122598132845091065 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202f28, 0xc000120000, 0x10e17e5, 0x19, 0xc0009bfe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 46s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/5we4slj4xxj52
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #481
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/481/display/redirect?page=changes>
Changes:
[Kenneth Knowles] Upgrade to Gradle 7.4
[Kenneth Knowles] Remove Python module dependency on Dataflow worker
[noreply] [BEAM-13925] Dont double assign committers if author or other reviewer
[noreply] [BEAM-13739] Remove deprecated shallow clone funcs (#17362)
[noreply] [BEAM-11104] Pipe Continuation to DataSource level (#17334)
[noreply] [BEAM-11105] Basic Watermark Estimation (Wall Clock Observing) (#17267)
[noreply] Respect output coder for TextIO. (#17367)
[noreply] Merge pull request #17200 from [BEAM-12164]: fix the autoscaling backlog
[noreply] [BEAM-17035] Call python3 directly when it is available. (#17366)
[noreply] Merge pull request #17375: [BEAM-8691] Declare newer
------------------------------------------
[...truncated 17.38 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650017681452085711/****\022@fbd883d0cd8077aa758484662e074ca8d3bfb25eef6678fa961d3d8b44296f38"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/15 10:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650017681452085711/model
2022/04/15 10:14:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0415100236"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650017681452085711/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650017681452085711/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0415100236",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/15 10:14:45 Submitted job: 2022-04-15_03_14_42-3710367742580606060
2022/04/15 10:14:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-15_03_14_42-3710367742580606060?project=apache-beam-testing
2022/04/15 10:14:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-15_03_14_42-3710367742580606060
2022/04/15 10:14:45 Job state: JOB_STATE_PENDING ...
2022/04/15 10:15:15 Job still running ...
2022/04/15 10:15:45 Job still running ...
2022/04/15 10:16:16 Job still running ...
2022/04/15 10:16:46 Job still running ...
2022/04/15 10:17:16 Job still running ...
2022/04/15 10:17:46 Failed to execute job: job 2022-04-15_03_14_42-3710367742580606060 failed
panic: Failed to execute job: job 2022-04-15_03_14_42-3710367742580606060 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202f28, 0xc0000480c0, 0x10e17e5, 0x19, 0xc000565e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 24s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/zbjr6v52urjzc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #480
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/480/display/redirect?page=changes>
Changes:
[relax] handle changing schemas in Storage API sink
[noreply] Fix a couple style issues (#17361)
[noreply] [BEAM-14287] Clean up staticcheck warnings in graph/coder (#17337)
[noreply] Improvements to dataflow job service for non-Python jobs. (#17338)
[noreply] Bump minimist (#17290)
[noreply] Bump ansi-regex (#17291)
[noreply] Bump nanoid (#17292)
[noreply] Bump lodash (#17293)
[noreply] Bump url-parse (#17294)
[noreply] Bump moment (#17328)
[noreply] Merge pull request #15549 from [BEAM-11997] Changed RedisIO
------------------------------------------
[...truncated 17.43 KB...]
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649931279250629840/****\022@19d14d7fce413a96bb14c58678dcb579ec82c5034a1257f74abaf7163cafe3a9"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/14 10:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649931279250629840/model
2022/04/14 10:14:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0414100250"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649931279250629840/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649931279250629840/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0414100250",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/14 10:14:41 Submitted job: 2022-04-14_03_14_39-6638205837349465376
2022/04/14 10:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-14_03_14_39-6638205837349465376?project=apache-beam-testing
2022/04/14 10:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-14_03_14_39-6638205837349465376
2022/04/14 10:14:41 Job state: JOB_STATE_PENDING ...
2022/04/14 10:15:11 Job still running ...
2022/04/14 10:15:41 Job still running ...
2022/04/14 10:16:11 Job still running ...
2022/04/14 10:16:41 Job still running ...
2022/04/14 10:17:11 Job still running ...
2022/04/14 10:17:41 Job still running ...
2022/04/14 10:18:11 Job still running ...
2022/04/14 10:18:41 Job still running ...
2022/04/14 10:19:11 Job still running ...
2022/04/14 10:19:41 Job still running ...
2022/04/14 10:20:12 Failed to execute job: job 2022-04-14_03_14_39-6638205837349465376 failed
panic: Failed to execute job: job 2022-04-14_03_14_39-6638205837349465376 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fe8e8, 0xc00018a000, 0x10dd90d, 0x19, 0xc00056de00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/oc7a5hl2bylhk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #479
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/479/display/redirect?page=changes>
Changes:
[Valentyn Tymofieiev] Add remaining Dataflow test suites for Python 3.9.
[Heejong Lee] [BEAM-14232] Only resolve artifacts in expanded environments for Java
[noreply] Fix test ordering issue (#17350)
[buqian] Do not pass null to MoreObjects.firstNonNull as default value
[ningkang0957] [BEAM-14288] Fixed flaky test
[noreply] [BEAM-14277] Disables Spanner change streams tests (#17346)
[noreply] [BEAM-14219] Run cleanup script to remove stale prebuilt SDK container
[Heejong Lee] [BEAM-14300] Fix Java precommit failure
[noreply] [BEAM-14116] Rollback "Chunk commit requests dynamically (#17004)"
[noreply] [BEAM-13982] A base class for run inference (#16970)
[ningkang0957] Enumerates all possible expected strings when asserting
[noreply] [BEAM-13966] Add pivot(), a non-deferred column operation on categorical
------------------------------------------
[...truncated 17.44 KB...]
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649844878536599605/****\022@65878b4c34e53f51ca26a8ce87734b9e3068cd88bdf9ae6d73b98cf9dcbc2a26"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/13 10:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649844878536599605/model
2022/04/13 10:14:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0413100239"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649844878536599605/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649844878536599605/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0413100239",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/13 10:14:39 Submitted job: 2022-04-13_03_14_39-17597835399636276592
2022/04/13 10:14:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-13_03_14_39-17597835399636276592?project=apache-beam-testing
2022/04/13 10:14:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-13_03_14_39-17597835399636276592
2022/04/13 10:14:40 Job state: JOB_STATE_PENDING ...
2022/04/13 10:15:10 Job still running ...
2022/04/13 10:15:40 Job still running ...
2022/04/13 10:16:10 Job still running ...
2022/04/13 10:16:40 Job still running ...
2022/04/13 10:17:10 Job still running ...
2022/04/13 10:17:40 Job still running ...
2022/04/13 10:18:10 Job still running ...
2022/04/13 10:18:40 Job still running ...
2022/04/13 10:19:10 Job still running ...
2022/04/13 10:19:40 Job still running ...
2022/04/13 10:20:10 Failed to execute job: job 2022-04-13_03_14_39-17597835399636276592 failed
panic: Failed to execute job: job 2022-04-13_03_14_39-17597835399636276592 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fe8e8, 0xc0000480c0, 0x10dd90d, 0x19, 0xc0003abe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vx6hxzxgoa54u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #478
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/478/display/redirect?page=changes>
Changes:
[kamil.bregula] [BEAM-14215] Improve argument validation in SnowflakeIO
[benjamin.gonzalez] [BEAM-14013] Add PreCommit Kotlin examples Jenkins Job
[Andrew Pilloud] [BEAM-13151] Support multiple layers of AutoValue nesting
[Heejong Lee] [BEAM-14233] Merge requirements from expanded response for Java External
[benjamin.gonzalez] [BEAM-14013] Add spark, direct, flink runners as triggers for Kotlin
[noreply] [BEAM-13898] Add tests to the pubsubx package. (#17324)
[noreply] [BEAM-14285] Clean up Staticcheck Warnings in io packages (#17336)
[noreply] [BEAM-14187] Fix concurrency issue in IsmReaderImpl (#17201)
[noreply] [BEAM-14288] Skip flaking test
[noreply] Simplify specifying additional dependencies in Go SDK in XLang IOs
[noreply] [BEAM-14240] Clean staticcheck warnings in runner packages (#17340)
[Daniel Oliveira] [BEAM-13538] Workaround to fix go-licenses crash.
------------------------------------------
[...truncated 17.38 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649758476361917818/****\022@65878b4c34e53f51ca26a8ce87734b9e3068cd88bdf9ae6d73b98cf9dcbc2a26"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/12 10:14:36 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649758476361917818/model
2022/04/12 10:14:36 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0412100253"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649758476361917818/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649758476361917818/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0412100253",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/12 10:14:37 Submitted job: 2022-04-12_03_14_37-15185391582769658392
2022/04/12 10:14:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-12_03_14_37-15185391582769658392?project=apache-beam-testing
2022/04/12 10:14:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-12_03_14_37-15185391582769658392
2022/04/12 10:14:37 Job state: JOB_STATE_PENDING ...
2022/04/12 10:15:07 Job still running ...
2022/04/12 10:15:37 Job still running ...
2022/04/12 10:16:07 Job still running ...
2022/04/12 10:16:37 Job still running ...
2022/04/12 10:17:07 Job still running ...
2022/04/12 10:17:37 Failed to execute job: job 2022-04-12_03_14_37-15185391582769658392 failed
panic: Failed to execute job: job 2022-04-12_03_14_37-15185391582769658392 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fe8e8, 0xc000120000, 0x10dd90d, 0x19, 0xc0004bfe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 16s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/twfdroim2qckq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #477
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/477/display/redirect>
Changes:
------------------------------------------
[...truncated 17.38 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649672078838612141/****\022@aa82da42294c826fa79f98c59d8420af270ba6d1a4bf922421e49984379b1c05"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/11 10:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649672078838612141/model
2022/04/11 10:14:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0411100250"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649672078838612141/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649672078838612141/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0411100250",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/11 10:14:40 Submitted job: 2022-04-11_03_14_39-14049673898573676319
2022/04/11 10:14:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-11_03_14_39-14049673898573676319?project=apache-beam-testing
2022/04/11 10:14:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-11_03_14_39-14049673898573676319
2022/04/11 10:14:40 Job state: JOB_STATE_PENDING ...
2022/04/11 10:15:10 Job still running ...
2022/04/11 10:15:40 Job still running ...
2022/04/11 10:16:10 Job still running ...
2022/04/11 10:16:40 Job still running ...
2022/04/11 10:17:10 Job still running ...
2022/04/11 10:17:40 Job still running ...
2022/04/11 10:18:10 Failed to execute job: job 2022-04-11_03_14_39-14049673898573676319 failed
panic: Failed to execute job: job 2022-04-11_03_14_39-14049673898573676319 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fc148, 0xc0000480c0, 0x10db399, 0x19, 0xc00039be00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 46s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/awehmhc6km3oc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #476
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/476/display/redirect?page=changes>
Changes:
[chamikaramj] Re-raise exceptions swallowed in several Python I/O connectors
[noreply] Merge pull request #16928: [BEAM-11971] Re add reverted timer
------------------------------------------
[...truncated 17.38 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649585675332914703/****\022@aa82da42294c826fa79f98c59d8420af270ba6d1a4bf922421e49984379b1c05"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/10 10:14:35 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649585675332914703/model
2022/04/10 10:14:35 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0410100248"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649585675332914703/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649585675332914703/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0410100248",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/10 10:14:36 Submitted job: 2022-04-10_03_14_35-18408452118090579646
2022/04/10 10:14:36 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-10_03_14_35-18408452118090579646?project=apache-beam-testing
2022/04/10 10:14:36 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-10_03_14_35-18408452118090579646
2022/04/10 10:14:36 Job state: JOB_STATE_PENDING ...
2022/04/10 10:15:06 Job still running ...
2022/04/10 10:15:36 Job still running ...
2022/04/10 10:16:06 Job still running ...
2022/04/10 10:16:36 Job still running ...
2022/04/10 10:17:06 Job still running ...
2022/04/10 10:17:36 Job still running ...
2022/04/10 10:18:06 Failed to execute job: job 2022-04-10_03_14_35-18408452118090579646 failed
panic: Failed to execute job: job 2022-04-10_03_14_35-18408452118090579646 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fc148, 0xc000120000, 0x10db399, 0x19, 0xc000573e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 45s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ie2kpi5o4uhgw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #475
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/475/display/redirect?page=changes>
Changes:
[benjamin.gonzalez] [BEAM-11714] Change spotBugs jenkins config
[Robert Bradshaw] Cleanup docs on Shared.
[Kyle Weaver] Nit: correct description for precommit cron jobs.
[benjamin.gonzalez] [BEAM-11714] Add dummy class for testing
[benjamin.gonzalez] [BEAM-11714] Remove dummy class used for testing
[benjamin.gonzalez] [BEAM-11714] Spotbugs print toJenkins UI precommit_Java17
[noreply] [BEAM-13767] Remove eclipse plugin as it generates a lot of unused tasks
[noreply] [BEAM-10708] Updated beam_sql error message (#17314)
[noreply] [BEAM-14281] add as_deterministic_coder to nullable coder (#17322)
[noreply] Improvements to Beam/Spark quickstart. (#17129)
[chamikaramj] Disable BigQueryIOStorageWriteIT for Runner v2 test suite
------------------------------------------
[...truncated 17.45 KB...]
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649499276142344912/****\022@aa82da42294c826fa79f98c59d8420af270ba6d1a4bf922421e49984379b1c05"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/09 10:14:36 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649499276142344912/model
2022/04/09 10:14:36 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0409100244"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649499276142344912/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649499276142344912/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0409100244",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/09 10:14:37 Submitted job: 2022-04-09_03_14_36-12067842526843397777
2022/04/09 10:14:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-09_03_14_36-12067842526843397777?project=apache-beam-testing
2022/04/09 10:14:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-09_03_14_36-12067842526843397777
2022/04/09 10:14:37 Job state: JOB_STATE_PENDING ...
2022/04/09 10:15:07 Job still running ...
2022/04/09 10:15:37 Job still running ...
2022/04/09 10:16:07 Job still running ...
2022/04/09 10:16:37 Job still running ...
2022/04/09 10:17:07 Job still running ...
2022/04/09 10:17:37 Job still running ...
2022/04/09 10:18:07 Job still running ...
2022/04/09 10:18:37 Job still running ...
2022/04/09 10:19:07 Job still running ...
2022/04/09 10:19:37 Job still running ...
2022/04/09 10:20:08 Failed to execute job: job 2022-04-09_03_14_36-12067842526843397777 failed
panic: Failed to execute job: job 2022-04-09_03_14_36-12067842526843397777 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fc148, 0xc0000480c0, 0x10db399, 0x19, 0xc0003abe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 46s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/5rvcnlzfz6jdy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #474
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/474/display/redirect?page=changes>
Changes:
[johnjcasey] [BEAM-10529] add java and generic components of nullable xlang tests
[johnjcasey] [BEAM-10529] fix test case
[johnjcasey] [BEAM-10529] add coders and typehints to support nullable xlang coders
[johnjcasey] [BEAM-10529] update external builder to support nullable coder
[johnjcasey] [BEAM-10529] clean up coders.py
[johnjcasey] [BEAM-10529] add coder translation test
[johnjcasey] [BEAM-10529] add additional check to typecoder to not accidentally
[johnjcasey] [BEAM-10529] add test to retrieve nullable coder from typehint
[johnjcasey] [BEAM-10529] run spotless
[johnjcasey] [BEAM-10529] add go nullable coder
[johnjcasey] [BEAM-10529] cleanup extra println
[johnjcasey] [BEAM-10529] improve comments, clean up python
[bulat.safiullin] [BEAM-13992] [Website] update Contribute/Code Contribution Guide page
[bulat.safiullin] [BEAM-13992] [Website] change text, transfer tag a
[bulat.safiullin] [BEAM-13992] [Website] change code tags
[bulat.safiullin] [BEAM-13992] [Website] change text
[bulat.safiullin] [BEAM-13992] [Website] change text and links, add empty lines
[bulat.safiullin] [BEAM-13991] [Website] change links, add contribute file
[bulat.safiullin] [BEAM-13991] [Website] add content, add styles
[bulat.safiullin] [BEAM-13991] [Website] add images, add styles, delete spaces
[bulat.safiullin] [BEAM-13991] [Website] change url and aliases, delete bullet points
[bulat.safiullin] [BEAM-13991] [Website] add empty line
[bulat.safiullin] [BEAM-13992] [Website] change links, change text
[bulat.safiullin] [BEAM-13992] [Website] change links, add text, add dots
[bulat.safiullin] [BEAM-13992] [Website] change links, change text
[bulat.safiullin] [BEAM-13991] [Website] change styles, change quotes
[bulat.safiullin] [BEAM-13991] [Website] change link color
[bulat.safiullin] [BEAM-13992] [Website] change text, delete whitespace
[bulat.safiullin] [BEAM-13991] [Website] change text
[bulat.safiullin] [BEAM-13992] [Website] update text
[bulat.safiullin] [BEAM-13991] [Website] added changes from PR 13992, changed get-starting
[shivrajw] [BEAM-14236] Parquet IO support for list to conform with Apache Parquet
[chamikaramj] Sets 'sdk_harness_container_images' property for all Dataflow jobs -
[chamikaramj] Sets 'sdk_harness_container_images' property for all Dataflow jobs -
[mmack] [BEAM-14104] Support shard aware aggregation in Kinesis writer.
[noreply] [BEAM-13015] Lookup the container for the step once when registering
[noreply] [BEAM-14175] Log read loop abort at debug rather than error (#17183)
[noreply] [BEAM-11745] Fix author list rendering (#17308)
[noreply] [BEAM-14144] Record JFR profiles when GC thrashing is detected (#17151)
[noreply] Factors enable_prime flag in when checking use_unified_worker conditions
[noreply] [BEAM-11104] Add ProcessContinuation type to Go SDK (#17265)
[noreply] BEAM-13939: Restructure Protos to fix namespace conflicts (#16961)
[noreply] [BEAM-14270] Mark {Snowflake/BigQuery}Services as @Internal (#17309)
[noreply] [BEAM-13901] Add unit tests for graphx/cogbk.go
[noreply] [BEAM-14259, BEAM-14266] Remove unused function, replace use of ptypes
[noreply] [BEAM-14274] Fix staticcheck warnings in pipelinex (#17311)
[noreply] [BEAM-13857] Switched Go IT script to using Go flags for expansion
[noreply] Update python beam-master container image. (#17313)
------------------------------------------
[...truncated 17.36 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649412882473309555/****\022@aa82da42294c826fa79f98c59d8420af270ba6d1a4bf922421e49984379b1c05"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/08 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649412882473309555/model
2022/04/08 10:14:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0408100245"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649412882473309555/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649412882473309555/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0408100245",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/08 10:14:43 Submitted job: 2022-04-08_03_14_43-3676575395985554251
2022/04/08 10:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-08_03_14_43-3676575395985554251?project=apache-beam-testing
2022/04/08 10:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-08_03_14_43-3676575395985554251
2022/04/08 10:14:43 Job state: JOB_STATE_PENDING ...
2022/04/08 10:15:13 Job still running ...
2022/04/08 10:15:43 Job still running ...
2022/04/08 10:16:13 Job still running ...
2022/04/08 10:16:43 Job still running ...
2022/04/08 10:17:13 Job still running ...
2022/04/08 10:17:44 Job still running ...
2022/04/08 10:18:14 Job still running ...
2022/04/08 10:18:44 Failed to execute job: job 2022-04-08_03_14_43-3676575395985554251 failed
panic: Failed to execute job: job 2022-04-08_03_14_43-3676575395985554251 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fc148, 0xc0000480c0, 0x10db399, 0x19, 0xc00066de00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m 22s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/52zutkdtpvnfy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #473
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/473/display/redirect?page=changes>
Changes:
[noreply] Avoid pr-bot state desync (#17299)
[noreply] [BEAM-14259] Clean up staticcheck warnings in the exec package (#17285)
[noreply] Minor: Prefer registered schema in SQL docs (#17298)
[Kyle Weaver] [BEAM-14262] Update plugins for Dockerized Jenkins.
[Kyle Weaver] Add ansicolor and ws-cleanup plugins.
[noreply] [Playground] add meta tags (#17207)
[noreply] fixes golint and deprecated issues in recent Go SDK import (#17304)
[noreply] [BEAM-14266] Replace deprecated ptypes package uses (#17302)
[noreply] [BEAM-11936] Fix rawtypes warnings in SnowflakeIO (#17257)
[noreply] Merge pull request #17262: [BEAM-14244] Use the supplied output
------------------------------------------
[...truncated 17.43 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649326481606002600/****\022@ff9da1c6a12e416e26682a766904acb2b955ec7c22d4946aefa06272e93b9920"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/07 10:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649326481606002600/model
2022/04/07 10:14:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0407100254"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649326481606002600/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649326481606002600/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0407100254",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/07 10:14:42 Submitted job: 2022-04-07_03_14_42-10013493717965427462
2022/04/07 10:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-07_03_14_42-10013493717965427462?project=apache-beam-testing
2022/04/07 10:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-07_03_14_42-10013493717965427462
2022/04/07 10:14:42 Job state: JOB_STATE_PENDING ...
2022/04/07 10:15:12 Job still running ...
2022/04/07 10:15:42 Job still running ...
2022/04/07 10:16:13 Job still running ...
2022/04/07 10:16:43 Job still running ...
2022/04/07 10:17:13 Job still running ...
2022/04/07 10:17:43 Job still running ...
2022/04/07 10:18:13 Failed to execute job: job 2022-04-07_03_14_42-10013493717965427462 failed
panic: Failed to execute job: job 2022-04-07_03_14_42-10013493717965427462 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11f7b48, 0xc0000480c0, 0x10d748c, 0x19, 0xc0007e7e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/srpchknfqzyj4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #472
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/472/display/redirect?page=changes>
Changes:
[bingyeli] update query
[Robert Bradshaw] [BEAM-14250] Fix coder registration for types defined in __main__.
[johnjcasey] [BEAM-14256] update SpEL dependency to 5.3.18.RELEASE
[johnjcasey] [BEAM-14256] remove .RELEASE
[dannymccormick] Fix dependency issue causing failures
[Kyle Weaver] [BEAM-9649] Add region option to Mongo Dataflow test.
[noreply] Allow get_coder(None).
[noreply] [BEAM-13015] Disable retries for fnapi grpc channels which otherwise
[noreply] [BEAM-13952] Sickbay
[noreply] BEAM-14235 parquetio module does not parse PEP-440 compliant Pyarrow
[noreply] [Website] Contribution guide page indent bug fix (#17287)
[noreply] [BEAM-10976] Document go sdk bundle finalization (#17048)
[noreply] [BEAM-13829] Expose status API from Go SDK Harness (#16957)
------------------------------------------
[...truncated 17.44 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649240082267528843/****\022@6878e07e288bc427aaf2db6161ed510e6d7e52c4aa924632e6355f4597ae7296"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/06 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649240082267528843/model
2022/04/06 10:14:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0406100250"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649240082267528843/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649240082267528843/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0406100250",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/06 10:14:43 Submitted job: 2022-04-06_03_14_43-6598375069367508471
2022/04/06 10:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-06_03_14_43-6598375069367508471?project=apache-beam-testing
2022/04/06 10:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-06_03_14_43-6598375069367508471
2022/04/06 10:14:43 Job state: JOB_STATE_PENDING ...
2022/04/06 10:15:13 Job still running ...
2022/04/06 10:15:43 Job still running ...
2022/04/06 10:16:13 Job still running ...
2022/04/06 10:16:43 Job still running ...
2022/04/06 10:17:13 Job still running ...
2022/04/06 10:17:43 Job still running ...
2022/04/06 10:18:13 Job still running ...
2022/04/06 10:18:44 Job still running ...
2022/04/06 10:19:14 Job still running ...
2022/04/06 10:19:44 Job still running ...
2022/04/06 10:20:16 Job still running ...
2022/04/06 10:20:46 Failed to execute job: job 2022-04-06_03_14_43-6598375069367508471 failed
panic: Failed to execute job: job 2022-04-06_03_14_43-6598375069367508471 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11f7ac8, 0xc0000480c0, 0x10d748c, 0x19, 0xc00040be00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 6m 22s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/hl5cslh5qodw2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #471
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/471/display/redirect?page=changes>
Changes:
[benjamin.gonzalez] [BEAM-8970] Add docs to run wordcount example on portable Spark Runner
[Kiley Sok] Update python container version
[benjamin.gonzalez] [BEAM-8970] Add period to end of sentence
[Kyle Weaver] Add self-descriptive message for expected errors.
[noreply] Add --dataflowServiceOptions=enable_prime to useUnifiedWorker conditions
[noreply] [BEAM-10529] nullable xlang coder (#16923)
[noreply] Fix go fmt break in core/typex/special.go (#17266)
[noreply] [BEAM-5436] Add doc page on Go cross compilation. (#17256)
[noreply] Pr-bot Don't count all reviews as approvals (#17269)
[noreply] Fix postcommits (#17263)
[noreply] [BEAM-14241] Address staticcheck warnings in boot.go (#17264)
[noreply] [BEAM-14157] GrpcWindmillServer: Use stream specific boolean to do
[noreply] [BEAM-10582] Allow (and test) pyarrow 7 (#17229)
[noreply] [BEAM-13519] Solve race issues when the server responds with an error
------------------------------------------
[...truncated 17.39 KB...]
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649153674095282744/****\022@c0e37d558209c73c316caf100086463c2bceae4d3f2115ee97b381f760958fc9"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/05 10:14:34 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649153674095282744/model
2022/04/05 10:14:34 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0405100254"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649153674095282744/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649153674095282744/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0405100254",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/05 10:14:35 Submitted job: 2022-04-05_03_14_34-9484889235192568798
2022/04/05 10:14:35 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-05_03_14_34-9484889235192568798?project=apache-beam-testing
2022/04/05 10:14:35 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-05_03_14_34-9484889235192568798
2022/04/05 10:14:35 Job state: JOB_STATE_PENDING ...
2022/04/05 10:15:05 Job still running ...
2022/04/05 10:15:35 Job still running ...
2022/04/05 10:16:05 Job still running ...
2022/04/05 10:16:35 Job still running ...
2022/04/05 10:17:05 Job still running ...
2022/04/05 10:17:35 Job still running ...
2022/04/05 10:18:05 Job still running ...
2022/04/05 10:18:35 Job still running ...
2022/04/05 10:19:05 Job still running ...
2022/04/05 10:19:35 Job still running ...
2022/04/05 10:20:05 Failed to execute job: job 2022-04-05_03_14_34-9484889235192568798 failed
panic: Failed to execute job: job 2022-04-05_03_14_34-9484889235192568798 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11575e8, 0xc0000480c0, 0x1044372, 0x19, 0xc0003e7e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 41s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/oce44cfmd36qg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #470
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/470/display/redirect>
Changes:
------------------------------------------
[...truncated 17.36 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649067276458689654/****\022@14d013210e81652a4a20d02dcca9120e09485f05b890e10035939551fd69ef90"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/04 10:14:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649067276458689654/model
2022/04/04 10:14:37 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0404100246"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649067276458689654/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649067276458689654/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0404100246",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/04 10:14:37 Submitted job: 2022-04-04_03_14_37-15501053708556834841
2022/04/04 10:14:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-04_03_14_37-15501053708556834841?project=apache-beam-testing
2022/04/04 10:14:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-04_03_14_37-15501053708556834841
2022/04/04 10:14:37 Job state: JOB_STATE_PENDING ...
2022/04/04 10:15:07 Job still running ...
2022/04/04 10:15:37 Job still running ...
2022/04/04 10:16:07 Job still running ...
2022/04/04 10:16:37 Job still running ...
2022/04/04 10:17:07 Job still running ...
2022/04/04 10:17:37 Job still running ...
2022/04/04 10:18:07 Failed to execute job: job 2022-04-04_03_14_37-15501053708556834841 failed
panic: Failed to execute job: job 2022-04-04_03_14_37-15501053708556834841 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1155108, 0xc0000480c0, 0x104200d, 0x19, 0xc00034de00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 46s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/zmleq2djn3acg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #469
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/469/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14143] Simplifies the ExternalPythonTransform API (#17101)
------------------------------------------
[...truncated 17.40 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648980878270705883/****\022@14d013210e81652a4a20d02dcca9120e09485f05b890e10035939551fd69ef90"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/03 10:14:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648980878270705883/model
2022/04/03 10:14:38 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0403100304"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648980878270705883/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648980878270705883/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0403100304",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/03 10:14:39 Submitted job: 2022-04-03_03_14_38-13202730285513445682
2022/04/03 10:14:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-03_03_14_38-13202730285513445682?project=apache-beam-testing
2022/04/03 10:14:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-03_03_14_38-13202730285513445682
2022/04/03 10:14:39 Job state: JOB_STATE_PENDING ...
2022/04/03 10:15:09 Job still running ...
2022/04/03 10:15:39 Job still running ...
2022/04/03 10:16:09 Job still running ...
2022/04/03 10:16:39 Job still running ...
2022/04/03 10:17:09 Job still running ...
2022/04/03 10:17:39 Job still running ...
2022/04/03 10:18:09 Job still running ...
2022/04/03 10:18:39 Job still running ...
2022/04/03 10:19:09 Job still running ...
2022/04/03 10:19:39 Job still running ...
2022/04/03 10:20:09 Failed to execute job: job 2022-04-03_03_14_38-13202730285513445682 failed
panic: Failed to execute job: job 2022-04-03_03_14_38-13202730285513445682 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1155108, 0xc00018a000, 0x104200d, 0x19, 0xc000463e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 46s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/pzhrmg6gzkani
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #468
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/468/display/redirect?page=changes>
Changes:
[Heejong Lee] [BEAM-14133] Fix potential NPE in BigQueryServicesImpl.getErrorInfo
[Robert Bradshaw] Revert "Revert "[BEAM-14038] Auto-startup for Python expansion service.
[Robert Bradshaw] Skip failing test for now.
[Kyle Weaver] [BEAM-14225] load balance jenkins jobs
[noreply] [BEAM-14153] Reshuffled Row Coder PCollection used as Side Input cause
[noreply] delint go sdk (#17247)
[Heejong Lee] add test
[noreply] Merge pull request #16841 from [BEAM-8823] Make FnApiRunner work by
[noreply] [BEAM-14192] Update legacy container version (#17210)
[noreply] Fix mishandling of API with BQIO (#17211)
[noreply] [BEAM-14221] Update documentation with Flink on Dataproc features
[Kiley Sok] Revert "[BEAM-14190] Python sends dataflow schema field"
------------------------------------------
[...truncated 17.34 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648894485085911039/****\022@14d013210e81652a4a20d02dcca9120e09485f05b890e10035939551fd69ef90"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/02 10:14:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648894485085911039/model
2022/04/02 10:14:45 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0402100250"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648894485085911039/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648894485085911039/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0402100250",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/02 10:14:46 Submitted job: 2022-04-02_03_14_45-15346524103016869680
2022/04/02 10:14:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-02_03_14_45-15346524103016869680?project=apache-beam-testing
2022/04/02 10:14:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-02_03_14_45-15346524103016869680
2022/04/02 10:14:46 Job state: JOB_STATE_PENDING ...
2022/04/02 10:15:16 Job still running ...
2022/04/02 10:15:46 Job still running ...
2022/04/02 10:16:16 Job still running ...
2022/04/02 10:16:46 Job still running ...
2022/04/02 10:17:16 Job still running ...
2022/04/02 10:17:46 Job still running ...
2022/04/02 10:18:16 Failed to execute job: job 2022-04-02_03_14_45-15346524103016869680 failed
panic: Failed to execute job: job 2022-04-02_03_14_45-15346524103016869680 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1155108, 0xc000120000, 0x104200d, 0x19, 0xc0004c3e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ssevphaxe5r4i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #467
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/467/display/redirect?page=changes>
Changes:
[bulat.safiullin] [BEAM-14164] [Website] change styles
[Andrew Pilloud] [BEAM-14190] Python sends dataflow schema field
[noreply] [BEAM-14179] Fix possibly null value
[noreply] [BEAM-12815] Try to fix flaky Flink Post Commit (#17227)
[noreply] Add a portable job server that proxies the Dataflow backend. (#17189)
[noreply] [BEAM-14130] Implement JupyterLab extension for managing Dataproc
[Andrew Pilloud] [BEAM-13741] Remove forced calcite dependency from BaseBeamTable
[noreply] [BEAM-13951] Update release guide with pointers on updating
------------------------------------------
[...truncated 17.36 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648808084554651243/****\022@0a2515b258d512663b06d3c08fc54a898f18b4bc2ae6baac2d4ff0600a8a2fb4"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/01 10:14:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648808084554651243/model
2022/04/01 10:14:45 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0401100242"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648808084554651243/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648808084554651243/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0401100242",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/01 10:14:45 Submitted job: 2022-04-01_03_14_45-4911904483344932145
2022/04/01 10:14:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-01_03_14_45-4911904483344932145?project=apache-beam-testing
2022/04/01 10:14:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-01_03_14_45-4911904483344932145
2022/04/01 10:14:45 Job state: JOB_STATE_PENDING ...
2022/04/01 10:15:15 Job still running ...
2022/04/01 10:15:45 Job still running ...
2022/04/01 10:16:15 Job still running ...
2022/04/01 10:16:45 Job still running ...
2022/04/01 10:17:15 Job still running ...
2022/04/01 10:17:46 Job still running ...
2022/04/01 10:18:16 Failed to execute job: job 2022-04-01_03_14_45-4911904483344932145 failed
panic: Failed to execute job: job 2022-04-01_03_14_45-4911904483344932145 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11533e8, 0xc000120000, 0x104060d, 0x19, 0xc0002e1e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/qbyknyjhg5uxk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #466
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/466/display/redirect?page=changes>
Changes:
[brachipa] [BEAM-14094]Fix null pointer exception in HllCountInitFn
[brachipa] [BEAM-14094]Fix null pointer exception in HllCountInitFn
[egalpin] [BEAM-14003] Adds compat for Elasticsearch 8.0.0
[egalpin] [BEAM-13136] Removes support for Elasticsearch 2.x
[noreply] Merge pull request #17149 from [BEAM-13883] [Playground] Increase test
[Kiley Sok] ignore test
[noreply] [BEAM-13948] Add unstack(), a non-deferred column operation on
[noreply] [BEAM-10976] Bundle finalization: E2E support (#17045)
------------------------------------------
[...truncated 17.35 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648721687035873034/****\022@0a2515b258d512663b06d3c08fc54a898f18b4bc2ae6baac2d4ff0600a8a2fb4"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/31 10:14:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648721687035873034/model
2022/03/31 10:14:47 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0331100241"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648721687035873034/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648721687035873034/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0331100241",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/31 10:14:48 Submitted job: 2022-03-31_03_14_47-6064836055298254799
2022/03/31 10:14:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-31_03_14_47-6064836055298254799?project=apache-beam-testing
2022/03/31 10:14:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-31_03_14_47-6064836055298254799
2022/03/31 10:14:48 Job state: JOB_STATE_PENDING ...
2022/03/31 10:15:18 Job still running ...
2022/03/31 10:15:48 Job still running ...
2022/03/31 10:16:18 Job still running ...
2022/03/31 10:16:48 Job still running ...
2022/03/31 10:17:18 Job still running ...
2022/03/31 10:17:48 Job still running ...
2022/03/31 10:18:18 Failed to execute job: job 2022-03-31_03_14_47-6064836055298254799 failed
panic: Failed to execute job: job 2022-03-31_03_14_47-6064836055298254799 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11533e8, 0xc0000480c0, 0x104060d, 0x19, 0xc0005e9e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/rucagv6gmoqks
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #465
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/465/display/redirect?page=changes>
Changes:
[vachan] Update display data to include BQ information.
[noreply] Revert "[BEAM-14084] iterable_input_value_types changed from list to
[chamikaramj] Convert URLs to local jars when constructing filesToStage
[Valentyn Tymofieiev] Ensure the removed option prebuild_sdk_container_base_image not used on
[noreply] [BEAM-13314]Revise recommendations to manage Python pipeline
[noreply] Merge pull request #17202 from [BEAM-14194]: Disallow autoscaling for
[noreply] Merge pull request #17080 from [BEAM-13880] [Playground] Increase test
[noreply] Merge pull request #17050 from [BEAM-13877] [Playground] Increase test
[noreply] [BEAM-14200] Improve SamzaJobInvoker extensibility (#17212)
[noreply] Merge pull request #17148 from [BEAM-14042] [playground] Scroll imports
[noreply] [BEAM-13918] Increase datastoreio go sdk unit test coverage (#17173)
[noreply] Merge pull request #16819: [BEAM-13806] Adding test suite for Go x-lang
------------------------------------------
[...truncated 17.37 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648635307887305359/****\022@c4f40d200d5f4c551ee8225acadee9469e82191cdfceb3faf6f61b0f60b656cc"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/30 10:15:08 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648635307887305359/model
2022/03/30 10:15:08 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0330100232"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648635307887305359/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648635307887305359/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0330100232",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/30 10:15:09 Submitted job: 2022-03-30_03_15_08-9806696987992009361
2022/03/30 10:15:09 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-30_03_15_08-9806696987992009361?project=apache-beam-testing
2022/03/30 10:15:09 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-30_03_15_08-9806696987992009361
2022/03/30 10:15:09 Job state: JOB_STATE_PENDING ...
2022/03/30 10:15:39 Job still running ...
2022/03/30 10:16:09 Job still running ...
2022/03/30 10:16:39 Job still running ...
2022/03/30 10:17:09 Job still running ...
2022/03/30 10:17:39 Job still running ...
2022/03/30 10:18:09 Job still running ...
2022/03/30 10:18:39 Job still running ...
2022/03/30 10:19:09 Job still running ...
2022/03/30 10:19:39 Job still running ...
2022/03/30 10:20:09 Job still running ...
2022/03/30 10:20:40 Failed to execute job: job 2022-03-30_03_15_08-9806696987992009361 failed
panic: Failed to execute job: job 2022-03-30_03_15_08-9806696987992009361 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11515e8, 0xc0000480c0, 0x103e969, 0x19, 0xc000407e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 47s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ljescqonwkbna
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #464
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/464/display/redirect?page=changes>
Changes:
[hengfeng] feat: remove the metadata table after the pipeline finishes
[thiagotnunes] test: add test for metadata table dropping
[noreply] Minor: Add warning about pubsub client to Beam 2.36.0 blog (#17188)
[noreply] [BEAM-14177] Fix GBK re-iteration caching for portable runners. (#17184)
[noreply] Merge pull request #17187: [BEAM-14181] Make sure to evict connections
[noreply] Only reset transform.label if it is correctly assigned (#17192)
[noreply] [BEAM-12641] Use google-auth instead of oauth2client for GCP auth
[Robert Bradshaw] [BEAM-14163] Fix typo in single core per container logic.
[thiagotnunes] test: disable SpannerIO.readChangeStream test
[noreply] Merge pull request #17164 from [BEAM-14140][Playground] Fix Deploy
[noreply] Merge pull request #16855 from [BEAM-13938][Playground] Increase test
------------------------------------------
[...truncated 17.38 KB...]
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648548882656792544/****\022@c4f40d200d5f4c551ee8225acadee9469e82191cdfceb3faf6f61b0f60b656cc"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/29 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648548882656792544/model
2022/03/29 10:14:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0329100245"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648548882656792544/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648548882656792544/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0329100245",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/29 10:14:44 Submitted job: 2022-03-29_03_14_43-11718944418751321351
2022/03/29 10:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-29_03_14_43-11718944418751321351?project=apache-beam-testing
2022/03/29 10:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-29_03_14_43-11718944418751321351
2022/03/29 10:14:44 Job state: JOB_STATE_PENDING ...
2022/03/29 10:15:14 Job still running ...
2022/03/29 10:15:44 Job still running ...
2022/03/29 10:16:14 Job still running ...
2022/03/29 10:16:44 Job still running ...
2022/03/29 10:17:14 Job still running ...
2022/03/29 10:17:45 Failed to execute job: job 2022-03-29_03_14_43-11718944418751321351 failed
panic: Failed to execute job: job 2022-03-29_03_14_43-11718944418751321351 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11515e8, 0xc000120000, 0x103e969, 0x19, 0xc0005e9e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 21s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/r2dxxxaiw6d32
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #463
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/463/display/redirect>
Changes:
------------------------------------------
[...truncated 17.38 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648462480286204239/****\022@c4f40d200d5f4c551ee8225acadee9469e82191cdfceb3faf6f61b0f60b656cc"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/28 10:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648462480286204239/model
2022/03/28 10:14:41 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0328100240"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648462480286204239/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648462480286204239/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0328100240",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/28 10:14:41 Submitted job: 2022-03-28_03_14_41-17701389204309214968
2022/03/28 10:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-28_03_14_41-17701389204309214968?project=apache-beam-testing
2022/03/28 10:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-28_03_14_41-17701389204309214968
2022/03/28 10:14:41 Job state: JOB_STATE_PENDING ...
2022/03/28 10:15:11 Job still running ...
2022/03/28 10:15:41 Job still running ...
2022/03/28 10:16:11 Job still running ...
2022/03/28 10:16:42 Job still running ...
2022/03/28 10:17:12 Job still running ...
2022/03/28 10:17:42 Job still running ...
2022/03/28 10:18:12 Failed to execute job: job 2022-03-28_03_14_41-17701389204309214968 failed
panic: Failed to execute job: job 2022-03-28_03_14_41-17701389204309214968 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11515e8, 0xc0000480c0, 0x103e969, 0x19, 0xc0007f3e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/wjac2ar3slvoq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #462
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/462/display/redirect>
Changes:
------------------------------------------
[...truncated 17.38 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648376083307304210/****\022@c4f40d200d5f4c551ee8225acadee9469e82191cdfceb3faf6f61b0f60b656cc"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/27 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648376083307304210/model
2022/03/27 10:14:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0327100240"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648376083307304210/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648376083307304210/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0327100240",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/27 10:14:44 Submitted job: 2022-03-27_03_14_44-7806117293526872713
2022/03/27 10:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-27_03_14_44-7806117293526872713?project=apache-beam-testing
2022/03/27 10:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-27_03_14_44-7806117293526872713
2022/03/27 10:14:44 Job state: JOB_STATE_PENDING ...
2022/03/27 10:15:14 Job still running ...
2022/03/27 10:15:44 Job still running ...
2022/03/27 10:16:14 Job still running ...
2022/03/27 10:16:44 Job still running ...
2022/03/27 10:17:14 Job still running ...
2022/03/27 10:17:45 Job still running ...
2022/03/27 10:18:15 Failed to execute job: job 2022-03-27_03_14_44-7806117293526872713 failed
panic: Failed to execute job: job 2022-03-27_03_14_44-7806117293526872713 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11515e8, 0xc000198000, 0x103e969, 0x19, 0xc000451e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/q7mhu6m3ex3ak
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #461
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/461/display/redirect?page=changes>
Changes:
[ryanthompson591] iterable_input_value_types will now be an iterable, I don't anticipate
[marco.robles] [BEAM-8218] PulsarIO Connector
[benjamin.gonzalez] [BEAM-12572] Change examples jobs to run as cron jobs
[benjamin.gonzalez] [BEAM-12572] SpotlessApply
[Robert Bradshaw] [BEAM-14171] More explicit asserts in CoGBKResult.
[Robert Bradshaw] Add some comments.
[noreply] [BEAM-14160] Parse filesToStage in Java expansion service (#17167)
[chamikaramj] Mapped JOB_STATE_RESOURCE_CLEANING_UP to RESOURCE_CLEANING_UP in Python
[noreply] Explicitly import estimator from tensorflow (#17168)
------------------------------------------
[...truncated 17.41 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648289683334486179/****\022@c4f40d200d5f4c551ee8225acadee9469e82191cdfceb3faf6f61b0f60b656cc"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/26 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648289683334486179/model
2022/03/26 10:14:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0326100241"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648289683334486179/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648289683334486179/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0326100241",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/26 10:14:44 Submitted job: 2022-03-26_03_14_43-14265024178887560132
2022/03/26 10:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-26_03_14_43-14265024178887560132?project=apache-beam-testing
2022/03/26 10:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-26_03_14_43-14265024178887560132
2022/03/26 10:14:44 Job state: JOB_STATE_PENDING ...
2022/03/26 10:15:14 Job still running ...
2022/03/26 10:15:44 Job still running ...
2022/03/26 10:16:14 Job still running ...
2022/03/26 10:16:44 Job still running ...
2022/03/26 10:17:14 Job still running ...
2022/03/26 10:17:44 Job still running ...
2022/03/26 10:18:14 Failed to execute job: job 2022-03-26_03_14_43-14265024178887560132 failed
panic: Failed to execute job: job 2022-03-26_03_14_43-14265024178887560132 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11515e8, 0xc0000480c0, 0x103e969, 0x19, 0xc00074be00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/p7cql2utmhlhu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #460
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/460/display/redirect?page=changes>
Changes:
[Kyle Weaver] [BEAM-14139] Drop support for Flink 1.11.
[Kyle Weaver] [BEAM-14139] Remove obsolete reference to Flink 1.11.
[Kyle Weaver] [BEAM-14139] Update list of supported Flink versions.
[Kyle Weaver] [BEAM-14139] Update CHANGES.md
[noreply] [BEAM-14157] Don't call requestObserver.onNext on a closed windmill
[noreply] Minor: Make IOTypeHints a real NamedTuple (#17174)
[noreply] [BEAM-14172] Update tox.ini for pydocs (#17176)
[noreply] [BEAM-14065] Upgrade vendored bytebuddy to version 1.12.8 (#17028)
------------------------------------------
[...truncated 17.33 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648203283115158009/****\022@c4f40d200d5f4c551ee8225acadee9469e82191cdfceb3faf6f61b0f60b656cc"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/25 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648203283115158009/model
2022/03/25 10:14:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0325100242"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648203283115158009/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648203283115158009/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0325100242",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/25 10:14:46 Submitted job: 2022-03-25_03_14_43-15538005679407138967
2022/03/25 10:14:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-25_03_14_43-15538005679407138967?project=apache-beam-testing
2022/03/25 10:14:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-25_03_14_43-15538005679407138967
2022/03/25 10:14:46 Job state: JOB_STATE_PENDING ...
2022/03/25 10:15:16 Job still running ...
2022/03/25 10:15:46 Job still running ...
2022/03/25 10:16:16 Job still running ...
2022/03/25 10:16:46 Job still running ...
2022/03/25 10:17:16 Job still running ...
2022/03/25 10:17:46 Job still running ...
2022/03/25 10:18:16 Failed to execute job: job 2022-03-25_03_14_43-15538005679407138967 failed
panic: Failed to execute job: job 2022-03-25_03_14_43-15538005679407138967 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11515e8, 0xc0000480c0, 0x103e969, 0x19, 0xc0007e9e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/rh3wbptxedenc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #459
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/459/display/redirect?page=changes>
Changes:
[bulat.safiullin] [BEAM-13976] [Website] update homepage
[bulat.safiullin] [BEAM-13976] [Website] update homepage, add logo
[bulat.safiullin] [BEAM-13976] [Website] update text
[bulat.safiullin] [BEAM-13976] [Website] Update Community landing page
[bulat.safiullin] [BEAM-13979] [Website] Update Community/Contact us page
[bulat.safiullin] [BEAM-13979] [Website] update title
[bulat.safiullin] [BEAM-13979] [Website] delete space
[bulat.safiullin] [BEAM-13979] [Website] add Beam Playground
[bulat.safiullin] [BEAM-13976] [Website] delete Beam Playground
[bulat.safiullin] [BEAM-13976] [Website] change navbar css links rules, delete links from
[bulat.safiullin] [BEAM-13977] [Website] delete available-contact-channels on mobile
[bulat.safiullin] [BEAM-13976] [Website] change padding size between the sections
[bulat.safiullin] [BEAM-13976] [Website] change title to capital letters
[bulat.safiullin] [BEAM-13976] [Website] change title
[bulat.safiullin] [BEAM-14040] [Website] create new page, add link
[bulat.safiullin] [BEAM-13977] [Website] change title
[bulat.safiullin] [BEAM-13979] [Website] change text
[bulat.safiullin] [BEAM-13976] [Website] change text
[bulat.safiullin] [BEAM-13977] [Website] change text, add capital letters
[bulat.safiullin] [BEAM-13976] [Website] add playground sass, change text-align
[bulat.safiullin] [BEAM-14040] [Website] add io connectors table
[bulat.safiullin] [BEAM-13976] [Website] add playground section, add empty line
[bulat.safiullin] [BEAM-14040] [Website] add overflow to css, add table content
[bulat.safiullin] [BEAM-14040] [Website] change ✘ for ✔, add license, add br
[bulat.safiullin] [BEAM-14040] [Website] add empty line
[bulat.safiullin] [BEAM-14040] [Website] change td
[bulat.safiullin] [BEAM-14041] [Website] update built io transforms
[bulat.safiullin] [BEAM-14041] [Website] move connectors from Miscellaneous to Database
[bulat.safiullin] [BEAM-14040] [Website] change links color
[danielamartinmtz] Updated metrics' CronJob API to use the latest batch version.
[bulat.safiullin] [BEAM-14041] [Website] change IO from go to java
[bulat.safiullin] [BEAM-14040] [Website] change links, change specific version to current
[danielamartinmtz] Updated cluster to test in metrics-upgrade-clone in BeamMetrics_Publish
[aydar.zaynutdinov] [BEAM-13976][Website]
[aydar.zaynutdinov] [BEAM-14040][Website]
[aydar.zaynutdinov] [BEAM-14041][Website]
[danielamartinmtz] Updated StateFulSet k8s obejct in cassandra-svc-statefulset.yaml file in
[danielamartinmtz] Updated documentation including cluster specs.
[noreply] Beam 13058 k8s apis upgrade - elasticsearch (#18)
[danielamartinmtz] Removed code used for testing.
[danielamartinmtz] Removed code used for testing in job_PostCommit_BeamMetrics_Publish
[noreply] Beam 13058 k8s apis upgrade - Adding Basic Auth details in documentation
[mmack] [BEAM-13232] Close clients properly in KinesisSource. Also use lazy init
[Pablo Estrada] [BEAM-14151] Excluding Spanner CDC tests from Dataflow V1 suite
[danielamartinmtz] Added comments in initContainers and remove unused code in elasticsearch
[noreply] [BEAM-14134] Optimize memory allocations for various core coders
[noreply] [BEAM-14129] Restructure PubsubLiteIO Read side to produce smaller
[noreply] [BEAM-12697] Add primitive field generation from IR to SBE extension
[noreply] [BEAM-13889] Add test cases to jsonx package (#17124)
[noreply] Remove unreachable code in container.go (#17166)
[noreply] Add ability to handle streaming input to AvroSchemaIOProvider (#17126)
[noreply] [BEAM-12898] Flink Load Tests failure- UncheckedExecutionException -
[Daniel Oliveira] Moving to 2.39.0-SNAPSHOT on master branch.
------------------------------------------
[...truncated 17.34 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648116888018524935/****\022@c4f40d200d5f4c551ee8225acadee9469e82191cdfceb3faf6f61b0f60b656cc"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/24 10:14:48 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648116888018524935/model
2022/03/24 10:14:48 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0324100253"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648116888018524935/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648116888018524935/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0324100253",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/24 10:14:49 Submitted job: 2022-03-24_03_14_48-15114968722683274477
2022/03/24 10:14:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-24_03_14_48-15114968722683274477?project=apache-beam-testing
2022/03/24 10:14:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-24_03_14_48-15114968722683274477
2022/03/24 10:14:49 Job state: JOB_STATE_PENDING ...
2022/03/24 10:15:19 Job still running ...
2022/03/24 10:15:49 Job still running ...
2022/03/24 10:16:19 Job still running ...
2022/03/24 10:16:49 Job still running ...
2022/03/24 10:17:19 Job still running ...
2022/03/24 10:17:49 Job still running ...
2022/03/24 10:18:19 Failed to execute job: job 2022-03-24_03_14_48-15114968722683274477 failed
panic: Failed to execute job: job 2022-03-24_03_14_48-15114968722683274477 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11515e8, 0xc00019a000, 0x103e969, 0x19, 0xc0002e1e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/kyg3dvd7ohu4a
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #458
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/458/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14141] Set Interactive Beam to use the default Dataproc image
[noreply] BEAM-14115 - Update find criteria limited to _id (#17102)
[chamikaramj] Disable BigQueryIOStorageWriteIT for general Java post-commit
[noreply] Revert "[BEAM-14038] Auto-startup for Python expansion service.
[noreply] Minor: Bump timeout for Java PreCommit (#17157)
[noreply] [BEAM-14152] Disable flaky
[noreply] Fixing a small bug in TypedSchemaTransformTest that caused it to flake.
[noreply] [BEAM-14116] Catch MonitoringInfoMetricName null keys or values in the
[noreply] [BEAM-14129] Restructure SubscriptionPartitionLoader to use a manual SDF
[noreply] [BEAM-13015] Avoid repeated weighing of StateKey in
[noreply] Add option to add modules to JDK add-open (#17110)
[noreply] [BEAM-13015] Clarify ownership of the list for state caching across
------------------------------------------
[...truncated 17.38 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648030485044021082/****\022@7ea3e0c6699231341f291fa66bb7a1791deb03cc8757695c52877a86c251a286"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/23 10:14:46 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648030485044021082/model
2022/03/23 10:14:46 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0323100252"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648030485044021082/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648030485044021082/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0323100252",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/23 10:14:46 Submitted job: 2022-03-23_03_14_46-15541572225360521416
2022/03/23 10:14:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-23_03_14_46-15541572225360521416?project=apache-beam-testing
2022/03/23 10:14:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-23_03_14_46-15541572225360521416
2022/03/23 10:14:46 Job state: JOB_STATE_PENDING ...
2022/03/23 10:15:16 Job still running ...
2022/03/23 10:15:46 Job still running ...
2022/03/23 10:16:16 Job still running ...
2022/03/23 10:16:46 Job still running ...
2022/03/23 10:17:16 Job still running ...
2022/03/23 10:17:46 Job still running ...
2022/03/23 10:18:16 Failed to execute job: job 2022-03-23_03_14_46-15541572225360521416 failed
panic: Failed to execute job: job 2022-03-23_03_14_46-15541572225360521416 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11515e8, 0xc000120000, 0x103e969, 0x19, 0xc00059de00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/3imakzpbncuw2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #457
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/457/display/redirect?page=changes>
Changes:
[Kyle Weaver] [BEAM-14124] Add display data to BQ storage reads.
[mmack] [adhoc] Move aws IT tests to testing package according to best practices
[noreply] fixes static checks and go lint issues (#17138)
[Kyle Weaver] Don't print in task configuration.
[noreply] [BEAM-14136] Clean up staticcheck and linter warnings in the Go SDK
[noreply] Merge pull request #17063 from [BEAM-12164] Fix flaky tests
[noreply] Revert "[BEAM-14112] Avoid storing a generator in _CustomBigQuerySource
[Kyle Weaver] [BEAM-4106] Remove filesToStage from Flink pipeline option list.
[noreply] [BEAM-14071] Enabling Flink on Dataproc for Interactive Beam (#17044)
[noreply] Minor: Bypass schema registry in schemas_test.py (#17108)
------------------------------------------
[...truncated 17.47 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647944080934972497/****\022@7ea3e0c6699231341f291fa66bb7a1791deb03cc8757695c52877a86c251a286"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/22 10:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647944080934972497/model
2022/03/22 10:14:41 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0322100236"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647944080934972497/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647944080934972497/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0322100236",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/22 10:14:42 Submitted job: 2022-03-22_03_14_41-18425130805982316627
2022/03/22 10:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-22_03_14_41-18425130805982316627?project=apache-beam-testing
2022/03/22 10:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-22_03_14_41-18425130805982316627
2022/03/22 10:14:42 Job state: JOB_STATE_PENDING ...
2022/03/22 10:15:12 Job still running ...
2022/03/22 10:15:42 Job still running ...
2022/03/22 10:16:12 Job still running ...
2022/03/22 10:16:42 Job still running ...
2022/03/22 10:17:12 Job still running ...
2022/03/22 10:17:42 Job still running ...
2022/03/22 10:18:12 Job still running ...
2022/03/22 10:18:42 Job still running ...
2022/03/22 10:19:12 Job still running ...
2022/03/22 10:19:42 Job still running ...
2022/03/22 10:20:12 Failed to execute job: job 2022-03-22_03_14_41-18425130805982316627 failed
panic: Failed to execute job: job 2022-03-22_03_14_41-18425130805982316627 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11515e8, 0xc0000480c0, 0x103e969, 0x19, 0xc00040de00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/pe77yfsorjt34
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #456
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/456/display/redirect>
Changes:
------------------------------------------
[...truncated 17.32 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647857680764366537/****\022@b99141a92c2add70ddbe77d41dc70d55cdb80e82671b4a517490ac16b3227be2"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/21 10:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647857680764366537/model
2022/03/21 10:14:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0321100243"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647857680764366537/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647857680764366537/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0321100243",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/21 10:14:42 Submitted job: 2022-03-21_03_14_42-1593659086409336892
2022/03/21 10:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-21_03_14_42-1593659086409336892?project=apache-beam-testing
2022/03/21 10:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-21_03_14_42-1593659086409336892
2022/03/21 10:14:42 Job state: JOB_STATE_PENDING ...
2022/03/21 10:15:12 Job still running ...
2022/03/21 10:15:42 Job still running ...
2022/03/21 10:16:12 Job still running ...
2022/03/21 10:16:42 Job still running ...
2022/03/21 10:17:12 Job still running ...
2022/03/21 10:17:42 Job still running ...
2022/03/21 10:18:13 Failed to execute job: job 2022-03-21_03_14_42-1593659086409336892 failed
panic: Failed to execute job: job 2022-03-21_03_14_42-1593659086409336892 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11515e8, 0xc0000480c0, 0x103e969, 0x19, 0xc000405e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/jhav4tznilono
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #455
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/455/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14122] Upgrade pip-licenses dependency (#17132)
------------------------------------------
[...truncated 17.32 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647771281937535505/****\022@b99141a92c2add70ddbe77d41dc70d55cdb80e82671b4a517490ac16b3227be2"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/20 10:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647771281937535505/model
2022/03/20 10:14:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0320100234"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647771281937535505/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647771281937535505/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0320100234",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/20 10:14:43 Submitted job: 2022-03-20_03_14_42-15900324607098333908
2022/03/20 10:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-20_03_14_42-15900324607098333908?project=apache-beam-testing
2022/03/20 10:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-20_03_14_42-15900324607098333908
2022/03/20 10:14:43 Job state: JOB_STATE_PENDING ...
2022/03/20 10:15:13 Job still running ...
2022/03/20 10:15:43 Job still running ...
2022/03/20 10:16:13 Job still running ...
2022/03/20 10:16:43 Job still running ...
2022/03/20 10:17:13 Job still running ...
2022/03/20 10:17:43 Job still running ...
2022/03/20 10:18:14 Failed to execute job: job 2022-03-20_03_14_42-15900324607098333908 failed
panic: Failed to execute job: job 2022-03-20_03_14_42-15900324607098333908 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11515e8, 0xc000120000, 0x103e969, 0x19, 0xc00050fe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/msqoklesmtugk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #454
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/454/display/redirect?page=changes>
Changes:
[Kiley Sok] Add Java 17 Nexmark metrics to Grafana
[yiru] .
[yiru] .
[yiru] .
[yiru] format fix
[yiru] .
[yiru] make DoFn into a separate class
[yiru] .
[yiru] fix setting
[mmack] [adhoc] Minor cleanup for aws2 tests
[mmack] [BEAM-14125] Update website IO matrix to recommend aws2 IOs
[noreply] [BEAM-14128] Eliminating quadratic behavior of
[noreply] [BEAM-13972] Add RunInference interface (#16917)
[noreply] Merge pull request #17116 from [BEAM-12164] Remove change_stream in
[yiru] fix checkstyle
[yiru] spotlessapply
[noreply] Deprecate tags.go (#17025)
[noreply] [BEAM-12753] and [BEAM-12815] Fix Flink Integration Tests (#17067)
[noreply] Merge pull request #16895 from [BEAM-13882][Playground] More tests for
[noreply] [BEAM-13925] Add weekly automation to update our reviewer config
[noreply] Merge pull request #17076 from Beam 14082 update payground for mobile
[noreply] [BEAM-13925] Assign committers in the scheduled action (#17062)
[noreply] Pin setup-gcloud to v0 instead of master (#17123)
[noreply] [BEAM-3304] documentation for PaneInfo in BPG (#17047)
[noreply] Merge pull request #17016 from [BEAM-14049][Playground] Add new API
[noreply] Merge pull request #17077 from [BEAM-14078] [Website] change link
[noreply] Merge pull request #17085 from [BEAM-14077] [Website] add beam
[noreply] Update Changes.md w/Go pipeline pre-process fix.
[noreply] [BEAM-14098] wrapper for postgres on JDBC IO GO SDK (#17088)
[noreply] Merge pull request #17023 from [BEAM-12164]: Remove child partition
------------------------------------------
[...truncated 17.38 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647684886956516790/****\022@b99141a92c2add70ddbe77d41dc70d55cdb80e82671b4a517490ac16b3227be2"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/19 10:14:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647684886956516790/model
2022/03/19 10:14:47 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0319100246"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647684886956516790/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647684886956516790/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0319100246",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/19 10:14:48 Submitted job: 2022-03-19_03_14_47-190635904394226332
2022/03/19 10:14:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-19_03_14_47-190635904394226332?project=apache-beam-testing
2022/03/19 10:14:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-19_03_14_47-190635904394226332
2022/03/19 10:14:48 Job state: JOB_STATE_PENDING ...
2022/03/19 10:15:18 Job state: JOB_STATE_PENDING ...
2022/03/19 10:15:48 Job state: JOB_STATE_PENDING ...
2022/03/19 10:16:18 Job still running ...
2022/03/19 10:16:48 Job still running ...
2022/03/19 10:17:18 Job still running ...
2022/03/19 10:17:48 Job still running ...
2022/03/19 10:18:18 Job still running ...
2022/03/19 10:18:48 Job still running ...
2022/03/19 10:19:18 Job still running ...
2022/03/19 10:19:48 Failed to execute job: job 2022-03-19_03_14_47-190635904394226332 failed
panic: Failed to execute job: job 2022-03-19_03_14_47-190635904394226332 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11515e8, 0xc000198000, 0x103e969, 0x19, 0xc000355e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 24s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/bhz5caiplf7kg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #453
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/453/display/redirect?page=changes>
Changes:
[Luke Cwik] [BEAM-10212] Clean-up comments, remove rawtypes usage.
[noreply] [BEAM-11934] Add enable_file_dynamic_sharding to allow DataflowRunner
[noreply] [BEAM-12777] Create symlink for `current` directory (#17105)
[noreply] [BEAM-14020] Adding SchemaTransform, SchemaTransformProvider,
[noreply] [BEAM-13015] Modify metrics to begin and reset to a non-dirty state.
[noreply] [BEAM-14112] Avoid storing a generator in _CustomBigQuerySource (#17100)
[noreply] Populate environment capabilities in v1beta3 protos. (#17042)
[Kyle Weaver] [BEAM-12976] Test a whole pipeline using projection pushdown in BQ IO.
[Kyle Weaver] [BEAM-12976] Enable projection pushdown for Java pipelines on Dataflow,
[noreply] [BEAM-14038] Auto-startup for Python expansion service. (#17035)
[Kyle Weaver] [BEAM-14123] Fix typo in hdfsIntegrationTest task name.
[noreply] [BEAM-13893] improved coverage of jobopts package (#17003)
[noreply] Merge pull request #16977 from [BEAM-12164] Added integration test for
------------------------------------------
[...truncated 17.42 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647598488457088635/****\022@63adb1ccf36a82905b2586a432719f709f0da7be4aa85336991861fcf564f950"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/18 10:14:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647598488457088635/model
2022/03/18 10:14:49 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0318100240"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647598488457088635/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647598488457088635/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0318100240",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/18 10:14:49 Submitted job: 2022-03-18_03_14_49-1930818338769799004
2022/03/18 10:14:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-18_03_14_49-1930818338769799004?project=apache-beam-testing
2022/03/18 10:14:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-18_03_14_49-1930818338769799004
2022/03/18 10:14:49 Job state: JOB_STATE_PENDING ...
2022/03/18 10:15:19 Job still running ...
2022/03/18 10:15:49 Job still running ...
2022/03/18 10:16:19 Job still running ...
2022/03/18 10:16:49 Job still running ...
2022/03/18 10:17:19 Job still running ...
2022/03/18 10:17:50 Job still running ...
2022/03/18 10:18:20 Failed to execute job: job 2022-03-18_03_14_49-1930818338769799004 failed
panic: Failed to execute job: job 2022-03-18_03_14_49-1930818338769799004 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151608, 0xc000120000, 0x103e969, 0x19, 0xc00034de00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 56s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/33g3j54bi7pmg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #452
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/452/display/redirect?page=changes>
Changes:
[noreply] Mapped JOB_STATE_RESOURCE_CLEANING_UP to State.RUNNING.
[ryanthompson591] fixed typo in typehints
[zyichi] Remove unused prebuild_sdk_container_base_iamge option from validate
[hengfeng] feat: add more custom metrics
[noreply] [BEAM-14103][Playgrounf][Bugfix] Fix google analytics id (#17092)
[noreply] Minor: Make ScopedReadStateSupplier final (#16992)
[noreply] [BEAM-14113] Improve SamzaJobServerDriver extensibility (#17099)
[noreply] [BEAM-14116] Chunk commit requests dynamically (#17004)
[noreply] Merge pull request #17079 from [BEAM-13660] Add types and queries in
[noreply] [BEAM-13888] Add unit testing to ioutilx (#17058)
[noreply] Merge pull request #16822 from [BEAM-13841][Playground] Add Application
[noreply] Minor: Make serializableCoder warning gramatically correct english
[noreply] [BEAM-14091] Fixing Interactive Beam show/collect for remote runners
------------------------------------------
[...truncated 17.39 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647512084636689391/****\022@cc31d7b4e20b75e019774efa4fac7ffd36cfffe90bc12eb87d96700ef4e69ba4"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/17 10:14:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647512084636689391/model
2022/03/17 10:14:45 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0317100239"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647512084636689391/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647512084636689391/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0317100239",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/17 10:14:45 Submitted job: 2022-03-17_03_14_45-10407087370645164023
2022/03/17 10:14:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-17_03_14_45-10407087370645164023?project=apache-beam-testing
2022/03/17 10:14:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-17_03_14_45-10407087370645164023
2022/03/17 10:14:45 Job state: JOB_STATE_PENDING ...
2022/03/17 10:15:15 Job still running ...
2022/03/17 10:15:46 Job still running ...
2022/03/17 10:16:16 Job still running ...
2022/03/17 10:16:46 Job still running ...
2022/03/17 10:17:16 Job still running ...
2022/03/17 10:17:46 Job still running ...
2022/03/17 10:18:16 Failed to execute job: job 2022-03-17_03_14_45-10407087370645164023 failed
panic: Failed to execute job: job 2022-03-17_03_14_45-10407087370645164023 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151528, 0xc000120000, 0x103e889, 0x19, 0xc00040de00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vu2mzx5vfjxdc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #451
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/451/display/redirect?page=changes>
Changes:
[Chamikara Madhusanka Jayalath] Updates x-lang release validation to use staged jars
[dhuntsperger] documented maven-to-gradle conversion for Dataflow; refactored java
[dhuntsperger] adding a list of example pipelines
[dhuntsperger] removing unnecessary `ls` command from maven project generation
[mmack] [BEAM-13175] Add KinesisIO.write for AWS SDK v2.
[dhuntsperger] fixing filename formatting in response to feedback
[dhuntsperger] adding extra step emphasizing runner setupt
[dhuntsperger] reorganized instructions to emphasize setup steps for runners
[mmack] [BEAM-13175] Document changes to IOs in amazon-web-services2 for AWS
[noreply] [BEAM-13767] Move a bunch of python tasks to use gradle configuration…
[noreply] Merge pull request #17052 from [BEAM-13818] [SnowflakeIO] Add support
[noreply] Adding pydoc for StateHandler (#17091)
[noreply] BEAM-3165 Bypass split if numSplit is zero (#17084)
------------------------------------------
[...truncated 17.39 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647425683216495624/****\022@cc31d7b4e20b75e019774efa4fac7ffd36cfffe90bc12eb87d96700ef4e69ba4"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/16 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647425683216495624/model
2022/03/16 10:14:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0316100245"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647425683216495624/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647425683216495624/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0316100245",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/16 10:14:46 Submitted job: 2022-03-16_03_14_43-780210040161135301
2022/03/16 10:14:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-16_03_14_43-780210040161135301?project=apache-beam-testing
2022/03/16 10:14:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-16_03_14_43-780210040161135301
2022/03/16 10:14:46 Job state: JOB_STATE_PENDING ...
2022/03/16 10:15:16 Job still running ...
2022/03/16 10:15:46 Job still running ...
2022/03/16 10:16:16 Job still running ...
2022/03/16 10:16:46 Job still running ...
2022/03/16 10:17:16 Job still running ...
2022/03/16 10:17:46 Job still running ...
2022/03/16 10:18:16 Failed to execute job: job 2022-03-16_03_14_43-780210040161135301 failed
panic: Failed to execute job: job 2022-03-16_03_14_43-780210040161135301 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151528, 0xc000120000, 0x103e889, 0x19, 0xc0005d5e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/6bb43rpxymf3q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #450
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/450/display/redirect?page=changes>
Changes:
[benjamin.gonzalez] [BEAM-12572] Add DistinctExample test
[benjamin.gonzalez] [BEAM-12572] Add DistinctExample test
[benjamin.gonzalez] [BEAM-12572] Add java examples tests
[benjamin.gonzalez] [BEAM-12572] Change tests collected by runner
[benjamin.gonzalez] [BEAM-12572] Fix PipelineOptions, skip tests for specific runners
[benjamin.gonzalez] [BEAM-12572] Skip failing tests
[benjamin.gonzalez] [BEAM-12572] Fix checkstyle warnings
[benjamin.gonzalez] [BEAM-12572] Skip tfidf tests on direct runner
[benjamin.gonzalez] [BEAM-12572] Fix PipelineOptions
[benjamin.gonzalez] [BEAM-12572] Fix checkstyle warning
[benjamin.gonzalez] [BEAM-12572] Enable test with Pipeline serialization error fixed, link
[benjamin.gonzalez] [BEAM-12572] Sickbay TfIdf test for DirectRunner
[benjamin.gonzalez] [BEAM-12572] Refactor naming for BigQueryClient
[mmack] [adhoc] Update owners for aws modules
[noreply] [BEAM-14051] Add a warning to gradle.properties that many Beam modules
[noreply] Merge pull request #17000 from [BEAM-13881] [Playground] Increase test
[noreply] Add deterministic dict coding via key sorting. (#17037)
[noreply] Merge pull request #17054 from [BEAM-14075] [SnowflakeIO] Change a
------------------------------------------
[...truncated 17.37 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647339284468111973/****\022@cc31d7b4e20b75e019774efa4fac7ffd36cfffe90bc12eb87d96700ef4e69ba4"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/15 10:14:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647339284468111973/model
2022/03/15 10:14:45 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0315100244"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647339284468111973/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647339284468111973/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0315100244",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/15 10:14:45 Submitted job: 2022-03-15_03_14_45-9097755084072332160
2022/03/15 10:14:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-15_03_14_45-9097755084072332160?project=apache-beam-testing
2022/03/15 10:14:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-15_03_14_45-9097755084072332160
2022/03/15 10:14:45 Job state: JOB_STATE_PENDING ...
2022/03/15 10:15:15 Job still running ...
2022/03/15 10:15:45 Job still running ...
2022/03/15 10:16:15 Job still running ...
2022/03/15 10:16:45 Job still running ...
2022/03/15 10:17:16 Job still running ...
2022/03/15 10:17:46 Job still running ...
2022/03/15 10:18:16 Failed to execute job: job 2022-03-15_03_14_45-9097755084072332160 failed
panic: Failed to execute job: job 2022-03-15_03_14_45-9097755084072332160 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151528, 0xc0000480c0, 0x103e889, 0x19, 0xc0008abe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ro2w5p35ciis2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #449
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/449/display/redirect>
Changes:
------------------------------------------
[...truncated 17.37 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647252883530348502/****\022@cc31d7b4e20b75e019774efa4fac7ffd36cfffe90bc12eb87d96700ef4e69ba4"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/14 10:14:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647252883530348502/model
2022/03/14 10:14:44 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0314100232"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647252883530348502/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647252883530348502/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0314100232",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/14 10:14:44 Submitted job: 2022-03-14_03_14_44-7176373392722179813
2022/03/14 10:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-14_03_14_44-7176373392722179813?project=apache-beam-testing
2022/03/14 10:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-14_03_14_44-7176373392722179813
2022/03/14 10:14:44 Job state: JOB_STATE_PENDING ...
2022/03/14 10:15:14 Job still running ...
2022/03/14 10:15:44 Job still running ...
2022/03/14 10:16:14 Job still running ...
2022/03/14 10:16:45 Job still running ...
2022/03/14 10:17:15 Job still running ...
2022/03/14 10:17:45 Job still running ...
2022/03/14 10:18:15 Job still running ...
2022/03/14 10:18:45 Failed to execute job: job 2022-03-14_03_14_44-7176373392722179813 failed
panic: Failed to execute job: job 2022-03-14_03_14_44-7176373392722179813 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151528, 0xc000120000, 0x103e889, 0x19, 0xc0001dbe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m 22s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/bpw3bmyevmlps
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #448
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/448/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14072] [BEAM-13993] [BEAM-10039] Import beam plugins before
------------------------------------------
[...truncated 17.36 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647166483220988423/****\022@cc31d7b4e20b75e019774efa4fac7ffd36cfffe90bc12eb87d96700ef4e69ba4"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/13 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647166483220988423/model
2022/03/13 10:14:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0313100239"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647166483220988423/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647166483220988423/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0313100239",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/13 10:14:44 Submitted job: 2022-03-13_03_14_43-3729027099174062322
2022/03/13 10:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-13_03_14_43-3729027099174062322?project=apache-beam-testing
2022/03/13 10:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-13_03_14_43-3729027099174062322
2022/03/13 10:14:44 Job state: JOB_STATE_PENDING ...
2022/03/13 10:15:14 Job still running ...
2022/03/13 10:15:44 Job still running ...
2022/03/13 10:16:14 Job still running ...
2022/03/13 10:16:44 Job still running ...
2022/03/13 10:17:15 Job still running ...
2022/03/13 10:17:45 Job still running ...
2022/03/13 10:18:15 Failed to execute job: job 2022-03-13_03_14_43-3729027099174062322 failed
panic: Failed to execute job: job 2022-03-13_03_14_43-3729027099174062322 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151528, 0xc00018a000, 0x103e889, 0x19, 0xc0004cde00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/jl7r5s5ywdtmo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #447
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/447/display/redirect?page=changes>
Changes:
[Ismaël Mejía] [BEAM-13981] Remove Spark Runner specific code for event logging
[vitaly.terentyev] [BEAM-2766] Support null key/values in HadoopFormatIO
[vitaly.terentyev] [BEAM-2766] Fix checkstyle
------------------------------------------
[...truncated 17.35 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647080084372174529/****\022@cc31d7b4e20b75e019774efa4fac7ffd36cfffe90bc12eb87d96700ef4e69ba4"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/12 10:14:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647080084372174529/model
2022/03/12 10:14:45 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0312100230"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647080084372174529/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647080084372174529/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0312100230",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/12 10:14:45 Submitted job: 2022-03-12_02_14_45-7764437779426937775
2022/03/12 10:14:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-12_02_14_45-7764437779426937775?project=apache-beam-testing
2022/03/12 10:14:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-12_02_14_45-7764437779426937775
2022/03/12 10:14:45 Job state: JOB_STATE_PENDING ...
2022/03/12 10:15:15 Job still running ...
2022/03/12 10:15:45 Job still running ...
2022/03/12 10:16:15 Job still running ...
2022/03/12 10:16:45 Job still running ...
2022/03/12 10:17:15 Job still running ...
2022/03/12 10:17:45 Job still running ...
2022/03/12 10:18:16 Failed to execute job: job 2022-03-12_02_14_45-7764437779426937775 failed
panic: Failed to execute job: job 2022-03-12_02_14_45-7764437779426937775 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151528, 0xc00019a000, 0x103e889, 0x19, 0xc000493e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/rpjpfyy342iii
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #446
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/446/display/redirect?page=changes>
Changes:
[ihr] [BEAM-13923] Fix the answers placeholders locations in the Java katas
[jakub.kukul] [BEAM-14039] Propagate ignore_unknown_columns parameter.
[stranniknm] [BEAM-14079] playground - improve accessibility
[noreply] [BEAM-13925] Find and address prs that havent been reviewed in a week
[noreply] Fix import path
[noreply] [BEAM-13925] Fix one more import path
[noreply] Add a StatefulDoFn test that sets event time timer within allowed
[noreply] Merge pull request #17056 from [BEAM-14076] [SnowflakeIO] Add support
------------------------------------------
[...truncated 17.36 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646993686835923623/****\022@cc31d7b4e20b75e019774efa4fac7ffd36cfffe90bc12eb87d96700ef4e69ba4"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/11 10:14:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646993686835923623/model
2022/03/11 10:14:47 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0311100229"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646993686835923623/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646993686835923623/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0311100229",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/11 10:14:48 Submitted job: 2022-03-11_02_14_47-11153576364131134789
2022/03/11 10:14:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-11_02_14_47-11153576364131134789?project=apache-beam-testing
2022/03/11 10:14:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-11_02_14_47-11153576364131134789
2022/03/11 10:14:48 Job state: JOB_STATE_PENDING ...
2022/03/11 10:15:18 Job still running ...
2022/03/11 10:15:48 Job still running ...
2022/03/11 10:16:18 Job still running ...
2022/03/11 10:16:48 Job still running ...
2022/03/11 10:17:18 Job still running ...
2022/03/11 10:17:48 Job still running ...
2022/03/11 10:18:18 Failed to execute job: job 2022-03-11_02_14_47-11153576364131134789 failed
panic: Failed to execute job: job 2022-03-11_02_14_47-11153576364131134789 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151528, 0xc000198000, 0x103e889, 0x19, 0xc0002e3e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/5zmbppxwqvdoy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #445
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/445/display/redirect?page=changes>
Changes:
[hengfeng] [BEAM-12164]: display the metadata table's name on UI
[noreply] Revert "[BEAM-13993] [BEAM-10039] Import beam plugins before starting
[noreply] Merge pull request #17036 from [BEAM-12164] Convert all static instances
[noreply] fix variable reference (#16991)
[noreply] Merge pull request #16844 from [BEAM-12164]: allow for nanosecond
[noreply] [BEAM-13904] Increase unit testing in the reflectx package (#17024)
------------------------------------------
[...truncated 17.43 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646907280549481033/****\022@cc31d7b4e20b75e019774efa4fac7ffd36cfffe90bc12eb87d96700ef4e69ba4"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/10 10:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646907280549481033/model
2022/03/10 10:14:41 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0308201252"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646907280549481033/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646907280549481033/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0308201252",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/10 10:14:41 Submitted job: 2022-03-10_02_14_41-7256181793274303501
2022/03/10 10:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-10_02_14_41-7256181793274303501?project=apache-beam-testing
2022/03/10 10:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-10_02_14_41-7256181793274303501
2022/03/10 10:14:41 Job state: JOB_STATE_PENDING ...
2022/03/10 10:15:11 Job still running ...
2022/03/10 10:15:41 Job still running ...
2022/03/10 10:16:11 Job still running ...
2022/03/10 10:16:42 Job still running ...
2022/03/10 10:17:12 Job still running ...
2022/03/10 10:17:42 Job still running ...
2022/03/10 10:18:12 Failed to execute job: job 2022-03-10_02_14_41-7256181793274303501 failed
panic: Failed to execute job: job 2022-03-10_02_14_41-7256181793274303501 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151528, 0xc000120000, 0x103e889, 0x19, 0xc0003ffe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/mvtnx624dkmzq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #444
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/444/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Update dataflow API client.
[Robert Bradshaw] Instructions for updating apitools generated files.
[noreply] Merge pull request #17027: [BEAM-11205] Upgrade GCP Libraries BOM
[noreply] [BEAM-13709] Inconsistent behavior when parsing boolean flags across
[noreply] [BEAM-10976] Bundle finalization: Harness and some exec changes (#16980)
[noreply] Merge pull request #16976 from [BEAM-14010] [Website] Add Playground
[noreply] [BEAM-12447] Upgrade cloud build client and add/cleanup options (#17032)
------------------------------------------
[...truncated 17.28 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646820882580552028/****\022@cc31d7b4e20b75e019774efa4fac7ffd36cfffe90bc12eb87d96700ef4e69ba4"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/09 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646820882580552028/model
2022/03/09 10:14:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0308201252"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646820882580552028/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646820882580552028/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0308201252",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/09 10:14:43 Submitted job: 2022-03-09_02_14_43-17074273777172844711
2022/03/09 10:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-09_02_14_43-17074273777172844711?project=apache-beam-testing
2022/03/09 10:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-09_02_14_43-17074273777172844711
2022/03/09 10:14:44 Job state: JOB_STATE_PENDING ...
2022/03/09 10:15:14 Job still running ...
2022/03/09 10:15:44 Job still running ...
2022/03/09 10:16:14 Job still running ...
2022/03/09 10:16:44 Job still running ...
2022/03/09 10:17:14 Job still running ...
2022/03/09 10:17:44 Job still running ...
2022/03/09 10:18:14 Failed to execute job: job 2022-03-09_02_14_43-17074273777172844711 failed
panic: Failed to execute job: job 2022-03-09_02_14_43-17074273777172844711 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151528, 0xc000120000, 0x103e889, 0x19, 0xc00062fe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 42s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/omfu4okmpmmis
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #443
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/443/display/redirect?page=changes>
Changes:
[dannymccormick] [BEAM-11085] Test that windows are correctly observed in DoFns
[jrmccluskey] [BEAM-14050] Update taxi.go example instructions
[noreply] Give pr bot write permissions on pr update
[noreply] Adding a logical type for Schemas using proto serialization. (#16940)
[noreply] BEAM-13765 missing PAssert methods (#16668)
[noreply] [BEAM-13909] improve coverage of Provision package (#17014)
------------------------------------------
[...truncated 17.34 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646734485483867838/****\022@130ee2900930181c6a6ff5da8154f6af61480a92572cc81af4421d6d3ca28622"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/08 10:14:46 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646734485483867838/model
2022/03/08 10:14:46 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0308101108"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646734485483867838/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646734485483867838/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0308101108",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/08 10:14:46 Submitted job: 2022-03-08_02_14_46-9341623692286405726
2022/03/08 10:14:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-08_02_14_46-9341623692286405726?project=apache-beam-testing
2022/03/08 10:14:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-08_02_14_46-9341623692286405726
2022/03/08 10:14:46 Job state: JOB_STATE_PENDING ...
2022/03/08 10:15:16 Job still running ...
2022/03/08 10:15:46 Job still running ...
2022/03/08 10:16:17 Job still running ...
2022/03/08 10:16:47 Job still running ...
2022/03/08 10:17:17 Job still running ...
2022/03/08 10:17:47 Job still running ...
2022/03/08 10:18:17 Failed to execute job: job 2022-03-08_02_14_46-9341623692286405726 failed
panic: Failed to execute job: job 2022-03-08_02_14_46-9341623692286405726 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e328, 0xc000120000, 0x103bc69, 0x19, 0xc0003f5e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/esyyyrb3angsk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #442
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/442/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13925] Add ability to get metrics on pr-bot performance (#16985)
------------------------------------------
[...truncated 17.34 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646648081425597513/****\022@130ee2900930181c6a6ff5da8154f6af61480a92572cc81af4421d6d3ca28622"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/07 10:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646648081425597513/model
2022/03/07 10:14:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0307101138"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646648081425597513/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646648081425597513/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0307101138",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/07 10:14:43 Submitted job: 2022-03-07_02_14_42-17252137627993791265
2022/03/07 10:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-07_02_14_42-17252137627993791265?project=apache-beam-testing
2022/03/07 10:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-07_02_14_42-17252137627993791265
2022/03/07 10:14:43 Job state: JOB_STATE_PENDING ...
2022/03/07 10:15:13 Job still running ...
2022/03/07 10:15:43 Job still running ...
2022/03/07 10:16:13 Job still running ...
2022/03/07 10:16:43 Job still running ...
2022/03/07 10:17:13 Job still running ...
2022/03/07 10:17:43 Job still running ...
2022/03/07 10:18:14 Failed to execute job: job 2022-03-07_02_14_42-17252137627993791265 failed
panic: Failed to execute job: job 2022-03-07_02_14_42-17252137627993791265 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e328, 0xc000120000, 0x103bc69, 0x19, 0xc0004e5e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/rnz7zeptjab2i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #441
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/441/display/redirect>
Changes:
------------------------------------------
[...truncated 17.43 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646580037958759074/****\022@130ee2900930181c6a6ff5da8154f6af61480a92572cc81af4421d6d3ca28622"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/06 15:20:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646580037958759074/model
2022/03/06 15:20:38 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0306143629"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646580037958759074/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646580037958759074/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0306143629",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/06 15:20:39 Submitted job: 2022-03-06_07_20_38-6146876003145984577
2022/03/06 15:20:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-06_07_20_38-6146876003145984577?project=apache-beam-testing
2022/03/06 15:20:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-06_07_20_38-6146876003145984577
2022/03/06 15:20:39 Job state: JOB_STATE_PENDING ...
2022/03/06 15:21:09 Job still running ...
2022/03/06 15:21:39 Job still running ...
2022/03/06 15:22:09 Job still running ...
2022/03/06 15:22:39 Job still running ...
2022/03/06 15:23:09 Job still running ...
2022/03/06 15:23:39 Job still running ...
2022/03/06 15:24:09 Failed to execute job: job 2022-03-06_07_20_38-6146876003145984577 failed
panic: Failed to execute job: job 2022-03-06_07_20_38-6146876003145984577 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e328, 0xc0000480c0, 0x103bc69, 0x19, 0xc00040be00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 56s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/blbsvwcgqgdwu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #440
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/440/display/redirect?page=changes>
Changes:
[rahuliyer573] py: Import beam plugins before starting SdkHarness
[stephen.patel] BEAM-14011 fix s3 filesystem multipart copy
[Valentyn Tymofieiev] Bump numpy bound to include 1.22 and regenerate container deps.
[github-actions] [BEAM-13925] months in date constructor are 0 indexed
[noreply] Merge pull request #16842 from [BEAM-13932][Playground] Container's user
[noreply] Doc updates and blog post for 2.37.0 (#16887)
[noreply] Remove resolved issue in docs + update class path on sample (#17018)
[noreply] [BEAM-14016] Fixed flaky postcommit test (#17009)
[noreply] Remove resolved issue in notebook
[noreply] [BEAM-13947] Add split() and rsplit(), non-deferred column operations on
[noreply] BEAM-14026 - Fixes bug related to Unnesting nested rows in an array
------------------------------------------
[...truncated 17.42 KB...]
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646475286001744202/****\022@130ee2900930181c6a6ff5da8154f6af61480a92572cc81af4421d6d3ca28622"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/05 10:14:46 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646475286001744202/model
2022/03/05 10:14:46 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0305100233"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646475286001744202/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646475286001744202/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0305100233",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/05 10:14:47 Submitted job: 2022-03-05_02_14_46-8768718869014961927
2022/03/05 10:14:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-05_02_14_46-8768718869014961927?project=apache-beam-testing
2022/03/05 10:14:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-05_02_14_46-8768718869014961927
2022/03/05 10:14:47 Job state: JOB_STATE_PENDING ...
2022/03/05 10:15:17 Job still running ...
2022/03/05 10:15:47 Job still running ...
2022/03/05 10:16:17 Job still running ...
2022/03/05 10:16:47 Job still running ...
2022/03/05 10:17:18 Job still running ...
2022/03/05 10:17:48 Job still running ...
2022/03/05 10:18:18 Job still running ...
2022/03/05 10:18:48 Job still running ...
2022/03/05 10:19:18 Job still running ...
2022/03/05 10:19:48 Job still running ...
2022/03/05 10:20:18 Job still running ...
2022/03/05 10:20:48 Failed to execute job: job 2022-03-05_02_14_46-8768718869014961927 failed
panic: Failed to execute job: job 2022-03-05_02_14_46-8768718869014961927 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e328, 0xc000120000, 0x103bc69, 0x19, 0xc0001f9e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 6m 24s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/k63nplrx5x5x6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #439
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/439/display/redirect?page=changes>
Changes:
[stranniknm] [BEAM-13999] playground - support vertical orientation for graph
[noreply] [adhoc] Prepare aws2 ClientConfiguration for json serialization and
[noreply] Merge pull request #16879 from [BEAM-12164] Add javadocs to
[noreply] [Cleanup] Update pre-v2 go package references (#17002)
[noreply] [BEAM-13885] Add unit tests to window package (#16971)
[noreply] Merge pull request #16891 from [BEAM-13872] [Playground] Increase test
[noreply] Merge pull request #16912 from [BEAM-13878] [Playground] Increase test
[noreply] Merge pull request #16946 from [BEAM-13873] [Playground] Increase test
[noreply] [BEAM-13951] Update mass_comment.py list of Run commands (#16889)
[noreply] [BEAM-10652] Allow Clustering without Partition in BigQuery (#16578)
[noreply] [BEAM-13857] Add K:V flags for expansion service jars and addresses to
------------------------------------------
[...truncated 17.41 KB...]
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646388881251825556/****\022@130ee2900930181c6a6ff5da8154f6af61480a92572cc81af4421d6d3ca28622"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/04 10:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646388881251825556/model
2022/03/04 10:14:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0304100243"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646388881251825556/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646388881251825556/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0304100243",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/04 10:14:42 Submitted job: 2022-03-04_02_14_42-8314986130251894279
2022/03/04 10:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-04_02_14_42-8314986130251894279?project=apache-beam-testing
2022/03/04 10:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-04_02_14_42-8314986130251894279
2022/03/04 10:14:42 Job state: JOB_STATE_PENDING ...
2022/03/04 10:15:12 Job still running ...
2022/03/04 10:15:42 Job still running ...
2022/03/04 10:16:12 Job still running ...
2022/03/04 10:16:42 Job still running ...
2022/03/04 10:17:13 Job still running ...
2022/03/04 10:17:43 Job still running ...
2022/03/04 10:18:13 Job still running ...
2022/03/04 10:18:43 Job still running ...
2022/03/04 10:19:13 Job still running ...
2022/03/04 10:19:43 Job still running ...
2022/03/04 10:20:13 Job still running ...
2022/03/04 10:20:43 Failed to execute job: job 2022-03-04_02_14_42-8314986130251894279 failed
panic: Failed to execute job: job 2022-03-04_02_14_42-8314986130251894279 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e328, 0xc0000480c0, 0x103bc69, 0x19, 0xc00034fe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 6m 20s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/uabtggaedurdy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #438
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/438/display/redirect?page=changes>
Changes:
[Alexey Romanenko] Bump org.mongodb:mongo-java-driver to 3.12.10
[noreply] [BEAM-13973] Link Dataproc Flink master URLs to the InteractiveRunner
[noreply] [BEAM-13925] Turn pr bot on for go prs (#16984)
[Pablo Estrada] Skipping flaky sad-path tests for Spanner changestreams
[noreply] [BEAM-13964] Bump kotlin to 1.6.x (#16882)
[noreply] Merge pull request #16906: [BEAM-13974] Handle idle Storage Api streams
[noreply] Merge pull request #16562 from [BEAM-13051][D] Enable pylint warnings
[noreply] [BEAM-13925] A couple small pr-bot bug fixes (#16996)
[noreply] [BEAM-14029] Add getter, setter for target maven repo (#16995)
[noreply] [BEAM-13903] Improve coverage of metricsx package (#16994)
[noreply] [BEAM-13892] Improve coverage of avroio package (#16990)
------------------------------------------
[...truncated 17.33 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646302482349501943/****\022@e3eab0e28fb1723802ae4da77b012d29df2fa1fbc2595924d0ace5a8366114c2"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/03 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646302482349501943/model
2022/03/03 10:14:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0303100241"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646302482349501943/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646302482349501943/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0303100241",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/03 10:14:43 Submitted job: 2022-03-03_02_14_43-14903980495470769206
2022/03/03 10:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-03_02_14_43-14903980495470769206?project=apache-beam-testing
2022/03/03 10:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-03_02_14_43-14903980495470769206
2022/03/03 10:14:43 Job state: JOB_STATE_PENDING ...
2022/03/03 10:15:13 Job still running ...
2022/03/03 10:15:43 Job still running ...
2022/03/03 10:16:14 Job still running ...
2022/03/03 10:16:44 Job still running ...
2022/03/03 10:17:14 Job still running ...
2022/03/03 10:17:44 Job still running ...
2022/03/03 10:18:14 Failed to execute job: job 2022-03-03_02_14_43-14903980495470769206 failed
panic: Failed to execute job: job 2022-03-03_02_14_43-14903980495470769206 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e328, 0xc0000480c0, 0x103bc69, 0x19, 0xc0004c3e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/tnvubqsuzy7mo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #437
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/437/display/redirect?page=changes>
Changes:
[egalpin] Use default context output rather than outputWithTimestamp for
[stranniknm] Palo Alto case study - fix link
[rogelio.hernandez] [BEAM-12777] Removed current docs version redirect
[noreply] Merge pull request #16850: [BEAM-11205] Upgrade Libraries BOM
[noreply] Merge pull request #16484 from [BEAM-13633] [Playground] Implement
[noreply] Add 2022 events blog post (#16975)
[noreply] Clean up Go formatter suggestions (#16973)
[noreply] [BEAM-14012] Add go fmt to Github Actions (#16978)
[noreply] [BEAM-13911] Add basic tests to Go direct runner. (#16979)
[noreply] [BEAM-13960] Add support for more types when converting from between row
------------------------------------------
[...truncated 17.36 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646216083196319405/****\022@dee6d2a64143b7ef5cb5ef2771c87e0a90ad5cdc014a6e93134fb1da4deb8b86"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/02 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646216083196319405/model
2022/03/02 10:14:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0302100238"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646216083196319405/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646216083196319405/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0302100238",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/02 10:14:44 Submitted job: 2022-03-02_02_14_43-5017896872493859574
2022/03/02 10:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-02_02_14_43-5017896872493859574?project=apache-beam-testing
2022/03/02 10:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-02_02_14_43-5017896872493859574
2022/03/02 10:14:44 Job state: JOB_STATE_PENDING ...
2022/03/02 10:15:14 Job still running ...
2022/03/02 10:15:44 Job still running ...
2022/03/02 10:16:14 Job still running ...
2022/03/02 10:16:44 Job still running ...
2022/03/02 10:17:15 Job still running ...
2022/03/02 10:17:45 Job still running ...
2022/03/02 10:18:15 Failed to execute job: job 2022-03-02_02_14_43-5017896872493859574 failed
panic: Failed to execute job: job 2022-03-02_02_14_43-5017896872493859574 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e2e8, 0xc000120000, 0x103bc29, 0x19, 0xc0002ffe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/2ttfkm2tvcbo6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #436
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/436/display/redirect?page=changes>
Changes:
[noreply] Build wheels for Python 3.9
[noreply] Merge pull request #16892 from [BEAM-13755] [Playground] Scroll the
[noreply] Merge pull request #16880 from [BEAM-13963][Playground] Get bucket name
[noreply] Merge pull request #16870 from [BEAM-13874][Playground] Tag multifile
[noreply] Merge pull request #16910 from [BEAM-13724] [Playground] Get the default
[noreply] [BEAM-14008] Fix incorrect guava import (#16966)
[noreply] Fix ignored exception in BatchSpannerRead. (#16960)
[noreply] [BEAM-13917] Improve coverage of databaseio package (#16956)
[noreply] [BEAM-13925] Add entry files to process new prs and pr updates for PR
[noreply] [BEAM-13899] Improve coverage of debug package (#16951)
[noreply] [BEAM-13907] Improve coverage of textio package (#16937)
[noreply] [BEAM-9150] Fix beam_PostRelease_Python_Candidate (python RC validation
------------------------------------------
[...truncated 17.38 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646129803973110795/****\022@dee6d2a64143b7ef5cb5ef2771c87e0a90ad5cdc014a6e93134fb1da4deb8b86"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/01 10:16:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646129803973110795/model
2022/03/01 10:16:45 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0301100243"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646129803973110795/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646129803973110795/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0301100243",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/01 10:16:45 Submitted job: 2022-03-01_02_16_45-17370075997808827230
2022/03/01 10:16:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-01_02_16_45-17370075997808827230?project=apache-beam-testing
2022/03/01 10:16:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-01_02_16_45-17370075997808827230
2022/03/01 10:16:45 Job state: JOB_STATE_PENDING ...
2022/03/01 10:17:15 Job still running ...
2022/03/01 10:17:45 Job still running ...
2022/03/01 10:18:15 Job still running ...
2022/03/01 10:18:45 Job still running ...
2022/03/01 10:19:15 Job still running ...
2022/03/01 10:19:45 Job still running ...
2022/03/01 10:20:15 Failed to execute job: job 2022-03-01_02_16_45-17370075997808827230 failed
panic: Failed to execute job: job 2022-03-01_02_16_45-17370075997808827230 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e2e8, 0xc0000480c0, 0x103bc29, 0x19, 0xc00082fe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m 59s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/wf4kujmvdi7xy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #435
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/435/display/redirect>
Changes:
------------------------------------------
[...truncated 17.37 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646043281884640765/****\022@dee6d2a64143b7ef5cb5ef2771c87e0a90ad5cdc014a6e93134fb1da4deb8b86"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/28 10:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646043281884640765/model
2022/02/28 10:14:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0228100242"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646043281884640765/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646043281884640765/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0228100242",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/28 10:14:43 Submitted job: 2022-02-28_02_14_42-3845143920563014272
2022/02/28 10:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-28_02_14_42-3845143920563014272?project=apache-beam-testing
2022/02/28 10:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-28_02_14_42-3845143920563014272
2022/02/28 10:14:43 Job state: JOB_STATE_PENDING ...
2022/02/28 10:15:13 Job still running ...
2022/02/28 10:15:43 Job still running ...
2022/02/28 10:16:13 Job still running ...
2022/02/28 10:16:43 Job still running ...
2022/02/28 10:17:13 Job still running ...
2022/02/28 10:17:43 Job still running ...
2022/02/28 10:18:13 Failed to execute job: job 2022-02-28_02_14_42-3845143920563014272 failed
panic: Failed to execute job: job 2022-02-28_02_14_42-3845143920563014272 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e2e8, 0xc000128000, 0x103bc29, 0x19, 0xc000345e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/fsohzgddzcul2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #434
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/434/display/redirect>
Changes:
------------------------------------------
[...truncated 17.37 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645956878492157242/****\022@dee6d2a64143b7ef5cb5ef2771c87e0a90ad5cdc014a6e93134fb1da4deb8b86"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/27 10:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645956878492157242/model
2022/02/27 10:14:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0227100240"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645956878492157242/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645956878492157242/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0227100240",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/27 10:14:39 Submitted job: 2022-02-27_02_14_39-508089720478290676
2022/02/27 10:14:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-27_02_14_39-508089720478290676?project=apache-beam-testing
2022/02/27 10:14:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-27_02_14_39-508089720478290676
2022/02/27 10:14:39 Job state: JOB_STATE_PENDING ...
2022/02/27 10:15:09 Job still running ...
2022/02/27 10:15:39 Job still running ...
2022/02/27 10:16:09 Job still running ...
2022/02/27 10:16:39 Job still running ...
2022/02/27 10:17:10 Job still running ...
2022/02/27 10:17:40 Job still running ...
2022/02/27 10:18:10 Failed to execute job: job 2022-02-27_02_14_39-508089720478290676 failed
panic: Failed to execute job: job 2022-02-27_02_14_39-508089720478290676 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e2e8, 0xc0000480c0, 0x103bc29, 0x19, 0xc0008c1e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/kifpdf3p3ergu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #433
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/433/display/redirect?page=changes>
Changes:
[Ankur Goenka] [BEAM-13952] Sickbaying
[noreply] Memoize some objects for timer processing to reduce overhead. (#16207)
[noreply] [BEAM-13965] Use TypeDeserializer if type information is available to
[noreply] [BEAM-13912] Add more coverage for dataflow.go (#16903)
[noreply] [BEAM-12563] swaplevel general function for dataframe and series
[noreply] [BEAM-14001] Update coder.go unit tests (#16952)
[noreply] [BEAM-13910] Improve coverage of gcsx package (#16942)
[noreply] [BEAM-13015] Use a DirectExecutor for state since we are just completing
------------------------------------------
[...truncated 17.44 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645870481244632716/****\022@dee6d2a64143b7ef5cb5ef2771c87e0a90ad5cdc014a6e93134fb1da4deb8b86"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/26 10:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645870481244632716/model
2022/02/26 10:14:41 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0226100226"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645870481244632716/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645870481244632716/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0226100226",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/26 10:14:42 Submitted job: 2022-02-26_02_14_41-2885763646152486274
2022/02/26 10:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-26_02_14_41-2885763646152486274?project=apache-beam-testing
2022/02/26 10:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-26_02_14_41-2885763646152486274
2022/02/26 10:14:42 Job state: JOB_STATE_PENDING ...
2022/02/26 10:15:12 Job still running ...
2022/02/26 10:15:42 Job still running ...
2022/02/26 10:16:12 Job still running ...
2022/02/26 10:16:42 Job still running ...
2022/02/26 10:17:12 Job still running ...
2022/02/26 10:17:42 Job still running ...
2022/02/26 10:18:12 Job still running ...
2022/02/26 10:18:42 Job still running ...
2022/02/26 10:19:12 Job still running ...
2022/02/26 10:19:42 Job still running ...
2022/02/26 10:20:12 Failed to execute job: job 2022-02-26_02_14_41-2885763646152486274 failed
panic: Failed to execute job: job 2022-02-26_02_14_41-2885763646152486274 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e2e8, 0xc0000480c0, 0x103bc29, 0x19, 0xc00042be00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/3ojbr7qct52fc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #432
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/432/display/redirect?page=changes>
Changes:
[benjamin.gonzalez] Revert PR#16253 due errors with plugin flaky-test-handler
[noreply] Fix BoundedQueueExecutor and StreamingDataflowWorker to actually limit
[noreply] [BEAM-1857] Add Neo4jIO (#15916)
[noreply] [BEAM-13767] Migrate serveral portable runner tasks to use configuration
[noreply] [BEAM-13996] Removing 'No cluster_manager is associated with the
[noreply] [BEAM-13906] Improve coverage of errors package (#16934)
[noreply] [BEAM-13886] unit tests for trigger package (#16935)
[noreply] [BEAM-4767] Remove beam- prefix from release script tags (#16899)
[noreply] [BEAM-13866] Add small unit tests to errorx, make boolean assignment
[noreply] [BEAM-13925] Add most of the supporting files for the pr management
[noreply] Merge pull request #16846 from [BEAM-12164]: Add sad path tests for
------------------------------------------
[...truncated 17.33 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645784093866419374/****\022@c18bacecac2383a644bb3abcfb6f49927ad2540a14b36afa34203af399390a30"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/25 10:14:55 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645784093866419374/model
2022/02/25 10:14:55 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0225100231"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645784093866419374/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645784093866419374/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0225100231",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/25 10:14:55 Submitted job: 2022-02-25_02_14_55-8983979366048781811
2022/02/25 10:14:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-25_02_14_55-8983979366048781811?project=apache-beam-testing
2022/02/25 10:14:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-25_02_14_55-8983979366048781811
2022/02/25 10:14:55 Job state: JOB_STATE_PENDING ...
2022/02/25 10:15:25 Job still running ...
2022/02/25 10:15:55 Job still running ...
2022/02/25 10:16:25 Job still running ...
2022/02/25 10:16:55 Job still running ...
2022/02/25 10:17:25 Job still running ...
2022/02/25 10:17:55 Job still running ...
2022/02/25 10:18:26 Job still running ...
2022/02/25 10:18:56 Failed to execute job: job 2022-02-25_02_14_55-8983979366048781811 failed
panic: Failed to execute job: job 2022-02-25_02_14_55-8983979366048781811 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e328, 0xc000120000, 0x103bc29, 0x19, 0xc0002c9e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m 33s
12 actionable tasks: 10 executed, 1 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/76nhr4ojoppt6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #431
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/431/display/redirect?page=changes>
Changes:
[noreply] [BEAM-12645] Fix code-cov flakes due to monorepo. (#16925)
[noreply] [BEAM-13969] Deprecate stringx package (#16884)
[noreply] Add Go badge to ReadMe (#16897)
[noreply] [BEAM-13980] Re-add method gone missing in af2f8ee6 (#16918)
[noreply] [BEAM-13884] Improve mtime package (#16924)
[noreply] Minor: Update Go API doc links (#16932)
[noreply] [BEAM-13218] Re-enable
[noreply] Merge pull request #16857 from [BEAM-13662] [Playground] Support
[noreply] Merge pull request #16826 from [BEAM-13870] [Playground] Increase test
------------------------------------------
[...truncated 17.39 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645697691701433078/****\022@06b2b1ff1a096b207d45cb233fd490293370664fb10e55561252992874a06e51"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/24 10:14:52 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645697691701433078/model
2022/02/24 10:14:52 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0224100237"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645697691701433078/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645697691701433078/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0224100237",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/24 10:14:52 Submitted job: 2022-02-24_02_14_52-7643564027798748374
2022/02/24 10:14:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-24_02_14_52-7643564027798748374?project=apache-beam-testing
2022/02/24 10:14:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-24_02_14_52-7643564027798748374
2022/02/24 10:14:52 Job state: JOB_STATE_PENDING ...
2022/02/24 10:15:23 Job still running ...
2022/02/24 10:15:53 Job still running ...
2022/02/24 10:16:23 Job still running ...
2022/02/24 10:16:53 Job still running ...
2022/02/24 10:17:23 Job still running ...
2022/02/24 10:17:53 Job still running ...
2022/02/24 10:18:23 Failed to execute job: job 2022-02-24_02_14_52-7643564027798748374 failed
panic: Failed to execute job: job 2022-02-24_02_14_52-7643564027798748374 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e328, 0xc0000480c0, 0x103bc29, 0x19, 0xc000415e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m 1s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/c26nvodvud6qk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #430
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/430/display/redirect?page=changes>
Changes:
[Kyle Weaver] [BEAM-13796] projection pushdown in BQ IO
[Kyle Weaver] [BEAM-13796] Move test to ReadTest class and correct javadoc for
[Kyle Weaver] [BEAM-13796] Pushdown is not supported on TypedRead#fromQuery.
[noreply] [BEAM-13738] Reenable ignored SQS test after bumping elasticmq for fixed
[noreply] fix build status link (#16907)
[noreply] Merge pull request #16549 from [BEAM-13681][Playground] Refactoring
[noreply] Merge pull request #16732 from [BEAM-13825] [Playground] updated
[noreply] Merge pull request #16683 from [BEAM-13713][Playground] Java graph
[noreply] case study pages - improvements and fixes (#16896)
[noreply] Palo Alto case study (#16915)
------------------------------------------
[...truncated 17.36 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645611277567859738/****\022@2e4ca8196b8c4b8037478fd97031e0843441a6e4e4004f0918e593ec2c27afb7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/23 10:14:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645611277567859738/model
2022/02/23 10:14:38 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0223100246"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645611277567859738/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645611277567859738/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0223100246",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/23 10:14:38 Submitted job: 2022-02-23_02_14_38-8378722095194568122
2022/02/23 10:14:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-23_02_14_38-8378722095194568122?project=apache-beam-testing
2022/02/23 10:14:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-23_02_14_38-8378722095194568122
2022/02/23 10:14:38 Job state: JOB_STATE_PENDING ...
2022/02/23 10:15:09 Job still running ...
2022/02/23 10:15:39 Job still running ...
2022/02/23 10:16:09 Job still running ...
2022/02/23 10:16:39 Job still running ...
2022/02/23 10:17:09 Job still running ...
2022/02/23 10:17:39 Job still running ...
2022/02/23 10:18:09 Job still running ...
2022/02/23 10:18:39 Job still running ...
2022/02/23 10:19:09 Job still running ...
2022/02/23 10:19:39 Job still running ...
2022/02/23 10:20:09 Failed to execute job: job 2022-02-23_02_14_38-8378722095194568122 failed
panic: Failed to execute job: job 2022-02-23_02_14_38-8378722095194568122 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e328, 0xc0000480c0, 0x103bc29, 0x19, 0xc0003e7e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 47s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/t3yugq3m2quws
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #429
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/429/display/redirect>
Changes:
------------------------------------------
[...truncated 17.35 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645524880559853933/****\022@2e4ca8196b8c4b8037478fd97031e0843441a6e4e4004f0918e593ec2c27afb7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/22 10:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645524880559853933/model
2022/02/22 10:14:41 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0222101229"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645524880559853933/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645524880559853933/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0222101229",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/22 10:14:41 Submitted job: 2022-02-22_02_14_41-13920459919269008433
2022/02/22 10:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-22_02_14_41-13920459919269008433?project=apache-beam-testing
2022/02/22 10:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-22_02_14_41-13920459919269008433
2022/02/22 10:14:41 Job state: JOB_STATE_PENDING ...
2022/02/22 10:15:11 Job still running ...
2022/02/22 10:15:41 Job still running ...
2022/02/22 10:16:11 Job still running ...
2022/02/22 10:16:41 Job still running ...
2022/02/22 10:17:11 Job still running ...
2022/02/22 10:17:42 Job still running ...
2022/02/22 10:18:12 Failed to execute job: job 2022-02-22_02_14_41-13920459919269008433 failed
panic: Failed to execute job: job 2022-02-22_02_14_41-13920459919269008433 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e328, 0xc0000480c0, 0x103bc29, 0x19, 0xc000617e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/qvngpi3xd6ads
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #428
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/428/display/redirect>
Changes:
------------------------------------------
[...truncated 17.35 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645467491161768695/****\022@2e4ca8196b8c4b8037478fd97031e0843441a6e4e4004f0918e593ec2c27afb7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/21 18:18:12 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645467491161768695/model
2022/02/21 18:18:12 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0219185530"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645467491161768695/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645467491161768695/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0219185530",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/21 18:18:12 Submitted job: 2022-02-21_10_18_12-10143196914320321294
2022/02/21 18:18:12 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-21_10_18_12-10143196914320321294?project=apache-beam-testing
2022/02/21 18:18:12 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-21_10_18_12-10143196914320321294
2022/02/21 18:18:12 Job state: JOB_STATE_PENDING ...
2022/02/21 18:18:42 Job still running ...
2022/02/21 18:19:12 Job still running ...
2022/02/21 18:19:42 Job still running ...
2022/02/21 18:20:12 Job still running ...
2022/02/21 18:20:42 Job still running ...
2022/02/21 18:21:12 Job still running ...
2022/02/21 18:21:42 Failed to execute job: job 2022-02-21_10_18_12-10143196914320321294 failed
panic: Failed to execute job: job 2022-02-21_10_18_12-10143196914320321294 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e328, 0xc000118000, 0x103bc29, 0x19, 0xc0005c7e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m 24s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/uvr3o74iisxwg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #427
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/427/display/redirect?page=changes>
Changes:
[rogelio.hernandez] [BEAM-13051] Pylint misplaced-bare-raise warning enabled
[rogelio.hernandez] [BEAM-13051] Added descriptions to Kinesis and PortableRunner exceptions
[thiagotnunes] fix: fix bug when retrieving either string or json
[noreply] [BEAM-13812] Integrate DataprocClusterManager into Interactive
[noreply] [BEAM-12572] Fix failing python examples tests in Dataflow runner
[noreply] Remove build status from PR (#16902)
------------------------------------------
[...truncated 17.33 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645265682957389744/****\022@2e4ca8196b8c4b8037478fd97031e0843441a6e4e4004f0918e593ec2c27afb7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/19 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645265682957389744/model
2022/02/19 10:14:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0219100600"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645265682957389744/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645265682957389744/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0219100600",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/19 10:14:44 Submitted job: 2022-02-19_02_14_43-4718248788789815183
2022/02/19 10:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-19_02_14_43-4718248788789815183?project=apache-beam-testing
2022/02/19 10:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-19_02_14_43-4718248788789815183
2022/02/19 10:14:44 Job state: JOB_STATE_PENDING ...
2022/02/19 10:15:14 Job still running ...
2022/02/19 10:15:44 Job still running ...
2022/02/19 10:16:14 Job still running ...
2022/02/19 10:16:44 Job still running ...
2022/02/19 10:17:14 Job still running ...
2022/02/19 10:17:44 Job still running ...
2022/02/19 10:18:14 Failed to execute job: job 2022-02-19_02_14_43-4718248788789815183 failed
panic: Failed to execute job: job 2022-02-19_02_14_43-4718248788789815183 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e328, 0xc0000480c0, 0x103bc29, 0x19, 0xc00061de00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/xgpf4wzadmnpk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #426
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/426/display/redirect?page=changes>
Changes:
[Pablo Estrada] Simplify README for new users
[Kenneth Knowles] Disable AfterSynchronizedProcessingTime test on Dataflow
[mmack] [BEAM-13563] Introducing common AWS ClientBuilderFactory to unify
[laraschmidt] Fix final allowskew error to properly handle a large allowedSkew
[noreply] Case studies page improvements (#16702)
[noreply] [BEAM-13946] Add get_dummies(), a non-deferred column operation on
[noreply] [release-2.36.0] Fix pickler argument for 2.36 blog (#16774)
[noreply] [adhoc] Avoid using SerializablePipelineOptions for testing to minimize
------------------------------------------
[...truncated 17.30 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645179283219403776/****\022@2e4ca8196b8c4b8037478fd97031e0843441a6e4e4004f0918e593ec2c27afb7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/18 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645179283219403776/model
2022/02/18 10:14:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0218070007"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645179283219403776/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645179283219403776/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0218070007",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/18 10:14:44 Submitted job: 2022-02-18_02_14_43-3021059621877238302
2022/02/18 10:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-18_02_14_43-3021059621877238302?project=apache-beam-testing
2022/02/18 10:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-18_02_14_43-3021059621877238302
2022/02/18 10:14:44 Job state: JOB_STATE_PENDING ...
2022/02/18 10:15:14 Job still running ...
2022/02/18 10:15:44 Job still running ...
2022/02/18 10:16:14 Job still running ...
2022/02/18 10:16:44 Job still running ...
2022/02/18 10:17:14 Job still running ...
2022/02/18 10:17:44 Job still running ...
2022/02/18 10:18:14 Failed to execute job: job 2022-02-18_02_14_43-3021059621877238302 failed
panic: Failed to execute job: job 2022-02-18_02_14_43-3021059621877238302 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e328, 0xc000120000, 0x103bc29, 0x19, 0xc0005ede00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 41s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/2iwpqr4us4cby
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #425
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/425/display/redirect?page=changes>
Changes:
[Jeff Tapper] Update Java LTS roadmap info on website for Java 17
[Kyle Weaver] [BEAM-13106] Support Flink 1.14.
[Kyle Weaver] [BEAM-13106] Reuse executor instead of shutting it down mid-test.
[Kyle Weaver] [BEAM-13106] Prevent infinite wait in Flink savepoint test.
[Ismaël Mejía] [BEAM-13202] Fix typos on tests names for VarianceFnTest
[Ismaël Mejía] [BEAM-13202] Add Coder to CountIfFn.Accum
[Ismaël Mejía] [BEAM-13202] Reuse Count transform code since CountIf is a specific case
[Kenneth Knowles] Add test category UsesProcessingTimeTimers
[Kenneth Knowles] Label tests that need UsesProcessingTimeTimers
[Kenneth Knowles] Exclude UsesProcessingTimeTimers from SamzaRunner tests
[Kyle Weaver] [BEAM-13106] A couple additional fixes to FlinkSavepointTest.
[mmack] [adhoc] Migrate KinesisIOIT to use ITEnvironment for Localstack based IT
[noreply] [BEAM-13955] Fix pylint breakage from #16836 (#16867)
[relax] Fix TableRow conversion for the case of fields named "f"
[noreply] Bump dataflow.fnapi_container_version (#16874)
------------------------------------------
[...truncated 17.45 KB...]
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645092880307235613/****\022@2e4ca8196b8c4b8037478fd97031e0843441a6e4e4004f0918e593ec2c27afb7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/17 10:14:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645092880307235613/model
2022/02/17 10:14:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0217101331"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645092880307235613/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645092880307235613/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0217101331",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/17 10:14:41 Submitted job: 2022-02-17_02_14_41-17661266666365083673
2022/02/17 10:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-17_02_14_41-17661266666365083673?project=apache-beam-testing
2022/02/17 10:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-17_02_14_41-17661266666365083673
2022/02/17 10:14:41 Job state: JOB_STATE_PENDING ...
2022/02/17 10:15:11 Job still running ...
2022/02/17 10:15:41 Job still running ...
2022/02/17 10:16:11 Job still running ...
2022/02/17 10:16:41 Job still running ...
2022/02/17 10:17:11 Job still running ...
2022/02/17 10:17:41 Job still running ...
2022/02/17 10:18:11 Job still running ...
2022/02/17 10:18:41 Job still running ...
2022/02/17 10:19:11 Job still running ...
2022/02/17 10:19:41 Job still running ...
2022/02/17 10:20:12 Job still running ...
2022/02/17 10:20:42 Failed to execute job: job 2022-02-17_02_14_41-17661266666365083673 failed
panic: Failed to execute job: job 2022-02-17_02_14_41-17661266666365083673 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e328, 0xc0000480c0, 0x103bc29, 0x19, 0xc000295e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 6m 17s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/y2mmsioa6epgo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #424
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/424/display/redirect?page=changes>
Changes:
[stranniknm] [BEAM-13785] playground - enable scio sdk
[mattcasters] [BEAM-13854] Document casting trick for Avro value serializer in KafkaIO
[noreply] Merge pull request #16838 from [BEAM-13931] - make sure large rows cause
[noreply] Seznam Case Study (#16825)
[noreply] [Website] Apache Hop Case Study (#16824)
[noreply] [BEAM-13694] Force hadoop-hdfs-client in hadoopVersion tests for hdfs
[noreply] [Website] Ricardo - added case study feedback (#16807)
[noreply] Merge pull request #16735 from [BEAM-13827] - fix medium file size
[noreply] Merge pull request #16753 from [BEAM-13837] [Playground] show graph on
------------------------------------------
[...truncated 17.37 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645006629218301057/****\022@2e4ca8196b8c4b8037478fd97031e0843441a6e4e4004f0918e593ec2c27afb7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/16 10:17:09 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645006629218301057/model
2022/02/16 10:17:09 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0216100308"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645006629218301057/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645006629218301057/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0216100308",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/16 10:17:10 Submitted job: 2022-02-16_02_17_09-2212762759584438378
2022/02/16 10:17:10 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-16_02_17_09-2212762759584438378?project=apache-beam-testing
2022/02/16 10:17:10 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-16_02_17_09-2212762759584438378
2022/02/16 10:17:10 Job state: JOB_STATE_PENDING ...
2022/02/16 10:17:40 Job still running ...
2022/02/16 10:18:10 Job still running ...
2022/02/16 10:18:40 Job still running ...
2022/02/16 10:19:10 Job still running ...
2022/02/16 10:19:40 Job still running ...
2022/02/16 10:20:10 Job still running ...
2022/02/16 10:20:40 Failed to execute job: job 2022-02-16_02_17_09-2212762759584438378 failed
panic: Failed to execute job: job 2022-02-16_02_17_09-2212762759584438378 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e328, 0xc0000480c0, 0x103bc29, 0x19, 0xc000677e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/zlnvskrlbkc5u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #423
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/423/display/redirect?page=changes>
Changes:
[Kyle Weaver] [BEAM-12712] Spark: Exclude looping timer tests.
[Kyle Weaver] [BEAM-13919] Annotate PerKeyOrderingTest with UsesStatefulParDo.
[noreply] Update 2.36.0 blog post to mention ARM64 support
[noreply] Minor: Disable checker framework in nightly snapshot (#16829)
[artur.khanin] Updated example link
[noreply] [BEAM-13860] Make `DoFn.infer_output_type` return element type (#16788)
[noreply] [BEAM-13894] Unit test utilities in the ptest package (#16830)
[Kenneth Knowles] Add test for processing time continuation trigger
[noreply] [BEAM-13922] [Coverage] Make boot.go more testable and add tests
[noreply] Exclude SpannerChangeStream IT from Dataflow V1 postcommit (#16851)
[noreply] [BEAM-13930] Address StateSpec consistency issue between Runner and Fn
------------------------------------------
[...truncated 17.28 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644920070110386682/****\022@2e4ca8196b8c4b8037478fd97031e0843441a6e4e4004f0918e593ec2c27afb7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/15 10:14:30 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644920070110386682/model
2022/02/15 10:14:30 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0215101259"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644920070110386682/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644920070110386682/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0215101259",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/15 10:14:31 Submitted job: 2022-02-15_02_14_30-16833297091556687728
2022/02/15 10:14:31 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-15_02_14_30-16833297091556687728?project=apache-beam-testing
2022/02/15 10:14:31 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-15_02_14_30-16833297091556687728
2022/02/15 10:14:31 Job state: JOB_STATE_PENDING ...
2022/02/15 10:15:01 Job still running ...
2022/02/15 10:15:31 Job still running ...
2022/02/15 10:16:01 Job still running ...
2022/02/15 10:16:31 Job still running ...
2022/02/15 10:17:01 Job still running ...
2022/02/15 10:17:31 Job still running ...
2022/02/15 10:18:01 Failed to execute job: job 2022-02-15_02_14_30-16833297091556687728 failed
panic: Failed to execute job: job 2022-02-15_02_14_30-16833297091556687728 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e328, 0xc0000480c0, 0x103bc29, 0x19, 0xc00076de00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 39s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/frliw4glc34m2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #422
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/422/display/redirect?page=changes>
Changes:
[akustov] fix name project id from secreton scio deploy action
[alexander.zhuravlev] [BEAM-13775] Fixed bug with run button
[ihr] [BEAM-13836] Fix the answers placeholders locations in the Python katas
[noreply] Merge pull request #16703 from [BEAM-13804][Playground][Bugfix] Add
[noreply] Merge pull request #16611 from [BEAM-13712][Playground] Add graph for
[noreply] Merge pull request #16757 from [BEAM-13655] [Playground] Persist the
------------------------------------------
[...truncated 17.36 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644833676778739709/****\022@2e4ca8196b8c4b8037478fd97031e0843441a6e4e4004f0918e593ec2c27afb7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/14 10:14:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644833676778739709/model
2022/02/14 10:14:37 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0214100236"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644833676778739709/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644833676778739709/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0214100236",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/14 10:14:38 Submitted job: 2022-02-14_02_14_37-11199162881818409395
2022/02/14 10:14:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-14_02_14_37-11199162881818409395?project=apache-beam-testing
2022/02/14 10:14:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-14_02_14_37-11199162881818409395
2022/02/14 10:14:38 Job state: JOB_STATE_PENDING ...
2022/02/14 10:15:08 Job still running ...
2022/02/14 10:15:38 Job still running ...
2022/02/14 10:16:08 Job still running ...
2022/02/14 10:16:38 Job still running ...
2022/02/14 10:17:08 Job still running ...
2022/02/14 10:17:38 Job still running ...
2022/02/14 10:18:08 Failed to execute job: job 2022-02-14_02_14_37-11199162881818409395 failed
panic: Failed to execute job: job 2022-02-14_02_14_37-11199162881818409395 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e328, 0xc00019a000, 0x103bc29, 0x19, 0xc00026de00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 46s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/z4dyfdlyzlli6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #421
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/421/display/redirect?page=changes>
Changes:
[randomstep] [BEAM-9195] Bump org.testcontainers to 1.16.3
------------------------------------------
[...truncated 17.35 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644747279060652719/****\022@2e4ca8196b8c4b8037478fd97031e0843441a6e4e4004f0918e593ec2c27afb7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/13 10:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644747279060652719/model
2022/02/13 10:14:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0213100236"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644747279060652719/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644747279060652719/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0213100236",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/13 10:14:40 Submitted job: 2022-02-13_02_14_39-13406870296237823127
2022/02/13 10:14:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-13_02_14_39-13406870296237823127?project=apache-beam-testing
2022/02/13 10:14:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-13_02_14_39-13406870296237823127
2022/02/13 10:14:40 Job state: JOB_STATE_PENDING ...
2022/02/13 10:15:10 Job still running ...
2022/02/13 10:15:40 Job still running ...
2022/02/13 10:16:10 Job still running ...
2022/02/13 10:16:40 Job still running ...
2022/02/13 10:17:10 Job still running ...
2022/02/13 10:17:40 Job still running ...
2022/02/13 10:18:10 Job still running ...
2022/02/13 10:18:40 Failed to execute job: job 2022-02-13_02_14_39-13406870296237823127 failed
panic: Failed to execute job: job 2022-02-13_02_14_39-13406870296237823127 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e328, 0xc00019a000, 0x103bc29, 0x19, 0xc000253e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m 17s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/6mwh4p3bby5vm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #420
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/420/display/redirect?page=changes>
Changes:
[Carl Yeksigian] Cache bucket matcher regex in GcsPath
[noreply] [BEAM-4032]Support staging binary distributions of dependency packages
[noreply] [BEAM-13834] Increase influxDB persistent storage. (#16817)
[noreply] Minor: Fix link to nexmark benchmarks (#16803)
[noreply] Regenerate python container base_image_requirements.txt (#16832)
------------------------------------------
[...truncated 17.33 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644660879316568317/****\022@2e4ca8196b8c4b8037478fd97031e0843441a6e4e4004f0918e593ec2c27afb7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/12 10:14:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644660879316568317/model
2022/02/12 10:14:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0212100436"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644660879316568317/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644660879316568317/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0212100436",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/12 10:14:40 Submitted job: 2022-02-12_02_14_40-10420554674876532832
2022/02/12 10:14:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-12_02_14_40-10420554674876532832?project=apache-beam-testing
2022/02/12 10:14:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-12_02_14_40-10420554674876532832
2022/02/12 10:14:40 Job state: JOB_STATE_PENDING ...
2022/02/12 10:15:10 Job still running ...
2022/02/12 10:15:40 Job still running ...
2022/02/12 10:16:10 Job still running ...
2022/02/12 10:16:40 Job still running ...
2022/02/12 10:17:11 Job still running ...
2022/02/12 10:17:41 Job still running ...
2022/02/12 10:18:11 Failed to execute job: job 2022-02-12_02_14_40-10420554674876532832 failed
panic: Failed to execute job: job 2022-02-12_02_14_40-10420554674876532832 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e328, 0xc0000480c0, 0x103bc29, 0x19, 0xc0001f7e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 47s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/x5eipe6drpp4k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #419
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/419/display/redirect?page=changes>
Changes:
[benjamin.gonzalez] [BEAM-12672] Retry flaky tests
[benjamin.gonzalez] [BEAM-12672] Fix spotlessApply
[laraschmidt] Fixing the log line to properly handle a large allowed skew.
[n] BEAM-13159 Update embedded-redis dependency
[n] address comments
[noreply] Minor: Add 2.38.0 section to CHANGES.md (#16804)
[noreply] [BEAM-12000] Fix typo in portable Python job definition (#16812)
[noreply] [BEAM-12164]: Fixes SpannerChangeStreamIT (#16806)
[noreply] [BEAM-12572] Fix failures in python examples tests (#16781)
[noreply] [BEAM-13921] filter out debeziumIO test for spark runner (#16815)
[noreply] [BEAM-13855] Skip SpannerChangeStreamOrderedWithinKeyIT and
[noreply] [BEAM-13679] playground - move quick start category to the top (#16808)
[noreply] Update license_script.sh (#16789)
[noreply] [BEAM-13908] [Coverage] Better testing coverage for gcpopts (#16816)
[noreply] Merge pull request #16809 from [BEAM-12164] Added integration test for
------------------------------------------
[...truncated 17.26 KB...]
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644575018519366853/****\022@2e4ca8196b8c4b8037478fd97031e0843441a6e4e4004f0918e593ec2c27afb7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/11 10:23:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644575018519366853/model
2022/02/11 10:23:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0211102301"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644575018519366853/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644575018519366853/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0211102301",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/11 10:23:39 Submitted job: 2022-02-11_02_23_39-3302999279888540291
2022/02/11 10:23:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-11_02_23_39-3302999279888540291?project=apache-beam-testing
2022/02/11 10:23:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-11_02_23_39-3302999279888540291
2022/02/11 10:23:39 Job state: JOB_STATE_PENDING ...
2022/02/11 10:24:10 Job still running ...
FATAL: command execution failed
java.io.IOException: Backing channel 'apache-beam-jenkins-12' is disconnected.
at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:216)
at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:286)
at com.sun.proxy.$Proxy126.isAlive(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1211)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1203)
at hudson.Launcher$ProcStarter.join(Launcher.java:523)
at hudson.plugins.gradle.Gradle.perform(Gradle.java:317)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:803)
at hudson.model.Build$BuildExecution.build(Build.java:197)
at hudson.model.Build$BuildExecution.doRun(Build.java:163)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:513)
at hudson.model.Run.execute(Run.java:1906)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: java.io.IOException: Pipe closed after 0 cycles
at org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:118)
at org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:101)
at hudson.remoting.FlightRecorderInputStream.read(FlightRecorderInputStream.java:93)
at hudson.remoting.ChunkedInputStream.readHeader(ChunkedInputStream.java:74)
at hudson.remoting.ChunkedInputStream.readUntilBreak(ChunkedInputStream.java:104)
at hudson.remoting.ChunkedCommandTransport.readBlock(ChunkedCommandTransport.java:39)
at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34)
at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:61)
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
ERROR: apache-beam-jenkins-12 is offline; cannot locate jdk_1.8_latest
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #418
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/418/display/redirect?page=changes>
Changes:
[david.prieto.rivera] Missing contribution
[mmack] [adhoc] Remove remaining usage of Powermock from aws2.
[noreply] [BEAM-13803] Add support for native iterable side inputs to the Go SDK
[noreply] [BEAM-11095] Better error handling for illegal emit functions (#16776)
[noreply] Merge pull request #16613 from Supporting JdbcIO driver in classpath for
[noreply] Merge pull request #15848 from [BEAM-13835] An any-type implementation
[Valentyn Tymofieiev] [BEAM-12920] Assume that bare generators types define simple generators.
[Valentyn Tymofieiev] Add a container for Python 3.9.
[Valentyn Tymofieiev] Allow job submission with Python 3.9 on Dataflow runner
[Valentyn Tymofieiev] Add Python 3.9 test suites. Keep Dataflow V1 suites unchanged for now.
[Valentyn Tymofieiev] Add py3.9 Github actions suites.
[Valentyn Tymofieiev] Py39 Doc updates.
[Valentyn Tymofieiev] [BEAM-9980] Simplify run_validates_container.sh to avoid branching.
[Valentyn Tymofieiev] Update Cython to a new version that has py39 wheels.
[Valentyn Tymofieiev] [BEAM-13845] Fix comparison with potentially incomparable default
[Valentyn Tymofieiev] [BEAM-12920] Assume that bare generators types define simple generators.
[Valentyn Tymofieiev] Mark Python 3.9 as supported version.
[noreply] [release-2.36.0][website] Fix github release notes script, header for
[noreply] Use shell to run python for setupVirtualenv (#16796)
[Daniel Oliveira] [BEAM-13830] Properly shut down Debezium expansion service in IT script.
[noreply] Merge pull request #16659 from [BEAM-13774][Playground] Add user to
[Valentyn Tymofieiev] [BEAM-13868] Remove gsutil dep from hdfs IT test.
[noreply] [BEAM-13776][Playground] (#16731)
[noreply] [BEAM-13867] Drop NaNs returned by nlargest in flight_delays example
[noreply] Announce Python 3.9 in CHANGES.md (#16802)
[Brian Hulette] Moving to 2.38.0-SNAPSHOT on master branch.
[noreply] [BEAM-11095] Better error handling for iter/reiter/multimap (#16794)
------------------------------------------
[...truncated 17.38 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644488091265271749/****\022@2e4ca8196b8c4b8037478fd97031e0843441a6e4e4004f0918e593ec2c27afb7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/10 10:14:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644488091265271749/model
2022/02/10 10:14:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0210100243"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644488091265271749/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644488091265271749/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0210100243",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/10 10:14:52 Submitted job: 2022-02-10_02_14_51-10245121360461043600
2022/02/10 10:14:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-10_02_14_51-10245121360461043600?project=apache-beam-testing
2022/02/10 10:14:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-10_02_14_51-10245121360461043600
2022/02/10 10:14:52 Job state: JOB_STATE_PENDING ...
2022/02/10 10:15:22 Job still running ...
2022/02/10 10:15:52 Job still running ...
2022/02/10 10:16:23 Job still running ...
2022/02/10 10:16:53 Job still running ...
2022/02/10 10:17:23 Job still running ...
2022/02/10 10:17:53 Job still running ...
2022/02/10 10:18:23 Failed to execute job: job 2022-02-10_02_14_51-10245121360461043600 failed
panic: Failed to execute job: job 2022-02-10_02_14_51-10245121360461043600 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e328, 0xc000120000, 0x103bc29, 0x19, 0xc00070fe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 54s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/a57gdkjvpechk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #417
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/417/display/redirect?page=changes>
Changes:
[noreply] Update README.md
[marco.robles] Update README with latest PreCommit Jobs
[marco.robles] Update Postcommit jobs with latest jobs
[marco.robles] Update Performace job tests in readme
[marco.robles] update load job tests with latest updates
[marco.robles] update other jobs test with latest updates
[marco.robles] mismatch links fix
[marco.robles] update trigger phrase for some postCommit jobs
[marco.robles] correct trigger phrases in readme
[marco.robles] add pending jobs to readme
[noreply] Update README.md
[mmack] [BEAM-13246] Add support for S3 Bucket Key at the object level (AWS Sdk
[Ismaël Mejía] [BEAM-13839] Upgrade zstd-jni to version 1.5.2-1
[Pablo Estrada] Output successful rows from BQ Streaming Inserts
[schapman] BEAM-13439 Type annotation for ptransform_fn
[noreply] [BEAM-13606] Fail bundles with failed BigTable mutations (#16751)
[marco.robles] fix broken links in jobs & remove the invalid ones
[Kyle Weaver] Update Dataflow Python dev container images.
[Kiley Sok] Add java 17 to changes
[noreply] [BEAM-12914] Add missing 3.9 opcodes to type inference. (#16761)
[noreply] [BEAM-13321] Initial BigQueryIO externalization. (#16489)
[noreply] [BEAM-13193] Enable process bundle response elements embedding in Java
[noreply] [BEAM-13830] added a debeziumio_expansion_addr flag to GoSDK (#16780)
[noreply] Apply spotless. (#16783)
[Daniel Oliveira] [BEAM-13732] Switch x-lang BigQueryIO expansion service to GCP one.
[noreply] [BEAM-13858] Fix broken github action on :sdks:go:examples:wordCount
[Kiley Sok] add jira for runner v2
[noreply] [BEAM-13732] Go SDK BigQuery IO wrapper. Initial implementation.
[noreply] [BEAM-13732] Add example for Go BigQuery IO wrapper. (#16786)
[noreply] Update CHANGES.md with Go SDK milestones. (#16787)
[noreply] [BEAM-13193] Allow BeamFnDataOutboundObserver to flush elements.
------------------------------------------
[...truncated 17.37 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644401680668736304/****\022@dc9357ee9bfdb35bfb0345c5fdfac1742080d9d1306889b58e8c1b601ac2d755"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/09 10:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644401680668736304/model
2022/02/09 10:14:41 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0209100418"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644401680668736304/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644401680668736304/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0209100418",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/09 10:14:42 Submitted job: 2022-02-09_02_14_41-9700408392037507753
2022/02/09 10:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-09_02_14_41-9700408392037507753?project=apache-beam-testing
2022/02/09 10:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-09_02_14_41-9700408392037507753
2022/02/09 10:14:42 Job state: JOB_STATE_PENDING ...
2022/02/09 10:15:12 Job still running ...
2022/02/09 10:15:42 Job still running ...
2022/02/09 10:16:12 Job still running ...
2022/02/09 10:16:42 Job still running ...
2022/02/09 10:17:12 Job still running ...
2022/02/09 10:17:42 Job still running ...
2022/02/09 10:18:12 Failed to execute job: job 2022-02-09_02_14_41-9700408392037507753 failed
panic: Failed to execute job: job 2022-02-09_02_14_41-9700408392037507753 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114cc48, 0xc000120000, 0x103a880, 0x19, 0xc0004e9e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/iaabuyoq6obs2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #416
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/416/display/redirect?page=changes>
Changes:
[Kyle Weaver] [BEAM-12976] Log projection pushdown optimizations.
[benjamin.gonzalez] [BEAM-12572] Change jobs to run as cron jobs
[mmack] [BEAM-13840] Fix usage of legacy rawtypes in AWS modules
[alexander.zhuravlev] [BEAM-13820] Changed color of delete icon in pipeline options dropdown,
[noreply] [BEAM-11971] Revert "Fix timer consistency in direct runner" (#16748)
[noreply] [BEAM-13193] Aggregates fn api outbound data/timers of different
[noreply] [BEAM-13767] Migrate a bundle of grade tasks to use configuration
[noreply] Merge pull request #16653 from [BEAM-12164]: Add integration tests for
[noreply] Merge pull request #16728 from [BEAM-13823] Update docs for SnowflakeIO
[noreply] Merge pull request #16660 from [BEAM-13771][Playground] Send multifile
[noreply] Merge pull request #16646 from [BEAM-13643][Playground] Setup running
[noreply] [BEAM-13015] Add state caching benchmark and move benchmarks to their
[noreply] [BEAM-13419] Check for initialization in dataflow runner (#16765)
[noreply] Merge pull request #16701 from [BEAM-13786] [Playground] [Bugfix] Update
[noreply] Merge pull request #16754 from [BEAM-13838][Playground] Add logs in case
[noreply] [BEAM-13293] consistent naming for expansion service address and flag
[noreply] Merge pull request #16700 from [BEAM-13790][Playground] Change logic of
[noreply] [BEAM-13830] update dependency for debeziumio expansion service (#16743)
[noreply] [BEAM-13761] consistent namings for expansion address in Debezium IO
[noreply] [BEAM-13806] Shutting down SchemaIO expansion services from Go VR
[noreply] [release-2.36.0] Update website/changelog for release 2.36.0 (#16627)
[noreply] [BEAM-13848] Update numpy intersphinx link (#16767)
[noreply] [release-23.6.0] Fix JIRA link for 2.36 blog (#16771)
[noreply] [BEAM-13647] Use role for Go worker binary. (#16729)
------------------------------------------
[...truncated 17.35 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644315285324963429/****\022@dc9357ee9bfdb35bfb0345c5fdfac1742080d9d1306889b58e8c1b601ac2d755"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/08 10:14:46 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644315285324963429/model
2022/02/08 10:14:46 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0208100357"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644315285324963429/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644315285324963429/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0208100357",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/08 10:14:47 Submitted job: 2022-02-08_02_14_46-3215979550181737191
2022/02/08 10:14:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-08_02_14_46-3215979550181737191?project=apache-beam-testing
2022/02/08 10:14:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-08_02_14_46-3215979550181737191
2022/02/08 10:14:47 Job state: JOB_STATE_PENDING ...
2022/02/08 10:15:17 Job still running ...
2022/02/08 10:15:47 Job still running ...
2022/02/08 10:16:17 Job still running ...
2022/02/08 10:16:47 Job still running ...
2022/02/08 10:17:17 Job still running ...
2022/02/08 10:17:47 Job still running ...
2022/02/08 10:18:17 Failed to execute job: job 2022-02-08_02_14_46-3215979550181737191 failed
panic: Failed to execute job: job 2022-02-08_02_14_46-3215979550181737191 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114cc48, 0xc000128000, 0x103a880, 0x19, 0xc0005c1e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/n6nythmfrvvca
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #415
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/415/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #16726 from [BEAM-12164]: Parses change streams
[mmack] [BEAM-13147] Avoid nullness issue during init of AwsModule (AWS Sdk v2)
------------------------------------------
[...truncated 17.93 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/07 15:40:28 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644248427612614393/model
2022/02/07 15:40:28 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0207144759"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644248427612614393/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644248427612614393/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0207144759",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/07 15:40:30 Submitted job: 2022-02-07_07_40_28-9504769975479286427
2022/02/07 15:40:30 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-07_07_40_28-9504769975479286427?project=apache-beam-testing
2022/02/07 15:40:30 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-07_07_40_28-9504769975479286427
2022/02/07 15:40:30 Job state: JOB_STATE_PENDING ...
2022/02/07 15:41:00 Job still running ...
2022/02/07 15:41:30 Job still running ...
2022/02/07 15:42:00 Job still running ...
2022/02/07 15:42:30 Job still running ...
2022/02/07 15:43:01 Job still running ...
2022/02/07 15:43:31 Job still running ...
2022/02/07 15:44:01 Failed to execute job: job 2022-02-07_07_40_28-9504769975479286427 failed
panic: Failed to execute job: job 2022-02-07_07_40_28-9504769975479286427 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114b828, 0xc00018a000, 0x1039760, 0x19, 0xc0003c9e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m 1s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/6g6fdse3lld6k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #414
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/414/display/redirect?page=changes>
Changes:
[mmack] [BEAM-13663] Remove unused duplicate option for AWS client configuration
[mmack] [BEAM-13203] Deprecate SnsIO.writeAsync for AWS Sdk v2 due to risk of
[noreply] [BEAM-13828] Fix stale bot (#16734)
[noreply] Merge pull request #16364 from [BEAM-13182] Add diagrams to backend
[noreply] [BEAM-13811] Fix save_main_session arg in tests examples (#16709)
[Kiley Sok] Update beam-master version
[noreply] [BEAM-13015] Calculate exception for closing BeamFnDataInboundObserver2
[noreply] Minor doc tweaks for validating vendoring. (#16747)
[noreply] [BEAM-13686] OOM while logging a large pipeline even when logging level
[noreply] [BEAM-13629] Update URL artifact type for Dataflow Go (#16490)
[noreply] [BEAM-13832] Add automated expansion service start-up to JDBCio (#16739)
[noreply] [BEAM-13831] Add automated expansion service infra into Debezium Read()
[noreply] [BEAM-13821] Add automated expansion service start-up to KafkaIO
[noreply] [BEAM-13799] Created a Dataproc cluster manager for Interactive Beam
[noreply] Merge pull request #16727: [BEAM-11971] remove unsafe Concurrent data
------------------------------------------
[...truncated 17.88 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/05 10:14:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644056084906141761/model
2022/02/05 10:14:45 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0205100504"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644056084906141761/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644056084906141761/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0205100504",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/05 10:14:46 Submitted job: 2022-02-05_02_14_45-1266512309135870309
2022/02/05 10:14:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-05_02_14_45-1266512309135870309?project=apache-beam-testing
2022/02/05 10:14:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-05_02_14_45-1266512309135870309
2022/02/05 10:14:46 Job state: JOB_STATE_PENDING ...
2022/02/05 10:15:16 Job still running ...
2022/02/05 10:15:46 Job still running ...
2022/02/05 10:16:16 Job still running ...
2022/02/05 10:16:46 Job still running ...
2022/02/05 10:17:16 Job still running ...
2022/02/05 10:17:46 Job still running ...
2022/02/05 10:18:16 Job still running ...
2022/02/05 10:18:46 Failed to execute job: job 2022-02-05_02_14_45-1266512309135870309 failed
panic: Failed to execute job: job 2022-02-05_02_14_45-1266512309135870309 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114b828, 0xc000128000, 0x1039760, 0x19, 0xc000387e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m 22s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ompu25e3shqic
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #413
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/413/display/redirect?page=changes>
Changes:
[Kiley Sok] Allow Java 17 to be used in SDK
[Kiley Sok] add testing support
[Kiley Sok] Add more testing support for java 17
[Kiley Sok] workaround for jamm
[Kiley Sok] Add Jenkins test for Java 17
[Kiley Sok] Fix jvm hex and skip errorprone
[Kiley Sok] Fix display data for anonymous classes
[Kiley Sok] fix jpms tests
[Kiley Sok] skip zetasql
[Kiley Sok] spotless
[Kiley Sok] spotless
[Kiley Sok] Fix trigger
[Kiley Sok] skip checker framework
[Kiley Sok] fix app name
[Kiley Sok] remove duplicate property check
[Heejong Lee] [BEAM-13813] Add support for URL artifact to extractStagingToPath
[avilovpavel6] Remove Python SQL Test example from catalog
[relax] Fix timer consistency in direct runner
[noreply] [BEAM-13757] adds pane observation in DoFn (#16629)
[Jan Lukavský] Change links to Books from Amazon to Publisher
[noreply] [BEAM-13605] Add support for pandas 1.4.0 (#16590)
[noreply] [BEAM-13761] adds Debezium IO wrapper for Go SDK (#16642)
[noreply] [BEAM-13024] Unify PipelineOptions behavior (#16719)
[noreply] Update sdks/go/pkg/beam/artifact/materialize_test.go
[noreply] Merge pull request #16605 from [BEAM-13634][Playground] Create a
[noreply] Merge pull request #16593 from [BEAM-13725][Playground] Add graph to the
[noreply] Merge pull request #16699 from [BEAM-13789][Playground] Change logic of
[alexander.chermenin] Fixed CSS for Case study page
------------------------------------------
[...truncated 17.91 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/04 10:14:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643969686458081125/model
2022/02/04 10:14:47 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0204100236"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643969686458081125/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643969686458081125/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0204100236",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/04 10:14:48 Submitted job: 2022-02-04_02_14_47-11692596305243090456
2022/02/04 10:14:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-04_02_14_47-11692596305243090456?project=apache-beam-testing
2022/02/04 10:14:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-04_02_14_47-11692596305243090456
2022/02/04 10:14:48 Job state: JOB_STATE_PENDING ...
2022/02/04 10:15:18 Job still running ...
2022/02/04 10:15:48 Job still running ...
2022/02/04 10:16:18 Job still running ...
2022/02/04 10:16:48 Job still running ...
2022/02/04 10:17:18 Job still running ...
2022/02/04 10:17:48 Job still running ...
2022/02/04 10:18:18 Job still running ...
2022/02/04 10:18:48 Job still running ...
2022/02/04 10:19:18 Job still running ...
2022/02/04 10:19:48 Job still running ...
2022/02/04 10:20:18 Failed to execute job: job 2022-02-04_02_14_47-11692596305243090456 failed
panic: Failed to execute job: job 2022-02-04_02_14_47-11692596305243090456 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114b768, 0xc000120000, 0x1039760, 0x19, 0xc000377e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 55s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/kezmpf4qnqzlw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #412
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/412/display/redirect?page=changes>
Changes:
[aydar.zaynutdinov] [BEAM-13737][Playground]
[Robert Bradshaw] Make num-stages counter into an internal counter.
[Kenneth Knowles] [BEAM-13768] Fix NullPointerException in BigQueryStorageSourceBase
[Robert Bradshaw] Avoid packaging avro in the java harness jar.
[mmack] [BEAM-13563] Restructure Kinesis Source for Aws 2 internally to prepare
[noreply] [BEAM-4665] Allow joining a running dataflow pipeline without throwing
[noreply] [BEAM-13801] Add standard coder tests for state backed iterable.
[noreply] [BEAM-13430] Fix provided configuration by removing extendsFrom for
[noreply] [BEAM-12830] Print clearer go version fail message (#16693)
[Jan Lukavský] Add reference to Books to Learning Resources in website
[noreply] Use ThreadLocal for DESERIALIZATION_CONTEXT (#16680)
[noreply] Minor: Add apt update after adding deadsnakes repository in dev env
[noreply] [BEAM-13807] Regenerate container images to get TF 2.8.0 (#16707)
[noreply] [BEAM-13399, BEAM-13683] Eagerly materialize artifacts for automated
[noreply] Merge pull request #16617 from [BEAM-13743] [Playground] Add context
[noreply] Merge pull request #16618 from [BEAM-13744] [Playground] Add context
[noreply] Merge pull request #16698 from [BEAM-13802][Playground] [Bugfix] Clean
[noreply] [BEAM-13293][BEAM-13806] Pipe a SchemaIO flag through Go integration
[noreply] [BEAM-13605] Modify groupby.apply implementation in preparation for
[noreply] Merge pull request #16436 from [BEAM-1330] - DatastoreIO Writes should
------------------------------------------
[...truncated 17.99 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/03 16:29:19 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643905758611726759/model
2022/02/03 16:29:19 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0203153139"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643905758611726759/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643905758611726759/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0203153139",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/03 16:29:19 Submitted job: 2022-02-03_08_29_19-16464218713724411247
2022/02/03 16:29:19 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-03_08_29_19-16464218713724411247?project=apache-beam-testing
2022/02/03 16:29:19 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-03_08_29_19-16464218713724411247
2022/02/03 16:29:19 Job state: JOB_STATE_PENDING ...
2022/02/03 16:29:49 Job still running ...
2022/02/03 16:30:19 Job still running ...
2022/02/03 16:30:49 Job still running ...
2022/02/03 16:31:19 Job still running ...
2022/02/03 16:31:49 Job still running ...
2022/02/03 16:32:19 Job still running ...
2022/02/03 16:32:49 Job still running ...
2022/02/03 16:33:20 Job still running ...
2022/02/03 16:33:50 Job still running ...
2022/02/03 16:34:20 Job still running ...
2022/02/03 16:34:50 Failed to execute job: job 2022-02-03_08_29_19-16464218713724411247 failed
panic: Failed to execute job: job 2022-02-03_08_29_19-16464218713724411247 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114a588, 0xc0000480c0, 0x10386fc, 0x19, 0xc00042be00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/333qq7sl623pg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #411
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/411/display/redirect?page=changes>
Changes:
[career] [BEAM-13734] Support cache directories that use GCS buckets
[noreply] Merge pull request #16655 from [BEAM-12164]: Add retry protection to
[noreply] Merge pull request #16586 from [BEAM-13731] FhirIO: Add support for
[noreply] [BEAM-13011] Adds a link to Multi-language Pipelines Tips wiki page
[noreply] [BEAM-12572] Run python examples on multiple runners (#16154)
[noreply] [BEAM-13574] Large Wordcount (#16455)
[noreply] [BEAM-13293] Refactor JDBC IO Go Wrapper (#16686)
[noreply] Edit license script for Java, add manual licenses for xz (#16692)
------------------------------------------
[...truncated 17.88 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/02 10:14:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643796888350038416/model
2022/02/02 10:14:49 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0202100236"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643796888350038416/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643796888350038416/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0202100236",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/02 10:14:49 Submitted job: 2022-02-02_02_14_49-5718022153194491140
2022/02/02 10:14:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-02_02_14_49-5718022153194491140?project=apache-beam-testing
2022/02/02 10:14:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-02_02_14_49-5718022153194491140
2022/02/02 10:14:49 Job state: JOB_STATE_PENDING ...
2022/02/02 10:15:19 Job still running ...
2022/02/02 10:15:49 Job still running ...
2022/02/02 10:16:19 Job still running ...
2022/02/02 10:16:50 Job still running ...
2022/02/02 10:17:20 Job still running ...
2022/02/02 10:17:50 Job still running ...
2022/02/02 10:18:20 Failed to execute job: job 2022-02-02_02_14_49-5718022153194491140 failed
panic: Failed to execute job: job 2022-02-02_02_14_49-5718022153194491140 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1147668, 0xc0000480d0, 0x1035b9f, 0x19, 0xc0001fbe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 57s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/bfge544gyraig
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #410
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/410/display/redirect?page=changes>
Changes:
[daria.malkova] Support SCIO SDK via sbt projects
[samuelw] [BEAM-11648] Share thread pool across RetryManager instances.
[Pablo Estrada] Exclude per-key order tests on Twister2 runner
[mrudary] Generalize S3FileSystem to support multiple URI schemes.
[Heejong Lee] Fix Java SDK container image name for load-tests and nexmark
[daria.malkova] Change executable name fo go tests
[avilovpavel6] Fix java test
[noreply] [BEAM-13769] Skip test_main_session_not_staged_when_using_cloudpickle
[noreply] [BEAM-6744] Support implicitly setting project id in Go Dataflow runner
[noreply] Merge pull request #16493 from [BEAM-13632][Playground] Save catalog
[noreply] Exclude jul-to-slf4j from Spark runner in quickstart POM templates
[noreply] [BEAM-11936] Enable a few errorprone checks that were broken by pinned
[noreply] [BEAM-13780] Add CONTRIBUTING.md pointing to main guide (#16666)
[noreply] [BEAM-13777] Accept cache capacity as input parameter instead of default
[noreply] [BEAM-13051][A] Enable pylint warnings
[noreply] [BEAM-13779] Fix pr labeling (#16665)
[noreply] Merge pull request #16581 from [BEAM-12164]: Add
[noreply] Fix labeler trigger (#16674)
[noreply] [BEAM-13781] Exclude grpc-netty-shaded from gax-grpc's dependency
[noreply] [BEAM-13051] Fixed pylint warnings : raising-non-exception (E0710),
[noreply] [BEAM-13740] Correctly install go before running tests (#16673)
[noreply] [BEAM-12830] Update local Docker env Go version. (#16670)
[noreply] [BEAM-13051][B] Enable pylint warnings
[noreply] [BEAM-13430] Revert Spark libraries in Spark runner to provided (#16675)
[noreply] [BEAM-12240] Add Java 17 support (#16568)
[noreply] [BEAM-13760] Add random component to default python dataflow job name
------------------------------------------
[...truncated 17.81 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/01 10:14:32 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643710472178564314/model
2022/02/01 10:14:32 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0201100229"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643710472178564314/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643710472178564314/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0201100229",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/01 10:14:33 Submitted job: 2022-02-01_02_14_32-7712326999873107760
2022/02/01 10:14:33 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-01_02_14_32-7712326999873107760?project=apache-beam-testing
2022/02/01 10:14:33 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-01_02_14_32-7712326999873107760
2022/02/01 10:14:33 Job state: JOB_STATE_PENDING ...
2022/02/01 10:15:03 Job still running ...
2022/02/01 10:15:33 Job still running ...
2022/02/01 10:16:03 Job still running ...
2022/02/01 10:16:33 Job still running ...
2022/02/01 10:17:03 Job still running ...
2022/02/01 10:17:33 Job still running ...
2022/02/01 10:18:03 Failed to execute job: job 2022-02-01_02_14_32-7712326999873107760 failed
panic: Failed to execute job: job 2022-02-01_02_14_32-7712326999873107760 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1147668, 0xc000120000, 0x1035b9f, 0x19, 0xc0004c5e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 41s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/zptmntci4mhcc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #409
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/409/display/redirect>
Changes:
------------------------------------------
[...truncated 17.90 KB...]
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/31 10:14:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643624078411446254/model
2022/01/31 10:14:38 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0131100233"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643624078411446254/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643624078411446254/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0131100233",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/31 10:14:39 Submitted job: 2022-01-31_02_14_39-8006702805447327207
2022/01/31 10:14:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-31_02_14_39-8006702805447327207?project=apache-beam-testing
2022/01/31 10:14:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-31_02_14_39-8006702805447327207
2022/01/31 10:14:39 Job state: JOB_STATE_PENDING ...
2022/01/31 10:15:09 Job still running ...
2022/01/31 10:15:39 Job still running ...
2022/01/31 10:16:09 Job still running ...
2022/01/31 10:16:39 Job still running ...
2022/01/31 10:17:09 Job still running ...
2022/01/31 10:17:39 Job still running ...
2022/01/31 10:18:10 Job still running ...
2022/01/31 10:18:40 Job still running ...
2022/01/31 10:19:10 Job still running ...
2022/01/31 10:19:40 Job still running ...
2022/01/31 10:20:10 Job still running ...
2022/01/31 10:20:40 Failed to execute job: job 2022-01-31_02_14_39-8006702805447327207 failed
panic: Failed to execute job: job 2022-01-31_02_14_39-8006702805447327207 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1147668, 0xc0000480d0, 0x1035b9f, 0x19, 0xc0003e7e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 6m 18s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/sadsxxv76pmya
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #408
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/408/display/redirect>
Changes:
------------------------------------------
[...truncated 17.87 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/30 10:14:48 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643537687950507306/model
2022/01/30 10:14:48 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0130100219"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643537687950507306/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643537687950507306/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0130100219",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/30 10:14:49 Submitted job: 2022-01-30_02_14_48-13144549195361442281
2022/01/30 10:14:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-30_02_14_48-13144549195361442281?project=apache-beam-testing
2022/01/30 10:14:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-30_02_14_48-13144549195361442281
2022/01/30 10:14:49 Job state: JOB_STATE_PENDING ...
2022/01/30 10:15:19 Job still running ...
2022/01/30 10:15:49 Job still running ...
2022/01/30 10:16:19 Job still running ...
2022/01/30 10:16:49 Job still running ...
2022/01/30 10:17:19 Job still running ...
2022/01/30 10:17:49 Job still running ...
2022/01/30 10:18:19 Failed to execute job: job 2022-01-30_02_14_48-13144549195361442281 failed
panic: Failed to execute job: job 2022-01-30_02_14_48-13144549195361442281 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1147668, 0xc000120000, 0x1035b9f, 0x19, 0xc000401e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 57s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/oqumo4wq66nnw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #407
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/407/display/redirect?page=changes>
Changes:
[Kyle Weaver] [BEAM-13751] Don't block on gcloud when attempting to get default GCP
[Kyle Weaver] [BEAM-13751] Parameterize wait timeout so test doesn't waste 2s.
[Kyle Weaver] [BEAM-13751] Add comment explaining sleep.
[noreply] Update Python SDK beam-master tags (#16630)
[noreply] Merge pull request #16592 from [BEAM-13722][Playground] Add precompiling
[noreply] Merge pull request #16505 from [BEAM-13527] [Playground] Pipeline
[noreply] [BEAM-13293] XLang Jdbc IO for Go SDK (#16111)
[noreply] [BEAM-10206] Add Go Vet to Github Actions (#16612)
------------------------------------------
[...truncated 17.85 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/29 10:14:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643451286309658834/model
2022/01/29 10:14:47 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0129100250"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643451286309658834/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643451286309658834/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0129100250",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/29 10:14:48 Submitted job: 2022-01-29_02_14_47-10532877681356684521
2022/01/29 10:14:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-29_02_14_47-10532877681356684521?project=apache-beam-testing
2022/01/29 10:14:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-29_02_14_47-10532877681356684521
2022/01/29 10:14:48 Job state: JOB_STATE_PENDING ...
2022/01/29 10:15:18 Job still running ...
2022/01/29 10:15:48 Job still running ...
2022/01/29 10:16:18 Job still running ...
2022/01/29 10:16:49 Job still running ...
2022/01/29 10:17:19 Job still running ...
2022/01/29 10:17:49 Job still running ...
2022/01/29 10:18:19 Job still running ...
2022/01/29 10:18:49 Failed to execute job: job 2022-01-29_02_14_47-10532877681356684521 failed
panic: Failed to execute job: job 2022-01-29_02_14_47-10532877681356684521 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1147668, 0xc000118000, 0x1035b9f, 0x19, 0xc0007afe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m 26s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/pregkprm2vtba
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #406
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/406/display/redirect?page=changes>
Changes:
[marcin.kuthan] Get rid of unnessecary logs for BigQuery streaming writes in
[dhuntsperger] added GitHub example references to Python multilang quickstart
[mmack] [adhoc] Test S3Options and AwsOptions for Sdk v2
[noreply] [BEAM-13537] Fix NPE in kafkatopubsub example (#16625)
[noreply] [BEAM-13740] update java_tests.yml to remove setup-go, which is
[Heejong Lee] Fix google3 import error
[noreply] [BEAM-12976] Implement Java projection pushdown optimizer. (#16513)
[noreply] Merge pull request #16579 from Revert "Revert "Merge pull request #15863
[noreply] Merge pull request #16606 from [BEAM-13247] [Playground] Embedding
------------------------------------------
[...truncated 17.84 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/28 10:14:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643364893854217122/model
2022/01/28 10:14:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0128100242"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643364893854217122/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643364893854217122/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0128100242",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/28 10:14:55 Submitted job: 2022-01-28_02_14_54-1739299363126554023
2022/01/28 10:14:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-28_02_14_54-1739299363126554023?project=apache-beam-testing
2022/01/28 10:14:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-28_02_14_54-1739299363126554023
2022/01/28 10:14:55 Job state: JOB_STATE_PENDING ...
2022/01/28 10:15:25 Job still running ...
2022/01/28 10:15:55 Job still running ...
2022/01/28 10:16:25 Job still running ...
2022/01/28 10:16:55 Job still running ...
2022/01/28 10:17:25 Job still running ...
2022/01/28 10:17:55 Job still running ...
2022/01/28 10:18:25 Failed to execute job: job 2022-01-28_02_14_54-1739299363126554023 failed
panic: Failed to execute job: job 2022-01-28_02_14_54-1739299363126554023 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11460c8, 0xc0000480c0, 0x1034906, 0x19, 0xc00048de00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m 2s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/o6woi3wz24fne
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #405
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/405/display/redirect?page=changes>
Changes:
[Heejong Lee] [BEAM-13093] Enable JavaUsingPython CrossLanguageValidateRunner test for
[mmack] [BEAM-8807] Add integration test for SnsIO.write (Sdk v1 & v2)
[mmack] [BEAM-13746] Fix deserialization of SSECustomerKey for AWS Sdk v2
[noreply] [BEAM-7928] Allow users to specify worker disk type for Dataflow runner
[noreply] Merge pull request #16534 from [BEAM-13671][Playground] Add backend
[noreply] [BEAM-13271] Bump errorprone to 2.10.0 (#16231)
[noreply] [BEAM-13595] Don't load main session when cloudpickle is used. (#16589)
[Heejong Lee] Update readme for XVR tests
------------------------------------------
[...truncated 17.78 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/27 10:14:33 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643278472492243019/model
2022/01/27 10:14:33 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0127100232"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643278472492243019/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643278472492243019/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0127100232",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/27 10:14:35 Submitted job: 2022-01-27_02_14_33-16543971998296870947
2022/01/27 10:14:35 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-27_02_14_33-16543971998296870947?project=apache-beam-testing
2022/01/27 10:14:35 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-27_02_14_33-16543971998296870947
2022/01/27 10:14:35 Job state: JOB_STATE_PENDING ...
2022/01/27 10:15:05 Job still running ...
2022/01/27 10:15:35 Job still running ...
2022/01/27 10:16:05 Job still running ...
2022/01/27 10:16:35 Job still running ...
2022/01/27 10:17:05 Job still running ...
2022/01/27 10:17:35 Job still running ...
2022/01/27 10:18:05 Failed to execute job: job 2022-01-27_02_14_33-16543971998296870947 failed
panic: Failed to execute job: job 2022-01-27_02_14_33-16543971998296870947 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11460c8, 0xc000120000, 0x1034906, 0x19, 0xc00026be00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 43s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/l2zzo6j4m2m5o
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #404
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/404/display/redirect?page=changes>
Changes:
[artur.khanin] Privacy policy update regarding Apache Beam Playground
[Daniel Oliveira] [BEAM-13321] Fix exception with BigQuery StreamWriter TraceID.
[mmack] [BEAM-13510] Don't retry on invalid SQS receipt handles.
[noreply] [BEAM-13736] Make lifting cache exact. (#16603)
[noreply] Merge pull request #16565 from [BEAM-13692][Playground] Implement
[noreply] Merge pull request #16502 from [BEAM-13650][Playground] Add link for
[noreply] [BEAM-13310] remove call to get offset consumer config, which was rep…
------------------------------------------
[...truncated 17.96 KB...]
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/26 10:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643192080848195997/model
2022/01/26 10:14:41 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0126100245"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643192080848195997/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643192080848195997/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0126100245",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/26 10:14:42 Submitted job: 2022-01-26_02_14_41-538648952719135226
2022/01/26 10:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-26_02_14_41-538648952719135226?project=apache-beam-testing
2022/01/26 10:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-26_02_14_41-538648952719135226
2022/01/26 10:14:42 Job state: JOB_STATE_PENDING ...
2022/01/26 10:15:12 Job still running ...
2022/01/26 10:15:42 Job still running ...
2022/01/26 10:16:12 Job still running ...
2022/01/26 10:16:42 Job still running ...
2022/01/26 10:17:12 Job still running ...
2022/01/26 10:17:42 Job still running ...
2022/01/26 10:18:12 Job still running ...
2022/01/26 10:18:42 Job still running ...
2022/01/26 10:19:12 Job still running ...
2022/01/26 10:19:42 Job still running ...
2022/01/26 10:20:12 Job still running ...
2022/01/26 10:20:42 Failed to execute job: job 2022-01-26_02_14_41-538648952719135226 failed
panic: Failed to execute job: job 2022-01-26_02_14_41-538648952719135226 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1146048, 0xc0000480b0, 0x10348bd, 0x19, 0xc0002dbe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 6m 21s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/tukb2a6g6ept4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #403
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/403/display/redirect?page=changes>
Changes:
[Heejong Lee] [BEAM-13716] Clear before creating a new virtual environment in
[mmack] [BEAM-13653] Make SnsIO.write topicArn optional. If provided, validate
[noreply] [BEAM-10897] Update the fastavro lower bound due to an issue on Windows
[noreply] [BEAM-13605] Update pandas_doctests_test denylists in preparation for
[noreply] Merge pull request #16538 from [BEAM-13676][Playground][Bugfix]Build Of
[noreply] Merge pull request #16582 from [BEAM-13711] [Playground] [Bugfix] Add
[noreply] Merge pull request #16515 from [BEAM-13636] [Playground] Checking the
[ningkang0957] [BEAM-13275] Removed the explicit selenium dependency from setup
[noreply] [BEAM-10206] Deprecate unused shallow cloning functions (#16600)
[noreply] Bump Dataflow container versions (#16602)
[noreply] Improved multi-language pipelines section of the programming guide
------------------------------------------
[...truncated 17.78 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/25 10:14:31 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643105671028639816/model
2022/01/25 10:14:31 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0125100232"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643105671028639816/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643105671028639816/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0125100232",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/25 10:14:34 Submitted job: 2022-01-25_02_14_31-2740969621517997875
2022/01/25 10:14:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-25_02_14_31-2740969621517997875?project=apache-beam-testing
2022/01/25 10:14:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-25_02_14_31-2740969621517997875
2022/01/25 10:14:34 Job state: JOB_STATE_PENDING ...
2022/01/25 10:15:04 Job still running ...
2022/01/25 10:15:34 Job still running ...
2022/01/25 10:16:05 Job still running ...
2022/01/25 10:16:35 Job still running ...
2022/01/25 10:17:05 Job still running ...
2022/01/25 10:17:35 Job still running ...
2022/01/25 10:18:05 Failed to execute job: job 2022-01-25_02_14_31-2740969621517997875 failed
panic: Failed to execute job: job 2022-01-25_02_14_31-2740969621517997875 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144a48, 0xc000120000, 0x10333fd, 0x19, 0xc00028be00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 46s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/5f6yh4i3rb3va
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #402
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/402/display/redirect>
Changes:
------------------------------------------
[...truncated 17.87 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/24 10:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643019279243460589/model
2022/01/24 10:14:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0124100223"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643019279243460589/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643019279243460589/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0124100223",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/24 10:14:40 Submitted job: 2022-01-24_02_14_39-5246465564338229123
2022/01/24 10:14:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-24_02_14_39-5246465564338229123?project=apache-beam-testing
2022/01/24 10:14:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-24_02_14_39-5246465564338229123
2022/01/24 10:14:40 Job state: JOB_STATE_PENDING ...
2022/01/24 10:15:10 Job still running ...
2022/01/24 10:15:40 Job still running ...
2022/01/24 10:16:10 Job still running ...
2022/01/24 10:16:40 Job still running ...
2022/01/24 10:17:10 Job still running ...
2022/01/24 10:17:40 Job still running ...
2022/01/24 10:18:10 Failed to execute job: job 2022-01-24_02_14_39-5246465564338229123 failed
panic: Failed to execute job: job 2022-01-24_02_14_39-5246465564338229123 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144a48, 0xc000120000, 0x10333fd, 0x19, 0xc0004efe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/q6zuuctqdut6w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #401
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/401/display/redirect>
Changes:
------------------------------------------
[...truncated 17.87 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/23 10:14:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642932884289931113/model
2022/01/23 10:14:44 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0123100221"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642932884289931113/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642932884289931113/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0123100221",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/23 10:14:45 Submitted job: 2022-01-23_02_14_44-16068856906243271168
2022/01/23 10:14:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-23_02_14_44-16068856906243271168?project=apache-beam-testing
2022/01/23 10:14:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-23_02_14_44-16068856906243271168
2022/01/23 10:14:45 Job state: JOB_STATE_PENDING ...
2022/01/23 10:15:15 Job still running ...
2022/01/23 10:15:45 Job still running ...
2022/01/23 10:16:15 Job still running ...
2022/01/23 10:16:45 Job still running ...
2022/01/23 10:17:15 Job still running ...
2022/01/23 10:17:45 Job still running ...
2022/01/23 10:18:16 Failed to execute job: job 2022-01-23_02_14_44-16068856906243271168 failed
panic: Failed to execute job: job 2022-01-23_02_14_44-16068856906243271168 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144a48, 0xc0000480b0, 0x10333fd, 0x19, 0xc000459e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/oncssfznrrsd2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #400
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/400/display/redirect?page=changes>
Changes:
[ningkang0957] [BEAM-13687] Improved Spanner IO request count metrics
[noreply] [BEAM-10206] Add key for fields in wrapper (#16583)
[noreply] Merge pull request #16530 from Adding JSON support in SpannerIO and
[noreply] [BEAM-13685] Enable users to specify cache directory under Interactive
------------------------------------------
[...truncated 17.88 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/22 10:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642846481475659293/model
2022/01/22 10:14:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0122100235"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642846481475659293/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642846481475659293/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0122100235",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/22 10:14:43 Submitted job: 2022-01-22_02_14_42-16510528399705337220
2022/01/22 10:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-22_02_14_42-16510528399705337220?project=apache-beam-testing
2022/01/22 10:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-22_02_14_42-16510528399705337220
2022/01/22 10:14:43 Job state: JOB_STATE_PENDING ...
2022/01/22 10:15:13 Job still running ...
2022/01/22 10:15:43 Job still running ...
2022/01/22 10:16:13 Job still running ...
2022/01/22 10:16:43 Job still running ...
2022/01/22 10:17:13 Job still running ...
2022/01/22 10:17:43 Job still running ...
2022/01/22 10:18:13 Failed to execute job: job 2022-01-22_02_14_42-16510528399705337220 failed
panic: Failed to execute job: job 2022-01-22_02_14_42-16510528399705337220 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144a48, 0xc0000480b0, 0x10333fd, 0x19, 0xc0007bfe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/o4zkifumcbf6y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #399
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/399/display/redirect?page=changes>
Changes:
[thiagotnunes] [BEAM-12164]: Add SDF for reading change stream records
[tuyarer] [BEAM-13577] Beam Select's uniquifyNames function loses nullability of
[sergey.kalinin] Update GH Actions to use proper variables names and proper triggers
[dhuntsperger] edited README and comments in Python multi-lang pipes examples
[Pablo Estrada] Revert "Merge pull request #15863 from [BEAM-13184] Autosharding for
[Pablo Estrada] BEAM-13611 reactivating jdbcio xlang test
[Steve Niemitz] [BEAM-13689] Output token elements when BQ batch writes complete.
[noreply] Merge pull request #16371 from [BEAM-13518][Playground] Beam Playground
[noreply] Update Java FnAPI beam master (#16572)
[noreply] [BEAM-13699] Replace fnv with maphash. (#16573)
[noreply] [BEAM-13693] Bump
[noreply] [BEAM-10206] Remove Fatalf calls in non-test goroutines for
[noreply] [BEAM-13430] Re-add provided configuration (#16552)
[noreply] Merge pull request #16540 from [BEAM-13678][Playground]Update Github
[noreply] Merge pull request #16546 from [BEAM-13661] [BEAM-13704] [Playground]
[noreply] Merge pull request #16369 from [BEAM-13558] [Playground] Hide the Graph
------------------------------------------
[...truncated 17.93 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/21 10:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642760081831368547/model
2022/01/21 10:14:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0121100226"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642760081831368547/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642760081831368547/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0121100226",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/21 10:14:43 Submitted job: 2022-01-21_02_14_42-11648307003126915888
2022/01/21 10:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-21_02_14_42-11648307003126915888?project=apache-beam-testing
2022/01/21 10:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-21_02_14_42-11648307003126915888
2022/01/21 10:14:43 Job state: JOB_STATE_PENDING ...
2022/01/21 10:15:13 Job still running ...
2022/01/21 10:15:43 Job still running ...
2022/01/21 10:16:13 Job still running ...
2022/01/21 10:16:43 Job still running ...
2022/01/21 10:17:13 Job still running ...
2022/01/21 10:17:43 Job still running ...
2022/01/21 10:18:13 Job still running ...
2022/01/21 10:18:43 Job still running ...
2022/01/21 10:19:14 Job still running ...
2022/01/21 10:19:44 Job still running ...
2022/01/21 10:20:14 Failed to execute job: job 2022-01-21_02_14_42-11648307003126915888 failed
panic: Failed to execute job: job 2022-01-21_02_14_42-11648307003126915888 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144a48, 0xc0000480b0, 0x10333fd, 0x19, 0xc000353e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/5fdebd6vbb75o
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #398
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/398/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13015] Provide caching statistics in the status client. (#16495)
[noreply] [BEAM-13611] Skip test_xlang_jdbc_write (#16554)
[noreply] Merge pull request #16370 from [BEAM-13556] playground - color and
[noreply] Merge pull request #16531 from [BEAM-13567] [playground] Handle run code
[noreply] Merge pull request #16533 from [BEAM-13548] [Playground] Add example
[noreply] Merge pull request #16519 from [BEAM-13639] [Playground] Add
[noreply] Merge pull request #16518 from [BEAM-13619] [Playground] Add loading
[noreply] Merge pull request #16243 from
[noreply] [BEAM-13683] Make cross-language SQL example pipeline (#16567)
[noreply] [BEAM-13688] fixed type in BPG 4.5.3 window section (#16560)
[noreply] Remove obsolete commands from Inventory job. (#16564)
[noreply] Disable logging for memoization test. (#16556)
[noreply] Merge pull request #16472: [BEAM-13697] Add SchemaFieldNumber annotation
[noreply] Merge pull request #16373 from [BEAM-13515] [Playground] Hiding lines in
------------------------------------------
[...truncated 17.90 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/20 10:14:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642673683626453658/model
2022/01/20 10:14:44 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0120100227"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642673683626453658/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642673683626453658/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0120100227",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/20 10:14:44 Submitted job: 2022-01-20_02_14_44-16925084302805069749
2022/01/20 10:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-20_02_14_44-16925084302805069749?project=apache-beam-testing
2022/01/20 10:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-20_02_14_44-16925084302805069749
2022/01/20 10:14:45 Job state: JOB_STATE_PENDING ...
2022/01/20 10:15:15 Job still running ...
2022/01/20 10:15:45 Job still running ...
2022/01/20 10:16:15 Job still running ...
2022/01/20 10:16:45 Job still running ...
2022/01/20 10:17:15 Job still running ...
2022/01/20 10:17:45 Job still running ...
2022/01/20 10:18:15 Failed to execute job: job 2022-01-20_02_14_44-16925084302805069749 failed
panic: Failed to execute job: job 2022-01-20_02_14_44-16925084302805069749 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144568, 0xc0000480b0, 0x1032fbd, 0x19, 0xc000543e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/7odflhnfetym6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #397
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/397/display/redirect?page=changes>
Changes:
[mmack] [BEAM-8806] Integration test for SqsIO
[mmack] [BEAM-13631] Add deterministic SQS message coder to fix reading from SQS
[Robert Bradshaw] Bump beam container version.
[alexander.zhuravlev] [BEAM-13680] Fixed code_repository (added pipelineUuid to RunCodeResult
[Robert Bradshaw] Also bump FnAPI container.
[noreply] [BEAM-13616][BEAM-13645] Switch to vendored grpc 1.43.2 (#16543)
[noreply] [BEAM-13616][BEAM-13646] Upgrade vendored calcite to 1.28.0:0.2 (#16544)
[noreply] Merge pull request #16486 from [BEAM-13544][Playground] Add logs to
[noreply] [BEAM-13683] Correct SQL transform schema, fix expansion address
[noreply] Update walkthrough.md (#16512)
[noreply] [BEAM-11808][BEAM-9879] Support aggregate functions with two arguments
[noreply] Merge pull request #16506 from [BEAM-13652][Playground] Send examples'
[noreply] Merge pull request #16322 from [BEAM-13407] [Playground] Preload fonts
[noreply] [BEAM-13665] Make SpannerIO projectID optional again (#16547)
[noreply] [BEAM-13015] Add state caching capability to be used as hint for runners
[noreply] Merge pull request #16309: [BEAM-13503] Set a default value to
------------------------------------------
[...truncated 17.97 KB...]
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/19 10:14:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642587280213786552/model
2022/01/19 10:14:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0119100240"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642587280213786552/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642587280213786552/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0119100240",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/19 10:14:41 Submitted job: 2022-01-19_02_14_40-6990173904608334229
2022/01/19 10:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-19_02_14_40-6990173904608334229?project=apache-beam-testing
2022/01/19 10:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-19_02_14_40-6990173904608334229
2022/01/19 10:14:41 Job state: JOB_STATE_PENDING ...
2022/01/19 10:15:11 Job still running ...
2022/01/19 10:15:41 Job still running ...
2022/01/19 10:16:11 Job still running ...
2022/01/19 10:16:41 Job still running ...
2022/01/19 10:17:11 Job still running ...
2022/01/19 10:17:41 Job still running ...
2022/01/19 10:18:12 Job still running ...
2022/01/19 10:18:42 Job still running ...
2022/01/19 10:19:12 Job still running ...
2022/01/19 10:19:42 Job still running ...
2022/01/19 10:20:12 Job still running ...
2022/01/19 10:20:42 Failed to execute job: job 2022-01-19_02_14_40-6990173904608334229 failed
panic: Failed to execute job: job 2022-01-19_02_14_40-6990173904608334229 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144568, 0xc0000480b0, 0x1032fbd, 0x19, 0xc000375e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 6m 20s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/2uljlgr2t3xkw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #396
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/396/display/redirect?page=changes>
Changes:
[aydar.zaynutdinov] [BEAM-13641][Playground]
[mmack] [BEAM-8806] Integration test for SqsIO using Localstack
[noreply] Remove jcenter repositories from gradle configuration. (#16532)
[noreply] [BEAM-13430] Remove jcenter which will no longer contain any updates.
[noreply] [BEAM-13616] Update com.google.cloud:libraries-bom to 24.2.0 (#16509)
------------------------------------------
[...truncated 17.90 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/18 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642500882868517706/model
2022/01/18 10:14:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0118100234"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642500882868517706/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642500882868517706/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0118100234",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/18 10:14:44 Submitted job: 2022-01-18_02_14_43-10417587825058030602
2022/01/18 10:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-18_02_14_43-10417587825058030602?project=apache-beam-testing
2022/01/18 10:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-18_02_14_43-10417587825058030602
2022/01/18 10:14:44 Job state: JOB_STATE_PENDING ...
2022/01/18 10:15:14 Job still running ...
2022/01/18 10:15:44 Job still running ...
2022/01/18 10:16:15 Job still running ...
2022/01/18 10:16:45 Job still running ...
2022/01/18 10:17:15 Job still running ...
2022/01/18 10:17:45 Job still running ...
2022/01/18 10:18:15 Job still running ...
2022/01/18 10:18:45 Job still running ...
2022/01/18 10:19:15 Job still running ...
2022/01/18 10:19:45 Job still running ...
2022/01/18 10:20:15 Failed to execute job: job 2022-01-18_02_14_43-10417587825058030602 failed
panic: Failed to execute job: job 2022-01-18_02_14_43-10417587825058030602 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144568, 0xc0000480b0, 0x1032fbd, 0x19, 0xc0004dfe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://scans.gradle.com/s/5fv6sys2eugzo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #395
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/395/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #16507: [BEAM-13137] Fixes ES utest size flakiness
------------------------------------------
[...truncated 17.98 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/17 10:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642414482246799774/model
2022/01/17 10:14:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0117100237"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642414482246799774/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642414482246799774/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0117100237",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/17 10:14:43 Submitted job: 2022-01-17_02_14_42-2027609258631195871
2022/01/17 10:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-17_02_14_42-2027609258631195871?project=apache-beam-testing
2022/01/17 10:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-17_02_14_42-2027609258631195871
2022/01/17 10:14:43 Job state: JOB_STATE_PENDING ...
2022/01/17 10:15:13 Job still running ...
2022/01/17 10:15:43 Job still running ...
2022/01/17 10:16:13 Job still running ...
2022/01/17 10:16:44 Job still running ...
2022/01/17 10:17:14 Job still running ...
2022/01/17 10:17:44 Job still running ...
2022/01/17 10:18:14 Failed to execute job: job 2022-01-17_02_14_42-2027609258631195871 failed
panic: Failed to execute job: job 2022-01-17_02_14_42-2027609258631195871 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144568, 0xc0000480b0, 0x1032fbd, 0x19, 0xc000025e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://scans.gradle.com/s/nlkqil7cvlmx2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #394
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/394/display/redirect>
Changes:
------------------------------------------
[...truncated 17.90 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/16 10:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642328080683513661/model
2022/01/16 10:14:41 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0116100226"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642328080683513661/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642328080683513661/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0116100226",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/16 10:14:41 Submitted job: 2022-01-16_02_14_41-4404833142930395433
2022/01/16 10:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-16_02_14_41-4404833142930395433?project=apache-beam-testing
2022/01/16 10:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-16_02_14_41-4404833142930395433
2022/01/16 10:14:42 Job state: JOB_STATE_PENDING ...
2022/01/16 10:15:12 Job still running ...
2022/01/16 10:15:42 Job still running ...
2022/01/16 10:16:12 Job still running ...
2022/01/16 10:16:42 Job still running ...
2022/01/16 10:17:12 Job still running ...
2022/01/16 10:17:42 Job still running ...
2022/01/16 10:18:12 Failed to execute job: job 2022-01-16_02_14_41-4404833142930395433 failed
panic: Failed to execute job: job 2022-01-16_02_14_41-4404833142930395433 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144568, 0xc0000480b0, 0x1032fbd, 0x19, 0xc00056de00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://scans.gradle.com/s/ikdkal56vnpig
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #393
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/393/display/redirect?page=changes>
Changes:
[daria.malkova] Split builder into several builder for each step of pipeline execution
[Valentyn Tymofieiev] Provide API to check whether a hint is known.
[Valentyn Tymofieiev] [BEAM-12558] Fix doc typo.
[arietis27] [BEAM-13400] JDBC IO does not support UUID and JSONB PostgreSQL types
[noreply] [BEAM-12572] Run java examples on multiple runners (#16450)
[jrmccluskey] [BEAM-10206] Resolve go vet errors in protox package
[noreply] Merge pull request #16482 from [BEAM-13429][Playground] Add builder for
[noreply] [BEAM-13590] Fix abc imports from collections (#15850)
[jrmccluskey] Fix staticcheck errors in transforms directory
[jrmccluskey] Remove unnecessary fmt.Sprintf() in partition.go
[jrmccluskey] Replace bytes.Compare() with bytes.Equal() in test cases
[jrmccluskey] Replace string(buf.Bytes()) with buf.String() in coder_test.go
[jrmccluskey] Remove unnecessary blank identifier assignment in harness.go
[jrmccluskey] fix capitalized error strings in expansionx
[jrmccluskey] Clean up string cast of bytes in vet.go and corresponding tests
[jrmccluskey] Remove unnecessary fmt call in universal.go
[Robert Bradshaw] Remove tab from source.
[noreply] Redirecting cross-language transforms content (#16504)
[noreply] doc tweaks (#16498)
[noreply] [BEAM-12621] - Update Jenkins VMs to modern Ubuntu version (#16457)
[noreply] [BEAM-13664] Fix Primitives hashing benchmark (#16523)
------------------------------------------
[...truncated 17.91 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/15 10:14:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642241685076423363/model
2022/01/15 10:14:45 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0115100235"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642241685076423363/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642241685076423363/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0115100235",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/15 10:14:46 Submitted job: 2022-01-15_02_14_45-14163985350588540888
2022/01/15 10:14:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-15_02_14_45-14163985350588540888?project=apache-beam-testing
2022/01/15 10:14:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-15_02_14_45-14163985350588540888
2022/01/15 10:14:46 Job state: JOB_STATE_PENDING ...
2022/01/15 10:15:16 Job still running ...
2022/01/15 10:15:46 Job still running ...
2022/01/15 10:16:16 Job still running ...
2022/01/15 10:16:46 Job still running ...
2022/01/15 10:17:16 Job still running ...
2022/01/15 10:17:46 Job still running ...
2022/01/15 10:18:16 Failed to execute job: job 2022-01-15_02_14_45-14163985350588540888 failed
panic: Failed to execute job: job 2022-01-15_02_14_45-14163985350588540888 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144568, 0xc0000480b0, 0x1032fbd, 0x19, 0xc0002dde00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://scans.gradle.com/s/6lwr7gyezctvy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #392
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/392/display/redirect?page=changes>
Changes:
[blais] python sdk examples: Fixed typo in wordcount example.
[noreply] [BEAM-13480] Increase pipeline timeout for
[noreply] Stronger typing inference for CoGBK. (#16465)
[noreply] [BEAM-12464] Change ProtoSchemaTranslator beam schema creation to match
[noreply] Introduce the notion of a JoinIndex for fewer shuffles. (#16101)
[noreply] Merge pull request #16467 from [BEAM-12164]: SpannerIO
[noreply] Merge pull request #16385 from [BEAM-13535] [Playground] add cancel
[noreply] Merge pull request #16485 from [BEAM-13486] [Playground] For unit tests
[heejong] [BEAM-13455] Remove duplicated artifacts when using multiple
------------------------------------------
[...truncated 17.92 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/14 10:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642155280606185141/model
2022/01/14 10:14:41 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0114100238"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642155280606185141/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642155280606185141/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0114100238",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/14 10:14:41 Submitted job: 2022-01-14_02_14_41-18422070290231743319
2022/01/14 10:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-14_02_14_41-18422070290231743319?project=apache-beam-testing
2022/01/14 10:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-14_02_14_41-18422070290231743319
2022/01/14 10:14:42 Job state: JOB_STATE_PENDING ...
2022/01/14 10:15:12 Job still running ...
2022/01/14 10:15:42 Job still running ...
2022/01/14 10:16:12 Job still running ...
2022/01/14 10:16:42 Job still running ...
2022/01/14 10:17:12 Job still running ...
2022/01/14 10:17:42 Job still running ...
2022/01/14 10:18:12 Failed to execute job: job 2022-01-14_02_14_41-18422070290231743319 failed
panic: Failed to execute job: job 2022-01-14_02_14_41-18422070290231743319 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144568, 0xc000120000, 0x1032fbd, 0x19, 0xc0005dde00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/fjezr7xnunhr6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #391
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/391/display/redirect?page=changes>
Changes:
[mmack] [BEAM-13638] Datatype of timestamp fields in SqsMessage for AWS IOs for
[noreply] Merge pull request #16469 from [BEAM-13623][Playground] [Bugfix] During
[noreply] Merge pull request #16149 from [BEAM-13113] [Playground] playground
[noreply] Merge pull request #16363 from [BEAM-13557] [Playground] show code
[noreply] Merge pull request #16374 from [BEAM-13398][Playground] Split LifeCycle
[noreply] [BEAM-13616][BEAM-13646] Update vendored calcite 1.28.0 with protobuf
[chamikaramj] Adds several example multi-language Python pipelines
[noreply] Merge pull request #16325 from [BEAM-13471] [Playground] Tag existing
[noreply] [BEAM-13399] Move service liveness polling to Runner type (#16487)
------------------------------------------
[...truncated 17.91 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/13 10:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642068880293314739/model
2022/01/13 10:14:41 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0113100232"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642068880293314739/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642068880293314739/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0113100232",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/13 10:14:41 Submitted job: 2022-01-13_02_14_41-17300617779914652056
2022/01/13 10:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-13_02_14_41-17300617779914652056?project=apache-beam-testing
2022/01/13 10:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-13_02_14_41-17300617779914652056
2022/01/13 10:14:41 Job state: JOB_STATE_PENDING ...
2022/01/13 10:15:11 Job still running ...
2022/01/13 10:15:41 Job still running ...
2022/01/13 10:16:11 Job still running ...
2022/01/13 10:16:41 Job still running ...
2022/01/13 10:17:12 Job still running ...
2022/01/13 10:17:42 Job still running ...
2022/01/13 10:18:12 Failed to execute job: job 2022-01-13_02_14_41-17300617779914652056 failed
panic: Failed to execute job: job 2022-01-13_02_14_41-17300617779914652056 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144568, 0xc000120000, 0x1032fbd, 0x19, 0xc000379e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/4yjuhyyyxppr2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #390
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/390/display/redirect?page=changes>
Changes:
[ningkang0957] [BEAM-13602] Prevented metrics gathering from failing bigtable io
[ningkang0957] make the code more pythonic
[mmack] [BEAM-13243][BEAM-8374] Add support for missing PublishResponse fields
[Robert Bradshaw] Optional args and kwargs for named external transforms.
[mmack] [adhoc] Run spotlessApply on java examples to fix master
[noreply] [BEAM-13628] Update SideInputCache to use full Transform and
[noreply] [BEAM-13432] Skip ExpansionService creation in Job Server (#16222)
[noreply] [BEAM-13616] Initial files for vendored gRPC 1.43.2 (#16460)
------------------------------------------
[...truncated 18.63 KB...]
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/12 10:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641982482104763529/model
2022/01/12 10:14:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0112100224"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641982482104763529/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641982482104763529/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0112100224",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/12 10:14:43 Submitted job: 2022-01-12_02_14_42-6580347520483436449
2022/01/12 10:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-12_02_14_42-6580347520483436449?project=apache-beam-testing
2022/01/12 10:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-12_02_14_42-6580347520483436449
2022/01/12 10:14:43 Job state: JOB_STATE_PENDING ...
2022/01/12 10:15:13 Job still running ...
2022/01/12 10:15:43 Job still running ...
2022/01/12 10:16:13 Job still running ...
2022/01/12 10:16:43 Job still running ...
2022/01/12 10:17:13 Job still running ...
2022/01/12 10:17:43 Job still running ...
2022/01/12 10:18:14 Failed to execute job: job 2022-01-12_02_14_42-6580347520483436449 failed
panic: Failed to execute job: job 2022-01-12_02_14_42-6580347520483436449 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144568, 0xc000120000, 0x1032fbd, 0x19, 0xc000457e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
Publishing failed.
The build scan server appears to be unavailable.
Please check https://status.gradle.com for the latest service status.
If the service is reported as available, please report this problem via https://gradle.com/help/plugin and include the following via copy/paste:
----------
Gradle version: 7.3.2
Plugin version: 3.4.1
Request URL: https://status.gradle.com
Request ID: 1707bd77-abfd-4966-8455-60eb0e147bfa
Response status code: 405
Response server type: Varnish
----------
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #389
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/389/display/redirect?page=changes>
Changes:
[Alexey Romanenko] [BEAM-8727] Bump software.amazon.awssdk to 2.17.106
[relax] don't close streams in finalize
[noreply] Loosen typing extensions bound
[Alexey Romanenko] [BEAM-4868] Bump com.amazonaws to 1.12.135
[noreply] [BEAM-12092] Bump jedis to version 4.0.1 (#16287)
[noreply] [BEAM-13534] Add automated port polling to expansion service runner if
[noreply] Merge pull request #16344 from [BEAM-13536][Playground][Bugfix] CI step
[noreply] Merge pull request #16359 from [BEAM-13545][Playground] Add
[noreply] Merge pull request #16384 from [BEAM-13308] [Playground] Getting
[noreply] Merge pull request #16306 from [BEAM-13447] [Playground] Add filling of
[noreply] Merge pull request #16361 from [BEAM-13543][Playground] Add logic of
[noreply] [BEAM-12562] Dataframe pipe implementation (#16256)
[noreply] Merge pull request #16338 from [BEAM-13528][Playground] Add liveness
[noreply] [BEAM-13626] Remap expanded outputs after merging. (#16471)
[noreply] Merge pull request #16147 from [BEAM-13359] [Playground] Tag existing
[noreply] [BEAM-3221] Improve documentation in model pipeline protos (#16474)
[noreply] [BEAM-13614] Add OnWindowExpiration support to the Java SDK harness and
[noreply] Merge pull request #16156 from [BEAM-13391] Fix temporary file format in
------------------------------------------
[...truncated 17.93 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/11 10:14:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641896085058776986/model
2022/01/11 10:14:45 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0111100225"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641896085058776986/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641896085058776986/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0111100225",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/11 10:14:46 Submitted job: 2022-01-11_02_14_45-7337445275606914172
2022/01/11 10:14:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-11_02_14_45-7337445275606914172?project=apache-beam-testing
2022/01/11 10:14:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-11_02_14_45-7337445275606914172
2022/01/11 10:14:46 Job state: JOB_STATE_PENDING ...
2022/01/11 10:15:16 Job still running ...
2022/01/11 10:15:46 Job still running ...
2022/01/11 10:16:16 Job still running ...
2022/01/11 10:16:46 Job still running ...
2022/01/11 10:17:16 Job still running ...
2022/01/11 10:17:46 Job still running ...
2022/01/11 10:18:16 Failed to execute job: job 2022-01-11_02_14_45-7337445275606914172 failed
panic: Failed to execute job: job 2022-01-11_02_14_45-7337445275606914172 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1143228, 0xc0000480b0, 0x1031dbd, 0x19, 0xc000751e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 54s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/nhwxuvjgm23du
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #388
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/388/display/redirect>
Changes:
------------------------------------------
[...truncated 18.13 KB...]
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/10 10:14:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641809692231771166/model
2022/01/10 10:14:53 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0110100222"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641809692231771166/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641809692231771166/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0110100222",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/10 10:14:53 Submitted job: 2022-01-10_02_14_53-12400460516543838766
2022/01/10 10:14:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-10_02_14_53-12400460516543838766?project=apache-beam-testing
2022/01/10 10:14:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-10_02_14_53-12400460516543838766
2022/01/10 10:14:53 Job state: JOB_STATE_PENDING ...
2022/01/10 10:15:23 Job still running ...
2022/01/10 10:15:53 Job still running ...
2022/01/10 10:16:23 Job still running ...
2022/01/10 10:16:54 Job still running ...
2022/01/10 10:17:24 Job still running ...
2022/01/10 10:17:54 Job still running ...
2022/01/10 10:18:24 Job still running ...
2022/01/10 10:18:54 Job still running ...
2022/01/10 10:19:24 Job still running ...
2022/01/10 10:19:54 Job still running ...
2022/01/10 10:20:24 Failed to execute job: job 2022-01-10_02_14_53-12400460516543838766 failed
panic: Failed to execute job: job 2022-01-10_02_14_53-12400460516543838766 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1143228, 0xc0000480b0, 0x1031dbd, 0x19, 0xc0005b3e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 1s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ammeyvn56qxku
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #387
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/387/display/redirect>
Changes:
------------------------------------------
[...truncated 17.91 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/09 10:15:01 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641723300782025327/model
2022/01/09 10:15:01 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0109100233"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641723300782025327/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641723300782025327/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0109100233",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/09 10:15:02 Submitted job: 2022-01-09_02_15_01-14261961477001358574
2022/01/09 10:15:02 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-09_02_15_01-14261961477001358574?project=apache-beam-testing
2022/01/09 10:15:02 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-09_02_15_01-14261961477001358574
2022/01/09 10:15:02 Job state: JOB_STATE_PENDING ...
2022/01/09 10:15:32 Job still running ...
2022/01/09 10:16:02 Job still running ...
2022/01/09 10:16:32 Job still running ...
2022/01/09 10:17:02 Job still running ...
2022/01/09 10:17:32 Job still running ...
2022/01/09 10:18:02 Job still running ...
2022/01/09 10:18:32 Failed to execute job: job 2022-01-09_02_15_01-14261961477001358574 failed
panic: Failed to execute job: job 2022-01-09_02_15_01-14261961477001358574 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1143228, 0xc0000480b0, 0x1031dbd, 0x19, 0xc0004bde00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/e5cynb6bmgjvy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #386
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/386/display/redirect?page=changes>
Changes:
[Alexey Romanenko] [adhoc] Fix BigTableIO description
[noreply] [BEAM-13015] Remove dead code now that all instances have migrated to
[noreply] [BEAM-13386] Add RLock support for cloudpickle (#16250)
[danthev] Fix overflow
------------------------------------------
[...truncated 17.96 KB...]
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/08 10:14:56 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641636895581272762/model
2022/01/08 10:14:56 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0108100231"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641636895581272762/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641636895581272762/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0108100231",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/08 10:14:56 Submitted job: 2022-01-08_02_14_56-14030322924335190171
2022/01/08 10:14:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-08_02_14_56-14030322924335190171?project=apache-beam-testing
2022/01/08 10:14:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-08_02_14_56-14030322924335190171
2022/01/08 10:14:57 Job state: JOB_STATE_PENDING ...
2022/01/08 10:15:27 Job still running ...
2022/01/08 10:15:57 Job still running ...
2022/01/08 10:16:27 Job still running ...
2022/01/08 10:16:57 Job still running ...
2022/01/08 10:17:27 Job still running ...
2022/01/08 10:17:57 Job still running ...
2022/01/08 10:18:27 Job still running ...
2022/01/08 10:18:57 Failed to execute job: job 2022-01-08_02_14_56-14030322924335190171 failed
panic: Failed to execute job: job 2022-01-08_02_14_56-14030322924335190171 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1143228, 0xc0000480b0, 0x1031dbd, 0x19, 0xc0006f1e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 33s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/uzhehqmkrf37k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #385
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/385/display/redirect?page=changes>
Changes:
[heejong] [BEAM-13091] Generate missing staged names from hash for Dataflow runner
[heejong] add test
[arietis27] [BEAM-13604] NPE while getting null from BigDecimal column
[noreply] Fixed empty labels treated as wildcard when matching cache files
[noreply] [BEAM-13570] Remove erroneous compileClasspath dependency. (#16438)
[noreply] [BEAM-13015] Plumb through process wide and bundle cache through the
[noreply] [BEAM-13015] Cache the state backed iterable used for large GBK results.
[noreply] Fix formatting/alignment (#16443)
[noreply] Merge pull request #16183 from [BEAM-13427] [Playground] show logs for
[noreply] [BEAM-10277] re-write encoding position tests to declare schema protos
[noreply] Update local_env_tests.yml (#16444)
[noreply] [BEAM-13574] Filesystem abstraction Rename support (#16428)
[noreply] [BEAM-13597] Setup Go in github actions (#16446)
[noreply] Merge pull request #16161 from [BEAM-12164] Add Spanner Partition
[noreply] Merge pull request #16203 from [BEAM-12164] Add Spanner Change Stream
------------------------------------------
[...truncated 18.17 KB...]
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/07 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641550482609670258/model
2022/01/07 10:14:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0107100233"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641550482609670258/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641550482609670258/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0107100233",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/07 10:14:43 Submitted job: 2022-01-07_02_14_43-1688418067290828176
2022/01/07 10:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-07_02_14_43-1688418067290828176?project=apache-beam-testing
2022/01/07 10:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-07_02_14_43-1688418067290828176
2022/01/07 10:14:44 Job state: JOB_STATE_PENDING ...
2022/01/07 10:15:14 Job still running ...
2022/01/07 10:15:44 Job still running ...
2022/01/07 10:16:14 Job still running ...
2022/01/07 10:16:44 Job still running ...
2022/01/07 10:17:14 Job still running ...
2022/01/07 10:17:44 Job still running ...
2022/01/07 10:18:14 Job still running ...
2022/01/07 10:18:44 Job still running ...
2022/01/07 10:19:14 Job still running ...
2022/01/07 10:19:44 Job still running ...
2022/01/07 10:20:14 Failed to execute job: job 2022-01-07_02_14_43-1688418067290828176 failed
panic: Failed to execute job: job 2022-01-07_02_14_43-1688418067290828176 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1143228, 0xc000120000, 0x1031dbd, 0x19, 0xc000417e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/cs5g2hwrfevk6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #384
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/384/display/redirect?page=changes>
Changes:
[aydar.zaynutdinov] [BEAM-13565][Playground]
[relax] update bom
[zyichi] Upgrade python library versions in base_image_requirements.txt
[noreply] [BEAM-13567] Consolidate runner flag definition. (#16426)
[noreply] [BEAM-13601] Don't cache Row types for a schema. (#16427)
[noreply] [BEAM-13430] Re-enable checkerframework (#16429)
[noreply] [BEAM-13430] Ensure that testRuntimeMigration depends on "default"
[noreply] Merge pull request #16277 from [BEAM-13124][Playground] Create readiness
[noreply] Merge pull request #16314 from [BEAM-13260][Playground]Implement setup
[noreply] Merge pull request #16383 from [BEAM-13566][Playground] Add logic of
[noreply] Merge pull request #16365 from [BEAM-13559][Playground] Remove tag in
[noreply] Merge pull request #16360 from [BEAM-13546][Playground] Update nginx
[noreply] Merge pull request #16192 from [BEAM-13395] [Playground] Tag katas
[noreply] Merge pull request #16254 from [BEAM-13249][Playground] Security – Mock
[ningkang0957] [BEAM-12879] Prevented missing permission from failing GCS I/O
[noreply] Merge pull request #16347: fix: move connector to use v1 BigQuery
[noreply] [BEAM-13603] Fix bug in apache_beam.utils.Shared (#16437)
[noreply] [BEAM-10345] Add an import guard to support recent google-cloud-spanner
------------------------------------------
[...truncated 18.20 KB...]
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/06 10:14:52 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641464092113109296/model
2022/01/06 10:14:52 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0106100238"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641464092113109296/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641464092113109296/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0106100238",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/06 10:14:53 Submitted job: 2022-01-06_02_14_52-3616611683174250088
2022/01/06 10:14:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-06_02_14_52-3616611683174250088?project=apache-beam-testing
2022/01/06 10:14:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-06_02_14_52-3616611683174250088
2022/01/06 10:14:53 Job state: JOB_STATE_PENDING ...
2022/01/06 10:15:23 Job still running ...
2022/01/06 10:15:53 Job still running ...
2022/01/06 10:16:23 Job still running ...
2022/01/06 10:16:53 Job still running ...
2022/01/06 10:17:23 Job still running ...
2022/01/06 10:17:53 Job still running ...
2022/01/06 10:18:24 Job still running ...
2022/01/06 10:18:54 Job still running ...
2022/01/06 10:19:24 Job still running ...
2022/01/06 10:19:54 Job still running ...
2022/01/06 10:20:24 Job still running ...
2022/01/06 10:20:54 Failed to execute job: job 2022-01-06_02_14_52-3616611683174250088 failed
panic: Failed to execute job: job 2022-01-06_02_14_52-3616611683174250088 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1141e48, 0xc0000480b0, 0x1030cd7, 0x19, 0xc00038be00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 29s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/critstigi75le
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #383
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/383/display/redirect?page=changes>
Changes:
[johnjcasey] [BEAM-12391] update avro sink to close the opened file handle, instead
[Robert Bradshaw] [BEAM-13482] Python fully qualified name external transforms.
[Robert Bradshaw] Add Python expansion service entry point.
[Kyle Weaver] [BEAM-13569] Change Spark dependencies to implementation.
[Kyle Weaver] remove redundant dependency
[wuren] [BEAM-13591] Bump log4j2 version to 2.17.1
[Steve Niemitz] [BEAM-13459] Update CHANGES.md, add note about artifact caching for
[relax] Add Flink runner support for OrderedListState. This version reads the
[noreply] Merge pull request #16404: [BEAM-13586] Fix NPE in
[zyichi] Fix sdk_container_builder too many values to unpack error
[noreply] [BEAM-13480] Sickbay PubSubIntegrationTest.test_streaming_data_only on
[Kyle Weaver] remove redundant testImplementation dependencies
[noreply] [BEAM-13430] Swap to use "mainClass" instead of "main" since it was
[zyichi] Fix remaining failing perf IT tests.
[noreply] [BEAM-13430] Replace deprecated "appendix" with "archiveAppendix"
[noreply] [BEAM-13015] Add jamm as a java agent to the Java SDK harness container
[noreply] [BEAM-13430] Partially revert
[noreply] Merge pull request #15863 from [BEAM-13184] Autosharding for
[noreply] [BEAM-11936] Enable FloatingPointAssertionWithinEpsilon errorprone check
[noreply] [BEAM-11936] Enable LockNotBeforeTry errorprone check (#16259)
[noreply] [BEAM-11936] Enable errorprone unused checks (#16262)
[noreply] Add Nexmark Query 14 (#16337)
[noreply] [BEAM-13015] Migrate all user state and side implementations to support
[noreply] [BEAM-13015] Use 20% of memory when the maximum has been configured.
------------------------------------------
[...truncated 17.97 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/05 10:14:46 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641377685612456504/model
2022/01/05 10:14:46 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0105100234"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641377685612456504/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641377685612456504/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0105100234",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/05 10:14:46 Submitted job: 2022-01-05_02_14_46-18059127718819618074
2022/01/05 10:14:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-05_02_14_46-18059127718819618074?project=apache-beam-testing
2022/01/05 10:14:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-05_02_14_46-18059127718819618074
2022/01/05 10:14:46 Job state: JOB_STATE_PENDING ...
2022/01/05 10:15:16 Job still running ...
2022/01/05 10:15:47 Job still running ...
2022/01/05 10:16:17 Job still running ...
2022/01/05 10:16:47 Job still running ...
2022/01/05 10:17:17 Job still running ...
2022/01/05 10:17:47 Job still running ...
2022/01/05 10:18:17 Failed to execute job: job 2022-01-05_02_14_46-18059127718819618074 failed
panic: Failed to execute job: job 2022-01-05_02_14_46-18059127718819618074 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1141e48, 0xc0000480b0, 0x1030cd7, 0x19, 0xc0003dfe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 54s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/fw32ba3nx5tcu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #382
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/382/display/redirect?page=changes>
Changes:
[mmack] [BEAM-13509] Stop sharing SQS client between readers of same source.
[mmack] [BEAM-13587] Attempt to load AWS region from default provider chain in
------------------------------------------
[...truncated 17.95 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/04 10:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641291281513722232/model
2022/01/04 10:14:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0104100231"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641291281513722232/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641291281513722232/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0104100231",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/04 10:14:42 Submitted job: 2022-01-04_02_14_42-4264944889605956895
2022/01/04 10:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-04_02_14_42-4264944889605956895?project=apache-beam-testing
2022/01/04 10:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-04_02_14_42-4264944889605956895
2022/01/04 10:14:42 Job state: JOB_STATE_PENDING ...
2022/01/04 10:15:12 Job still running ...
2022/01/04 10:15:42 Job still running ...
2022/01/04 10:16:13 Job still running ...
2022/01/04 10:16:43 Job still running ...
2022/01/04 10:17:13 Job still running ...
2022/01/04 10:17:43 Job still running ...
2022/01/04 10:18:13 Failed to execute job: job 2022-01-04_02_14_42-4264944889605956895 failed
panic: Failed to execute job: job 2022-01-04_02_14_42-4264944889605956895 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1141e48, 0xc000120000, 0x1030cd7, 0x19, 0xc00028de00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/yvbapaafuwabs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #381
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/381/display/redirect>
Changes:
------------------------------------------
[...truncated 17.93 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/03 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641204882494515612/model
2022/01/03 10:14:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0103100230"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641204882494515612/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641204882494515612/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0103100230",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/03 10:14:43 Submitted job: 2022-01-03_02_14_43-6802900932045941978
2022/01/03 10:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-03_02_14_43-6802900932045941978?project=apache-beam-testing
2022/01/03 10:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-03_02_14_43-6802900932045941978
2022/01/03 10:14:43 Job state: JOB_STATE_PENDING ...
2022/01/03 10:15:14 Job still running ...
2022/01/03 10:15:44 Job still running ...
2022/01/03 10:16:14 Job still running ...
2022/01/03 10:16:44 Job still running ...
2022/01/03 10:17:14 Job still running ...
2022/01/03 10:17:44 Job still running ...
2022/01/03 10:18:14 Failed to execute job: job 2022-01-03_02_14_43-6802900932045941978 failed
panic: Failed to execute job: job 2022-01-03_02_14_43-6802900932045941978 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1141e48, 0xc0000480b0, 0x1030cd7, 0x19, 0xc000587e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/godawld2dp53u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #380
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/380/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13498, BEAM-13522] Sickbay broken test and test category for Spark
------------------------------------------
[...truncated 17.97 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/02 14:13:25 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641132804816736958/model
2022/01/02 14:13:25 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0102135131"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641132804816736958/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641132804816736958/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0102135131",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/02 14:13:26 Submitted job: 2022-01-02_06_13_25-2551824342086910712
2022/01/02 14:13:26 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-02_06_13_25-2551824342086910712?project=apache-beam-testing
2022/01/02 14:13:26 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-02_06_13_25-2551824342086910712
2022/01/02 14:13:26 Job state: JOB_STATE_PENDING ...
2022/01/02 14:13:56 Job still running ...
2022/01/02 14:14:26 Job still running ...
2022/01/02 14:14:56 Job still running ...
2022/01/02 14:15:26 Job still running ...
2022/01/02 14:15:56 Job still running ...
2022/01/02 14:16:26 Job still running ...
2022/01/02 14:16:56 Failed to execute job: job 2022-01-02_06_13_25-2551824342086910712 failed
panic: Failed to execute job: job 2022-01-02_06_13_25-2551824342086910712 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1141e48, 0xc0000480b0, 0x1030cd7, 0x19, 0xc000571e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 5s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ljljs3ohfxaou
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #379
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/379/display/redirect?page=changes>
Changes:
[stranniknm] [BEAM-13555] playground - quick fix for safari
[noreply] Merge pull request #15769 from [BEAM-13031] [Playground] Code editor -
[noreply] [BEAM-13541] Fix spotbugs issue with DLS in tail (#16407)
[noreply] [BEAM-13588] Add missing module for PVR tests and also sickbay known
[noreply] [BEAM-13575] Sickbay test that is flaky to restore precommit test signal
[noreply] [BEAM-12092] Bump jedis to version 3.8.0 (#16403)
------------------------------------------
[...truncated 17.93 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/01 10:14:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641032093571057825/model
2022/01/01 10:14:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0101100231"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641032093571057825/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641032093571057825/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0101100231",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/01 10:14:54 Submitted job: 2022-01-01_02_14_54-7590736961444872385
2022/01/01 10:14:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-01_02_14_54-7590736961444872385?project=apache-beam-testing
2022/01/01 10:14:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-01_02_14_54-7590736961444872385
2022/01/01 10:14:54 Job state: JOB_STATE_PENDING ...
2022/01/01 10:15:24 Job still running ...
2022/01/01 10:15:54 Job still running ...
2022/01/01 10:16:24 Job still running ...
2022/01/01 10:16:54 Job still running ...
2022/01/01 10:17:24 Job still running ...
2022/01/01 10:17:54 Job still running ...
2022/01/01 10:18:25 Failed to execute job: job 2022-01-01_02_14_54-7590736961444872385 failed
panic: Failed to execute job: job 2022-01-01_02_14_54-7590736961444872385 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1141e48, 0xc0000480b0, 0x1030cd7, 0x19, 0xc000653e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 3s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/4633ilr3yuhyy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #378
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/378/display/redirect?page=changes>
Changes:
[mmack] [BEAM-13009] Fix tests to ensure absence of duplicates only per request
[mmack] [adhoc] Use predefined min/max combiners in SQS reader to gather stats
[zyichi] Fix class not found in perf integration tests.
[noreply] Update
[noreply] [BEAM-13430] Fix class not found error for example integration tests and
[noreply] [BEAM-13430] Re-enable dependency analysis for modules. (#16395)
[noreply] [BEAM-13484][Playground] Improve Terraform Scripts For Deploy
[noreply] [BEAM-13541] More intelligent caching of CoGBK values. (#16354)
------------------------------------------
[...truncated 17.92 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/31 10:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640945680761283852/model
2021/12/31 10:14:41 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1231100227"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640945680761283852/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640945680761283852/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1231100227",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/31 10:14:42 Submitted job: 2021-12-31_02_14_41-8495945215231549896
2021/12/31 10:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-31_02_14_41-8495945215231549896?project=apache-beam-testing
2021/12/31 10:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-31_02_14_41-8495945215231549896
2021/12/31 10:14:42 Job state: JOB_STATE_PENDING ...
2021/12/31 10:15:12 Job still running ...
2021/12/31 10:15:42 Job still running ...
2021/12/31 10:16:12 Job still running ...
2021/12/31 10:16:42 Job still running ...
2021/12/31 10:17:12 Job still running ...
2021/12/31 10:17:42 Job still running ...
2021/12/31 10:18:12 Failed to execute job: job 2021-12-31_02_14_41-8495945215231549896 failed
panic: Failed to execute job: job 2021-12-31_02_14_41-8495945215231549896 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1141e48, 0xc000120000, 0x1030cd7, 0x19, 0xc0003efe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/uzqktthm2nwxe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #377
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/377/display/redirect?page=changes>
Changes:
[Steve Niemitz] [BEAM-13488] Work around bug in classpath detection
[noreply] [BEAM-13578] Validate that repeatable PipelineOptions need to be
[noreply] [BEAM-13430] Update comment over eclipse plugin. (#16387)
[zyichi] [BEAM-13430] Fix broken ULR validates runner tests
[noreply] Update venv creation commands in release scripts. (#16381)
[Steve Niemitz] [BEAM-13459] Cache artifacts across job runs on python+dataflow
[noreply] [BEAM-12777] Stable URL for current API docs (#16327)
[noreply] [BEAM-13539] correct resource override dependencies (#16392)
[Kyle Weaver] [BEAM-13581] Remove previous job name for Flink PVR precommit.
[emilyye] Moving to 2.37.0-SNAPSHOT on master branch.
[noreply] Release website update for Beam 2.35.0 (#16115)
[noreply] [BEAM-13430] Re-enable checkerframework for the project excluding the
------------------------------------------
[...truncated 18.23 KB...]
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/30 10:14:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640859283947522660/model
2021/12/30 10:14:44 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1230100222"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640859283947522660/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640859283947522660/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1230100222",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/30 10:14:45 Submitted job: 2021-12-30_02_14_44-45215011728066191
2021/12/30 10:14:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-30_02_14_44-45215011728066191?project=apache-beam-testing
2021/12/30 10:14:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-30_02_14_44-45215011728066191
2021/12/30 10:14:45 Job state: JOB_STATE_PENDING ...
2021/12/30 10:15:15 Job still running ...
2021/12/30 10:15:45 Job still running ...
2021/12/30 10:16:15 Job still running ...
2021/12/30 10:16:45 Job still running ...
2021/12/30 10:17:15 Job still running ...
2021/12/30 10:17:45 Job still running ...
2021/12/30 10:18:15 Job still running ...
2021/12/30 10:18:45 Job still running ...
2021/12/30 10:19:15 Job still running ...
2021/12/30 10:19:45 Job still running ...
2021/12/30 10:20:15 Job still running ...
2021/12/30 10:20:45 Failed to execute job: job 2021-12-30_02_14_44-45215011728066191 failed
panic: Failed to execute job: job 2021-12-30_02_14_44-45215011728066191 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1141e48, 0xc000120000, 0x1030cd7, 0x19, 0xc0003d3e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 23s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/gijeomnlmw2lg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #376
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/376/display/redirect?page=changes>
Changes:
[dpcollins] [BEAM-13402] Simplify PubsubLiteSink
[Kyle Weaver] [BEAM-13521] flink pvr batch precommit
[Kyle Weaver] [BEAM-13571] Fix ClassNotFound exception in Flink tests
[Kyle Weaver] [BEAM-13498] [BEAM-13573] exclude new tests on Flink
[noreply] Exclude UsesOnWindowExpiration by category from Dataflow v2 streaming
[noreply] [BEAM-13052] Increment pubsub python version and fix breakages. (#16126)
[noreply] [BEAM-13052] Add Pub/Sub Lite xlang transforms in python (#15727)
[noreply] [BEAM-13402] Version bump Pub/Sub Lite and implement changes to ensure
------------------------------------------
[...truncated 17.94 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/29 10:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640772879092726453/model
2021/12/29 10:14:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1229100228"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640772879092726453/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640772879092726453/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1229100228",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/29 10:14:40 Submitted job: 2021-12-29_02_14_39-8745116587182397226
2021/12/29 10:14:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-29_02_14_39-8745116587182397226?project=apache-beam-testing
2021/12/29 10:14:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-29_02_14_39-8745116587182397226
2021/12/29 10:14:40 Job state: JOB_STATE_PENDING ...
2021/12/29 10:15:10 Job still running ...
2021/12/29 10:15:40 Job still running ...
2021/12/29 10:16:10 Job still running ...
2021/12/29 10:16:40 Job still running ...
2021/12/29 10:17:10 Job still running ...
2021/12/29 10:17:40 Job still running ...
2021/12/29 10:18:10 Failed to execute job: job 2021-12-29_02_14_39-8745116587182397226 failed
panic: Failed to execute job: job 2021-12-29_02_14_39-8745116587182397226 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1141e48, 0xc000120000, 0x1030cd7, 0x19, 0xc000341e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/3kxkuxa4daoto
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #375
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/375/display/redirect?page=changes>
Changes:
[mmack] [adhoc] Forbid to import guava and others from org.testcontainers.shaded
[noreply] [BEAM-13526] Kafka.IO: make DeserializerProvider a public interface
------------------------------------------
[...truncated 17.93 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/28 10:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640686478963976491/model
2021/12/28 10:14:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1228100218"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640686478963976491/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640686478963976491/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1228100218",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/28 10:14:40 Submitted job: 2021-12-28_02_14_39-14741110121201418342
2021/12/28 10:14:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-28_02_14_39-14741110121201418342?project=apache-beam-testing
2021/12/28 10:14:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-28_02_14_39-14741110121201418342
2021/12/28 10:14:40 Job state: JOB_STATE_PENDING ...
2021/12/28 10:15:10 Job still running ...
2021/12/28 10:15:40 Job still running ...
2021/12/28 10:16:10 Job still running ...
2021/12/28 10:16:40 Job still running ...
2021/12/28 10:17:10 Job still running ...
2021/12/28 10:17:40 Job still running ...
2021/12/28 10:18:10 Failed to execute job: job 2021-12-28_02_14_39-14741110121201418342 failed
panic: Failed to execute job: job 2021-12-28_02_14_39-14741110121201418342 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1141e48, 0xc0000480b0, 0x1030cd7, 0x19, 0xc000025e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/udm7fasymcq3y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #374
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/374/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #16285 from [BEAM-13492][Playground] Update backend
------------------------------------------
[...truncated 18.20 KB...]
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/27 10:14:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640600076744347370/model
2021/12/27 10:14:37 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1227100215"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640600076744347370/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640600076744347370/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1227100215",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/27 10:14:38 Submitted job: 2021-12-27_02_14_37-237712035580755333
2021/12/27 10:14:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-27_02_14_37-237712035580755333?project=apache-beam-testing
2021/12/27 10:14:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-27_02_14_37-237712035580755333
2021/12/27 10:14:38 Job state: JOB_STATE_PENDING ...
2021/12/27 10:15:08 Job still running ...
2021/12/27 10:15:38 Job still running ...
2021/12/27 10:16:08 Job still running ...
2021/12/27 10:16:39 Job still running ...
2021/12/27 10:17:09 Job still running ...
2021/12/27 10:17:39 Job still running ...
2021/12/27 10:18:09 Job still running ...
2021/12/27 10:18:39 Job still running ...
2021/12/27 10:19:09 Job still running ...
2021/12/27 10:19:39 Job still running ...
2021/12/27 10:20:09 Job still running ...
2021/12/27 10:20:39 Failed to execute job: job 2021-12-27_02_14_37-237712035580755333 failed
panic: Failed to execute job: job 2021-12-27_02_14_37-237712035580755333 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1141e48, 0xc000120000, 0x1030cd7, 0x19, 0xc0007c5e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 18s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/xxhhuslwn7baa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #373
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/373/display/redirect?page=changes>
Changes:
[alexander.zhuravlev] [BEAM-13530] Fixed scrollbar in the Output section
[noreply] Merge pull request #16355 from [BEAM-13529] [Playground] [Bugfix] Fix
[noreply] Fixed grammar error in Go ParDo function comments. (#16329)
------------------------------------------
[...truncated 17.95 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/26 10:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640513678742788952/model
2021/12/26 10:14:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1226100217"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640513678742788952/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640513678742788952/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1226100217",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/26 10:14:41 Submitted job: 2021-12-26_02_14_39-9830153269541151666
2021/12/26 10:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-26_02_14_39-9830153269541151666?project=apache-beam-testing
2021/12/26 10:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-26_02_14_39-9830153269541151666
2021/12/26 10:14:41 Job state: JOB_STATE_PENDING ...
2021/12/26 10:15:11 Job still running ...
2021/12/26 10:15:41 Job still running ...
2021/12/26 10:16:11 Job still running ...
2021/12/26 10:16:41 Job still running ...
2021/12/26 10:17:11 Job still running ...
2021/12/26 10:17:41 Job still running ...
2021/12/26 10:18:11 Failed to execute job: job 2021-12-26_02_14_39-9830153269541151666 failed
panic: Failed to execute job: job 2021-12-26_02_14_39-9830153269541151666 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1141e48, 0xc0000480b0, 0x1030cd7, 0x19, 0xc000777e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/bwn5fypy4pwwi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #372
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/372/display/redirect>
Changes:
------------------------------------------
[...truncated 18.16 KB...]
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/25 10:14:46 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640427285386218023/model
2021/12/25 10:14:46 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1225100227"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640427285386218023/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640427285386218023/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1225100227",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/25 10:14:46 Submitted job: 2021-12-25_02_14_46-5726505351926236089
2021/12/25 10:14:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-25_02_14_46-5726505351926236089?project=apache-beam-testing
2021/12/25 10:14:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-25_02_14_46-5726505351926236089
2021/12/25 10:14:46 Job state: JOB_STATE_PENDING ...
2021/12/25 10:15:16 Job still running ...
2021/12/25 10:15:46 Job still running ...
2021/12/25 10:16:16 Job still running ...
2021/12/25 10:16:46 Job still running ...
2021/12/25 10:17:17 Job still running ...
2021/12/25 10:17:47 Job still running ...
2021/12/25 10:18:17 Job still running ...
2021/12/25 10:18:47 Job still running ...
2021/12/25 10:19:17 Job still running ...
2021/12/25 10:19:47 Job still running ...
2021/12/25 10:20:17 Job still running ...
2021/12/25 10:20:47 Failed to execute job: job 2021-12-25_02_14_46-5726505351926236089 failed
panic: Failed to execute job: job 2021-12-25_02_14_46-5726505351926236089 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1141e48, 0xc000120000, 0x1030cd7, 0x19, 0xc000343e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 26s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/zglya45dmzp7e
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #371
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/371/display/redirect?page=changes>
Changes:
[alexander.zhuravlev] [BEAM-13489] Updated manifest.json and index.html to follow best
[arietis27] [BEAM-13517] Unable to write nulls to columns with logical types
[stranniknm] [BEAM-13531] playground - fetch example info only once
[mmack] [BEAM-7559] Add integration test for DynamoDBIO (SDK v2)
[mmack] [BEAM-7559] Add integration test for DynamoDBIO (SDK v1)
[noreply] [BEAM-13399] Disable expansion service integration test on Samza and
[noreply] [BEAM-13430] Upgrade beam to gradle 7.3.2 (#16319)
[noreply] Merge pull request #16320 from [BEAM-13512] [Playground] send request to
[noreply] Merge pull request #16209 from [Playground][BEAM-13304]Deploy Python
[noreply] Merge pull request #16105 from [BEAM-13328] [Playground] Add
[noreply] Merge pull request #16103 from [BEAM-13252] [Playground] Feedback Thumbs
[noreply] Better type inference for GroupBy. (#16318)
[noreply] [BEAM-13534] Update TestAutomatedExpansionService liveness check to not
[noreply] [BEAM-13490] Bump log4j version to 2.17.0 (#16276)
------------------------------------------
[...truncated 17.90 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/24 10:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640340880432170805/model
2021/12/24 10:14:41 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1224100230"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640340880432170805/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640340880432170805/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1224100230",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/24 10:14:41 Submitted job: 2021-12-24_02_14_41-10165385584527364063
2021/12/24 10:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-24_02_14_41-10165385584527364063?project=apache-beam-testing
2021/12/24 10:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-24_02_14_41-10165385584527364063
2021/12/24 10:14:41 Job state: JOB_STATE_PENDING ...
2021/12/24 10:15:11 Job still running ...
2021/12/24 10:15:41 Job still running ...
2021/12/24 10:16:11 Job still running ...
2021/12/24 10:16:41 Job still running ...
2021/12/24 10:17:11 Job still running ...
2021/12/24 10:17:41 Job still running ...
2021/12/24 10:18:12 Failed to execute job: job 2021-12-24_02_14_41-10165385584527364063 failed
panic: Failed to execute job: job 2021-12-24_02_14_41-10165385584527364063 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1141e48, 0xc000120000, 0x1030cd7, 0x19, 0xc0003f1e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/76nle3l5ov474
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #370
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/370/display/redirect?page=changes>
Changes:
[mmack] [BEAM-13494] Avoid draining Kinesis API limits & CPU when reading from
[arietis27] [BEAM-13517] Unable to write nulls to columns with logical types
[stranniknm] [BEAM-13501] playground - add log about processing and precompiled run
[noreply] Make S3 streaming more efficient (#15931)
[noreply] [Playground][BEAM-13358]Deploy Go service via Ci/CD (#16210)
[dpcollins] [BEAM-13430] Clean up tests that override the time of the JVM
[noreply] [BEAM-12830] Install go version w/host platform. (#16330)
[noreply] [BEAM-13399] Add extra time buffer to reduce likelihood of flake in
[noreply] [BEAM-12865] Fix triggering_frequency validation (#16315)
[noreply] [BEAM-13525] Sickbay new PardoTests for Dataflow V2 Java Streaming VR
[noreply] [BEAM-12830] Avoid flock and prepare task once. (OSX fix.) (#16333)
[noreply] Bump Python beam-master containers (#16332)
------------------------------------------
[...truncated 17.89 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/23 10:14:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640254477049990140/model
2021/12/23 10:14:37 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1223100243"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640254477049990140/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640254477049990140/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1223100243",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/23 10:14:38 Submitted job: 2021-12-23_02_14_37-9691613726991641773
2021/12/23 10:14:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-23_02_14_37-9691613726991641773?project=apache-beam-testing
2021/12/23 10:14:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-23_02_14_37-9691613726991641773
2021/12/23 10:14:38 Job state: JOB_STATE_PENDING ...
2021/12/23 10:15:08 Job still running ...
2021/12/23 10:15:38 Job still running ...
2021/12/23 10:16:08 Job still running ...
2021/12/23 10:16:38 Job still running ...
2021/12/23 10:17:08 Job still running ...
2021/12/23 10:17:38 Job still running ...
2021/12/23 10:18:08 Job still running ...
2021/12/23 10:18:38 Job still running ...
2021/12/23 10:19:08 Job still running ...
2021/12/23 10:19:38 Job still running ...
2021/12/23 10:20:08 Failed to execute job: job 2021-12-23_02_14_37-9691613726991641773 failed
panic: Failed to execute job: job 2021-12-23_02_14_37-9691613726991641773 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1141e48, 0xc000120000, 0x1030cd7, 0x19, 0xc000415e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 48s
2 actionable tasks: 2 executed
Publishing build scan...
https://gradle.com/s/hu2c2daqyma4k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #369
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/369/display/redirect?page=changes>
Changes:
[rsl4] [BEAM-13397] Bump numpy to 1.21 for M1 chip
[rsl4] re-generate requirements.txt
[Kyle Weaver] [BEAM-13498] Sickbay portable Flink testProcessElementSkew.
[stranniknm] [BEAM-13502]: fix loading example on embedded version
[noreply] [BEAM-13430] Start the process of upgrading the Gradle 7. (#16292)
[noreply] [BEAM-13430] Introduce new testRuntimeMigration configuration that
[noreply] Update flink cluster to use a supported dataproc version (1.2 -> 1.5)
[Robert Bradshaw] Add microbenchmark for row coder.
[noreply] [BEAM-13499] Add warning about hcatalog to release notes and javadoc
[Robert Bradshaw] Compile RowCoderImpl with Cython.
[Robert Bradshaw] RowCoder optimizations.
[Robert Bradshaw] Further optimizations for common case of components in order.
[noreply] [BEAM-13430] Remove propdeps and replace with compileOnly (#16308)
[Robert Bradshaw] Optimize rows with null fields.
[noreply] Merge pull request #16304 from [BEAM-13491] [Playground] Examples'
[noreply] Merge pull request #16283 from [BEAM-13448] [Playground] track run code
[noreply] Merge pull request #16244 from [BEAM-13463] [Playground] add retries to
[noreply] Merge pull request #16241 from [BEAM-13440] [Playground] Implement
[noreply] [BEAM-13399] Add integration test for Go SDK expansion service JAR
[noreply] [BEAM-13421] Fix bug with xs called with non-tuple key (#16258)
[Robert Bradshaw] RowCoder lint.
------------------------------------------
[...truncated 17.05 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/22 10:14:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640168078089463650/model
2021/12/22 10:14:38 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1222100226"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640168078089463650/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640168078089463650/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1222100226",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/22 10:14:39 Submitted job: 2021-12-22_02_14_38-704966731663715527
2021/12/22 10:14:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-22_02_14_38-704966731663715527?project=apache-beam-testing
2021/12/22 10:14:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-22_02_14_38-704966731663715527
2021/12/22 10:14:39 Job state: JOB_STATE_PENDING ...
2021/12/22 10:15:09 Job still running ...
2021/12/22 10:15:39 Job still running ...
2021/12/22 10:16:09 Job still running ...
2021/12/22 10:16:39 Job still running ...
2021/12/22 10:17:09 Job still running ...
2021/12/22 10:17:39 Job still running ...
2021/12/22 10:18:09 Failed to execute job: job 2021-12-22_02_14_38-704966731663715527 failed
panic: Failed to execute job: job 2021-12-22_02_14_38-704966731663715527 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1141e48, 0xc0000480b0, 0x1030cd7, 0x19, 0xc0003bfe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 47s
2 actionable tasks: 2 executed
Publishing build scan...
https://gradle.com/s/la4jgdzkpgvxu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #368
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/368/display/redirect?page=changes>
Changes:
[benjamin.gonzalez] [BEAM-13088] Add parameter tempWriteDataset to BigQueryIO to store temp
[mmack] [BEAM-13233] Replace AWS API used to list shards from DescribeStream to
[stranniknm] [BEAM-13466]: sort categories and examples by name
[aydar.zaynutdinov] [BEAM-13485][Playground]
[alexander.zhuravlev] [BEAM-13476] Changed Timeout Error Text
[alexander.zhuravlev] [BEAM-13474] Changed 'Playground' logo text color
[mmack] [BEAM-13443] Avoid blocking put to Kinesis records queue to shutdown
[noreply] Merge pull request #16278 from [BEAM-13479] [Playground] Change logic
[noreply] Merge pull request #16281 from [BEAM-13475] [Playground] [Bugfix] Error
[noreply] Merge pull request #16279 from [BEAM-13473] [Playground] [Bugfix] Reset
[noreply] Merge pull request #16232 from [BEAM-13285][Playground] Add steps to
[noreply] [BEAM-13399] Add check for dev versions of JARs to download code
[noreply] Merge pull request #16122 from [BEAM-13345] [Playground] add resizable
[benjamin.gonzalez] [BEAM-13088] Make tempDataset final
[noreply] Merge pull request #16170 from [BEAM-13411][Playground] Add getting of
[noreply] Merge pull request #16172 from [BEAM-13417] [Playground] Add java
[noreply] Merge pull request #16240 from [BEAM-13465][Playground] Change error
[noreply] Merge pull request #16234 from [BEAM-13461][Playground] [Bugfix] Error
[noreply] Merge pull request #15489 from [BEAM-12865] Allow custom batch_duration
[noreply] [BEAM-13483] Increase timeout of Java Examples Dataflow suite. (#16226)
[Kyle Weaver] [BEAM-13496] Upgrade Flink runner to include log4j patches.
[Kyle Weaver] [BEAM-13497] Correct class name in Flink tests.
[noreply] Pin transitive log4j dependencies to 2.17.0 in :sdks:java:io:hcatalog
[noreply] [BEAM-13434] Bump solr to 8.11.1 (#16296)
[noreply] Use a patched shadow 6.1.0 plugin using Log4j 2.16.0 (#16269)
[noreply] [BEAM-12830] Replace GoGradle plugin with Shell Scripts. (#16291)
------------------------------------------
[...truncated 17.05 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/21 10:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640081680776671129/model
2021/12/21 10:14:41 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1221100234"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640081680776671129/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640081680776671129/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1221100234",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/21 10:14:42 Submitted job: 2021-12-21_02_14_41-3662258534692714227
2021/12/21 10:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-21_02_14_41-3662258534692714227?project=apache-beam-testing
2021/12/21 10:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-21_02_14_41-3662258534692714227
2021/12/21 10:14:42 Job state: JOB_STATE_PENDING ...
2021/12/21 10:15:12 Job still running ...
2021/12/21 10:15:42 Job still running ...
2021/12/21 10:16:12 Job still running ...
2021/12/21 10:16:42 Job still running ...
2021/12/21 10:17:12 Job still running ...
2021/12/21 10:17:42 Job still running ...
2021/12/21 10:18:12 Failed to execute job: job 2021-12-21_02_14_41-3662258534692714227 failed
panic: Failed to execute job: job 2021-12-21_02_14_41-3662258534692714227 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1141e48, 0xc0000480b0, 0x1030cd7, 0x19, 0xc0003ffe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 50s
2 actionable tasks: 2 executed
Publishing build scan...
https://gradle.com/s/lfxsw43uvadbe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #367
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/367/display/redirect>
Changes:
------------------------------------------
[...truncated 18.70 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/20 10:14:48 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1639995287862281970/model
2021/12/20 10:14:48 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1220100219"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639995287862281970/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639995287862281970/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1220100219",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/20 10:14:49 Submitted job: 2021-12-20_02_14_48-7248462162132989646
2021/12/20 10:14:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-20_02_14_48-7248462162132989646?project=apache-beam-testing
2021/12/20 10:14:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-20_02_14_48-7248462162132989646
2021/12/20 10:14:49 Job state: JOB_STATE_PENDING ...
2021/12/20 10:15:19 Job still running ...
2021/12/20 10:15:49 Job still running ...
2021/12/20 10:16:19 Job still running ...
2021/12/20 10:16:49 Job still running ...
2021/12/20 10:17:19 Job still running ...
2021/12/20 10:17:49 Job still running ...
2021/12/20 10:18:19 Failed to execute job: job 2021-12-20_02_14_48-7248462162132989646 failed
panic: Failed to execute job: job 2021-12-20_02_14_48-7248462162132989646 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fee8, 0xc000120000, 0x102f999, 0x19, 0xc0005cfe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 58s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/mndmqdwbxkary
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #366
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/366/display/redirect>
Changes:
------------------------------------------
[...truncated 18.70 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/19 10:15:00 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1639908899620214928/model
2021/12/19 10:15:00 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1219100218"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639908899620214928/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639908899620214928/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1219100218",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/19 10:15:00 Submitted job: 2021-12-19_02_15_00-8166285624557565576
2021/12/19 10:15:00 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-19_02_15_00-8166285624557565576?project=apache-beam-testing
2021/12/19 10:15:00 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-19_02_15_00-8166285624557565576
2021/12/19 10:15:00 Job state: JOB_STATE_PENDING ...
2021/12/19 10:15:30 Job still running ...
2021/12/19 10:16:00 Job still running ...
2021/12/19 10:16:30 Job still running ...
2021/12/19 10:17:01 Job still running ...
2021/12/19 10:17:31 Job still running ...
2021/12/19 10:18:01 Job still running ...
2021/12/19 10:18:31 Failed to execute job: job 2021-12-19_02_15_00-8166285624557565576 failed
panic: Failed to execute job: job 2021-12-19_02_15_00-8166285624557565576 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fee8, 0xc000120000, 0x102f999, 0x19, 0xc0003cfe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 9s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/u4btvlsqrrpe6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #365
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/365/display/redirect>
Changes:
------------------------------------------
[...truncated 18.83 KB...]
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/18 10:14:56 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1639822495738509110/model
2021/12/18 10:14:56 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1218100218"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639822495738509110/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639822495738509110/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1218100218",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/18 10:14:57 Submitted job: 2021-12-18_02_14_56-3788382333721542365
2021/12/18 10:14:57 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-18_02_14_56-3788382333721542365?project=apache-beam-testing
2021/12/18 10:14:57 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-18_02_14_56-3788382333721542365
2021/12/18 10:14:57 Job state: JOB_STATE_PENDING ...
2021/12/18 10:15:27 Job still running ...
2021/12/18 10:15:57 Job still running ...
2021/12/18 10:16:27 Job still running ...
2021/12/18 10:16:57 Job still running ...
2021/12/18 10:17:27 Job still running ...
2021/12/18 10:17:57 Job still running ...
2021/12/18 10:18:27 Job still running ...
2021/12/18 10:18:57 Job still running ...
2021/12/18 10:19:27 Job still running ...
2021/12/18 10:19:57 Job still running ...
2021/12/18 10:20:27 Job still running ...
2021/12/18 10:20:57 Failed to execute job: job 2021-12-18_02_14_56-3788382333721542365 failed
panic: Failed to execute job: job 2021-12-18_02_14_56-3788382333721542365 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fee8, 0xc0000480b0, 0x102f999, 0x19, 0xc000381e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 36s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/pdgeslytavxf6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #364
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/364/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #16061 from [BEAM-13428] [Playground] Integrate
[noreply] Clarify CoGroupByKey creates Iterable, not list. (#16099)
[noreply] [BEAM-12931] Allow for DoFn#getAllowedTimestampSkew() when checking the
[noreply] [BEAM-13467] Properly handle null argument types for logical types.
[noreply] [BEAM-10277] Initial implementation for encoding position in Python
[noreply] [BEAM-11545] State & timer for batched RPC calls pattern (#13643)
[noreply] Automatically prune local images before building an RC. (#16238)
[noreply] Add verbose error messages to container-related scripts. (#16056)
[noreply] [BEAM-13456] Rollback #15890 to fix timeout in Java PostCommit (#16257)
[noreply] [BEAM-13015] Add a state backed iterable that can be mutated under
[noreply] [BEAM-13388] Update Cloud DLP after breaking changes. (#16236)
[noreply] [BEAM-13434] Bump google pubsublite on master. (#16265)
[mmack] [adhoc] Fix guava imports in tests
------------------------------------------
[...truncated 18.75 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/17 10:14:55 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1639736094528306631/model
2021/12/17 10:14:55 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1217100243"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639736094528306631/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639736094528306631/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1217100243",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/17 10:14:55 Submitted job: 2021-12-17_02_14_55-15556397855706940148
2021/12/17 10:14:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-17_02_14_55-15556397855706940148?project=apache-beam-testing
2021/12/17 10:14:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-17_02_14_55-15556397855706940148
2021/12/17 10:14:55 Job state: JOB_STATE_PENDING ...
2021/12/17 10:15:25 Job still running ...
2021/12/17 10:15:55 Job still running ...
2021/12/17 10:16:25 Job still running ...
2021/12/17 10:16:55 Job still running ...
2021/12/17 10:17:26 Job still running ...
2021/12/17 10:17:56 Job still running ...
2021/12/17 10:18:26 Job still running ...
2021/12/17 10:18:56 Failed to execute job: job 2021-12-17_02_14_55-15556397855706940148 failed
panic: Failed to execute job: job 2021-12-17_02_14_55-15556397855706940148 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fee8, 0xc000120000, 0x102f999, 0x19, 0xc000507e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 34s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/plicakaufgvui
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #363
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/363/display/redirect?page=changes>
Changes:
[thiagotnunes] [BEAM-12164] Add Spanner Change Stream DAOs
[mmack] [BEAM-13209] Fix DynamoDBIO.write to properly handle partial success
[noreply] [BEAM-13341] Serialize reflection parameter in AvroCoder cloud object
[noreply] Update grafana from 8.1.6 to 8.1.8
[noreply] [BEAM-13015] Update FakeBeamFnStateClient to generate elements that stop
[noreply] [BEAM-13218] Sickbay
[noreply] [BEAM-13399] Add infrastructure to start JARs from Go functions (#16214)
------------------------------------------
[...truncated 18.79 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/16 10:14:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1639649690797463787/model
2021/12/16 10:14:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1216100216"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639649690797463787/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639649690797463787/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1216100216",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/16 10:14:53 Submitted job: 2021-12-16_02_14_51-13123153526785071984
2021/12/16 10:14:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-16_02_14_51-13123153526785071984?project=apache-beam-testing
2021/12/16 10:14:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-16_02_14_51-13123153526785071984
2021/12/16 10:14:53 Job state: JOB_STATE_PENDING ...
2021/12/16 10:15:23 Job still running ...
2021/12/16 10:15:53 Job still running ...
2021/12/16 10:16:23 Job still running ...
2021/12/16 10:16:54 Job still running ...
2021/12/16 10:17:24 Job still running ...
2021/12/16 10:17:54 Job still running ...
2021/12/16 10:18:24 Job still running ...
2021/12/16 10:18:54 Job still running ...
2021/12/16 10:19:24 Job still running ...
2021/12/16 10:19:54 Job still running ...
2021/12/16 10:20:24 Failed to execute job: job 2021-12-16_02_14_51-13123153526785071984 failed
panic: Failed to execute job: job 2021-12-16_02_14_51-13123153526785071984 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fee8, 0xc0000480b0, 0x102f999, 0x19, 0xc0004e9e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 5s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/6ly4p5w73ufrw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #362
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/362/display/redirect?page=changes>
Changes:
[aydar.zaynutdinov] [BEAM-13438][Playground]
[stranniknm] [BEAM-13446]: fix incorrect tab symbol
[noreply] Removes the comment that seems no longer relevant.
[Valentyn Tymofieiev] Update a few dependencies that may depend on log4j transitively.
[noreply] [BEAM-13159] Add Redis Stream (XADD) Write Support (#15858)
[noreply] Merge pull request #15994: [BEAM-13263] Support OnWindowExpiration in
[noreply] Bump dataflow container version to beam-master-20211213 (#16213)
[noreply] Merge pull request #16198 from [BEAM-13437][Playground] Add
[noreply] Merge pull request #16195 from a[BEAM-13436][Playground] Add
[noreply] [BEAM-13355] add Big Query parameter to enable users to specify load_…
[noreply] Updated the base images to use debian:bullseye (#16221)
[noreply] [BEAM-13434] Bump log4j to 2.16.0. (#16237)
[mmack] [BEAM-13209] Fix DynamoDBIO.write to properly handle partial success
------------------------------------------
[...truncated 18.80 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/15 10:14:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1639563294021374901/model
2021/12/15 10:14:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1215100218"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639563294021374901/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639563294021374901/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1215100218",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/15 10:14:55 Submitted job: 2021-12-15_02_14_54-16308582656943130476
2021/12/15 10:14:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-15_02_14_54-16308582656943130476?project=apache-beam-testing
2021/12/15 10:14:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-15_02_14_54-16308582656943130476
2021/12/15 10:14:55 Job state: JOB_STATE_PENDING ...
2021/12/15 10:15:25 Job still running ...
2021/12/15 10:15:55 Job still running ...
2021/12/15 10:16:25 Job still running ...
2021/12/15 10:16:55 Job still running ...
2021/12/15 10:17:25 Job still running ...
2021/12/15 10:17:55 Job still running ...
2021/12/15 10:18:25 Job still running ...
2021/12/15 10:18:55 Failed to execute job: job 2021-12-15_02_14_54-16308582656943130476 failed
panic: Failed to execute job: job 2021-12-15_02_14_54-16308582656943130476 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fee8, 0xc0000480b0, 0x102f999, 0x19, 0xc0002c5e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 34s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/eirj7yx4raffm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #361
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/361/display/redirect?page=changes>
Changes:
[Daniel Oliveira] [BEAM-13321] Pass TempLocation as pipeline option to Dataflow Go for
[Robert Bradshaw] Better type hints for Count combiners.
[Kyle Weaver] Include name of missing tag in error message.
[stranniknm] [BEAM-13423]: fix frontend failure if no examples
[daria.malkova] change return type of 2 methods
[mmack] [BEAM-13441] Use quiet delete for S3 batch deletes. In quiet mode only
[noreply] Updating Grafana from v8.1.2 to v8.1.6
[daria.malkova] Docs for validators tests
[daria.malkova] change context type
[noreply] Merge pull request #16140 from [BEAM-13377][Playground] Update CI/CD
[noreply] Merge pull request #16120 from [BEAM-13333][Playground] Save Python logs
[noreply] Merge pull request #16185 from [BEAM-13425][Playground][Bugfix] Support
[mmack] [BEAM-13445] Correctly set data limit when flushing S3 upload buffer and
[noreply] Merge pull request #16121 from [BEAM-13334][Playground] Save Go logs to
[noreply] Merge pull request #16179 from [BEAM-13344][Playground] support python
[noreply] Merge pull request #16208 from [BEAM-13442][Playground] Filepath to log
[noreply] [BEAM-13276] bump jackson-core to 2.13.0 for .test-infra (#16062)
[noreply] Change Pub/Sub Lite PollResult to set explicit watermark (#16216)
[noreply] [BEAM-13454] Fix and test dataframe read_fwf. (#16064)
[noreply] [BEAM-12976] Pipeline visitor to discover pushdown opportunities.
[noreply] [BEAM-13015] Allow decoding a set of elements until we hit the block
------------------------------------------
[...truncated 18.86 KB...]
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/14 10:15:03 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1639476902668732522/model
2021/12/14 10:15:03 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1214100231"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639476902668732522/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639476902668732522/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1214100231",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/14 10:15:03 Submitted job: 2021-12-14_02_15_03-7798481973891056772
2021/12/14 10:15:03 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-14_02_15_03-7798481973891056772?project=apache-beam-testing
2021/12/14 10:15:03 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-14_02_15_03-7798481973891056772
2021/12/14 10:15:04 Job state: JOB_STATE_PENDING ...
2021/12/14 10:15:34 Job still running ...
2021/12/14 10:16:04 Job still running ...
2021/12/14 10:16:34 Job still running ...
2021/12/14 10:17:04 Job still running ...
2021/12/14 10:17:34 Job still running ...
2021/12/14 10:18:04 Job still running ...
2021/12/14 10:18:34 Job still running ...
2021/12/14 10:19:04 Job still running ...
2021/12/14 10:19:34 Job still running ...
2021/12/14 10:20:04 Job still running ...
2021/12/14 10:20:34 Job still running ...
2021/12/14 10:21:04 Failed to execute job: job 2021-12-14_02_15_03-7798481973891056772 failed
panic: Failed to execute job: job 2021-12-14_02_15_03-7798481973891056772 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fee8, 0xc0000480b0, 0x102f999, 0x19, 0xc000417e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 40s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/6nuqslxv7yy4o
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #360
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/360/display/redirect>
Changes:
------------------------------------------
[...truncated 18.72 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/13 10:15:02 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1639390502110500163/model
2021/12/13 10:15:02 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1213100235"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639390502110500163/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639390502110500163/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1213100235",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/13 10:15:03 Submitted job: 2021-12-13_02_15_02-9691295155606104486
2021/12/13 10:15:03 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-13_02_15_02-9691295155606104486?project=apache-beam-testing
2021/12/13 10:15:03 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-13_02_15_02-9691295155606104486
2021/12/13 10:15:03 Job state: JOB_STATE_PENDING ...
2021/12/13 10:15:33 Job still running ...
2021/12/13 10:16:03 Job still running ...
2021/12/13 10:16:33 Job still running ...
2021/12/13 10:17:03 Job still running ...
2021/12/13 10:17:33 Job still running ...
2021/12/13 10:18:04 Job still running ...
2021/12/13 10:18:34 Job still running ...
2021/12/13 10:19:04 Failed to execute job: job 2021-12-13_02_15_02-9691295155606104486 failed
panic: Failed to execute job: job 2021-12-13_02_15_02-9691295155606104486 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc000120000, 0x102f979, 0x19, 0xc000577e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 41s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/l7nrwv6ojs4ao
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #359
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/359/display/redirect?page=changes>
Changes:
[noreply] [BEAM-12683] Fix failing integration tests for Python Recommendation AI
[noreply] [BEAM-13015] Plumb the cache through contexts and transform executors.
------------------------------------------
[...truncated 18.80 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/12 10:15:03 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1639304102998829865/model
2021/12/12 10:15:03 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1212100218"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639304102998829865/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639304102998829865/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1212100218",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/12 10:15:07 Submitted job: 2021-12-12_02_15_03-14155208980800419756
2021/12/12 10:15:07 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-12_02_15_03-14155208980800419756?project=apache-beam-testing
2021/12/12 10:15:07 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-12_02_15_03-14155208980800419756
2021/12/12 10:15:07 Job state: JOB_STATE_PENDING ...
2021/12/12 10:15:37 Job still running ...
2021/12/12 10:16:07 Job still running ...
2021/12/12 10:16:37 Job still running ...
2021/12/12 10:17:07 Job still running ...
2021/12/12 10:17:37 Job still running ...
2021/12/12 10:18:07 Job still running ...
2021/12/12 10:18:37 Job still running ...
2021/12/12 10:19:07 Job still running ...
2021/12/12 10:19:37 Job still running ...
2021/12/12 10:20:07 Job still running ...
2021/12/12 10:20:37 Job still running ...
2021/12/12 10:21:07 Failed to execute job: job 2021-12-12_02_15_03-14155208980800419756 failed
panic: Failed to execute job: job 2021-12-12_02_15_03-14155208980800419756 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc0000480b0, 0x102f979, 0x19, 0xc0004ede00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 45s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/hrwz7julgy2y4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #358
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/358/display/redirect?page=changes>
Changes:
[aydar.zaynutdinov] [BEAM-13424][Playground]
[aydar.zaynutdinov] [BEAM-13424][Playground]
[stranniknm] [BEAM-13426] clear log and output panels on example change
[aydar.zaynutdinov] [BEAM-13428][Playground]
[aydar.zaynutdinov] [BEAM-13424][Playground]
[daria.malkova] add type of precompiled object
[Alexey Romanenko] [BEAM-13171] Fix Duration ambiguity
[mmack] [BEAM-13410][BEAM-11788] Integration test for S3Filesystem using
[Alexey Romanenko] [BEAM-13434] Bump up Apache log4j2 vulnerability to 2.15.0
[noreply] Merge pull request #16138 from [BEAM-13343][Playground] Support go unit
[noreply] [BEAM-12560] Dataframe idxmin and idxmax implementation (#15827)
[noreply] [BEAM-12565] Dataframe compare implementation (#16027)
[noreply] [BEAM-12976] Use a map to pass all pushdown requests at once. (#16189)
------------------------------------------
[...truncated 18.74 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/11 10:15:01 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1639217700669635537/model
2021/12/11 10:15:01 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1211100219"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639217700669635537/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639217700669635537/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1211100219",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/11 10:15:01 Submitted job: 2021-12-11_02_15_01-10902474541848222121
2021/12/11 10:15:01 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-11_02_15_01-10902474541848222121?project=apache-beam-testing
2021/12/11 10:15:01 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-11_02_15_01-10902474541848222121
2021/12/11 10:15:02 Job state: JOB_STATE_PENDING ...
2021/12/11 10:15:32 Job still running ...
2021/12/11 10:16:02 Job still running ...
2021/12/11 10:16:32 Job still running ...
2021/12/11 10:17:02 Job still running ...
2021/12/11 10:17:32 Job still running ...
2021/12/11 10:18:02 Job still running ...
2021/12/11 10:18:32 Job still running ...
2021/12/11 10:19:02 Job still running ...
2021/12/11 10:19:32 Job still running ...
2021/12/11 10:20:02 Failed to execute job: job 2021-12-11_02_15_01-10902474541848222121 failed
panic: Failed to execute job: job 2021-12-11_02_15_01-10902474541848222121 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc0000480b0, 0x102f979, 0x19, 0xc0004e9e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 39s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/7dliumglquyqa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #357
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/357/display/redirect?page=changes>
Changes:
[slebedev] [BEAM-13384] Re-exported the metrics subpackage in
[zyichi] [BEAM-13401] Wait for worker start to reduce flakiness in
[zyichi] Fix pytest unknown markers warning.
[noreply] [BEAM-11936] Remove suppression in ReadFromKafkaDoFn (#16174)
[noreply] [BEAM-12561] method truncate on series and dataframe (#15833)
[noreply] [BEAM-13294] Widen key schema for all keys before use (#16158)
[noreply] [BEAM-13171] Support for stopReadTime on KafkaIO SDF (#15951)
[noreply] [BEAM-13399] Add functionality to download Beam JARs from Maven
[noreply] [BEAM-13402] Add another workaround for
------------------------------------------
[...truncated 18.88 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/10 10:14:59 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1639131298973497076/model
2021/12/10 10:14:59 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1210100217"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639131298973497076/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639131298973497076/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1210100217",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/10 10:15:01 Submitted job: 2021-12-10_02_14_59-1031753978772505177
2021/12/10 10:15:01 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-10_02_14_59-1031753978772505177?project=apache-beam-testing
2021/12/10 10:15:01 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-10_02_14_59-1031753978772505177
2021/12/10 10:15:01 Job state: JOB_STATE_PENDING ...
2021/12/10 10:15:31 Job still running ...
2021/12/10 10:16:01 Job still running ...
2021/12/10 10:16:31 Job still running ...
2021/12/10 10:17:01 Job still running ...
2021/12/10 10:17:31 Job still running ...
2021/12/10 10:18:01 Job still running ...
2021/12/10 10:18:31 Job still running ...
2021/12/10 10:19:01 Job still running ...
2021/12/10 10:19:31 Job still running ...
2021/12/10 10:20:01 Job still running ...
2021/12/10 10:20:32 Job still running ...
2021/12/10 10:21:02 Failed to execute job: job 2021-12-10_02_14_59-1031753978772505177 failed
panic: Failed to execute job: job 2021-12-10_02_14_59-1031753978772505177 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc0000480b0, 0x102f979, 0x19, 0xc000167e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 40s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/6cfrgnitdh3zm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #356
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/356/display/redirect?page=changes>
Changes:
[stranniknm] fix playground frontend licences
[noreply] Merge pull request #16167 from [BEAM-13409][Playground] [Bugfix] Change
[noreply] Merge pull request #16136 from [BEAM-13365] [Playground] Add Pipelines
[noreply] [BEAM-13244] Support STS Assume role credentials provider for AWS SDK v2
[noreply] [BEAM-11936] Fix errorprone UnusedVariable in core,examples,harness..
[noreply] [BEAM-11936] Remove suppressUnusedVariable flag (#16171)
[noreply] [BEAM-13090] Adding SDK harness container overrides option to Java SDK
[noreply] [BEAM-11936] Fix errorprone warnings (#15890)
[noreply] [BEAM-13015] Start integrating a process wide cache. (#16130)
------------------------------------------
[...truncated 18.70 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/09 10:15:00 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1639044899614277216/model
2021/12/09 10:15:00 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1209100227"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639044899614277216/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639044899614277216/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1209100227",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/09 10:15:01 Submitted job: 2021-12-09_02_15_00-9455532305470806054
2021/12/09 10:15:01 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-09_02_15_00-9455532305470806054?project=apache-beam-testing
2021/12/09 10:15:01 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-09_02_15_00-9455532305470806054
2021/12/09 10:15:01 Job state: JOB_STATE_PENDING ...
2021/12/09 10:15:31 Job still running ...
2021/12/09 10:16:01 Job still running ...
2021/12/09 10:16:31 Job still running ...
2021/12/09 10:17:01 Job still running ...
2021/12/09 10:17:31 Job still running ...
2021/12/09 10:18:01 Job still running ...
2021/12/09 10:18:31 Job still running ...
2021/12/09 10:19:01 Failed to execute job: job 2021-12-09_02_15_00-9455532305470806054 failed
panic: Failed to execute job: job 2021-12-09_02_15_00-9455532305470806054 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc0000480b0, 0x102f979, 0x19, 0xc0002e1e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 39s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/jfbnrjsuylpqy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #355
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/355/display/redirect?page=changes>
Changes:
[heejong] [BEAM-13092] Adding dummy external transform translators for Dataflow
[stranniknm] [BEAM-13112]: playground embedded version
[zyichi] [BEAM-13388] Fix broken google cloud dlp test.
[relax] don't store unserializable DatasetService as a member variable
[noreply] [BEAM-13236] Properly close kinesis producer on teardown (#15955)
[noreply] Merge pull request #16150 from [BEAM-13396][Playground][Bugfix] Issues
[noreply] Merge pull request #16148 from [BEAM-13394][Playground] [Bugfix] Fix
[noreply] Avoid overriding explicit portable job submission disabling. (#16143)
[noreply] Merge pull request #16151 from [BEAM-13350][Playground] Support running
[zyichi] [BEAM-13373] Increase python post commit timeout to reduce chance of
[melissapa] [BEAM-11758] Final cleanup for Beam Basics doc content
[msbukal] Exclude FhirIOPatientEverything from v2 dataflow runner intg test.
[noreply] [BEAM-13371] Fix bug where DataFrame overview snippets don't show up
[dpcollins] Add a workaround for https://github.com/googleapis/gax-java/issues/1577
[noreply] [BEAM-12976] Implement pipeline visitor to get global field access in…
[noreply] [BEAM-13388] Use 3.0.0 as lower bound for google-cloud-dlp (#16164)
[noreply] Merge pull request #16127 from [BEAM-13366] [Playground] Add support
------------------------------------------
[...truncated 18.81 KB...]
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/08 10:14:58 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1638958497616666707/model
2021/12/08 10:14:58 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1208100233"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638958497616666707/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638958497616666707/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1208100233",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/08 10:15:01 Submitted job: 2021-12-08_02_14_58-12947264942478017634
2021/12/08 10:15:01 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-08_02_14_58-12947264942478017634?project=apache-beam-testing
2021/12/08 10:15:01 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-08_02_14_58-12947264942478017634
2021/12/08 10:15:01 Job state: JOB_STATE_PENDING ...
2021/12/08 10:15:31 Job still running ...
2021/12/08 10:16:01 Job still running ...
2021/12/08 10:16:31 Job still running ...
2021/12/08 10:17:01 Job still running ...
2021/12/08 10:17:31 Job still running ...
2021/12/08 10:18:02 Job still running ...
2021/12/08 10:18:32 Job still running ...
2021/12/08 10:19:02 Job still running ...
2021/12/08 10:19:32 Job still running ...
2021/12/08 10:20:02 Job still running ...
2021/12/08 10:20:32 Failed to execute job: job 2021-12-08_02_14_58-12947264942478017634 failed
panic: Failed to execute job: job 2021-12-08_02_14_58-12947264942478017634 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc000120000, 0x102f979, 0x19, 0xc0001f9e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 10s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/qrdlu5pexxhk4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #354
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/354/display/redirect?page=changes>
Changes:
[Daniel Oliveira] Minor Gradle Fixups: Removing unneeded dependency in expansion service.
[aydar.zaynutdinov] [BEAM-13363][Playground]
[aydar.zaynutdinov] [BEAM-13357][Playground]
[aydar.zaynutdinov] [BEAM-13357][Playground]
[Luke Cwik] [BEAM-13015] Simplify fake state API testing client and make it
[zyichi] [BEAM-13380] Fix broken seedjob.
[aydar.zaynutdinov] [BEAM-13357][Playground]
[noreply] Merge pull request #16137 from [BEAM-13381][Playground][Bugfix] Update
[noreply] Merge pull request #16107 from [BEAM-13332] [Playground] Add logs output
[noreply] Merge pull request #16109 from [BEAM-13330][Playground] Save Java logs
[noreply] Merge pull request #16125 from [BEAM-13322][Playground] Support Java
[melissapa] [BEAM-11758] Update basics page: Window, Watermark
------------------------------------------
[...truncated 18.69 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/07 10:14:56 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1638872095484366415/model
2021/12/07 10:14:56 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1207100228"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638872095484366415/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638872095484366415/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1207100228",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/07 10:14:56 Submitted job: 2021-12-07_02_14_56-15465473656781129127
2021/12/07 10:14:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-07_02_14_56-15465473656781129127?project=apache-beam-testing
2021/12/07 10:14:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-07_02_14_56-15465473656781129127
2021/12/07 10:14:56 Job state: JOB_STATE_PENDING ...
2021/12/07 10:15:26 Job still running ...
2021/12/07 10:15:57 Job still running ...
2021/12/07 10:16:27 Job still running ...
2021/12/07 10:16:57 Job still running ...
2021/12/07 10:17:27 Job still running ...
2021/12/07 10:17:57 Job still running ...
2021/12/07 10:18:27 Failed to execute job: job 2021-12-07_02_14_56-15465473656781129127 failed
panic: Failed to execute job: job 2021-12-07_02_14_56-15465473656781129127 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc000120000, 0x102f979, 0x19, 0xc0003efe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 5s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/fzqxgzvtwj2oi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #353
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/353/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #16118 from [BEAM-13362][Playground] python ci cd
------------------------------------------
[...truncated 18.74 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/06 10:14:58 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1638785697880590604/model
2021/12/06 10:14:58 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1206100223"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638785697880590604/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638785697880590604/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1206100223",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/06 10:14:59 Submitted job: 2021-12-06_02_14_58-264869885998682697
2021/12/06 10:14:59 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-06_02_14_58-264869885998682697?project=apache-beam-testing
2021/12/06 10:14:59 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-06_02_14_58-264869885998682697
2021/12/06 10:14:59 Job state: JOB_STATE_PENDING ...
2021/12/06 10:15:29 Job still running ...
2021/12/06 10:15:59 Job still running ...
2021/12/06 10:16:29 Job still running ...
2021/12/06 10:16:59 Job still running ...
2021/12/06 10:17:29 Job still running ...
2021/12/06 10:17:59 Job still running ...
2021/12/06 10:18:29 Job still running ...
2021/12/06 10:18:59 Failed to execute job: job 2021-12-06_02_14_58-264869885998682697 failed
panic: Failed to execute job: job 2021-12-06_02_14_58-264869885998682697 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc0000480b0, 0x102f979, 0x19, 0xc000377e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 37s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/sv224wu6omkss
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #352
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/352/display/redirect>
Changes:
------------------------------------------
[...truncated 18.81 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/05 11:23:55 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1638703435234584382/model
2021/12/05 11:23:55 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1205065424"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638703435234584382/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638703435234584382/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1205065424",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/05 11:23:56 Submitted job: 2021-12-05_03_23_55-14762947360708019972
2021/12/05 11:23:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-05_03_23_55-14762947360708019972?project=apache-beam-testing
2021/12/05 11:23:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-05_03_23_55-14762947360708019972
2021/12/05 11:23:56 Job state: JOB_STATE_PENDING ...
2021/12/05 11:24:26 Job still running ...
2021/12/05 11:24:56 Job still running ...
2021/12/05 11:25:26 Job still running ...
2021/12/05 11:25:56 Job still running ...
2021/12/05 11:26:26 Job still running ...
2021/12/05 11:26:56 Job still running ...
2021/12/05 11:27:26 Job still running ...
2021/12/05 11:27:56 Job still running ...
2021/12/05 11:28:26 Job still running ...
2021/12/05 11:28:57 Job still running ...
2021/12/05 11:29:27 Job still running ...
2021/12/05 11:29:57 Failed to execute job: job 2021-12-05_03_23_55-14762947360708019972 failed
panic: Failed to execute job: job 2021-12-05_03_23_55-14762947360708019972 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc0000480b0, 0x102f979, 0x19, 0xc0003cfe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 39s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/yltgppzjm6e2w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #351
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/351/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Revert "Revert "Allow wildcards for java class lookup transform
[Robert Bradshaw] Move stand-alone expansion service jar into its own project.
[noreply] Merge pull request #16117 from [BEAM-13368][Playground][Bugfix] Fix CI
[noreply] Run python SpannerIO IT with python 3.7 only to avoid overload spanner
[noreply] Merge pull request #15378 from [RFC] Define and document per-key
[noreply] Bump python containers to beam-master-20211202 (#16129)
[noreply] [BEAM-13354, BEAM-13015, BEAM-12802, BEAM-12588] Support prefetch for
[zyichi] Fix failing RecommendationAICatalogItemIT
[Valentyn Tymofieiev] Clarify instructions on how to get contributor list.
[noreply] [BEAM-11936] Fix errorprone UnusedVariable in IO (#16036)
------------------------------------------
[...truncated 18.76 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/04 10:14:56 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1638612895482603972/model
2021/12/04 10:14:56 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1204100227"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638612895482603972/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638612895482603972/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1204100227",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/04 10:14:56 Submitted job: 2021-12-04_02_14_56-9580261301618006156
2021/12/04 10:14:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-04_02_14_56-9580261301618006156?project=apache-beam-testing
2021/12/04 10:14:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-04_02_14_56-9580261301618006156
2021/12/04 10:14:56 Job state: JOB_STATE_PENDING ...
2021/12/04 10:15:26 Job still running ...
2021/12/04 10:15:56 Job still running ...
2021/12/04 10:16:26 Job still running ...
2021/12/04 10:16:56 Job still running ...
2021/12/04 10:17:26 Job still running ...
2021/12/04 10:17:56 Job still running ...
2021/12/04 10:18:26 Failed to execute job: job 2021-12-04_02_14_56-9580261301618006156 failed
panic: Failed to execute job: job 2021-12-04_02_14_56-9580261301618006156 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc0000480b0, 0x102f979, 0x19, 0xc0003d5e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 5s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/not4iiq4utw24
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #350
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/350/display/redirect?page=changes>
Changes:
[aydar.zaynutdinov] [BEAM-13329][Playground]
[aydar.zaynutdinov] [BEAM-13329][Playground]
[alexander.zhuravlev] [BEAM-13370] Deleted unused prints & strings
[ilya.kozyrev] Fix pylint issues and apply yapf with Beam config
[ilya.kozyrev] fix white spaces
[noreply] Don't pin a particular version of Tensorflow. (#16102)
[noreply] [BEAM-12733] Fix failing integration tests for Java Recommendation AI
[noreply] [BEAM-13288] improve logging for no rows present error (#16096)
------------------------------------------
[...truncated 18.70 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/03 10:14:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1638526489073934989/model
2021/12/03 10:14:49 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1203100222"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638526489073934989/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638526489073934989/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1203100222",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/03 10:14:50 Submitted job: 2021-12-03_02_14_49-7319537371803300007
2021/12/03 10:14:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-03_02_14_49-7319537371803300007?project=apache-beam-testing
2021/12/03 10:14:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-03_02_14_49-7319537371803300007
2021/12/03 10:14:50 Job state: JOB_STATE_PENDING ...
2021/12/03 10:15:20 Job still running ...
2021/12/03 10:15:50 Job still running ...
2021/12/03 10:16:20 Job still running ...
2021/12/03 10:16:50 Job still running ...
2021/12/03 10:17:20 Job still running ...
2021/12/03 10:17:50 Job still running ...
2021/12/03 10:18:20 Failed to execute job: job 2021-12-03_02_14_49-7319537371803300007 failed
panic: Failed to execute job: job 2021-12-03_02_14_49-7319537371803300007 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc000120000, 0x102f979, 0x19, 0xc0004cde00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 58s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/u76gykgl6cv24
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #349
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/349/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Require explicit designation of proxy partitioning specification.
[Robert Bradshaw] Elementwise transforms preserve all partitionings.
[aydar.zaynutdinov] [BEAM-13360][Playground]
[noreply] Merge pull request #16011 from [BEAM-12164] Add models for Spanner
[noreply] [BEAM-13335] Use signed int64 range for DataFrame read unique indexes
[iyi] Add test case for untriggered expansion with temp tables.
[zyichi] Fix small typo in ProcessBundleHandlerTest.java
[noreply] Merge pull request #16079 from [BEAM-13241] [Playground] Frontend
[noreply] Ricardo Case Study (#16087)
[noreply] Merge pull request #16086 from [BEAM-13258][Playground] Get and store
[noreply] [BEAM-11936] Fix errorprone UnusedVariable in Runners (#16035)
[noreply] [BEAM-8123] Add cloudpickle as optional library (#15472)
[noreply] [BEAM-12572] Beam python examples continuously exercised on at least 2
------------------------------------------
[...truncated 18.77 KB...]
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/02 10:15:03 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1638440102567679353/model
2021/12/02 10:15:03 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1202100218"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638440102567679353/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638440102567679353/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1202100218",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/02 10:15:05 Submitted job: 2021-12-02_02_15_03-18048199269084160513
2021/12/02 10:15:05 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-02_02_15_03-18048199269084160513?project=apache-beam-testing
2021/12/02 10:15:05 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-02_02_15_03-18048199269084160513
2021/12/02 10:15:05 Job state: JOB_STATE_PENDING ...
2021/12/02 10:15:35 Job still running ...
2021/12/02 10:16:05 Job still running ...
2021/12/02 10:16:35 Job still running ...
2021/12/02 10:17:05 Job still running ...
2021/12/02 10:17:35 Job still running ...
2021/12/02 10:18:06 Job still running ...
2021/12/02 10:18:36 Job still running ...
2021/12/02 10:19:06 Job still running ...
2021/12/02 10:19:36 Job still running ...
2021/12/02 10:20:06 Job still running ...
2021/12/02 10:20:36 Failed to execute job: job 2021-12-02_02_15_03-18048199269084160513 failed
panic: Failed to execute job: job 2021-12-02_02_15_03-18048199269084160513 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc000120000, 0x102f979, 0x19, 0xc000573e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 14s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/ct6nw4zx73emu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #348
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/348/display/redirect?page=changes>
Changes:
[mmack] [BEAM-11494][BEAM-11821] FileIO stops overwriting files on retries (AWS
[Pablo Estrada] [py] Supporting ignore_unknown_values for WriteToBigQuery
[noreply] Merge pull request #16072 from [BEAM-13135][Playground] Add function to
[noreply] Merge pull request #16084 from [BEAM-13347][Playground] [Bugfix] Backend
[noreply] Merge pull request #15987 from [BEAM-13242] Allow values with smaller
[noreply] [BEAM-11936] Fix errorprone UnusedVariable in Extensions (#16033)
[noreply] Merge pull request #15936 from [BEAM-13351] FhirIO GetPatientEverything
[avilovpavel6] Add fmt preparator for go sdk
[noreply] Merge pull request #16073 from [BEAM-13267][Playground] Implement
[ningkang0957] Updated screen diff test for Interactive Beam
[noreply] [BEAM-13282][Playground] Create go dockerfile #16049
[noreply] Merge pull request #16085 from [Beam-13336][Playground] Refactor
[noreply] [BEAM-11936] Fix errorprone UnusedVariable in Extensions-sql (#16034)
[noreply] [BEAM-13193] Support
[noreply] Merge pull request #16090: [BEAM-13352] Add transient qualifier to
------------------------------------------
[...truncated 18.77 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/01 10:14:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1638353689367828308/model
2021/12/01 10:14:49 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1201100228"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638353689367828308/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638353689367828308/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1201100228",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/01 10:14:50 Submitted job: 2021-12-01_02_14_49-16465644282551137874
2021/12/01 10:14:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-01_02_14_49-16465644282551137874?project=apache-beam-testing
2021/12/01 10:14:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-01_02_14_49-16465644282551137874
2021/12/01 10:14:50 Job state: JOB_STATE_PENDING ...
2021/12/01 10:15:20 Job still running ...
2021/12/01 10:15:50 Job still running ...
2021/12/01 10:16:20 Job still running ...
2021/12/01 10:16:50 Job still running ...
2021/12/01 10:17:20 Job still running ...
2021/12/01 10:17:50 Job still running ...
2021/12/01 10:18:20 Failed to execute job: job 2021-12-01_02_14_49-16465644282551137874 failed
panic: Failed to execute job: job 2021-12-01_02_14_49-16465644282551137874 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc000120000, 0x102f979, 0x19, 0xc000291e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 59s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/puttko67ttc2o
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #347
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/347/display/redirect?page=changes>
Changes:
[kileysok] Increase timeout for Dataflow Streaming VR
[Kyle Weaver] [BEAM-13220] Update release instructions.
[noreply] Merge pull request #16050 from [BEAM-13307][Playground] Support Python
[noreply] Merge pull request #16071 from [BEAM-13306][Playground] Add using of
[noreply] [BEAM-11943] Fix wrong Klio logo being displayed (#16078)
[noreply] Merge pull request #15954 from [BEAM-960][BEAM-1675] Improvements to
[noreply] [BEAM-13284] Respect expiration time for all Redis write methods.
[noreply] [BEAM-12697] Add SBE module and initial classes (#15733)
[noreply] [Playground][Beam-13316][Bugfix] Fix Playground Frontend Precommit
[Kyle Weaver] [BEAM-13337] Periodically delete stale spanner databases.
[noreply] [BEAM-13115][Playground] Security – Mock Storage (#16047)
[noreply] [BEAM-13335] Use shorter, numerical indices for dataframe reads.
[noreply] Be more conservative about rebatching. (#16058)
[noreply] [BEAM-12587] Allow None in Python's Any logical type. (#16055)
[melissapa] [BEAM-11758] Update basics page: Trigger, State and timers
------------------------------------------
[...truncated 18.80 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/30 10:14:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1638267286440400643/model
2021/11/30 10:14:47 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1130100225"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638267286440400643/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638267286440400643/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1130100225",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/30 10:14:47 Submitted job: 2021-11-30_02_14_47-16613704464137792773
2021/11/30 10:14:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-30_02_14_47-16613704464137792773?project=apache-beam-testing
2021/11/30 10:14:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-30_02_14_47-16613704464137792773
2021/11/30 10:14:47 Job state: JOB_STATE_PENDING ...
2021/11/30 10:15:17 Job still running ...
2021/11/30 10:15:47 Job still running ...
2021/11/30 10:16:17 Job still running ...
2021/11/30 10:16:47 Job still running ...
2021/11/30 10:17:17 Job still running ...
2021/11/30 10:17:47 Job still running ...
2021/11/30 10:18:18 Job still running ...
2021/11/30 10:18:48 Job still running ...
2021/11/30 10:19:18 Job still running ...
2021/11/30 10:19:48 Job still running ...
2021/11/30 10:20:18 Job still running ...
2021/11/30 10:20:48 Failed to execute job: job 2021-11-30_02_14_47-16613704464137792773 failed
panic: Failed to execute job: job 2021-11-30_02_14_47-16613704464137792773 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc0000480b0, 0x102f979, 0x19, 0xc000155e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 27s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/k4a4cgjky5mss
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #346
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/346/display/redirect>
Changes:
------------------------------------------
[...truncated 18.72 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/29 10:14:48 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1638180885633212261/model
2021/11/29 10:14:48 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1129100215"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638180885633212261/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638180885633212261/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1129100215",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/29 10:14:48 Submitted job: 2021-11-29_02_14_48-10701969040231765054
2021/11/29 10:14:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-29_02_14_48-10701969040231765054?project=apache-beam-testing
2021/11/29 10:14:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-29_02_14_48-10701969040231765054
2021/11/29 10:14:48 Job state: JOB_STATE_PENDING ...
2021/11/29 10:15:18 Job still running ...
2021/11/29 10:15:48 Job still running ...
2021/11/29 10:16:18 Job still running ...
2021/11/29 10:16:48 Job still running ...
2021/11/29 10:17:19 Job still running ...
2021/11/29 10:17:49 Job still running ...
2021/11/29 10:18:19 Failed to execute job: job 2021-11-29_02_14_48-10701969040231765054 failed
panic: Failed to execute job: job 2021-11-29_02_14_48-10701969040231765054 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc000120000, 0x102f979, 0x19, 0xc0004d3e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 58s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/hky2mhax5ucdu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #345
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/345/display/redirect?page=changes>
Changes:
[vitaly.ivanov] [BEAM-13269] Data exceeds database column capacity error while inserting
[vitaly.ivanov] [BEAM-13269] Data exceeds database column capacity error while inserting
[noreply] Merge pull request #16074 from [BEAM-13323][Playground] [Bugfix] Fix CI
------------------------------------------
[...truncated 18.72 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/28 10:14:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1638094491140787626/model
2021/11/28 10:14:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1128100226"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638094491140787626/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638094491140787626/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1128100226",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/28 10:14:52 Submitted job: 2021-11-28_02_14_51-10198742805436559128
2021/11/28 10:14:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-28_02_14_51-10198742805436559128?project=apache-beam-testing
2021/11/28 10:14:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-28_02_14_51-10198742805436559128
2021/11/28 10:14:52 Job state: JOB_STATE_PENDING ...
2021/11/28 10:15:22 Job still running ...
2021/11/28 10:15:52 Job still running ...
2021/11/28 10:16:22 Job still running ...
2021/11/28 10:16:52 Job still running ...
2021/11/28 10:17:23 Job still running ...
2021/11/28 10:17:53 Job still running ...
2021/11/28 10:18:23 Failed to execute job: job 2021-11-28_02_14_51-10198742805436559128 failed
panic: Failed to execute job: job 2021-11-28_02_14_51-10198742805436559128 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc000120000, 0x102f979, 0x19, 0xc000407e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 2s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/vjn5pmiub6z6i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #344
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/344/display/redirect>
Changes:
------------------------------------------
[...truncated 18.71 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/27 10:14:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1638008093449736935/model
2021/11/27 10:14:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1127100226"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638008093449736935/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638008093449736935/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1127100226",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/27 10:14:54 Submitted job: 2021-11-27_02_14_54-1016562990570541347
2021/11/27 10:14:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-27_02_14_54-1016562990570541347?project=apache-beam-testing
2021/11/27 10:14:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-27_02_14_54-1016562990570541347
2021/11/27 10:14:54 Job state: JOB_STATE_PENDING ...
2021/11/27 10:15:24 Job still running ...
2021/11/27 10:15:54 Job still running ...
2021/11/27 10:16:24 Job still running ...
2021/11/27 10:16:54 Job still running ...
2021/11/27 10:17:24 Job still running ...
2021/11/27 10:17:54 Job still running ...
2021/11/27 10:18:25 Failed to execute job: job 2021-11-27_02_14_54-1016562990570541347 failed
panic: Failed to execute job: job 2021-11-27_02_14_54-1016562990570541347 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc0000480b0, 0x102f979, 0x19, 0xc0007afe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 3s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/ydsy7evz66bns
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #343
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/343/display/redirect>
Changes:
------------------------------------------
[...truncated 18.79 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/26 10:14:46 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1637921686424330698/model
2021/11/26 10:14:46 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1126100228"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637921686424330698/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637921686424330698/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1126100228",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/26 10:14:47 Submitted job: 2021-11-26_02_14_46-9274143543967731720
2021/11/26 10:14:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-26_02_14_46-9274143543967731720?project=apache-beam-testing
2021/11/26 10:14:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-26_02_14_46-9274143543967731720
2021/11/26 10:14:47 Job state: JOB_STATE_PENDING ...
2021/11/26 10:15:17 Job still running ...
2021/11/26 10:15:47 Job still running ...
2021/11/26 10:16:17 Job still running ...
2021/11/26 10:16:47 Job still running ...
2021/11/26 10:17:17 Job still running ...
2021/11/26 10:17:47 Job still running ...
2021/11/26 10:18:18 Job still running ...
2021/11/26 10:18:48 Job still running ...
2021/11/26 10:19:18 Job still running ...
2021/11/26 10:19:48 Job still running ...
2021/11/26 10:20:18 Job still running ...
2021/11/26 10:20:48 Failed to execute job: job 2021-11-26_02_14_46-9274143543967731720 failed
panic: Failed to execute job: job 2021-11-26_02_14_46-9274143543967731720 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc0000480b0, 0x102f979, 0x19, 0xc0003b9e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 27s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/e54zrnss7h6tq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #342
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/342/display/redirect?page=changes>
Changes:
[Luke Cwik] [BEAM-13015] Simplify
[Luke Cwik] [BEAM-13015] Simplify DataStreamsDecoder by moving hasNext logic to next
------------------------------------------
[...truncated 18.71 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/25 10:15:00 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1637835300180482896/model
2021/11/25 10:15:00 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1125100227"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637835300180482896/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637835300180482896/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1125100227",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/25 10:15:01 Submitted job: 2021-11-25_02_15_00-343074152103012350
2021/11/25 10:15:01 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-25_02_15_00-343074152103012350?project=apache-beam-testing
2021/11/25 10:15:01 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-25_02_15_00-343074152103012350
2021/11/25 10:15:01 Job state: JOB_STATE_PENDING ...
2021/11/25 10:15:31 Job still running ...
2021/11/25 10:16:01 Job still running ...
2021/11/25 10:16:31 Job still running ...
2021/11/25 10:17:01 Job still running ...
2021/11/25 10:17:31 Job still running ...
2021/11/25 10:18:01 Job still running ...
2021/11/25 10:18:32 Failed to execute job: job 2021-11-25_02_15_00-343074152103012350 failed
panic: Failed to execute job: job 2021-11-25_02_15_00-343074152103012350 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc0000480b0, 0x102f979, 0x19, 0xc000591e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 11s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/kbum4cxxhmjtm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #341
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/341/display/redirect?page=changes>
Changes:
[noreply] Increase the timeout for LoadTest Jenkins jobs 4h->12h.
[noreply] [BEAM-13073] UseParallelGC on Java container
[noreply] Merge pull request #16002 from [BEAM-13101] [Playground] load examples
[noreply] Merge pull request #16016 from [BEAM-13089][Playground] Enable
[noreply] Merge pull request #16046 from [BEAM-13295] [Playground] [Bugfix]
[noreply] Merge pull request #16048 from [Beam-13256] [Playground] Implement an
[noreply] Merge pull request #16026 from [BEAM-13208][Playground] Separate stderr
[noreply] Append to state in chunks. (#15983)
[Luke Cwik] [BEAM-13313] Fix WindowingStrategy proto to use snake case field names.
[noreply] [BEAM-12829] Never copy .gogradle/** for Python. (#16059)
------------------------------------------
[...truncated 18.70 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/24 10:14:52 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1637748891808355063/model
2021/11/24 10:14:52 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1124100237"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637748891808355063/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637748891808355063/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1124100237",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/24 10:14:53 Submitted job: 2021-11-24_02_14_52-11922442944410802111
2021/11/24 10:14:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-24_02_14_52-11922442944410802111?project=apache-beam-testing
2021/11/24 10:14:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-24_02_14_52-11922442944410802111
2021/11/24 10:14:53 Job state: JOB_STATE_PENDING ...
2021/11/24 10:15:23 Job still running ...
2021/11/24 10:15:53 Job still running ...
2021/11/24 10:16:23 Job still running ...
2021/11/24 10:16:53 Job still running ...
2021/11/24 10:17:23 Job still running ...
2021/11/24 10:17:53 Job still running ...
2021/11/24 10:18:23 Failed to execute job: job 2021-11-24_02_14_52-11922442944410802111 failed
panic: Failed to execute job: job 2021-11-24_02_14_52-11922442944410802111 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc0000480b0, 0x102f979, 0x19, 0xc000405e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 4s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/6dgsdnrvqnr6i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #340
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/340/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Make sure implicit inputs are noted in the portable graph.
[benjamin.gonzalez] [BEAM-13003] Integration Test for DebeziumIO that connects to
[noreply] Merge pull request #16032 from [BEAM-13297][Playground][Bugfix]
[noreply] Merge pull request #16031 from [BEAM-13296][Playground][Bugfix] remove
[noreply] Merge pull request #16030 from [BEAM-13219][Playground] Initialise
[noreply] Merge pull request #15996 from [BEAM-13156][Playground] Implement
------------------------------------------
[...truncated 18.75 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/23 10:14:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1637662493306854095/model
2021/11/23 10:14:53 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1123100221"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637662493306854095/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637662493306854095/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1123100221",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/23 10:14:54 Submitted job: 2021-11-23_02_14_53-1042106860652214549
2021/11/23 10:14:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-23_02_14_53-1042106860652214549?project=apache-beam-testing
2021/11/23 10:14:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-23_02_14_53-1042106860652214549
2021/11/23 10:14:54 Job state: JOB_STATE_PENDING ...
2021/11/23 10:15:24 Job still running ...
2021/11/23 10:15:54 Job still running ...
2021/11/23 10:16:24 Job still running ...
2021/11/23 10:16:54 Job still running ...
2021/11/23 10:17:24 Job still running ...
2021/11/23 10:17:54 Job still running ...
2021/11/23 10:18:25 Job still running ...
2021/11/23 10:18:55 Failed to execute job: job 2021-11-23_02_14_53-1042106860652214549 failed
panic: Failed to execute job: job 2021-11-23_02_14_53-1042106860652214549 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc0000480b0, 0x102f979, 0x19, 0xc00026fe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 32s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/eqmetmrgpgl5u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #339
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/339/display/redirect>
Changes:
------------------------------------------
[...truncated 18.74 KB...]
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/22 10:15:07 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1637576107187946671/model
2021/11/22 10:15:07 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1122100229"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637576107187946671/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637576107187946671/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1122100229",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/22 10:15:08 Submitted job: 2021-11-22_02_15_07-5595143234324272901
2021/11/22 10:15:08 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-22_02_15_07-5595143234324272901?project=apache-beam-testing
2021/11/22 10:15:08 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-22_02_15_07-5595143234324272901
2021/11/22 10:15:08 Job state: JOB_STATE_PENDING ...
2021/11/22 10:15:38 Job still running ...
2021/11/22 10:16:08 Job still running ...
2021/11/22 10:16:38 Job still running ...
2021/11/22 10:17:08 Job still running ...
2021/11/22 10:17:38 Job still running ...
2021/11/22 10:18:08 Job still running ...
2021/11/22 10:18:38 Job still running ...
2021/11/22 10:19:08 Job still running ...
2021/11/22 10:19:38 Job still running ...
2021/11/22 10:20:08 Job still running ...
2021/11/22 10:20:38 Failed to execute job: job 2021-11-22_02_15_07-5595143234324272901 failed
panic: Failed to execute job: job 2021-11-22_02_15_07-5595143234324272901 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc000120000, 0x102f979, 0x19, 0xc0002dbe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 16s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/5wluimvfosgo2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #338
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/338/display/redirect>
Changes:
------------------------------------------
[...truncated 18.77 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/21 10:14:55 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1637489694883346003/model
2021/11/21 10:14:55 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1121100215"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637489694883346003/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637489694883346003/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1121100215",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/21 10:14:56 Submitted job: 2021-11-21_02_14_55-7286646863170488807
2021/11/21 10:14:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-21_02_14_55-7286646863170488807?project=apache-beam-testing
2021/11/21 10:14:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-21_02_14_55-7286646863170488807
2021/11/21 10:14:56 Job state: JOB_STATE_PENDING ...
2021/11/21 10:15:26 Job still running ...
2021/11/21 10:15:56 Job still running ...
2021/11/21 10:16:26 Job still running ...
2021/11/21 10:16:56 Job still running ...
2021/11/21 10:17:26 Job still running ...
2021/11/21 10:17:56 Job still running ...
2021/11/21 10:18:26 Job still running ...
2021/11/21 10:18:56 Job still running ...
2021/11/21 10:19:26 Job still running ...
2021/11/21 10:19:56 Job still running ...
2021/11/21 10:20:26 Job still running ...
2021/11/21 10:20:56 Failed to execute job: job 2021-11-21_02_14_55-7286646863170488807 failed
panic: Failed to execute job: job 2021-11-21_02_14_55-7286646863170488807 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc000120000, 0x102f979, 0x19, 0xc000433e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 35s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/d45a7za6ppdtm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #337
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/337/display/redirect?page=changes>
Changes:
[Valentyn Tymofieiev] Add future back to Beam containers.
[noreply] [BEAM-13290] Handle disable_prime_runner_v2 flag (#16018)
[noreply] [BEAM-11936] Add configuration parameter for suppressing unusedvariable
[noreply] Merge pull request #15957 from [BEAM-13045][Playground] Implemented
[noreply] [BEAM-13286] RowJson should expect ReadableInstant for DATETIME values
[noreply] Merge pull request #16025 from [BEAM-13216] [Playground] Add client to
[ningkang0957] Updated dep and goldens for Interactive Beam screen diff tests
[ningkang0957] Removed Pillow from requirements of containers.
[noreply] Merge pull request #16013 from [BEAM-13281] [playground] Update favicon
[noreply] Merge pull request #15768 from [BEAM-13064] [Playground] Implement
[noreply] Added go code coverage report with codecov (#16020)
------------------------------------------
[...truncated 18.69 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/20 10:14:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1637403290593540047/model
2021/11/20 10:14:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1120100217"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637403290593540047/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637403290593540047/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1120100217",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/20 10:14:52 Submitted job: 2021-11-20_02_14_51-5223185486977594720
2021/11/20 10:14:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-20_02_14_51-5223185486977594720?project=apache-beam-testing
2021/11/20 10:14:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-20_02_14_51-5223185486977594720
2021/11/20 10:14:52 Job state: JOB_STATE_PENDING ...
2021/11/20 10:15:22 Job still running ...
2021/11/20 10:15:52 Job still running ...
2021/11/20 10:16:22 Job still running ...
2021/11/20 10:16:52 Job still running ...
2021/11/20 10:17:22 Job still running ...
2021/11/20 10:17:52 Job still running ...
2021/11/20 10:18:22 Failed to execute job: job 2021-11-20_02_14_51-5223185486977594720 failed
panic: Failed to execute job: job 2021-11-20_02_14_51-5223185486977594720 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc0000480b0, 0x102f979, 0x19, 0xc0003e1e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 2s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/nxk7ycmt2dgo4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #336
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/336/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Allow wildcards for java class lookup transform providers.
[Robert Bradshaw] Disallow getClass().forname().
[Robert Bradshaw] Docs, globbing, and a test.
[Robert Bradshaw] Defer expansion service creation for easier testing.
[Robert Bradshaw] Allow java jar service with classpath.
[avilovpavel6] Support GO sdk
[dpcollins] Fix race condition in Pub/Sub Lite SDF that causes it to error out when
[dpcollins] edit
[noreply] Merge pull request #15785 from Support for passing priority parameter in
[dpcollins] Restructure processor to access beam types from downcall thread
[dpcollins] Restructure processor to access beam types from downcall thread
[noreply] [BEAM-13283] Skip apache beam dependency installation from
[dpcollins] Restructure processor to access beam types from downcall thread
[noreply] Merge pull request #15956 from [BEAM-13210] [Playground]: support
[noreply] created quickstart guide for multi-language pipelines (Python) (#16001)
[dpcollins] use interface in logger to work around likely SLF4J bug
[dpcollins] revert logger class
[noreply] Revert "Allow wildcards for java class lookup transform providers."
[Valentyn Tymofieiev] Moving to 2.36.0-SNAPSHOT on master branch.
------------------------------------------
[...truncated 18.75 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/19 10:14:50 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1637316889551118996/model
2021/11/19 10:14:50 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1119100229"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637316889551118996/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637316889551118996/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1119100229",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/19 10:14:50 Submitted job: 2021-11-19_02_14_50-10441505479548183162
2021/11/19 10:14:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-19_02_14_50-10441505479548183162?project=apache-beam-testing
2021/11/19 10:14:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-19_02_14_50-10441505479548183162
2021/11/19 10:14:50 Job state: JOB_STATE_PENDING ...
2021/11/19 10:15:21 Job still running ...
2021/11/19 10:15:51 Job still running ...
2021/11/19 10:16:21 Job still running ...
2021/11/19 10:16:51 Job still running ...
2021/11/19 10:17:21 Job still running ...
2021/11/19 10:17:51 Job still running ...
2021/11/19 10:18:21 Failed to execute job: job 2021-11-19_02_14_50-10441505479548183162 failed
panic: Failed to execute job: job 2021-11-19_02_14_50-10441505479548183162 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc0000480b0, 0x102f979, 0x19, 0xc000179e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 0s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/gpcelsaanbxje
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #335
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/335/display/redirect?page=changes>
Changes:
[samuelw] [BEAM-12818] Write windowed file output to a consistent subdirectory
[samuelw] [BEAM-13268] Change autosharding big query inserts to happen in parallel
[noreply] [BEAM-3293] Add check for error on NewIterable call (#16006)
[Brian Hulette] remove pkg_resources in run_generate_requirements.sh
[Brian Hulette] Run generatePythonRequirementsAll for pyarrow 6
[noreply] Update dev container tags used by Dataflow runner with unreleased SDKs.
[noreply] [BEAM-13265] Add withDeterministicRecordIdFn which allows for
[noreply] [BEAM-13183] [BEAM-8152] Use venv instead of virtualenv to create Python
------------------------------------------
[...truncated 18.75 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/18 10:14:52 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1637230491526840584/model
2021/11/18 10:14:52 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1118100225"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637230491526840584/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637230491526840584/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1118100225",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/18 10:14:52 Submitted job: 2021-11-18_02_14_52-8826041758950389880
2021/11/18 10:14:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-18_02_14_52-8826041758950389880?project=apache-beam-testing
2021/11/18 10:14:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-18_02_14_52-8826041758950389880
2021/11/18 10:14:52 Job state: JOB_STATE_PENDING ...
2021/11/18 10:15:22 Job still running ...
2021/11/18 10:15:53 Job still running ...
2021/11/18 10:16:23 Job still running ...
2021/11/18 10:16:53 Job still running ...
2021/11/18 10:17:23 Job still running ...
2021/11/18 10:17:53 Job still running ...
2021/11/18 10:18:23 Failed to execute job: job 2021-11-18_02_14_52-8826041758950389880 failed
panic: Failed to execute job: job 2021-11-18_02_14_52-8826041758950389880 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc0000480b0, 0x102f979, 0x19, 0xc0004b3e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 2s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/3b4pcxcbk5mqu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #334
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/334/display/redirect?page=changes>
Changes:
[aydar.zaynutdinov] [BEAM-13178][Playground]
[Pablo Estrada] [BEAM-8033] Throwing an error if a dataSourceProviderFn is defined twice
[minherz] fix: update dlp dependency version range
[noreply] [BEAM-3293] Finish E2E implementation of MultiMap side inputs, add
[noreply] Merge pull request #15740 from [BEAM-12936][Playground] Code editor -
[noreply] Merge pull request #15976 from [Playground][BEAM-12941][Bugfix] Fix
[noreply] Merge pull request #15991 [BEAM-13251][Playground] [Bugfix] Lint Fails
[noreply] Merge pull request #15990 from [BEAM-13177][Playground] Change using of
[noreply] [BEAM-13262] Forward for metrics.SingleResult (#15993)
[noreply] Generate Python container dependencies in an automated way. (#15927)
[noreply] [BEAM-13264] Allow pyarrow up to 6.x (#15995)
[noreply] Update the go get command with v2 (#15945)
[noreply] Go Quickstart: switch to Spark 3 JobServer for better out-of-box
[noreply] Golint fixes for recent Go SDK import (#15999)
[noreply] Merge pull request #15997: [BEAM-8688] Upgrading gcsio library to latest
------------------------------------------
[...truncated 18.83 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/17 10:14:55 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1637144095169110023/model
2021/11/17 10:14:55 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1117100231"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637144095169110023/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637144095169110023/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1117100231",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/17 10:14:56 Submitted job: 2021-11-17_02_14_55-9823463078682666273
2021/11/17 10:14:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-17_02_14_55-9823463078682666273?project=apache-beam-testing
2021/11/17 10:14:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-17_02_14_55-9823463078682666273
2021/11/17 10:14:56 Job state: JOB_STATE_PENDING ...
2021/11/17 10:15:26 Job still running ...
2021/11/17 10:15:56 Job still running ...
2021/11/17 10:16:26 Job still running ...
2021/11/17 10:16:56 Job still running ...
2021/11/17 10:17:26 Job still running ...
2021/11/17 10:17:56 Job still running ...
2021/11/17 10:18:26 Job still running ...
2021/11/17 10:18:56 Job still running ...
2021/11/17 10:19:26 Job still running ...
2021/11/17 10:19:56 Job still running ...
2021/11/17 10:20:27 Job still running ...
2021/11/17 10:20:57 Failed to execute job: job 2021-11-17_02_14_55-9823463078682666273 failed
panic: Failed to execute job: job 2021-11-17_02_14_55-9823463078682666273 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113fec8, 0xc0000480b0, 0x102f979, 0x19, 0xc00061de00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 35s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/52twsecjwai42
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #333
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/333/display/redirect?page=changes>
Changes:
[brachipa] [BEAM-12737] error handling for sql calc error
[brachipa] [BEAM-12737] error handling for sql calc error
[brachipa] [BEAM-12737] error handling for sql calc error
[brachipa] [BEAM-12737] add test
[brachipa] [BEAM-12737] fix build
[brachipa] [BEAM-12737] fix build
[brachipa] revert
[brachipa] [beam-12737] cr fix
[brachipa] [beam-12737] cr fixes
[brachipa] [beam-12737] send errorTransformer to `buildPTransform`
[brachipa] [beam-12737] send errorTransformer to `buildPTransform`
[brachipa] [beam-12737] fix type `? extends POutput`
[Robert Bradshaw] Fully resolve type variables after PTransform type inference.
[brachipa] [beam-12737] add complex test, change error row type
[noreply] [BEAM-13226] Batch metrics parsing errors (#15972)
[noreply] [BEAM-13239] pass through io.EOF when decoding row (#15971)
[noreply] [BEAM-5378] Register types & funcs for examples. (#15970)
[Robert Bradshaw] Key-inferable type hints for CombinePerKey.
[Robert Bradshaw] Implement type variable binding for union types.
[Robert Bradshaw] Add comment about wildcard.
[noreply] [BEAM-3293] Add initial MultiMap side input backing type (#15975)
[Robert Bradshaw] Type inference deterministic coder fix for old Python versions.
[Robert Bradshaw] Also implement type matching for union types.
[noreply] [BEAM-13238] Bump all Dataflow Java VR timeouts (#15979)
[noreply] Merge pull request #15978: [BEAM-8691] Upgrading Java deps compatible
[noreply] [BEAM-13221] Don't drop last data. (#15939)
------------------------------------------
[...truncated 18.85 KB...]
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/16 10:15:02 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1637057702099971149/model
2021/11/16 10:15:02 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1116100225"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637057702099971149/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637057702099971149/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1116100225",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/16 10:15:03 Submitted job: 2021-11-16_02_15_02-4647127910313836077
2021/11/16 10:15:03 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-16_02_15_02-4647127910313836077?project=apache-beam-testing
2021/11/16 10:15:03 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-16_02_15_02-4647127910313836077
2021/11/16 10:15:03 Job state: JOB_STATE_PENDING ...
2021/11/16 10:15:33 Job still running ...
2021/11/16 10:16:03 Job still running ...
2021/11/16 10:16:33 Job still running ...
2021/11/16 10:17:03 Job still running ...
2021/11/16 10:17:33 Job still running ...
2021/11/16 10:18:03 Job still running ...
2021/11/16 10:18:33 Job still running ...
2021/11/16 10:19:03 Job still running ...
2021/11/16 10:19:33 Job still running ...
2021/11/16 10:20:03 Job still running ...
2021/11/16 10:20:34 Failed to execute job: job 2021-11-16_02_15_02-4647127910313836077 failed
panic: Failed to execute job: job 2021-11-16_02_15_02-4647127910313836077 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113ea48, 0xc0000480b0, 0x102e6d9, 0x19, 0xc000577e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 11s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/snox2kh35ylx6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #332
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/332/display/redirect>
Changes:
------------------------------------------
[...truncated 18.71 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/15 10:14:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1636971286792405634/model
2021/11/15 10:14:47 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1115100219"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636971286792405634/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636971286792405634/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1115100219",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/15 10:14:48 Submitted job: 2021-11-15_02_14_47-16720549504484717751
2021/11/15 10:14:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-15_02_14_47-16720549504484717751?project=apache-beam-testing
2021/11/15 10:14:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-15_02_14_47-16720549504484717751
2021/11/15 10:14:48 Job state: JOB_STATE_PENDING ...
2021/11/15 10:15:18 Job still running ...
2021/11/15 10:15:48 Job still running ...
2021/11/15 10:16:18 Job still running ...
2021/11/15 10:16:48 Job still running ...
2021/11/15 10:17:18 Job still running ...
2021/11/15 10:17:48 Job still running ...
2021/11/15 10:18:18 Failed to execute job: job 2021-11-15_02_14_47-16720549504484717751 failed
panic: Failed to execute job: job 2021-11-15_02_14_47-16720549504484717751 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113e988, 0xc0000480b0, 0x102e6cc, 0x19, 0xc000343e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 56s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/uiuep7ue4zbc4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #331
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/331/display/redirect>
Changes:
------------------------------------------
[...truncated 18.76 KB...]
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/14 10:14:46 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1636884885671779868/model
2021/11/14 10:14:46 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1114100225"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636884885671779868/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636884885671779868/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1114100225",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/14 10:14:47 Submitted job: 2021-11-14_02_14_46-17794788953864417331
2021/11/14 10:14:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-14_02_14_46-17794788953864417331?project=apache-beam-testing
2021/11/14 10:14:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-14_02_14_46-17794788953864417331
2021/11/14 10:14:47 Job state: JOB_STATE_PENDING ...
2021/11/14 10:15:17 Job still running ...
2021/11/14 10:15:47 Job still running ...
2021/11/14 10:16:17 Job still running ...
2021/11/14 10:16:47 Job still running ...
2021/11/14 10:17:17 Job still running ...
2021/11/14 10:17:47 Job still running ...
2021/11/14 10:18:17 Job still running ...
2021/11/14 10:18:47 Job still running ...
2021/11/14 10:19:17 Job still running ...
2021/11/14 10:19:47 Job still running ...
2021/11/14 10:20:17 Failed to execute job: job 2021-11-14_02_14_46-17794788953864417331 failed
panic: Failed to execute job: job 2021-11-14_02_14_46-17794788953864417331 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113e988, 0xc0000480b0, 0x102e6cc, 0x19, 0xc00055be00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 57s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/qlqpyfhmtg63w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #330
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/330/display/redirect?page=changes>
Changes:
[mmack] [BEAM-13009] Bugfix: Prevent dataloss in DynamoDBIO write if
[mmack] [BEAM-13009] Bugfix: Prevent dataloss in DynamoDBIO write if
[Alexey Romanenko] [BEAM-8727] Bump software.amazon.awssdk to 2.17.77
[aydar.zaynutdinov] [BEAM-13224][Playground]
[Alexey Romanenko] [BEAM-4868] Bump com.amazonaws to 1.12.106
[noreply] [BEAM-13147] Fix nullability issues in aws (SDK v1 + v2) for AwsModule
[noreply] [BEAM-3293] Add encoding of map/multimap side inputs into proto (#15960)
[noreply] [BEAM-13052] Implement ProtoPlusCoder and add it to the default options
[noreply] [BEAM-13193] Add elements field in ProcessBundleRequest and ProcessBu…
[noreply] [BEAM-3304] Refactor trigger API (#15952)
[noreply] [BEAM-3293] Add NewKeyedIterable function to SideInputAdapter interface
[noreply] [BEAM-13223] Documents two new features of cross-language transforms
------------------------------------------
[...truncated 18.74 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/13 10:14:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1636798493279842841/model
2021/11/13 10:14:53 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1113100228"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636798493279842841/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636798493279842841/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1113100228",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/13 10:14:54 Submitted job: 2021-11-13_02_14_53-12268451189715659189
2021/11/13 10:14:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-13_02_14_53-12268451189715659189?project=apache-beam-testing
2021/11/13 10:14:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-13_02_14_53-12268451189715659189
2021/11/13 10:14:54 Job state: JOB_STATE_PENDING ...
2021/11/13 10:15:25 Job still running ...
2021/11/13 10:15:55 Job still running ...
2021/11/13 10:16:25 Job still running ...
2021/11/13 10:16:55 Job still running ...
2021/11/13 10:17:25 Job still running ...
2021/11/13 10:17:55 Job still running ...
2021/11/13 10:18:25 Failed to execute job: job 2021-11-13_02_14_53-12268451189715659189 failed
panic: Failed to execute job: job 2021-11-13_02_14_53-12268451189715659189 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113e988, 0xc000120000, 0x102e6cc, 0x19, 0xc0007a1e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 4s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/2zycm4djz25pc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #329
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/329/display/redirect?page=changes>
Changes:
[Kyle Weaver] Update Beam website to release 2.34.0.
[noreply] [BEAM-12550] Parallelizable kurtosis Implementation (#15909)
[noreply] [BEAM-13016] Remove avro-python3 dependency from Beam (#15900)
[Kyle Weaver] Prepare docs for 2.34.0 release.
[noreply] [BEAM-13133] Loosen partitioning requirement for sample (#15818)
[noreply] [BEAM-13228] fix data race in metrics.store (#15946)
[noreply] [BEAM-3293] Add binding cases for MultiMap side inputs (#15943)
[noreply] [BEAM-13222] Re-enable Spanner integration tests (#15948)
[noreply] Merge pull request #15926 from [BEAM-13110][Playground] Playground
[noreply] [BEAM-13025] Disable deduplicating messages, as Dedupe is broken on
[noreply] [BEAM-13001] collect DoFn metrics for Combine (#15911)
------------------------------------------
[...truncated 18.74 KB...]
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/12 10:14:58 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1636712098305786758/model
2021/11/12 10:14:58 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1112100227"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636712098305786758/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636712098305786758/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1112100227",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/12 10:14:59 Submitted job: 2021-11-12_02_14_58-8524185911887711359
2021/11/12 10:14:59 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-12_02_14_58-8524185911887711359?project=apache-beam-testing
2021/11/12 10:14:59 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-12_02_14_58-8524185911887711359
2021/11/12 10:14:59 Job state: JOB_STATE_PENDING ...
2021/11/12 10:15:29 Job still running ...
2021/11/12 10:15:59 Job still running ...
2021/11/12 10:16:29 Job still running ...
2021/11/12 10:16:59 Job still running ...
2021/11/12 10:17:29 Job still running ...
2021/11/12 10:17:59 Job still running ...
2021/11/12 10:18:29 Job still running ...
2021/11/12 10:19:00 Job still running ...
2021/11/12 10:19:30 Job still running ...
2021/11/12 10:20:00 Job still running ...
2021/11/12 10:20:30 Failed to execute job: job 2021-11-12_02_14_58-8524185911887711359 failed
panic: Failed to execute job: job 2021-11-12_02_14_58-8524185911887711359 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113f1c8, 0xc00003e0b0, 0x102ecf3, 0x19, 0xc0004e7e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 7s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/mtu2sheaiummk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #328
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/328/display/redirect?page=changes>
Changes:
[sergey.kalinin] Initial add for dockerfiles and build scripts
[sergey.kalinin] Initial add for terraform scripts for infra provision
[sergey.kalinin] Add licenses
[sergey.kalinin] Add fixes to docker plugin and also build arg for beam sdk image
[sergey.kalinin] Remove wrongly added comments
[sergey.kalinin] Add beam playground applications deploy
[sergey.kalinin] Remove wrongly added log file
[sergey.kalinin] Fix syntax
[sergey.kalinin] Added default values
[sergey.kalinin] Add default value to base image
[sergey.kalinin] Added Beam Version as build arg, also changed way of getting tags for
[sergey.kalinin] Added readme file
[sergey.kalinin] Add workflow to build backend application
[sergey.kalinin] Add license
[asottile] remove unused future / futures dependencies
[sergey.kalinin] Add frontend workflow
[sergey.kalinin] Add license to README and added reader access to bucket
[sergey.kalinin] Remove trailing whitespace
[relax] for existing tables, no need to set a schema
[avilovpavel6] Fix environment_service_test.go
[sergey.kalinin] Remove comment from dockerfile
[noreply] [BEAM-13190] Elide trailing nils (#15920)
[noreply] [BEAM-13052] Increment protobuf version to 3.19.0 (#15883)
[noreply] [BEAM-3304] refactoring trigger package in GoSDK (#15933)
[noreply] [BEAM-13001] Hook to configure sampling period for DoFn metric
[noreply] [BEAM-3293] Add MultiMap side input decomposition (#15934)
[noreply] [BEAM-12651] Exclude packages from jacoco report (#15792)
[noreply] [BEAM-13222] Skip spanner integration tests (#15942)
[noreply] BEAM-13189 Python TextIO: add escapechar feature. (#15901)
------------------------------------------
[...truncated 18.80 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/11 10:14:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1636625694283935481/model
2021/11/11 10:14:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1111100223"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636625694283935481/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636625694283935481/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1111100223",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/11 10:14:57 Submitted job: 2021-11-11_02_14_54-5205479089278133111
2021/11/11 10:14:57 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-11_02_14_54-5205479089278133111?project=apache-beam-testing
2021/11/11 10:14:57 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-11_02_14_54-5205479089278133111
2021/11/11 10:14:57 Job state: JOB_STATE_PENDING ...
2021/11/11 10:15:27 Job still running ...
2021/11/11 10:15:57 Job still running ...
2021/11/11 10:16:27 Job still running ...
2021/11/11 10:16:57 Job still running ...
2021/11/11 10:17:27 Job still running ...
2021/11/11 10:17:57 Job still running ...
2021/11/11 10:18:27 Job still running ...
2021/11/11 10:18:57 Job still running ...
2021/11/11 10:19:27 Job still running ...
2021/11/11 10:19:57 Job still running ...
2021/11/11 10:20:27 Job still running ...
2021/11/11 10:20:57 Failed to execute job: job 2021-11-11_02_14_54-5205479089278133111 failed
panic: Failed to execute job: job 2021-11-11_02_14_54-5205479089278133111 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113f1c8, 0xc00003e0b0, 0x102ecd3, 0x19, 0xc0004e7e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 36s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/24ehhty4v5awy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #327
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/327/display/redirect?page=changes>
Changes:
[Kyle Weaver] [BEAM-12976] Add Java interfaces for projection pushdown.
[Kyle Weaver] fix cast
[Kyle Weaver] [BEAM-12976] Address review comments.
[Kyle Weaver] Hard-code output tag instead of making it public.
[Kyle Weaver] revert MAIN_OUTPUT_TAG to private
[Kyle Weaver] Remove WITHOUT_FIELD_ORDERING. Field reordering will be a prerequisite
[msbukal] Minor HL7v2IO Fixes
[dpcollins] Add detection of BundleFinalizers to DoFnSignatures
[dpcollins] Add enable_prime to the unified worker experiment list.
[dpcollins] Raise an exception before trying to launch a pipeline using
[dpcollins] Fix detection to properly null check.
[Andrew Pilloud] [BEAM-13056] Expose FieldAccess in DoFnSchemaInformation
[noreply] [BEAM-11097] Create hook to enable cross-bundle side input caching
[noreply] Merge pull request #15804 from [BEAM-13109][Playground] Add processing
[noreply] Improve FhirIO LRO Counters + minor fixes (#15921)
[noreply] Merge pull request #15771 from Enable BQ Standard SQL dialect style
[noreply] [BEAM-11217] Metrics querying for Pcol metrics (#15923)
------------------------------------------
[...truncated 18.78 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/10 10:14:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1636539293681930646/model
2021/11/10 10:14:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1110100220"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636539293681930646/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636539293681930646/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1110100220",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/10 10:14:54 Submitted job: 2021-11-10_02_14_54-11621139562092790952
2021/11/10 10:14:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-10_02_14_54-11621139562092790952?project=apache-beam-testing
2021/11/10 10:14:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-10_02_14_54-11621139562092790952
2021/11/10 10:14:54 Job state: JOB_STATE_PENDING ...
2021/11/10 10:15:24 Job still running ...
2021/11/10 10:15:55 Job still running ...
2021/11/10 10:16:25 Job still running ...
2021/11/10 10:16:55 Job still running ...
2021/11/10 10:17:25 Job still running ...
2021/11/10 10:17:55 Job still running ...
2021/11/10 10:18:25 Failed to execute job: job 2021-11-10_02_14_54-11621139562092790952 failed
panic: Failed to execute job: job 2021-11-10_02_14_54-11621139562092790952 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113e028, 0xc00003e0b0, 0x102dbd3, 0x19, 0xc0004cde00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x431
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 3s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/ohbwdftuwqxhi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #326
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/326/display/redirect?page=changes>
Changes:
[aydar.zaynutdinov] [BEAM-13155][Playground]
[25622840+adude3141] [BEAM-13157] add regression test for hadoop configuration on
[noreply] Merge pull request #15873 from [BEAM-13181] Remove Sharding from
[noreply] Merge pull request #15813 from [BEAM-13071] [Playground] Update run code
[Kyle Weaver] [BEAM-5172] Temporary ignore testSplit and testSizes tests waiting for a
------------------------------------------
[...truncated 18.76 KB...]
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/09 10:14:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1636452891224794585/model
2021/11/09 10:14:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1109100218"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636452891224794585/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636452891224794585/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1109100218",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/09 10:14:52 Submitted job: 2021-11-09_02_14_51-17997318148941698417
2021/11/09 10:14:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-09_02_14_51-17997318148941698417?project=apache-beam-testing
2021/11/09 10:14:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-09_02_14_51-17997318148941698417
2021/11/09 10:14:52 Job state: JOB_STATE_PENDING ...
2021/11/09 10:15:22 Job still running ...
2021/11/09 10:15:52 Job still running ...
2021/11/09 10:16:22 Job still running ...
2021/11/09 10:16:52 Job still running ...
2021/11/09 10:17:22 Job still running ...
2021/11/09 10:17:52 Job still running ...
2021/11/09 10:18:22 Job still running ...
2021/11/09 10:18:52 Job still running ...
2021/11/09 10:19:22 Job still running ...
2021/11/09 10:19:52 Job still running ...
2021/11/09 10:20:23 Failed to execute job: job 2021-11-09_02_14_51-17997318148941698417 failed
panic: Failed to execute job: job 2021-11-09_02_14_51-17997318148941698417 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113aa28, 0xc000120000, 0x102ab93, 0x19, 0xc000429e48, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x42a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 2s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/oaj5x3qged3yq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #325
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/325/display/redirect>
Changes:
------------------------------------------
[...truncated 18.70 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/08 10:14:46 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1636366485994115988/model
2021/11/08 10:14:46 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1108100236"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636366485994115988/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636366485994115988/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1108100236",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/08 10:14:47 Submitted job: 2021-11-08_02_14_46-5056033640340241928
2021/11/08 10:14:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-08_02_14_46-5056033640340241928?project=apache-beam-testing
2021/11/08 10:14:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-08_02_14_46-5056033640340241928
2021/11/08 10:14:47 Job state: JOB_STATE_PENDING ...
2021/11/08 10:15:17 Job still running ...
2021/11/08 10:15:47 Job still running ...
2021/11/08 10:16:17 Job still running ...
2021/11/08 10:16:47 Job still running ...
2021/11/08 10:17:17 Job still running ...
2021/11/08 10:17:47 Job still running ...
2021/11/08 10:18:17 Failed to execute job: job 2021-11-08_02_14_46-5056033640340241928 failed
panic: Failed to execute job: job 2021-11-08_02_14_46-5056033640340241928 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113aa28, 0xc000120000, 0x102ab93, 0x19, 0xc000577e48, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x42a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 57s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/2dmoss7as5wri
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #324
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/324/display/redirect?page=changes>
Changes:
[relax] remove log statement
------------------------------------------
[...truncated 18.75 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/07 12:51:10 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1636289469557688038/model
2021/11/07 12:51:10 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1107065417"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636289469557688038/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636289469557688038/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1107065417",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/07 12:51:10 Submitted job: 2021-11-07_04_51_10-2660432149665700480
2021/11/07 12:51:10 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-07_04_51_10-2660432149665700480?project=apache-beam-testing
2021/11/07 12:51:10 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-07_04_51_10-2660432149665700480
2021/11/07 12:51:10 Job state: JOB_STATE_PENDING ...
2021/11/07 12:51:40 Job still running ...
2021/11/07 12:52:10 Job still running ...
2021/11/07 12:52:40 Job still running ...
2021/11/07 12:53:10 Job still running ...
2021/11/07 12:53:40 Job still running ...
2021/11/07 12:54:10 Job still running ...
2021/11/07 12:54:40 Failed to execute job: job 2021-11-07_04_51_10-2660432149665700480 failed
panic: Failed to execute job: job 2021-11-07_04_51_10-2660432149665700480 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113aa28, 0xc000120000, 0x102ab93, 0x19, 0xc0004d9e48, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x42a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 44s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/cm3dif43hyv3c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #323
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/323/display/redirect?page=changes>
Changes:
[noreply] [adhoc] Speedup slow tests for AWS IO modules (#15899)
[noreply] [BEAM-12566] Implement set_axis for DataFrame and Series (#15773)
[noreply] [BEAM-13192] Fix buggy retry tests for AWS SnsIO (#15910)
[noreply] [BEAM-11217] Metrics Query filtering for DoFn metrics. (#15887)
[noreply] [Go SDK] Go SDK Exits Experimental (#15894)
[joseinigo] [BEAM-13080] Fix number of default keys
[joseinigo] [BEAM-13080] Fix number of default keys
------------------------------------------
[...truncated 18.85 KB...]
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/06 10:14:55 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1636193694600626199/model
2021/11/06 10:14:55 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1106100230"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636193694600626199/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636193694600626199/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1106100230",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/06 10:14:55 Submitted job: 2021-11-06_03_14_55-4151467509600448708
2021/11/06 10:14:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-06_03_14_55-4151467509600448708?project=apache-beam-testing
2021/11/06 10:14:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-06_03_14_55-4151467509600448708
2021/11/06 10:14:55 Job state: JOB_STATE_PENDING ...
2021/11/06 10:15:25 Job still running ...
2021/11/06 10:15:55 Job still running ...
2021/11/06 10:16:25 Job still running ...
2021/11/06 10:16:56 Job still running ...
2021/11/06 10:17:26 Job still running ...
2021/11/06 10:17:56 Job still running ...
2021/11/06 10:18:26 Job still running ...
2021/11/06 10:18:56 Job still running ...
2021/11/06 10:19:26 Job still running ...
2021/11/06 10:19:56 Job still running ...
2021/11/06 10:20:26 Job still running ...
2021/11/06 10:20:56 Job still running ...
2021/11/06 10:21:26 Failed to execute job: job 2021-11-06_03_14_55-4151467509600448708 failed
panic: Failed to execute job: job 2021-11-06_03_14_55-4151467509600448708 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113aa28, 0xc000120000, 0x102ab93, 0x19, 0xc0003dbe48, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x42a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 5s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/lfnrk24ewxb76
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #322
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/322/display/redirect?page=changes>
Changes:
[heejong] [BEAM-13021] Deduplicate Python artifact not only by hash but also by
[heejong] add test
[heejong] rename variables
[mmack] [BEAM-11440] Add integration test for KinesisIO using Localstack on
[mmack] Bump localstack container version for more robust version with respect
[mmack] Bump localstack container version for DynamoDBIOTest to version used in
[mmack] Apply format
[mmack] Apply format
[mmack] Use vendored guava deps
[Luke Cwik] [BEAM-3811] Code clean-up of the CancelleableQueue to not throw
[heejong] rearrange comparison order
[Luke Cwik] [BEAM-13164] Address most of a race condition between instantiation and
[Robert Bradshaw] Defer filesToStage construction until after full jar resolution.
[heejong] s/pathes/paths/
[noreply] Merge pull request #15835: [BEAM-11205] Google Libraries BOM 24.0.0 and
[noreply] Merge pull request #15810: [BEAM-2791] Support low-latency StorageApi
[noreply] [BEAM-13081] Fixes a compatible issue of decoding null-value bitmap
------------------------------------------
[...truncated 18.75 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/05 10:14:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1636107291327776944/model
2021/11/05 10:14:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1105100223"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636107291327776944/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636107291327776944/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1105100223",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/05 10:14:52 Submitted job: 2021-11-05_03_14_51-17028495744448380089
2021/11/05 10:14:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-05_03_14_51-17028495744448380089?project=apache-beam-testing
2021/11/05 10:14:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-05_03_14_51-17028495744448380089
2021/11/05 10:14:52 Job state: JOB_STATE_PENDING ...
2021/11/05 10:15:22 Job still running ...
2021/11/05 10:15:52 Job still running ...
2021/11/05 10:16:22 Job still running ...
2021/11/05 10:16:52 Job still running ...
2021/11/05 10:17:22 Job still running ...
2021/11/05 10:17:52 Job still running ...
2021/11/05 10:18:23 Failed to execute job: job 2021-11-05_03_14_51-17028495744448380089 failed
panic: Failed to execute job: job 2021-11-05_03_14_51-17028495744448380089 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1139768, 0xc000120000, 0x1029a2e, 0x19, 0xc0004dfe48, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x42a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 1s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/veu5mch4jn76e
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #321
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/321/display/redirect?page=changes>
Changes:
[noreply] Add missing parentheses for Python test example
[noreply] Update test input and imports
[stranniknm] [BEAM-13105] playground - add shorcut hint tooltip
[25622840+adude3141] [BEAM-13157] support hadoop configuration on ParquetIO.Parse
[Pablo Estrada] JdbcIO has a single WriteFn underlying all implementations
[dpcollins] Performance improvement to PubSubLiteIO to not use a streaming committer
[noreply] Merge pull request #15854 from [BEAM-13046][Playground] protobuf
[noreply] [BEAM-12550] Parallelizable skew Implementation (#15809)
[noreply] Merge pull request #15782 from [BEAM-13034] [Playground] add semantics
[hlagosperez] Use BigQuieryIO.loadProjectId in WriteRename class to create
[noreply] [BEAM-13099] Use vendored Calcite 1.28.0 in SQL extensions (#15836)
[Luke Cwik] [BEAM-13015] Use a network based channel instead of an inmemory one
[Pablo Estrada] Addressing comments
[noreply] Merge pull request #15839 from [BEAM-13041][Playground] Prepare files
[noreply] [BEAM-13001] updated CHANGES.md to include msec counter for Go (#15872)
[noreply] Add window mapping to CHANGES.md (#15871)
[noreply] Merge pull request #15784 from [BEAM-8135] - Removing
[noreply] [BEAM-13119] Subdirectory prefix tag for Go SDK (#15881)
[noreply] Merge pull request #15852 from [BEAM-13102] [Playground] update
[Kyle Weaver] Fix typo: s/spark/twister2
------------------------------------------
[...truncated 18.69 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/04 10:14:55 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1636020894640206137/model
2021/11/04 10:14:55 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1104100230"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636020894640206137/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636020894640206137/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1104100230",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/04 10:14:55 Submitted job: 2021-11-04_03_14_55-11550209544462298653
2021/11/04 10:14:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-04_03_14_55-11550209544462298653?project=apache-beam-testing
2021/11/04 10:14:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-04_03_14_55-11550209544462298653
2021/11/04 10:14:55 Job state: JOB_STATE_PENDING ...
2021/11/04 10:15:25 Job still running ...
2021/11/04 10:15:55 Job still running ...
2021/11/04 10:16:25 Job still running ...
2021/11/04 10:16:56 Job still running ...
2021/11/04 10:17:26 Job still running ...
2021/11/04 10:17:56 Job still running ...
2021/11/04 10:18:26 Failed to execute job: job 2021-11-04_03_14_55-11550209544462298653 failed
panic: Failed to execute job: job 2021-11-04_03_14_55-11550209544462298653 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1139768, 0xc000120000, 0x1029a2e, 0x19, 0xc0005f3e48, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x42a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 3s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/acoaabdxchaka
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #320
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/320/display/redirect?page=changes>
Changes:
[Andrew Pilloud] [BEAM-13118] Use branch for nightly "tag", tags are immutable
[dmitrii_kuzin] [BEAM-12730] Python. Custom delimiter add corner case
[Alexey Romanenko] [BEAM-12070] ParquetIO: use splittable reading by default
[noreply] [BEAM-13001] fixes nil reference error in Extractor.ExtractFrom (#15865)
[noreply] Merge pull request #15842 from [BEAM-13125][Playground] Update
[noreply] Merge pull request #15838 from [BEAM-13127] [Playground] Implement TCP
[noreply] Merge pull request #15832 from [BEAM-13149] Changing readWithPartitions
[noreply] Minor: add resource key to presentation materials link (#15867)
------------------------------------------
[...truncated 18.71 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/03 10:14:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1635934493709835034/model
2021/11/03 10:14:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1103100227"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635934493709835034/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635934493709835034/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1103100227",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/03 10:14:54 Submitted job: 2021-11-03_03_14_54-1902365125709175938
2021/11/03 10:14:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-03_03_14_54-1902365125709175938?project=apache-beam-testing
2021/11/03 10:14:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-03_03_14_54-1902365125709175938
2021/11/03 10:14:54 Job state: JOB_STATE_PENDING ...
2021/11/03 10:15:24 Job still running ...
2021/11/03 10:15:55 Job still running ...
2021/11/03 10:16:25 Job still running ...
2021/11/03 10:16:55 Job still running ...
2021/11/03 10:17:25 Job still running ...
2021/11/03 10:17:55 Job still running ...
2021/11/03 10:18:25 Failed to execute job: job 2021-11-03_03_14_54-1902365125709175938 failed
panic: Failed to execute job: job 2021-11-03_03_14_54-1902365125709175938 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1139768, 0xc000120000, 0x1029a2e, 0x19, 0xc0004f7e48, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x42a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 4s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/mld2cpq22d7wg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #319
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/319/display/redirect?page=changes>
Changes:
[aydar.zaynutdinov] [BEAM-13145][Playground]
[avilovpavel6] Added cleanup os env before and after tests
[noreply] [BEAM-11936] Fix errorprone warnings (#15821)
[noreply] [BEAM-13001] fixes Golint issues (#15859)
[noreply] Merge pull request #15840 from [Playground][BEAM-13146][Bugfix]
------------------------------------------
[...truncated 18.74 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/02 10:15:05 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1635848104547705773/model
2021/11/02 10:15:05 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1102100225"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635848104547705773/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635848104547705773/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1102100225",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/02 10:15:05 Submitted job: 2021-11-02_03_15_05-14622404839879903402
2021/11/02 10:15:05 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-02_03_15_05-14622404839879903402?project=apache-beam-testing
2021/11/02 10:15:05 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-02_03_15_05-14622404839879903402
2021/11/02 10:15:05 Job state: JOB_STATE_PENDING ...
2021/11/02 10:15:35 Job still running ...
2021/11/02 10:16:05 Job still running ...
2021/11/02 10:16:35 Job still running ...
2021/11/02 10:17:05 Job still running ...
2021/11/02 10:17:35 Job still running ...
2021/11/02 10:18:05 Job still running ...
2021/11/02 10:18:36 Failed to execute job: job 2021-11-02_03_15_05-14622404839879903402 failed
panic: Failed to execute job: job 2021-11-02_03_15_05-14622404839879903402 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1139768, 0xc00018a000, 0x1029a2e, 0x19, 0xc000463e48, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x42a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 12s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/spj43fa2dskmm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #318
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/318/display/redirect>
Changes:
------------------------------------------
[...truncated 18.73 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/01 10:14:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1635761694295602421/model
2021/11/01 10:14:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1101100222"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635761694295602421/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635761694295602421/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1101100222",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/01 10:14:55 Submitted job: 2021-11-01_03_14_54-8561415556646569739
2021/11/01 10:14:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-01_03_14_54-8561415556646569739?project=apache-beam-testing
2021/11/01 10:14:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-01_03_14_54-8561415556646569739
2021/11/01 10:14:55 Job state: JOB_STATE_PENDING ...
2021/11/01 10:15:25 Job still running ...
2021/11/01 10:15:55 Job still running ...
2021/11/01 10:16:25 Job still running ...
2021/11/01 10:16:55 Job still running ...
2021/11/01 10:17:25 Job still running ...
2021/11/01 10:17:55 Job still running ...
2021/11/01 10:18:25 Failed to execute job: job 2021-11-01_03_14_54-8561415556646569739 failed
panic: Failed to execute job: job 2021-11-01_03_14_54-8561415556646569739 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1139768, 0xc00003e0c0, 0x1029a2e, 0x19, 0xc0002cde48, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x42a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 4s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/zehjczjvp3te2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #317
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/317/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #15753 from [BEAM-13080] Add option in Reshuffle to
------------------------------------------
[...truncated 18.73 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/31 10:14:57 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1635675297234991884/model
2021/10/31 10:14:57 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1031100217"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635675297234991884/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635675297234991884/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1031100217",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/31 10:14:58 Submitted job: 2021-10-31_03_14_57-11842321157072045545
2021/10/31 10:14:58 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-31_03_14_57-11842321157072045545?project=apache-beam-testing
2021/10/31 10:14:58 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-31_03_14_57-11842321157072045545
2021/10/31 10:14:58 Job state: JOB_STATE_PENDING ...
2021/10/31 10:15:28 Job still running ...
2021/10/31 10:15:58 Job still running ...
2021/10/31 10:16:28 Job still running ...
2021/10/31 10:16:58 Job still running ...
2021/10/31 10:17:28 Job still running ...
2021/10/31 10:17:58 Job still running ...
2021/10/31 10:18:28 Failed to execute job: job 2021-10-31_03_14_57-11842321157072045545 failed
panic: Failed to execute job: job 2021-10-31_03_14_57-11842321157072045545 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1139768, 0xc000120000, 0x1029a2e, 0x19, 0xc000717e48, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x42a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 6s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/kfbpc7v4pqmqo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #316
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/316/display/redirect?page=changes>
Changes:
[Luke Cwik] [BEAM-13015] Migrate bundle processing in the SDK harness to using
[noreply] [BEAM-8958] Use AWS credentials provider with BasicKinesisProvider
[Brian Hulette] [BEAM-13099] Copy vendored calcite build for 1.28.0
[Brian Hulette] [BEAM-13099] Modifications for vendor/calcite-1_28_0 build
[noreply] [BEAM-13099] Use BlockBuilder.add(..) rather than
[noreply] Minor: Remove broken python compatibility checks (#15828)
[noreply] [BEAM-12047] Updates CHANGES.md to mention the URN convention (#15845)
[noreply] [BEAM-13001] DoFn metrics for Go SDK (#15657)
------------------------------------------
[...truncated 18.79 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/30 10:15:03 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1635588902514744268/model
2021/10/30 10:15:03 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1030100224"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635588902514744268/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635588902514744268/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1030100224",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/30 10:15:03 Submitted job: 2021-10-30_03_15_03-7148644543388136592
2021/10/30 10:15:03 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-30_03_15_03-7148644543388136592?project=apache-beam-testing
2021/10/30 10:15:03 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-30_03_15_03-7148644543388136592
2021/10/30 10:15:03 Job state: JOB_STATE_PENDING ...
2021/10/30 10:15:33 Job still running ...
2021/10/30 10:16:03 Job still running ...
2021/10/30 10:16:33 Job still running ...
2021/10/30 10:17:03 Job still running ...
2021/10/30 10:17:33 Job still running ...
2021/10/30 10:18:03 Job still running ...
2021/10/30 10:18:34 Failed to execute job: job 2021-10-30_03_15_03-7148644543388136592 failed
panic: Failed to execute job: job 2021-10-30_03_15_03-7148644543388136592 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1139768, 0xc000128000, 0x1029a2e, 0x19, 0xc0005ade48, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x42a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 11s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/egsdxaei4lw2c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #315
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/315/display/redirect?page=changes>
Changes:
[artur.khanin] Implemented GetCompileOutput and covered with unit tests
[artur.khanin] Replaced logging library regarding PR comment
[daria.malkova] fix executor tests
[mmack] [BEAM-13138] Update code to retrieve container endpoint
[aydar.zaynutdinov] [BEAM-13120][Playground]
[noreply] Merge pull request #15709 from [BEAM-12967] [Playground] Create Example
[noreply] Merge pull request #15294 from [BEAM-11986] Spanner write metric
[noreply] [BEAM-13130] Remove persistent references to stateKeyReaders (#15815)
[Brian Hulette] [BEAM-13099] Replace call to RelNode.metadata with BeamRelMetadataQuery
[Brian Hulette] [BEAM-13099] Update all rels to use BeamRelMetadataQuery
[Kyle Weaver] [BEAM-13143] Fix python doc generator error.
[Pablo Estrada] Handle runner-provided shards for TextIO
[noreply] Merge pull request #15721 from [BEAM-13023][Playground] Implement Redis
[noreply] Merge pull request #15802 from [BEAM-12970][Playground] Implement gRPC
[noreply] Merge pull request #15800 from [BEAM-12970][Playground] Implement gRPC
------------------------------------------
[...truncated 18.76 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/29 10:15:00 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1635502499670294369/model
2021/10/29 10:15:00 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1029100242"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635502499670294369/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635502499670294369/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1029100242",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/29 10:15:02 Submitted job: 2021-10-29_03_15_00-10422724255406339235
2021/10/29 10:15:02 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-29_03_15_00-10422724255406339235?project=apache-beam-testing
2021/10/29 10:15:02 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-29_03_15_00-10422724255406339235
2021/10/29 10:15:02 Job state: JOB_STATE_PENDING ...
2021/10/29 10:15:32 Job still running ...
2021/10/29 10:16:02 Job still running ...
2021/10/29 10:16:32 Job still running ...
2021/10/29 10:17:02 Job still running ...
2021/10/29 10:17:32 Job still running ...
2021/10/29 10:18:02 Job still running ...
2021/10/29 10:18:32 Failed to execute job: job 2021-10-29_03_15_00-10422724255406339235 failed
panic: Failed to execute job: job 2021-10-29_03_15_00-10422724255406339235 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1133c68, 0xc000120000, 0x10247d9, 0x19, 0xc0004f7e90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 10s
4 actionable tasks: 4 executed
Publishing build scan...
Publishing build scan failed due to network error 'java.net.SocketTimeoutException: Read timed out' (2 retries remaining)...
https://gradle.com/s/7dknveuoh6moe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #314
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/314/display/redirect?page=changes>
Changes:
[relax] support json
[aydar.zaynutdinov] [BEAM-12970][Playground]
[Andrew Pilloud] [BEAM-13118] Don't force push to master
[aydar.zaynutdinov] [BEAM-12970][Playground]
[eugene.nikolayev] Fix Python docs build pre-commit failures.
[mmack] [BEAM-8958] Use AWS credentials provider with BasicKinesisProvider (AWS
[aydar.zaynutdinov] [BEAM-12970][Playground]
[noreply] Merge pull request #15731: [BEAM-13067] Mark GroupIntoBatches output as
[noreply] [BEAM-13066, BEAM-13087] Workaround for coder type combiner packing
[noreply] [BEAM-13066] Disable using abstract iterable by default. (#15805)
[aydar.zaynutdinov] [BEAM-12970][Playground]
------------------------------------------
[...truncated 18.74 KB...]
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/28 10:14:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1635416093928866510/model
2021/10/28 10:14:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1028100231"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635416093928866510/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635416093928866510/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1028100231",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/28 10:14:55 Submitted job: 2021-10-28_03_14_54-15472000892615898488
2021/10/28 10:14:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-28_03_14_54-15472000892615898488?project=apache-beam-testing
2021/10/28 10:14:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-28_03_14_54-15472000892615898488
2021/10/28 10:14:55 Job state: JOB_STATE_PENDING ...
2021/10/28 10:15:25 Job still running ...
2021/10/28 10:15:55 Job still running ...
2021/10/28 10:16:25 Job still running ...
2021/10/28 10:16:56 Job still running ...
2021/10/28 10:17:26 Job still running ...
2021/10/28 10:17:56 Job still running ...
2021/10/28 10:18:26 Job still running ...
2021/10/28 10:18:56 Job still running ...
2021/10/28 10:19:26 Job still running ...
2021/10/28 10:19:56 Job still running ...
2021/10/28 10:20:26 Failed to execute job: job 2021-10-28_03_14_54-15472000892615898488 failed
panic: Failed to execute job: job 2021-10-28_03_14_54-15472000892615898488 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1133c48, 0xc00003e0c0, 0x10247f9, 0x19, 0xc000355e90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 4s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/5pns6zlyyzq2m
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #313
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/313/display/redirect?page=changes>
Changes:
[baeminbo] [BEAM-6721] Set numShards dynamically for TextIO.write()
[heejong] [BEAM-12978] Customizable dependency for Java external transform
[melissapa] [BEAM-11758] Update basics page: Splittable DoFn
[heejong] add ConfigT param to getDependencies method
[Alexey Romanenko] [BEAM-13104] ParquetIO: SplitReadFn must read the whole block
[noreply] Change sql.Options to an interface under sqlx. (#15790)
[melissapa] Address review feedback
[noreply] [BEAM-4149] Ensure that we always provide and require the worker id.
[noreply] [BEAM-13098] Fix translation of repeated TableRow fields (#15779)
------------------------------------------
[...truncated 18.68 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/27 10:14:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1635329694001124259/model
2021/10/27 10:14:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1027100218"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635329694001124259/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635329694001124259/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1027100218",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/27 10:14:55 Submitted job: 2021-10-27_03_14_54-16274801148528910722
2021/10/27 10:14:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-27_03_14_54-16274801148528910722?project=apache-beam-testing
2021/10/27 10:14:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-27_03_14_54-16274801148528910722
2021/10/27 10:14:55 Job state: JOB_STATE_PENDING ...
2021/10/27 10:15:25 Job still running ...
2021/10/27 10:15:55 Job still running ...
2021/10/27 10:16:25 Job still running ...
2021/10/27 10:16:55 Job still running ...
2021/10/27 10:17:25 Job still running ...
2021/10/27 10:17:55 Job still running ...
2021/10/27 10:18:25 Failed to execute job: job 2021-10-27_03_14_54-16274801148528910722 failed
panic: Failed to execute job: job 2021-10-27_03_14_54-16274801148528910722 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1133c48, 0xc00003e0c0, 0x10247f9, 0x19, 0xc000151e90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 3s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/nqbpcr3g3ehag
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #312
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/312/display/redirect?page=changes>
Changes:
[Luke Cwik] [BEAM-12522] Enable side inputs on all splittable DoFn execution time
[aydar.zaynutdinov] [BEAM-13062][Playground]
[ilya.kozyrev] Add environment_service.go and structures for beam sdk, network envs,
[aydar.zaynutdinov] [BEAM-13062][Playground]
[noreply] Merge pull request #15772 from [BEAM-13032] [Playground] Implement the
[noreply] Merge pull request #15714 from [BEAM-13005] [Playground] Implement local
[noreply] Merge pull request #15770 from [BEAM-13095][Playground] Using working
[noreply] [BEAM-11758] Update basics page: Aggregation, Runner, UDF, Schema
[noreply] Merge pull request #15783 from [BEAM-13048] [Playground] Add shortcuts
[Luke Cwik] [BEAM-8543] Fix test filtering for Dataflow Runner V2 to exclude
[noreply] Merge pull request #15744 from [BEAM-13072][Playground] Executor builder
------------------------------------------
[...truncated 18.78 KB...]
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/26 10:14:57 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1635243296523470076/model
2021/10/26 10:14:57 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1026100228"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635243296523470076/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635243296523470076/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1026100228",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/26 10:15:07 Submitted job: 2021-10-26_03_14_57-13421628960390474092
2021/10/26 10:15:07 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-26_03_14_57-13421628960390474092?project=apache-beam-testing
2021/10/26 10:15:07 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-26_03_14_57-13421628960390474092
2021/10/26 10:15:07 Job state: JOB_STATE_PENDING ...
2021/10/26 10:15:37 Job still running ...
2021/10/26 10:16:07 Job still running ...
2021/10/26 10:16:38 Job still running ...
2021/10/26 10:17:08 Job still running ...
2021/10/26 10:17:38 Job still running ...
2021/10/26 10:18:08 Job still running ...
2021/10/26 10:18:38 Job still running ...
2021/10/26 10:19:08 Job still running ...
2021/10/26 10:19:38 Job still running ...
2021/10/26 10:20:08 Job still running ...
2021/10/26 10:20:38 Failed to execute job: job 2021-10-26_03_14_57-13421628960390474092 failed
panic: Failed to execute job: job 2021-10-26_03_14_57-13421628960390474092 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1133c48, 0xc000120000, 0x10247f9, 0x19, 0xc00067de90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 16s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/h2726zkzjg6bo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #311
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/311/display/redirect?page=changes>
Changes:
[noreply] Fixing BigQueryIO request too big corner case for streaming inserts
------------------------------------------
[...truncated 18.82 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/25 10:15:01 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1635156900649454595/model
2021/10/25 10:15:01 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1025100228"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635156900649454595/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635156900649454595/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1025100228",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/25 10:15:01 Submitted job: 2021-10-25_03_15_01-8763809660807875195
2021/10/25 10:15:01 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-25_03_15_01-8763809660807875195?project=apache-beam-testing
2021/10/25 10:15:01 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-25_03_15_01-8763809660807875195
2021/10/25 10:15:01 Job state: JOB_STATE_PENDING ...
2021/10/25 10:15:31 Job still running ...
2021/10/25 10:16:01 Job still running ...
2021/10/25 10:16:31 Job still running ...
2021/10/25 10:17:02 Job still running ...
2021/10/25 10:17:32 Job still running ...
2021/10/25 10:18:02 Job still running ...
2021/10/25 10:18:32 Job still running ...
2021/10/25 10:19:02 Job still running ...
2021/10/25 10:19:32 Job still running ...
2021/10/25 10:20:02 Job still running ...
2021/10/25 10:20:32 Job still running ...
2021/10/25 10:21:02 Failed to execute job: job 2021-10-25_03_15_01-8763809660807875195 failed
panic: Failed to execute job: job 2021-10-25_03_15_01-8763809660807875195 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1133c48, 0xc00003e0c0, 0x10247f9, 0x19, 0xc000455e90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 41s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/xmpbmla3nqasw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #310
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/310/display/redirect>
Changes:
------------------------------------------
[...truncated 18.85 KB...]
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/24 10:14:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1635070491012625602/model
2021/10/24 10:14:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1024100225"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635070491012625602/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635070491012625602/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1024100225",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/24 10:14:52 Submitted job: 2021-10-24_03_14_51-18343742566124523031
2021/10/24 10:14:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-24_03_14_51-18343742566124523031?project=apache-beam-testing
2021/10/24 10:14:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-24_03_14_51-18343742566124523031
2021/10/24 10:14:52 Job state: JOB_STATE_PENDING ...
2021/10/24 10:15:22 Job still running ...
2021/10/24 10:15:52 Job still running ...
2021/10/24 10:16:22 Job still running ...
2021/10/24 10:16:52 Job still running ...
2021/10/24 10:17:22 Job still running ...
2021/10/24 10:17:52 Job still running ...
2021/10/24 10:18:22 Job still running ...
2021/10/24 10:18:52 Job still running ...
2021/10/24 10:19:22 Job still running ...
2021/10/24 10:19:52 Job still running ...
2021/10/24 10:20:23 Failed to execute job: job 2021-10-24_03_14_51-18343742566124523031 failed
panic: Failed to execute job: job 2021-10-24_03_14_51-18343742566124523031 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1133c48, 0xc000128000, 0x10247f9, 0x19, 0xc000317e90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 2s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/vy6p4kilrrg3y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #309
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/309/display/redirect>
Changes:
------------------------------------------
[...truncated 18.80 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/23 10:14:55 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1634984094993852981/model
2021/10/23 10:14:55 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1023100233"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634984094993852981/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634984094993852981/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1023100233",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/23 10:14:56 Submitted job: 2021-10-23_03_14_55-10619755945364860901
2021/10/23 10:14:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-23_03_14_55-10619755945364860901?project=apache-beam-testing
2021/10/23 10:14:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-23_03_14_55-10619755945364860901
2021/10/23 10:14:56 Job state: JOB_STATE_PENDING ...
2021/10/23 10:15:26 Job still running ...
2021/10/23 10:15:56 Job still running ...
2021/10/23 10:16:26 Job still running ...
2021/10/23 10:16:56 Job still running ...
2021/10/23 10:17:26 Job still running ...
2021/10/23 10:17:56 Job still running ...
2021/10/23 10:18:26 Failed to execute job: job 2021-10-23_03_14_55-10619755945364860901 failed
panic: Failed to execute job: job 2021-10-23_03_14_55-10619755945364860901 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1133c48, 0xc00003e0c0, 0x10247f9, 0x19, 0xc00055fe90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 4s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/lbydduu64emxa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #308
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/308/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #15761 from [BEAM-13008] Create gradle tasks for the
[noreply] [BEAM-13096] Double test timeout. (#15774)
[noreply] [BEAM-13019] Add `containsInAnyOrder` with matchers to the
[Daniel Oliveira] Avoiding read-only Go module cache in Gradle config.
[noreply] [BEAM-11758] Update basics page: Pipeline, PCollection, PTransform
[noreply] Test SetState addIfAbsent with no read (#15776)
[noreply] lazy creation of source splits for export-based ReadFromBigQuery
[noreply] [BEAM-11275] Support remote package download from remote filesystems in
[noreply] [BEAM-13015] Create a multiplexer that sends Elements based upon
------------------------------------------
[...truncated 18.80 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/22 10:14:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1634897694119490234/model
2021/10/22 10:14:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1022100216"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634897694119490234/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634897694119490234/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1022100216",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/22 10:14:55 Submitted job: 2021-10-22_03_14_54-858806717829412371
2021/10/22 10:14:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-22_03_14_54-858806717829412371?project=apache-beam-testing
2021/10/22 10:14:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-22_03_14_54-858806717829412371
2021/10/22 10:14:55 Job state: JOB_STATE_PENDING ...
2021/10/22 10:15:25 Job still running ...
2021/10/22 10:15:55 Job still running ...
2021/10/22 10:16:25 Job still running ...
2021/10/22 10:16:55 Job still running ...
2021/10/22 10:17:25 Job still running ...
2021/10/22 10:17:55 Job still running ...
2021/10/22 10:18:25 Failed to execute job: job 2021-10-22_03_14_54-858806717829412371 failed
panic: Failed to execute job: job 2021-10-22_03_14_54-858806717829412371 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1133c48, 0xc000128000, 0x10247f9, 0x19, 0xc0007ede90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 4s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/grgxngcfeqnze
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #307
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/307/display/redirect?page=changes>
Changes:
[noreply] Add -XX:+AlwaysActAsServerClassMachine to Java SDK container
[moritz] adhoc: Minor update to flink runner docs
[noreply] [BEAM-11087] Add default WindowMappingFn from Main to Side Input
[noreply] [BEAM-13082] Re-use dataWriter buffer. (#15762)
------------------------------------------
[...truncated 18.73 KB...]
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/21 10:14:56 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1634811295935674547/model
2021/10/21 10:14:56 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1021100225"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634811295935674547/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634811295935674547/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1021100225",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/21 10:14:57 Submitted job: 2021-10-21_03_14_56-17993959496105081156
2021/10/21 10:14:57 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-21_03_14_56-17993959496105081156?project=apache-beam-testing
2021/10/21 10:14:57 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-21_03_14_56-17993959496105081156
2021/10/21 10:14:57 Job state: JOB_STATE_PENDING ...
2021/10/21 10:15:27 Job still running ...
2021/10/21 10:15:57 Job still running ...
2021/10/21 10:16:27 Job still running ...
2021/10/21 10:16:57 Job still running ...
2021/10/21 10:17:27 Job still running ...
2021/10/21 10:17:57 Job still running ...
2021/10/21 10:18:27 Job still running ...
2021/10/21 10:18:57 Job still running ...
2021/10/21 10:19:27 Job still running ...
2021/10/21 10:19:57 Job still running ...
2021/10/21 10:20:27 Failed to execute job: job 2021-10-21_03_14_56-17993959496105081156 failed
panic: Failed to execute job: job 2021-10-21_03_14_56-17993959496105081156 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1133c48, 0xc00003e0c0, 0x10247f9, 0x19, 0xc00071de90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 6s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/gdzbaqahfwfdc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #306
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/306/display/redirect?page=changes>
Changes:
[samuelw] [BEAM-13042] Prevent unexpected blocking in
[ilya.kozyrev] Implement initial server with grpcweb wrapper
[aydar.zaynutdinov] [BEAM_13077][Playground]
[egalpin] [BEAM-10990] Adds response filtering for ElasticsearchIO
[egalpin] [BEAM-5172] Tries to reduce ES uTest flakiness
[noreply] [BEAM-13068] Add a SQL API in Beam Go SDK (#15746)
[Kyle Weaver] [BEAM-13055] Use unshallow clone to create PR.
[noreply] [BEAM-13079] Updates cross-language transform URNs to use the new
------------------------------------------
[...truncated 18.72 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/20 10:14:59 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1634724898792822317/model
2021/10/20 10:14:59 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1020100230"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634724898792822317/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634724898792822317/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1020100230",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/20 10:14:59 Submitted job: 2021-10-20_03_14_59-9058062765450198727
2021/10/20 10:14:59 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-20_03_14_59-9058062765450198727?project=apache-beam-testing
2021/10/20 10:14:59 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-20_03_14_59-9058062765450198727
2021/10/20 10:15:00 Job state: JOB_STATE_PENDING ...
2021/10/20 10:15:30 Job still running ...
2021/10/20 10:16:00 Job still running ...
2021/10/20 10:16:30 Job still running ...
2021/10/20 10:17:00 Job still running ...
2021/10/20 10:17:30 Job still running ...
2021/10/20 10:18:00 Job still running ...
2021/10/20 10:18:30 Job still running ...
2021/10/20 10:19:00 Failed to execute job: job 2021-10-20_03_14_59-9058062765450198727 failed
panic: Failed to execute job: job 2021-10-20_03_14_59-9058062765450198727 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1132548, 0xc000120000, 0x102355c, 0x19, 0xc00029de90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 38s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/z5zsgnadghgsw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #305
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/305/display/redirect?page=changes>
Changes:
[zhoufek] [BEAM-9487] Multiple Trigger.may_lose_data fixes
[zhoufek] [BEAM-9487] Remove CONDITION_NOT_GUARANTEED as potential data loss
[zhoufek] [BEAM-9487] Do AfterAny, AfterAll, and AfterEach checks properly (i.e.
[zhoufek] [BEAM-9487] Remove unused import
[zhoufek] [BEAM-9487] Reintroduce flag but do not use it
[zhoufek] [BEAM-9487] Add test that shows AfterCount finishing
[zhoufek] [BEAM-9487] Make _ParallelTriggerFn.may_finish clearer
[Robert Bradshaw] Revert "Merge pull request #15441 from [BEAM-8823] Make FnApiRunner work
[Robert Bradshaw] [BEAM-13040] Add some test cases enforcing side input waiting.
[Robert Bradshaw] lint
[brachipa] [BEAM-12393] sql support for Zeta Sql
[aydar.zaynutdinov] [BEAM-12988] [Playground]
[brachipa] [BEAM-12393] package private
[brachipa] [BEAM-12393] returning more generic interface
[noreply] [BEAM-13066] Produce abstract iterables from IterableCoder. (#15662)
[noreply] [BEAM-11936] Fix some errorprone warnings (#15648)
[noreply] [BEAM-13068] Add xlangx.DecodeStructPayload (#15741)
[Luke Cwik] [BEAM-13015] Implement a simplified cancellable blocking queue with
------------------------------------------
[...truncated 18.77 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/19 10:14:56 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1634638496065238026/model
2021/10/19 10:14:56 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1019100259"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634638496065238026/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634638496065238026/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1019100259",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/19 10:14:57 Submitted job: 2021-10-19_03_14_56-4030806126342867951
2021/10/19 10:14:57 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-19_03_14_56-4030806126342867951?project=apache-beam-testing
2021/10/19 10:14:57 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-19_03_14_56-4030806126342867951
2021/10/19 10:14:57 Job state: JOB_STATE_PENDING ...
2021/10/19 10:15:27 Job still running ...
2021/10/19 10:15:57 Job still running ...
2021/10/19 10:16:27 Job still running ...
2021/10/19 10:16:57 Job still running ...
2021/10/19 10:17:27 Job still running ...
2021/10/19 10:17:57 Job still running ...
2021/10/19 10:18:27 Failed to execute job: job 2021-10-19_03_14_56-4030806126342867951 failed
panic: Failed to execute job: job 2021-10-19_03_14_56-4030806126342867951 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1132548, 0xc00018a000, 0x102355c, 0x19, 0xc00072de90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 6s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/67wobrsnml2os
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #304
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/304/display/redirect>
Changes:
------------------------------------------
[...truncated 18.82 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/18 10:14:55 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1634552094512674068/model
2021/10/18 10:14:55 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1018100239"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634552094512674068/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634552094512674068/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1018100239",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/18 10:14:55 Submitted job: 2021-10-18_03_14_55-26244888919991725
2021/10/18 10:14:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-18_03_14_55-26244888919991725?project=apache-beam-testing
2021/10/18 10:14:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-18_03_14_55-26244888919991725
2021/10/18 10:14:55 Job state: JOB_STATE_PENDING ...
2021/10/18 10:15:25 Job still running ...
2021/10/18 10:15:55 Job still running ...
2021/10/18 10:16:25 Job still running ...
2021/10/18 10:16:55 Job still running ...
2021/10/18 10:17:26 Job still running ...
2021/10/18 10:17:56 Job still running ...
2021/10/18 10:18:26 Job still running ...
2021/10/18 10:18:56 Job still running ...
2021/10/18 10:19:26 Job still running ...
2021/10/18 10:19:56 Job still running ...
2021/10/18 10:20:26 Job still running ...
2021/10/18 10:20:56 Failed to execute job: job 2021-10-18_03_14_55-26244888919991725 failed
panic: Failed to execute job: job 2021-10-18_03_14_55-26244888919991725 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1132548, 0xc00003e0b0, 0x102355c, 0x19, 0xc000345e90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 35s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/nbl36amhcpfei
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #303
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/303/display/redirect>
Changes:
------------------------------------------
[...truncated 18.74 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/17 10:14:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1634465691125781742/model
2021/10/17 10:14:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1017100229"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634465691125781742/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634465691125781742/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1017100229",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/17 10:14:52 Submitted job: 2021-10-17_03_14_51-9554741380053807938
2021/10/17 10:14:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-17_03_14_51-9554741380053807938?project=apache-beam-testing
2021/10/17 10:14:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-17_03_14_51-9554741380053807938
2021/10/17 10:14:52 Job state: JOB_STATE_PENDING ...
2021/10/17 10:15:22 Job still running ...
2021/10/17 10:15:52 Job still running ...
2021/10/17 10:16:22 Job still running ...
2021/10/17 10:16:52 Job still running ...
2021/10/17 10:17:22 Job still running ...
2021/10/17 10:17:52 Job still running ...
2021/10/17 10:18:22 Failed to execute job: job 2021-10-17_03_14_51-9554741380053807938 failed
panic: Failed to execute job: job 2021-10-17_03_14_51-9554741380053807938 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1132548, 0xc00003e0b0, 0x102355c, 0x19, 0xc000179e90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 1s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/f27phw4etbdfm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #302
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/302/display/redirect?page=changes>
Changes:
[noreply] Corrected Join Example
[noreply] Minor: Add more links to DataFrame API documentation (#15661)
[noreply] [BEAM-11480] Use snippets for DataFrame examples (#15600)
[noreply] Allow multiple Python worker processe to share the same VM. (#15642)
[noreply] [BEAM-12564] Implement Series.hasnans (#15729)
[noreply] Minor: Fix frames_test.py equality check for non-frame outputs (#15734)
[noreply] [BEAM-12769] Adds integration tests for Java Class Lookup based
[Brian Hulette] Address BEAM-4028 cleanup TODOs
[Brian Hulette] Bump Dataflow container to beam-master-20211015
[noreply] [BEAM-13052] Restructure pubsublite folder to move non-user interface
------------------------------------------
[...truncated 18.76 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/16 10:15:03 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1634379302615467994/model
2021/10/16 10:15:03 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1016100234"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634379302615467994/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634379302615467994/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1016100234",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/16 10:15:03 Submitted job: 2021-10-16_03_15_03-6237441606067020746
2021/10/16 10:15:03 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-16_03_15_03-6237441606067020746?project=apache-beam-testing
2021/10/16 10:15:03 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-16_03_15_03-6237441606067020746
2021/10/16 10:15:03 Job state: JOB_STATE_PENDING ...
2021/10/16 10:15:33 Job still running ...
2021/10/16 10:16:04 Job still running ...
2021/10/16 10:16:34 Job still running ...
2021/10/16 10:17:04 Job still running ...
2021/10/16 10:17:34 Job still running ...
2021/10/16 10:18:04 Failed to execute job: job 2021-10-16_03_15_03-6237441606067020746 failed
panic: Failed to execute job: job 2021-10-16_03_15_03-6237441606067020746 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1132548, 0xc00003e0b0, 0x102355c, 0x19, 0xc000229e90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 42s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/laeseg3njhh2i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #301
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/301/display/redirect?page=changes>
Changes:
[ilya.kozyrev] Add java executor to compile java code in created file system
[zyichi] Use daemon thread to report lull operation and move code to
[noreply] Merge pull request #15722 from [BEAM-13022] [Playground] Run code on the
[Luke Cwik] [BEAM-12640] Skip checkerframework on generated code/test libraries for
[Luke Cwik] [BEAM-13015] Add tiny bundle processing benchmark for Java SDK harness.
[noreply] [BEAM-12922] Test MapState putIfAbsent with no read (#15704)
[Robert Bradshaw] [BEAM-13053] Avoid runner v2 when streaming engine explicitly disabled.
[noreply] [Go SDK] Small typo fixes. (#15725)
[noreply] [BEAM-13038] Migrate to use a context object within
[noreply] [BEAM-12135] Avoid windowing overhead in Spark global GBK. (#15637)
[noreply] [BEAM-12907] Run DataFrame API tests with multiple pandas versions
[vachan] Remove unnecessary ERROR logging.
------------------------------------------
[...truncated 18.72 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/15 10:14:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1634292893141121452/model
2021/10/15 10:14:53 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1015100234"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634292893141121452/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634292893141121452/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1015100234",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/15 10:14:54 Submitted job: 2021-10-15_03_14_53-6684777812072406611
2021/10/15 10:14:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-15_03_14_53-6684777812072406611?project=apache-beam-testing
2021/10/15 10:14:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-15_03_14_53-6684777812072406611
2021/10/15 10:14:54 Job state: JOB_STATE_PENDING ...
2021/10/15 10:15:24 Job still running ...
2021/10/15 10:15:54 Job still running ...
2021/10/15 10:16:24 Job still running ...
2021/10/15 10:16:54 Job still running ...
2021/10/15 10:17:24 Job still running ...
2021/10/15 10:17:54 Job still running ...
2021/10/15 10:18:24 Failed to execute job: job 2021-10-15_03_14_53-6684777812072406611 failed
panic: Failed to execute job: job 2021-10-15_03_14_53-6684777812072406611 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1132488, 0xc000120000, 0x102349c, 0x19, 0xc0003cbe90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 3s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/ltduoztikpniq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #300
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/300/display/redirect?page=changes>
Changes:
[Udi Meiri] Release guide: minor updates
[dmitrii_kuzin] [BEAM-12730] Custom delimiter always bytes
[noreply] Minor: Add base_func to Series.aggregate expression names (#15706)
[noreply] [BEAM-13013] Extend cross language expansion. (#15698)
[noreply] Minor: Clarify confusing boolean logic for selecting PerWindowInvoker
[noreply] [BEAM-4424] Execute hooks in enabling order (#15713)
[noreply] [BEAM-11097] Update cache with metrics counting, windowing (#15717)
[kawaigin] Prepare release of apache-beam-jupyterlab-sidepanel v2.0.0
[noreply] [BEAM-12644] Javascript files moved to assets (#15653)
------------------------------------------
[...truncated 18.70 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/14 10:15:00 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1634206499639088743/model
2021/10/14 10:15:00 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1014100237"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634206499639088743/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634206499639088743/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1014100237",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/14 10:15:00 Submitted job: 2021-10-14_03_15_00-6616566462928698526
2021/10/14 10:15:00 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-14_03_15_00-6616566462928698526?project=apache-beam-testing
2021/10/14 10:15:00 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-14_03_15_00-6616566462928698526
2021/10/14 10:15:00 Job state: JOB_STATE_PENDING ...
2021/10/14 10:15:30 Job still running ...
2021/10/14 10:16:01 Job still running ...
2021/10/14 10:16:31 Job still running ...
2021/10/14 10:17:01 Job still running ...
2021/10/14 10:17:31 Job still running ...
2021/10/14 10:18:01 Job still running ...
2021/10/14 10:18:31 Failed to execute job: job 2021-10-14_03_15_00-6616566462928698526 failed
panic: Failed to execute job: job 2021-10-14_03_15_00-6616566462928698526 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1132488, 0xc000120000, 0x102349c, 0x19, 0xc000569e90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 9s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/dju3lshi437dm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #299
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/299/display/redirect?page=changes>
Changes:
[cgray] [BEAM-7169] Fix singleton assertion in PAssert javadoc.
[noreply] Revert "[BEAM-10913] - Forcing update of YAML file by running kubectl
[heejong] Update Dataflow Python container tag
[noreply] Merge pull request #15667 from [BEAM-12730] Add custom delimiters to
[noreply] Merge pull request #15700 from [BEAM-12987] [Playground] Add page UI
[kawaigin] [BEAM-12997] Upgraded labextension to V3
[noreply] [BEAM-12513] Add JIRAs for missing Go SDK features (#15658)
------------------------------------------
[...truncated 18.57 KB...]
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/13 10:14:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1634120093909221675/model
2021/10/13 10:14:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1013100233"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634120093909221675/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634120093909221675/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1013100233",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/13 10:14:54 Submitted job: 2021-10-13_03_14_54-8316024423429012933
2021/10/13 10:14:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-13_03_14_54-8316024423429012933?project=apache-beam-testing
2021/10/13 10:14:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-13_03_14_54-8316024423429012933
2021/10/13 10:14:55 Job state: JOB_STATE_PENDING ...
2021/10/13 10:15:25 Job still running ...
2021/10/13 10:15:55 Job still running ...
2021/10/13 10:16:25 Job still running ...
2021/10/13 10:16:55 Job still running ...
2021/10/13 10:17:25 Job still running ...
2021/10/13 10:17:55 Job still running ...
2021/10/13 10:18:25 Failed to execute job: job 2021-10-13_03_14_54-8316024423429012933 failed
panic: Failed to execute job: job 2021-10-13_03_14_54-8316024423429012933 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1130608, 0xc00003e0b0, 0x1021b2b, 0x19, 0xc0000d1e90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 3s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/ogt3sdf6g6yy4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #298
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/298/display/redirect?page=changes>
Changes:
[rogan.o.morrow] [BEAM-12875] Register file systems in SparkExecutableStageFunction
[rogelio.hernandez] [BEAM-12371][BEAM-12373] Fixed page navigation
[Kyle Weaver] [BEAM-12694] Include datetime in dicom test dataset name.
[noreply] [BEAM-12960] Add extra context for structural DoFn ProcessElement error
[noreply] Release 2.33 documentation update (#15543)
[noreply] Merge pull request #15441 from [BEAM-8823] Make FnApiRunner work by
------------------------------------------
[...truncated 18.62 KB...]
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/12 10:14:55 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1634033695382615436/model
2021/10/12 10:14:55 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1012100233"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634033695382615436/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634033695382615436/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1012100233",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/12 10:14:56 Submitted job: 2021-10-12_03_14_55-10621955306056486143
2021/10/12 10:14:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-12_03_14_55-10621955306056486143?project=apache-beam-testing
2021/10/12 10:14:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-12_03_14_55-10621955306056486143
2021/10/12 10:14:56 Job state: JOB_STATE_PENDING ...
2021/10/12 10:15:26 Job still running ...
2021/10/12 10:15:56 Job still running ...
2021/10/12 10:16:26 Job still running ...
2021/10/12 10:16:56 Job still running ...
2021/10/12 10:17:26 Job still running ...
2021/10/12 10:17:56 Job still running ...
2021/10/12 10:18:26 Failed to execute job: job 2021-10-12_03_14_55-10621955306056486143 failed
panic: Failed to execute job: job 2021-10-12_03_14_55-10621955306056486143 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1130608, 0xc000120000, 0x1021b2b, 0x19, 0xc0003d7e90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 6s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/ojt4oxrct4fyi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #297
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/297/display/redirect>
Changes:
------------------------------------------
[...truncated 18.59 KB...]
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/11 10:14:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633947288559693291/model
2021/10/11 10:14:49 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1011100232"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633947288559693291/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633947288559693291/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1011100232",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/11 10:14:49 Submitted job: 2021-10-11_03_14_49-17494418369599870020
2021/10/11 10:14:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-11_03_14_49-17494418369599870020?project=apache-beam-testing
2021/10/11 10:14:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-11_03_14_49-17494418369599870020
2021/10/11 10:14:49 Job state: JOB_STATE_PENDING ...
2021/10/11 10:15:19 Job still running ...
2021/10/11 10:15:49 Job still running ...
2021/10/11 10:16:19 Job still running ...
2021/10/11 10:16:49 Job still running ...
2021/10/11 10:17:19 Job still running ...
2021/10/11 10:17:49 Job still running ...
2021/10/11 10:18:20 Failed to execute job: job 2021-10-11_03_14_49-17494418369599870020 failed
panic: Failed to execute job: job 2021-10-11_03_14_49-17494418369599870020 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112f4c8, 0xc00003e0b0, 0x1020b2b, 0x19, 0xc000743e90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 59s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/j6cmrtpzp3rfw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #296
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/296/display/redirect>
Changes:
------------------------------------------
[...truncated 18.59 KB...]
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/10 10:14:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633860892812508310/model
2021/10/10 10:14:53 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1010100232"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633860892812508310/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633860892812508310/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1010100232",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/10 10:14:53 Submitted job: 2021-10-10_03_14_53-1848285089768866549
2021/10/10 10:14:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-10_03_14_53-1848285089768866549?project=apache-beam-testing
2021/10/10 10:14:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-10_03_14_53-1848285089768866549
2021/10/10 10:14:53 Job state: JOB_STATE_PENDING ...
2021/10/10 10:15:23 Job still running ...
2021/10/10 10:15:54 Job still running ...
2021/10/10 10:16:24 Job still running ...
2021/10/10 10:16:54 Job still running ...
2021/10/10 10:17:24 Job still running ...
2021/10/10 10:17:54 Job still running ...
2021/10/10 10:18:24 Failed to execute job: job 2021-10-10_03_14_53-1848285089768866549 failed
panic: Failed to execute job: job 2021-10-10_03_14_53-1848285089768866549 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112f4c8, 0xc000120000, 0x1020b2b, 0x19, 0xc00054fe90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 3s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/ctznybr3u6dha
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #295
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/295/display/redirect?page=changes>
Changes:
[noreply] fixing test link
[Brian Hulette] Add DataFrame changes to CHANGES.md
[stranniknm] [BEAM-12964]: add code editor component
[stranniknm] [BEAM-12966]: load initial example on page load
[stranniknm] [BEAM-12964]: fix editor scrolling
[stranniknm] [BEAM-12964]: add dark theme support
[stranniknm] [BEAM-12964]: add licence to example repository file
[stranniknm] [BEAM-12964]: extract playground page providers
[stranniknm] [BEAM-12964]: refactor styles
[noreply] fix linter issues
[Brian Hulette] Don't use run_pytest.sh for pyarrow tests
[Brian Hulette] Fail in run_pytest.sh if -m is specified
[noreply] [BEAM-10913] - Forcing update of YAML file by running kubectl apply
[noreply] [BEAM-10955] Flink Java Runner test flake: Could not find Flink job
[noreply] [BEAM-10114] Bump Pub/Sub Lite version (#15640)
------------------------------------------
[...truncated 18.58 KB...]
key: "c7"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/09 10:15:02 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633774501899372915/model
2021/10/09 10:15:02 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1009100227"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633774501899372915/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633774501899372915/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1009100227",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/09 10:15:02 Submitted job: 2021-10-09_03_15_02-3679661166927364521
2021/10/09 10:15:02 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-09_03_15_02-3679661166927364521?project=apache-beam-testing
2021/10/09 10:15:02 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-09_03_15_02-3679661166927364521
2021/10/09 10:15:03 Job state: JOB_STATE_PENDING ...
2021/10/09 10:15:33 Job still running ...
2021/10/09 10:16:03 Job still running ...
2021/10/09 10:16:33 Job still running ...
2021/10/09 10:17:03 Job still running ...
2021/10/09 10:17:33 Job still running ...
2021/10/09 10:18:03 Failed to execute job: job 2021-10-09_03_15_02-3679661166927364521 failed
panic: Failed to execute job: job 2021-10-09_03_15_02-3679661166927364521 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112f4c8, 0xc000120000, 0x1020b2b, 0x19, 0xc0000c5e90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 42s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/7ka7qd36oqebk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #294
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/294/display/redirect?page=changes>
Changes:
[Udi Meiri] Release script fixes
[noreply] [BEAM-13015] Remove the overhead of SpecMonitoringInfoValidator
[noreply] Minor: Replace generic external.py links in multi-language documentation
[noreply] Revert "[BEAM-12993] Update to Debezium 1.7.0.Final (#15636)"
[kawaigin] Updated screendiff integration test golden screenshots.
[noreply] [BEAM-12769] Few fixes related to Java Class Lookup based cross-language
------------------------------------------
[...truncated 18.55 KB...]
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/08 10:15:03 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633688103124424637/model
2021/10/08 10:15:03 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1008100235"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633688103124424637/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633688103124424637/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1008100235",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/08 10:15:04 Submitted job: 2021-10-08_03_15_03-8737580856611186120
2021/10/08 10:15:04 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-08_03_15_03-8737580856611186120?project=apache-beam-testing
2021/10/08 10:15:04 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-08_03_15_03-8737580856611186120
2021/10/08 10:15:04 Job state: JOB_STATE_PENDING ...
2021/10/08 10:15:34 Job still running ...
2021/10/08 10:16:04 Job still running ...
2021/10/08 10:16:34 Job still running ...
2021/10/08 10:17:04 Job still running ...
2021/10/08 10:17:34 Job still running ...
2021/10/08 10:18:04 Job still running ...
2021/10/08 10:18:34 Failed to execute job: job 2021-10-08_03_15_03-8737580856611186120 failed
panic: Failed to execute job: job 2021-10-08_03_15_03-8737580856611186120 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112f4c8, 0xc000120000, 0x1020b2b, 0x19, 0xc00028de90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 13s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/xjx6kjscicwjq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #293
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/293/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Restore "Default to Runner v2 for Python Streaming jobs. (#15140)"
[stefan.istrate] Fix "too many pings" errors.
[stefan.istrate] Increase keepalive timeout to 5 minutes.
[david.prieto] [BEAM-12950] Not delete orphaned files to avoid missing events
[david.prieto] [BEAM-12950] Add Bug fix description to CHANGES.md
[david.prieto] [BEAM-12950] fix linter issues
[Robert Bradshaw] Dead letter option.
[Robert Bradshaw] Guard setup.py logic with __main__ condition.
[stefan.istrate] Fix yapf complaints.
[Robert Bradshaw] Avoid incompatible setting.
[aydar.zaynutdinov] [BEAM-12969] [Playground]
[david.prieto] [BEAN-12950] Skip unit test
[noreply] [BEAM-12909][BEAM-12849] Add support for running spark3 nexmark queries
[Robert Bradshaw] Add the ability to use subprocesses with the dead letter queue.
[Robert Bradshaw] Support multi-output DoFns.
[noreply] Merge pull request #15510 from [BEAM-12883] Add coder for
[Robert Bradshaw] multi-output fix
[Robert Bradshaw] Add thresholding to dead letter pattern.
[Robert Bradshaw] treshold test fixes
[Robert Bradshaw] Better naming, documentation.
[noreply] [BEAM-12482] Ensure that we ignore schema update options when loading
[Kyle Weaver] Moving to 2.35.0-SNAPSHOT on master branch.
[Kyle Weaver] Add 2.35.0 section to changelog.
[noreply] Fix email links in the contact page
------------------------------------------
[...truncated 18.69 KB...]
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/07 10:14:58 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633601698214226067/model
2021/10/07 10:14:58 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1007100223"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633601698214226067/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633601698214226067/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1007100223",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/07 10:14:59 Submitted job: 2021-10-07_03_14_58-11379875598152859454
2021/10/07 10:14:59 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-07_03_14_58-11379875598152859454?project=apache-beam-testing
2021/10/07 10:14:59 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-07_03_14_58-11379875598152859454
2021/10/07 10:14:59 Job state: JOB_STATE_PENDING ...
2021/10/07 10:15:29 Job still running ...
2021/10/07 10:15:59 Job still running ...
2021/10/07 10:16:29 Job still running ...
2021/10/07 10:16:59 Job still running ...
2021/10/07 10:17:29 Job still running ...
2021/10/07 10:17:59 Job still running ...
2021/10/07 10:18:29 Job still running ...
2021/10/07 10:18:59 Job still running ...
2021/10/07 10:19:29 Job still running ...
2021/10/07 10:19:59 Job still running ...
2021/10/07 10:20:29 Failed to execute job: job 2021-10-07_03_14_58-11379875598152859454 failed
panic: Failed to execute job: job 2021-10-07_03_14_58-11379875598152859454 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112f4c8, 0xc000120000, 0x1020b2b, 0x19, 0xc00056de90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 7s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/qmfk6jn7obhhe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #292
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/292/display/redirect?page=changes>
Changes:
[noreply] Only stage the single (fat) jar when auto-starting expansion service.
[noreply] Disable samza counters (#15659)
[noreply] Merge pull request #15614 from [BEAM-12953] [Playground] Create protobuf
[noreply] [BEAM-11831] Parially Revert "[BEAM-11805] Replace user-agent for
[kawaigin] [BEAM-10708] Enable submit beam_sql built jobs to Dataflow
[noreply] Merge pull request #15602 from [BEAM-10917] Add support for BigQuery
------------------------------------------
[...truncated 18.62 KB...]
key: "c7"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/06 10:15:06 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633515305440908989/model
2021/10/06 10:15:06 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1006100236"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633515305440908989/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633515305440908989/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1006100236",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/06 10:15:06 Submitted job: 2021-10-06_03_15_06-5273847069710689697
2021/10/06 10:15:06 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-06_03_15_06-5273847069710689697?project=apache-beam-testing
2021/10/06 10:15:06 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-06_03_15_06-5273847069710689697
2021/10/06 10:15:06 Job state: JOB_STATE_PENDING ...
2021/10/06 10:15:36 Job still running ...
2021/10/06 10:16:06 Job still running ...
2021/10/06 10:16:36 Job still running ...
2021/10/06 10:17:06 Job still running ...
2021/10/06 10:17:36 Job still running ...
2021/10/06 10:18:07 Failed to execute job: job 2021-10-06_03_15_06-5273847069710689697 failed
panic: Failed to execute job: job 2021-10-06_03_15_06-5273847069710689697 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112f4c8, 0xc00003e0b0, 0x1020b2b, 0x19, 0xc0007a7e90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 43s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/l2xkatsp3eyri
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #291
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/291/display/redirect?page=changes>
Changes:
[danthev] Switch hintNumWorkers to ValueProvider, switch firstInstant to side
[noreply] [BEAM-11516] Upgrade to pylint 2.11.1, fix warnings (#15612)
[noreply] [BEAM-12979, BEAM-11097] Change cache to store ReStreams, clean up to…
[noreply] [BEAM-3304, BEAM-12513] Trigger changes and Windowing. (#15644)
[noreply] Merge pull request #15618 from [BEAM-12968] [Playground] Create README
[noreply] Merge pull request #15626 from [BEAM-12963] [Playground] Create base
[noreply] Merge pull request #15566 from [BEAM-12925] Correct behavior retrieving
[noreply] [BEAM-12911] Update schema translation (Java, Python) to log more
[noreply] Update CHANGES.md for JdbcIO breaking change (#15651)
[noreply] [BEAM-12513] Add Go SDK metrics content to BPG. (#15650)
[noreply] [BEAM-12996] Improve Error Logging in ConfigBuilder (#15646)
[noreply] [BEAM-13000] Disable Reshuffle Translation in Samza Portable Mode
------------------------------------------
[...truncated 18.59 KB...]
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/05 10:14:59 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633428898897840362/model
2021/10/05 10:14:59 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1005100239"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633428898897840362/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633428898897840362/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1005100239",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/05 10:15:00 Submitted job: 2021-10-05_03_14_59-13647526691422203623
2021/10/05 10:15:00 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-05_03_14_59-13647526691422203623?project=apache-beam-testing
2021/10/05 10:15:00 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-05_03_14_59-13647526691422203623
2021/10/05 10:15:00 Job state: JOB_STATE_PENDING ...
2021/10/05 10:15:30 Job still running ...
2021/10/05 10:16:00 Job still running ...
2021/10/05 10:16:30 Job still running ...
2021/10/05 10:17:00 Job still running ...
2021/10/05 10:17:30 Job still running ...
2021/10/05 10:18:00 Job still running ...
2021/10/05 10:18:30 Failed to execute job: job 2021-10-05_03_14_59-13647526691422203623 failed
panic: Failed to execute job: job 2021-10-05_03_14_59-13647526691422203623 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112f4c8, 0xc00003e0b0, 0x1020b2b, 0x19, 0xc0003f3e90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 8s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/ysp24sz22qfl2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #290
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/290/display/redirect>
Changes:
------------------------------------------
[...truncated 18.63 KB...]
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/04 10:14:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633342493056908423/model
2021/10/04 10:14:53 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1004100241"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633342493056908423/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633342493056908423/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1004100241",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/04 10:14:54 Submitted job: 2021-10-04_03_14_53-10068255795266031430
2021/10/04 10:14:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-04_03_14_53-10068255795266031430?project=apache-beam-testing
2021/10/04 10:14:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-04_03_14_53-10068255795266031430
2021/10/04 10:14:54 Job state: JOB_STATE_PENDING ...
2021/10/04 10:15:24 Job still running ...
2021/10/04 10:15:54 Job still running ...
2021/10/04 10:16:24 Job still running ...
2021/10/04 10:16:54 Job still running ...
2021/10/04 10:17:24 Job still running ...
2021/10/04 10:17:54 Job still running ...
2021/10/04 10:18:24 Job still running ...
2021/10/04 10:18:54 Job still running ...
2021/10/04 10:19:24 Job still running ...
2021/10/04 10:19:54 Job still running ...
2021/10/04 10:20:24 Failed to execute job: job 2021-10-04_03_14_53-10068255795266031430 failed
panic: Failed to execute job: job 2021-10-04_03_14_53-10068255795266031430 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112ef28, 0xc000120000, 0x10207cb, 0x19, 0xc0006abe90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 3s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/2i2ij7j76om5k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #289
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/289/display/redirect>
Changes:
------------------------------------------
[...truncated 18.66 KB...]
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/03 12:26:06 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633263966425229674/model
2021/10/03 12:26:06 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1003065433"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633263966425229674/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633263966425229674/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1003065433",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/03 12:26:07 Submitted job: 2021-10-03_05_26_07-12455522714036771645
2021/10/03 12:26:07 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-03_05_26_07-12455522714036771645?project=apache-beam-testing
2021/10/03 12:26:07 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-03_05_26_07-12455522714036771645
2021/10/03 12:26:07 Job state: JOB_STATE_PENDING ...
2021/10/03 12:26:37 Job still running ...
2021/10/03 12:27:07 Job still running ...
2021/10/03 12:27:37 Job still running ...
2021/10/03 12:28:07 Job still running ...
2021/10/03 12:28:37 Job still running ...
2021/10/03 12:29:07 Job still running ...
2021/10/03 12:29:37 Job still running ...
2021/10/03 12:30:07 Job still running ...
2021/10/03 12:30:37 Job still running ...
2021/10/03 12:31:07 Job still running ...
2021/10/03 12:31:38 Failed to execute job: job 2021-10-03_05_26_07-12455522714036771645 failed
panic: Failed to execute job: job 2021-10-03_05_26_07-12455522714036771645 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112ef28, 0xc00003e0b0, 0x10207cb, 0x19, 0xc000377e90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 45s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/3v6awgy235eiu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #288
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/288/display/redirect?page=changes>
Changes:
[noreply] Switching to innerText and removing alerts
[noreply] [BEAM-12993] Update to Debezium 1.7.0.Final (#15636)
[noreply] Minor: Fix `Iterable[SplitResultResidual]` type errors (#15634)
[noreply] [BEAM-11217] Implemented metrics filtering (#15482)
[noreply] [BEAM-12513] Schemas and Coders (#15632)
------------------------------------------
[...truncated 18.63 KB...]
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/02 10:14:59 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633169699095290880/model
2021/10/02 10:14:59 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1002100238"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633169699095290880/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633169699095290880/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1002100238",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/02 10:15:00 Submitted job: 2021-10-02_03_14_59-17974556347700950231
2021/10/02 10:15:00 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-02_03_14_59-17974556347700950231?project=apache-beam-testing
2021/10/02 10:15:00 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-02_03_14_59-17974556347700950231
2021/10/02 10:15:00 Job state: JOB_STATE_PENDING ...
2021/10/02 10:15:30 Job still running ...
2021/10/02 10:16:00 Job still running ...
2021/10/02 10:16:30 Job still running ...
2021/10/02 10:17:00 Job still running ...
2021/10/02 10:17:30 Job still running ...
2021/10/02 10:18:00 Job still running ...
2021/10/02 10:18:30 Job still running ...
2021/10/02 10:19:00 Job still running ...
2021/10/02 10:19:30 Job still running ...
2021/10/02 10:20:00 Job still running ...
2021/10/02 10:20:30 Failed to execute job: job 2021-10-02_03_14_59-17974556347700950231 failed
panic: Failed to execute job: job 2021-10-02_03_14_59-17974556347700950231 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112ef28, 0xc000120000, 0x10207cb, 0x19, 0xc00074be90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 10s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/456zamzcx4fss
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #287
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/287/display/redirect?page=changes>
Changes:
[stranniknm] [BEAM-12951]: Create initial structure for Playground application
[dpcollins] [BEAM-12908] Change to use PubsubSignal for information propagation so
[Robert Bradshaw] Preserve more types in transform replacement.
[rohde.samuel] Fix BEAM-12984
[Robert Bradshaw] Update test to reflect preserved type hint.
[noreply] Update Beam glossary (#15619)
[noreply] [BEAM-11985] Python Bigtable - Implement IO Request Count metrics
[noreply] [BEAM-9918] Make TryCrossLanguage match non Try API (#15633)
[noreply] [BEAM-12957] Add support for pyarrow 5.x (#15588)
------------------------------------------
[...truncated 18.56 KB...]
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/01 10:14:59 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633083299178694037/model
2021/10/01 10:14:59 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-1001100325"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633083299178694037/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633083299178694037/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-1001100325",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/01 10:15:00 Submitted job: 2021-10-01_03_14_59-4932736002893811575
2021/10/01 10:15:00 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-01_03_14_59-4932736002893811575?project=apache-beam-testing
2021/10/01 10:15:00 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-01_03_14_59-4932736002893811575
2021/10/01 10:15:00 Job state: JOB_STATE_PENDING ...
2021/10/01 10:15:30 Job still running ...
2021/10/01 10:16:00 Job still running ...
2021/10/01 10:16:30 Job still running ...
2021/10/01 10:17:00 Job still running ...
2021/10/01 10:17:30 Job still running ...
2021/10/01 10:18:00 Job still running ...
2021/10/01 10:18:30 Failed to execute job: job 2021-10-01_03_14_59-4932736002893811575 failed
panic: Failed to execute job: job 2021-10-01_03_14_59-4932736002893811575 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112da48, 0xc00003e0b0, 0x101f4eb, 0x19, 0xc0004cde90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 8s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/bbqpx3lwxy7gu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #286
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/286/display/redirect?page=changes>
Changes:
[kileysok] Update windmill state map to resolve *IfAbsent methods immediately
[samuelw] [BEAM-12942] Validate pubsub messages before they are published in
[clairem] [BEAM-12628] make useReflectApi default to true
[noreply] [BEAM-12856] Change hard-coded limits for reading from a UnboundedReader
[piotr.szczepanik] [BEAM-12356] Fixed last non-cached usage of DatasetService in BigQuery
[noreply] [BEAM-12977] Translates Reshuffle in Portable Mode with Samza native
[noreply] [BEAM-12982] Help users debug which JvmInitializer is running and when.
------------------------------------------
[...truncated 18.65 KB...]
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/30 10:15:08 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632996908049184477/model
2021/09/30 10:15:08 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0930100218"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632996908049184477/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632996908049184477/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0930100218",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/30 10:15:09 Submitted job: 2021-09-30_03_15_08-9501044413816181319
2021/09/30 10:15:09 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-30_03_15_08-9501044413816181319?project=apache-beam-testing
2021/09/30 10:15:09 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-30_03_15_08-9501044413816181319
2021/09/30 10:15:09 Job state: JOB_STATE_PENDING ...
2021/09/30 10:15:39 Job still running ...
2021/09/30 10:16:09 Job still running ...
2021/09/30 10:16:39 Job still running ...
2021/09/30 10:17:09 Job still running ...
2021/09/30 10:17:39 Job still running ...
2021/09/30 10:18:09 Job still running ...
2021/09/30 10:18:39 Job still running ...
2021/09/30 10:19:09 Job still running ...
2021/09/30 10:19:39 Failed to execute job: job 2021-09-30_03_15_08-9501044413816181319 failed
panic: Failed to execute job: job 2021-09-30_03_15_08-9501044413816181319 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112da48, 0xc00003e0b0, 0x101f4eb, 0x19, 0xc00030be90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 18s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/25bhkut2copvs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #285
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/285/display/redirect?page=changes>
Changes:
[chamikaramj] Sets the correct coder in 'ConstantTableDestinations' when using BQ
[Luke Cwik] [BEAM-12974] Migrate off of deprecated package for MockitoJUnitRunner
[noreply] [BEAM-12593] Verify DataFrame API on pandas 1.3 (with container update)
[noreply] [BEAM-12973] Print Go Test and Script info. (#15604)
[noreply] [BEAM-10913] - Installing and persisting Grafana plugin in kubernetes
[noreply] [BEAM-11129] Add namespace and key to portable display data (#15564)
[noreply] [BEAM-12906] Add a `dataframe` extra for installing a pandas version
------------------------------------------
[...truncated 18.62 KB...]
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/29 10:14:52 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632910492043642877/model
2021/09/29 10:14:52 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0929100228"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632910492043642877/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632910492043642877/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0929100228",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/29 10:14:53 Submitted job: 2021-09-29_03_14_52-2597070331041050965
2021/09/29 10:14:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-29_03_14_52-2597070331041050965?project=apache-beam-testing
2021/09/29 10:14:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-29_03_14_52-2597070331041050965
2021/09/29 10:14:53 Job state: JOB_STATE_PENDING ...
2021/09/29 10:15:23 Job still running ...
2021/09/29 10:15:53 Job still running ...
2021/09/29 10:16:23 Job still running ...
2021/09/29 10:16:53 Job still running ...
2021/09/29 10:17:23 Job still running ...
2021/09/29 10:17:53 Job still running ...
2021/09/29 10:18:23 Failed to execute job: job 2021-09-29_03_14_52-2597070331041050965 failed
panic: Failed to execute job: job 2021-09-29_03_14_52-2597070331041050965 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112da48, 0xc00003e0b0, 0x101f4eb, 0x19, 0xc00017be90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 2s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/7b4sqwdjqmoqa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #284
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/284/display/redirect?page=changes>
Changes:
[Andrew Pilloud] [BEAM-12691] FieldAccessDescriptor for BeamCalcRel
[aydar.zaynutdinov] Init basic go backend structure
[noreply] Update container tags used by unreleased SDKs.
[aydar.zaynutdinov] Add .gitkeep file as an exclusion
[yileiyang] Remove encoding= from the json.loads call.
[noreply] [BEAM-12798] Add configurable combiner packing limit (#15391)
[noreply] [BEAM-12926] Translates Reshuffle with Samza native repartition operator
[noreply] [BEAM-11007] Allow nbconvert 6.x (#15595)
[noreply] [BEAM-12945] Fix crashes when importing the DataFrame API with pandas
[noreply] [BEAM-12611] Capture a greater proporition of logs associated to an
------------------------------------------
[...truncated 18.78 KB...]
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/28 10:14:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632824091234841036/model
2021/09/28 10:14:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0928100235"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632824091234841036/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632824091234841036/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0928100235",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/28 10:14:52 Submitted job: 2021-09-28_03_14_51-12239362074817790330
2021/09/28 10:14:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-28_03_14_51-12239362074817790330?project=apache-beam-testing
2021/09/28 10:14:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-28_03_14_51-12239362074817790330
2021/09/28 10:14:52 Job state: JOB_STATE_PENDING ...
2021/09/28 10:15:22 Job still running ...
2021/09/28 10:15:52 Job still running ...
2021/09/28 10:16:22 Job still running ...
2021/09/28 10:16:52 Job still running ...
2021/09/28 10:17:22 Job still running ...
2021/09/28 10:17:52 Job still running ...
2021/09/28 10:18:22 Job still running ...
2021/09/28 10:18:52 Job still running ...
2021/09/28 10:19:23 Job still running ...
2021/09/28 10:19:53 Job still running ...
2021/09/28 10:20:23 Job still running ...
2021/09/28 10:20:53 Failed to execute job: job 2021-09-28_03_14_51-12239362074817790330 failed
panic: Failed to execute job: job 2021-09-28_03_14_51-12239362074817790330 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112da48, 0xc00003e0b0, 0x101f4eb, 0x19, 0xc00015be90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 32s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/64x6odjaij3be
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #283
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/283/display/redirect>
Changes:
------------------------------------------
[...truncated 18.57 KB...]
key: "c7"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/27 10:14:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632737684344403875/model
2021/09/27 10:14:44 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0927100230"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632737684344403875/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632737684344403875/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0927100230",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/27 10:14:45 Submitted job: 2021-09-27_03_14_44-12632640178185396865
2021/09/27 10:14:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-27_03_14_44-12632640178185396865?project=apache-beam-testing
2021/09/27 10:14:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-27_03_14_44-12632640178185396865
2021/09/27 10:14:45 Job state: JOB_STATE_PENDING ...
2021/09/27 10:15:16 Job still running ...
2021/09/27 10:15:46 Job still running ...
2021/09/27 10:16:16 Job still running ...
2021/09/27 10:16:46 Job still running ...
2021/09/27 10:17:16 Job still running ...
2021/09/27 10:17:46 Failed to execute job: job 2021-09-27_03_14_44-12632640178185396865 failed
panic: Failed to execute job: job 2021-09-27_03_14_44-12632640178185396865 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112da48, 0xc000120000, 0x101f4eb, 0x19, 0xc0004dfe90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 26s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/4jhlqsdevzl4w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #282
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/282/display/redirect>
Changes:
------------------------------------------
[...truncated 18.70 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/26 10:14:50 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632651290437387039/model
2021/09/26 10:14:50 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0926100233"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632651290437387039/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632651290437387039/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0926100233",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/26 10:14:51 Submitted job: 2021-09-26_03_14_50-17446458796208637902
2021/09/26 10:14:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-26_03_14_50-17446458796208637902?project=apache-beam-testing
2021/09/26 10:14:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-26_03_14_50-17446458796208637902
2021/09/26 10:14:51 Job state: JOB_STATE_PENDING ...
2021/09/26 10:15:21 Job still running ...
2021/09/26 10:15:51 Job still running ...
2021/09/26 10:16:21 Job still running ...
2021/09/26 10:16:51 Job still running ...
2021/09/26 10:17:21 Job still running ...
2021/09/26 10:17:51 Job still running ...
2021/09/26 10:18:21 Job still running ...
2021/09/26 10:18:51 Job still running ...
2021/09/26 10:19:21 Job still running ...
2021/09/26 10:19:52 Job still running ...
2021/09/26 10:20:22 Job still running ...
2021/09/26 10:20:52 Job still running ...
2021/09/26 10:21:22 Failed to execute job: job 2021-09-26_03_14_50-17446458796208637902 failed
panic: Failed to execute job: job 2021-09-26_03_14_50-17446458796208637902 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112da48, 0xc00003e0b0, 0x101f4eb, 0x19, 0xc000747e90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 2s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/ihgo6jlpfi4zc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #281
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/281/display/redirect?page=changes>
Changes:
[Robert Bradshaw] [BEAM-12934] Use environment capabilities to determine length prefixing.
[Brian Hulette] Add missing comma
[ryanthompson591] Update tensorflow to version 2.6.0
[zhoufek] [BEAM-9487] Fix incorrected Repeatedly.may_finish implementation
[noreply] Cleanup use of futures. (#15043)
[noreply] Go Lint fix for wordcount and metrics (#15580)
[Brian Hulette] Fix whitespace lint
[noreply] [BEAM-3304] Snippets for trigger in BPG (#15409)
[noreply] [BEAM-12832] Add Go SDK xlang info to programming guide. (#15447)
[noreply] [BEAM-11097] Add SideInputCache to StateReader (#15563)
[Robert Bradshaw] Revert "Avoid apiary submission of job graph when it is not needed.
[noreply] [BEAM-12769] Java-emulating external transform. (#15546)
[noreply] [BEAM-12913] Pass query priority from ReadAllFromBigQuery (#15584)
[noreply] [BEAM-11982] Java Spanner - Implement IO Request Count metrics (#15493)
------------------------------------------
[...truncated 18.58 KB...]
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/25 10:14:59 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632564898846520917/model
2021/09/25 10:14:59 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0925100225"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632564898846520917/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632564898846520917/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0925100225",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/25 10:15:00 Submitted job: 2021-09-25_03_14_59-9215081892095291392
2021/09/25 10:15:00 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-25_03_14_59-9215081892095291392?project=apache-beam-testing
2021/09/25 10:15:00 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-25_03_14_59-9215081892095291392
2021/09/25 10:15:00 Job state: JOB_STATE_PENDING ...
2021/09/25 10:15:30 Job still running ...
2021/09/25 10:16:00 Job still running ...
2021/09/25 10:16:30 Job still running ...
2021/09/25 10:17:00 Job still running ...
2021/09/25 10:17:30 Job still running ...
2021/09/25 10:18:00 Job still running ...
2021/09/25 10:18:30 Failed to execute job: job 2021-09-25_03_14_59-9215081892095291392 failed
panic: Failed to execute job: job 2021-09-25_03_14_59-9215081892095291392 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112da48, 0xc00003e0b0, 0x101f4eb, 0x19, 0xc0005ffe90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 10s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/o3lexyxvzpohc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #280
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/280/display/redirect?page=changes>
Changes:
[noreply] Avoid setting empty builders in proto setters
[Brian Hulette] Add back 'more' break
[Robert Bradshaw] Fix some website logos.
[chuck.yang] Run BigQuery queries with batch priority
[chuck.yang] Allow changing query priority in ReadFromBigQuery
[chuck.yang] Update CHANGES
[kawaigin] Implicitly watch and track anonymous pipeline and PCollections
[chamikaramj] Reject requests when parameter names cannot be validated unless
[chamikaramj] Updates error message
[alexander.chermenin] [BEAM-10822] Fixed typo in BigqueryClient
[zyichi] [BEAM-12898] Minor fix to Kubernetes.groovy postBuildScript.
[noreply] [BEAM-12869] Bump tensorflow from 2.5.0 to 2.5.1 in
[noreply] [BEAM-12946] Fix SmallestPerKey, add unit testing (#15567)
[zyichi] [BEAM-12908] Sickbay pubsublite.ReadWriteIT
[noreply] Relocate Go SDK breaking change note out of template into 2.33.0.
------------------------------------------
[...truncated 18.56 KB...]
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/24 10:14:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632478493805664133/model
2021/09/24 10:14:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0924100247"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632478493805664133/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632478493805664133/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0924100247",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/24 10:14:55 Submitted job: 2021-09-24_03_14_54-2141170064937261968
2021/09/24 10:14:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-24_03_14_54-2141170064937261968?project=apache-beam-testing
2021/09/24 10:14:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-24_03_14_54-2141170064937261968
2021/09/24 10:14:55 Job state: JOB_STATE_PENDING ...
2021/09/24 10:15:25 Job still running ...
2021/09/24 10:15:55 Job still running ...
2021/09/24 10:16:25 Job still running ...
2021/09/24 10:16:55 Job still running ...
2021/09/24 10:17:25 Job still running ...
2021/09/24 10:17:55 Job still running ...
2021/09/24 10:18:25 Failed to execute job: job 2021-09-24_03_14_54-2141170064937261968 failed
panic: Failed to execute job: job 2021-09-24_03_14_54-2141170064937261968 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112bfc8, 0xc00003e0b0, 0x101dd2b, 0x19, 0xc00025fe90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 3s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/wndooen6rio6m
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #279
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/279/display/redirect?page=changes>
Changes:
[kileysok] Add MapState and SetState support
[Kyle Weaver] [BEAM-12898] Use new postbuildscript dsl in Flink load tests
[Kyle Weaver] run postbuild regardless of test result
[Kyle Weaver] spotless
[noreply] Merge pull request #15487 from [BEAM-12812] - Run Github Actions on GCP
[noreply] [BEAM-11097] Add SideInputCache to harness control type (#15530)
[kawaigin] Updated interactive integration test golden screenshots.
[noreply] Revert PR 15487 (BEAM-12812) (#15554)
[zyichi] [BEAM-12898] Trying out solution suggestion for JENKINS-66189 to solve
[noreply] [BEAM-12383] Adding Go SDK and Kafka IO to Gradle cross-language test
------------------------------------------
[...truncated 18.60 KB...]
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/23 10:14:55 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632392094780523264/model
2021/09/23 10:14:55 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0923100242"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632392094780523264/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632392094780523264/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0923100242",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/23 10:14:55 Submitted job: 2021-09-23_03_14_55-16495929890236561344
2021/09/23 10:14:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-23_03_14_55-16495929890236561344?project=apache-beam-testing
2021/09/23 10:14:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-23_03_14_55-16495929890236561344
2021/09/23 10:14:56 Job state: JOB_STATE_PENDING ...
2021/09/23 10:15:26 Job still running ...
2021/09/23 10:15:56 Job still running ...
2021/09/23 10:16:26 Job still running ...
2021/09/23 10:16:56 Job still running ...
2021/09/23 10:17:26 Job still running ...
2021/09/23 10:17:56 Job still running ...
2021/09/23 10:18:26 Failed to execute job: job 2021-09-23_03_14_55-16495929890236561344 failed
panic: Failed to execute job: job 2021-09-23_03_14_55-16495929890236561344 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112bfc8, 0xc000120000, 0x101dd2b, 0x19, 0xc000419e90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 5s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/5k5pylleglnzs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #278
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/278/display/redirect?page=changes>
Changes:
[noreply] [BEAM-12919] Removed IBM Streams from runner matrix (#15542)
[danthev] Fix 2.32.0 release notes.
[noreply] [BEAM-12258] Re-throw exception from forked thread in
[kawaigin] [BEAM-10708] Added an example notebook for beam_sql magic
[noreply] Add a timeout for BQ streaming_insert RPCS (#15541)
[noreply] Merge pull request #15537 from [BEAM-12908] Add a sleep to the IT after
------------------------------------------
[...truncated 18.56 KB...]
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/22 10:14:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632305691151627075/model
2021/09/22 10:14:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0922100234"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632305691151627075/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632305691151627075/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0922100234",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/22 10:14:52 Submitted job: 2021-09-22_03_14_51-13304742772650192199
2021/09/22 10:14:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-22_03_14_51-13304742772650192199?project=apache-beam-testing
2021/09/22 10:14:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-22_03_14_51-13304742772650192199
2021/09/22 10:14:52 Job state: JOB_STATE_PENDING ...
2021/09/22 10:15:22 Job still running ...
2021/09/22 10:15:52 Job still running ...
2021/09/22 10:16:22 Job still running ...
2021/09/22 10:16:52 Job still running ...
2021/09/22 10:17:22 Job still running ...
2021/09/22 10:17:52 Job still running ...
2021/09/22 10:18:22 Failed to execute job: job 2021-09-22_03_14_51-13304742772650192199 failed
panic: Failed to execute job: job 2021-09-22_03_14_51-13304742772650192199 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112af68, 0xc00003e0b0, 0x101d16b, 0x19, 0xc000771e90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 2s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/k5dzki2cr25wa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #277
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/277/display/redirect?page=changes>
Changes:
[chamikaramj] Python support for directly using Java transforms using constructor and
[chamikaramj] Fixes yapf
[chamikaramj] Fixes lint
[chamikaramj] Addressing reviewer comments
[chamikaramj] Adds support for a field name format that will be ignored at expansion
[danthev] Fix flaky test.
[danthev] Fix lint errors.
[Robert Bradshaw] Additional CoGBK tests.
[chamikaramj] Addresses reviewer comments
[chamikaramj] Use correct ignore field prefix in Python side
[noreply] [BEAM-12803] Update deprecated use of _field_types (#15539)
[Robert Bradshaw] Move CoGBK tests into appropreate module.
------------------------------------------
[...truncated 18.66 KB...]
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/21 10:14:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632219291387343253/model
2021/09/21 10:14:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0921100223"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632219291387343253/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632219291387343253/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0921100223",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/21 10:14:52 Submitted job: 2021-09-21_03_14_51-2325768703425270816
2021/09/21 10:14:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-21_03_14_51-2325768703425270816?project=apache-beam-testing
2021/09/21 10:14:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-21_03_14_51-2325768703425270816
2021/09/21 10:14:52 Job state: JOB_STATE_PENDING ...
2021/09/21 10:15:22 Job still running ...
2021/09/21 10:15:52 Job still running ...
2021/09/21 10:16:22 Job still running ...
2021/09/21 10:16:52 Job still running ...
2021/09/21 10:17:22 Job still running ...
2021/09/21 10:17:52 Job still running ...
2021/09/21 10:18:22 Failed to execute job: job 2021-09-21_03_14_51-2325768703425270816 failed
panic: Failed to execute job: job 2021-09-21_03_14_51-2325768703425270816 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112af68, 0xc000120000, 0x101d16b, 0x19, 0xc000223e90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 2s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/aa54vhlla66ly
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #276
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/276/display/redirect>
Changes:
------------------------------------------
[...truncated 18.65 KB...]
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/20 10:14:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632132891022523376/model
2021/09/20 10:14:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0920100233"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632132891022523376/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632132891022523376/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0920100233",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/20 10:14:52 Submitted job: 2021-09-20_03_14_51-4011957598317438524
2021/09/20 10:14:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-20_03_14_51-4011957598317438524?project=apache-beam-testing
2021/09/20 10:14:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-20_03_14_51-4011957598317438524
2021/09/20 10:14:52 Job state: JOB_STATE_PENDING ...
2021/09/20 10:15:22 Job still running ...
2021/09/20 10:15:52 Job still running ...
2021/09/20 10:16:22 Job still running ...
2021/09/20 10:16:52 Job still running ...
2021/09/20 10:17:22 Job still running ...
2021/09/20 10:17:52 Job still running ...
2021/09/20 10:18:22 Job still running ...
2021/09/20 10:18:52 Job still running ...
2021/09/20 10:19:22 Job still running ...
2021/09/20 10:19:52 Job still running ...
2021/09/20 10:20:23 Failed to execute job: job 2021-09-20_03_14_51-4011957598317438524 failed
panic: Failed to execute job: job 2021-09-20_03_14_51-4011957598317438524 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112af68, 0xc000120000, 0x101d16b, 0x19, 0xc000353e90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 2s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/nt5blgtb2udma
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #275
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/275/display/redirect>
Changes:
------------------------------------------
[...truncated 18.65 KB...]
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/19 10:14:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632046488824779595/model
2021/09/19 10:14:49 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0919100217"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632046488824779595/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632046488824779595/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0919100217",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/19 10:14:50 Submitted job: 2021-09-19_03_14_49-16936482384479556770
2021/09/19 10:14:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-19_03_14_49-16936482384479556770?project=apache-beam-testing
2021/09/19 10:14:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-19_03_14_49-16936482384479556770
2021/09/19 10:14:50 Job state: JOB_STATE_PENDING ...
2021/09/19 10:15:20 Job still running ...
2021/09/19 10:15:50 Job still running ...
2021/09/19 10:16:20 Job still running ...
2021/09/19 10:16:50 Job still running ...
2021/09/19 10:17:20 Job still running ...
2021/09/19 10:17:50 Job still running ...
2021/09/19 10:18:20 Job still running ...
2021/09/19 10:18:50 Job still running ...
2021/09/19 10:19:20 Job still running ...
2021/09/19 10:19:50 Job still running ...
2021/09/19 10:20:20 Failed to execute job: job 2021-09-19_03_14_49-16936482384479556770 failed
panic: Failed to execute job: job 2021-09-19_03_14_49-16936482384479556770 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112af68, 0xc000120000, 0x101d16b, 0x19, 0xc00064fe90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 0s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/2upijurqbatcu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #274
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/274/display/redirect?page=changes>
Changes:
[samuelw] [BEAM-12740] Add option to CreateOptions to avoid GetObjectMetadata for
[noreply] Minor: Prune docker volumes in Inventory job(#15532)
------------------------------------------
[...truncated 18.59 KB...]
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/18 10:14:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1631960089439152261/model
2021/09/18 10:14:49 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0918100221"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631960089439152261/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631960089439152261/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0918100221",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/18 10:14:50 Submitted job: 2021-09-18_03_14_49-3800078183650630155
2021/09/18 10:14:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-18_03_14_49-3800078183650630155?project=apache-beam-testing
2021/09/18 10:14:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-18_03_14_49-3800078183650630155
2021/09/18 10:14:50 Job state: JOB_STATE_PENDING ...
2021/09/18 10:15:20 Job still running ...
2021/09/18 10:15:50 Job still running ...
2021/09/18 10:16:20 Job still running ...
2021/09/18 10:16:50 Job still running ...
2021/09/18 10:17:20 Job still running ...
2021/09/18 10:17:50 Job still running ...
2021/09/18 10:18:21 Failed to execute job: job 2021-09-18_03_14_49-3800078183650630155 failed
panic: Failed to execute job: job 2021-09-18_03_14_49-3800078183650630155 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112af68, 0xc00003e0b0, 0x101d16b, 0x19, 0xc0001f1e90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 1s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/4g5idctemiodi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #273
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/273/display/redirect?page=changes>
Changes:
[randomstep] [BEAM-12899] Upgrade Gradle to version 6.9.x
[noreply] [BEAM-12701] Added extra parameter in to_csv for DeferredFrame to name
[zyichi] [BEAM-12603] Add retries to FnApiRunnerTest due to flakiness of grpc
[noreply] [BEAM-12535] add dataframes notebook (#15470)
------------------------------------------
[...truncated 18.59 KB...]
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/17 10:14:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1631873691081638876/model
2021/09/17 10:14:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-gbk-1-0917100236"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631873691081638876/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631873691081638876/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0917100236",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/17 10:14:52 Submitted job: 2021-09-17_03_14_51-17039440326096640464
2021/09/17 10:14:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-17_03_14_51-17039440326096640464?project=apache-beam-testing
2021/09/17 10:14:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-17_03_14_51-17039440326096640464
2021/09/17 10:14:52 Job state: JOB_STATE_PENDING ...
2021/09/17 10:15:22 Job still running ...
2021/09/17 10:15:52 Job still running ...
2021/09/17 10:16:22 Job still running ...
2021/09/17 10:16:52 Job still running ...
2021/09/17 10:17:22 Job still running ...
2021/09/17 10:17:52 Job still running ...
2021/09/17 10:18:22 Failed to execute job: job 2021-09-17_03_14_51-17039440326096640464 failed
panic: Failed to execute job: job 2021-09-17_03_14_51-17039440326096640464 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112af68, 0xc00003e0b0, 0x101d16b, 0x19, 0xc000435e90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 2s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/i7wzi3gwt7f3m
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #272
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/272/display/redirect?page=changes>
Changes:
[noreply] [BEAM-12153] revert "implement GroupByKey with CombinePerKey with
[noreply] [BEAM-12845] Add AWS services as a runtime dependency to Spark Job
[dpcollins] [BEAM-12882] - fix test that is flaky when jenkins is overloaded
[noreply] [BEAM-12885] Enable NeedsRunner Tests for Samza Portable Runner (#15512)
[noreply] [BEAM-12100][BEAM-10379][BEAM-9514][BEAM-12647][BEAM-12099]
[noreply] [BEAM-12543] Fix DataFrrame typo (#15509)
[noreply] [BEAM-12794] Remove obsolete uses of sys.exc_info. (#15507)
[noreply] [BEAM-11666] flake on RecordingManagerTest (#15118)
[kawaigin] [BEAM-10708] Introspect beam_sql output
[noreply] Minor: Restore "Bugfix" section in CHANGES.md (#15516)
[Kyle Weaver] [BEAM-10459] Unignore numeric aggregation tests.
[ajamato] [BEAM-12898] Disable Flink Load tests which are leading Dataproc
------------------------------------------
[...truncated 21.94 KB...]
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631787290087238066/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631787290087238066/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0916100227",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/16 10:14:51 Submitted job: 2021-09-16_03_14_50-18015145324729365182
2021/09/16 10:14:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-16_03_14_50-18015145324729365182?project=apache-beam-testing
2021/09/16 10:14:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-16_03_14_50-18015145324729365182
2021/09/16 10:14:51 Job state: JOB_STATE_PENDING ...
2021/09/16 10:15:21 Job still running ...
2021/09/16 10:15:51 Job still running ...
2021/09/16 10:16:21 Job still running ...
2021/09/16 10:16:51 Job still running ...
2021/09/16 10:17:21 Job still running ...
2021/09/16 10:17:51 Job still running ...
2021/09/16 10:18:21 Job still running ...
2021/09/16 10:18:51 Job still running ...
2021/09/16 10:19:21 Job still running ...
2021/09/16 10:19:51 Job still running ...
2021/09/16 10:20:21 Job still running ...
2021/09/16 10:20:51 Job still running ...
2021/09/16 10:21:21 Job still running ...
2021/09/16 10:21:51 Job still running ...
2021/09/16 10:22:22 Job still running ...
2021/09/16 10:22:52 Job still running ...
2021/09/16 10:23:22 Job still running ...
2021/09/16 10:23:52 Job still running ...
2021/09/16 10:24:22 Job still running ...
2021/09/16 10:24:52 Job still running ...
2021/09/16 10:25:22 Job still running ...
2021/09/16 10:25:52 Job still running ...
2021/09/16 10:26:22 Job still running ...
2021/09/16 10:26:52 Job still running ...
2021/09/16 10:27:22 Job still running ...
2021/09/16 10:27:52 Job still running ...
2021/09/16 10:28:22 Job still running ...
2021/09/16 10:28:52 Job still running ...
2021/09/16 10:29:22 Job still running ...
2021/09/16 10:29:52 Job still running ...
2021/09/16 10:30:22 Job still running ...
2021/09/16 10:30:52 Job still running ...
2021/09/16 10:31:22 Job still running ...
2021/09/16 10:31:52 Job still running ...
2021/09/16 10:32:22 Job still running ...
2021/09/16 10:32:52 Job still running ...
2021/09/16 10:33:23 Job still running ...
2021/09/16 10:33:53 Job still running ...
2021/09/16 10:34:23 Job still running ...
2021/09/16 10:34:53 Job still running ...
2021/09/16 10:35:23 Job still running ...
2021/09/16 10:35:53 Job still running ...
2021/09/16 10:36:23 Job still running ...
2021/09/16 10:36:53 Job still running ...
2021/09/16 10:37:23 Job still running ...
2021/09/16 10:37:53 Job still running ...
2021/09/16 10:38:23 Job still running ...
2021/09/16 10:38:53 Job still running ...
2021/09/16 10:39:23 Job still running ...
2021/09/16 10:39:53 Job still running ...
2021/09/16 10:40:23 Job still running ...
2021/09/16 10:40:53 Job still running ...
2021/09/16 10:41:23 Job still running ...
2021/09/16 10:41:53 Job still running ...
2021/09/16 10:42:24 Job still running ...
2021/09/16 10:42:54 Job still running ...
2021/09/16 10:43:24 Job still running ...
2021/09/16 10:43:54 Job still running ...
2021/09/16 10:44:24 Job still running ...
2021/09/16 10:44:54 Job still running ...
2021/09/16 10:45:24 Job still running ...
2021/09/16 10:45:54 Job still running ...
2021/09/16 10:46:24 Job still running ...
2021/09/16 10:46:54 Job still running ...
2021/09/16 10:47:24 Job still running ...
2021/09/16 10:47:54 Job still running ...
2021/09/16 10:48:24 Job still running ...
2021/09/16 10:48:54 Job still running ...
2021/09/16 10:49:24 Job still running ...
2021/09/16 10:49:54 Job still running ...
2021/09/16 10:50:24 Job still running ...
2021/09/16 10:50:54 Job still running ...
2021/09/16 10:51:24 Job still running ...
2021/09/16 10:51:54 Job still running ...
2021/09/16 10:52:24 Job still running ...
2021/09/16 10:52:54 Job still running ...
2021/09/16 10:53:25 Job still running ...
2021/09/16 10:53:55 Job still running ...
2021/09/16 10:54:25 Job still running ...
2021/09/16 10:54:55 Job still running ...
2021/09/16 10:55:25 Job still running ...
2021/09/16 10:55:55 Job still running ...
2021/09/16 10:56:25 Job still running ...
2021/09/16 10:56:55 Job still running ...
2021/09/16 10:57:25 Job still running ...
2021/09/16 10:57:55 Job still running ...
2021/09/16 10:58:25 Job still running ...
2021/09/16 10:58:55 Job still running ...
2021/09/16 10:59:25 Job still running ...
2021/09/16 10:59:55 Job still running ...
2021/09/16 11:00:25 Job still running ...
2021/09/16 11:00:55 Job still running ...
2021/09/16 11:01:25 Job still running ...
2021/09/16 11:01:55 Job still running ...
2021/09/16 11:02:25 Job still running ...
2021/09/16 11:02:55 Job still running ...
2021/09/16 11:03:25 Job still running ...
2021/09/16 11:03:55 Job still running ...
2021/09/16 11:04:26 Job still running ...
2021/09/16 11:04:56 Job still running ...
2021/09/16 11:05:26 Job still running ...
2021/09/16 11:05:56 Job still running ...
2021/09/16 11:06:26 Job still running ...
2021/09/16 11:06:56 Job still running ...
2021/09/16 11:07:26 Job still running ...
2021/09/16 11:07:56 Job still running ...
2021/09/16 11:08:26 Job still running ...
2021/09/16 11:08:56 Job still running ...
2021/09/16 11:09:26 Job still running ...
2021/09/16 11:09:56 Job still running ...
2021/09/16 11:10:26 Job still running ...
2021/09/16 11:10:56 Job still running ...
2021/09/16 11:11:26 Job still running ...
2021/09/16 11:11:56 Job still running ...
2021/09/16 11:12:26 Job still running ...
2021/09/16 11:12:57 Job still running ...
2021/09/16 11:13:27 Job still running ...
2021/09/16 11:13:57 Job still running ...
2021/09/16 11:14:27 Job still running ...
2021/09/16 11:14:57 Job still running ...
2021/09/16 11:15:27 Job still running ...
2021/09/16 11:15:57 Job still running ...
2021/09/16 11:16:27 Job still running ...
2021/09/16 11:16:57 Job still running ...
2021/09/16 11:17:27 Job still running ...
2021/09/16 11:17:57 Failed to execute job: job 2021-09-16_03_14_50-18015145324729365182 failed
panic: Failed to execute job: job 2021-09-16_03_14_50-18015145324729365182 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112af68, 0xc00003e0b0, 0x101d16b, 0x19, 0xc0002d3e90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 3m 36s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/wbvwzta2k5e2i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #271
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/271/display/redirect?page=changes>
Changes:
[dhuntsperger] updated Maven-to-Gradle conversion step in Java quickstart
[noreply] [BEAM-10913] - Updating Grafana from v6.7.3 to v8.1.2 (#15503)
[noreply] [BEAM-12876] Adding doc and glossary entry for resource hints (#15499)
------------------------------------------
[...truncated 22.01 KB...]
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631700891081737782/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631700891081737782/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0915100223",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/15 10:14:52 Submitted job: 2021-09-15_03_14_51-16444585382999734980
2021/09/15 10:14:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-15_03_14_51-16444585382999734980?project=apache-beam-testing
2021/09/15 10:14:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-15_03_14_51-16444585382999734980
2021/09/15 10:14:52 Job state: JOB_STATE_PENDING ...
2021/09/15 10:15:22 Job still running ...
2021/09/15 10:15:52 Job still running ...
2021/09/15 10:16:22 Job still running ...
2021/09/15 10:16:52 Job still running ...
2021/09/15 10:17:22 Job still running ...
2021/09/15 10:17:52 Job still running ...
2021/09/15 10:18:22 Job still running ...
2021/09/15 10:18:53 Job still running ...
2021/09/15 10:19:23 Job still running ...
2021/09/15 10:19:53 Job still running ...
2021/09/15 10:20:23 Job still running ...
2021/09/15 10:20:53 Job still running ...
2021/09/15 10:21:23 Job still running ...
2021/09/15 10:21:53 Job still running ...
2021/09/15 10:22:23 Job still running ...
2021/09/15 10:22:53 Job still running ...
2021/09/15 10:23:23 Job still running ...
2021/09/15 10:23:53 Job still running ...
2021/09/15 10:24:23 Job still running ...
2021/09/15 10:24:53 Job still running ...
2021/09/15 10:25:23 Job still running ...
2021/09/15 10:25:53 Job still running ...
2021/09/15 10:26:23 Job still running ...
2021/09/15 10:26:53 Job still running ...
2021/09/15 10:27:23 Job still running ...
2021/09/15 10:27:53 Job still running ...
2021/09/15 10:28:23 Job still running ...
2021/09/15 10:28:54 Job still running ...
2021/09/15 10:29:24 Job still running ...
2021/09/15 10:29:54 Job still running ...
2021/09/15 10:30:24 Job still running ...
2021/09/15 10:30:54 Job still running ...
2021/09/15 10:31:24 Job still running ...
2021/09/15 10:31:54 Job still running ...
2021/09/15 10:32:24 Job still running ...
2021/09/15 10:32:54 Job still running ...
2021/09/15 10:33:24 Job still running ...
2021/09/15 10:33:54 Job still running ...
2021/09/15 10:34:24 Job still running ...
2021/09/15 10:34:54 Job still running ...
2021/09/15 10:35:24 Job still running ...
2021/09/15 10:35:54 Job still running ...
2021/09/15 10:36:24 Job still running ...
2021/09/15 10:36:54 Job still running ...
2021/09/15 10:37:24 Job still running ...
2021/09/15 10:37:54 Job still running ...
2021/09/15 10:38:24 Job still running ...
2021/09/15 10:38:54 Job still running ...
2021/09/15 10:39:24 Job still running ...
2021/09/15 10:39:55 Job still running ...
2021/09/15 10:40:25 Job still running ...
2021/09/15 10:40:55 Job still running ...
2021/09/15 10:41:25 Job still running ...
2021/09/15 10:41:55 Job still running ...
2021/09/15 10:42:25 Job still running ...
2021/09/15 10:42:55 Job still running ...
2021/09/15 10:43:25 Job still running ...
2021/09/15 10:43:55 Job still running ...
2021/09/15 10:44:25 Job still running ...
2021/09/15 10:44:55 Job still running ...
2021/09/15 10:45:25 Job still running ...
2021/09/15 10:45:55 Job still running ...
2021/09/15 10:46:25 Job still running ...
2021/09/15 10:46:55 Job still running ...
2021/09/15 10:47:25 Job still running ...
2021/09/15 10:47:55 Job still running ...
2021/09/15 10:48:25 Job still running ...
2021/09/15 10:48:55 Job still running ...
2021/09/15 10:49:25 Job still running ...
2021/09/15 10:49:56 Job still running ...
2021/09/15 10:50:26 Job still running ...
2021/09/15 10:50:56 Job still running ...
2021/09/15 10:51:26 Job still running ...
2021/09/15 10:51:56 Job still running ...
2021/09/15 10:52:26 Job still running ...
2021/09/15 10:52:56 Job still running ...
2021/09/15 10:53:26 Job still running ...
2021/09/15 10:53:56 Job still running ...
2021/09/15 10:54:26 Job still running ...
2021/09/15 10:54:56 Job still running ...
2021/09/15 10:55:26 Job still running ...
2021/09/15 10:55:56 Job still running ...
2021/09/15 10:56:26 Job still running ...
2021/09/15 10:56:56 Job still running ...
2021/09/15 10:57:26 Job still running ...
2021/09/15 10:57:56 Job still running ...
2021/09/15 10:58:26 Job still running ...
2021/09/15 10:58:56 Job still running ...
2021/09/15 10:59:26 Job still running ...
2021/09/15 10:59:56 Job still running ...
2021/09/15 11:00:26 Job still running ...
2021/09/15 11:00:57 Job still running ...
2021/09/15 11:01:27 Job still running ...
2021/09/15 11:01:57 Job still running ...
2021/09/15 11:02:27 Job still running ...
2021/09/15 11:02:57 Job still running ...
2021/09/15 11:03:27 Job still running ...
2021/09/15 11:03:57 Job still running ...
2021/09/15 11:04:27 Job still running ...
2021/09/15 11:04:57 Job still running ...
2021/09/15 11:05:27 Job still running ...
2021/09/15 11:05:57 Job still running ...
2021/09/15 11:06:27 Job still running ...
2021/09/15 11:06:57 Job still running ...
2021/09/15 11:07:27 Job still running ...
2021/09/15 11:07:57 Job still running ...
2021/09/15 11:08:27 Job still running ...
2021/09/15 11:08:57 Job still running ...
2021/09/15 11:09:27 Job still running ...
2021/09/15 11:09:57 Job still running ...
2021/09/15 11:10:27 Job still running ...
2021/09/15 11:10:57 Job still running ...
2021/09/15 11:11:28 Job still running ...
2021/09/15 11:11:58 Job still running ...
2021/09/15 11:12:28 Job still running ...
2021/09/15 11:12:58 Job still running ...
2021/09/15 11:13:28 Job still running ...
2021/09/15 11:13:58 Job still running ...
2021/09/15 11:14:28 Job still running ...
2021/09/15 11:14:58 Job still running ...
2021/09/15 11:15:28 Job still running ...
2021/09/15 11:15:58 Job still running ...
2021/09/15 11:16:28 Job still running ...
2021/09/15 11:16:58 Job still running ...
2021/09/15 11:17:28 Job still running ...
2021/09/15 11:17:58 Failed to execute job: job 2021-09-15_03_14_51-16444585382999734980 failed
panic: Failed to execute job: job 2021-09-15_03_14_51-16444585382999734980 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112af68, 0xc00003e0b0, 0x101d16b, 0x19, 0xc0003fbe90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 3m 38s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/67esnlf2zeqgo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #270
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/270/display/redirect?page=changes>
Changes:
[rohde.samuel] [BEAM-12842] Add timestamp to test work item to deflake
[dhuntsperger] fixed broken Python tab on HCatalog IO page
[suztomo] [BEAM-12873] HL7v2IO: to leave schematizedData null, not empty
[noreply] Avoid apiary submission of job graph when it is not needed. (#15458)
[noreply] [BEAM-7261] Add support for BasicSessionCredentials for AWS credentials.
[noreply] Bump dataflow java container version to beam-master-20210913 (#15506)
[noreply] [BEAM-11980] Java GCS - Implement IO Request Count metrics (#15394)
------------------------------------------
[...truncated 21.97 KB...]
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631614490283052585/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631614490283052585/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0914100245",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/14 10:14:51 Submitted job: 2021-09-14_03_14_50-1463620514682681026
2021/09/14 10:14:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-14_03_14_50-1463620514682681026?project=apache-beam-testing
2021/09/14 10:14:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-14_03_14_50-1463620514682681026
2021/09/14 10:14:51 Job state: JOB_STATE_PENDING ...
2021/09/14 10:15:21 Job still running ...
2021/09/14 10:15:51 Job still running ...
2021/09/14 10:16:21 Job still running ...
2021/09/14 10:16:51 Job still running ...
2021/09/14 10:17:21 Job still running ...
2021/09/14 10:17:52 Job still running ...
2021/09/14 10:18:22 Job still running ...
2021/09/14 10:18:52 Job still running ...
2021/09/14 10:19:22 Job still running ...
2021/09/14 10:19:52 Job still running ...
2021/09/14 10:20:22 Job still running ...
2021/09/14 10:20:52 Job still running ...
2021/09/14 10:21:22 Job still running ...
2021/09/14 10:21:52 Job still running ...
2021/09/14 10:22:22 Job still running ...
2021/09/14 10:22:52 Job still running ...
2021/09/14 10:23:22 Job still running ...
2021/09/14 10:23:52 Job still running ...
2021/09/14 10:24:22 Job still running ...
2021/09/14 10:24:52 Job still running ...
2021/09/14 10:25:22 Job still running ...
2021/09/14 10:25:52 Job still running ...
2021/09/14 10:26:22 Job still running ...
2021/09/14 10:26:52 Job still running ...
2021/09/14 10:27:22 Job still running ...
2021/09/14 10:27:52 Job still running ...
2021/09/14 10:28:22 Job still running ...
2021/09/14 10:28:52 Job still running ...
2021/09/14 10:29:22 Job still running ...
2021/09/14 10:29:52 Job still running ...
2021/09/14 10:30:22 Job still running ...
2021/09/14 10:30:53 Job still running ...
2021/09/14 10:31:23 Job still running ...
2021/09/14 10:31:53 Job still running ...
2021/09/14 10:32:23 Job still running ...
2021/09/14 10:32:53 Job still running ...
2021/09/14 10:33:23 Job still running ...
2021/09/14 10:33:53 Job still running ...
2021/09/14 10:34:23 Job still running ...
2021/09/14 10:34:53 Job still running ...
2021/09/14 10:35:23 Job still running ...
2021/09/14 10:35:53 Job still running ...
2021/09/14 10:36:23 Job still running ...
2021/09/14 10:36:53 Job still running ...
2021/09/14 10:37:23 Job still running ...
2021/09/14 10:37:53 Job still running ...
2021/09/14 10:38:23 Job still running ...
2021/09/14 10:38:53 Job still running ...
2021/09/14 10:39:23 Job still running ...
2021/09/14 10:39:53 Job still running ...
2021/09/14 10:40:23 Job still running ...
2021/09/14 10:40:53 Job still running ...
2021/09/14 10:41:23 Job still running ...
2021/09/14 10:41:54 Job still running ...
2021/09/14 10:42:24 Job still running ...
2021/09/14 10:42:54 Job still running ...
2021/09/14 10:43:24 Job still running ...
2021/09/14 10:43:54 Job still running ...
2021/09/14 10:44:24 Job still running ...
2021/09/14 10:44:54 Job still running ...
2021/09/14 10:45:24 Job still running ...
2021/09/14 10:45:54 Job still running ...
2021/09/14 10:46:24 Job still running ...
2021/09/14 10:46:54 Job still running ...
2021/09/14 10:47:24 Job still running ...
2021/09/14 10:47:54 Job still running ...
2021/09/14 10:48:24 Job still running ...
2021/09/14 10:48:54 Job still running ...
2021/09/14 10:49:24 Job still running ...
2021/09/14 10:49:54 Job still running ...
2021/09/14 10:50:24 Job still running ...
2021/09/14 10:50:54 Job still running ...
2021/09/14 10:51:24 Job still running ...
2021/09/14 10:51:54 Job still running ...
2021/09/14 10:52:24 Job still running ...
2021/09/14 10:52:54 Job still running ...
2021/09/14 10:53:24 Job still running ...
2021/09/14 10:53:55 Job still running ...
2021/09/14 10:54:25 Job still running ...
2021/09/14 10:54:55 Job still running ...
2021/09/14 10:55:25 Job still running ...
2021/09/14 10:55:55 Job still running ...
2021/09/14 10:56:25 Job still running ...
2021/09/14 10:56:55 Job still running ...
2021/09/14 10:57:25 Job still running ...
2021/09/14 10:57:55 Job still running ...
2021/09/14 10:58:25 Job still running ...
2021/09/14 10:58:55 Job still running ...
2021/09/14 10:59:25 Job still running ...
2021/09/14 10:59:55 Job still running ...
2021/09/14 11:00:25 Job still running ...
2021/09/14 11:00:55 Job still running ...
2021/09/14 11:01:25 Job still running ...
2021/09/14 11:01:55 Job still running ...
2021/09/14 11:02:25 Job still running ...
2021/09/14 11:02:55 Job still running ...
2021/09/14 11:03:25 Job still running ...
2021/09/14 11:03:55 Job still running ...
2021/09/14 11:04:25 Job still running ...
2021/09/14 11:04:55 Job still running ...
2021/09/14 11:05:25 Job still running ...
2021/09/14 11:05:56 Job still running ...
2021/09/14 11:06:26 Job still running ...
2021/09/14 11:06:56 Job still running ...
2021/09/14 11:07:26 Job still running ...
2021/09/14 11:07:56 Job still running ...
2021/09/14 11:08:26 Job still running ...
2021/09/14 11:08:56 Job still running ...
2021/09/14 11:09:26 Job still running ...
2021/09/14 11:09:56 Job still running ...
2021/09/14 11:10:26 Job still running ...
2021/09/14 11:10:56 Job still running ...
2021/09/14 11:11:26 Job still running ...
2021/09/14 11:11:56 Job still running ...
2021/09/14 11:12:26 Job still running ...
2021/09/14 11:12:56 Job still running ...
2021/09/14 11:13:26 Job still running ...
2021/09/14 11:13:56 Job still running ...
2021/09/14 11:14:26 Job still running ...
2021/09/14 11:14:56 Job still running ...
2021/09/14 11:15:26 Job still running ...
2021/09/14 11:15:56 Job still running ...
2021/09/14 11:16:26 Job still running ...
2021/09/14 11:16:57 Job still running ...
2021/09/14 11:17:27 Job still running ...
2021/09/14 11:17:57 Failed to execute job: job 2021-09-14_03_14_50-1463620514682681026 failed
panic: Failed to execute job: job 2021-09-14_03_14_50-1463620514682681026 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112af68, 0xc00003e0b0, 0x101d16b, 0x19, 0xc00033be90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 3m 36s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/ur5h2fmqmwsdm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #269
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/269/display/redirect>
Changes:
------------------------------------------
[...truncated 22.04 KB...]
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631528090915864317/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631528090915864317/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0913100226",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/13 10:14:52 Submitted job: 2021-09-13_03_14_51-6337685986032390711
2021/09/13 10:14:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-13_03_14_51-6337685986032390711?project=apache-beam-testing
2021/09/13 10:14:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-13_03_14_51-6337685986032390711
2021/09/13 10:14:52 Job state: JOB_STATE_PENDING ...
2021/09/13 10:15:22 Job still running ...
2021/09/13 10:15:52 Job still running ...
2021/09/13 10:16:23 Job still running ...
2021/09/13 10:16:53 Job still running ...
2021/09/13 10:17:23 Job still running ...
2021/09/13 10:17:53 Job still running ...
2021/09/13 10:18:23 Job still running ...
2021/09/13 10:18:53 Job still running ...
2021/09/13 10:19:23 Job still running ...
2021/09/13 10:19:53 Job still running ...
2021/09/13 10:20:23 Job still running ...
2021/09/13 10:20:53 Job still running ...
2021/09/13 10:21:23 Job still running ...
2021/09/13 10:21:53 Job still running ...
2021/09/13 10:22:23 Job still running ...
2021/09/13 10:22:53 Job still running ...
2021/09/13 10:23:23 Job still running ...
2021/09/13 10:23:54 Job still running ...
2021/09/13 10:24:24 Job still running ...
2021/09/13 10:24:54 Job still running ...
2021/09/13 10:25:24 Job still running ...
2021/09/13 10:25:54 Job still running ...
2021/09/13 10:26:24 Job still running ...
2021/09/13 10:26:54 Job still running ...
2021/09/13 10:27:24 Job still running ...
2021/09/13 10:27:54 Job still running ...
2021/09/13 10:28:24 Job still running ...
2021/09/13 10:28:54 Job still running ...
2021/09/13 10:29:24 Job still running ...
2021/09/13 10:29:54 Job still running ...
2021/09/13 10:30:24 Job still running ...
2021/09/13 10:30:54 Job still running ...
2021/09/13 10:31:25 Job still running ...
2021/09/13 10:31:55 Job still running ...
2021/09/13 10:32:25 Job still running ...
2021/09/13 10:32:55 Job still running ...
2021/09/13 10:33:25 Job still running ...
2021/09/13 10:33:55 Job still running ...
2021/09/13 10:34:25 Job still running ...
2021/09/13 10:34:55 Job still running ...
2021/09/13 10:35:25 Job still running ...
2021/09/13 10:35:55 Job still running ...
2021/09/13 10:36:25 Job still running ...
2021/09/13 10:36:56 Job still running ...
2021/09/13 10:37:26 Job still running ...
2021/09/13 10:37:56 Job still running ...
2021/09/13 10:38:26 Job still running ...
2021/09/13 10:38:56 Job still running ...
2021/09/13 10:39:26 Job still running ...
2021/09/13 10:39:56 Job still running ...
2021/09/13 10:40:26 Job still running ...
2021/09/13 10:40:56 Job still running ...
2021/09/13 10:41:26 Job still running ...
2021/09/13 10:41:56 Job still running ...
2021/09/13 10:42:26 Job still running ...
2021/09/13 10:42:56 Job still running ...
2021/09/13 10:43:26 Job still running ...
2021/09/13 10:43:56 Job still running ...
2021/09/13 10:44:26 Job still running ...
2021/09/13 10:44:56 Job still running ...
2021/09/13 10:45:27 Job still running ...
2021/09/13 10:45:57 Job still running ...
2021/09/13 10:46:27 Job still running ...
2021/09/13 10:46:57 Job still running ...
2021/09/13 10:47:27 Job still running ...
2021/09/13 10:47:57 Job still running ...
2021/09/13 10:48:27 Job still running ...
2021/09/13 10:48:57 Job still running ...
2021/09/13 10:49:27 Job still running ...
2021/09/13 10:49:57 Job still running ...
2021/09/13 10:50:27 Job still running ...
2021/09/13 10:50:57 Job still running ...
2021/09/13 10:51:27 Job still running ...
2021/09/13 10:51:58 Job still running ...
2021/09/13 10:52:28 Job still running ...
2021/09/13 10:52:58 Job still running ...
2021/09/13 10:53:28 Job still running ...
2021/09/13 10:53:58 Job still running ...
2021/09/13 10:54:28 Job still running ...
2021/09/13 10:54:58 Job still running ...
2021/09/13 10:55:28 Job still running ...
2021/09/13 10:55:59 Job still running ...
2021/09/13 10:56:29 Job still running ...
2021/09/13 10:56:59 Job still running ...
2021/09/13 10:57:29 Job still running ...
2021/09/13 10:57:59 Job still running ...
2021/09/13 10:58:29 Job still running ...
2021/09/13 10:58:59 Job still running ...
2021/09/13 10:59:29 Job still running ...
2021/09/13 10:59:59 Job still running ...
2021/09/13 11:00:29 Job still running ...
2021/09/13 11:00:59 Job still running ...
2021/09/13 11:01:29 Job still running ...
2021/09/13 11:01:59 Job still running ...
2021/09/13 11:02:29 Job still running ...
2021/09/13 11:02:59 Job still running ...
2021/09/13 11:03:29 Job still running ...
2021/09/13 11:03:59 Job still running ...
2021/09/13 11:04:30 Job still running ...
2021/09/13 11:05:00 Job still running ...
2021/09/13 11:05:30 Job still running ...
2021/09/13 11:06:00 Job still running ...
2021/09/13 11:06:30 Job still running ...
2021/09/13 11:07:00 Job still running ...
2021/09/13 11:07:30 Job still running ...
2021/09/13 11:08:00 Job still running ...
2021/09/13 11:08:30 Job still running ...
2021/09/13 11:09:00 Job still running ...
2021/09/13 11:09:30 Job still running ...
2021/09/13 11:10:00 Job still running ...
2021/09/13 11:10:30 Job still running ...
2021/09/13 11:11:00 Job still running ...
2021/09/13 11:11:30 Job still running ...
2021/09/13 11:12:00 Job still running ...
2021/09/13 11:12:31 Job still running ...
2021/09/13 11:13:01 Job still running ...
2021/09/13 11:13:31 Job still running ...
2021/09/13 11:14:02 Job still running ...
2021/09/13 11:14:32 Job still running ...
2021/09/13 11:15:02 Job still running ...
2021/09/13 11:15:32 Job still running ...
2021/09/13 11:16:02 Job still running ...
2021/09/13 11:16:32 Job still running ...
2021/09/13 11:17:02 Job still running ...
2021/09/13 11:17:32 Job still running ...
2021/09/13 11:18:02 Job still running ...
2021/09/13 11:18:33 Failed to execute job: job 2021-09-13_03_14_51-6337685986032390711 failed
panic: Failed to execute job: job 2021-09-13_03_14_51-6337685986032390711 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112af68, 0xc000120000, 0x101d16b, 0x19, 0xc0000cfe90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 4m 12s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/bkermd3y7dmrm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #268
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/268/display/redirect>
Changes:
------------------------------------------
[...truncated 22.05 KB...]
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_gbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631441692888396437/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631441692888396437/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0912100229",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/12 10:14:54 Submitted job: 2021-09-12_03_14_53-5157486105996988544
2021/09/12 10:14:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-12_03_14_53-5157486105996988544?project=apache-beam-testing
2021/09/12 10:14:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-12_03_14_53-5157486105996988544
2021/09/12 10:14:54 Job state: JOB_STATE_PENDING ...
2021/09/12 10:15:24 Job still running ...
2021/09/12 10:15:54 Job still running ...
2021/09/12 10:16:24 Job still running ...
2021/09/12 10:16:54 Job still running ...
2021/09/12 10:17:24 Job still running ...
2021/09/12 10:17:54 Job still running ...
2021/09/12 10:18:25 Job still running ...
2021/09/12 10:18:55 Job still running ...
2021/09/12 10:19:25 Job still running ...
2021/09/12 10:19:55 Job still running ...
2021/09/12 10:20:25 Job still running ...
2021/09/12 10:20:55 Job still running ...
2021/09/12 10:21:25 Job still running ...
2021/09/12 10:21:55 Job still running ...
2021/09/12 10:22:25 Job still running ...
2021/09/12 10:22:55 Job still running ...
2021/09/12 10:23:25 Job still running ...
2021/09/12 10:23:56 Job still running ...
2021/09/12 10:24:26 Job still running ...
2021/09/12 10:24:56 Job still running ...
2021/09/12 10:25:26 Job still running ...
2021/09/12 10:25:56 Job still running ...
2021/09/12 10:26:26 Job still running ...
2021/09/12 10:26:56 Job still running ...
2021/09/12 10:27:26 Job still running ...
2021/09/12 10:27:56 Job still running ...
2021/09/12 10:28:26 Job still running ...
2021/09/12 10:28:56 Job still running ...
2021/09/12 10:29:26 Job still running ...
2021/09/12 10:29:56 Job still running ...
2021/09/12 10:30:26 Job still running ...
2021/09/12 10:30:56 Job still running ...
2021/09/12 10:31:26 Job still running ...
2021/09/12 10:31:56 Job still running ...
2021/09/12 10:32:27 Job still running ...
2021/09/12 10:32:57 Job still running ...
2021/09/12 10:33:27 Job still running ...
2021/09/12 10:33:57 Job still running ...
2021/09/12 10:34:27 Job still running ...
2021/09/12 10:34:57 Job still running ...
2021/09/12 10:35:27 Job still running ...
2021/09/12 10:35:57 Job still running ...
2021/09/12 10:36:27 Job still running ...
2021/09/12 10:36:57 Job still running ...
2021/09/12 10:37:27 Job still running ...
2021/09/12 10:37:57 Job still running ...
2021/09/12 10:38:27 Job still running ...
2021/09/12 10:38:57 Job still running ...
2021/09/12 10:39:27 Job still running ...
2021/09/12 10:39:57 Job still running ...
2021/09/12 10:40:27 Job still running ...
2021/09/12 10:40:58 Job still running ...
2021/09/12 10:41:28 Job still running ...
2021/09/12 10:41:58 Job still running ...
2021/09/12 10:42:28 Job still running ...
2021/09/12 10:42:58 Job still running ...
2021/09/12 10:43:28 Job still running ...
2021/09/12 10:43:58 Job still running ...
2021/09/12 10:44:28 Job still running ...
2021/09/12 10:44:58 Job still running ...
2021/09/12 10:45:28 Job still running ...
2021/09/12 10:45:58 Job still running ...
2021/09/12 10:46:28 Job still running ...
2021/09/12 10:46:58 Job still running ...
2021/09/12 10:47:28 Job still running ...
2021/09/12 10:47:58 Job still running ...
2021/09/12 10:48:28 Job still running ...
2021/09/12 10:48:59 Job still running ...
2021/09/12 10:49:29 Job still running ...
2021/09/12 10:49:59 Job still running ...
2021/09/12 10:50:29 Job still running ...
2021/09/12 10:50:59 Job still running ...
2021/09/12 10:51:29 Job still running ...
2021/09/12 10:51:59 Job still running ...
2021/09/12 10:52:29 Job still running ...
2021/09/12 10:52:59 Job still running ...
2021/09/12 10:53:29 Job still running ...
2021/09/12 10:53:59 Job still running ...
2021/09/12 10:54:29 Job still running ...
2021/09/12 10:54:59 Job still running ...
2021/09/12 10:55:30 Job still running ...
2021/09/12 10:56:00 Job still running ...
2021/09/12 10:56:30 Job still running ...
2021/09/12 10:57:00 Job still running ...
2021/09/12 10:57:30 Job still running ...
2021/09/12 10:58:00 Job still running ...
2021/09/12 10:58:30 Job still running ...
2021/09/12 10:59:00 Job still running ...
2021/09/12 10:59:30 Job still running ...
2021/09/12 11:00:00 Job still running ...
2021/09/12 11:00:30 Job still running ...
2021/09/12 11:01:00 Job still running ...
2021/09/12 11:01:30 Job still running ...
2021/09/12 11:02:00 Job still running ...
2021/09/12 11:02:31 Job still running ...
2021/09/12 11:03:01 Job still running ...
2021/09/12 11:03:31 Job still running ...
2021/09/12 11:04:01 Job still running ...
2021/09/12 11:04:31 Job still running ...
2021/09/12 11:05:01 Job still running ...
2021/09/12 11:05:31 Job still running ...
2021/09/12 11:06:01 Job still running ...
2021/09/12 11:06:31 Job still running ...
2021/09/12 11:07:01 Job still running ...
2021/09/12 11:07:31 Job still running ...
2021/09/12 11:08:01 Job still running ...
2021/09/12 11:08:31 Job still running ...
2021/09/12 11:09:01 Job still running ...
2021/09/12 11:09:31 Job still running ...
2021/09/12 11:10:01 Job still running ...
2021/09/12 11:10:31 Job still running ...
2021/09/12 11:11:02 Job still running ...
2021/09/12 11:11:32 Job still running ...
2021/09/12 11:12:02 Job still running ...
2021/09/12 11:12:32 Job still running ...
2021/09/12 11:13:02 Job still running ...
2021/09/12 11:13:32 Job still running ...
2021/09/12 11:14:02 Job still running ...
2021/09/12 11:14:32 Job still running ...
2021/09/12 11:15:02 Job still running ...
2021/09/12 11:15:32 Job still running ...
2021/09/12 11:16:02 Job still running ...
2021/09/12 11:16:32 Job still running ...
2021/09/12 11:17:02 Job still running ...
2021/09/12 11:17:32 Job still running ...
2021/09/12 11:18:02 Failed to execute job: job 2021-09-12_03_14_53-5157486105996988544 failed
panic: Failed to execute job: job 2021-09-12_03_14_53-5157486105996988544 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112af68, 0xc00003e0b0, 0x101d16b, 0x19, 0xc0005efe90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 3m 42s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/ir5pv6pm44dk4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #267
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/267/display/redirect?page=changes>
Changes:
[noreply] Register MapCoder, some comments/cleanup. (#15471)
[noreply] [BEAM-12588] Multimap user state proto changes (#15473)
[noreply] Added type annotations to some combiners missing it. (#15414)
[noreply] [BEAM-12634] JmsIO auto scaling feature (#15464)
[noreply] [BEAM-12662] Get Flink version from cluster. (#15223)
[noreply] Port changes from Pub/Sub Lite to beam (#15418)
[heejong] [BEAM-12805] Fix XLang CombinePerKey test by explicitly assigning the
[BenWhitehead] [BEAM-8376] Google Cloud Firestore Connector - Add handling for
[noreply] Decreasing peak memory usage for beam.TupleCombineFn (#15494)
[noreply] [BEAM-12802] Add support for prefetch through data layers down through
[noreply] [BEAM-11097] Add implementation of side input cache (#15483)
------------------------------------------
[...truncated 22.04 KB...]
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/group_by_key"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "fanout",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631355294082558581/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"fanout": "1",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_gbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
"iterations": "1",
"****_binary": "linux_amd64/group_by_key"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631355294082558581/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-gbk-1-0911100233",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/11 10:14:56 Submitted job: 2021-09-11_03_14_54-4223297648253554247
2021/09/11 10:14:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-11_03_14_54-4223297648253554247?project=apache-beam-testing
2021/09/11 10:14:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-11_03_14_54-4223297648253554247
2021/09/11 10:14:56 Job state: JOB_STATE_PENDING ...
2021/09/11 10:15:26 Job still running ...
2021/09/11 10:15:56 Job still running ...
2021/09/11 10:16:26 Job still running ...
2021/09/11 10:16:56 Job still running ...
2021/09/11 10:17:26 Job still running ...
2021/09/11 10:17:56 Job still running ...
2021/09/11 10:18:26 Job still running ...
2021/09/11 10:18:56 Job still running ...
2021/09/11 10:19:26 Job still running ...
2021/09/11 10:19:56 Job still running ...
2021/09/11 10:20:26 Job still running ...
2021/09/11 10:20:56 Job still running ...
2021/09/11 10:21:27 Job still running ...
2021/09/11 10:21:57 Job still running ...
2021/09/11 10:22:27 Job still running ...
2021/09/11 10:22:57 Job still running ...
2021/09/11 10:23:27 Job still running ...
2021/09/11 10:23:57 Job still running ...
2021/09/11 10:24:27 Job still running ...
2021/09/11 10:24:57 Job still running ...
2021/09/11 10:25:27 Job still running ...
2021/09/11 10:25:57 Job still running ...
2021/09/11 10:26:27 Job still running ...
2021/09/11 10:26:57 Job still running ...
2021/09/11 10:27:27 Job still running ...
2021/09/11 10:27:57 Job still running ...
2021/09/11 10:28:27 Job still running ...
2021/09/11 10:28:57 Job still running ...
2021/09/11 10:29:27 Job still running ...
2021/09/11 10:29:57 Job still running ...
2021/09/11 10:30:27 Job still running ...
2021/09/11 10:30:57 Job still running ...
2021/09/11 10:31:28 Job still running ...
2021/09/11 10:31:58 Job still running ...
2021/09/11 10:32:28 Job still running ...
2021/09/11 10:32:58 Job still running ...
2021/09/11 10:33:28 Job still running ...
2021/09/11 10:33:58 Job still running ...
2021/09/11 10:34:28 Job still running ...
2021/09/11 10:34:58 Job still running ...
2021/09/11 10:35:28 Job still running ...
2021/09/11 10:35:58 Job still running ...
2021/09/11 10:36:28 Job still running ...
2021/09/11 10:36:58 Job still running ...
2021/09/11 10:37:28 Job still running ...
2021/09/11 10:37:58 Job still running ...
2021/09/11 10:38:28 Job still running ...
2021/09/11 10:38:58 Job still running ...
2021/09/11 10:39:29 Job still running ...
2021/09/11 10:39:59 Job still running ...
2021/09/11 10:40:29 Job still running ...
2021/09/11 10:40:59 Job still running ...
2021/09/11 10:41:29 Job still running ...
2021/09/11 10:41:59 Job still running ...
2021/09/11 10:42:29 Job still running ...
2021/09/11 10:42:59 Job still running ...
2021/09/11 10:43:29 Job still running ...
2021/09/11 10:43:59 Job still running ...
2021/09/11 10:44:29 Job still running ...
2021/09/11 10:44:59 Job still running ...
2021/09/11 10:45:29 Job still running ...
2021/09/11 10:45:59 Job still running ...
2021/09/11 10:46:30 Job still running ...
2021/09/11 10:47:00 Job still running ...
2021/09/11 10:47:30 Job still running ...
2021/09/11 10:48:00 Job still running ...
2021/09/11 10:48:30 Job still running ...
2021/09/11 10:49:00 Job still running ...
2021/09/11 10:49:30 Job still running ...
2021/09/11 10:50:00 Job still running ...
2021/09/11 10:50:30 Job still running ...
2021/09/11 10:51:00 Job still running ...
2021/09/11 10:51:30 Job still running ...
2021/09/11 10:52:00 Job still running ...
2021/09/11 10:52:30 Job still running ...
2021/09/11 10:53:00 Job still running ...
2021/09/11 10:53:31 Job still running ...
2021/09/11 10:54:01 Job still running ...
2021/09/11 10:54:31 Job still running ...
2021/09/11 10:55:01 Job still running ...
2021/09/11 10:55:31 Job still running ...
2021/09/11 10:56:01 Job still running ...
2021/09/11 10:56:31 Job still running ...
2021/09/11 10:57:01 Job still running ...
2021/09/11 10:57:31 Job still running ...
2021/09/11 10:58:01 Job still running ...
2021/09/11 10:58:31 Job still running ...
2021/09/11 10:59:01 Job still running ...
2021/09/11 10:59:31 Job still running ...
2021/09/11 11:00:01 Job still running ...
2021/09/11 11:00:31 Job still running ...
2021/09/11 11:01:01 Job still running ...
2021/09/11 11:01:31 Job still running ...
2021/09/11 11:02:02 Job still running ...
2021/09/11 11:02:32 Job still running ...
2021/09/11 11:03:02 Job still running ...
2021/09/11 11:03:32 Job still running ...
2021/09/11 11:04:02 Job still running ...
2021/09/11 11:04:32 Job still running ...
2021/09/11 11:05:02 Job still running ...
2021/09/11 11:05:32 Job still running ...
2021/09/11 11:06:02 Job still running ...
2021/09/11 11:06:32 Job still running ...
2021/09/11 11:07:02 Job still running ...
2021/09/11 11:07:32 Job still running ...
2021/09/11 11:08:02 Job still running ...
2021/09/11 11:08:32 Job still running ...
2021/09/11 11:09:02 Job still running ...
2021/09/11 11:09:32 Job still running ...
2021/09/11 11:10:02 Job still running ...
2021/09/11 11:10:33 Job still running ...
2021/09/11 11:11:03 Job still running ...
2021/09/11 11:11:33 Job still running ...
2021/09/11 11:12:03 Job still running ...
2021/09/11 11:12:33 Job still running ...
2021/09/11 11:13:03 Job still running ...
2021/09/11 11:13:33 Job still running ...
2021/09/11 11:14:03 Job still running ...
2021/09/11 11:14:33 Job still running ...
2021/09/11 11:15:03 Job still running ...
2021/09/11 11:15:33 Job still running ...
2021/09/11 11:16:03 Job still running ...
2021/09/11 11:16:33 Job still running ...
2021/09/11 11:17:03 Job still running ...
2021/09/11 11:17:33 Job still running ...
2021/09/11 11:18:03 Failed to execute job: job 2021-09-11_03_14_54-4223297648253554247 failed
panic: Failed to execute job: job 2021-09-11_03_14_54-4223297648253554247 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112af68, 0xc00003e0b0, 0x101d16b, 0x19, 0xc0003dfe90, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x425
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 3m 42s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/ys6znq7qpggpo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org