You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/08/27 10:03:21 UTC
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#251
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/251/display/redirect?page=changes>
Changes:
[Ahmet Altay] Clean unused methods out of apiclient.py
[Ahmet Altay] fix
[Ahmet Altay] lint
[Ahmet Altay] fix
[baeminbo] [BEAM-12751] Set clientRequestId for Dataflow python job creation
[Ankur Goenka] Add a blogpost for Apache Beam 2.32.0
[Ankur Goenka] Updating date for beam 2.32.0 blog post
[Ankur Goenka] Fixing author name
[Kyle Weaver] [BEAM-12320] Sickbay testSQLSelectsArrayAttributes.
[noreply] [BEAM-12742] SamzaTimerInternalsFactory#deleteTimer(TimerData) does not
[Daniel Oliveira] [GoSDK Infra] Bugfix: Parallelism ignored when using endpoint flag.
[noreply] Merge pull request #15183 from [BEAM-11983] Java Datastore - Implement
[noreply] Merge pull request #15328 from [BEAM-11987] Python Datastore - Implement
------------------------------------------
[...truncated 29.71 KB...]
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1630054812536751046/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1630054812536751046/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0827065615",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/08/27 09:00:13 Submitted job: 2021-08-27_02_00_13-14418015941483443352
2021/08/27 09:00:13 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-08-27_02_00_13-14418015941483443352?project=apache-beam-testing
2021/08/27 09:00:13 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-08-27_02_00_13-14418015941483443352
2021/08/27 09:00:13 Job state: JOB_STATE_PENDING ...
2021/08/27 09:00:44 Job still running ...
2021/08/27 09:01:14 Job still running ...
2021/08/27 09:01:44 Job still running ...
2021/08/27 09:02:14 Job still running ...
2021/08/27 09:02:44 Job still running ...
2021/08/27 09:03:14 Job still running ...
2021/08/27 09:03:44 Job still running ...
2021/08/27 09:04:14 Job still running ...
2021/08/27 09:04:44 Job still running ...
2021/08/27 09:05:14 Job still running ...
2021/08/27 09:05:44 Job still running ...
2021/08/27 09:06:14 Job still running ...
2021/08/27 09:06:44 Job still running ...
2021/08/27 09:07:14 Job still running ...
2021/08/27 09:07:44 Job still running ...
2021/08/27 09:08:14 Job still running ...
2021/08/27 09:08:44 Job still running ...
2021/08/27 09:09:14 Job still running ...
2021/08/27 09:09:44 Job still running ...
2021/08/27 09:10:14 Job still running ...
2021/08/27 09:10:44 Job still running ...
2021/08/27 09:11:15 Job still running ...
2021/08/27 09:11:45 Job still running ...
2021/08/27 09:12:15 Job still running ...
2021/08/27 09:12:45 Job still running ...
2021/08/27 09:13:15 Job still running ...
2021/08/27 09:13:45 Job still running ...
2021/08/27 09:14:15 Job still running ...
2021/08/27 09:14:45 Job still running ...
2021/08/27 09:15:15 Job still running ...
2021/08/27 09:15:45 Job still running ...
2021/08/27 09:16:15 Job still running ...
2021/08/27 09:16:45 Job still running ...
2021/08/27 09:17:15 Job still running ...
2021/08/27 09:17:45 Job still running ...
2021/08/27 09:18:15 Job still running ...
2021/08/27 09:18:45 Job still running ...
2021/08/27 09:19:15 Job still running ...
2021/08/27 09:19:45 Job still running ...
2021/08/27 09:20:15 Job still running ...
2021/08/27 09:20:45 Job still running ...
2021/08/27 09:21:15 Job still running ...
2021/08/27 09:21:46 Job still running ...
2021/08/27 09:22:16 Job still running ...
2021/08/27 09:22:46 Job still running ...
2021/08/27 09:23:16 Job still running ...
2021/08/27 09:23:46 Job still running ...
2021/08/27 09:24:16 Job still running ...
2021/08/27 09:24:46 Job still running ...
2021/08/27 09:25:16 Job still running ...
2021/08/27 09:25:46 Job still running ...
2021/08/27 09:26:16 Job still running ...
2021/08/27 09:26:46 Job still running ...
2021/08/27 09:27:16 Job still running ...
2021/08/27 09:27:46 Job still running ...
2021/08/27 09:28:16 Job still running ...
2021/08/27 09:28:46 Job still running ...
2021/08/27 09:29:16 Job still running ...
2021/08/27 09:29:46 Job still running ...
2021/08/27 09:30:16 Job still running ...
2021/08/27 09:30:46 Job still running ...
2021/08/27 09:31:16 Job still running ...
2021/08/27 09:31:46 Job still running ...
2021/08/27 09:32:17 Job still running ...
2021/08/27 09:32:47 Job still running ...
2021/08/27 09:33:17 Job still running ...
2021/08/27 09:33:47 Job still running ...
2021/08/27 09:34:17 Job still running ...
2021/08/27 09:34:47 Job still running ...
2021/08/27 09:35:17 Job still running ...
2021/08/27 09:35:47 Job still running ...
2021/08/27 09:36:17 Job still running ...
2021/08/27 09:36:47 Job still running ...
2021/08/27 09:37:17 Job still running ...
2021/08/27 09:37:47 Job still running ...
2021/08/27 09:38:17 Job still running ...
2021/08/27 09:38:47 Job still running ...
2021/08/27 09:39:17 Job still running ...
2021/08/27 09:39:47 Job still running ...
2021/08/27 09:40:17 Job still running ...
2021/08/27 09:40:47 Job still running ...
2021/08/27 09:41:17 Job still running ...
2021/08/27 09:41:47 Job still running ...
2021/08/27 09:42:17 Job still running ...
2021/08/27 09:42:47 Job still running ...
2021/08/27 09:43:17 Job still running ...
2021/08/27 09:43:47 Job still running ...
2021/08/27 09:44:17 Job still running ...
2021/08/27 09:44:47 Job still running ...
2021/08/27 09:45:18 Job still running ...
2021/08/27 09:45:48 Job still running ...
2021/08/27 09:46:18 Job still running ...
2021/08/27 09:46:48 Job still running ...
2021/08/27 09:47:18 Job still running ...
2021/08/27 09:47:48 Job still running ...
2021/08/27 09:48:18 Job still running ...
2021/08/27 09:48:48 Job still running ...
2021/08/27 09:49:18 Job still running ...
2021/08/27 09:49:48 Job still running ...
2021/08/27 09:50:18 Job still running ...
2021/08/27 09:50:48 Job still running ...
2021/08/27 09:51:18 Job still running ...
2021/08/27 09:51:48 Job still running ...
2021/08/27 09:52:18 Job still running ...
2021/08/27 09:52:48 Job still running ...
2021/08/27 09:53:18 Job still running ...
2021/08/27 09:53:48 Job still running ...
2021/08/27 09:54:18 Job still running ...
2021/08/27 09:54:48 Job still running ...
2021/08/27 09:55:18 Job still running ...
2021/08/27 09:55:48 Job still running ...
2021/08/27 09:56:18 Job still running ...
2021/08/27 09:56:48 Job still running ...
2021/08/27 09:57:18 Job still running ...
2021/08/27 09:57:48 Job still running ...
2021/08/27 09:58:18 Job still running ...
2021/08/27 09:58:49 Job still running ...
2021/08/27 09:59:19 Job still running ...
2021/08/27 09:59:49 Job still running ...
2021/08/27 10:00:19 Job still running ...
2021/08/27 10:00:49 Job still running ...
2021/08/27 10:01:19 Job still running ...
2021/08/27 10:01:49 Job still running ...
2021/08/27 10:02:19 Job still running ...
2021/08/27 10:02:49 Job still running ...
2021/08/27 10:03:19 Failed to execute job: job 2021-08-27_02_00_13-14418015941483443352 failed
panic: Failed to execute job: job 2021-08-27_02_00_13-14418015941483443352 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1129dc8, 0xc00003e0b0, 0x101c117, 0x19, 0xc0002c1e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 3m 57s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/sgx3cjhspzsi6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #416
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/416/display/redirect?page=changes>
Changes:
[noreply] Update README.md
[marco.robles] Update README with latest PreCommit Jobs
[marco.robles] Update Postcommit jobs with latest jobs
[marco.robles] Update Performace job tests in readme
[marco.robles] update load job tests with latest updates
[marco.robles] update other jobs test with latest updates
[marco.robles] mismatch links fix
[marco.robles] update trigger phrase for some postCommit jobs
[marco.robles] correct trigger phrases in readme
[marco.robles] add pending jobs to readme
[noreply] Update README.md
[mmack] [BEAM-13246] Add support for S3 Bucket Key at the object level (AWS Sdk
[Ismaël Mejía] [BEAM-13839] Upgrade zstd-jni to version 1.5.2-1
[mmack] [BEAM-13840] Fix usage of legacy rawtypes in AWS modules
[Pablo Estrada] Output successful rows from BQ Streaming Inserts
[schapman] BEAM-13439 Type annotation for ptransform_fn
[noreply] [BEAM-13606] Fail bundles with failed BigTable mutations (#16751)
[marco.robles] fix broken links in jobs & remove the invalid ones
[Kyle Weaver] Update Dataflow Python dev container images.
[Kiley Sok] Add java 17 to changes
[noreply] [BEAM-12914] Add missing 3.9 opcodes to type inference. (#16761)
[noreply] [BEAM-13321] Initial BigQueryIO externalization. (#16489)
[noreply] [BEAM-13193] Enable process bundle response elements embedding in Java
[noreply] [BEAM-13830] added a debeziumio_expansion_addr flag to GoSDK (#16780)
[noreply] Apply spotless. (#16783)
[Daniel Oliveira] [BEAM-13732] Switch x-lang BigQueryIO expansion service to GCP one.
[noreply] [BEAM-13858] Fix broken github action on :sdks:go:examples:wordCount
[Kiley Sok] add jira for runner v2
[noreply] [BEAM-13732] Go SDK BigQuery IO wrapper. Initial implementation.
[noreply] [BEAM-13732] Add example for Go BigQuery IO wrapper. (#16786)
[noreply] Update CHANGES.md with Go SDK milestones. (#16787)
[noreply] [BEAM-13193] Allow BeamFnDataOutboundObserver to flush elements.
------------------------------------------
[...truncated 24.92 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644397172380621006/****\022@44bcf14b6e9e0ad151079738e1e86905215c745276fcb9d1ec676007ed1e7c97"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/09 08:59:33 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644397172380621006/model
2022/02/09 08:59:33 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0209065634"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644397172380621006/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644397172380621006/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0209065634",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/09 08:59:38 Submitted job: 2022-02-09_00_59_33-11605192947149935130
2022/02/09 08:59:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-09_00_59_33-11605192947149935130?project=apache-beam-testing
2022/02/09 08:59:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-09_00_59_33-11605192947149935130
2022/02/09 08:59:38 Job state: JOB_STATE_PENDING ...
2022/02/09 09:00:08 Job still running ...
2022/02/09 09:00:38 Job still running ...
2022/02/09 09:01:08 Job still running ...
2022/02/09 09:01:38 Job still running ...
2022/02/09 09:02:08 Job still running ...
2022/02/09 09:02:38 Job still running ...
2022/02/09 09:03:08 Failed to execute job: job 2022-02-09_00_59_33-11605192947149935130 failed
panic: Failed to execute job: job 2022-02-09_00_59_33-11605192947149935130 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114ce28, 0xc000128000, 0x103a9ac, 0x19, 0xc000443df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 45s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/4mmi5rruqprp2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #415
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/415/display/redirect?page=changes>
Changes:
[Kyle Weaver] [BEAM-12976] Log projection pushdown optimizations.
[benjamin.gonzalez] [BEAM-12572] Change jobs to run as cron jobs
[alexander.zhuravlev] [BEAM-13820] Changed color of delete icon in pipeline options dropdown,
[noreply] [BEAM-11971] Revert "Fix timer consistency in direct runner" (#16748)
[noreply] [BEAM-13193] Aggregates fn api outbound data/timers of different
[noreply] [BEAM-13767] Migrate a bundle of grade tasks to use configuration
[noreply] Merge pull request #16653 from [BEAM-12164]: Add integration tests for
[noreply] Merge pull request #16728 from [BEAM-13823] Update docs for SnowflakeIO
[noreply] Merge pull request #16660 from [BEAM-13771][Playground] Send multifile
[noreply] Merge pull request #16646 from [BEAM-13643][Playground] Setup running
[noreply] [BEAM-13015] Add state caching benchmark and move benchmarks to their
[noreply] [BEAM-13419] Check for initialization in dataflow runner (#16765)
[noreply] Merge pull request #16701 from [BEAM-13786] [Playground] [Bugfix] Update
[noreply] Merge pull request #16754 from [BEAM-13838][Playground] Add logs in case
[noreply] [BEAM-13293] consistent naming for expansion service address and flag
[noreply] Merge pull request #16700 from [BEAM-13790][Playground] Change logic of
[noreply] [BEAM-13830] update dependency for debeziumio expansion service (#16743)
[noreply] [BEAM-13761] consistent namings for expansion address in Debezium IO
[noreply] [BEAM-13806] Shutting down SchemaIO expansion services from Go VR
[noreply] [release-2.36.0] Update website/changelog for release 2.36.0 (#16627)
[noreply] [BEAM-13848] Update numpy intersphinx link (#16767)
[noreply] [release-23.6.0] Fix JIRA link for 2.36 blog (#16771)
[noreply] [BEAM-13647] Use role for Go worker binary. (#16729)
------------------------------------------
[...truncated 24.89 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644310776663218172/****\022@44bcf14b6e9e0ad151079738e1e86905215c745276fcb9d1ec676007ed1e7c97"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/08 08:59:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644310776663218172/model
2022/02/08 08:59:37 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0208065622"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644310776663218172/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644310776663218172/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0208065622",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/08 08:59:38 Submitted job: 2022-02-08_00_59_37-4995729025081523115
2022/02/08 08:59:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-08_00_59_37-4995729025081523115?project=apache-beam-testing
2022/02/08 08:59:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-08_00_59_37-4995729025081523115
2022/02/08 08:59:38 Job state: JOB_STATE_PENDING ...
2022/02/08 09:00:08 Job still running ...
2022/02/08 09:00:38 Job still running ...
2022/02/08 09:01:08 Job still running ...
2022/02/08 09:01:38 Job still running ...
2022/02/08 09:02:08 Job still running ...
2022/02/08 09:02:38 Job still running ...
2022/02/08 09:03:08 Failed to execute job: job 2022-02-08_00_59_37-4995729025081523115 failed
panic: Failed to execute job: job 2022-02-08_00_59_37-4995729025081523115 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114ce28, 0xc000128000, 0x103a9ac, 0x19, 0xc0007a5df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 45s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/wjdd4wot42hnw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #414
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/414/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #16726 from [BEAM-12164]: Parses change streams
[mmack] [BEAM-13147] Avoid nullness issue during init of AwsModule (AWS Sdk v2)
------------------------------------------
[...truncated 25.64 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/07 15:42:24 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644248543551514617/model
2022/02/07 15:42:24 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0207144956"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644248543551514617/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644248543551514617/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0207144956",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/07 15:42:24 Submitted job: 2022-02-07_07_42_24-9657747954310360464
2022/02/07 15:42:24 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-07_07_42_24-9657747954310360464?project=apache-beam-testing
2022/02/07 15:42:24 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-07_07_42_24-9657747954310360464
2022/02/07 15:42:24 Job state: JOB_STATE_PENDING ...
2022/02/07 15:42:54 Job still running ...
2022/02/07 15:43:24 Job still running ...
2022/02/07 15:43:55 Job still running ...
2022/02/07 15:44:25 Job still running ...
2022/02/07 15:44:55 Job still running ...
2022/02/07 15:45:25 Job still running ...
2022/02/07 15:45:55 Job still running ...
2022/02/07 15:46:25 Job still running ...
2022/02/07 15:46:55 Job still running ...
2022/02/07 15:47:25 Job still running ...
2022/02/07 15:47:55 Failed to execute job: job 2022-02-07_07_42_24-9657747954310360464 failed
panic: Failed to execute job: job 2022-02-07_07_42_24-9657747954310360464 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114ba28, 0xc00019a000, 0x10398ac, 0x19, 0xc000475df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 59s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/waa3khat6bblk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #413
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/413/display/redirect?page=changes>
Changes:
[mmack] [BEAM-13663] Remove unused duplicate option for AWS client configuration
[mmack] [BEAM-13203] Deprecate SnsIO.writeAsync for AWS Sdk v2 due to risk of
[noreply] [BEAM-13828] Fix stale bot (#16734)
[noreply] Merge pull request #16364 from [BEAM-13182] Add diagrams to backend
[noreply] [BEAM-13811] Fix save_main_session arg in tests examples (#16709)
[Kiley Sok] Update beam-master version
[noreply] [BEAM-13015] Calculate exception for closing BeamFnDataInboundObserver2
[noreply] Minor doc tweaks for validating vendoring. (#16747)
[noreply] [BEAM-13686] OOM while logging a large pipeline even when logging level
[noreply] [BEAM-13629] Update URL artifact type for Dataflow Go (#16490)
[noreply] [BEAM-13832] Add automated expansion service start-up to JDBCio (#16739)
[noreply] [BEAM-13831] Add automated expansion service infra into Debezium Read()
[noreply] [BEAM-13821] Add automated expansion service start-up to KafkaIO
[noreply] [BEAM-13799] Created a Dataproc cluster manager for Interactive Beam
[noreply] Merge pull request #16727: [BEAM-11971] remove unsafe Concurrent data
------------------------------------------
[...truncated 25.55 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/05 08:59:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644051582538833316/model
2022/02/05 08:59:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0205065626"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644051582538833316/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644051582538833316/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0205065626",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/05 08:59:43 Submitted job: 2022-02-05_00_59_43-16333102740292149302
2022/02/05 08:59:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-05_00_59_43-16333102740292149302?project=apache-beam-testing
2022/02/05 08:59:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-05_00_59_43-16333102740292149302
2022/02/05 08:59:43 Job state: JOB_STATE_PENDING ...
2022/02/05 09:00:13 Job still running ...
2022/02/05 09:00:43 Job still running ...
2022/02/05 09:01:14 Job still running ...
2022/02/05 09:01:44 Job still running ...
2022/02/05 09:02:14 Job still running ...
2022/02/05 09:02:44 Job still running ...
2022/02/05 09:03:14 Job still running ...
2022/02/05 09:03:45 Failed to execute job: job 2022-02-05_00_59_43-16333102740292149302 failed
panic: Failed to execute job: job 2022-02-05_00_59_43-16333102740292149302 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114ba28, 0xc000120000, 0x10398ac, 0x19, 0xc0002fddf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m 22s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/u3avusyuxghba
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #412
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/412/display/redirect?page=changes>
Changes:
[Kiley Sok] Allow Java 17 to be used in SDK
[Kiley Sok] add testing support
[Kiley Sok] Add more testing support for java 17
[Kiley Sok] workaround for jamm
[Kiley Sok] Add Jenkins test for Java 17
[Kiley Sok] Fix jvm hex and skip errorprone
[Kiley Sok] Fix display data for anonymous classes
[Kiley Sok] fix jpms tests
[Kiley Sok] skip zetasql
[Kiley Sok] spotless
[Kiley Sok] spotless
[Kiley Sok] Fix trigger
[Kiley Sok] skip checker framework
[Kiley Sok] fix app name
[Kiley Sok] remove duplicate property check
[Heejong Lee] [BEAM-13813] Add support for URL artifact to extractStagingToPath
[avilovpavel6] Remove Python SQL Test example from catalog
[relax] Fix timer consistency in direct runner
[noreply] [BEAM-13757] adds pane observation in DoFn (#16629)
[Jan Lukavský] Change links to Books from Amazon to Publisher
[noreply] [BEAM-13605] Add support for pandas 1.4.0 (#16590)
[noreply] [BEAM-13761] adds Debezium IO wrapper for Go SDK (#16642)
[noreply] [BEAM-13024] Unify PipelineOptions behavior (#16719)
[noreply] Update sdks/go/pkg/beam/artifact/materialize_test.go
[noreply] Merge pull request #16605 from [BEAM-13634][Playground] Create a
[noreply] Merge pull request #16593 from [BEAM-13725][Playground] Add graph to the
[noreply] Merge pull request #16699 from [BEAM-13789][Playground] Change logic of
[alexander.chermenin] Fixed CSS for Case study page
------------------------------------------
[...truncated 25.48 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/04 08:59:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643965183454902711/model
2022/02/04 08:59:44 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0204065628"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643965183454902711/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643965183454902711/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0204065628",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/04 08:59:44 Submitted job: 2022-02-04_00_59_44-9670712922233996184
2022/02/04 08:59:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-04_00_59_44-9670712922233996184?project=apache-beam-testing
2022/02/04 08:59:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-04_00_59_44-9670712922233996184
2022/02/04 08:59:44 Job state: JOB_STATE_PENDING ...
2022/02/04 09:00:14 Job still running ...
2022/02/04 09:00:44 Job still running ...
2022/02/04 09:01:15 Job still running ...
2022/02/04 09:01:45 Job still running ...
2022/02/04 09:02:15 Job still running ...
2022/02/04 09:02:45 Job still running ...
2022/02/04 09:03:15 Failed to execute job: job 2022-02-04_00_59_44-9670712922233996184 failed
panic: Failed to execute job: job 2022-02-04_00_59_44-9670712922233996184 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114b968, 0xc00019a000, 0x10398ac, 0x19, 0xc000621df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/nu3embryuyqyc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #411
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/411/display/redirect?page=changes>
Changes:
[aydar.zaynutdinov] [BEAM-13737][Playground]
[Robert Bradshaw] Make num-stages counter into an internal counter.
[Kenneth Knowles] [BEAM-13768] Fix NullPointerException in BigQueryStorageSourceBase
[Robert Bradshaw] Avoid packaging avro in the java harness jar.
[mmack] [BEAM-13563] Restructure Kinesis Source for Aws 2 internally to prepare
[noreply] [BEAM-4665] Allow joining a running dataflow pipeline without throwing
[noreply] [BEAM-13801] Add standard coder tests for state backed iterable.
[noreply] [BEAM-13430] Fix provided configuration by removing extendsFrom for
[noreply] [BEAM-12830] Print clearer go version fail message (#16693)
[Jan Lukavský] Add reference to Books to Learning Resources in website
[noreply] Use ThreadLocal for DESERIALIZATION_CONTEXT (#16680)
[noreply] Minor: Add apt update after adding deadsnakes repository in dev env
[noreply] [BEAM-13807] Regenerate container images to get TF 2.8.0 (#16707)
[noreply] [BEAM-13399, BEAM-13683] Eagerly materialize artifacts for automated
[noreply] Merge pull request #16617 from [BEAM-13743] [Playground] Add context
[noreply] Merge pull request #16618 from [BEAM-13744] [Playground] Add context
[noreply] Merge pull request #16698 from [BEAM-13802][Playground] [Bugfix] Clean
[noreply] [BEAM-13293][BEAM-13806] Pipe a SchemaIO flag through Go integration
[noreply] [BEAM-13605] Modify groupby.apply implementation in preparation for
[noreply] Merge pull request #16436 from [BEAM-1330] - DatastoreIO Writes should
------------------------------------------
[...truncated 25.69 KB...]
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/03 16:32:15 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643905934933780129/model
2022/02/03 16:32:15 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0203153335"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643905934933780129/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643905934933780129/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0203153335",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/03 16:32:16 Submitted job: 2022-02-03_08_32_15-8992515190443930474
2022/02/03 16:32:16 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-03_08_32_15-8992515190443930474?project=apache-beam-testing
2022/02/03 16:32:16 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-03_08_32_15-8992515190443930474
2022/02/03 16:32:16 Job state: JOB_STATE_PENDING ...
2022/02/03 16:32:46 Job still running ...
2022/02/03 16:33:16 Job still running ...
2022/02/03 16:33:46 Job still running ...
2022/02/03 16:34:16 Job still running ...
2022/02/03 16:34:46 Job still running ...
2022/02/03 16:35:16 Job still running ...
2022/02/03 16:35:46 Job still running ...
2022/02/03 16:36:16 Job still running ...
2022/02/03 16:36:46 Job still running ...
2022/02/03 16:37:17 Job still running ...
2022/02/03 16:37:47 Job still running ...
2022/02/03 16:38:17 Failed to execute job: job 2022-02-03_08_32_15-8992515190443930474 failed
panic: Failed to execute job: job 2022-02-03_08_32_15-8992515190443930474 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114a768, 0xc0000480c0, 0x1038848, 0x19, 0xc000359df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 6m 36s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vxs4yfz7fnpra
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #410
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/410/display/redirect?page=changes>
Changes:
[career] [BEAM-13734] Support cache directories that use GCS buckets
[noreply] Merge pull request #16655 from [BEAM-12164]: Add retry protection to
[noreply] Merge pull request #16586 from [BEAM-13731] FhirIO: Add support for
[noreply] [BEAM-13011] Adds a link to Multi-language Pipelines Tips wiki page
[noreply] [BEAM-12572] Run python examples on multiple runners (#16154)
[noreply] [BEAM-13574] Large Wordcount (#16455)
[noreply] [BEAM-13293] Refactor JDBC IO Go Wrapper (#16686)
[noreply] Edit license script for Java, add manual licenses for xz (#16692)
------------------------------------------
[...truncated 25.49 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/02 08:59:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643792379734177252/model
2022/02/02 08:59:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0202065644"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643792379734177252/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643792379734177252/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0202065644",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/02 08:59:41 Submitted job: 2022-02-02_00_59_40-6788767035127109471
2022/02/02 08:59:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-02_00_59_40-6788767035127109471?project=apache-beam-testing
2022/02/02 08:59:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-02_00_59_40-6788767035127109471
2022/02/02 08:59:41 Job state: JOB_STATE_PENDING ...
2022/02/02 09:00:11 Job still running ...
2022/02/02 09:00:41 Job still running ...
2022/02/02 09:01:11 Job still running ...
2022/02/02 09:01:41 Job still running ...
2022/02/02 09:02:11 Job still running ...
2022/02/02 09:02:41 Job still running ...
2022/02/02 09:03:11 Failed to execute job: job 2022-02-02_00_59_40-6788767035127109471 failed
panic: Failed to execute job: job 2022-02-02_00_59_40-6788767035127109471 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1147848, 0xc0000480d0, 0x1035ccb, 0x19, 0xc000343df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 47s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/nixey6jq4xtmw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #409
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/409/display/redirect?page=changes>
Changes:
[daria.malkova] Support SCIO SDK via sbt projects
[samuelw] [BEAM-11648] Share thread pool across RetryManager instances.
[Pablo Estrada] Exclude per-key order tests on Twister2 runner
[mrudary] Generalize S3FileSystem to support multiple URI schemes.
[Heejong Lee] Fix Java SDK container image name for load-tests and nexmark
[daria.malkova] Change executable name fo go tests
[avilovpavel6] Fix java test
[noreply] [BEAM-13769] Skip test_main_session_not_staged_when_using_cloudpickle
[noreply] [BEAM-6744] Support implicitly setting project id in Go Dataflow runner
[noreply] Merge pull request #16493 from [BEAM-13632][Playground] Save catalog
[noreply] Exclude jul-to-slf4j from Spark runner in quickstart POM templates
[noreply] [BEAM-11936] Enable a few errorprone checks that were broken by pinned
[noreply] [BEAM-13780] Add CONTRIBUTING.md pointing to main guide (#16666)
[noreply] [BEAM-13777] Accept cache capacity as input parameter instead of default
[noreply] [BEAM-13051][A] Enable pylint warnings
[noreply] [BEAM-13779] Fix pr labeling (#16665)
[noreply] Merge pull request #16581 from [BEAM-12164]: Add
[noreply] Fix labeler trigger (#16674)
[noreply] [BEAM-13781] Exclude grpc-netty-shaded from gax-grpc's dependency
[noreply] [BEAM-13051] Fixed pylint warnings : raising-non-exception (E0710),
[noreply] [BEAM-13740] Correctly install go before running tests (#16673)
[noreply] [BEAM-12830] Update local Docker env Go version. (#16670)
[noreply] [BEAM-13051][B] Enable pylint warnings
[noreply] [BEAM-13430] Revert Spark libraries in Spark runner to provided (#16675)
[noreply] [BEAM-12240] Add Java 17 support (#16568)
[noreply] [BEAM-13760] Add random component to default python dataflow job name
------------------------------------------
[...truncated 25.53 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/01 08:59:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643705978858733105/model
2022/02/01 08:59:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0201074004"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643705978858733105/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643705978858733105/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0201074004",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/01 08:59:40 Submitted job: 2022-02-01_00_59_39-16711452986721150822
2022/02/01 08:59:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-01_00_59_39-16711452986721150822?project=apache-beam-testing
2022/02/01 08:59:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-01_00_59_39-16711452986721150822
2022/02/01 08:59:40 Job state: JOB_STATE_PENDING ...
2022/02/01 09:00:10 Job still running ...
2022/02/01 09:00:40 Job still running ...
2022/02/01 09:01:10 Job still running ...
2022/02/01 09:01:40 Job still running ...
2022/02/01 09:02:10 Job still running ...
2022/02/01 09:02:40 Job still running ...
2022/02/01 09:03:10 Failed to execute job: job 2022-02-01_00_59_39-16711452986721150822 failed
panic: Failed to execute job: job 2022-02-01_00_59_39-16711452986721150822 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1147848, 0xc000120000, 0x1035ccb, 0x19, 0xc0002dddf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/kgujfkr6wfw3s
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #408
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/408/display/redirect>
Changes:
------------------------------------------
[...truncated 25.50 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/31 08:59:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643619577445976888/model
2022/01/31 08:59:38 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0131070328"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643619577445976888/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643619577445976888/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0131070328",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/31 08:59:39 Submitted job: 2022-01-31_00_59_38-15196148209605842372
2022/01/31 08:59:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-31_00_59_38-15196148209605842372?project=apache-beam-testing
2022/01/31 08:59:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-31_00_59_38-15196148209605842372
2022/01/31 08:59:39 Job state: JOB_STATE_PENDING ...
2022/01/31 09:00:09 Job still running ...
2022/01/31 09:00:39 Job still running ...
2022/01/31 09:01:10 Job still running ...
2022/01/31 09:01:40 Job still running ...
2022/01/31 09:02:10 Job still running ...
2022/01/31 09:02:40 Job still running ...
2022/01/31 09:03:10 Failed to execute job: job 2022-01-31_00_59_38-15196148209605842372 failed
panic: Failed to execute job: job 2022-01-31_00_59_38-15196148209605842372 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1147828, 0xc0000480d0, 0x1035ccb, 0x19, 0xc00088fdf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/y75v34rxeilye
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #407
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/407/display/redirect>
Changes:
------------------------------------------
[...truncated 25.54 KB...]
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/30 08:59:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643533181506038945/model
2022/01/30 08:59:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0130071853"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643533181506038945/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643533181506038945/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0130071853",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/30 08:59:43 Submitted job: 2022-01-30_00_59_42-15558852032698291143
2022/01/30 08:59:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-30_00_59_42-15558852032698291143?project=apache-beam-testing
2022/01/30 08:59:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-30_00_59_42-15558852032698291143
2022/01/30 08:59:43 Job state: JOB_STATE_PENDING ...
2022/01/30 09:00:13 Job still running ...
2022/01/30 09:00:43 Job still running ...
2022/01/30 09:01:13 Job still running ...
2022/01/30 09:01:43 Job still running ...
2022/01/30 09:02:13 Job still running ...
2022/01/30 09:02:43 Job still running ...
2022/01/30 09:03:13 Job still running ...
2022/01/30 09:03:43 Job still running ...
2022/01/30 09:04:13 Job still running ...
2022/01/30 09:04:43 Failed to execute job: job 2022-01-30_00_59_42-15558852032698291143 failed
panic: Failed to execute job: job 2022-01-30_00_59_42-15558852032698291143 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1147828, 0xc0000480d0, 0x1035ccb, 0x19, 0xc000429df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 21s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/v3grouavd6opi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #406
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/406/display/redirect?page=changes>
Changes:
[Kyle Weaver] [BEAM-13751] Don't block on gcloud when attempting to get default GCP
[Kyle Weaver] [BEAM-13751] Parameterize wait timeout so test doesn't waste 2s.
[Kyle Weaver] [BEAM-13751] Add comment explaining sleep.
[noreply] Update Python SDK beam-master tags (#16630)
[noreply] Merge pull request #16592 from [BEAM-13722][Playground] Add precompiling
[noreply] Merge pull request #16505 from [BEAM-13527] [Playground] Pipeline
[noreply] [BEAM-13293] XLang Jdbc IO for Go SDK (#16111)
[noreply] [BEAM-10206] Add Go Vet to Github Actions (#16612)
------------------------------------------
[...truncated 26.03 KB...]
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/29 08:59:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643446784787982254/model
2022/01/29 08:59:45 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0129073057"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643446784787982254/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643446784787982254/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0129073057",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/29 08:59:46 Submitted job: 2022-01-29_00_59_45-8251536614596506965
2022/01/29 08:59:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-29_00_59_45-8251536614596506965?project=apache-beam-testing
2022/01/29 08:59:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-29_00_59_45-8251536614596506965
2022/01/29 08:59:46 Job state: JOB_STATE_PENDING ...
2022/01/29 09:00:16 Job still running ...
2022/01/29 09:00:46 Job still running ...
2022/01/29 09:01:16 Job still running ...
2022/01/29 09:01:46 Job still running ...
2022/01/29 09:02:16 Job still running ...
2022/01/29 09:02:46 Job still running ...
2022/01/29 09:03:16 Job still running ...
2022/01/29 09:03:46 Job still running ...
2022/01/29 09:04:16 Job still running ...
2022/01/29 09:04:46 Job still running ...
2022/01/29 09:05:16 Job still running ...
2022/01/29 09:05:46 Failed to execute job: job 2022-01-29_00_59_45-8251536614596506965 failed
panic: Failed to execute job: job 2022-01-29_00_59_45-8251536614596506965 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1147828, 0xc0000480d0, 0x1035ccb, 0x19, 0xc00035bdf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 6m 25s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/z5gq66qivrjme
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #405
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/405/display/redirect?page=changes>
Changes:
[marcin.kuthan] Get rid of unnessecary logs for BigQuery streaming writes in
[dhuntsperger] added GitHub example references to Python multilang quickstart
[mmack] [adhoc] Test S3Options and AwsOptions for Sdk v2
[noreply] [BEAM-13537] Fix NPE in kafkatopubsub example (#16625)
[noreply] [BEAM-13740] update java_tests.yml to remove setup-go, which is
[Heejong Lee] Fix google3 import error
[noreply] [BEAM-12976] Implement Java projection pushdown optimizer. (#16513)
[noreply] Merge pull request #16579 from Revert "Revert "Merge pull request #15863
[noreply] Merge pull request #16606 from [BEAM-13247] [Playground] Embedding
------------------------------------------
[...truncated 25.62 KB...]
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/28 08:59:52 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643360391491625380/model
2022/01/28 08:59:52 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0128074654"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643360391491625380/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643360391491625380/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0128074654",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/28 08:59:52 Submitted job: 2022-01-28_00_59_52-9289776175485743740
2022/01/28 08:59:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-28_00_59_52-9289776175485743740?project=apache-beam-testing
2022/01/28 08:59:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-28_00_59_52-9289776175485743740
2022/01/28 08:59:52 Job state: JOB_STATE_PENDING ...
2022/01/28 09:00:22 Job still running ...
2022/01/28 09:00:52 Job still running ...
2022/01/28 09:01:22 Job still running ...
2022/01/28 09:01:52 Job still running ...
2022/01/28 09:02:23 Job still running ...
2022/01/28 09:02:53 Job still running ...
2022/01/28 09:03:23 Job still running ...
2022/01/28 09:03:53 Job still running ...
2022/01/28 09:04:23 Job still running ...
2022/01/28 09:04:53 Job still running ...
2022/01/28 09:05:23 Job still running ...
2022/01/28 09:05:53 Failed to execute job: job 2022-01-28_00_59_52-9289776175485743740 failed
panic: Failed to execute job: job 2022-01-28_00_59_52-9289776175485743740 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1146268, 0xc0000480c0, 0x1034a12, 0x19, 0xc0002dfdf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 6m 28s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/u3hwybw5km7xs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #404
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/404/display/redirect?page=changes>
Changes:
[Heejong Lee] [BEAM-13093] Enable JavaUsingPython CrossLanguageValidateRunner test for
[mmack] [BEAM-8807] Add integration test for SnsIO.write (Sdk v1 & v2)
[mmack] [BEAM-13746] Fix deserialization of SSECustomerKey for AWS Sdk v2
[noreply] [BEAM-7928] Allow users to specify worker disk type for Dataflow runner
[noreply] Merge pull request #16534 from [BEAM-13671][Playground] Add backend
[noreply] [BEAM-13271] Bump errorprone to 2.10.0 (#16231)
[noreply] [BEAM-13595] Don't load main session when cloudpickle is used. (#16589)
[Heejong Lee] Update readme for XVR tests
------------------------------------------
[...truncated 25.55 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/27 08:59:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643273985111592722/model
2022/01/27 08:59:45 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0127065814"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643273985111592722/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643273985111592722/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0127065814",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/27 08:59:46 Submitted job: 2022-01-27_00_59_45-12315891122515103043
2022/01/27 08:59:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-27_00_59_45-12315891122515103043?project=apache-beam-testing
2022/01/27 08:59:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-27_00_59_45-12315891122515103043
2022/01/27 08:59:46 Job state: JOB_STATE_PENDING ...
2022/01/27 09:00:16 Job still running ...
2022/01/27 09:00:46 Job still running ...
2022/01/27 09:01:16 Job still running ...
2022/01/27 09:01:46 Job still running ...
2022/01/27 09:02:16 Job still running ...
2022/01/27 09:02:46 Job still running ...
2022/01/27 09:03:16 Job still running ...
2022/01/27 09:03:46 Job still running ...
2022/01/27 09:04:16 Job still running ...
2022/01/27 09:04:46 Job still running ...
2022/01/27 09:05:17 Failed to execute job: job 2022-01-27_00_59_45-12315891122515103043 failed
panic: Failed to execute job: job 2022-01-27_00_59_45-12315891122515103043 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1146268, 0xc000120000, 0x1034a12, 0x19, 0xc000421df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 55s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/wcn33m5qbhkmc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #403
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/403/display/redirect?page=changes>
Changes:
[artur.khanin] Privacy policy update regarding Apache Beam Playground
[Daniel Oliveira] [BEAM-13321] Fix exception with BigQuery StreamWriter TraceID.
[mmack] [BEAM-13510] Don't retry on invalid SQS receipt handles.
[noreply] [BEAM-13736] Make lifting cache exact. (#16603)
[noreply] Merge pull request #16565 from [BEAM-13692][Playground] Implement
[noreply] Merge pull request #16502 from [BEAM-13650][Playground] Add link for
[noreply] [BEAM-13310] remove call to get offset consumer config, which was rep…
------------------------------------------
[...truncated 25.54 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/26 08:59:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643187583314923072/model
2022/01/26 08:59:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0126065621"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643187583314923072/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643187583314923072/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0126065621",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/26 08:59:44 Submitted job: 2022-01-26_00_59_43-11873928177399987430
2022/01/26 08:59:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-26_00_59_43-11873928177399987430?project=apache-beam-testing
2022/01/26 08:59:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-26_00_59_43-11873928177399987430
2022/01/26 08:59:45 Job state: JOB_STATE_PENDING ...
2022/01/26 09:00:15 Job still running ...
2022/01/26 09:00:45 Job still running ...
2022/01/26 09:01:15 Job still running ...
2022/01/26 09:01:45 Job still running ...
2022/01/26 09:02:15 Job still running ...
2022/01/26 09:02:45 Job still running ...
2022/01/26 09:03:15 Failed to execute job: job 2022-01-26_00_59_43-11873928177399987430 failed
panic: Failed to execute job: job 2022-01-26_00_59_43-11873928177399987430 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1146208, 0xc000120000, 0x10349e9, 0x19, 0xc000409df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 54s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vq3o4ykd2vwka
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #402
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/402/display/redirect?page=changes>
Changes:
[Heejong Lee] [BEAM-13716] Clear before creating a new virtual environment in
[mmack] [BEAM-13653] Make SnsIO.write topicArn optional. If provided, validate
[noreply] [BEAM-10897] Update the fastavro lower bound due to an issue on Windows
[noreply] [BEAM-13605] Update pandas_doctests_test denylists in preparation for
[noreply] Merge pull request #16538 from [BEAM-13676][Playground][Bugfix]Build Of
[noreply] Merge pull request #16582 from [BEAM-13711] [Playground] [Bugfix] Add
[noreply] Merge pull request #16515 from [BEAM-13636] [Playground] Checking the
[ningkang0957] [BEAM-13275] Removed the explicit selenium dependency from setup
[noreply] [BEAM-10206] Deprecate unused shallow cloning functions (#16600)
[noreply] Bump Dataflow container versions (#16602)
[noreply] Improved multi-language pipelines section of the programming guide
------------------------------------------
[...truncated 25.47 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/25 08:59:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643101183563600369/model
2022/01/25 08:59:44 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0125065638"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643101183563600369/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643101183563600369/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0125065638",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/25 08:59:45 Submitted job: 2022-01-25_00_59_44-2104988975019718065
2022/01/25 08:59:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-25_00_59_44-2104988975019718065?project=apache-beam-testing
2022/01/25 08:59:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-25_00_59_44-2104988975019718065
2022/01/25 08:59:45 Job state: JOB_STATE_PENDING ...
2022/01/25 09:00:15 Job still running ...
2022/01/25 09:00:45 Job still running ...
2022/01/25 09:01:15 Job still running ...
2022/01/25 09:01:45 Job still running ...
2022/01/25 09:02:15 Job still running ...
2022/01/25 09:02:45 Job still running ...
2022/01/25 09:03:15 Failed to execute job: job 2022-01-25_00_59_44-2104988975019718065 failed
panic: Failed to execute job: job 2022-01-25_00_59_44-2104988975019718065 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144c28, 0xc0000480b0, 0x1033529, 0x19, 0xc0004b7df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/kesmgaxrr2fl4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #401
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/401/display/redirect>
Changes:
------------------------------------------
[...truncated 25.48 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/24 08:59:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643014779649238888/model
2022/01/24 08:59:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0124065636"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643014779649238888/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643014779649238888/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0124065636",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/24 08:59:40 Submitted job: 2022-01-24_00_59_40-15092494003879521226
2022/01/24 08:59:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-24_00_59_40-15092494003879521226?project=apache-beam-testing
2022/01/24 08:59:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-24_00_59_40-15092494003879521226
2022/01/24 08:59:41 Job state: JOB_STATE_PENDING ...
2022/01/24 09:00:11 Job still running ...
2022/01/24 09:00:41 Job still running ...
2022/01/24 09:01:11 Job still running ...
2022/01/24 09:01:41 Job still running ...
2022/01/24 09:02:11 Job still running ...
2022/01/24 09:02:41 Job still running ...
2022/01/24 09:03:11 Failed to execute job: job 2022-01-24_00_59_40-15092494003879521226 failed
panic: Failed to execute job: job 2022-01-24_00_59_40-15092494003879521226 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144c28, 0xc000120000, 0x1033529, 0x19, 0xc00031ddf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/czncxt7oyyjy4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #400
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/400/display/redirect>
Changes:
------------------------------------------
[...truncated 25.48 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/23 08:59:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642928382840297237/model
2022/01/23 08:59:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0123065623"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642928382840297237/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642928382840297237/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0123065623",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/23 08:59:44 Submitted job: 2022-01-23_00_59_43-8304880057078538888
2022/01/23 08:59:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-23_00_59_43-8304880057078538888?project=apache-beam-testing
2022/01/23 08:59:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-23_00_59_43-8304880057078538888
2022/01/23 08:59:44 Job state: JOB_STATE_PENDING ...
2022/01/23 09:00:14 Job still running ...
2022/01/23 09:00:44 Job still running ...
2022/01/23 09:01:14 Job still running ...
2022/01/23 09:01:44 Job still running ...
2022/01/23 09:02:14 Job still running ...
2022/01/23 09:02:44 Job still running ...
2022/01/23 09:03:14 Failed to execute job: job 2022-01-23_00_59_43-8304880057078538888 failed
panic: Failed to execute job: job 2022-01-23_00_59_43-8304880057078538888 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144c28, 0xc0000480b0, 0x1033529, 0x19, 0xc000433df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/h6rztv7cepq6w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #399
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/399/display/redirect?page=changes>
Changes:
[ningkang0957] [BEAM-13687] Improved Spanner IO request count metrics
[noreply] [BEAM-10206] Add key for fields in wrapper (#16583)
[noreply] Merge pull request #16530 from Adding JSON support in SpannerIO and
[noreply] [BEAM-13685] Enable users to specify cache directory under Interactive
------------------------------------------
[...truncated 25.56 KB...]
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/22 08:59:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642841982758679243/model
2022/01/22 08:59:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0122065632"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642841982758679243/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642841982758679243/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0122065632",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/22 08:59:44 Submitted job: 2022-01-22_00_59_43-10406486727515351606
2022/01/22 08:59:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-22_00_59_43-10406486727515351606?project=apache-beam-testing
2022/01/22 08:59:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-22_00_59_43-10406486727515351606
2022/01/22 08:59:44 Job state: JOB_STATE_PENDING ...
2022/01/22 09:00:14 Job still running ...
2022/01/22 09:00:44 Job still running ...
2022/01/22 09:01:14 Job still running ...
2022/01/22 09:01:44 Job still running ...
2022/01/22 09:02:14 Job still running ...
2022/01/22 09:02:44 Job still running ...
2022/01/22 09:03:14 Job still running ...
2022/01/22 09:03:44 Job still running ...
2022/01/22 09:04:15 Job still running ...
2022/01/22 09:04:45 Job still running ...
2022/01/22 09:05:15 Failed to execute job: job 2022-01-22_00_59_43-10406486727515351606 failed
panic: Failed to execute job: job 2022-01-22_00_59_43-10406486727515351606 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144c28, 0xc000120000, 0x1033529, 0x19, 0xc00050bdf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/rraabwajygi2i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #398
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/398/display/redirect?page=changes>
Changes:
[thiagotnunes] [BEAM-12164]: Add SDF for reading change stream records
[tuyarer] [BEAM-13577] Beam Select's uniquifyNames function loses nullability of
[sergey.kalinin] Update GH Actions to use proper variables names and proper triggers
[dhuntsperger] edited README and comments in Python multi-lang pipes examples
[Pablo Estrada] Revert "Merge pull request #15863 from [BEAM-13184] Autosharding for
[Pablo Estrada] BEAM-13611 reactivating jdbcio xlang test
[Steve Niemitz] [BEAM-13689] Output token elements when BQ batch writes complete.
[noreply] Merge pull request #16371 from [BEAM-13518][Playground] Beam Playground
[noreply] Update Java FnAPI beam master (#16572)
[noreply] [BEAM-13699] Replace fnv with maphash. (#16573)
[noreply] [BEAM-13693] Bump
[noreply] [BEAM-10206] Remove Fatalf calls in non-test goroutines for
[noreply] [BEAM-13430] Re-add provided configuration (#16552)
[noreply] Merge pull request #16540 from [BEAM-13678][Playground]Update Github
[noreply] Merge pull request #16546 from [BEAM-13661] [BEAM-13704] [Playground]
[noreply] Merge pull request #16369 from [BEAM-13558] [Playground] Hide the Graph
------------------------------------------
[...truncated 25.63 KB...]
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/21 08:59:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642755578744951190/model
2022/01/21 08:59:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0121065648"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642755578744951190/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642755578744951190/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0121065648",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/21 08:59:39 Submitted job: 2022-01-21_00_59_39-3417173138059446913
2022/01/21 08:59:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-21_00_59_39-3417173138059446913?project=apache-beam-testing
2022/01/21 08:59:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-21_00_59_39-3417173138059446913
2022/01/21 08:59:40 Job state: JOB_STATE_PENDING ...
2022/01/21 09:00:10 Job still running ...
2022/01/21 09:00:40 Job still running ...
2022/01/21 09:01:10 Job still running ...
2022/01/21 09:01:40 Job still running ...
2022/01/21 09:02:10 Job still running ...
2022/01/21 09:02:40 Job still running ...
2022/01/21 09:03:10 Job still running ...
2022/01/21 09:03:40 Job still running ...
2022/01/21 09:04:10 Job still running ...
2022/01/21 09:04:40 Job still running ...
2022/01/21 09:05:10 Job still running ...
2022/01/21 09:05:40 Failed to execute job: job 2022-01-21_00_59_39-3417173138059446913 failed
panic: Failed to execute job: job 2022-01-21_00_59_39-3417173138059446913 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144c28, 0xc000120000, 0x1033529, 0x19, 0xc0003e7df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 6m 21s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/xmqpsd3h7wtgo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #397
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/397/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #16309: [BEAM-13503] Set a default value to
[noreply] [BEAM-13015] Provide caching statistics in the status client. (#16495)
[noreply] [BEAM-13611] Skip test_xlang_jdbc_write (#16554)
[noreply] Merge pull request #16370 from [BEAM-13556] playground - color and
[noreply] Merge pull request #16531 from [BEAM-13567] [playground] Handle run code
[noreply] Merge pull request #16533 from [BEAM-13548] [Playground] Add example
[noreply] Merge pull request #16519 from [BEAM-13639] [Playground] Add
[noreply] Merge pull request #16518 from [BEAM-13619] [Playground] Add loading
[noreply] Merge pull request #16243 from
[noreply] [BEAM-13683] Make cross-language SQL example pipeline (#16567)
[noreply] [BEAM-13688] fixed type in BPG 4.5.3 window section (#16560)
[noreply] Remove obsolete commands from Inventory job. (#16564)
[noreply] Disable logging for memoization test. (#16556)
[noreply] Merge pull request #16472: [BEAM-13697] Add SchemaFieldNumber annotation
[noreply] Merge pull request #16373 from [BEAM-13515] [Playground] Hiding lines in
------------------------------------------
[...truncated 25.53 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/20 09:01:17 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642669276825652758/model
2022/01/20 09:01:17 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0120065639"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642669276825652758/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642669276825652758/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0120065639",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/20 09:01:18 Submitted job: 2022-01-20_01_01_17-4001667962871028942
2022/01/20 09:01:18 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-20_01_01_17-4001667962871028942?project=apache-beam-testing
2022/01/20 09:01:18 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-20_01_01_17-4001667962871028942
2022/01/20 09:01:18 Job state: JOB_STATE_PENDING ...
2022/01/20 09:01:48 Job still running ...
2022/01/20 09:02:18 Job still running ...
2022/01/20 09:02:48 Job still running ...
2022/01/20 09:03:18 Job still running ...
2022/01/20 09:03:48 Job still running ...
2022/01/20 09:04:18 Job still running ...
2022/01/20 09:04:48 Failed to execute job: job 2022-01-20_01_01_17-4001667962871028942 failed
panic: Failed to execute job: job 2022-01-20_01_01_17-4001667962871028942 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144748, 0xc000120000, 0x10330e9, 0x19, 0xc00055ddf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m 46s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/2cfiuayn7ltms
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #396
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/396/display/redirect?page=changes>
Changes:
[mmack] [BEAM-8806] Integration test for SqsIO
[mmack] [BEAM-13631] Add deterministic SQS message coder to fix reading from SQS
[Robert Bradshaw] Bump beam container version.
[alexander.zhuravlev] [BEAM-13680] Fixed code_repository (added pipelineUuid to RunCodeResult
[Robert Bradshaw] Also bump FnAPI container.
[noreply] [BEAM-13616][BEAM-13645] Switch to vendored grpc 1.43.2 (#16543)
[noreply] [BEAM-13616][BEAM-13646] Upgrade vendored calcite to 1.28.0:0.2 (#16544)
[noreply] Merge pull request #16486 from [BEAM-13544][Playground] Add logs to
[noreply] [BEAM-13683] Correct SQL transform schema, fix expansion address
[noreply] Update walkthrough.md (#16512)
[noreply] [BEAM-11808][BEAM-9879] Support aggregate functions with two arguments
[noreply] Merge pull request #16506 from [BEAM-13652][Playground] Send examples'
[noreply] Merge pull request #16322 from [BEAM-13407] [Playground] Preload fonts
[noreply] [BEAM-13665] Make SpannerIO projectID optional again (#16547)
[noreply] [BEAM-13015] Add state caching capability to be used as hint for runners
------------------------------------------
[...truncated 25.58 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/19 08:59:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642582782662705949/model
2022/01/19 08:59:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0119065629"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642582782662705949/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642582782662705949/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0119065629",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/19 08:59:44 Submitted job: 2022-01-19_00_59_43-9757846962851776844
2022/01/19 08:59:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-19_00_59_43-9757846962851776844?project=apache-beam-testing
2022/01/19 08:59:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-19_00_59_43-9757846962851776844
2022/01/19 08:59:44 Job state: JOB_STATE_PENDING ...
2022/01/19 09:00:14 Job still running ...
2022/01/19 09:00:44 Job still running ...
2022/01/19 09:01:14 Job still running ...
2022/01/19 09:01:44 Job still running ...
2022/01/19 09:02:14 Job still running ...
2022/01/19 09:02:44 Job still running ...
2022/01/19 09:03:14 Failed to execute job: job 2022-01-19_00_59_43-9757846962851776844 failed
panic: Failed to execute job: job 2022-01-19_00_59_43-9757846962851776844 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144748, 0xc0000480b0, 0x10330e9, 0x19, 0xc0002d9df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/grrcgetxdujru
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #395
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/395/display/redirect?page=changes>
Changes:
[aydar.zaynutdinov] [BEAM-13641][Playground]
[mmack] [BEAM-8806] Integration test for SqsIO using Localstack
[noreply] Merge pull request #16507: [BEAM-13137] Fixes ES utest size flakiness
[noreply] Remove jcenter repositories from gradle configuration. (#16532)
[noreply] [BEAM-13430] Remove jcenter which will no longer contain any updates.
[noreply] [BEAM-13616] Update com.google.cloud:libraries-bom to 24.2.0 (#16509)
------------------------------------------
[...truncated 25.49 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/18 09:01:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642496498304650402/model
2022/01/18 09:01:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0118065637"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642496498304650402/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642496498304650402/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0118065637",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/18 09:01:39 Submitted job: 2022-01-18_01_01_39-15081869137154624735
2022/01/18 09:01:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-18_01_01_39-15081869137154624735?project=apache-beam-testing
2022/01/18 09:01:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-18_01_01_39-15081869137154624735
2022/01/18 09:01:39 Job state: JOB_STATE_PENDING ...
2022/01/18 09:02:09 Job still running ...
2022/01/18 09:02:40 Job still running ...
2022/01/18 09:03:10 Job still running ...
2022/01/18 09:03:40 Job still running ...
2022/01/18 09:04:10 Job still running ...
2022/01/18 09:04:40 Job still running ...
2022/01/18 09:05:10 Failed to execute job: job 2022-01-18_01_01_39-15081869137154624735 failed
panic: Failed to execute job: job 2022-01-18_01_01_39-15081869137154624735 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144748, 0xc0000480b0, 0x10330e9, 0x19, 0xc0003d9df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://scans.gradle.com/s/7xbus6sp4vhj4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #394
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/394/display/redirect>
Changes:
------------------------------------------
[...truncated 25.64 KB...]
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/17 08:59:36 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642409976412887009/model
2022/01/17 08:59:36 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0117065616"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642409976412887009/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642409976412887009/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0117065616",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/17 08:59:37 Submitted job: 2022-01-17_00_59_37-3611793586977292042
2022/01/17 08:59:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-17_00_59_37-3611793586977292042?project=apache-beam-testing
2022/01/17 08:59:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-17_00_59_37-3611793586977292042
2022/01/17 08:59:37 Job state: JOB_STATE_PENDING ...
2022/01/17 09:00:07 Job still running ...
2022/01/17 09:00:37 Job still running ...
2022/01/17 09:01:07 Job still running ...
2022/01/17 09:01:37 Job still running ...
2022/01/17 09:02:07 Job still running ...
2022/01/17 09:02:37 Job still running ...
2022/01/17 09:03:07 Failed to execute job: job 2022-01-17_00_59_37-3611793586977292042 failed
panic: Failed to execute job: job 2022-01-17_00_59_37-3611793586977292042 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144748, 0xc0000480b0, 0x10330e9, 0x19, 0xc00061bdf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://scans.gradle.com/s/z5q7ptlyz4z4y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #393
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/393/display/redirect>
Changes:
------------------------------------------
[...truncated 25.70 KB...]
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/16 08:59:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642323579420460445/model
2022/01/16 08:59:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0116065616"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642323579420460445/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642323579420460445/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0116065616",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/16 08:59:40 Submitted job: 2022-01-16_00_59_40-5744110305294430215
2022/01/16 08:59:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-16_00_59_40-5744110305294430215?project=apache-beam-testing
2022/01/16 08:59:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-16_00_59_40-5744110305294430215
2022/01/16 08:59:40 Job state: JOB_STATE_PENDING ...
2022/01/16 09:00:10 Job still running ...
2022/01/16 09:00:40 Job still running ...
2022/01/16 09:01:10 Job still running ...
2022/01/16 09:01:40 Job still running ...
2022/01/16 09:02:11 Job still running ...
2022/01/16 09:02:41 Job still running ...
2022/01/16 09:03:11 Job still running ...
2022/01/16 09:03:41 Failed to execute job: job 2022-01-16_00_59_40-5744110305294430215 failed
panic: Failed to execute job: job 2022-01-16_00_59_40-5744110305294430215 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144748, 0xc0000480b0, 0x10330e9, 0x19, 0xc0003fbdf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://scans.gradle.com/s/hdsy2sjde3hza
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #392
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/392/display/redirect?page=changes>
Changes:
[daria.malkova] Split builder into several builder for each step of pipeline execution
[Valentyn Tymofieiev] Provide API to check whether a hint is known.
[Valentyn Tymofieiev] [BEAM-12558] Fix doc typo.
[arietis27] [BEAM-13400] JDBC IO does not support UUID and JSONB PostgreSQL types
[noreply] [BEAM-12572] Run java examples on multiple runners (#16450)
[jrmccluskey] [BEAM-10206] Resolve go vet errors in protox package
[noreply] Merge pull request #16482 from [BEAM-13429][Playground] Add builder for
[noreply] [BEAM-13590] Fix abc imports from collections (#15850)
[jrmccluskey] Fix staticcheck errors in transforms directory
[jrmccluskey] Remove unnecessary fmt.Sprintf() in partition.go
[jrmccluskey] Replace bytes.Compare() with bytes.Equal() in test cases
[jrmccluskey] Replace string(buf.Bytes()) with buf.String() in coder_test.go
[jrmccluskey] Remove unnecessary blank identifier assignment in harness.go
[jrmccluskey] fix capitalized error strings in expansionx
[jrmccluskey] Clean up string cast of bytes in vet.go and corresponding tests
[jrmccluskey] Remove unnecessary fmt call in universal.go
[Robert Bradshaw] Remove tab from source.
[noreply] Redirecting cross-language transforms content (#16504)
[noreply] doc tweaks (#16498)
[noreply] [BEAM-12621] - Update Jenkins VMs to modern Ubuntu version (#16457)
[noreply] [BEAM-13664] Fix Primitives hashing benchmark (#16523)
------------------------------------------
[...truncated 25.64 KB...]
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/15 08:59:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642237178691213175/model
2022/01/15 08:59:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0115065611"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642237178691213175/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642237178691213175/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0115065611",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/15 08:59:40 Submitted job: 2022-01-15_00_59_39-14151540608493401186
2022/01/15 08:59:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-15_00_59_39-14151540608493401186?project=apache-beam-testing
2022/01/15 08:59:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-15_00_59_39-14151540608493401186
2022/01/15 08:59:40 Job state: JOB_STATE_PENDING ...
2022/01/15 09:00:10 Job still running ...
2022/01/15 09:00:40 Job still running ...
2022/01/15 09:01:10 Job still running ...
2022/01/15 09:01:40 Job still running ...
2022/01/15 09:02:10 Job still running ...
2022/01/15 09:02:40 Job still running ...
2022/01/15 09:03:10 Failed to execute job: job 2022-01-15_00_59_39-14151540608493401186 failed
panic: Failed to execute job: job 2022-01-15_00_59_39-14151540608493401186 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144748, 0xc0000480b0, 0x10330e9, 0x19, 0xc00040ddf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://scans.gradle.com/s/i7u7bju33nmkk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #391
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/391/display/redirect?page=changes>
Changes:
[blais] python sdk examples: Fixed typo in wordcount example.
[noreply] [BEAM-13480] Increase pipeline timeout for
[noreply] Stronger typing inference for CoGBK. (#16465)
[noreply] [BEAM-12464] Change ProtoSchemaTranslator beam schema creation to match
[noreply] Introduce the notion of a JoinIndex for fewer shuffles. (#16101)
[noreply] Merge pull request #16467 from [BEAM-12164]: SpannerIO
[noreply] Merge pull request #16385 from [BEAM-13535] [Playground] add cancel
[noreply] Merge pull request #16485 from [BEAM-13486] [Playground] For unit tests
[heejong] [BEAM-13455] Remove duplicated artifacts when using multiple
------------------------------------------
[...truncated 25.82 KB...]
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/14 08:59:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642150779400191568/model
2022/01/14 08:59:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0114065616"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642150779400191568/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642150779400191568/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0114065616",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/14 08:59:40 Submitted job: 2022-01-14_00_59_40-14939887816473866691
2022/01/14 08:59:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-14_00_59_40-14939887816473866691?project=apache-beam-testing
2022/01/14 08:59:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-14_00_59_40-14939887816473866691
2022/01/14 08:59:40 Job state: JOB_STATE_PENDING ...
2022/01/14 09:00:10 Job still running ...
2022/01/14 09:00:40 Job still running ...
2022/01/14 09:01:10 Job still running ...
2022/01/14 09:01:40 Job still running ...
2022/01/14 09:02:11 Job still running ...
2022/01/14 09:02:41 Job still running ...
2022/01/14 09:03:11 Job still running ...
2022/01/14 09:03:41 Job still running ...
2022/01/14 09:04:11 Job still running ...
2022/01/14 09:04:41 Job still running ...
2022/01/14 09:05:11 Failed to execute job: job 2022-01-14_00_59_40-14939887816473866691 failed
panic: Failed to execute job: job 2022-01-14_00_59_40-14939887816473866691 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144748, 0xc0000480b0, 0x10330e9, 0x19, 0xc000357df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/msuenyq2epqu6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #390
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/390/display/redirect?page=changes>
Changes:
[mmack] [BEAM-13638] Datatype of timestamp fields in SqsMessage for AWS IOs for
[noreply] Merge pull request #16469 from [BEAM-13623][Playground] [Bugfix] During
[noreply] Merge pull request #16149 from [BEAM-13113] [Playground] playground
[noreply] Merge pull request #16363 from [BEAM-13557] [Playground] show code
[noreply] Merge pull request #16374 from [BEAM-13398][Playground] Split LifeCycle
[noreply] [BEAM-13616][BEAM-13646] Update vendored calcite 1.28.0 with protobuf
[chamikaramj] Adds several example multi-language Python pipelines
[noreply] Merge pull request #16325 from [BEAM-13471] [Playground] Tag existing
[noreply] [BEAM-13399] Move service liveness polling to Runner type (#16487)
------------------------------------------
[...truncated 25.59 KB...]
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/13 08:59:29 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642064368593974717/model
2022/01/13 08:59:29 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0113065621"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642064368593974717/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642064368593974717/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0113065621",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/13 08:59:29 Submitted job: 2022-01-13_00_59_29-5063960648188893845
2022/01/13 08:59:29 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-13_00_59_29-5063960648188893845?project=apache-beam-testing
2022/01/13 08:59:29 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-13_00_59_29-5063960648188893845
2022/01/13 08:59:29 Job state: JOB_STATE_PENDING ...
2022/01/13 08:59:59 Job still running ...
2022/01/13 09:00:30 Job still running ...
2022/01/13 09:01:00 Job still running ...
2022/01/13 09:01:30 Job still running ...
2022/01/13 09:02:00 Job still running ...
2022/01/13 09:02:30 Job still running ...
2022/01/13 09:03:00 Failed to execute job: job 2022-01-13_00_59_29-5063960648188893845 failed
panic: Failed to execute job: job 2022-01-13_00_59_29-5063960648188893845 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144748, 0xc000120000, 0x10330e9, 0x19, 0xc00041ddf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 40s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/tkjonbn5igwho
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #389
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/389/display/redirect?page=changes>
Changes:
[ningkang0957] [BEAM-13602] Prevented metrics gathering from failing bigtable io
[ningkang0957] make the code more pythonic
[mmack] [BEAM-13243][BEAM-8374] Add support for missing PublishResponse fields
[Robert Bradshaw] Optional args and kwargs for named external transforms.
[mmack] [adhoc] Run spotlessApply on java examples to fix master
[noreply] [BEAM-13628] Update SideInputCache to use full Transform and
[noreply] [BEAM-13432] Skip ExpansionService creation in Job Server (#16222)
[noreply] [BEAM-13616] Initial files for vendored gRPC 1.43.2 (#16460)
------------------------------------------
[...truncated 26.51 KB...]
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/12 08:59:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641977978399147560/model
2022/01/12 08:59:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0112082747"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641977978399147560/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641977978399147560/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0112082747",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/12 08:59:39 Submitted job: 2022-01-12_00_59_39-42672477098026782
2022/01/12 08:59:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-12_00_59_39-42672477098026782?project=apache-beam-testing
2022/01/12 08:59:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-12_00_59_39-42672477098026782
2022/01/12 08:59:39 Job state: JOB_STATE_PENDING ...
2022/01/12 09:00:10 Job still running ...
2022/01/12 09:00:40 Job still running ...
2022/01/12 09:01:10 Job still running ...
2022/01/12 09:01:40 Job still running ...
2022/01/12 09:02:10 Job still running ...
2022/01/12 09:02:40 Job still running ...
2022/01/12 09:03:10 Job still running ...
2022/01/12 09:03:40 Job still running ...
2022/01/12 09:04:10 Job still running ...
2022/01/12 09:04:40 Job still running ...
2022/01/12 09:05:10 Failed to execute job: job 2022-01-12_00_59_39-42672477098026782 failed
panic: Failed to execute job: job 2022-01-12_00_59_39-42672477098026782 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144748, 0xc000120000, 0x10330e9, 0x19, 0xc0004a9df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
Publishing failed.
The build scan server appears to be unavailable.
Please check https://status.gradle.com for the latest service status.
If the service is reported as available, please report this problem via https://gradle.com/help/plugin and include the following via copy/paste:
----------
Gradle version: 7.3.2
Plugin version: 3.4.1
Request URL: https://status.gradle.com
Request ID: 15a0617a-acd3-4169-85e3-c9fbfcc9ce06
Response status code: 405
Response server type: Varnish
----------
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #388
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/388/display/redirect?page=changes>
Changes:
[Alexey Romanenko] [BEAM-8727] Bump software.amazon.awssdk to 2.17.106
[relax] don't close streams in finalize
[noreply] Loosen typing extensions bound
[Alexey Romanenko] [BEAM-4868] Bump com.amazonaws to 1.12.135
[noreply] [BEAM-12092] Bump jedis to version 4.0.1 (#16287)
[noreply] [BEAM-13534] Add automated port polling to expansion service runner if
[noreply] Merge pull request #16344 from [BEAM-13536][Playground][Bugfix] CI step
[noreply] Merge pull request #16359 from [BEAM-13545][Playground] Add
[noreply] Merge pull request #16384 from [BEAM-13308] [Playground] Getting
[noreply] Merge pull request #16306 from [BEAM-13447] [Playground] Add filling of
[noreply] Merge pull request #16361 from [BEAM-13543][Playground] Add logic of
[noreply] [BEAM-12562] Dataframe pipe implementation (#16256)
[noreply] Merge pull request #16338 from [BEAM-13528][Playground] Add liveness
[noreply] [BEAM-13626] Remap expanded outputs after merging. (#16471)
[noreply] Merge pull request #16147 from [BEAM-13359] [Playground] Tag existing
[noreply] [BEAM-3221] Improve documentation in model pipeline protos (#16474)
[noreply] [BEAM-13614] Add OnWindowExpiration support to the Java SDK harness and
[noreply] Merge pull request #16156 from [BEAM-13391] Fix temporary file format in
------------------------------------------
[...truncated 25.69 KB...]
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/11 08:59:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641891580056908241/model
2022/01/11 08:59:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0111074027"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641891580056908241/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641891580056908241/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0111074027",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/11 08:59:41 Submitted job: 2022-01-11_00_59_40-10945296663225257383
2022/01/11 08:59:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-11_00_59_40-10945296663225257383?project=apache-beam-testing
2022/01/11 08:59:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-11_00_59_40-10945296663225257383
2022/01/11 08:59:41 Job state: JOB_STATE_PENDING ...
2022/01/11 09:00:11 Job state: JOB_STATE_PENDING ...
2022/01/11 09:00:41 Job still running ...
2022/01/11 09:01:11 Job still running ...
2022/01/11 09:01:41 Job still running ...
2022/01/11 09:02:11 Job still running ...
2022/01/11 09:02:41 Job still running ...
2022/01/11 09:03:11 Job still running ...
2022/01/11 09:03:42 Failed to execute job: job 2022-01-11_00_59_40-10945296663225257383 failed
panic: Failed to execute job: job 2022-01-11_00_59_40-10945296663225257383 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11433c8, 0xc0000480b0, 0x1031ec9, 0x19, 0xc0003e7df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 21s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/pkkzmco75yvk4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #387
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/387/display/redirect>
Changes:
------------------------------------------
[...truncated 25.64 KB...]
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/10 08:59:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641805179851941599/model
2022/01/10 08:59:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0110065606"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641805179851941599/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641805179851941599/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0110065606",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/10 08:59:41 Submitted job: 2022-01-10_00_59_40-5084674933680863537
2022/01/10 08:59:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-10_00_59_40-5084674933680863537?project=apache-beam-testing
2022/01/10 08:59:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-10_00_59_40-5084674933680863537
2022/01/10 08:59:41 Job state: JOB_STATE_PENDING ...
2022/01/10 09:00:11 Job still running ...
2022/01/10 09:00:41 Job still running ...
2022/01/10 09:01:11 Job still running ...
2022/01/10 09:01:41 Job still running ...
2022/01/10 09:02:11 Job still running ...
2022/01/10 09:02:41 Job still running ...
2022/01/10 09:03:11 Failed to execute job: job 2022-01-10_00_59_40-5084674933680863537 failed
panic: Failed to execute job: job 2022-01-10_00_59_40-5084674933680863537 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11433c8, 0xc0000480b0, 0x1031ec9, 0x19, 0xc0004e5df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vch2yodwgeazm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #386
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/386/display/redirect>
Changes:
------------------------------------------
[...truncated 25.87 KB...]
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/09 08:59:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641718779279349644/model
2022/01/09 08:59:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0109065617"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641718779279349644/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641718779279349644/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0109065617",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/09 08:59:40 Submitted job: 2022-01-09_00_59_40-2068432144724091721
2022/01/09 08:59:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-09_00_59_40-2068432144724091721?project=apache-beam-testing
2022/01/09 08:59:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-09_00_59_40-2068432144724091721
2022/01/09 08:59:40 Job state: JOB_STATE_PENDING ...
2022/01/09 09:00:10 Job still running ...
2022/01/09 09:00:40 Job still running ...
2022/01/09 09:01:10 Job still running ...
2022/01/09 09:01:41 Job still running ...
2022/01/09 09:02:11 Job still running ...
2022/01/09 09:02:41 Job still running ...
2022/01/09 09:03:11 Job still running ...
2022/01/09 09:03:41 Job still running ...
2022/01/09 09:04:11 Job still running ...
2022/01/09 09:04:41 Job still running ...
2022/01/09 09:05:11 Job still running ...
2022/01/09 09:05:41 Failed to execute job: job 2022-01-09_00_59_40-2068432144724091721 failed
panic: Failed to execute job: job 2022-01-09_00_59_40-2068432144724091721 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11433c8, 0xc000120000, 0x1031ec9, 0x19, 0xc0003eddf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 20s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/kd5s7kebtrv7y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #385
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/385/display/redirect?page=changes>
Changes:
[Alexey Romanenko] [adhoc] Fix BigTableIO description
[noreply] [BEAM-13015] Remove dead code now that all instances have migrated to
[noreply] [BEAM-13386] Add RLock support for cloudpickle (#16250)
[danthev] Fix overflow
------------------------------------------
[...truncated 25.81 KB...]
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/08 08:59:27 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641632367124924953/model
2022/01/08 08:59:27 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0108065631"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641632367124924953/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641632367124924953/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0108065631",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/08 08:59:28 Submitted job: 2022-01-08_00_59_27-6231356489731091025
2022/01/08 08:59:28 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-08_00_59_27-6231356489731091025?project=apache-beam-testing
2022/01/08 08:59:28 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-08_00_59_27-6231356489731091025
2022/01/08 08:59:28 Job state: JOB_STATE_PENDING ...
2022/01/08 08:59:58 Job still running ...
2022/01/08 09:00:28 Job still running ...
2022/01/08 09:00:58 Job still running ...
2022/01/08 09:01:28 Job still running ...
2022/01/08 09:01:58 Job still running ...
2022/01/08 09:02:28 Job still running ...
2022/01/08 09:02:58 Job still running ...
2022/01/08 09:03:28 Job still running ...
2022/01/08 09:03:58 Job still running ...
2022/01/08 09:04:28 Job still running ...
2022/01/08 09:04:58 Job still running ...
2022/01/08 09:05:29 Failed to execute job: job 2022-01-08_00_59_27-6231356489731091025 failed
panic: Failed to execute job: job 2022-01-08_00_59_27-6231356489731091025 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11433c8, 0xc0000480b0, 0x1031ec9, 0x19, 0xc0003f5df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 9s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/fnijh7e66llia
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #384
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/384/display/redirect?page=changes>
Changes:
[heejong] [BEAM-13091] Generate missing staged names from hash for Dataflow runner
[heejong] add test
[arietis27] [BEAM-13604] NPE while getting null from BigDecimal column
[noreply] Fixed empty labels treated as wildcard when matching cache files
[noreply] [BEAM-13570] Remove erroneous compileClasspath dependency. (#16438)
[noreply] [BEAM-13015] Plumb through process wide and bundle cache through the
[noreply] [BEAM-13015] Cache the state backed iterable used for large GBK results.
[noreply] Fix formatting/alignment (#16443)
[noreply] Merge pull request #16183 from [BEAM-13427] [Playground] show logs for
[noreply] [BEAM-10277] re-write encoding position tests to declare schema protos
[noreply] Update local_env_tests.yml (#16444)
[noreply] [BEAM-13574] Filesystem abstraction Rename support (#16428)
[noreply] [BEAM-13597] Setup Go in github actions (#16446)
[noreply] Merge pull request #16161 from [BEAM-12164] Add Spanner Partition
[noreply] Merge pull request #16203 from [BEAM-12164] Add Spanner Change Stream
------------------------------------------
[...truncated 25.79 KB...]
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/07 08:59:29 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641545968837191470/model
2022/01/07 08:59:29 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0107065640"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641545968837191470/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641545968837191470/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0107065640",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/07 08:59:30 Submitted job: 2022-01-07_00_59_29-3958099359411197756
2022/01/07 08:59:30 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-07_00_59_29-3958099359411197756?project=apache-beam-testing
2022/01/07 08:59:30 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-07_00_59_29-3958099359411197756
2022/01/07 08:59:30 Job state: JOB_STATE_PENDING ...
2022/01/07 09:00:00 Job still running ...
2022/01/07 09:00:30 Job still running ...
2022/01/07 09:01:00 Job still running ...
2022/01/07 09:01:30 Job still running ...
2022/01/07 09:02:00 Job still running ...
2022/01/07 09:02:30 Job still running ...
2022/01/07 09:03:00 Job still running ...
2022/01/07 09:03:30 Job still running ...
2022/01/07 09:04:00 Job still running ...
2022/01/07 09:04:31 Job still running ...
2022/01/07 09:05:01 Failed to execute job: job 2022-01-07_00_59_29-3958099359411197756 failed
panic: Failed to execute job: job 2022-01-07_00_59_29-3958099359411197756 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11433c8, 0xc000120000, 0x1031ec9, 0x19, 0xc00040ddf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 41s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/os3r344cghjxk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #383
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/383/display/redirect?page=changes>
Changes:
[aydar.zaynutdinov] [BEAM-13565][Playground]
[relax] update bom
[zyichi] Upgrade python library versions in base_image_requirements.txt
[noreply] [BEAM-13567] Consolidate runner flag definition. (#16426)
[noreply] [BEAM-13601] Don't cache Row types for a schema. (#16427)
[noreply] [BEAM-13430] Re-enable checkerframework (#16429)
[noreply] [BEAM-13430] Ensure that testRuntimeMigration depends on "default"
[noreply] Merge pull request #16277 from [BEAM-13124][Playground] Create readiness
[noreply] Merge pull request #16314 from [BEAM-13260][Playground]Implement setup
[noreply] Merge pull request #16383 from [BEAM-13566][Playground] Add logic of
[noreply] Merge pull request #16365 from [BEAM-13559][Playground] Remove tag in
[noreply] Merge pull request #16360 from [BEAM-13546][Playground] Update nginx
[noreply] Merge pull request #16192 from [BEAM-13395] [Playground] Tag katas
[noreply] Merge pull request #16254 from [BEAM-13249][Playground] Security – Mock
[ningkang0957] [BEAM-12879] Prevented missing permission from failing GCS I/O
[noreply] Merge pull request #16347: fix: move connector to use v1 BigQuery
[noreply] [BEAM-13603] Fix bug in apache_beam.utils.Shared (#16437)
[noreply] [BEAM-10345] Add an import guard to support recent google-cloud-spanner
------------------------------------------
[...truncated 25.93 KB...]
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/06 08:59:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641459579366082454/model
2022/01/06 08:59:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0106072422"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641459579366082454/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641459579366082454/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0106072422",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/06 08:59:41 Submitted job: 2022-01-06_00_59_40-11039436874163030921
2022/01/06 08:59:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-06_00_59_40-11039436874163030921?project=apache-beam-testing
2022/01/06 08:59:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-06_00_59_40-11039436874163030921
2022/01/06 08:59:41 Job state: JOB_STATE_PENDING ...
2022/01/06 09:00:11 Job still running ...
2022/01/06 09:00:41 Job still running ...
2022/01/06 09:01:11 Job still running ...
2022/01/06 09:01:41 Job still running ...
2022/01/06 09:02:11 Job still running ...
2022/01/06 09:02:41 Job still running ...
2022/01/06 09:03:11 Job still running ...
2022/01/06 09:03:41 Job still running ...
2022/01/06 09:04:11 Job still running ...
2022/01/06 09:04:41 Job still running ...
2022/01/06 09:05:11 Job still running ...
2022/01/06 09:05:42 Failed to execute job: job 2022-01-06_00_59_40-11039436874163030921 failed
panic: Failed to execute job: job 2022-01-06_00_59_40-11039436874163030921 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1142028, 0xc0000480b0, 0x1030e03, 0x19, 0xc0008afdf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 22s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/mgvbgix73cidm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #382
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/382/display/redirect?page=changes>
Changes:
[johnjcasey] [BEAM-12391] update avro sink to close the opened file handle, instead
[Robert Bradshaw] [BEAM-13482] Python fully qualified name external transforms.
[Robert Bradshaw] Add Python expansion service entry point.
[Kyle Weaver] [BEAM-13569] Change Spark dependencies to implementation.
[Kyle Weaver] remove redundant dependency
[wuren] [BEAM-13591] Bump log4j2 version to 2.17.1
[Steve Niemitz] [BEAM-13459] Update CHANGES.md, add note about artifact caching for
[relax] Add Flink runner support for OrderedListState. This version reads the
[noreply] Merge pull request #16404: [BEAM-13586] Fix NPE in
[zyichi] Fix sdk_container_builder too many values to unpack error
[noreply] [BEAM-13480] Sickbay PubSubIntegrationTest.test_streaming_data_only on
[Kyle Weaver] remove redundant testImplementation dependencies
[noreply] [BEAM-13430] Swap to use "mainClass" instead of "main" since it was
[zyichi] Fix remaining failing perf IT tests.
[noreply] [BEAM-13430] Replace deprecated "appendix" with "archiveAppendix"
[noreply] [BEAM-13015] Add jamm as a java agent to the Java SDK harness container
[noreply] [BEAM-13430] Partially revert
[noreply] Merge pull request #15863 from [BEAM-13184] Autosharding for
[noreply] [BEAM-11936] Enable FloatingPointAssertionWithinEpsilon errorprone check
[noreply] [BEAM-11936] Enable LockNotBeforeTry errorprone check (#16259)
[noreply] [BEAM-11936] Enable errorprone unused checks (#16262)
[noreply] Add Nexmark Query 14 (#16337)
[noreply] [BEAM-13015] Migrate all user state and side implementations to support
[noreply] [BEAM-13015] Use 20% of memory when the maximum has been configured.
------------------------------------------
[...truncated 25.68 KB...]
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/05 08:59:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641373176503523377/model
2022/01/05 08:59:37 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0105065639"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641373176503523377/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641373176503523377/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0105065639",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/05 08:59:37 Submitted job: 2022-01-05_00_59_37-1723528755717707213
2022/01/05 08:59:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-05_00_59_37-1723528755717707213?project=apache-beam-testing
2022/01/05 08:59:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-05_00_59_37-1723528755717707213
2022/01/05 08:59:37 Job state: JOB_STATE_PENDING ...
2022/01/05 09:00:07 Job still running ...
2022/01/05 09:00:37 Job still running ...
2022/01/05 09:01:07 Job still running ...
2022/01/05 09:01:38 Job still running ...
2022/01/05 09:02:08 Job still running ...
2022/01/05 09:02:38 Job still running ...
2022/01/05 09:03:08 Failed to execute job: job 2022-01-05_00_59_37-1723528755717707213 failed
panic: Failed to execute job: job 2022-01-05_00_59_37-1723528755717707213 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1142028, 0xc0000480b0, 0x1030e03, 0x19, 0xc0002dbdf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/jhlj2qj43wwlo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #381
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/381/display/redirect?page=changes>
Changes:
[mmack] [BEAM-13509] Stop sharing SQS client between readers of same source.
[mmack] [BEAM-13587] Attempt to load AWS region from default provider chain in
------------------------------------------
[...truncated 25.68 KB...]
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/04 08:59:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641286777916814251/model
2022/01/04 08:59:38 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0104065634"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641286777916814251/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641286777916814251/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0104065634",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/04 08:59:39 Submitted job: 2022-01-04_00_59_38-12026932014996957408
2022/01/04 08:59:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-04_00_59_38-12026932014996957408?project=apache-beam-testing
2022/01/04 08:59:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-04_00_59_38-12026932014996957408
2022/01/04 08:59:39 Job state: JOB_STATE_PENDING ...
2022/01/04 09:00:09 Job still running ...
2022/01/04 09:00:39 Job still running ...
2022/01/04 09:01:09 Job still running ...
2022/01/04 09:01:39 Job still running ...
2022/01/04 09:02:09 Job still running ...
2022/01/04 09:02:39 Job still running ...
2022/01/04 09:03:09 Failed to execute job: job 2022-01-04_00_59_38-12026932014996957408 failed
panic: Failed to execute job: job 2022-01-04_00_59_38-12026932014996957408 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1142028, 0xc000128000, 0x1030e03, 0x19, 0xc000619df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/2mvs4zl3uhij4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #380
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/380/display/redirect>
Changes:
------------------------------------------
[...truncated 25.66 KB...]
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/03 08:59:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641200378606216863/model
2022/01/03 08:59:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0103065618"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641200378606216863/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641200378606216863/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0103065618",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/03 08:59:39 Submitted job: 2022-01-03_00_59_39-14465236398592392286
2022/01/03 08:59:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-03_00_59_39-14465236398592392286?project=apache-beam-testing
2022/01/03 08:59:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-03_00_59_39-14465236398592392286
2022/01/03 08:59:39 Job state: JOB_STATE_PENDING ...
2022/01/03 09:00:10 Job still running ...
2022/01/03 09:00:40 Job still running ...
2022/01/03 09:01:10 Job still running ...
2022/01/03 09:01:40 Job still running ...
2022/01/03 09:02:10 Job still running ...
2022/01/03 09:02:40 Job still running ...
2022/01/03 09:03:10 Failed to execute job: job 2022-01-03_00_59_39-14465236398592392286 failed
panic: Failed to execute job: job 2022-01-03_00_59_39-14465236398592392286 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1142028, 0xc0000480b0, 0x1030e03, 0x19, 0xc00028ddf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/fxpyfo6su2au6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #379
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/379/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13498, BEAM-13522] Sickbay broken test and test category for Spark
------------------------------------------
[...truncated 25.93 KB...]
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/02 14:14:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641132877429924010/model
2022/01/02 14:14:37 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0102135316"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641132877429924010/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641132877429924010/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0102135316",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/02 14:14:38 Submitted job: 2022-01-02_06_14_37-4081768944932742771
2022/01/02 14:14:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-02_06_14_37-4081768944932742771?project=apache-beam-testing
2022/01/02 14:14:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-02_06_14_37-4081768944932742771
2022/01/02 14:14:38 Job state: JOB_STATE_PENDING ...
2022/01/02 14:15:08 Job still running ...
2022/01/02 14:15:38 Job still running ...
2022/01/02 14:16:08 Job still running ...
2022/01/02 14:16:38 Job still running ...
2022/01/02 14:17:08 Job still running ...
2022/01/02 14:17:38 Job still running ...
2022/01/02 14:18:08 Job still running ...
2022/01/02 14:18:38 Job still running ...
2022/01/02 14:19:08 Job still running ...
2022/01/02 14:19:38 Job still running ...
2022/01/02 14:20:08 Job still running ...
2022/01/02 14:20:39 Failed to execute job: job 2022-01-02_06_14_37-4081768944932742771 failed
panic: Failed to execute job: job 2022-01-02_06_14_37-4081768944932742771 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1142028, 0xc000122000, 0x1030e03, 0x19, 0xc0003f7df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 23s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/gaufi7jwdecj2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #378
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/378/display/redirect?page=changes>
Changes:
[stranniknm] [BEAM-13555] playground - quick fix for safari
[noreply] Merge pull request #15769 from [BEAM-13031] [Playground] Code editor -
[noreply] [BEAM-13541] Fix spotbugs issue with DLS in tail (#16407)
[noreply] [BEAM-13588] Add missing module for PVR tests and also sickbay known
[noreply] [BEAM-13575] Sickbay test that is flaky to restore precommit test signal
[noreply] [BEAM-12092] Bump jedis to version 3.8.0 (#16403)
------------------------------------------
[...truncated 25.63 KB...]
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/01 08:59:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641027579903189545/model
2022/01/01 08:59:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0101065619"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641027579903189545/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641027579903189545/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0101065619",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/01 08:59:41 Submitted job: 2022-01-01_00_59_40-7217734334605409428
2022/01/01 08:59:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-01_00_59_40-7217734334605409428?project=apache-beam-testing
2022/01/01 08:59:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-01_00_59_40-7217734334605409428
2022/01/01 08:59:41 Job state: JOB_STATE_PENDING ...
2022/01/01 09:00:11 Job still running ...
2022/01/01 09:00:41 Job still running ...
2022/01/01 09:01:11 Job still running ...
2022/01/01 09:01:41 Job still running ...
2022/01/01 09:02:11 Job still running ...
2022/01/01 09:02:41 Job still running ...
2022/01/01 09:03:11 Failed to execute job: job 2022-01-01_00_59_40-7217734334605409428 failed
panic: Failed to execute job: job 2022-01-01_00_59_40-7217734334605409428 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1142028, 0xc0000480b0, 0x1030e03, 0x19, 0xc0002dfdf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/acmkqyncnvwlk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #377
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/377/display/redirect?page=changes>
Changes:
[mmack] [BEAM-13009] Fix tests to ensure absence of duplicates only per request
[mmack] [adhoc] Use predefined min/max combiners in SQS reader to gather stats
[zyichi] Fix class not found in perf integration tests.
[noreply] Update
[noreply] [BEAM-13430] Fix class not found error for example integration tests and
[noreply] [BEAM-13430] Re-enable dependency analysis for modules. (#16395)
[noreply] [BEAM-13484][Playground] Improve Terraform Scripts For Deploy
[noreply] [BEAM-13541] More intelligent caching of CoGBK values. (#16354)
------------------------------------------
[...truncated 25.65 KB...]
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/31 08:59:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640941178687402376/model
2021/12/31 08:59:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1231065623"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640941178687402376/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640941178687402376/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1231065623",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/31 08:59:39 Submitted job: 2021-12-31_00_59_39-17650493194405035767
2021/12/31 08:59:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-31_00_59_39-17650493194405035767?project=apache-beam-testing
2021/12/31 08:59:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-31_00_59_39-17650493194405035767
2021/12/31 08:59:39 Job state: JOB_STATE_PENDING ...
2021/12/31 09:00:10 Job still running ...
2021/12/31 09:00:40 Job still running ...
2021/12/31 09:01:10 Job still running ...
2021/12/31 09:01:40 Job still running ...
2021/12/31 09:02:10 Job still running ...
2021/12/31 09:02:40 Job still running ...
2021/12/31 09:03:10 Failed to execute job: job 2021-12-31_00_59_39-17650493194405035767 failed
panic: Failed to execute job: job 2021-12-31_00_59_39-17650493194405035767 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1142028, 0xc0000480b0, 0x1030e03, 0x19, 0xc0003e7df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/hv6aurlqoh3zw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #376
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/376/display/redirect?page=changes>
Changes:
[Steve Niemitz] [BEAM-13488] Work around bug in classpath detection
[noreply] [BEAM-13578] Validate that repeatable PipelineOptions need to be
[noreply] [BEAM-13430] Update comment over eclipse plugin. (#16387)
[zyichi] [BEAM-13430] Fix broken ULR validates runner tests
[noreply] Update venv creation commands in release scripts. (#16381)
[Steve Niemitz] [BEAM-13459] Cache artifacts across job runs on python+dataflow
[noreply] [BEAM-12777] Stable URL for current API docs (#16327)
[noreply] [BEAM-13539] correct resource override dependencies (#16392)
[Kyle Weaver] [BEAM-13581] Remove previous job name for Flink PVR precommit.
[emilyye] Moving to 2.37.0-SNAPSHOT on master branch.
[noreply] Release website update for Beam 2.35.0 (#16115)
[noreply] [BEAM-13430] Re-enable checkerframework for the project excluding the
------------------------------------------
[...truncated 25.89 KB...]
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/30 08:59:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640854779645890350/model
2021/12/30 08:59:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1230065639"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640854779645890350/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640854779645890350/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1230065639",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/30 08:59:40 Submitted job: 2021-12-30_00_59_40-12585401043044147103
2021/12/30 08:59:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-30_00_59_40-12585401043044147103?project=apache-beam-testing
2021/12/30 08:59:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-30_00_59_40-12585401043044147103
2021/12/30 08:59:40 Job state: JOB_STATE_PENDING ...
2021/12/30 09:00:10 Job still running ...
2021/12/30 09:00:41 Job still running ...
2021/12/30 09:01:11 Job still running ...
2021/12/30 09:01:41 Job still running ...
2021/12/30 09:02:11 Job still running ...
2021/12/30 09:02:41 Job still running ...
2021/12/30 09:03:11 Job still running ...
2021/12/30 09:03:41 Job still running ...
2021/12/30 09:04:11 Job still running ...
2021/12/30 09:04:41 Job still running ...
2021/12/30 09:05:11 Failed to execute job: job 2021-12-30_00_59_40-12585401043044147103 failed
panic: Failed to execute job: job 2021-12-30_00_59_40-12585401043044147103 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1142028, 0xc0000480b0, 0x1030e03, 0x19, 0xc000429df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/b4r6cefmwv3us
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #375
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/375/display/redirect?page=changes>
Changes:
[dpcollins] [BEAM-13402] Simplify PubsubLiteSink
[Kyle Weaver] [BEAM-13521] flink pvr batch precommit
[noreply] [BEAM-13526] Kafka.IO: make DeserializerProvider a public interface
[Kyle Weaver] [BEAM-13571] Fix ClassNotFound exception in Flink tests
[Kyle Weaver] [BEAM-13498] [BEAM-13573] exclude new tests on Flink
[noreply] Exclude UsesOnWindowExpiration by category from Dataflow v2 streaming
[noreply] [BEAM-13052] Increment pubsub python version and fix breakages. (#16126)
[noreply] [BEAM-13052] Add Pub/Sub Lite xlang transforms in python (#15727)
[noreply] [BEAM-13402] Version bump Pub/Sub Lite and implement changes to ensure
------------------------------------------
[...truncated 25.65 KB...]
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/29 08:59:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640768378473497973/model
2021/12/29 08:59:38 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1229065617"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640768378473497973/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640768378473497973/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1229065617",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/29 08:59:39 Submitted job: 2021-12-29_00_59_39-8055735862511887280
2021/12/29 08:59:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-29_00_59_39-8055735862511887280?project=apache-beam-testing
2021/12/29 08:59:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-29_00_59_39-8055735862511887280
2021/12/29 08:59:39 Job state: JOB_STATE_PENDING ...
2021/12/29 09:00:09 Job still running ...
2021/12/29 09:00:40 Job still running ...
2021/12/29 09:01:10 Job still running ...
2021/12/29 09:01:40 Job still running ...
2021/12/29 09:02:10 Job still running ...
2021/12/29 09:02:40 Job still running ...
2021/12/29 09:03:10 Failed to execute job: job 2021-12-29_00_59_39-8055735862511887280 failed
panic: Failed to execute job: job 2021-12-29_00_59_39-8055735862511887280 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1142028, 0xc0000480b0, 0x1030e03, 0x19, 0xc000353df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/kwaqef2y45ury
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #374
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/374/display/redirect?page=changes>
Changes:
[mmack] [adhoc] Forbid to import guava and others from org.testcontainers.shaded
------------------------------------------
[...truncated 25.68 KB...]
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/28 08:59:35 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640681974907806912/model
2021/12/28 08:59:35 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1228065602"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640681974907806912/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640681974907806912/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1228065602",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/28 08:59:36 Submitted job: 2021-12-28_00_59_35-1195593914105251422
2021/12/28 08:59:36 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-28_00_59_35-1195593914105251422?project=apache-beam-testing
2021/12/28 08:59:36 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-28_00_59_35-1195593914105251422
2021/12/28 08:59:36 Job state: JOB_STATE_PENDING ...
2021/12/28 09:00:06 Job still running ...
2021/12/28 09:00:36 Job still running ...
2021/12/28 09:01:06 Job still running ...
2021/12/28 09:01:36 Job still running ...
2021/12/28 09:02:06 Job still running ...
2021/12/28 09:02:36 Job still running ...
2021/12/28 09:03:06 Failed to execute job: job 2021-12-28_00_59_35-1195593914105251422 failed
panic: Failed to execute job: job 2021-12-28_00_59_35-1195593914105251422 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1142028, 0xc0000480b0, 0x1030e03, 0x19, 0xc00288fdf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 46s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/efd7fpnnrrszo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #373
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/373/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #16285 from [BEAM-13492][Playground] Update backend
------------------------------------------
[...truncated 25.67 KB...]
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/27 08:59:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640595577096749428/model
2021/12/27 08:59:37 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1227065612"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640595577096749428/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640595577096749428/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1227065612",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/27 08:59:38 Submitted job: 2021-12-27_00_59_37-8123255229017636385
2021/12/27 08:59:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-27_00_59_37-8123255229017636385?project=apache-beam-testing
2021/12/27 08:59:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-27_00_59_37-8123255229017636385
2021/12/27 08:59:38 Job state: JOB_STATE_PENDING ...
2021/12/27 09:00:08 Job still running ...
2021/12/27 09:00:38 Job still running ...
2021/12/27 09:01:08 Job still running ...
2021/12/27 09:01:38 Job still running ...
2021/12/27 09:02:08 Job still running ...
2021/12/27 09:02:38 Job still running ...
2021/12/27 09:03:08 Failed to execute job: job 2021-12-27_00_59_37-8123255229017636385 failed
panic: Failed to execute job: job 2021-12-27_00_59_37-8123255229017636385 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1142028, 0xc000120000, 0x1030e03, 0x19, 0xc00034bdf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/tjzu5bpgjmkbg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #372
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/372/display/redirect?page=changes>
Changes:
[alexander.zhuravlev] [BEAM-13530] Fixed scrollbar in the Output section
[noreply] Merge pull request #16355 from [BEAM-13529] [Playground] [Bugfix] Fix
[noreply] Fixed grammar error in Go ParDo function comments. (#16329)
------------------------------------------
[...truncated 25.88 KB...]
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/26 08:59:36 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640509175705844062/model
2021/12/26 08:59:36 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1226065621"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640509175705844062/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640509175705844062/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1226065621",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/26 08:59:36 Submitted job: 2021-12-26_00_59_36-9807148830025710008
2021/12/26 08:59:36 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-26_00_59_36-9807148830025710008?project=apache-beam-testing
2021/12/26 08:59:36 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-26_00_59_36-9807148830025710008
2021/12/26 08:59:37 Job state: JOB_STATE_PENDING ...
2021/12/26 09:00:07 Job still running ...
2021/12/26 09:00:37 Job still running ...
2021/12/26 09:01:07 Job still running ...
2021/12/26 09:01:37 Job still running ...
2021/12/26 09:02:07 Job still running ...
2021/12/26 09:02:37 Job still running ...
2021/12/26 09:03:07 Job still running ...
2021/12/26 09:03:37 Job still running ...
2021/12/26 09:04:07 Job still running ...
2021/12/26 09:04:37 Job still running ...
2021/12/26 09:05:07 Failed to execute job: job 2021-12-26_00_59_36-9807148830025710008 failed
panic: Failed to execute job: job 2021-12-26_00_59_36-9807148830025710008 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1142028, 0xc000128000, 0x1030e03, 0x19, 0xc000431df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 47s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/u6bz4wcfwvhza
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #371
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/371/display/redirect>
Changes:
------------------------------------------
[...truncated 25.63 KB...]
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/25 08:59:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640422777525701783/model
2021/12/25 08:59:38 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1225065619"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640422777525701783/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640422777525701783/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1225065619",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/25 08:59:38 Submitted job: 2021-12-25_00_59_38-1844922179111665606
2021/12/25 08:59:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-25_00_59_38-1844922179111665606?project=apache-beam-testing
2021/12/25 08:59:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-25_00_59_38-1844922179111665606
2021/12/25 08:59:38 Job state: JOB_STATE_PENDING ...
2021/12/25 09:00:08 Job still running ...
2021/12/25 09:00:38 Job still running ...
2021/12/25 09:01:08 Job still running ...
2021/12/25 09:01:38 Job still running ...
2021/12/25 09:02:08 Job still running ...
2021/12/25 09:02:39 Job still running ...
2021/12/25 09:03:09 Failed to execute job: job 2021-12-25_00_59_38-1844922179111665606 failed
panic: Failed to execute job: job 2021-12-25_00_59_38-1844922179111665606 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1142028, 0xc0000480b0, 0x1030e03, 0x19, 0xc000225df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/fns77nd572ipk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #370
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/370/display/redirect?page=changes>
Changes:
[alexander.zhuravlev] [BEAM-13489] Updated manifest.json and index.html to follow best
[arietis27] [BEAM-13517] Unable to write nulls to columns with logical types
[stranniknm] [BEAM-13531] playground - fetch example info only once
[mmack] [BEAM-7559] Add integration test for DynamoDBIO (SDK v2)
[mmack] [BEAM-7559] Add integration test for DynamoDBIO (SDK v1)
[noreply] [BEAM-13399] Disable expansion service integration test on Samza and
[noreply] [BEAM-13430] Upgrade beam to gradle 7.3.2 (#16319)
[noreply] Merge pull request #16320 from [BEAM-13512] [Playground] send request to
[noreply] Merge pull request #16209 from [Playground][BEAM-13304]Deploy Python
[noreply] Merge pull request #16105 from [BEAM-13328] [Playground] Add
[noreply] Merge pull request #16103 from [BEAM-13252] [Playground] Feedback Thumbs
[noreply] Better type inference for GroupBy. (#16318)
[noreply] [BEAM-13534] Update TestAutomatedExpansionService liveness check to not
[noreply] [BEAM-13490] Bump log4j version to 2.17.0 (#16276)
------------------------------------------
[...truncated 25.63 KB...]
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/24 08:59:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640336377011752774/model
2021/12/24 08:59:37 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1224065615"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640336377011752774/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640336377011752774/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1224065615",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/24 08:59:38 Submitted job: 2021-12-24_00_59_37-11818053315960750594
2021/12/24 08:59:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-24_00_59_37-11818053315960750594?project=apache-beam-testing
2021/12/24 08:59:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-24_00_59_37-11818053315960750594
2021/12/24 08:59:38 Job state: JOB_STATE_PENDING ...
2021/12/24 09:00:08 Job still running ...
2021/12/24 09:00:38 Job still running ...
2021/12/24 09:01:08 Job still running ...
2021/12/24 09:01:38 Job still running ...
2021/12/24 09:02:08 Job still running ...
2021/12/24 09:02:38 Job still running ...
2021/12/24 09:03:08 Failed to execute job: job 2021-12-24_00_59_37-11818053315960750594 failed
panic: Failed to execute job: job 2021-12-24_00_59_37-11818053315960750594 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1142028, 0xc0000480b0, 0x1030e03, 0x19, 0xc00026ddf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 47s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/jr4wrw5bzjfbe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #369
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/369/display/redirect?page=changes>
Changes:
[mmack] [BEAM-13494] Avoid draining Kinesis API limits & CPU when reading from
[arietis27] [BEAM-13517] Unable to write nulls to columns with logical types
[stranniknm] [BEAM-13501] playground - add log about processing and precompiled run
[noreply] Make S3 streaming more efficient (#15931)
[noreply] [Playground][BEAM-13358]Deploy Go service via Ci/CD (#16210)
[dpcollins] [BEAM-13430] Clean up tests that override the time of the JVM
[noreply] [BEAM-12830] Install go version w/host platform. (#16330)
[noreply] [BEAM-13399] Add extra time buffer to reduce likelihood of flake in
[noreply] [BEAM-12865] Fix triggering_frequency validation (#16315)
[noreply] [BEAM-13525] Sickbay new PardoTests for Dataflow V2 Java Streaming VR
[noreply] [BEAM-12830] Avoid flock and prepare task once. (OSX fix.) (#16333)
[noreply] Bump Python beam-master containers (#16332)
------------------------------------------
[...truncated 25.63 KB...]
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/23 08:59:29 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640249969132602249/model
2021/12/23 08:59:29 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1223065630"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640249969132602249/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640249969132602249/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1223065630",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/23 08:59:30 Submitted job: 2021-12-23_00_59_29-9596090596219628499
2021/12/23 08:59:30 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-23_00_59_29-9596090596219628499?project=apache-beam-testing
2021/12/23 08:59:30 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-23_00_59_29-9596090596219628499
2021/12/23 08:59:30 Job state: JOB_STATE_PENDING ...
2021/12/23 09:00:00 Job still running ...
2021/12/23 09:00:30 Job still running ...
2021/12/23 09:01:00 Job still running ...
2021/12/23 09:01:30 Job still running ...
2021/12/23 09:02:00 Job still running ...
2021/12/23 09:02:30 Job still running ...
2021/12/23 09:03:00 Job still running ...
2021/12/23 09:03:30 Job still running ...
2021/12/23 09:04:00 Job still running ...
2021/12/23 09:04:30 Job still running ...
2021/12/23 09:05:01 Job still running ...
2021/12/23 09:05:31 Failed to execute job: job 2021-12-23_00_59_29-9596090596219628499 failed
panic: Failed to execute job: job 2021-12-23_00_59_29-9596090596219628499 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1142028, 0xc000120000, 0x1030e03, 0x19, 0xc0007b5df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 9s
2 actionable tasks: 2 executed
Publishing build scan...
https://gradle.com/s/eymtuir66rmlm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #368
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/368/display/redirect?page=changes>
Changes:
[rsl4] [BEAM-13397] Bump numpy to 1.21 for M1 chip
[rsl4] re-generate requirements.txt
[Kyle Weaver] [BEAM-13498] Sickbay portable Flink testProcessElementSkew.
[stranniknm] [BEAM-13502]: fix loading example on embedded version
[noreply] [BEAM-13430] Start the process of upgrading the Gradle 7. (#16292)
[noreply] [BEAM-13430] Introduce new testRuntimeMigration configuration that
[noreply] Update flink cluster to use a supported dataproc version (1.2 -> 1.5)
[Robert Bradshaw] Add microbenchmark for row coder.
[noreply] [BEAM-13499] Add warning about hcatalog to release notes and javadoc
[Robert Bradshaw] Compile RowCoderImpl with Cython.
[Robert Bradshaw] RowCoder optimizations.
[Robert Bradshaw] Further optimizations for common case of components in order.
[noreply] [BEAM-13430] Remove propdeps and replace with compileOnly (#16308)
[Robert Bradshaw] Optimize rows with null fields.
[noreply] Merge pull request #16304 from [BEAM-13491] [Playground] Examples'
[noreply] Merge pull request #16283 from [BEAM-13448] [Playground] track run code
[noreply] Merge pull request #16244 from [BEAM-13463] [Playground] add retries to
[noreply] Merge pull request #16241 from [BEAM-13440] [Playground] Implement
[noreply] [BEAM-13399] Add integration test for Go SDK expansion service JAR
[noreply] [BEAM-13421] Fix bug with xs called with non-tuple key (#16258)
[Robert Bradshaw] RowCoder lint.
------------------------------------------
[...truncated 24.92 KB...]
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/22 08:59:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640163577704959837/model
2021/12/22 08:59:38 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1222065639"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640163577704959837/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640163577704959837/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1222065639",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/22 08:59:38 Submitted job: 2021-12-22_00_59_38-10077071849830523306
2021/12/22 08:59:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-22_00_59_38-10077071849830523306?project=apache-beam-testing
2021/12/22 08:59:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-22_00_59_38-10077071849830523306
2021/12/22 08:59:39 Job state: JOB_STATE_PENDING ...
2021/12/22 09:00:09 Job still running ...
2021/12/22 09:00:39 Job still running ...
2021/12/22 09:01:09 Job still running ...
2021/12/22 09:01:39 Job still running ...
2021/12/22 09:02:09 Job still running ...
2021/12/22 09:02:39 Job still running ...
2021/12/22 09:03:09 Job still running ...
2021/12/22 09:03:39 Job still running ...
2021/12/22 09:04:09 Job still running ...
2021/12/22 09:04:39 Job still running ...
2021/12/22 09:05:09 Job still running ...
2021/12/22 09:05:39 Failed to execute job: job 2021-12-22_00_59_38-10077071849830523306 failed
panic: Failed to execute job: job 2021-12-22_00_59_38-10077071849830523306 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1142028, 0xc0000480b0, 0x1030e03, 0x19, 0xc000315df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 18s
2 actionable tasks: 2 executed
Publishing build scan...
https://gradle.com/s/g3kkhyf57siy6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #367
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/367/display/redirect?page=changes>
Changes:
[benjamin.gonzalez] [BEAM-13088] Add parameter tempWriteDataset to BigQueryIO to store temp
[mmack] [BEAM-13233] Replace AWS API used to list shards from DescribeStream to
[stranniknm] [BEAM-13466]: sort categories and examples by name
[aydar.zaynutdinov] [BEAM-13485][Playground]
[alexander.zhuravlev] [BEAM-13476] Changed Timeout Error Text
[alexander.zhuravlev] [BEAM-13474] Changed 'Playground' logo text color
[mmack] [BEAM-13443] Avoid blocking put to Kinesis records queue to shutdown
[noreply] Merge pull request #16278 from [BEAM-13479] [Playground] Change logic
[noreply] Merge pull request #16281 from [BEAM-13475] [Playground] [Bugfix] Error
[noreply] Merge pull request #16279 from [BEAM-13473] [Playground] [Bugfix] Reset
[noreply] Merge pull request #16232 from [BEAM-13285][Playground] Add steps to
[noreply] [BEAM-13399] Add check for dev versions of JARs to download code
[noreply] Merge pull request #16122 from [BEAM-13345] [Playground] add resizable
[benjamin.gonzalez] [BEAM-13088] Make tempDataset final
[noreply] Merge pull request #16170 from [BEAM-13411][Playground] Add getting of
[noreply] Merge pull request #16172 from [BEAM-13417] [Playground] Add java
[noreply] Merge pull request #16240 from [BEAM-13465][Playground] Change error
[noreply] Merge pull request #16234 from [BEAM-13461][Playground] [Bugfix] Error
[noreply] Merge pull request #15489 from [BEAM-12865] Allow custom batch_duration
[noreply] [BEAM-13483] Increase timeout of Java Examples Dataflow suite. (#16226)
[Kyle Weaver] [BEAM-13496] Upgrade Flink runner to include log4j patches.
[Kyle Weaver] [BEAM-13497] Correct class name in Flink tests.
[noreply] Pin transitive log4j dependencies to 2.17.0 in :sdks:java:io:hcatalog
[noreply] [BEAM-13434] Bump solr to 8.11.1 (#16296)
[noreply] Use a patched shadow 6.1.0 plugin using Log4j 2.16.0 (#16269)
[noreply] [BEAM-12830] Replace GoGradle plugin with Shell Scripts. (#16291)
------------------------------------------
[...truncated 24.64 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/21 08:59:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640077193046100280/model
2021/12/21 08:59:53 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1221065607"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640077193046100280/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640077193046100280/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1221065607",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/21 08:59:57 Submitted job: 2021-12-21_00_59_53-16898302708175036597
2021/12/21 08:59:57 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-21_00_59_53-16898302708175036597?project=apache-beam-testing
2021/12/21 08:59:57 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-21_00_59_53-16898302708175036597
2021/12/21 08:59:57 Job state: JOB_STATE_PENDING ...
2021/12/21 09:00:27 Job still running ...
2021/12/21 09:00:57 Job still running ...
2021/12/21 09:01:27 Job still running ...
2021/12/21 09:01:57 Job still running ...
2021/12/21 09:02:27 Job still running ...
2021/12/21 09:02:57 Job still running ...
2021/12/21 09:03:27 Failed to execute job: job 2021-12-21_00_59_53-16898302708175036597 failed
panic: Failed to execute job: job 2021-12-21_00_59_53-16898302708175036597 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1142028, 0xc00011a000, 0x1030e03, 0x19, 0xc0003cfdf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 47s
2 actionable tasks: 2 executed
Publishing build scan...
https://gradle.com/s/vjgvdlx7vjqqu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #366
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/366/display/redirect>
Changes:
------------------------------------------
[...truncated 26.37 KB...]
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/20 08:59:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1639990788499520094/model
2021/12/20 08:59:49 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1220065605"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639990788499520094/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639990788499520094/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1220065605",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/20 08:59:49 Submitted job: 2021-12-20_00_59_49-6027854818115924970
2021/12/20 08:59:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-20_00_59_49-6027854818115924970?project=apache-beam-testing
2021/12/20 08:59:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-20_00_59_49-6027854818115924970
2021/12/20 08:59:49 Job state: JOB_STATE_PENDING ...
2021/12/20 09:00:19 Job still running ...
2021/12/20 09:00:49 Job still running ...
2021/12/20 09:01:19 Job still running ...
2021/12/20 09:01:50 Job still running ...
2021/12/20 09:02:20 Job still running ...
2021/12/20 09:02:50 Job still running ...
2021/12/20 09:03:20 Job still running ...
2021/12/20 09:03:50 Failed to execute job: job 2021-12-20_00_59_49-6027854818115924970 failed
panic: Failed to execute job: job 2021-12-20_00_59_49-6027854818115924970 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11400a8, 0xc000120000, 0x102fac5, 0x19, 0xc000589df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 31s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/y7o3zwmsgfkja
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #365
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/365/display/redirect>
Changes:
------------------------------------------
[...truncated 26.36 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/19 08:59:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1639904389189880275/model
2021/12/19 08:59:49 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1219065623"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639904389189880275/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639904389189880275/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1219065623",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/19 08:59:50 Submitted job: 2021-12-19_00_59_49-12166254756028901941
2021/12/19 08:59:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-19_00_59_49-12166254756028901941?project=apache-beam-testing
2021/12/19 08:59:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-19_00_59_49-12166254756028901941
2021/12/19 08:59:50 Job state: JOB_STATE_PENDING ...
2021/12/19 09:00:20 Job still running ...
2021/12/19 09:00:50 Job still running ...
2021/12/19 09:01:20 Job still running ...
2021/12/19 09:01:50 Job still running ...
2021/12/19 09:02:20 Job still running ...
2021/12/19 09:02:50 Job still running ...
2021/12/19 09:03:20 Failed to execute job: job 2021-12-19_00_59_49-12166254756028901941 failed
panic: Failed to execute job: job 2021-12-19_00_59_49-12166254756028901941 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11400a8, 0xc0000480b0, 0x102fac5, 0x19, 0xc000411df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 59s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/w33vqbq6l2sxi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #364
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/364/display/redirect?page=changes>
Changes:
[mmack] [adhoc] Fix guava imports in tests
------------------------------------------
[...truncated 26.36 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/18 08:59:48 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1639817988216631698/model
2021/12/18 08:59:48 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1218065608"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639817988216631698/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639817988216631698/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1218065608",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/18 08:59:49 Submitted job: 2021-12-18_00_59_48-17736997358752366228
2021/12/18 08:59:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-18_00_59_48-17736997358752366228?project=apache-beam-testing
2021/12/18 08:59:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-18_00_59_48-17736997358752366228
2021/12/18 08:59:49 Job state: JOB_STATE_PENDING ...
2021/12/18 09:00:19 Job still running ...
2021/12/18 09:00:49 Job still running ...
2021/12/18 09:01:19 Job still running ...
2021/12/18 09:01:49 Job still running ...
2021/12/18 09:02:19 Job still running ...
2021/12/18 09:02:49 Job still running ...
2021/12/18 09:03:19 Failed to execute job: job 2021-12-18_00_59_48-17736997358752366228 failed
panic: Failed to execute job: job 2021-12-18_00_59_48-17736997358752366228 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11400a8, 0xc000128000, 0x102fac5, 0x19, 0xc0004b5df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 58s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/e5oxnwoejajtu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #363
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/363/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #16061 from [BEAM-13428] [Playground] Integrate
[noreply] Clarify CoGroupByKey creates Iterable, not list. (#16099)
[noreply] [BEAM-12931] Allow for DoFn#getAllowedTimestampSkew() when checking the
[noreply] [BEAM-13467] Properly handle null argument types for logical types.
[noreply] [BEAM-10277] Initial implementation for encoding position in Python
[noreply] [BEAM-11545] State & timer for batched RPC calls pattern (#13643)
[noreply] Automatically prune local images before building an RC. (#16238)
[noreply] Add verbose error messages to container-related scripts. (#16056)
[noreply] [BEAM-13456] Rollback #15890 to fix timeout in Java PostCommit (#16257)
[noreply] [BEAM-13015] Add a state backed iterable that can be mutated under
[noreply] [BEAM-13388] Update Cloud DLP after breaking changes. (#16236)
[noreply] [BEAM-13434] Bump google pubsublite on master. (#16265)
------------------------------------------
[...truncated 26.38 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/17 08:59:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1639731587092300230/model
2021/12/17 08:59:47 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1217065623"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639731587092300230/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639731587092300230/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1217065623",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/17 08:59:48 Submitted job: 2021-12-17_00_59_47-15307671198706952219
2021/12/17 08:59:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-17_00_59_47-15307671198706952219?project=apache-beam-testing
2021/12/17 08:59:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-17_00_59_47-15307671198706952219
2021/12/17 08:59:48 Job state: JOB_STATE_PENDING ...
2021/12/17 09:00:18 Job still running ...
2021/12/17 09:00:48 Job still running ...
2021/12/17 09:01:18 Job still running ...
2021/12/17 09:01:48 Job still running ...
2021/12/17 09:02:18 Job still running ...
2021/12/17 09:02:48 Job still running ...
2021/12/17 09:03:18 Failed to execute job: job 2021-12-17_00_59_47-15307671198706952219 failed
panic: Failed to execute job: job 2021-12-17_00_59_47-15307671198706952219 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11400a8, 0xc0000480b0, 0x102fac5, 0x19, 0xc0004f5df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 58s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/y2xkb3gx5wua2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #362
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/362/display/redirect?page=changes>
Changes:
[thiagotnunes] [BEAM-12164] Add Spanner Change Stream DAOs
[mmack] [BEAM-13209] Fix DynamoDBIO.write to properly handle partial success
[mmack] [BEAM-13209] Fix DynamoDBIO.write to properly handle partial success
[noreply] [BEAM-13341] Serialize reflection parameter in AvroCoder cloud object
[noreply] Update grafana from 8.1.6 to 8.1.8
[noreply] [BEAM-13015] Update FakeBeamFnStateClient to generate elements that stop
[noreply] [BEAM-13218] Sickbay
[noreply] [BEAM-13399] Add infrastructure to start JARs from Go functions (#16214)
------------------------------------------
[...truncated 26.31 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/16 08:59:46 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1639645186198039347/model
2021/12/16 08:59:46 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1216065619"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639645186198039347/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639645186198039347/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1216065619",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/16 08:59:47 Submitted job: 2021-12-16_00_59_46-6055466230763291497
2021/12/16 08:59:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-16_00_59_46-6055466230763291497?project=apache-beam-testing
2021/12/16 08:59:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-16_00_59_46-6055466230763291497
2021/12/16 08:59:47 Job state: JOB_STATE_PENDING ...
2021/12/16 09:00:17 Job still running ...
2021/12/16 09:00:47 Job still running ...
2021/12/16 09:01:17 Job still running ...
2021/12/16 09:01:47 Job still running ...
2021/12/16 09:02:17 Job still running ...
2021/12/16 09:02:47 Job still running ...
2021/12/16 09:03:17 Failed to execute job: job 2021-12-16_00_59_46-6055466230763291497 failed
panic: Failed to execute job: job 2021-12-16_00_59_46-6055466230763291497 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11400a8, 0xc0000480b0, 0x102fac5, 0x19, 0xc0003d7df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 57s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/js2tp6c26x62i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #361
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/361/display/redirect?page=changes>
Changes:
[aydar.zaynutdinov] [BEAM-13438][Playground]
[stranniknm] [BEAM-13446]: fix incorrect tab symbol
[noreply] Removes the comment that seems no longer relevant.
[Valentyn Tymofieiev] Update a few dependencies that may depend on log4j transitively.
[noreply] [BEAM-13159] Add Redis Stream (XADD) Write Support (#15858)
[noreply] Merge pull request #15994: [BEAM-13263] Support OnWindowExpiration in
[noreply] Bump dataflow container version to beam-master-20211213 (#16213)
[noreply] Merge pull request #16198 from [BEAM-13437][Playground] Add
[noreply] Merge pull request #16195 from a[BEAM-13436][Playground] Add
[noreply] [BEAM-13355] add Big Query parameter to enable users to specify load_…
[noreply] Updated the base images to use debian:bullseye (#16221)
[noreply] [BEAM-13434] Bump log4j to 2.16.0. (#16237)
------------------------------------------
[...truncated 26.28 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/15 08:59:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1639558779677427377/model
2021/12/15 08:59:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1215065627"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639558779677427377/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639558779677427377/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1215065627",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/15 08:59:40 Submitted job: 2021-12-15_00_59_40-3312052472896612825
2021/12/15 08:59:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-15_00_59_40-3312052472896612825?project=apache-beam-testing
2021/12/15 08:59:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-15_00_59_40-3312052472896612825
2021/12/15 08:59:41 Job state: JOB_STATE_PENDING ...
2021/12/15 09:00:11 Job still running ...
2021/12/15 09:00:41 Job still running ...
2021/12/15 09:01:11 Job still running ...
2021/12/15 09:01:41 Job still running ...
2021/12/15 09:02:11 Job still running ...
2021/12/15 09:02:41 Job still running ...
2021/12/15 09:03:11 Failed to execute job: job 2021-12-15_00_59_40-3312052472896612825 failed
panic: Failed to execute job: job 2021-12-15_00_59_40-3312052472896612825 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11400a8, 0xc000120000, 0x102fac5, 0x19, 0xc000521df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 52s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/gvo3lngky5fbk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #360
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/360/display/redirect?page=changes>
Changes:
[Daniel Oliveira] [BEAM-13321] Pass TempLocation as pipeline option to Dataflow Go for
[Robert Bradshaw] Better type hints for Count combiners.
[Kyle Weaver] Include name of missing tag in error message.
[stranniknm] [BEAM-13423]: fix frontend failure if no examples
[daria.malkova] change return type of 2 methods
[mmack] [BEAM-13441] Use quiet delete for S3 batch deletes. In quiet mode only
[noreply] Updating Grafana from v8.1.2 to v8.1.6
[daria.malkova] Docs for validators tests
[daria.malkova] change context type
[noreply] Merge pull request #16140 from [BEAM-13377][Playground] Update CI/CD
[noreply] Merge pull request #16120 from [BEAM-13333][Playground] Save Python logs
[noreply] Merge pull request #16185 from [BEAM-13425][Playground][Bugfix] Support
[mmack] [BEAM-13445] Correctly set data limit when flushing S3 upload buffer and
[noreply] Merge pull request #16121 from [BEAM-13334][Playground] Save Go logs to
[noreply] Merge pull request #16179 from [BEAM-13344][Playground] support python
[noreply] Merge pull request #16208 from [BEAM-13442][Playground] Filepath to log
[noreply] [BEAM-13276] bump jackson-core to 2.13.0 for .test-infra (#16062)
[noreply] Change Pub/Sub Lite PollResult to set explicit watermark (#16216)
[noreply] [BEAM-13454] Fix and test dataframe read_fwf. (#16064)
[noreply] [BEAM-12976] Pipeline visitor to discover pushdown opportunities.
[noreply] [BEAM-13015] Allow decoding a set of elements until we hit the block
------------------------------------------
[...truncated 26.41 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/14 09:04:57 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1639472695951018537/model
2021/12/14 09:04:57 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1214065614"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639472695951018537/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639472695951018537/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1214065614",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/14 09:04:57 Submitted job: 2021-12-14_01_04_57-13922234903234991123
2021/12/14 09:04:57 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-14_01_04_57-13922234903234991123?project=apache-beam-testing
2021/12/14 09:04:57 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-14_01_04_57-13922234903234991123
2021/12/14 09:04:57 Job state: JOB_STATE_PENDING ...
2021/12/14 09:05:27 Job still running ...
2021/12/14 09:05:57 Job still running ...
2021/12/14 09:06:28 Job still running ...
2021/12/14 09:06:58 Job still running ...
2021/12/14 09:07:28 Job still running ...
2021/12/14 09:07:58 Job still running ...
2021/12/14 09:08:28 Failed to execute job: job 2021-12-14_01_04_57-13922234903234991123 failed
panic: Failed to execute job: job 2021-12-14_01_04_57-13922234903234991123 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11400a8, 0xc0000480b0, 0x102fac5, 0x19, 0xc00039bdf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 48s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/ul2dqjzgikw54
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #359
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/359/display/redirect>
Changes:
------------------------------------------
[...truncated 26.36 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/13 08:59:50 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1639385989398805145/model
2021/12/13 08:59:50 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1213065628"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639385989398805145/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639385989398805145/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1213065628",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/13 08:59:50 Submitted job: 2021-12-13_00_59_50-17613284697807244340
2021/12/13 08:59:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-13_00_59_50-17613284697807244340?project=apache-beam-testing
2021/12/13 08:59:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-13_00_59_50-17613284697807244340
2021/12/13 08:59:50 Job state: JOB_STATE_PENDING ...
2021/12/13 09:00:20 Job still running ...
2021/12/13 09:00:51 Job still running ...
2021/12/13 09:01:21 Job still running ...
2021/12/13 09:01:51 Job still running ...
2021/12/13 09:02:21 Job still running ...
2021/12/13 09:02:51 Job still running ...
2021/12/13 09:03:21 Failed to execute job: job 2021-12-13_00_59_50-17613284697807244340 failed
panic: Failed to execute job: job 2021-12-13_00_59_50-17613284697807244340 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc0000480b0, 0x102faa5, 0x19, 0xc000311df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 0s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/ajmvyzhlonuuc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #358
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/358/display/redirect?page=changes>
Changes:
[noreply] [BEAM-12683] Fix failing integration tests for Python Recommendation AI
[noreply] [BEAM-13015] Plumb the cache through contexts and transform executors.
------------------------------------------
[...truncated 26.36 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/12 08:59:50 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1639299589811939590/model
2021/12/12 08:59:50 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1212065626"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639299589811939590/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639299589811939590/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1212065626",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/12 08:59:51 Submitted job: 2021-12-12_00_59_50-15210159823705335659
2021/12/12 08:59:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-12_00_59_50-15210159823705335659?project=apache-beam-testing
2021/12/12 08:59:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-12_00_59_50-15210159823705335659
2021/12/12 08:59:51 Job state: JOB_STATE_PENDING ...
2021/12/12 09:00:21 Job still running ...
2021/12/12 09:00:51 Job still running ...
2021/12/12 09:01:21 Job still running ...
2021/12/12 09:01:51 Job still running ...
2021/12/12 09:02:21 Job still running ...
2021/12/12 09:02:51 Job still running ...
2021/12/12 09:03:21 Failed to execute job: job 2021-12-12_00_59_50-15210159823705335659 failed
panic: Failed to execute job: job 2021-12-12_00_59_50-15210159823705335659 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc0000480b0, 0x102faa5, 0x19, 0xc0004cddf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 2s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/7kt2qfvhqca5c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #357
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/357/display/redirect?page=changes>
Changes:
[aydar.zaynutdinov] [BEAM-13424][Playground]
[aydar.zaynutdinov] [BEAM-13424][Playground]
[stranniknm] [BEAM-13426] clear log and output panels on example change
[aydar.zaynutdinov] [BEAM-13428][Playground]
[aydar.zaynutdinov] [BEAM-13424][Playground]
[daria.malkova] add type of precompiled object
[Alexey Romanenko] [BEAM-13171] Fix Duration ambiguity
[mmack] [BEAM-13410][BEAM-11788] Integration test for S3Filesystem using
[Alexey Romanenko] [BEAM-13434] Bump up Apache log4j2 vulnerability to 2.15.0
[noreply] Merge pull request #16138 from [BEAM-13343][Playground] Support go unit
[noreply] [BEAM-12560] Dataframe idxmin and idxmax implementation (#15827)
[noreply] [BEAM-12565] Dataframe compare implementation (#16027)
[noreply] [BEAM-12976] Use a map to pass all pushdown requests at once. (#16189)
------------------------------------------
[...truncated 26.37 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/11 08:59:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1639213189349533651/model
2021/12/11 08:59:49 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1211065603"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639213189349533651/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639213189349533651/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1211065603",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/11 08:59:50 Submitted job: 2021-12-11_00_59_49-3185948721920677835
2021/12/11 08:59:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-11_00_59_49-3185948721920677835?project=apache-beam-testing
2021/12/11 08:59:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-11_00_59_49-3185948721920677835
2021/12/11 08:59:50 Job state: JOB_STATE_PENDING ...
2021/12/11 09:00:20 Job still running ...
2021/12/11 09:00:50 Job still running ...
2021/12/11 09:01:20 Job still running ...
2021/12/11 09:01:50 Job still running ...
2021/12/11 09:02:20 Job still running ...
2021/12/11 09:02:50 Job still running ...
2021/12/11 09:03:21 Job still running ...
2021/12/11 09:03:51 Failed to execute job: job 2021-12-11_00_59_49-3185948721920677835 failed
panic: Failed to execute job: job 2021-12-11_00_59_49-3185948721920677835 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc000120000, 0x102faa5, 0x19, 0xc00056fdf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 30s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/sou6g7ti6oyis
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #356
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/356/display/redirect?page=changes>
Changes:
[slebedev] [BEAM-13384] Re-exported the metrics subpackage in
[zyichi] [BEAM-13401] Wait for worker start to reduce flakiness in
[zyichi] Fix pytest unknown markers warning.
[noreply] [BEAM-11936] Remove suppression in ReadFromKafkaDoFn (#16174)
[noreply] [BEAM-12561] method truncate on series and dataframe (#15833)
[noreply] [BEAM-13294] Widen key schema for all keys before use (#16158)
[noreply] [BEAM-13171] Support for stopReadTime on KafkaIO SDF (#15951)
[noreply] [BEAM-13399] Add functionality to download Beam JARs from Maven
[noreply] [BEAM-13402] Add another workaround for
------------------------------------------
[...truncated 26.46 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/10 08:59:55 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1639126794802108480/model
2021/12/10 08:59:55 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1210065624"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639126794802108480/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639126794802108480/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1210065624",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/10 08:59:55 Submitted job: 2021-12-10_00_59_55-8200028725551164743
2021/12/10 08:59:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-10_00_59_55-8200028725551164743?project=apache-beam-testing
2021/12/10 08:59:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-10_00_59_55-8200028725551164743
2021/12/10 08:59:56 Job state: JOB_STATE_PENDING ...
2021/12/10 09:00:26 Job still running ...
2021/12/10 09:00:56 Job still running ...
2021/12/10 09:01:26 Job still running ...
2021/12/10 09:01:56 Job still running ...
2021/12/10 09:02:26 Job still running ...
2021/12/10 09:02:56 Job still running ...
2021/12/10 09:03:26 Job still running ...
2021/12/10 09:03:56 Failed to execute job: job 2021-12-10_00_59_55-8200028725551164743 failed
panic: Failed to execute job: job 2021-12-10_00_59_55-8200028725551164743 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc0000480b0, 0x102faa5, 0x19, 0xc00040fdf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 35s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/42mxtuoztqqok
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #355
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/355/display/redirect?page=changes>
Changes:
[stranniknm] fix playground frontend licences
[noreply] Merge pull request #16167 from [BEAM-13409][Playground] [Bugfix] Change
[noreply] Merge pull request #16136 from [BEAM-13365] [Playground] Add Pipelines
[noreply] [BEAM-13244] Support STS Assume role credentials provider for AWS SDK v2
[noreply] [BEAM-11936] Fix errorprone UnusedVariable in core,examples,harness..
[noreply] [BEAM-11936] Remove suppressUnusedVariable flag (#16171)
[noreply] [BEAM-13090] Adding SDK harness container overrides option to Java SDK
[noreply] [BEAM-11936] Fix errorprone warnings (#15890)
[noreply] [BEAM-13015] Start integrating a process wide cache. (#16130)
------------------------------------------
[...truncated 26.51 KB...]
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/09 08:59:57 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1639040396615324295/model
2021/12/09 08:59:57 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1209065607"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639040396615324295/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1639040396615324295/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1209065607",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/09 08:59:57 Submitted job: 2021-12-09_00_59_57-5280320332717310455
2021/12/09 08:59:57 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-09_00_59_57-5280320332717310455?project=apache-beam-testing
2021/12/09 08:59:57 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-09_00_59_57-5280320332717310455
2021/12/09 08:59:57 Job state: JOB_STATE_PENDING ...
2021/12/09 09:00:27 Job still running ...
2021/12/09 09:00:58 Job still running ...
2021/12/09 09:01:28 Job still running ...
2021/12/09 09:01:58 Job still running ...
2021/12/09 09:02:28 Job still running ...
2021/12/09 09:02:58 Job still running ...
2021/12/09 09:03:28 Job still running ...
2021/12/09 09:03:58 Job still running ...
2021/12/09 09:04:28 Job still running ...
2021/12/09 09:04:58 Job still running ...
2021/12/09 09:05:28 Job still running ...
2021/12/09 09:05:58 Failed to execute job: job 2021-12-09_00_59_57-5280320332717310455 failed
panic: Failed to execute job: job 2021-12-09_00_59_57-5280320332717310455 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc0000480b0, 0x102faa5, 0x19, 0xc000659df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 34s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/tic46gqpr7qrq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #354
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/354/display/redirect?page=changes>
Changes:
[heejong] [BEAM-13092] Adding dummy external transform translators for Dataflow
[stranniknm] [BEAM-13112]: playground embedded version
[zyichi] [BEAM-13388] Fix broken google cloud dlp test.
[relax] don't store unserializable DatasetService as a member variable
[noreply] [BEAM-13236] Properly close kinesis producer on teardown (#15955)
[noreply] Merge pull request #16150 from [BEAM-13396][Playground][Bugfix] Issues
[noreply] Merge pull request #16148 from [BEAM-13394][Playground] [Bugfix] Fix
[noreply] Avoid overriding explicit portable job submission disabling. (#16143)
[noreply] Merge pull request #16151 from [BEAM-13350][Playground] Support running
[zyichi] [BEAM-13373] Increase python post commit timeout to reduce chance of
[melissapa] [BEAM-11758] Final cleanup for Beam Basics doc content
[msbukal] Exclude FhirIOPatientEverything from v2 dataflow runner intg test.
[noreply] [BEAM-13371] Fix bug where DataFrame overview snippets don't show up
[dpcollins] Add a workaround for https://github.com/googleapis/gax-java/issues/1577
[noreply] [BEAM-12976] Implement pipeline visitor to get global field access in…
[noreply] [BEAM-13388] Use 3.0.0 as lower bound for google-cloud-dlp (#16164)
[noreply] Merge pull request #16127 from [BEAM-13366] [Playground] Add support
------------------------------------------
[...truncated 26.55 KB...]
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/08 08:59:52 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1638953991464757988/model
2021/12/08 08:59:52 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1208065606"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638953991464757988/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638953991464757988/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1208065606",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/08 08:59:52 Submitted job: 2021-12-08_00_59_52-10699336994603645623
2021/12/08 08:59:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-08_00_59_52-10699336994603645623?project=apache-beam-testing
2021/12/08 08:59:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-08_00_59_52-10699336994603645623
2021/12/08 08:59:52 Job state: JOB_STATE_PENDING ...
2021/12/08 09:00:23 Job still running ...
2021/12/08 09:00:53 Job still running ...
2021/12/08 09:01:23 Job still running ...
2021/12/08 09:01:53 Job still running ...
2021/12/08 09:02:23 Job still running ...
2021/12/08 09:02:53 Job still running ...
2021/12/08 09:03:23 Job still running ...
2021/12/08 09:03:53 Job still running ...
2021/12/08 09:04:23 Job still running ...
2021/12/08 09:04:53 Job still running ...
2021/12/08 09:05:23 Job still running ...
2021/12/08 09:05:53 Failed to execute job: job 2021-12-08_00_59_52-10699336994603645623 failed
panic: Failed to execute job: job 2021-12-08_00_59_52-10699336994603645623 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc000120000, 0x102faa5, 0x19, 0xc00073ddf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 32s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/hfafjnv54oute
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #353
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/353/display/redirect?page=changes>
Changes:
[Daniel Oliveira] Minor Gradle Fixups: Removing unneeded dependency in expansion service.
[aydar.zaynutdinov] [BEAM-13363][Playground]
[aydar.zaynutdinov] [BEAM-13357][Playground]
[aydar.zaynutdinov] [BEAM-13357][Playground]
[Luke Cwik] [BEAM-13015] Simplify fake state API testing client and make it
[zyichi] [BEAM-13380] Fix broken seedjob.
[aydar.zaynutdinov] [BEAM-13357][Playground]
[noreply] Merge pull request #16137 from [BEAM-13381][Playground][Bugfix] Update
[noreply] Merge pull request #16107 from [BEAM-13332] [Playground] Add logs output
[noreply] Merge pull request #16109 from [BEAM-13330][Playground] Save Java logs
[noreply] Merge pull request #16125 from [BEAM-13322][Playground] Support Java
[melissapa] [BEAM-11758] Update basics page: Window, Watermark
------------------------------------------
[...truncated 26.50 KB...]
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/07 08:59:56 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1638867595705907865/model
2021/12/07 08:59:56 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1207065623"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638867595705907865/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638867595705907865/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1207065623",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/07 08:59:57 Submitted job: 2021-12-07_00_59_56-1814491444878425374
2021/12/07 08:59:57 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-07_00_59_56-1814491444878425374?project=apache-beam-testing
2021/12/07 08:59:57 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-07_00_59_56-1814491444878425374
2021/12/07 08:59:57 Job state: JOB_STATE_PENDING ...
2021/12/07 09:00:27 Job still running ...
2021/12/07 09:00:57 Job still running ...
2021/12/07 09:01:27 Job still running ...
2021/12/07 09:01:57 Job still running ...
2021/12/07 09:02:27 Job still running ...
2021/12/07 09:02:57 Job still running ...
2021/12/07 09:03:27 Job still running ...
2021/12/07 09:03:57 Job still running ...
2021/12/07 09:04:27 Job still running ...
2021/12/07 09:04:57 Job still running ...
2021/12/07 09:05:27 Job still running ...
2021/12/07 09:05:57 Failed to execute job: job 2021-12-07_00_59_56-1814491444878425374 failed
panic: Failed to execute job: job 2021-12-07_00_59_56-1814491444878425374 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc0000480b0, 0x102faa5, 0x19, 0xc000663df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 35s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/lwkc5qkufobpg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #352
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/352/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #16118 from [BEAM-13362][Playground] python ci cd
------------------------------------------
[...truncated 26.38 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/06 08:59:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1638781188778181226/model
2021/12/06 08:59:49 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1206065602"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638781188778181226/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638781188778181226/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1206065602",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/06 08:59:50 Submitted job: 2021-12-06_00_59_49-12736321287654178033
2021/12/06 08:59:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-06_00_59_49-12736321287654178033?project=apache-beam-testing
2021/12/06 08:59:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-06_00_59_49-12736321287654178033
2021/12/06 08:59:50 Job state: JOB_STATE_PENDING ...
2021/12/06 09:00:20 Job still running ...
2021/12/06 09:00:50 Job still running ...
2021/12/06 09:01:20 Job still running ...
2021/12/06 09:01:50 Job still running ...
2021/12/06 09:02:20 Job still running ...
2021/12/06 09:02:50 Job still running ...
2021/12/06 09:03:20 Failed to execute job: job 2021-12-06_00_59_49-12736321287654178033 failed
panic: Failed to execute job: job 2021-12-06_00_59_49-12736321287654178033 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc000120000, 0x102faa5, 0x19, 0xc000771df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 1s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/5v74tjlwidawy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #351
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/351/display/redirect>
Changes:
------------------------------------------
[...truncated 26.54 KB...]
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/05 11:23:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1638703429224424870/model
2021/12/05 11:23:49 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1205065616"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638703429224424870/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638703429224424870/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1205065616",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/05 11:23:50 Submitted job: 2021-12-05_03_23_49-1465270220253855379
2021/12/05 11:23:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-05_03_23_49-1465270220253855379?project=apache-beam-testing
2021/12/05 11:23:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-05_03_23_49-1465270220253855379
2021/12/05 11:23:50 Job state: JOB_STATE_PENDING ...
2021/12/05 11:24:20 Job still running ...
2021/12/05 11:24:50 Job still running ...
2021/12/05 11:25:20 Job still running ...
2021/12/05 11:25:50 Job still running ...
2021/12/05 11:26:21 Job still running ...
2021/12/05 11:26:51 Job still running ...
2021/12/05 11:27:21 Job still running ...
2021/12/05 11:27:51 Job still running ...
2021/12/05 11:28:21 Job still running ...
2021/12/05 11:28:51 Job still running ...
2021/12/05 11:29:21 Job still running ...
2021/12/05 11:29:51 Failed to execute job: job 2021-12-05_03_23_49-1465270220253855379 failed
panic: Failed to execute job: job 2021-12-05_03_23_49-1465270220253855379 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc00019a000, 0x102faa5, 0x19, 0xc0005f5df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 34s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/sp7gkihlam4aq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #350
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/350/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Revert "Revert "Allow wildcards for java class lookup transform
[Robert Bradshaw] Move stand-alone expansion service jar into its own project.
[noreply] Merge pull request #16117 from [BEAM-13368][Playground][Bugfix] Fix CI
[noreply] Run python SpannerIO IT with python 3.7 only to avoid overload spanner
[noreply] Merge pull request #15378 from [RFC] Define and document per-key
[noreply] Bump python containers to beam-master-20211202 (#16129)
[noreply] [BEAM-13354, BEAM-13015, BEAM-12802, BEAM-12588] Support prefetch for
[zyichi] Fix failing RecommendationAICatalogItemIT
[Valentyn Tymofieiev] Clarify instructions on how to get contributor list.
[noreply] [BEAM-11936] Fix errorprone UnusedVariable in IO (#16036)
------------------------------------------
[...truncated 26.54 KB...]
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/04 08:59:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1638608391108249224/model
2021/12/04 08:59:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1204065612"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638608391108249224/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638608391108249224/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1204065612",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/04 08:59:52 Submitted job: 2021-12-04_00_59_51-3786422535469166188
2021/12/04 08:59:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-04_00_59_51-3786422535469166188?project=apache-beam-testing
2021/12/04 08:59:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-04_00_59_51-3786422535469166188
2021/12/04 08:59:52 Job state: JOB_STATE_PENDING ...
2021/12/04 09:00:22 Job still running ...
2021/12/04 09:00:52 Job still running ...
2021/12/04 09:01:22 Job still running ...
2021/12/04 09:01:52 Job still running ...
2021/12/04 09:02:22 Job still running ...
2021/12/04 09:02:52 Job still running ...
2021/12/04 09:03:22 Job still running ...
2021/12/04 09:03:52 Job still running ...
2021/12/04 09:04:22 Job still running ...
2021/12/04 09:04:53 Job still running ...
2021/12/04 09:05:23 Job still running ...
2021/12/04 09:05:53 Failed to execute job: job 2021-12-04_00_59_51-3786422535469166188 failed
panic: Failed to execute job: job 2021-12-04_00_59_51-3786422535469166188 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc0000480b0, 0x102faa5, 0x19, 0xc0003ebdf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 32s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/xeomzrny2uo6q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #349
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/349/display/redirect?page=changes>
Changes:
[aydar.zaynutdinov] [BEAM-13329][Playground]
[aydar.zaynutdinov] [BEAM-13329][Playground]
[alexander.zhuravlev] [BEAM-13370] Deleted unused prints & strings
[ilya.kozyrev] Fix pylint issues and apply yapf with Beam config
[ilya.kozyrev] fix white spaces
[noreply] Don't pin a particular version of Tensorflow. (#16102)
[noreply] [BEAM-12733] Fix failing integration tests for Java Recommendation AI
[noreply] [BEAM-13288] improve logging for no rows present error (#16096)
------------------------------------------
[...truncated 26.29 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/03 08:59:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1638521981354420292/model
2021/12/03 08:59:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1203065612"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638521981354420292/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638521981354420292/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1203065612",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/03 08:59:42 Submitted job: 2021-12-03_00_59_42-4631373745465455682
2021/12/03 08:59:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-03_00_59_42-4631373745465455682?project=apache-beam-testing
2021/12/03 08:59:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-03_00_59_42-4631373745465455682
2021/12/03 08:59:42 Job state: JOB_STATE_PENDING ...
2021/12/03 09:00:12 Job still running ...
2021/12/03 09:00:42 Job still running ...
2021/12/03 09:01:13 Job still running ...
2021/12/03 09:01:43 Job still running ...
2021/12/03 09:02:13 Job still running ...
2021/12/03 09:02:43 Job still running ...
2021/12/03 09:03:13 Failed to execute job: job 2021-12-03_00_59_42-4631373745465455682 failed
panic: Failed to execute job: job 2021-12-03_00_59_42-4631373745465455682 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc0000480b0, 0x102faa5, 0x19, 0xc000529df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 52s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/bedmhdezanca2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #348
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/348/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Require explicit designation of proxy partitioning specification.
[Robert Bradshaw] Elementwise transforms preserve all partitionings.
[aydar.zaynutdinov] [BEAM-13360][Playground]
[noreply] Merge pull request #16011 from [BEAM-12164] Add models for Spanner
[noreply] [BEAM-13335] Use signed int64 range for DataFrame read unique indexes
[iyi] Add test case for untriggered expansion with temp tables.
[zyichi] Fix small typo in ProcessBundleHandlerTest.java
[noreply] Merge pull request #16079 from [BEAM-13241] [Playground] Frontend
[noreply] Ricardo Case Study (#16087)
[noreply] Merge pull request #16086 from [BEAM-13258][Playground] Get and store
[noreply] [BEAM-11936] Fix errorprone UnusedVariable in Runners (#16035)
[noreply] [BEAM-8123] Add cloudpickle as optional library (#15472)
[noreply] [BEAM-12572] Beam python examples continuously exercised on at least 2
------------------------------------------
[...truncated 26.37 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/02 08:59:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1638435592436539413/model
2021/12/02 08:59:53 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1202065623"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638435592436539413/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638435592436539413/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1202065623",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/02 08:59:53 Submitted job: 2021-12-02_00_59_53-16161640057520008404
2021/12/02 08:59:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-02_00_59_53-16161640057520008404?project=apache-beam-testing
2021/12/02 08:59:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-02_00_59_53-16161640057520008404
2021/12/02 08:59:53 Job state: JOB_STATE_PENDING ...
2021/12/02 09:00:23 Job still running ...
2021/12/02 09:00:53 Job still running ...
2021/12/02 09:01:24 Job still running ...
2021/12/02 09:01:54 Job still running ...
2021/12/02 09:02:24 Job still running ...
2021/12/02 09:02:54 Job still running ...
2021/12/02 09:03:24 Failed to execute job: job 2021-12-02_00_59_53-16161640057520008404 failed
panic: Failed to execute job: job 2021-12-02_00_59_53-16161640057520008404 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc0000480b0, 0x102faa5, 0x19, 0xc0005d9df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 2s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/thccyrfuug6f2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #347
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/347/display/redirect?page=changes>
Changes:
[mmack] [BEAM-11494][BEAM-11821] FileIO stops overwriting files on retries (AWS
[melissapa] [BEAM-11758] Update basics page: Trigger, State and timers
[Pablo Estrada] [py] Supporting ignore_unknown_values for WriteToBigQuery
[noreply] Merge pull request #16072 from [BEAM-13135][Playground] Add function to
[noreply] Merge pull request #16084 from [BEAM-13347][Playground] [Bugfix] Backend
[noreply] Merge pull request #15987 from [BEAM-13242] Allow values with smaller
[noreply] [BEAM-11936] Fix errorprone UnusedVariable in Extensions (#16033)
[noreply] Merge pull request #15936 from [BEAM-13351] FhirIO GetPatientEverything
[avilovpavel6] Add fmt preparator for go sdk
[noreply] Merge pull request #16073 from [BEAM-13267][Playground] Implement
[ningkang0957] Updated screen diff test for Interactive Beam
[noreply] [BEAM-13282][Playground] Create go dockerfile #16049
[noreply] Merge pull request #16085 from [Beam-13336][Playground] Refactor
[noreply] [BEAM-11936] Fix errorprone UnusedVariable in Extensions-sql (#16034)
[noreply] [BEAM-13193] Support
[noreply] Merge pull request #16090: [BEAM-13352] Add transient qualifier to
------------------------------------------
[...truncated 26.48 KB...]
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/01 08:59:50 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1638349189883073581/model
2021/12/01 08:59:50 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1201065619"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638349189883073581/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638349189883073581/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1201065619",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/01 08:59:51 Submitted job: 2021-12-01_00_59_50-5523562312548679829
2021/12/01 08:59:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-01_00_59_50-5523562312548679829?project=apache-beam-testing
2021/12/01 08:59:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-01_00_59_50-5523562312548679829
2021/12/01 08:59:51 Job state: JOB_STATE_PENDING ...
2021/12/01 09:00:21 Job still running ...
2021/12/01 09:00:51 Job still running ...
2021/12/01 09:01:21 Job still running ...
2021/12/01 09:01:51 Job still running ...
2021/12/01 09:02:21 Job still running ...
2021/12/01 09:02:51 Job still running ...
2021/12/01 09:03:21 Job still running ...
2021/12/01 09:03:51 Job still running ...
2021/12/01 09:04:21 Job still running ...
2021/12/01 09:04:51 Job still running ...
2021/12/01 09:05:21 Failed to execute job: job 2021-12-01_00_59_50-5523562312548679829 failed
panic: Failed to execute job: job 2021-12-01_00_59_50-5523562312548679829 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc0000480b0, 0x102faa5, 0x19, 0xc0003e1df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 1s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/5l22bbjr3eoci
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #346
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/346/display/redirect?page=changes>
Changes:
[kileysok] Increase timeout for Dataflow Streaming VR
[Kyle Weaver] [BEAM-13220] Update release instructions.
[noreply] Merge pull request #16050 from [BEAM-13307][Playground] Support Python
[noreply] Merge pull request #16071 from [BEAM-13306][Playground] Add using of
[noreply] [BEAM-11943] Fix wrong Klio logo being displayed (#16078)
[noreply] Merge pull request #15954 from [BEAM-960][BEAM-1675] Improvements to
[noreply] [BEAM-13284] Respect expiration time for all Redis write methods.
[noreply] [BEAM-12697] Add SBE module and initial classes (#15733)
[noreply] [Playground][Beam-13316][Bugfix] Fix Playground Frontend Precommit
[Kyle Weaver] [BEAM-13337] Periodically delete stale spanner databases.
[noreply] [BEAM-13115][Playground] Security – Mock Storage (#16047)
[noreply] [BEAM-13335] Use shorter, numerical indices for dataframe reads.
[noreply] Be more conservative about rebatching. (#16058)
[noreply] [BEAM-12587] Allow None in Python's Any logical type. (#16055)
------------------------------------------
[...truncated 26.36 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/30 08:59:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1638262793351538367/model
2021/11/30 08:59:53 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1130065632"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638262793351538367/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638262793351538367/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1130065632",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/30 08:59:54 Submitted job: 2021-11-30_00_59_53-14546001968985389
2021/11/30 08:59:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-30_00_59_53-14546001968985389?project=apache-beam-testing
2021/11/30 08:59:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-30_00_59_53-14546001968985389
2021/11/30 08:59:54 Job state: JOB_STATE_PENDING ...
2021/11/30 09:00:24 Job still running ...
2021/11/30 09:00:54 Job still running ...
2021/11/30 09:01:24 Job still running ...
2021/11/30 09:01:54 Job still running ...
2021/11/30 09:02:24 Job still running ...
2021/11/30 09:02:54 Job still running ...
2021/11/30 09:03:25 Job still running ...
2021/11/30 09:03:55 Failed to execute job: job 2021-11-30_00_59_53-14546001968985389 failed
panic: Failed to execute job: job 2021-11-30_00_59_53-14546001968985389 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc000128000, 0x102faa5, 0x19, 0xc00034fdf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 33s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/o4t3lylcevpfu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #345
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/345/display/redirect>
Changes:
------------------------------------------
[...truncated 26.47 KB...]
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/29 08:59:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1638176391001305468/model
2021/11/29 08:59:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1129065620"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638176391001305468/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638176391001305468/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1129065620",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/29 08:59:52 Submitted job: 2021-11-29_00_59_51-6780094404508163905
2021/11/29 08:59:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-29_00_59_51-6780094404508163905?project=apache-beam-testing
2021/11/29 08:59:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-29_00_59_51-6780094404508163905
2021/11/29 08:59:52 Job state: JOB_STATE_PENDING ...
2021/11/29 09:00:22 Job still running ...
2021/11/29 09:00:52 Job still running ...
2021/11/29 09:01:22 Job still running ...
2021/11/29 09:01:52 Job still running ...
2021/11/29 09:02:22 Job still running ...
2021/11/29 09:02:52 Job still running ...
2021/11/29 09:03:22 Job still running ...
2021/11/29 09:03:52 Job still running ...
2021/11/29 09:04:24 Job still running ...
2021/11/29 09:04:54 Job still running ...
2021/11/29 09:05:24 Failed to execute job: job 2021-11-29_00_59_51-6780094404508163905 failed
panic: Failed to execute job: job 2021-11-29_00_59_51-6780094404508163905 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc0000480b0, 0x102faa5, 0x19, 0xc000599df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 4s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/k2ad5bjo2b7f6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #344
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/344/display/redirect?page=changes>
Changes:
[vitaly.ivanov] [BEAM-13269] Data exceeds database column capacity error while inserting
[vitaly.ivanov] [BEAM-13269] Data exceeds database column capacity error while inserting
[noreply] Merge pull request #16074 from [BEAM-13323][Playground] [Bugfix] Fix CI
------------------------------------------
[...truncated 26.36 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/28 08:59:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1638089991067551590/model
2021/11/28 08:59:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1128065618"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638089991067551590/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638089991067551590/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1128065618",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/28 08:59:52 Submitted job: 2021-11-28_00_59_51-7431545436861485541
2021/11/28 08:59:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-28_00_59_51-7431545436861485541?project=apache-beam-testing
2021/11/28 08:59:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-28_00_59_51-7431545436861485541
2021/11/28 08:59:52 Job state: JOB_STATE_PENDING ...
2021/11/28 09:00:22 Job still running ...
2021/11/28 09:00:52 Job still running ...
2021/11/28 09:01:22 Job still running ...
2021/11/28 09:01:52 Job still running ...
2021/11/28 09:02:22 Job still running ...
2021/11/28 09:02:52 Job still running ...
2021/11/28 09:03:22 Failed to execute job: job 2021-11-28_00_59_51-7431545436861485541 failed
panic: Failed to execute job: job 2021-11-28_00_59_51-7431545436861485541 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc000120000, 0x102faa5, 0x19, 0xc000521df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 4s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/v3uvpqm4h6las
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #343
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/343/display/redirect>
Changes:
------------------------------------------
[...truncated 26.36 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/27 08:59:50 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1638003589839665843/model
2021/11/27 08:59:50 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1127065607"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638003589839665843/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1638003589839665843/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1127065607",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/27 08:59:51 Submitted job: 2021-11-27_00_59_50-860067709970642434
2021/11/27 08:59:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-27_00_59_50-860067709970642434?project=apache-beam-testing
2021/11/27 08:59:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-27_00_59_50-860067709970642434
2021/11/27 08:59:51 Job state: JOB_STATE_PENDING ...
2021/11/27 09:00:21 Job still running ...
2021/11/27 09:00:51 Job still running ...
2021/11/27 09:01:21 Job still running ...
2021/11/27 09:01:51 Job still running ...
2021/11/27 09:02:21 Job still running ...
2021/11/27 09:02:51 Job still running ...
2021/11/27 09:03:21 Failed to execute job: job 2021-11-27_00_59_50-860067709970642434 failed
panic: Failed to execute job: job 2021-11-27_00_59_50-860067709970642434 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc0000480b0, 0x102faa5, 0x19, 0xc000543df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 1s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/n4dfyacdvpnmo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #342
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/342/display/redirect>
Changes:
------------------------------------------
[...truncated 26.36 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/26 08:59:52 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1637917191973159144/model
2021/11/26 08:59:52 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1126065610"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637917191973159144/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637917191973159144/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1126065610",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/26 08:59:53 Submitted job: 2021-11-26_00_59_52-13242523449249271226
2021/11/26 08:59:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-26_00_59_52-13242523449249271226?project=apache-beam-testing
2021/11/26 08:59:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-26_00_59_52-13242523449249271226
2021/11/26 08:59:53 Job state: JOB_STATE_PENDING ...
2021/11/26 09:00:23 Job still running ...
2021/11/26 09:00:53 Job still running ...
2021/11/26 09:01:23 Job still running ...
2021/11/26 09:01:53 Job still running ...
2021/11/26 09:02:23 Job still running ...
2021/11/26 09:02:53 Job still running ...
2021/11/26 09:03:23 Failed to execute job: job 2021-11-26_00_59_52-13242523449249271226 failed
panic: Failed to execute job: job 2021-11-26_00_59_52-13242523449249271226 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc0000480b0, 0x102faa5, 0x19, 0xc000321df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 3s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/5eyhrwbnsfe3a
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #341
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/341/display/redirect?page=changes>
Changes:
[Luke Cwik] [BEAM-13015] Simplify
[Luke Cwik] [BEAM-13015] Simplify DataStreamsDecoder by moving hasNext logic to next
------------------------------------------
[...truncated 26.36 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/25 08:59:50 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1637830790028597704/model
2021/11/25 08:59:50 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1125065625"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637830790028597704/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637830790028597704/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1125065625",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/25 08:59:51 Submitted job: 2021-11-25_00_59_50-9383861859580984268
2021/11/25 08:59:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-25_00_59_50-9383861859580984268?project=apache-beam-testing
2021/11/25 08:59:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-25_00_59_50-9383861859580984268
2021/11/25 08:59:51 Job state: JOB_STATE_PENDING ...
2021/11/25 09:00:21 Job still running ...
2021/11/25 09:00:51 Job still running ...
2021/11/25 09:01:21 Job still running ...
2021/11/25 09:01:51 Job still running ...
2021/11/25 09:02:21 Job still running ...
2021/11/25 09:02:51 Job still running ...
2021/11/25 09:03:21 Failed to execute job: job 2021-11-25_00_59_50-9383861859580984268 failed
panic: Failed to execute job: job 2021-11-25_00_59_50-9383861859580984268 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc0001a2000, 0x102faa5, 0x19, 0xc000483df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 1s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/n5yeidbibtu2y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #340
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/340/display/redirect?page=changes>
Changes:
[noreply] Increase the timeout for LoadTest Jenkins jobs 4h->12h.
[noreply] [BEAM-13073] UseParallelGC on Java container
[noreply] Merge pull request #16002 from [BEAM-13101] [Playground] load examples
[noreply] Merge pull request #16016 from [BEAM-13089][Playground] Enable
[noreply] Merge pull request #16046 from [BEAM-13295] [Playground] [Bugfix]
[noreply] Merge pull request #16048 from [Beam-13256] [Playground] Implement an
[noreply] Merge pull request #16026 from [BEAM-13208][Playground] Separate stderr
[noreply] Append to state in chunks. (#15983)
[Luke Cwik] [BEAM-13313] Fix WindowingStrategy proto to use snake case field names.
[noreply] [BEAM-12829] Never copy .gogradle/** for Python. (#16059)
------------------------------------------
[...truncated 26.34 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/24 08:59:56 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1637744395563749104/model
2021/11/24 08:59:56 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1124065633"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637744395563749104/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637744395563749104/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1124065633",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/24 08:59:56 Submitted job: 2021-11-24_00_59_56-14347545063027074154
2021/11/24 08:59:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-24_00_59_56-14347545063027074154?project=apache-beam-testing
2021/11/24 08:59:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-24_00_59_56-14347545063027074154
2021/11/24 08:59:56 Job state: JOB_STATE_PENDING ...
2021/11/24 09:00:26 Job still running ...
2021/11/24 09:00:56 Job still running ...
2021/11/24 09:01:26 Job still running ...
2021/11/24 09:01:56 Job still running ...
2021/11/24 09:02:26 Job still running ...
2021/11/24 09:02:56 Job still running ...
2021/11/24 09:03:27 Failed to execute job: job 2021-11-24_00_59_56-14347545063027074154 failed
panic: Failed to execute job: job 2021-11-24_00_59_56-14347545063027074154 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc0000480b0, 0x102faa5, 0x19, 0xc0004afdf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 8s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/h3sdzqexmps3k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #339
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/339/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Make sure implicit inputs are noted in the portable graph.
[benjamin.gonzalez] [BEAM-13003] Integration Test for DebeziumIO that connects to
[noreply] Merge pull request #16032 from [BEAM-13297][Playground][Bugfix]
[noreply] Merge pull request #16031 from [BEAM-13296][Playground][Bugfix] remove
[noreply] Merge pull request #16030 from [BEAM-13219][Playground] Initialise
[noreply] Merge pull request #15996 from [BEAM-13156][Playground] Implement
------------------------------------------
[...truncated 26.40 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/23 08:59:48 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1637657988298644549/model
2021/11/23 08:59:48 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1123065609"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637657988298644549/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637657988298644549/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1123065609",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/23 08:59:49 Submitted job: 2021-11-23_00_59_48-16193875168017210368
2021/11/23 08:59:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-23_00_59_48-16193875168017210368?project=apache-beam-testing
2021/11/23 08:59:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-23_00_59_48-16193875168017210368
2021/11/23 08:59:49 Job state: JOB_STATE_PENDING ...
2021/11/23 09:00:19 Job still running ...
2021/11/23 09:00:49 Job still running ...
2021/11/23 09:01:19 Job still running ...
2021/11/23 09:01:49 Job still running ...
2021/11/23 09:02:19 Job still running ...
2021/11/23 09:02:49 Job still running ...
2021/11/23 09:03:20 Job still running ...
2021/11/23 09:03:50 Failed to execute job: job 2021-11-23_00_59_48-16193875168017210368 failed
panic: Failed to execute job: job 2021-11-23_00_59_48-16193875168017210368 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc0000480b0, 0x102faa5, 0x19, 0xc000271df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 31s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/elc4zygc7o2ms
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #338
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/338/display/redirect>
Changes:
------------------------------------------
[...truncated 26.45 KB...]
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/22 08:59:50 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1637571590147617576/model
2021/11/22 08:59:50 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1122065603"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637571590147617576/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637571590147617576/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1122065603",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/22 08:59:51 Submitted job: 2021-11-22_00_59_50-12750245188836472168
2021/11/22 08:59:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-22_00_59_50-12750245188836472168?project=apache-beam-testing
2021/11/22 08:59:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-22_00_59_50-12750245188836472168
2021/11/22 08:59:51 Job state: JOB_STATE_PENDING ...
2021/11/22 09:00:21 Job still running ...
2021/11/22 09:00:51 Job still running ...
2021/11/22 09:01:21 Job still running ...
2021/11/22 09:01:51 Job still running ...
2021/11/22 09:02:21 Job still running ...
2021/11/22 09:02:51 Job still running ...
2021/11/22 09:03:21 Job still running ...
2021/11/22 09:03:52 Job still running ...
2021/11/22 09:04:22 Job still running ...
2021/11/22 09:04:52 Job still running ...
2021/11/22 09:05:22 Failed to execute job: job 2021-11-22_00_59_50-12750245188836472168 failed
panic: Failed to execute job: job 2021-11-22_00_59_50-12750245188836472168 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc0000480b0, 0x102faa5, 0x19, 0xc0001fbdf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 1s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/fu4iccy6dz3ro
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #337
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/337/display/redirect>
Changes:
------------------------------------------
[...truncated 26.34 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/21 08:59:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1637485189150457622/model
2021/11/21 08:59:49 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1121065619"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637485189150457622/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637485189150457622/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1121065619",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/21 08:59:50 Submitted job: 2021-11-21_00_59_49-7991668570863926767
2021/11/21 08:59:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-21_00_59_49-7991668570863926767?project=apache-beam-testing
2021/11/21 08:59:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-21_00_59_49-7991668570863926767
2021/11/21 08:59:50 Job state: JOB_STATE_PENDING ...
2021/11/21 09:00:20 Job still running ...
2021/11/21 09:00:50 Job still running ...
2021/11/21 09:01:20 Job still running ...
2021/11/21 09:01:50 Job still running ...
2021/11/21 09:02:20 Job still running ...
2021/11/21 09:02:50 Job still running ...
2021/11/21 09:03:20 Failed to execute job: job 2021-11-21_00_59_49-7991668570863926767 failed
panic: Failed to execute job: job 2021-11-21_00_59_49-7991668570863926767 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc000128000, 0x102faa5, 0x19, 0xc000807df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 0s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/5zskdd5ryla5u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #336
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/336/display/redirect?page=changes>
Changes:
[Valentyn Tymofieiev] Add future back to Beam containers.
[noreply] [BEAM-13290] Handle disable_prime_runner_v2 flag (#16018)
[noreply] [BEAM-11936] Add configuration parameter for suppressing unusedvariable
[noreply] Merge pull request #15957 from [BEAM-13045][Playground] Implemented
[noreply] [BEAM-13286] RowJson should expect ReadableInstant for DATETIME values
[noreply] Merge pull request #16025 from [BEAM-13216] [Playground] Add client to
[ningkang0957] Updated dep and goldens for Interactive Beam screen diff tests
[ningkang0957] Removed Pillow from requirements of containers.
[noreply] Merge pull request #16013 from [BEAM-13281] [playground] Update favicon
[noreply] Merge pull request #15768 from [BEAM-13064] [Playground] Implement
[noreply] Added go code coverage report with codecov (#16020)
------------------------------------------
[...truncated 26.34 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.36.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/20 08:59:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1637398790314827103/model
2021/11/20 08:59:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1120065624"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637398790314827103/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637398790314827103/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1120065624",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/20 08:59:52 Submitted job: 2021-11-20_00_59_51-13225492309176199697
2021/11/20 08:59:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-20_00_59_51-13225492309176199697?project=apache-beam-testing
2021/11/20 08:59:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-20_00_59_51-13225492309176199697
2021/11/20 08:59:52 Job state: JOB_STATE_PENDING ...
2021/11/20 09:00:22 Job still running ...
2021/11/20 09:00:52 Job still running ...
2021/11/20 09:01:22 Job still running ...
2021/11/20 09:01:52 Job still running ...
2021/11/20 09:02:22 Job still running ...
2021/11/20 09:02:52 Job still running ...
2021/11/20 09:03:22 Failed to execute job: job 2021-11-20_00_59_51-13225492309176199697 failed
panic: Failed to execute job: job 2021-11-20_00_59_51-13225492309176199697 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc000120000, 0x102faa5, 0x19, 0xc0004a1df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 2s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/bh5nfqln6w24m
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #335
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/335/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Allow wildcards for java class lookup transform providers.
[Robert Bradshaw] Disallow getClass().forname().
[Robert Bradshaw] Docs, globbing, and a test.
[Robert Bradshaw] Defer expansion service creation for easier testing.
[Robert Bradshaw] Allow java jar service with classpath.
[avilovpavel6] Support GO sdk
[dpcollins] Fix race condition in Pub/Sub Lite SDF that causes it to error out when
[dpcollins] edit
[noreply] Merge pull request #15785 from Support for passing priority parameter in
[dpcollins] Restructure processor to access beam types from downcall thread
[dpcollins] Restructure processor to access beam types from downcall thread
[noreply] [BEAM-13283] Skip apache beam dependency installation from
[dpcollins] Restructure processor to access beam types from downcall thread
[noreply] Merge pull request #15956 from [BEAM-13210] [Playground]: support
[noreply] created quickstart guide for multi-language pipelines (Python) (#16001)
[dpcollins] use interface in logger to work around likely SLF4J bug
[dpcollins] revert logger class
[noreply] Revert "Allow wildcards for java class lookup transform providers."
[Valentyn Tymofieiev] Moving to 2.36.0-SNAPSHOT on master branch.
------------------------------------------
[...truncated 26.59 KB...]
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/19 08:59:48 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1637312388403362166/model
2021/11/19 08:59:48 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1119065615"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637312388403362166/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637312388403362166/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1119065615",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/19 08:59:49 Submitted job: 2021-11-19_00_59_48-5046453759749057950
2021/11/19 08:59:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-19_00_59_48-5046453759749057950?project=apache-beam-testing
2021/11/19 08:59:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-19_00_59_48-5046453759749057950
2021/11/19 08:59:49 Job state: JOB_STATE_PENDING ...
2021/11/19 09:00:19 Job still running ...
2021/11/19 09:00:49 Job still running ...
2021/11/19 09:01:19 Job still running ...
2021/11/19 09:01:49 Job still running ...
2021/11/19 09:02:19 Job still running ...
2021/11/19 09:02:49 Job still running ...
2021/11/19 09:03:19 Job still running ...
2021/11/19 09:03:49 Job still running ...
2021/11/19 09:04:19 Job still running ...
2021/11/19 09:04:49 Job still running ...
2021/11/19 09:05:20 Job still running ...
2021/11/19 09:05:50 Failed to execute job: job 2021-11-19_00_59_48-5046453759749057950 failed
panic: Failed to execute job: job 2021-11-19_00_59_48-5046453759749057950 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc0000480b0, 0x102faa5, 0x19, 0xc000229df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 29s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/3ghfkmvnt6moo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #334
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/334/display/redirect?page=changes>
Changes:
[samuelw] [BEAM-12818] Write windowed file output to a consistent subdirectory
[samuelw] [BEAM-13268] Change autosharding big query inserts to happen in parallel
[noreply] [BEAM-3293] Add check for error on NewIterable call (#16006)
[Brian Hulette] remove pkg_resources in run_generate_requirements.sh
[Brian Hulette] Run generatePythonRequirementsAll for pyarrow 6
[noreply] Update dev container tags used by Dataflow runner with unreleased SDKs.
[noreply] [BEAM-13265] Add withDeterministicRecordIdFn which allows for
[noreply] [BEAM-13183] [BEAM-8152] Use venv instead of virtualenv to create Python
------------------------------------------
[...truncated 27.26 KB...]
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/18 09:03:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1637226223044790088/model
2021/11/18 09:03:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1118065610"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637226223044790088/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637226223044790088/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1118065610",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/18 09:03:44 Submitted job: 2021-11-18_01_03_43-13883484321967811281
2021/11/18 09:03:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-18_01_03_43-13883484321967811281?project=apache-beam-testing
2021/11/18 09:03:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-18_01_03_43-13883484321967811281
2021/11/18 09:03:44 Job state: JOB_STATE_PENDING ...
2021/11/18 09:04:14 Job still running ...
2021/11/18 09:04:44 Job still running ...
2021/11/18 09:05:14 Job still running ...
2021/11/18 09:05:44 Job still running ...
2021/11/18 09:06:14 Job still running ...
2021/11/18 09:06:44 Job still running ...
2021/11/18 09:07:15 Failed to execute job: job 2021-11-18_01_03_43-13883484321967811281 failed
panic: Failed to execute job: job 2021-11-18_01_03_43-13883484321967811281 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc0000480b0, 0x102faa5, 0x19, 0xc000513df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 31s
4 actionable tasks: 4 executed
Publishing build scan...
Publishing failed.
The build scan server appears to be unavailable.
Please check https://status.gradle.com for the latest service status.
If the service is reported as available, please report this problem via https://gradle.com/help/plugin and include the following via copy/paste:
----------
Gradle version: 6.9.1
Plugin version: 3.4.1
Request URL: https://status.gradle.com
Request ID: 80d1fef7-7579-4cc1-a9e4-ff5aee675485
Response status code: 405
Response server type: Varnish
----------
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #333
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/333/display/redirect?page=changes>
Changes:
[aydar.zaynutdinov] [BEAM-13178][Playground]
[Pablo Estrada] [BEAM-8033] Throwing an error if a dataSourceProviderFn is defined twice
[minherz] fix: update dlp dependency version range
[noreply] [BEAM-3293] Finish E2E implementation of MultiMap side inputs, add
[noreply] Merge pull request #15740 from [BEAM-12936][Playground] Code editor -
[noreply] Merge pull request #15976 from [Playground][BEAM-12941][Bugfix] Fix
[noreply] Merge pull request #15991 [BEAM-13251][Playground] [Bugfix] Lint Fails
[noreply] Merge pull request #15990 from [BEAM-13177][Playground] Change using of
[noreply] [BEAM-13262] Forward for metrics.SingleResult (#15993)
[noreply] Generate Python container dependencies in an automated way. (#15927)
[noreply] [BEAM-13264] Allow pyarrow up to 6.x (#15995)
[noreply] Update the go get command with v2 (#15945)
[noreply] Go Quickstart: switch to Spark 3 JobServer for better out-of-box
[noreply] Golint fixes for recent Go SDK import (#15999)
[noreply] Merge pull request #15997: [BEAM-8688] Upgrading gcsio library to latest
------------------------------------------
[...truncated 26.54 KB...]
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/17 08:59:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1637139590560491673/model
2021/11/17 08:59:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1117065628"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637139590560491673/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637139590560491673/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1117065628",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/17 08:59:51 Submitted job: 2021-11-17_00_59_51-2996963651911951320
2021/11/17 08:59:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-17_00_59_51-2996963651911951320?project=apache-beam-testing
2021/11/17 08:59:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-17_00_59_51-2996963651911951320
2021/11/17 08:59:51 Job state: JOB_STATE_PENDING ...
2021/11/17 09:00:21 Job still running ...
2021/11/17 09:00:58 Job still running ...
2021/11/17 09:01:28 Job still running ...
2021/11/17 09:01:58 Job still running ...
2021/11/17 09:02:28 Job still running ...
2021/11/17 09:02:58 Job still running ...
2021/11/17 09:03:28 Job still running ...
2021/11/17 09:03:59 Job still running ...
2021/11/17 09:04:29 Job still running ...
2021/11/17 09:04:59 Job still running ...
2021/11/17 09:05:29 Job still running ...
2021/11/17 09:05:59 Failed to execute job: job 2021-11-17_00_59_51-2996963651911951320 failed
panic: Failed to execute job: job 2021-11-17_00_59_51-2996963651911951320 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140088, 0xc0000480b0, 0x102faa5, 0x19, 0xc000757df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 38s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/2stpjndvlrzhs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #332
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/332/display/redirect?page=changes>
Changes:
[brachipa] [BEAM-12737] error handling for sql calc error
[brachipa] [BEAM-12737] error handling for sql calc error
[brachipa] [BEAM-12737] error handling for sql calc error
[brachipa] [BEAM-12737] add test
[brachipa] [BEAM-12737] fix build
[brachipa] [BEAM-12737] fix build
[brachipa] revert
[brachipa] [beam-12737] cr fix
[brachipa] [beam-12737] cr fixes
[brachipa] [beam-12737] send errorTransformer to `buildPTransform`
[brachipa] [beam-12737] send errorTransformer to `buildPTransform`
[brachipa] [beam-12737] fix type `? extends POutput`
[Robert Bradshaw] Fully resolve type variables after PTransform type inference.
[brachipa] [beam-12737] add complex test, change error row type
[noreply] [BEAM-13226] Batch metrics parsing errors (#15972)
[noreply] [BEAM-13239] pass through io.EOF when decoding row (#15971)
[noreply] [BEAM-5378] Register types & funcs for examples. (#15970)
[Robert Bradshaw] Key-inferable type hints for CombinePerKey.
[Robert Bradshaw] Implement type variable binding for union types.
[Robert Bradshaw] Add comment about wildcard.
[noreply] [BEAM-3293] Add initial MultiMap side input backing type (#15975)
[Robert Bradshaw] Type inference deterministic coder fix for old Python versions.
[Robert Bradshaw] Also implement type matching for union types.
[noreply] [BEAM-13238] Bump all Dataflow Java VR timeouts (#15979)
[noreply] Merge pull request #15978: [BEAM-8691] Upgrading Java deps compatible
[noreply] [BEAM-13221] Don't drop last data. (#15939)
------------------------------------------
[...truncated 26.34 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/16 08:59:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1637053181824844508/model
2021/11/16 08:59:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1116065634"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637053181824844508/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1637053181824844508/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1116065634",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/16 08:59:43 Submitted job: 2021-11-16_00_59_42-11597340933704828743
2021/11/16 08:59:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-16_00_59_42-11597340933704828743?project=apache-beam-testing
2021/11/16 08:59:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-16_00_59_42-11597340933704828743
2021/11/16 08:59:43 Job state: JOB_STATE_PENDING ...
2021/11/16 09:00:13 Job still running ...
2021/11/16 09:00:43 Job still running ...
2021/11/16 09:01:13 Job still running ...
2021/11/16 09:01:43 Job still running ...
2021/11/16 09:02:13 Job still running ...
2021/11/16 09:02:43 Job still running ...
2021/11/16 09:03:13 Failed to execute job: job 2021-11-16_00_59_42-11597340933704828743 failed
panic: Failed to execute job: job 2021-11-16_00_59_42-11597340933704828743 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113ec28, 0xc0000480b0, 0x102e805, 0x19, 0xc00022fdf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 52s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/554wux4qypoug
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #331
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/331/display/redirect>
Changes:
------------------------------------------
[...truncated 26.34 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/15 08:59:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1636966790660183310/model
2021/11/15 08:59:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1115065603"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636966790660183310/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636966790660183310/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1115065603",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/15 08:59:52 Submitted job: 2021-11-15_00_59_51-3612469229674257281
2021/11/15 08:59:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-15_00_59_51-3612469229674257281?project=apache-beam-testing
2021/11/15 08:59:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-15_00_59_51-3612469229674257281
2021/11/15 08:59:52 Job state: JOB_STATE_PENDING ...
2021/11/15 09:00:22 Job still running ...
2021/11/15 09:00:52 Job still running ...
2021/11/15 09:01:22 Job still running ...
2021/11/15 09:01:52 Job still running ...
2021/11/15 09:02:22 Job still running ...
2021/11/15 09:02:52 Failed to execute job: job 2021-11-15_00_59_51-3612469229674257281 failed
panic: Failed to execute job: job 2021-11-15_00_59_51-3612469229674257281 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113eb48, 0xc000120000, 0x102e7f8, 0x19, 0xc000227df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 31s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/xm42gqmyy3o64
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #330
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/330/display/redirect>
Changes:
------------------------------------------
[...truncated 26.36 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/14 08:59:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1636880386639462127/model
2021/11/14 08:59:47 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1114065614"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636880386639462127/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636880386639462127/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1114065614",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/14 08:59:47 Submitted job: 2021-11-14_00_59_47-12523972385457370442
2021/11/14 08:59:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-14_00_59_47-12523972385457370442?project=apache-beam-testing
2021/11/14 08:59:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-14_00_59_47-12523972385457370442
2021/11/14 08:59:47 Job state: JOB_STATE_PENDING ...
2021/11/14 09:00:17 Job still running ...
2021/11/14 09:00:48 Job still running ...
2021/11/14 09:01:18 Job still running ...
2021/11/14 09:01:48 Job still running ...
2021/11/14 09:02:18 Job still running ...
2021/11/14 09:02:48 Job still running ...
2021/11/14 09:03:18 Failed to execute job: job 2021-11-14_00_59_47-12523972385457370442 failed
panic: Failed to execute job: job 2021-11-14_00_59_47-12523972385457370442 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113eb48, 0xc0000480b0, 0x102e7f8, 0x19, 0xc00067fdf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 57s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/a6vo4i64s3m5y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #329
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/329/display/redirect?page=changes>
Changes:
[mmack] [BEAM-13009] Bugfix: Prevent dataloss in DynamoDBIO write if
[mmack] [BEAM-13009] Bugfix: Prevent dataloss in DynamoDBIO write if
[Alexey Romanenko] [BEAM-8727] Bump software.amazon.awssdk to 2.17.77
[aydar.zaynutdinov] [BEAM-13224][Playground]
[Alexey Romanenko] [BEAM-4868] Bump com.amazonaws to 1.12.106
[noreply] [BEAM-13147] Fix nullability issues in aws (SDK v1 + v2) for AwsModule
[noreply] [BEAM-3293] Add encoding of map/multimap side inputs into proto (#15960)
[noreply] [BEAM-13052] Implement ProtoPlusCoder and add it to the default options
[noreply] [BEAM-13193] Add elements field in ProcessBundleRequest and ProcessBu…
[noreply] [BEAM-3304] Refactor trigger API (#15952)
[noreply] [BEAM-3293] Add NewKeyedIterable function to SideInputAdapter interface
[noreply] [BEAM-13223] Documents two new features of cross-language transforms
------------------------------------------
[...truncated 26.53 KB...]
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/13 08:59:52 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1636793991757095829/model
2021/11/13 08:59:52 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1113065617"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636793991757095829/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636793991757095829/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1113065617",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/13 08:59:53 Submitted job: 2021-11-13_00_59_52-10374975225141645225
2021/11/13 08:59:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-13_00_59_52-10374975225141645225?project=apache-beam-testing
2021/11/13 08:59:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-13_00_59_52-10374975225141645225
2021/11/13 08:59:53 Job state: JOB_STATE_PENDING ...
2021/11/13 09:00:23 Job still running ...
2021/11/13 09:00:53 Job still running ...
2021/11/13 09:01:23 Job still running ...
2021/11/13 09:01:53 Job still running ...
2021/11/13 09:02:23 Job still running ...
2021/11/13 09:02:53 Job still running ...
2021/11/13 09:03:23 Job still running ...
2021/11/13 09:03:53 Job still running ...
2021/11/13 09:04:23 Job still running ...
2021/11/13 09:04:53 Job still running ...
2021/11/13 09:05:23 Job still running ...
2021/11/13 09:05:53 Failed to execute job: job 2021-11-13_00_59_52-10374975225141645225 failed
panic: Failed to execute job: job 2021-11-13_00_59_52-10374975225141645225 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113eb48, 0xc0000480b0, 0x102e7f8, 0x19, 0xc000443df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 33s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/zxl6gr72zm3qi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#328
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/328/display/redirect?page=changes>
Changes:
[Kyle Weaver] Update Beam website to release 2.34.0.
[noreply] [BEAM-12550] Parallelizable kurtosis Implementation (#15909)
[noreply] [BEAM-13016] Remove avro-python3 dependency from Beam (#15900)
[Kyle Weaver] Prepare docs for 2.34.0 release.
[noreply] [BEAM-13133] Loosen partitioning requirement for sample (#15818)
[noreply] [BEAM-13228] fix data race in metrics.store (#15946)
[noreply] [BEAM-3293] Add binding cases for MultiMap side inputs (#15943)
[noreply] [BEAM-13222] Re-enable Spanner integration tests (#15948)
[noreply] Merge pull request #15926 from [BEAM-13110][Playground] Playground
[noreply] [BEAM-13025] Disable deduplicating messages, as Dedupe is broken on
[noreply] [BEAM-13001] collect DoFn metrics for Combine (#15911)
------------------------------------------
[...truncated 26.36 KB...]
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/12 08:59:52 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1636707592427973819/model
2021/11/12 08:59:52 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1112065632"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636707592427973819/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636707592427973819/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1112065632",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/12 08:59:53 Submitted job: 2021-11-12_00_59_52-514352972093671594
2021/11/12 08:59:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-12_00_59_52-514352972093671594?project=apache-beam-testing
2021/11/12 08:59:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-12_00_59_52-514352972093671594
2021/11/12 08:59:53 Job state: JOB_STATE_PENDING ...
2021/11/12 09:00:24 Job state: JOB_STATE_PENDING ...
2021/11/12 09:00:54 Job still running ...
2021/11/12 09:01:24 Job still running ...
2021/11/12 09:01:54 Job still running ...
2021/11/12 09:02:24 Job still running ...
2021/11/12 09:02:54 Job still running ...
2021/11/12 09:03:24 Job still running ...
2021/11/12 09:03:54 Job still running ...
2021/11/12 09:04:24 Failed to execute job: job 2021-11-12_00_59_52-514352972093671594 failed
panic: Failed to execute job: job 2021-11-12_00_59_52-514352972093671594 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113f388, 0xc000128000, 0x102edff, 0x19, 0xc000531df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 3s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/ftnv6ohzz76xo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#327
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/327/display/redirect?page=changes>
Changes:
[sergey.kalinin] Initial add for dockerfiles and build scripts
[sergey.kalinin] Initial add for terraform scripts for infra provision
[sergey.kalinin] Add licenses
[sergey.kalinin] Add fixes to docker plugin and also build arg for beam sdk image
[sergey.kalinin] Remove wrongly added comments
[sergey.kalinin] Add beam playground applications deploy
[sergey.kalinin] Remove wrongly added log file
[sergey.kalinin] Fix syntax
[sergey.kalinin] Added default values
[sergey.kalinin] Add default value to base image
[sergey.kalinin] Added Beam Version as build arg, also changed way of getting tags for
[sergey.kalinin] Added readme file
[sergey.kalinin] Add workflow to build backend application
[sergey.kalinin] Add license
[asottile] remove unused future / futures dependencies
[sergey.kalinin] Add frontend workflow
[sergey.kalinin] Add license to README and added reader access to bucket
[sergey.kalinin] Remove trailing whitespace
[relax] for existing tables, no need to set a schema
[avilovpavel6] Fix environment_service_test.go
[sergey.kalinin] Remove comment from dockerfile
[noreply] [BEAM-13190] Elide trailing nils (#15920)
[noreply] [BEAM-13052] Increment protobuf version to 3.19.0 (#15883)
[noreply] [BEAM-3304] refactoring trigger package in GoSDK (#15933)
[noreply] [BEAM-13001] Hook to configure sampling period for DoFn metric
[noreply] [BEAM-3293] Add MultiMap side input decomposition (#15934)
[noreply] [BEAM-12651] Exclude packages from jacoco report (#15792)
[noreply] [BEAM-13222] Skip spanner integration tests (#15942)
[noreply] BEAM-13189 Python TextIO: add escapechar feature. (#15901)
------------------------------------------
[...truncated 26.45 KB...]
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/11 08:59:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1636621193527983072/model
2021/11/11 08:59:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1111065625"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636621193527983072/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636621193527983072/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1111065625",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/11 08:59:54 Submitted job: 2021-11-11_00_59_54-7835904401797827554
2021/11/11 08:59:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-11_00_59_54-7835904401797827554?project=apache-beam-testing
2021/11/11 08:59:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-11_00_59_54-7835904401797827554
2021/11/11 08:59:54 Job state: JOB_STATE_PENDING ...
2021/11/11 09:00:24 Job still running ...
2021/11/11 09:00:54 Job still running ...
2021/11/11 09:01:24 Job still running ...
2021/11/11 09:01:54 Job still running ...
2021/11/11 09:02:24 Job still running ...
2021/11/11 09:02:54 Job still running ...
2021/11/11 09:03:25 Job still running ...
2021/11/11 09:03:55 Job still running ...
2021/11/11 09:04:25 Job still running ...
2021/11/11 09:04:55 Job still running ...
2021/11/11 09:05:25 Failed to execute job: job 2021-11-11_00_59_54-7835904401797827554 failed
panic: Failed to execute job: job 2021-11-11_00_59_54-7835904401797827554 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113f388, 0xc00003e0b0, 0x102eddf, 0x19, 0xc00065ddf0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 3s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/vq7kgexc7wul6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#326
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/326/display/redirect?page=changes>
Changes:
[Kyle Weaver] [BEAM-12976] Add Java interfaces for projection pushdown.
[Kyle Weaver] fix cast
[Kyle Weaver] [BEAM-12976] Address review comments.
[Kyle Weaver] Hard-code output tag instead of making it public.
[Kyle Weaver] revert MAIN_OUTPUT_TAG to private
[Kyle Weaver] Remove WITHOUT_FIELD_ORDERING. Field reordering will be a prerequisite
[msbukal] Minor HL7v2IO Fixes
[dpcollins] Add detection of BundleFinalizers to DoFnSignatures
[dpcollins] Add enable_prime to the unified worker experiment list.
[dpcollins] Raise an exception before trying to launch a pipeline using
[dpcollins] Fix detection to properly null check.
[Andrew Pilloud] [BEAM-13056] Expose FieldAccess in DoFnSchemaInformation
[noreply] [BEAM-11097] Create hook to enable cross-bundle side input caching
[noreply] Merge pull request #15804 from [BEAM-13109][Playground] Add processing
[noreply] Improve FhirIO LRO Counters + minor fixes (#15921)
[noreply] Merge pull request #15771 from Enable BQ Standard SQL dialect style
[noreply] [BEAM-11217] Metrics querying for Pcol metrics (#15923)
------------------------------------------
[...truncated 26.53 KB...]
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/10 08:59:55 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1636534795098294699/model
2021/11/10 08:59:55 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1110065631"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636534795098294699/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636534795098294699/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1110065631",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/10 08:59:56 Submitted job: 2021-11-10_00_59_55-11651897367469857234
2021/11/10 08:59:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-10_00_59_55-11651897367469857234?project=apache-beam-testing
2021/11/10 08:59:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-10_00_59_55-11651897367469857234
2021/11/10 08:59:56 Job state: JOB_STATE_PENDING ...
2021/11/10 09:00:26 Job still running ...
2021/11/10 09:00:56 Job still running ...
2021/11/10 09:01:26 Job still running ...
2021/11/10 09:01:56 Job still running ...
2021/11/10 09:02:26 Job still running ...
2021/11/10 09:02:56 Job still running ...
2021/11/10 09:03:26 Job still running ...
2021/11/10 09:03:56 Job still running ...
2021/11/10 09:04:26 Job still running ...
2021/11/10 09:04:56 Job still running ...
2021/11/10 09:05:26 Failed to execute job: job 2021-11-10_00_59_55-11651897367469857234 failed
panic: Failed to execute job: job 2021-11-10_00_59_55-11651897367469857234 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113e208, 0xc00003e0b0, 0x102dcff, 0x19, 0xc000569df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x53a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 6s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/unl6fepdmwoeu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#325
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/325/display/redirect?page=changes>
Changes:
[aydar.zaynutdinov] [BEAM-13155][Playground]
[25622840+adude3141] [BEAM-13157] add regression test for hadoop configuration on
[noreply] Merge pull request #15873 from [BEAM-13181] Remove Sharding from
[noreply] Merge pull request #15813 from [BEAM-13071] [Playground] Update run code
[Kyle Weaver] [BEAM-5172] Temporary ignore testSplit and testSizes tests waiting for a
------------------------------------------
[...truncated 26.33 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/09 08:59:46 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1636448385764239040/model
2021/11/09 08:59:46 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1109065621"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636448385764239040/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636448385764239040/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1109065621",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/09 08:59:46 Submitted job: 2021-11-09_00_59_46-509483667712949222
2021/11/09 08:59:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-09_00_59_46-509483667712949222?project=apache-beam-testing
2021/11/09 08:59:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-09_00_59_46-509483667712949222
2021/11/09 08:59:46 Job state: JOB_STATE_PENDING ...
2021/11/09 09:00:17 Job still running ...
2021/11/09 09:00:47 Job still running ...
2021/11/09 09:01:17 Job still running ...
2021/11/09 09:01:47 Job still running ...
2021/11/09 09:02:17 Job still running ...
2021/11/09 09:02:47 Job still running ...
2021/11/09 09:03:17 Failed to execute job: job 2021-11-09_00_59_46-509483667712949222 failed
panic: Failed to execute job: job 2021-11-09_00_59_46-509483667712949222 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113abc8, 0xc000120000, 0x102ac9f, 0x19, 0xc000633e38, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x525
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 59s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/qxybh7ei3s7qk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#324
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/324/display/redirect>
Changes:
------------------------------------------
[...truncated 26.38 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/08 08:59:57 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1636361996457873126/model
2021/11/08 08:59:57 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1108065600"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636361996457873126/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636361996457873126/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1108065600",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/08 08:59:57 Submitted job: 2021-11-08_00_59_57-4607493203257885108
2021/11/08 08:59:57 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-08_00_59_57-4607493203257885108?project=apache-beam-testing
2021/11/08 08:59:57 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-08_00_59_57-4607493203257885108
2021/11/08 08:59:57 Job state: JOB_STATE_PENDING ...
2021/11/08 09:00:27 Job still running ...
2021/11/08 09:00:58 Job still running ...
2021/11/08 09:01:28 Job still running ...
2021/11/08 09:01:58 Job still running ...
2021/11/08 09:02:28 Job still running ...
2021/11/08 09:02:58 Job still running ...
2021/11/08 09:03:28 Failed to execute job: job 2021-11-08_00_59_57-4607493203257885108 failed
panic: Failed to execute job: job 2021-11-08_00_59_57-4607493203257885108 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113abc8, 0xc000128000, 0x102ac9f, 0x19, 0xc0002dde38, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x525
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 7s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/junwj4lb3gamg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#323
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/323/display/redirect?page=changes>
Changes:
[relax] remove log statement
------------------------------------------
[...truncated 26.40 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/07 12:54:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1636289682411448166/model
2021/11/07 12:54:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1107065606"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636289682411448166/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636289682411448166/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1107065606",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/07 12:54:43 Submitted job: 2021-11-07_04_54_42-18316119450530721053
2021/11/07 12:54:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-07_04_54_42-18316119450530721053?project=apache-beam-testing
2021/11/07 12:54:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-07_04_54_42-18316119450530721053
2021/11/07 12:54:43 Job state: JOB_STATE_PENDING ...
2021/11/07 12:55:13 Job still running ...
2021/11/07 12:55:43 Job still running ...
2021/11/07 12:56:13 Job still running ...
2021/11/07 12:56:43 Job still running ...
2021/11/07 12:57:13 Job still running ...
2021/11/07 12:57:43 Job still running ...
2021/11/07 12:58:14 Failed to execute job: job 2021-11-07_04_54_42-18316119450530721053 failed
panic: Failed to execute job: job 2021-11-07_04_54_42-18316119450530721053 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113abc8, 0xc00003e0b0, 0x102ac9f, 0x19, 0xc00059de38, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x525
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 13s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/grbufwrigazrq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#322
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/322/display/redirect?page=changes>
Changes:
[noreply] [adhoc] Speedup slow tests for AWS IO modules (#15899)
[noreply] [BEAM-12566] Implement set_axis for DataFrame and Series (#15773)
[noreply] [BEAM-13192] Fix buggy retry tests for AWS SnsIO (#15910)
[noreply] [BEAM-11217] Metrics Query filtering for DoFn metrics. (#15887)
[noreply] [Go SDK] Go SDK Exits Experimental (#15894)
[joseinigo] [BEAM-13080] Fix number of default keys
[joseinigo] [BEAM-13080] Fix number of default keys
------------------------------------------
[...truncated 26.36 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/06 09:00:01 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1636189199977377256/model
2021/11/06 09:00:01 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1106065611"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636189199977377256/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636189199977377256/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1106065611",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/06 09:00:02 Submitted job: 2021-11-06_02_00_01-5076885782725942868
2021/11/06 09:00:02 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-06_02_00_01-5076885782725942868?project=apache-beam-testing
2021/11/06 09:00:02 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-06_02_00_01-5076885782725942868
2021/11/06 09:00:02 Job state: JOB_STATE_PENDING ...
2021/11/06 09:00:32 Job still running ...
2021/11/06 09:01:02 Job still running ...
2021/11/06 09:01:32 Job still running ...
2021/11/06 09:02:02 Job still running ...
2021/11/06 09:02:32 Job still running ...
2021/11/06 09:03:02 Job still running ...
2021/11/06 09:03:33 Failed to execute job: job 2021-11-06_02_00_01-5076885782725942868 failed
panic: Failed to execute job: job 2021-11-06_02_00_01-5076885782725942868 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x113abc8, 0xc000118000, 0x102ac9f, 0x19, 0xc0001f9e38, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x525
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 11s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/ke2bc3fju44zy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#321
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/321/display/redirect?page=changes>
Changes:
[heejong] [BEAM-13021] Deduplicate Python artifact not only by hash but also by
[heejong] add test
[heejong] rename variables
[mmack] [BEAM-11440] Add integration test for KinesisIO using Localstack on
[mmack] Bump localstack container version for more robust version with respect
[mmack] Bump localstack container version for DynamoDBIOTest to version used in
[mmack] Apply format
[mmack] Apply format
[mmack] Use vendored guava deps
[Luke Cwik] [BEAM-3811] Code clean-up of the CancelleableQueue to not throw
[heejong] rearrange comparison order
[Luke Cwik] [BEAM-13164] Address most of a race condition between instantiation and
[Robert Bradshaw] Defer filesToStage construction until after full jar resolution.
[heejong] s/pathes/paths/
[noreply] Merge pull request #15835: [BEAM-11205] Google Libraries BOM 24.0.0 and
[noreply] Merge pull request #15810: [BEAM-2791] Support low-latency StorageApi
[noreply] [BEAM-13081] Fixes a compatible issue of decoding null-value bitmap
------------------------------------------
[...truncated 26.33 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/05 08:59:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1636102785151778479/model
2021/11/05 08:59:45 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1105065621"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636102785151778479/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636102785151778479/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1105065621",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/05 08:59:46 Submitted job: 2021-11-05_01_59_45-6062708216777078905
2021/11/05 08:59:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-05_01_59_45-6062708216777078905?project=apache-beam-testing
2021/11/05 08:59:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-05_01_59_45-6062708216777078905
2021/11/05 08:59:46 Job state: JOB_STATE_PENDING ...
2021/11/05 09:00:16 Job still running ...
2021/11/05 09:00:46 Job still running ...
2021/11/05 09:01:16 Job still running ...
2021/11/05 09:01:46 Job still running ...
2021/11/05 09:02:16 Job still running ...
2021/11/05 09:02:46 Job still running ...
2021/11/05 09:03:16 Failed to execute job: job 2021-11-05_01_59_45-6062708216777078905 failed
panic: Failed to execute job: job 2021-11-05_01_59_45-6062708216777078905 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1139908, 0xc000120000, 0x1029b3a, 0x19, 0xc000357e38, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x525
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 54s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/2jivict7kkm36
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#320
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/320/display/redirect?page=changes>
Changes:
[noreply] Add missing parentheses for Python test example
[noreply] Update test input and imports
[stranniknm] [BEAM-13105] playground - add shorcut hint tooltip
[25622840+adude3141] [BEAM-13157] support hadoop configuration on ParquetIO.Parse
[Pablo Estrada] JdbcIO has a single WriteFn underlying all implementations
[dpcollins] Performance improvement to PubSubLiteIO to not use a streaming committer
[noreply] Merge pull request #15854 from [BEAM-13046][Playground] protobuf
[noreply] [BEAM-12550] Parallelizable skew Implementation (#15809)
[noreply] Merge pull request #15782 from [BEAM-13034] [Playground] add semantics
[hlagosperez] Use BigQuieryIO.loadProjectId in WriteRename class to create
[noreply] [BEAM-13099] Use vendored Calcite 1.28.0 in SQL extensions (#15836)
[Luke Cwik] [BEAM-13015] Use a network based channel instead of an inmemory one
[Pablo Estrada] Addressing comments
[noreply] Merge pull request #15839 from [BEAM-13041][Playground] Prepare files
[noreply] [BEAM-13001] updated CHANGES.md to include msec counter for Go (#15872)
[noreply] Add window mapping to CHANGES.md (#15871)
[noreply] Merge pull request #15784 from [BEAM-8135] - Removing
[noreply] [BEAM-13119] Subdirectory prefix tag for Go SDK (#15881)
[noreply] Merge pull request #15852 from [BEAM-13102] [Playground] update
[Kyle Weaver] Fix typo: s/spark/twister2
------------------------------------------
[...truncated 26.33 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/04 08:59:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1636016392536109039/model
2021/11/04 08:59:53 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1104065626"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636016392536109039/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1636016392536109039/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1104065626",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/04 08:59:53 Submitted job: 2021-11-04_01_59_53-5092118561569768202
2021/11/04 08:59:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-04_01_59_53-5092118561569768202?project=apache-beam-testing
2021/11/04 08:59:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-04_01_59_53-5092118561569768202
2021/11/04 08:59:53 Job state: JOB_STATE_PENDING ...
2021/11/04 09:00:24 Job still running ...
2021/11/04 09:00:54 Job still running ...
2021/11/04 09:01:24 Job still running ...
2021/11/04 09:01:54 Job still running ...
2021/11/04 09:02:24 Job still running ...
2021/11/04 09:02:54 Job still running ...
2021/11/04 09:03:24 Failed to execute job: job 2021-11-04_01_59_53-5092118561569768202 failed
panic: Failed to execute job: job 2021-11-04_01_59_53-5092118561569768202 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1139908, 0xc000120000, 0x1029b3a, 0x19, 0xc0004f9e38, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x525
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 3s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/6g7yrsbxgmme2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#319
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/319/display/redirect?page=changes>
Changes:
[Andrew Pilloud] [BEAM-13118] Use branch for nightly "tag", tags are immutable
[dmitrii_kuzin] [BEAM-12730] Python. Custom delimiter add corner case
[Alexey Romanenko] [BEAM-12070] ParquetIO: use splittable reading by default
[noreply] [BEAM-13001] fixes nil reference error in Extractor.ExtractFrom (#15865)
[noreply] Merge pull request #15842 from [BEAM-13125][Playground] Update
[noreply] Merge pull request #15838 from [BEAM-13127] [Playground] Implement TCP
[noreply] Merge pull request #15832 from [BEAM-13149] Changing readWithPartitions
[noreply] Minor: add resource key to presentation materials link (#15867)
------------------------------------------
[...truncated 26.36 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/03 08:59:58 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1635929997444296337/model
2021/11/03 08:59:58 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1103065615"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635929997444296337/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635929997444296337/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1103065615",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/03 08:59:58 Submitted job: 2021-11-03_01_59_58-13703993886293200383
2021/11/03 08:59:58 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-03_01_59_58-13703993886293200383?project=apache-beam-testing
2021/11/03 08:59:58 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-03_01_59_58-13703993886293200383
2021/11/03 08:59:58 Job state: JOB_STATE_PENDING ...
2021/11/03 09:00:28 Job still running ...
2021/11/03 09:00:58 Job still running ...
2021/11/03 09:01:28 Job still running ...
2021/11/03 09:01:58 Job still running ...
2021/11/03 09:02:29 Job still running ...
2021/11/03 09:02:59 Job still running ...
2021/11/03 09:03:29 Failed to execute job: job 2021-11-03_01_59_58-13703993886293200383 failed
panic: Failed to execute job: job 2021-11-03_01_59_58-13703993886293200383 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1139908, 0xc000120000, 0x1029b3a, 0x19, 0xc000377e38, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x525
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 7s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/6caxjdukajohs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#318
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/318/display/redirect?page=changes>
Changes:
[aydar.zaynutdinov] [BEAM-13145][Playground]
[avilovpavel6] Added cleanup os env before and after tests
[noreply] [BEAM-11936] Fix errorprone warnings (#15821)
[noreply] [BEAM-13001] fixes Golint issues (#15859)
[noreply] Merge pull request #15840 from [Playground][BEAM-13146][Bugfix]
------------------------------------------
[...truncated 26.52 KB...]
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/02 08:59:59 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1635843599040815892/model
2021/11/02 08:59:59 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1102065624"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635843599040815892/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635843599040815892/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1102065624",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/02 09:00:00 Submitted job: 2021-11-02_01_59_59-9879713196626504885
2021/11/02 09:00:00 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-02_01_59_59-9879713196626504885?project=apache-beam-testing
2021/11/02 09:00:00 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-02_01_59_59-9879713196626504885
2021/11/02 09:00:00 Job state: JOB_STATE_PENDING ...
2021/11/02 09:00:30 Job still running ...
2021/11/02 09:01:00 Job still running ...
2021/11/02 09:01:30 Job still running ...
2021/11/02 09:02:00 Job still running ...
2021/11/02 09:02:30 Job still running ...
2021/11/02 09:03:00 Job still running ...
2021/11/02 09:03:30 Job still running ...
2021/11/02 09:04:00 Job still running ...
2021/11/02 09:04:30 Job still running ...
2021/11/02 09:05:01 Job still running ...
2021/11/02 09:05:31 Job still running ...
2021/11/02 09:06:01 Failed to execute job: job 2021-11-02_01_59_59-9879713196626504885 failed
panic: Failed to execute job: job 2021-11-02_01_59_59-9879713196626504885 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1139908, 0xc00003e0c0, 0x1029b3a, 0x19, 0xc0001f7e38, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x525
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 39s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/kniub63ouicpu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#317
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/317/display/redirect>
Changes:
------------------------------------------
[...truncated 26.49 KB...]
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/01 08:59:52 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1635757192042273446/model
2021/11/01 08:59:52 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1101065616"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635757192042273446/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635757192042273446/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1101065616",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/11/01 08:59:53 Submitted job: 2021-11-01_01_59_52-9784495018099131538
2021/11/01 08:59:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-11-01_01_59_52-9784495018099131538?project=apache-beam-testing
2021/11/01 08:59:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-11-01_01_59_52-9784495018099131538
2021/11/01 08:59:53 Job state: JOB_STATE_PENDING ...
2021/11/01 09:00:23 Job still running ...
2021/11/01 09:00:53 Job still running ...
2021/11/01 09:01:23 Job still running ...
2021/11/01 09:01:53 Job still running ...
2021/11/01 09:02:23 Job still running ...
2021/11/01 09:02:53 Job still running ...
2021/11/01 09:03:23 Job still running ...
2021/11/01 09:03:53 Job still running ...
2021/11/01 09:04:23 Job still running ...
2021/11/01 09:04:53 Job still running ...
2021/11/01 09:05:23 Failed to execute job: job 2021-11-01_01_59_52-9784495018099131538 failed
panic: Failed to execute job: job 2021-11-01_01_59_52-9784495018099131538 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1139908, 0xc000120000, 0x1029b3a, 0x19, 0xc0004d3e38, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x525
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 2s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/sy3yqem2e323w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#316
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/316/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #15753 from [BEAM-13080] Add option in Reshuffle to
------------------------------------------
[...truncated 26.38 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/31 08:59:48 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1635670787562778369/model
2021/10/31 08:59:48 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1031065618"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635670787562778369/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635670787562778369/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1031065618",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/31 08:59:48 Submitted job: 2021-10-31_01_59_48-3628971225731267544
2021/10/31 08:59:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-31_01_59_48-3628971225731267544?project=apache-beam-testing
2021/10/31 08:59:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-31_01_59_48-3628971225731267544
2021/10/31 08:59:48 Job state: JOB_STATE_PENDING ...
2021/10/31 09:00:18 Job still running ...
2021/10/31 09:00:48 Job still running ...
2021/10/31 09:01:18 Job still running ...
2021/10/31 09:01:48 Job still running ...
2021/10/31 09:02:18 Job still running ...
2021/10/31 09:02:48 Job still running ...
2021/10/31 09:03:18 Failed to execute job: job 2021-10-31_01_59_48-3628971225731267544 failed
panic: Failed to execute job: job 2021-10-31_01_59_48-3628971225731267544 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1139908, 0xc00003e0c0, 0x1029b3a, 0x19, 0xc000227e38, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x525
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 57s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/b45zvpa5rfgag
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#315
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/315/display/redirect?page=changes>
Changes:
[Luke Cwik] [BEAM-13015] Migrate bundle processing in the SDK harness to using
[noreply] [BEAM-8958] Use AWS credentials provider with BasicKinesisProvider
[Brian Hulette] [BEAM-13099] Copy vendored calcite build for 1.28.0
[Brian Hulette] [BEAM-13099] Modifications for vendor/calcite-1_28_0 build
[noreply] [BEAM-13099] Use BlockBuilder.add(..) rather than
[noreply] Minor: Remove broken python compatibility checks (#15828)
[noreply] [BEAM-12047] Updates CHANGES.md to mention the URN convention (#15845)
[noreply] [BEAM-13001] DoFn metrics for Go SDK (#15657)
------------------------------------------
[...truncated 26.41 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/30 08:59:55 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1635584394744954140/model
2021/10/30 08:59:55 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1030065600"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635584394744954140/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635584394744954140/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1030065600",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/30 08:59:55 Submitted job: 2021-10-30_01_59_55-1991724444404877005
2021/10/30 08:59:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-30_01_59_55-1991724444404877005?project=apache-beam-testing
2021/10/30 08:59:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-30_01_59_55-1991724444404877005
2021/10/30 08:59:56 Job state: JOB_STATE_PENDING ...
2021/10/30 09:00:26 Job still running ...
2021/10/30 09:00:56 Job still running ...
2021/10/30 09:01:26 Job still running ...
2021/10/30 09:01:56 Job still running ...
2021/10/30 09:02:26 Job still running ...
2021/10/30 09:02:56 Job still running ...
2021/10/30 09:03:27 Failed to execute job: job 2021-10-30_01_59_55-1991724444404877005 failed
panic: Failed to execute job: job 2021-10-30_01_59_55-1991724444404877005 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1139908, 0xc00003e0c0, 0x1029b3a, 0x19, 0xc0002dde38, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x525
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 5s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/lejeddozvtrgu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#314
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/314/display/redirect?page=changes>
Changes:
[artur.khanin] Implemented GetCompileOutput and covered with unit tests
[artur.khanin] Replaced logging library regarding PR comment
[daria.malkova] fix executor tests
[mmack] [BEAM-13138] Update code to retrieve container endpoint
[aydar.zaynutdinov] [BEAM-13120][Playground]
[noreply] Merge pull request #15709 from [BEAM-12967] [Playground] Create Example
[noreply] Merge pull request #15294 from [BEAM-11986] Spanner write metric
[noreply] [BEAM-13130] Remove persistent references to stateKeyReaders (#15815)
[Brian Hulette] [BEAM-13099] Replace call to RelNode.metadata with BeamRelMetadataQuery
[Brian Hulette] [BEAM-13099] Update all rels to use BeamRelMetadataQuery
[Kyle Weaver] [BEAM-13143] Fix python doc generator error.
[Pablo Estrada] Handle runner-provided shards for TextIO
[noreply] Merge pull request #15721 from [BEAM-13023][Playground] Implement Redis
[noreply] Merge pull request #15802 from [BEAM-12970][Playground] Implement gRPC
[noreply] Merge pull request #15800 from [BEAM-12970][Playground] Implement gRPC
------------------------------------------
[...truncated 26.49 KB...]
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/29 08:59:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1635497992838709785/model
2021/10/29 08:59:53 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1029065629"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635497992838709785/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635497992838709785/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1029065629",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/29 08:59:54 Submitted job: 2021-10-29_01_59_53-5170386651811240411
2021/10/29 08:59:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-29_01_59_53-5170386651811240411?project=apache-beam-testing
2021/10/29 08:59:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-29_01_59_53-5170386651811240411
2021/10/29 08:59:54 Job state: JOB_STATE_PENDING ...
2021/10/29 09:00:24 Job still running ...
2021/10/29 09:00:54 Job still running ...
2021/10/29 09:01:24 Job still running ...
2021/10/29 09:01:54 Job still running ...
2021/10/29 09:02:24 Job still running ...
2021/10/29 09:02:54 Job still running ...
2021/10/29 09:03:24 Job still running ...
2021/10/29 09:03:54 Job still running ...
2021/10/29 09:04:24 Job still running ...
2021/10/29 09:04:54 Job still running ...
2021/10/29 09:05:24 Failed to execute job: job 2021-10-29_01_59_53-5170386651811240411 failed
panic: Failed to execute job: job 2021-10-29_01_59_53-5170386651811240411 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1133e48, 0xc000128000, 0x1024905, 0x19, 0xc0005c1e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 4s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/js2fiuzbxepai
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#313
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/313/display/redirect?page=changes>
Changes:
[relax] support json
[aydar.zaynutdinov] [BEAM-12970][Playground]
[Andrew Pilloud] [BEAM-13118] Don't force push to master
[aydar.zaynutdinov] [BEAM-12970][Playground]
[eugene.nikolayev] Fix Python docs build pre-commit failures.
[mmack] [BEAM-8958] Use AWS credentials provider with BasicKinesisProvider (AWS
[aydar.zaynutdinov] [BEAM-12970][Playground]
[noreply] Merge pull request #15731: [BEAM-13067] Mark GroupIntoBatches output as
[noreply] [BEAM-13066, BEAM-13087] Workaround for coder type combiner packing
[noreply] [BEAM-13066] Disable using abstract iterable by default. (#15805)
[aydar.zaynutdinov] [BEAM-12970][Playground]
------------------------------------------
[...truncated 26.35 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/28 08:59:50 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1635411589810701190/model
2021/10/28 08:59:50 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1028065618"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635411589810701190/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635411589810701190/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1028065618",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/28 08:59:50 Submitted job: 2021-10-28_01_59_50-6199492983343972450
2021/10/28 08:59:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-28_01_59_50-6199492983343972450?project=apache-beam-testing
2021/10/28 08:59:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-28_01_59_50-6199492983343972450
2021/10/28 08:59:51 Job state: JOB_STATE_PENDING ...
2021/10/28 09:00:21 Job still running ...
2021/10/28 09:00:51 Job still running ...
2021/10/28 09:01:21 Job still running ...
2021/10/28 09:01:51 Job still running ...
2021/10/28 09:02:21 Job still running ...
2021/10/28 09:02:51 Job still running ...
2021/10/28 09:03:21 Failed to execute job: job 2021-10-28_01_59_50-6199492983343972450 failed
panic: Failed to execute job: job 2021-10-28_01_59_50-6199492983343972450 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1133e08, 0xc00003e0c0, 0x1024905, 0x19, 0xc000565e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 0s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/qlrhc2l6go3ve
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#312
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/312/display/redirect?page=changes>
Changes:
[baeminbo] [BEAM-6721] Set numShards dynamically for TextIO.write()
[heejong] [BEAM-12978] Customizable dependency for Java external transform
[melissapa] [BEAM-11758] Update basics page: Splittable DoFn
[heejong] add ConfigT param to getDependencies method
[Alexey Romanenko] [BEAM-13104] ParquetIO: SplitReadFn must read the whole block
[noreply] Change sql.Options to an interface under sqlx. (#15790)
[melissapa] Address review feedback
[noreply] [BEAM-4149] Ensure that we always provide and require the worker id.
[noreply] [BEAM-13098] Fix translation of repeated TableRow fields (#15779)
------------------------------------------
[...truncated 26.33 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/27 08:59:55 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1635325195193515579/model
2021/10/27 08:59:55 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1027065610"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635325195193515579/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635325195193515579/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1027065610",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/27 08:59:56 Submitted job: 2021-10-27_01_59_55-6692828744783447726
2021/10/27 08:59:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-27_01_59_55-6692828744783447726?project=apache-beam-testing
2021/10/27 08:59:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-27_01_59_55-6692828744783447726
2021/10/27 08:59:56 Job state: JOB_STATE_PENDING ...
2021/10/27 09:00:26 Job still running ...
2021/10/27 09:00:56 Job still running ...
2021/10/27 09:01:26 Job still running ...
2021/10/27 09:01:56 Job still running ...
2021/10/27 09:02:26 Job still running ...
2021/10/27 09:02:56 Job still running ...
2021/10/27 09:03:26 Failed to execute job: job 2021-10-27_01_59_55-6692828744783447726 failed
panic: Failed to execute job: job 2021-10-27_01_59_55-6692828744783447726 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1133e08, 0xc00003e0c0, 0x1024905, 0x19, 0xc0003f5e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 6s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/qwbprdxiebcie
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#311
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/311/display/redirect?page=changes>
Changes:
[Luke Cwik] [BEAM-12522] Enable side inputs on all splittable DoFn execution time
[aydar.zaynutdinov] [BEAM-13062][Playground]
[ilya.kozyrev] Add environment_service.go and structures for beam sdk, network envs,
[aydar.zaynutdinov] [BEAM-13062][Playground]
[noreply] Merge pull request #15772 from [BEAM-13032] [Playground] Implement the
[noreply] Merge pull request #15714 from [BEAM-13005] [Playground] Implement local
[noreply] Merge pull request #15770 from [BEAM-13095][Playground] Using working
[noreply] [BEAM-11758] Update basics page: Aggregation, Runner, UDF, Schema
[noreply] Merge pull request #15783 from [BEAM-13048] [Playground] Add shortcuts
[Luke Cwik] [BEAM-8543] Fix test filtering for Dataflow Runner V2 to exclude
[noreply] Merge pull request #15744 from [BEAM-13072][Playground] Executor builder
------------------------------------------
[...truncated 26.36 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/26 08:59:50 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1635238790029287476/model
2021/10/26 08:59:50 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1026065627"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635238790029287476/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635238790029287476/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1026065627",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/26 08:59:51 Submitted job: 2021-10-26_01_59_50-5189440030007149647
2021/10/26 08:59:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-26_01_59_50-5189440030007149647?project=apache-beam-testing
2021/10/26 08:59:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-26_01_59_50-5189440030007149647
2021/10/26 08:59:51 Job state: JOB_STATE_PENDING ...
2021/10/26 09:00:21 Job still running ...
2021/10/26 09:00:51 Job still running ...
2021/10/26 09:01:21 Job still running ...
2021/10/26 09:01:51 Job still running ...
2021/10/26 09:02:21 Job still running ...
2021/10/26 09:02:51 Job still running ...
2021/10/26 09:03:21 Failed to execute job: job 2021-10-26_01_59_50-5189440030007149647 failed
panic: Failed to execute job: job 2021-10-26_01_59_50-5189440030007149647 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1133e08, 0xc000128000, 0x1024905, 0x19, 0xc0004e1e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 0s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/jkumdz6djxxyy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#310
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/310/display/redirect?page=changes>
Changes:
[noreply] Fixing BigQueryIO request too big corner case for streaming inserts
------------------------------------------
[...truncated 26.35 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/25 08:59:48 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1635152388392274525/model
2021/10/25 08:59:48 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1025065613"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635152388392274525/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635152388392274525/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1025065613",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/25 08:59:49 Submitted job: 2021-10-25_01_59_48-8946775056713548027
2021/10/25 08:59:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-25_01_59_48-8946775056713548027?project=apache-beam-testing
2021/10/25 08:59:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-25_01_59_48-8946775056713548027
2021/10/25 08:59:49 Job state: JOB_STATE_PENDING ...
2021/10/25 09:00:19 Job still running ...
2021/10/25 09:00:49 Job still running ...
2021/10/25 09:01:19 Job still running ...
2021/10/25 09:01:50 Job still running ...
2021/10/25 09:02:20 Job still running ...
2021/10/25 09:02:51 Job still running ...
2021/10/25 09:03:21 Failed to execute job: job 2021-10-25_01_59_48-8946775056713548027 failed
panic: Failed to execute job: job 2021-10-25_01_59_48-8946775056713548027 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1133e08, 0xc00003e0c0, 0x1024905, 0x19, 0xc0003fbe80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 1s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/ipxmvdxi7cza4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#309
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/309/display/redirect>
Changes:
------------------------------------------
[...truncated 26.47 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/24 09:01:14 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1635066073599249976/model
2021/10/24 09:01:14 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1024065618"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635066073599249976/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1635066073599249976/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1024065618",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/24 09:01:14 Submitted job: 2021-10-24_02_01_14-14551509088781407550
2021/10/24 09:01:14 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-24_02_01_14-14551509088781407550?project=apache-beam-testing
2021/10/24 09:01:14 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-24_02_01_14-14551509088781407550
2021/10/24 09:01:14 Job state: JOB_STATE_PENDING ...
2021/10/24 09:01:44 Job still running ...
2021/10/24 09:02:14 Job still running ...
2021/10/24 09:02:44 Job still running ...
2021/10/24 09:03:14 Job still running ...
2021/10/24 09:03:45 Job still running ...
2021/10/24 09:04:15 Job still running ...
2021/10/24 09:04:45 Failed to execute job: job 2021-10-24_02_01_14-14551509088781407550 failed
panic: Failed to execute job: job 2021-10-24_02_01_14-14551509088781407550 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1133e08, 0xc00003e0c0, 0x1024905, 0x19, 0xc00041fe80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 47s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/ewtgyydlxeyjk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#308
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/308/display/redirect>
Changes:
------------------------------------------
[...truncated 26.45 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/23 08:59:58 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1634979597773981707/model
2021/10/23 08:59:58 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1023065618"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634979597773981707/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634979597773981707/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1023065618",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/23 08:59:58 Submitted job: 2021-10-23_01_59_58-11908389377693678078
2021/10/23 08:59:58 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-23_01_59_58-11908389377693678078?project=apache-beam-testing
2021/10/23 08:59:58 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-23_01_59_58-11908389377693678078
2021/10/23 08:59:59 Job state: JOB_STATE_PENDING ...
2021/10/23 09:00:29 Job still running ...
2021/10/23 09:00:59 Job still running ...
2021/10/23 09:01:29 Job still running ...
2021/10/23 09:01:59 Job still running ...
2021/10/23 09:02:29 Job still running ...
2021/10/23 09:02:59 Job still running ...
2021/10/23 09:03:29 Failed to execute job: job 2021-10-23_01_59_58-11908389377693678078 failed
panic: Failed to execute job: job 2021-10-23_01_59_58-11908389377693678078 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1133e08, 0xc000198000, 0x1024905, 0x19, 0xc0003f1e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 9s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/omxea4elfsg2u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#307
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/307/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #15761 from [BEAM-13008] Create gradle tasks for the
[noreply] [BEAM-13096] Double test timeout. (#15774)
[noreply] [BEAM-13019] Add `containsInAnyOrder` with matchers to the
[Daniel Oliveira] Avoiding read-only Go module cache in Gradle config.
[noreply] [BEAM-11758] Update basics page: Pipeline, PCollection, PTransform
[noreply] Test SetState addIfAbsent with no read (#15776)
[noreply] lazy creation of source splits for export-based ReadFromBigQuery
[noreply] [BEAM-11275] Support remote package download from remote filesystems in
[noreply] [BEAM-13015] Create a multiplexer that sends Elements based upon
------------------------------------------
[...truncated 26.39 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/22 08:59:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1634893181278981961/model
2021/10/22 08:59:41 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1022065626"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634893181278981961/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634893181278981961/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1022065626",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/22 08:59:42 Submitted job: 2021-10-22_01_59_41-17042146892222456809
2021/10/22 08:59:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-22_01_59_41-17042146892222456809?project=apache-beam-testing
2021/10/22 08:59:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-22_01_59_41-17042146892222456809
2021/10/22 08:59:42 Job state: JOB_STATE_PENDING ...
2021/10/22 09:00:12 Job still running ...
2021/10/22 09:00:42 Job still running ...
2021/10/22 09:01:12 Job still running ...
2021/10/22 09:01:42 Job still running ...
2021/10/22 09:02:12 Job still running ...
2021/10/22 09:02:42 Job still running ...
2021/10/22 09:03:12 Failed to execute job: job 2021-10-22_01_59_41-17042146892222456809 failed
panic: Failed to execute job: job 2021-10-22_01_59_41-17042146892222456809 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1133e08, 0xc00003e0c0, 0x1024905, 0x19, 0xc0002cbe80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 83
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 52s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/rm3ed72pcs7to
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#306
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/306/display/redirect?page=changes>
Changes:
[noreply] Add -XX:+AlwaysActAsServerClassMachine to Java SDK container
[moritz] adhoc: Minor update to flink runner docs
[noreply] [BEAM-11087] Add default WindowMappingFn from Main to Side Input
[noreply] [BEAM-13082] Re-use dataWriter buffer. (#15762)
------------------------------------------
[...truncated 26.33 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/21 08:59:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1634806793718246016/model
2021/10/21 08:59:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1021065619"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634806793718246016/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634806793718246016/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1021065619",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/21 08:59:54 Submitted job: 2021-10-21_01_59_54-14149102567567242783
2021/10/21 08:59:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-21_01_59_54-14149102567567242783?project=apache-beam-testing
2021/10/21 08:59:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-21_01_59_54-14149102567567242783
2021/10/21 08:59:54 Job state: JOB_STATE_PENDING ...
2021/10/21 09:00:24 Job still running ...
2021/10/21 09:00:54 Job still running ...
2021/10/21 09:01:24 Job still running ...
2021/10/21 09:01:55 Job still running ...
2021/10/21 09:02:25 Job still running ...
2021/10/21 09:02:55 Job still running ...
2021/10/21 09:03:25 Failed to execute job: job 2021-10-21_01_59_54-14149102567567242783 failed
panic: Failed to execute job: job 2021-10-21_01_59_54-14149102567567242783 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1133e08, 0xc00003e0c0, 0x1024905, 0x19, 0xc0003e9e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 4s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/6b6tkf6xlvwy6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#305
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/305/display/redirect?page=changes>
Changes:
[samuelw] [BEAM-13042] Prevent unexpected blocking in
[ilya.kozyrev] Implement initial server with grpcweb wrapper
[aydar.zaynutdinov] [BEAM_13077][Playground]
[egalpin] [BEAM-10990] Adds response filtering for ElasticsearchIO
[egalpin] [BEAM-5172] Tries to reduce ES uTest flakiness
[noreply] [BEAM-13068] Add a SQL API in Beam Go SDK (#15746)
[Kyle Weaver] [BEAM-13055] Use unshallow clone to create PR.
[noreply] [BEAM-13079] Updates cross-language transform URNs to use the new
------------------------------------------
[...truncated 26.37 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/20 08:59:55 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1634720394348781870/model
2021/10/20 08:59:55 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1020065619"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634720394348781870/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634720394348781870/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1020065619",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/20 08:59:55 Submitted job: 2021-10-20_01_59_55-4171743293222418790
2021/10/20 08:59:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-20_01_59_55-4171743293222418790?project=apache-beam-testing
2021/10/20 08:59:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-20_01_59_55-4171743293222418790
2021/10/20 08:59:55 Job state: JOB_STATE_PENDING ...
2021/10/20 09:00:25 Job still running ...
2021/10/20 09:00:55 Job still running ...
2021/10/20 09:01:25 Job still running ...
2021/10/20 09:01:55 Job still running ...
2021/10/20 09:02:25 Job still running ...
2021/10/20 09:02:56 Job still running ...
2021/10/20 09:03:26 Failed to execute job: job 2021-10-20_01_59_55-4171743293222418790 failed
panic: Failed to execute job: job 2021-10-20_01_59_55-4171743293222418790 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1132708, 0xc00003e0c0, 0x1023668, 0x19, 0xc0004d5e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 3s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/xstlfi3gohvrq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#304
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/304/display/redirect?page=changes>
Changes:
[zhoufek] [BEAM-9487] Multiple Trigger.may_lose_data fixes
[zhoufek] [BEAM-9487] Remove CONDITION_NOT_GUARANTEED as potential data loss
[zhoufek] [BEAM-9487] Do AfterAny, AfterAll, and AfterEach checks properly (i.e.
[zhoufek] [BEAM-9487] Remove unused import
[zhoufek] [BEAM-9487] Reintroduce flag but do not use it
[zhoufek] [BEAM-9487] Add test that shows AfterCount finishing
[zhoufek] [BEAM-9487] Make _ParallelTriggerFn.may_finish clearer
[Robert Bradshaw] Revert "Merge pull request #15441 from [BEAM-8823] Make FnApiRunner work
[Robert Bradshaw] [BEAM-13040] Add some test cases enforcing side input waiting.
[Robert Bradshaw] lint
[brachipa] [BEAM-12393] sql support for Zeta Sql
[aydar.zaynutdinov] [BEAM-12988] [Playground]
[brachipa] [BEAM-12393] package private
[brachipa] [BEAM-12393] returning more generic interface
[noreply] [BEAM-13066] Produce abstract iterables from IterableCoder. (#15662)
[noreply] [BEAM-11936] Fix some errorprone warnings (#15648)
[noreply] [BEAM-13068] Add xlangx.DecodeStructPayload (#15741)
[Luke Cwik] [BEAM-13015] Implement a simplified cancellable blocking queue with
------------------------------------------
[...truncated 26.40 KB...]
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/19 08:59:58 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1634633998141978633/model
2021/10/19 08:59:58 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1019065628"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634633998141978633/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634633998141978633/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1019065628",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/19 08:59:59 Submitted job: 2021-10-19_01_59_58-9333913578866941694
2021/10/19 08:59:59 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-19_01_59_58-9333913578866941694?project=apache-beam-testing
2021/10/19 08:59:59 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-19_01_59_58-9333913578866941694
2021/10/19 08:59:59 Job state: JOB_STATE_PENDING ...
2021/10/19 09:00:29 Job still running ...
2021/10/19 09:00:59 Job still running ...
2021/10/19 09:01:29 Job still running ...
2021/10/19 09:01:59 Job still running ...
2021/10/19 09:02:29 Job still running ...
2021/10/19 09:02:59 Job still running ...
2021/10/19 09:03:29 Job still running ...
2021/10/19 09:03:59 Failed to execute job: job 2021-10-19_01_59_58-9333913578866941694 failed
panic: Failed to execute job: job 2021-10-19_01_59_58-9333913578866941694 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1132708, 0xc00003e0c0, 0x1023668, 0x19, 0xc0003e5e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 37s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/w5cgjt2rsywwi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#303
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/303/display/redirect>
Changes:
------------------------------------------
[...truncated 26.41 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/18 09:00:25 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1634547624469788442/model
2021/10/18 09:00:25 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1018065627"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634547624469788442/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634547624469788442/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1018065627",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/18 09:00:25 Submitted job: 2021-10-18_02_00_25-7558040037027707317
2021/10/18 09:00:25 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-18_02_00_25-7558040037027707317?project=apache-beam-testing
2021/10/18 09:00:25 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-18_02_00_25-7558040037027707317
2021/10/18 09:00:25 Job state: JOB_STATE_PENDING ...
2021/10/18 09:00:55 Job still running ...
2021/10/18 09:01:25 Job still running ...
2021/10/18 09:01:55 Job still running ...
2021/10/18 09:02:26 Job still running ...
2021/10/18 09:02:56 Job still running ...
2021/10/18 09:03:26 Job still running ...
2021/10/18 09:03:56 Failed to execute job: job 2021-10-18_02_00_25-7558040037027707317 failed
panic: Failed to execute job: job 2021-10-18_02_00_25-7558040037027707317 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1132708, 0xc00003e0b0, 0x1023668, 0x19, 0xc000031e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 34s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/mx4mx3yjq45wy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#302
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/302/display/redirect>
Changes:
------------------------------------------
[...truncated 26.50 KB...]
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/17 08:59:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1634461190531792960/model
2021/10/17 08:59:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1017065609"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634461190531792960/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634461190531792960/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1017065609",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/17 08:59:51 Submitted job: 2021-10-17_01_59_51-1613550149694186300
2021/10/17 08:59:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-17_01_59_51-1613550149694186300?project=apache-beam-testing
2021/10/17 08:59:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-17_01_59_51-1613550149694186300
2021/10/17 08:59:51 Job state: JOB_STATE_PENDING ...
2021/10/17 09:00:21 Job still running ...
2021/10/17 09:00:51 Job still running ...
2021/10/17 09:01:21 Job still running ...
2021/10/17 09:01:51 Job still running ...
2021/10/17 09:02:21 Job still running ...
2021/10/17 09:02:51 Job still running ...
2021/10/17 09:03:21 Job still running ...
2021/10/17 09:03:51 Job still running ...
2021/10/17 09:04:21 Job still running ...
2021/10/17 09:04:51 Job still running ...
2021/10/17 09:05:21 Failed to execute job: job 2021-10-17_01_59_51-1613550149694186300 failed
panic: Failed to execute job: job 2021-10-17_01_59_51-1613550149694186300 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1132708, 0xc00003e0b0, 0x1023668, 0x19, 0xc0004c7e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 1s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/55fap4i7ykylu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#301
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/301/display/redirect?page=changes>
Changes:
[noreply] Corrected Join Example
[noreply] Minor: Add more links to DataFrame API documentation (#15661)
[noreply] [BEAM-11480] Use snippets for DataFrame examples (#15600)
[noreply] Allow multiple Python worker processe to share the same VM. (#15642)
[noreply] [BEAM-12564] Implement Series.hasnans (#15729)
[noreply] Minor: Fix frames_test.py equality check for non-frame outputs (#15734)
[noreply] [BEAM-12769] Adds integration tests for Java Class Lookup based
[Brian Hulette] Address BEAM-4028 cleanup TODOs
[Brian Hulette] Bump Dataflow container to beam-master-20211015
[noreply] [BEAM-13052] Restructure pubsublite folder to move non-user interface
------------------------------------------
[...truncated 26.50 KB...]
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/16 08:59:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1634374794114522798/model
2021/10/16 08:59:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1016065632"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634374794114522798/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634374794114522798/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1016065632",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/16 08:59:55 Submitted job: 2021-10-16_01_59_54-12797489603241826321
2021/10/16 08:59:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-16_01_59_54-12797489603241826321?project=apache-beam-testing
2021/10/16 08:59:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-16_01_59_54-12797489603241826321
2021/10/16 08:59:55 Job state: JOB_STATE_PENDING ...
2021/10/16 09:00:25 Job still running ...
2021/10/16 09:00:55 Job still running ...
2021/10/16 09:01:25 Job still running ...
2021/10/16 09:01:55 Job still running ...
2021/10/16 09:02:25 Job still running ...
2021/10/16 09:02:55 Job still running ...
2021/10/16 09:03:25 Job still running ...
2021/10/16 09:03:55 Job still running ...
2021/10/16 09:04:25 Job still running ...
2021/10/16 09:04:55 Job still running ...
2021/10/16 09:05:25 Failed to execute job: job 2021-10-16_01_59_54-12797489603241826321 failed
panic: Failed to execute job: job 2021-10-16_01_59_54-12797489603241826321 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1132708, 0xc00003e0b0, 0x1023668, 0x19, 0xc0007bbe80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 5s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/o2a57xd3wchqo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#300
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/300/display/redirect?page=changes>
Changes:
[ilya.kozyrev] Add java executor to compile java code in created file system
[zyichi] Use daemon thread to report lull operation and move code to
[noreply] Merge pull request #15722 from [BEAM-13022] [Playground] Run code on the
[Luke Cwik] [BEAM-12640] Skip checkerframework on generated code/test libraries for
[Luke Cwik] [BEAM-13015] Add tiny bundle processing benchmark for Java SDK harness.
[noreply] [BEAM-12922] Test MapState putIfAbsent with no read (#15704)
[Robert Bradshaw] [BEAM-13053] Avoid runner v2 when streaming engine explicitly disabled.
[noreply] [Go SDK] Small typo fixes. (#15725)
[noreply] [BEAM-13038] Migrate to use a context object within
[noreply] [BEAM-12135] Avoid windowing overhead in Spark global GBK. (#15637)
[noreply] [BEAM-12907] Run DataFrame API tests with multiple pandas versions
[vachan] Remove unnecessary ERROR logging.
------------------------------------------
[...truncated 26.45 KB...]
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/15 08:59:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1634288391122077533/model
2021/10/15 08:59:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1015065704"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634288391122077533/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634288391122077533/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1015065704",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/15 08:59:52 Submitted job: 2021-10-15_01_59_51-17034637708429073567
2021/10/15 08:59:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-15_01_59_51-17034637708429073567?project=apache-beam-testing
2021/10/15 08:59:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-15_01_59_51-17034637708429073567
2021/10/15 08:59:52 Job state: JOB_STATE_PENDING ...
2021/10/15 09:00:22 Job still running ...
2021/10/15 09:00:52 Job still running ...
2021/10/15 09:01:22 Job still running ...
2021/10/15 09:01:52 Job still running ...
2021/10/15 09:02:22 Job still running ...
2021/10/15 09:02:52 Job still running ...
2021/10/15 09:03:22 Job still running ...
2021/10/15 09:03:52 Job still running ...
2021/10/15 09:04:22 Job still running ...
2021/10/15 09:04:52 Job still running ...
2021/10/15 09:05:22 Failed to execute job: job 2021-10-15_01_59_51-17034637708429073567 failed
panic: Failed to execute job: job 2021-10-15_01_59_51-17034637708429073567 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1132668, 0xc00003e0b0, 0x10235c8, 0x19, 0xc0004dde80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 1s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/kidywkknkaify
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#299
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/299/display/redirect?page=changes>
Changes:
[Udi Meiri] Release guide: minor updates
[dmitrii_kuzin] [BEAM-12730] Custom delimiter always bytes
[noreply] Minor: Add base_func to Series.aggregate expression names (#15706)
[noreply] [BEAM-13013] Extend cross language expansion. (#15698)
[noreply] Minor: Clarify confusing boolean logic for selecting PerWindowInvoker
[noreply] [BEAM-4424] Execute hooks in enabling order (#15713)
[noreply] [BEAM-11097] Update cache with metrics counting, windowing (#15717)
[kawaigin] Prepare release of apache-beam-jupyterlab-sidepanel v2.0.0
[noreply] [BEAM-12644] Javascript files moved to assets (#15653)
------------------------------------------
[...truncated 26.34 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/14 08:59:55 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1634201995427594120/model
2021/10/14 08:59:55 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1014065639"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634201995427594120/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634201995427594120/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1014065639",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/14 08:59:56 Submitted job: 2021-10-14_01_59_55-14956544141550324726
2021/10/14 08:59:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-14_01_59_55-14956544141550324726?project=apache-beam-testing
2021/10/14 08:59:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-14_01_59_55-14956544141550324726
2021/10/14 08:59:56 Job state: JOB_STATE_PENDING ...
2021/10/14 09:00:26 Job still running ...
2021/10/14 09:00:56 Job still running ...
2021/10/14 09:01:26 Job still running ...
2021/10/14 09:01:57 Job still running ...
2021/10/14 09:02:27 Job still running ...
2021/10/14 09:02:57 Job still running ...
2021/10/14 09:03:27 Failed to execute job: job 2021-10-14_01_59_55-14956544141550324726 failed
panic: Failed to execute job: job 2021-10-14_01_59_55-14956544141550324726 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1132668, 0xc000120000, 0x10235c8, 0x19, 0xc00034de80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 6s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/wjoiu3mrnjhqs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#298
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/298/display/redirect?page=changes>
Changes:
[cgray] [BEAM-7169] Fix singleton assertion in PAssert javadoc.
[noreply] Revert "[BEAM-10913] - Forcing update of YAML file by running kubectl
[heejong] Update Dataflow Python container tag
[noreply] Merge pull request #15667 from [BEAM-12730] Add custom delimiters to
[noreply] Merge pull request #15700 from [BEAM-12987] [Playground] Add page UI
[kawaigin] [BEAM-12997] Upgraded labextension to V3
[noreply] [BEAM-12513] Add JIRAs for missing Go SDK features (#15658)
------------------------------------------
[...truncated 26.20 KB...]
>
component_coder_ids: "c0"
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/13 08:59:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1634115592985449762/model
2021/10/13 08:59:53 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1013065625"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634115592985449762/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634115592985449762/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1013065625",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/13 08:59:54 Submitted job: 2021-10-13_01_59_53-15748114320096721662
2021/10/13 08:59:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-13_01_59_53-15748114320096721662?project=apache-beam-testing
2021/10/13 08:59:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-13_01_59_53-15748114320096721662
2021/10/13 08:59:54 Job state: JOB_STATE_PENDING ...
2021/10/13 09:00:24 Job still running ...
2021/10/13 09:00:54 Job still running ...
2021/10/13 09:01:24 Job still running ...
2021/10/13 09:01:54 Job still running ...
2021/10/13 09:02:24 Job still running ...
2021/10/13 09:02:54 Job still running ...
2021/10/13 09:03:24 Failed to execute job: job 2021-10-13_01_59_53-15748114320096721662 failed
panic: Failed to execute job: job 2021-10-13_01_59_53-15748114320096721662 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11307c8, 0xc000120000, 0x1021c57, 0x19, 0xc0004c7e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 3s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/d4mfefphqfnha
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#297
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/297/display/redirect?page=changes>
Changes:
[rogan.o.morrow] [BEAM-12875] Register file systems in SparkExecutableStageFunction
[rogelio.hernandez] [BEAM-12371][BEAM-12373] Fixed page navigation
[Kyle Weaver] [BEAM-12694] Include datetime in dicom test dataset name.
[noreply] [BEAM-12960] Add extra context for structural DoFn ProcessElement error
[noreply] Release 2.33 documentation update (#15543)
[noreply] Merge pull request #15441 from [BEAM-8823] Make FnApiRunner work by
------------------------------------------
[...truncated 26.38 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/12 09:00:02 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1634029202104558467/model
2021/10/12 09:00:02 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1012065641"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634029202104558467/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1634029202104558467/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1012065641",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/12 09:00:03 Submitted job: 2021-10-12_02_00_02-17470552962685699996
2021/10/12 09:00:03 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-12_02_00_02-17470552962685699996?project=apache-beam-testing
2021/10/12 09:00:03 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-12_02_00_02-17470552962685699996
2021/10/12 09:00:03 Job state: JOB_STATE_PENDING ...
2021/10/12 09:00:33 Job still running ...
2021/10/12 09:01:03 Job still running ...
2021/10/12 09:01:33 Job still running ...
2021/10/12 09:02:03 Job still running ...
2021/10/12 09:02:33 Job still running ...
2021/10/12 09:03:03 Job still running ...
2021/10/12 09:03:33 Job still running ...
2021/10/12 09:04:04 Job still running ...
2021/10/12 09:04:34 Job still running ...
2021/10/12 09:05:04 Job still running ...
2021/10/12 09:05:34 Job still running ...
2021/10/12 09:06:04 Job still running ...
2021/10/12 09:06:34 Failed to execute job: job 2021-10-12_02_00_02-17470552962685699996 failed
panic: Failed to execute job: job 2021-10-12_02_00_02-17470552962685699996 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11307c8, 0xc00003e0b0, 0x1021c57, 0x19, 0xc0003e3e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 13s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/a6ctgha7n5pdm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#296
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/296/display/redirect>
Changes:
------------------------------------------
[...truncated 26.23 KB...]
>
component_coder_ids: "c0"
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/11 08:59:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633942793107367143/model
2021/10/11 08:59:53 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1011065621"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633942793107367143/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633942793107367143/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1011065621",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/11 08:59:54 Submitted job: 2021-10-11_01_59_53-3970615890065173978
2021/10/11 08:59:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-11_01_59_53-3970615890065173978?project=apache-beam-testing
2021/10/11 08:59:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-11_01_59_53-3970615890065173978
2021/10/11 08:59:54 Job state: JOB_STATE_PENDING ...
2021/10/11 09:00:24 Job still running ...
2021/10/11 09:00:54 Job still running ...
2021/10/11 09:01:24 Job still running ...
2021/10/11 09:01:54 Job still running ...
2021/10/11 09:02:24 Job still running ...
2021/10/11 09:02:54 Job still running ...
2021/10/11 09:03:24 Failed to execute job: job 2021-10-11_01_59_53-3970615890065173978 failed
panic: Failed to execute job: job 2021-10-11_01_59_53-3970615890065173978 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1130688, 0xc000120000, 0x1021c57, 0x19, 0xc0004e9e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 4s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/l73voqyjxpugg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#295
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/295/display/redirect>
Changes:
------------------------------------------
[...truncated 26.27 KB...]
>
component_coder_ids: "c0"
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/10 08:59:52 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633856391713471501/model
2021/10/10 08:59:52 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1010065609"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633856391713471501/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633856391713471501/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1010065609",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/10 08:59:52 Submitted job: 2021-10-10_01_59_52-4339809569608449815
2021/10/10 08:59:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-10_01_59_52-4339809569608449815?project=apache-beam-testing
2021/10/10 08:59:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-10_01_59_52-4339809569608449815
2021/10/10 08:59:52 Job state: JOB_STATE_PENDING ...
2021/10/10 09:00:22 Job still running ...
2021/10/10 09:00:52 Job still running ...
2021/10/10 09:01:22 Job still running ...
2021/10/10 09:01:52 Job still running ...
2021/10/10 09:02:23 Job still running ...
2021/10/10 09:02:53 Job still running ...
2021/10/10 09:03:23 Failed to execute job: job 2021-10-10_01_59_52-4339809569608449815 failed
panic: Failed to execute job: job 2021-10-10_01_59_52-4339809569608449815 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1130688, 0xc000120000, 0x1021c57, 0x19, 0xc00075be80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 3s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/nq2yiqjcqdx3y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#294
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/294/display/redirect?page=changes>
Changes:
[noreply] fixing test link
[Brian Hulette] Add DataFrame changes to CHANGES.md
[stranniknm] [BEAM-12964]: add code editor component
[stranniknm] [BEAM-12966]: load initial example on page load
[stranniknm] [BEAM-12964]: fix editor scrolling
[stranniknm] [BEAM-12964]: add dark theme support
[stranniknm] [BEAM-12964]: add licence to example repository file
[stranniknm] [BEAM-12964]: extract playground page providers
[stranniknm] [BEAM-12964]: refactor styles
[noreply] fix linter issues
[Brian Hulette] Don't use run_pytest.sh for pyarrow tests
[Brian Hulette] Fail in run_pytest.sh if -m is specified
[noreply] [BEAM-10913] - Forcing update of YAML file by running kubectl apply
[noreply] [BEAM-10955] Flink Java Runner test flake: Could not find Flink job
[noreply] [BEAM-10114] Bump Pub/Sub Lite version (#15640)
------------------------------------------
[...truncated 26.33 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/09 09:00:00 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633769999712916075/model
2021/10/09 09:00:00 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1009065624"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633769999712916075/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633769999712916075/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1009065624",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/09 09:00:00 Submitted job: 2021-10-09_02_00_00-16353170873043822622
2021/10/09 09:00:00 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-09_02_00_00-16353170873043822622?project=apache-beam-testing
2021/10/09 09:00:00 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-09_02_00_00-16353170873043822622
2021/10/09 09:00:00 Job state: JOB_STATE_PENDING ...
2021/10/09 09:00:30 Job still running ...
2021/10/09 09:01:00 Job still running ...
2021/10/09 09:01:31 Job still running ...
2021/10/09 09:02:01 Job still running ...
2021/10/09 09:02:31 Job still running ...
2021/10/09 09:03:01 Job still running ...
2021/10/09 09:03:31 Job still running ...
2021/10/09 09:04:01 Job still running ...
2021/10/09 09:04:31 Job still running ...
2021/10/09 09:05:01 Job still running ...
2021/10/09 09:05:31 Failed to execute job: job 2021-10-09_02_00_00-16353170873043822622 failed
panic: Failed to execute job: job 2021-10-09_02_00_00-16353170873043822622 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1130688, 0xc00003e0b0, 0x1021c57, 0x19, 0xc0002dde80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 10s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/yv6nosddz4jtq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#293
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/293/display/redirect?page=changes>
Changes:
[Udi Meiri] Release script fixes
[noreply] [BEAM-13015] Remove the overhead of SpecMonitoringInfoValidator
[noreply] Minor: Replace generic external.py links in multi-language documentation
[noreply] Revert "[BEAM-12993] Update to Debezium 1.7.0.Final (#15636)"
[kawaigin] Updated screendiff integration test golden screenshots.
[noreply] [BEAM-12769] Few fixes related to Java Class Lookup based cross-language
------------------------------------------
[...truncated 26.25 KB...]
component_coder_ids: "c0"
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/08 08:59:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633683590763160502/model
2021/10/08 08:59:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1008065641"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633683590763160502/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633683590763160502/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1008065641",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/08 08:59:53 Submitted job: 2021-10-08_01_59_51-16308156347161587842
2021/10/08 08:59:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-08_01_59_51-16308156347161587842?project=apache-beam-testing
2021/10/08 08:59:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-08_01_59_51-16308156347161587842
2021/10/08 08:59:54 Job state: JOB_STATE_PENDING ...
2021/10/08 09:00:24 Job still running ...
2021/10/08 09:00:54 Job still running ...
2021/10/08 09:01:24 Job still running ...
2021/10/08 09:01:54 Job still running ...
2021/10/08 09:02:24 Job still running ...
2021/10/08 09:02:54 Job still running ...
2021/10/08 09:03:24 Job still running ...
2021/10/08 09:03:54 Failed to execute job: job 2021-10-08_01_59_51-16308156347161587842 failed
panic: Failed to execute job: job 2021-10-08_01_59_51-16308156347161587842 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1130688, 0xc00003e0b0, 0x1021c57, 0x19, 0xc0001f7e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 34s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/6p5qwldp5yx42
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#292
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/292/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Restore "Default to Runner v2 for Python Streaming jobs. (#15140)"
[stefan.istrate] Fix "too many pings" errors.
[stefan.istrate] Increase keepalive timeout to 5 minutes.
[david.prieto] [BEAM-12950] Not delete orphaned files to avoid missing events
[david.prieto] [BEAM-12950] Add Bug fix description to CHANGES.md
[david.prieto] [BEAM-12950] fix linter issues
[Robert Bradshaw] Dead letter option.
[Robert Bradshaw] Guard setup.py logic with __main__ condition.
[stefan.istrate] Fix yapf complaints.
[Robert Bradshaw] Avoid incompatible setting.
[aydar.zaynutdinov] [BEAM-12969] [Playground]
[david.prieto] [BEAN-12950] Skip unit test
[noreply] [BEAM-12909][BEAM-12849] Add support for running spark3 nexmark queries
[Robert Bradshaw] Add the ability to use subprocesses with the dead letter queue.
[Robert Bradshaw] Support multi-output DoFns.
[noreply] Merge pull request #15510 from [BEAM-12883] Add coder for
[Robert Bradshaw] multi-output fix
[Robert Bradshaw] Add thresholding to dead letter pattern.
[Robert Bradshaw] treshold test fixes
[Robert Bradshaw] Better naming, documentation.
[noreply] [BEAM-12482] Ensure that we ignore schema update options when loading
[Kyle Weaver] Moving to 2.35.0-SNAPSHOT on master branch.
[Kyle Weaver] Add 2.35.0 section to changelog.
[noreply] Fix email links in the contact page
------------------------------------------
[...truncated 26.35 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.35.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/07 08:59:56 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633597195390906105/model
2021/10/07 08:59:56 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1007065626"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.35.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633597195390906105/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.35.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633597195390906105/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.35.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.35.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1007065626",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/07 08:59:56 Submitted job: 2021-10-07_01_59_56-1085563944716230903
2021/10/07 08:59:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-07_01_59_56-1085563944716230903?project=apache-beam-testing
2021/10/07 08:59:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-07_01_59_56-1085563944716230903
2021/10/07 08:59:56 Job state: JOB_STATE_PENDING ...
2021/10/07 09:00:26 Job still running ...
2021/10/07 09:00:56 Job still running ...
2021/10/07 09:01:26 Job still running ...
2021/10/07 09:01:56 Job still running ...
2021/10/07 09:02:26 Job still running ...
2021/10/07 09:02:56 Job still running ...
2021/10/07 09:03:26 Job still running ...
2021/10/07 09:03:56 Job still running ...
2021/10/07 09:04:27 Job still running ...
2021/10/07 09:04:57 Job still running ...
2021/10/07 09:05:27 Failed to execute job: job 2021-10-07_01_59_56-1085563944716230903 failed
panic: Failed to execute job: job 2021-10-07_01_59_56-1085563944716230903 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1130688, 0xc00003e0b0, 0x1021c57, 0x19, 0xc000329e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 6s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/yiawk5pkux7kc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#291
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/291/display/redirect?page=changes>
Changes:
[noreply] Only stage the single (fat) jar when auto-starting expansion service.
[noreply] Disable samza counters (#15659)
[noreply] Merge pull request #15614 from [BEAM-12953] [Playground] Create protobuf
[noreply] [BEAM-11831] Parially Revert "[BEAM-11805] Replace user-agent for
[kawaigin] [BEAM-10708] Enable submit beam_sql built jobs to Dataflow
[noreply] Merge pull request #15602 from [BEAM-10917] Add support for BigQuery
------------------------------------------
[...truncated 26.18 KB...]
>
component_coder_ids: "c0"
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/06 08:59:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633510778654680440/model
2021/10/06 08:59:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1006065636"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633510778654680440/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633510778654680440/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1006065636",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/06 08:59:40 Submitted job: 2021-10-06_01_59_39-6552584647222127386
2021/10/06 08:59:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-06_01_59_39-6552584647222127386?project=apache-beam-testing
2021/10/06 08:59:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-06_01_59_39-6552584647222127386
2021/10/06 08:59:40 Job state: JOB_STATE_PENDING ...
2021/10/06 09:00:10 Job still running ...
2021/10/06 09:00:40 Job still running ...
2021/10/06 09:01:10 Job still running ...
2021/10/06 09:01:40 Job still running ...
2021/10/06 09:02:10 Job still running ...
2021/10/06 09:02:40 Job still running ...
2021/10/06 09:03:10 Failed to execute job: job 2021-10-06_01_59_39-6552584647222127386 failed
panic: Failed to execute job: job 2021-10-06_01_59_39-6552584647222127386 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1130688, 0xc00003e0b0, 0x1021c57, 0x19, 0xc00042fe80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 51s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/rtzn2v6f3dpeo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#290
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/290/display/redirect?page=changes>
Changes:
[danthev] Switch hintNumWorkers to ValueProvider, switch firstInstant to side
[noreply] [BEAM-11516] Upgrade to pylint 2.11.1, fix warnings (#15612)
[noreply] [BEAM-12979, BEAM-11097] Change cache to store ReStreams, clean up to…
[noreply] [BEAM-3304, BEAM-12513] Trigger changes and Windowing. (#15644)
[noreply] Merge pull request #15618 from [BEAM-12968] [Playground] Create README
[noreply] Merge pull request #15626 from [BEAM-12963] [Playground] Create base
[noreply] Merge pull request #15566 from [BEAM-12925] Correct behavior retrieving
[noreply] [BEAM-12911] Update schema translation (Java, Python) to log more
[noreply] Update CHANGES.md for JdbcIO breaking change (#15651)
[noreply] [BEAM-12513] Add Go SDK metrics content to BPG. (#15650)
[noreply] [BEAM-12996] Improve Error Logging in ConfigBuilder (#15646)
[noreply] [BEAM-13000] Disable Reshuffle Translation in Samza Portable Mode
------------------------------------------
[...truncated 26.25 KB...]
>
component_coder_ids: "c0"
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/05 09:02:07 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633424526646936387/model
2021/10/05 09:02:07 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1005065639"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633424526646936387/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633424526646936387/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1005065639",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/05 09:02:08 Submitted job: 2021-10-05_02_02_07-1084710047411819126
2021/10/05 09:02:08 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-05_02_02_07-1084710047411819126?project=apache-beam-testing
2021/10/05 09:02:08 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-05_02_02_07-1084710047411819126
2021/10/05 09:02:08 Job state: JOB_STATE_PENDING ...
2021/10/05 09:02:38 Job still running ...
2021/10/05 09:03:08 Job still running ...
2021/10/05 09:03:38 Job still running ...
2021/10/05 09:04:08 Job still running ...
2021/10/05 09:04:38 Job still running ...
2021/10/05 09:05:08 Job still running ...
2021/10/05 09:05:38 Failed to execute job: job 2021-10-05_02_02_07-1084710047411819126 failed
panic: Failed to execute job: job 2021-10-05_02_02_07-1084710047411819126 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1130688, 0xc00003e0b0, 0x1021c57, 0x19, 0xc000217e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 42s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/s5dm3lcevmf26
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#289
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/289/display/redirect>
Changes:
------------------------------------------
[...truncated 26.30 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/04 08:59:50 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633337989840013321/model
2021/10/04 08:59:50 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1004065620"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633337989840013321/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633337989840013321/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1004065620",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/04 08:59:51 Submitted job: 2021-10-04_01_59_50-5399321008779769828
2021/10/04 08:59:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-04_01_59_50-5399321008779769828?project=apache-beam-testing
2021/10/04 08:59:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-04_01_59_50-5399321008779769828
2021/10/04 08:59:51 Job state: JOB_STATE_PENDING ...
2021/10/04 09:00:21 Job still running ...
2021/10/04 09:00:51 Job still running ...
2021/10/04 09:01:21 Job still running ...
2021/10/04 09:01:51 Job still running ...
2021/10/04 09:02:21 Job still running ...
2021/10/04 09:02:51 Job still running ...
2021/10/04 09:03:21 Job still running ...
2021/10/04 09:03:51 Job still running ...
2021/10/04 09:04:21 Job still running ...
2021/10/04 09:04:51 Job still running ...
2021/10/04 09:05:21 Failed to execute job: job 2021-10-04_01_59_50-5399321008779769828 failed
panic: Failed to execute job: job 2021-10-04_01_59_50-5399321008779769828 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112f0e8, 0xc000120000, 0x10208f7, 0x19, 0xc000445e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 1s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/2ub4gujbci6pc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#288
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/288/display/redirect>
Changes:
------------------------------------------
[...truncated 26.21 KB...]
>
component_coder_ids: "c0"
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/03 12:26:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633264011242598205/model
2021/10/03 12:26:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1003065621"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633264011242598205/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633264011242598205/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1003065621",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/03 12:26:52 Submitted job: 2021-10-03_05_26_51-4825321240953581802
2021/10/03 12:26:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-03_05_26_51-4825321240953581802?project=apache-beam-testing
2021/10/03 12:26:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-03_05_26_51-4825321240953581802
2021/10/03 12:26:52 Job state: JOB_STATE_PENDING ...
2021/10/03 12:27:22 Job still running ...
2021/10/03 12:27:52 Job still running ...
2021/10/03 12:28:22 Job still running ...
2021/10/03 12:28:52 Job still running ...
2021/10/03 12:29:22 Job still running ...
2021/10/03 12:29:52 Job still running ...
2021/10/03 12:30:22 Failed to execute job: job 2021-10-03_05_26_51-4825321240953581802 failed
panic: Failed to execute job: job 2021-10-03_05_26_51-4825321240953581802 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112f0e8, 0xc000120000, 0x10208f7, 0x19, 0xc00040fe80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 13s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/w4empbbr4myac
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#287
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/287/display/redirect?page=changes>
Changes:
[noreply] Switching to innerText and removing alerts
[noreply] [BEAM-12993] Update to Debezium 1.7.0.Final (#15636)
[noreply] Minor: Fix `Iterable[SplitResultResidual]` type errors (#15634)
[noreply] [BEAM-11217] Implemented metrics filtering (#15482)
[noreply] [BEAM-12513] Schemas and Coders (#15632)
------------------------------------------
[...truncated 26.19 KB...]
>
component_coder_ids: "c0"
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/02 08:59:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633165193552539397/model
2021/10/02 08:59:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1002065603"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633165193552539397/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633165193552539397/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1002065603",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/02 08:59:55 Submitted job: 2021-10-02_01_59_54-16754863091285503655
2021/10/02 08:59:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-02_01_59_54-16754863091285503655?project=apache-beam-testing
2021/10/02 08:59:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-02_01_59_54-16754863091285503655
2021/10/02 08:59:55 Job state: JOB_STATE_PENDING ...
2021/10/02 09:00:25 Job still running ...
2021/10/02 09:00:55 Job still running ...
2021/10/02 09:01:25 Job still running ...
2021/10/02 09:01:55 Job still running ...
2021/10/02 09:02:25 Job still running ...
2021/10/02 09:02:55 Job still running ...
2021/10/02 09:03:25 Failed to execute job: job 2021-10-02_01_59_54-16754863091285503655 failed
panic: Failed to execute job: job 2021-10-02_01_59_54-16754863091285503655 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112f0e8, 0xc00003e0b0, 0x10208f7, 0x19, 0xc000379e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 5s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/xkqrz23jie5f4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#286
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/286/display/redirect?page=changes>
Changes:
[stranniknm] [BEAM-12951]: Create initial structure for Playground application
[dpcollins] [BEAM-12908] Change to use PubsubSignal for information propagation so
[Robert Bradshaw] Preserve more types in transform replacement.
[rohde.samuel] Fix BEAM-12984
[Robert Bradshaw] Update test to reflect preserved type hint.
[noreply] Update Beam glossary (#15619)
[noreply] [BEAM-11985] Python Bigtable - Implement IO Request Count metrics
[noreply] [BEAM-9918] Make TryCrossLanguage match non Try API (#15633)
[noreply] [BEAM-12957] Add support for pyarrow 5.x (#15588)
------------------------------------------
[...truncated 26.19 KB...]
>
component_coder_ids: "c0"
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/10/01 09:00:02 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1633078801609720951/model
2021/10/01 09:00:02 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-1001065758"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633078801609720951/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1633078801609720951/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-1001065758",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/10/01 09:00:02 Submitted job: 2021-10-01_02_00_02-4782449802330392302
2021/10/01 09:00:02 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-01_02_00_02-4782449802330392302?project=apache-beam-testing
2021/10/01 09:00:02 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-10-01_02_00_02-4782449802330392302
2021/10/01 09:00:02 Job state: JOB_STATE_PENDING ...
2021/10/01 09:00:32 Job still running ...
2021/10/01 09:01:02 Job still running ...
2021/10/01 09:01:32 Job still running ...
2021/10/01 09:02:02 Job still running ...
2021/10/01 09:02:32 Job still running ...
2021/10/01 09:03:02 Job still running ...
2021/10/01 09:03:33 Failed to execute job: job 2021-10-01_02_00_02-4782449802330392302 failed
panic: Failed to execute job: job 2021-10-01_02_00_02-4782449802330392302 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112dbe8, 0xc00003e0b0, 0x101f5f7, 0x19, 0xc00040de80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 12s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/a2wpdeae5gnyi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#285
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/285/display/redirect?page=changes>
Changes:
[kileysok] Update windmill state map to resolve *IfAbsent methods immediately
[samuelw] [BEAM-12942] Validate pubsub messages before they are published in
[clairem] [BEAM-12628] make useReflectApi default to true
[noreply] [BEAM-12856] Change hard-coded limits for reading from a UnboundedReader
[piotr.szczepanik] [BEAM-12356] Fixed last non-cached usage of DatasetService in BigQuery
[noreply] [BEAM-12977] Translates Reshuffle in Portable Mode with Samza native
[noreply] [BEAM-12982] Help users debug which JvmInitializer is running and when.
------------------------------------------
[...truncated 26.25 KB...]
>
component_coder_ids: "c0"
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/30 09:00:00 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632992399978236411/model
2021/09/30 09:00:00 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0930065603"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632992399978236411/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632992399978236411/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0930065603",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/30 09:00:01 Submitted job: 2021-09-30_02_00_00-16126418268394910463
2021/09/30 09:00:01 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-30_02_00_00-16126418268394910463?project=apache-beam-testing
2021/09/30 09:00:01 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-30_02_00_00-16126418268394910463
2021/09/30 09:00:01 Job state: JOB_STATE_PENDING ...
2021/09/30 09:00:31 Job still running ...
2021/09/30 09:01:01 Job still running ...
2021/09/30 09:01:31 Job still running ...
2021/09/30 09:02:01 Job still running ...
2021/09/30 09:02:31 Job still running ...
2021/09/30 09:03:01 Job still running ...
2021/09/30 09:03:31 Failed to execute job: job 2021-09-30_02_00_00-16126418268394910463 failed
panic: Failed to execute job: job 2021-09-30_02_00_00-16126418268394910463 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112dbe8, 0xc00003e0b0, 0x101f5f7, 0x19, 0xc0005b1e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 10s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/go34nl3feebeu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#284
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/284/display/redirect?page=changes>
Changes:
[chamikaramj] Sets the correct coder in 'ConstantTableDestinations' when using BQ
[Luke Cwik] [BEAM-12974] Migrate off of deprecated package for MockitoJUnitRunner
[noreply] [BEAM-12593] Verify DataFrame API on pandas 1.3 (with container update)
[noreply] [BEAM-12973] Print Go Test and Script info. (#15604)
[noreply] [BEAM-10913] - Installing and persisting Grafana plugin in kubernetes
[noreply] [BEAM-11129] Add namespace and key to portable display data (#15564)
[noreply] [BEAM-12906] Add a `dataframe` extra for installing a pandas version
------------------------------------------
[...truncated 26.29 KB...]
component_coder_ids: "c0"
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/29 08:59:52 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632905991586796630/model
2021/09/29 08:59:52 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0929065627"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632905991586796630/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632905991586796630/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0929065627",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/29 08:59:52 Submitted job: 2021-09-29_01_59_52-18275795705391720721
2021/09/29 08:59:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-29_01_59_52-18275795705391720721?project=apache-beam-testing
2021/09/29 08:59:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-29_01_59_52-18275795705391720721
2021/09/29 08:59:52 Job state: JOB_STATE_PENDING ...
2021/09/29 09:00:23 Job still running ...
2021/09/29 09:00:53 Job still running ...
2021/09/29 09:01:23 Job still running ...
2021/09/29 09:01:53 Job still running ...
2021/09/29 09:02:23 Job still running ...
2021/09/29 09:02:53 Job still running ...
2021/09/29 09:03:23 Job still running ...
2021/09/29 09:03:53 Failed to execute job: job 2021-09-29_01_59_52-18275795705391720721 failed
panic: Failed to execute job: job 2021-09-29_01_59_52-18275795705391720721 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112dbe8, 0xc000120000, 0x101f5f7, 0x19, 0xc0002fde80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 32s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/i3fzdpscfkors
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#283
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/283/display/redirect?page=changes>
Changes:
[Andrew Pilloud] [BEAM-12691] FieldAccessDescriptor for BeamCalcRel
[aydar.zaynutdinov] Init basic go backend structure
[noreply] Update container tags used by unreleased SDKs.
[aydar.zaynutdinov] Add .gitkeep file as an exclusion
[yileiyang] Remove encoding= from the json.loads call.
[noreply] [BEAM-12798] Add configurable combiner packing limit (#15391)
[noreply] [BEAM-12926] Translates Reshuffle with Samza native repartition operator
[noreply] [BEAM-11007] Allow nbconvert 6.x (#15595)
[noreply] [BEAM-12945] Fix crashes when importing the DataFrame API with pandas
[noreply] [BEAM-12611] Capture a greater proporition of logs associated to an
------------------------------------------
[...truncated 26.46 KB...]
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/28 08:59:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632819593951623625/model
2021/09/28 08:59:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0928065625"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632819593951623625/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632819593951623625/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0928065625",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/28 08:59:55 Submitted job: 2021-09-28_01_59_54-9804208247427874536
2021/09/28 08:59:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-28_01_59_54-9804208247427874536?project=apache-beam-testing
2021/09/28 08:59:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-28_01_59_54-9804208247427874536
2021/09/28 08:59:55 Job state: JOB_STATE_PENDING ...
2021/09/28 09:00:25 Job still running ...
2021/09/28 09:00:55 Job still running ...
2021/09/28 09:01:25 Job still running ...
2021/09/28 09:01:55 Job still running ...
2021/09/28 09:02:25 Job still running ...
2021/09/28 09:02:55 Job still running ...
2021/09/28 09:03:25 Job still running ...
2021/09/28 09:03:55 Job still running ...
2021/09/28 09:04:25 Job still running ...
2021/09/28 09:04:55 Job still running ...
2021/09/28 09:05:25 Job still running ...
2021/09/28 09:05:55 Job still running ...
2021/09/28 09:06:25 Failed to execute job: job 2021-09-28_01_59_54-9804208247427874536 failed
panic: Failed to execute job: job 2021-09-28_01_59_54-9804208247427874536 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112dbe8, 0xc00003e0b0, 0x101f5f7, 0x19, 0xc00034de80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 5s
4 actionable tasks: 4 executed
Publishing build scan...
Publishing build scan failed due to network error 'java.net.SocketTimeoutException: Read timed out' (2 retries remaining)...
https://gradle.com/s/xp32ealoxu6qo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#282
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/282/display/redirect>
Changes:
------------------------------------------
[...truncated 26.33 KB...]
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/27 08:59:55 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632733194918170297/model
2021/09/27 08:59:55 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0927065625"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632733194918170297/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632733194918170297/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0927065625",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/27 08:59:56 Submitted job: 2021-09-27_01_59_55-6419544764596753448
2021/09/27 08:59:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-27_01_59_55-6419544764596753448?project=apache-beam-testing
2021/09/27 08:59:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-27_01_59_55-6419544764596753448
2021/09/27 08:59:56 Job state: JOB_STATE_PENDING ...
2021/09/27 09:00:26 Job still running ...
2021/09/27 09:00:56 Job still running ...
2021/09/27 09:01:26 Job still running ...
2021/09/27 09:01:56 Job still running ...
2021/09/27 09:02:26 Job still running ...
2021/09/27 09:02:56 Job still running ...
2021/09/27 09:03:26 Job still running ...
2021/09/27 09:03:56 Job still running ...
2021/09/27 09:04:26 Job still running ...
2021/09/27 09:04:56 Job still running ...
2021/09/27 09:05:26 Job still running ...
2021/09/27 09:05:56 Failed to execute job: job 2021-09-27_01_59_55-6419544764596753448 failed
panic: Failed to execute job: job 2021-09-27_01_59_55-6419544764596753448 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112dbe8, 0xc00019a000, 0x101f5f7, 0x19, 0xc0002c9e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 36s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/rw5uixyn3rdt2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#281
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/281/display/redirect>
Changes:
------------------------------------------
[...truncated 26.22 KB...]
>
component_coder_ids: "c0"
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/26 08:59:55 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632646795032455466/model
2021/09/26 08:59:55 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0926065623"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632646795032455466/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632646795032455466/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0926065623",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/26 08:59:56 Submitted job: 2021-09-26_01_59_55-11945751926196568481
2021/09/26 08:59:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-26_01_59_55-11945751926196568481?project=apache-beam-testing
2021/09/26 08:59:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-26_01_59_55-11945751926196568481
2021/09/26 08:59:56 Job state: JOB_STATE_PENDING ...
2021/09/26 09:00:26 Job still running ...
2021/09/26 09:00:56 Job still running ...
2021/09/26 09:01:26 Job still running ...
2021/09/26 09:01:56 Job still running ...
2021/09/26 09:02:26 Job still running ...
2021/09/26 09:02:56 Job still running ...
2021/09/26 09:03:26 Failed to execute job: job 2021-09-26_01_59_55-11945751926196568481 failed
panic: Failed to execute job: job 2021-09-26_01_59_55-11945751926196568481 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112dbe8, 0xc00003e0b0, 0x101f5f7, 0x19, 0xc000611e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 7s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/jml4mbi7uk7lo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#280
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/280/display/redirect?page=changes>
Changes:
[Robert Bradshaw] [BEAM-12934] Use environment capabilities to determine length prefixing.
[Brian Hulette] Add missing comma
[ryanthompson591] Update tensorflow to version 2.6.0
[zhoufek] [BEAM-9487] Fix incorrected Repeatedly.may_finish implementation
[noreply] Cleanup use of futures. (#15043)
[noreply] Go Lint fix for wordcount and metrics (#15580)
[Brian Hulette] Fix whitespace lint
[noreply] [BEAM-3304] Snippets for trigger in BPG (#15409)
[noreply] [BEAM-12832] Add Go SDK xlang info to programming guide. (#15447)
[noreply] [BEAM-11097] Add SideInputCache to StateReader (#15563)
[Robert Bradshaw] Revert "Avoid apiary submission of job graph when it is not needed.
[noreply] [BEAM-12769] Java-emulating external transform. (#15546)
[noreply] [BEAM-12913] Pass query priority from ReadAllFromBigQuery (#15584)
[noreply] [BEAM-11982] Java Spanner - Implement IO Request Count metrics (#15493)
------------------------------------------
[...truncated 26.26 KB...]
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/25 09:00:01 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632560400910976186/model
2021/09/25 09:00:01 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0925065644"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632560400910976186/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632560400910976186/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0925065644",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/25 09:00:02 Submitted job: 2021-09-25_02_00_01-12176587513588142975
2021/09/25 09:00:02 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-25_02_00_01-12176587513588142975?project=apache-beam-testing
2021/09/25 09:00:02 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-25_02_00_01-12176587513588142975
2021/09/25 09:00:02 Job state: JOB_STATE_PENDING ...
2021/09/25 09:00:32 Job still running ...
2021/09/25 09:01:02 Job still running ...
2021/09/25 09:01:32 Job still running ...
2021/09/25 09:02:02 Job still running ...
2021/09/25 09:02:32 Job still running ...
2021/09/25 09:03:02 Job still running ...
2021/09/25 09:03:32 Job still running ...
2021/09/25 09:04:02 Job still running ...
2021/09/25 09:04:32 Failed to execute job: job 2021-09-25_02_00_01-12176587513588142975 failed
panic: Failed to execute job: job 2021-09-25_02_00_01-12176587513588142975 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112dbe8, 0xc000120000, 0x101f5f7, 0x19, 0xc000325e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 11s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/uct3aagyxmqeg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#279
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/279/display/redirect?page=changes>
Changes:
[noreply] Avoid setting empty builders in proto setters
[Brian Hulette] Add back 'more' break
[Robert Bradshaw] Fix some website logos.
[chuck.yang] Run BigQuery queries with batch priority
[chuck.yang] Allow changing query priority in ReadFromBigQuery
[chuck.yang] Update CHANGES
[kawaigin] Implicitly watch and track anonymous pipeline and PCollections
[chamikaramj] Reject requests when parameter names cannot be validated unless
[chamikaramj] Updates error message
[alexander.chermenin] [BEAM-10822] Fixed typo in BigqueryClient
[zyichi] [BEAM-12898] Minor fix to Kubernetes.groovy postBuildScript.
[noreply] [BEAM-12869] Bump tensorflow from 2.5.0 to 2.5.1 in
[noreply] [BEAM-12946] Fix SmallestPerKey, add unit testing (#15567)
[zyichi] [BEAM-12908] Sickbay pubsublite.ReadWriteIT
[noreply] Relocate Go SDK breaking change note out of template into 2.33.0.
------------------------------------------
[...truncated 26.20 KB...]
>
component_coder_ids: "c0"
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/24 08:59:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632473993825845425/model
2021/09/24 08:59:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0924065631"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632473993825845425/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632473993825845425/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0924065631",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/24 08:59:55 Submitted job: 2021-09-24_01_59_54-13793569005030374750
2021/09/24 08:59:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-24_01_59_54-13793569005030374750?project=apache-beam-testing
2021/09/24 08:59:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-24_01_59_54-13793569005030374750
2021/09/24 08:59:55 Job state: JOB_STATE_PENDING ...
2021/09/24 09:00:25 Job still running ...
2021/09/24 09:00:55 Job still running ...
2021/09/24 09:01:25 Job still running ...
2021/09/24 09:01:55 Job still running ...
2021/09/24 09:02:25 Job still running ...
2021/09/24 09:02:55 Job still running ...
2021/09/24 09:03:25 Failed to execute job: job 2021-09-24_01_59_54-13793569005030374750 failed
panic: Failed to execute job: job 2021-09-24_01_59_54-13793569005030374750 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112c168, 0xc00018a000, 0x101de37, 0x19, 0xc0004abe80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 2s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/2esuz6ojr43n4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#278
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/278/display/redirect?page=changes>
Changes:
[kileysok] Add MapState and SetState support
[danthev] Fix 2.32.0 release notes.
[Kyle Weaver] [BEAM-12898] Use new postbuildscript dsl in Flink load tests
[Kyle Weaver] run postbuild regardless of test result
[Kyle Weaver] spotless
[noreply] Merge pull request #15487 from [BEAM-12812] - Run Github Actions on GCP
[noreply] [BEAM-11097] Add SideInputCache to harness control type (#15530)
[kawaigin] Updated interactive integration test golden screenshots.
[noreply] Revert PR 15487 (BEAM-12812) (#15554)
[zyichi] [BEAM-12898] Trying out solution suggestion for JENKINS-66189 to solve
[noreply] [BEAM-12383] Adding Go SDK and Kafka IO to Gradle cross-language test
------------------------------------------
[...truncated 26.27 KB...]
component_coder_ids: "c0"
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/23 09:00:17 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632387617313407879/model
2021/09/23 09:00:17 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0923065616"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632387617313407879/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632387617313407879/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0923065616",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/23 09:00:18 Submitted job: 2021-09-23_02_00_17-16140036343192335056
2021/09/23 09:00:18 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-23_02_00_17-16140036343192335056?project=apache-beam-testing
2021/09/23 09:00:18 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-23_02_00_17-16140036343192335056
2021/09/23 09:00:18 Job state: JOB_STATE_PENDING ...
2021/09/23 09:00:48 Job still running ...
2021/09/23 09:01:18 Job still running ...
2021/09/23 09:01:48 Job still running ...
2021/09/23 09:02:18 Job still running ...
2021/09/23 09:02:49 Job still running ...
2021/09/23 09:03:19 Job still running ...
2021/09/23 09:03:49 Job still running ...
2021/09/23 09:04:19 Failed to execute job: job 2021-09-23_02_00_17-16140036343192335056 failed
panic: Failed to execute job: job 2021-09-23_02_00_17-16140036343192335056 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112c168, 0xc00003e0b0, 0x101de37, 0x19, 0xc00028be80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 58s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/trbtbzzz7jd4k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#277
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/277/display/redirect?page=changes>
Changes:
[noreply] [BEAM-12919] Removed IBM Streams from runner matrix (#15542)
[noreply] [BEAM-12258] Re-throw exception from forked thread in
[kawaigin] [BEAM-10708] Added an example notebook for beam_sql magic
[noreply] Add a timeout for BQ streaming_insert RPCS (#15541)
[noreply] Merge pull request #15537 from [BEAM-12908] Add a sleep to the IT after
------------------------------------------
[...truncated 26.25 KB...]
>
component_coder_ids: "c0"
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/22 08:59:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632301191062892775/model
2021/09/22 08:59:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0922065611"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632301191062892775/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632301191062892775/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0922065611",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/22 08:59:52 Submitted job: 2021-09-22_01_59_51-3470536074972425122
2021/09/22 08:59:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-22_01_59_51-3470536074972425122?project=apache-beam-testing
2021/09/22 08:59:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-22_01_59_51-3470536074972425122
2021/09/22 08:59:52 Job state: JOB_STATE_PENDING ...
2021/09/22 09:00:22 Job still running ...
2021/09/22 09:00:52 Job still running ...
2021/09/22 09:01:22 Job still running ...
2021/09/22 09:01:52 Job still running ...
2021/09/22 09:02:22 Job still running ...
2021/09/22 09:02:52 Job still running ...
2021/09/22 09:03:22 Failed to execute job: job 2021-09-22_01_59_51-3470536074972425122 failed
panic: Failed to execute job: job 2021-09-22_01_59_51-3470536074972425122 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112b108, 0xc00003e0b0, 0x101d277, 0x19, 0xc000543e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 2s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/qk2lrgwspjiy4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#276
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/276/display/redirect?page=changes>
Changes:
[chamikaramj] Python support for directly using Java transforms using constructor and
[chamikaramj] Fixes yapf
[chamikaramj] Fixes lint
[chamikaramj] Addressing reviewer comments
[chamikaramj] Adds support for a field name format that will be ignored at expansion
[danthev] Fix flaky test.
[danthev] Fix lint errors.
[Robert Bradshaw] Additional CoGBK tests.
[chamikaramj] Addresses reviewer comments
[chamikaramj] Use correct ignore field prefix in Python side
[noreply] [BEAM-12803] Update deprecated use of _field_types (#15539)
[Robert Bradshaw] Move CoGBK tests into appropreate module.
------------------------------------------
[...truncated 26.34 KB...]
component_coder_ids: "c0"
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/21 09:00:02 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632214802048884069/model
2021/09/21 09:00:02 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0921065628"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632214802048884069/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632214802048884069/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0921065628",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/21 09:00:03 Submitted job: 2021-09-21_02_00_02-4695600511852142258
2021/09/21 09:00:03 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-21_02_00_02-4695600511852142258?project=apache-beam-testing
2021/09/21 09:00:03 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-21_02_00_02-4695600511852142258
2021/09/21 09:00:03 Job state: JOB_STATE_PENDING ...
2021/09/21 09:00:33 Job still running ...
2021/09/21 09:01:03 Job still running ...
2021/09/21 09:01:33 Job still running ...
2021/09/21 09:02:03 Job still running ...
2021/09/21 09:02:33 Job still running ...
2021/09/21 09:03:03 Job still running ...
2021/09/21 09:03:33 Job still running ...
2021/09/21 09:04:04 Failed to execute job: job 2021-09-21_02_00_02-4695600511852142258 failed
panic: Failed to execute job: job 2021-09-21_02_00_02-4695600511852142258 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112b108, 0xc00003e0b0, 0x101d277, 0x19, 0xc00034be80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 43s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/plnhp3d3jf3ve
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#275
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/275/display/redirect>
Changes:
------------------------------------------
[...truncated 26.20 KB...]
>
component_coder_ids: "c0"
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/20 08:59:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632128393526109453/model
2021/09/20 08:59:53 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0920065635"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632128393526109453/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632128393526109453/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0920065635",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/20 08:59:56 Submitted job: 2021-09-20_01_59_54-12575852858852917306
2021/09/20 08:59:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-20_01_59_54-12575852858852917306?project=apache-beam-testing
2021/09/20 08:59:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-20_01_59_54-12575852858852917306
2021/09/20 08:59:56 Job state: JOB_STATE_PENDING ...
2021/09/20 09:00:26 Job still running ...
2021/09/20 09:00:56 Job still running ...
2021/09/20 09:01:26 Job still running ...
2021/09/20 09:01:56 Job still running ...
2021/09/20 09:02:26 Job still running ...
2021/09/20 09:02:56 Job still running ...
2021/09/20 09:03:26 Failed to execute job: job 2021-09-20_01_59_54-12575852858852917306 failed
panic: Failed to execute job: job 2021-09-20_01_59_54-12575852858852917306 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112b108, 0xc000120000, 0x101d277, 0x19, 0xc0004e5e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 5s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/kbl3krtei6wju
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#274
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/274/display/redirect>
Changes:
------------------------------------------
[...truncated 26.31 KB...]
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/19 08:59:48 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1632041988259282150/model
2021/09/19 08:59:48 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0919065618"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632041988259282150/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1632041988259282150/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0919065618",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/19 08:59:49 Submitted job: 2021-09-19_01_59_48-10672601892769528052
2021/09/19 08:59:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-19_01_59_48-10672601892769528052?project=apache-beam-testing
2021/09/19 08:59:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-19_01_59_48-10672601892769528052
2021/09/19 08:59:49 Job state: JOB_STATE_PENDING ...
2021/09/19 09:00:19 Job still running ...
2021/09/19 09:00:49 Job still running ...
2021/09/19 09:01:19 Job still running ...
2021/09/19 09:01:49 Job still running ...
2021/09/19 09:02:19 Job still running ...
2021/09/19 09:02:49 Job still running ...
2021/09/19 09:03:19 Job still running ...
2021/09/19 09:03:49 Job still running ...
2021/09/19 09:04:19 Job still running ...
2021/09/19 09:04:50 Job still running ...
2021/09/19 09:05:20 Failed to execute job: job 2021-09-19_01_59_48-10672601892769528052 failed
panic: Failed to execute job: job 2021-09-19_01_59_48-10672601892769528052 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112b108, 0xc00003e0b0, 0x101d277, 0x19, 0xc00040be80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 0s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/6xpspo6djwvso
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#273
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/273/display/redirect?page=changes>
Changes:
[samuelw] [BEAM-12740] Add option to CreateOptions to avoid GetObjectMetadata for
[noreply] Minor: Prune docker volumes in Inventory job(#15532)
------------------------------------------
[...truncated 26.19 KB...]
>
component_coder_ids: "c0"
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/18 08:59:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1631955594108261108/model
2021/09/18 08:59:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0918065607"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631955594108261108/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631955594108261108/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0918065607",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/18 08:59:55 Submitted job: 2021-09-18_01_59_54-10787933434638293172
2021/09/18 08:59:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-18_01_59_54-10787933434638293172?project=apache-beam-testing
2021/09/18 08:59:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-18_01_59_54-10787933434638293172
2021/09/18 08:59:55 Job state: JOB_STATE_PENDING ...
2021/09/18 09:00:25 Job still running ...
2021/09/18 09:00:55 Job still running ...
2021/09/18 09:01:25 Job still running ...
2021/09/18 09:01:55 Job still running ...
2021/09/18 09:02:25 Job still running ...
2021/09/18 09:02:55 Job still running ...
2021/09/18 09:03:25 Failed to execute job: job 2021-09-18_01_59_54-10787933434638293172 failed
panic: Failed to execute job: job 2021-09-18_01_59_54-10787933434638293172 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112b108, 0xc00003e0b0, 0x101d277, 0x19, 0xc0002dbe80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 5s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/56oq4prg2qvrc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#272
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/272/display/redirect?page=changes>
Changes:
[randomstep] [BEAM-12899] Upgrade Gradle to version 6.9.x
[noreply] [BEAM-12701] Added extra parameter in to_csv for DeferredFrame to name
[zyichi] [BEAM-12603] Add retries to FnApiRunnerTest due to flakiness of grpc
[noreply] [BEAM-12535] add dataframes notebook (#15470)
------------------------------------------
[...truncated 26.22 KB...]
>
component_coder_ids: "c0"
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/17 08:59:46 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1631869185873167783/model
2021/09/17 08:59:46 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0917081206"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631869185873167783/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631869185873167783/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0917081206",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/17 08:59:47 Submitted job: 2021-09-17_01_59_46-12039656099128441901
2021/09/17 08:59:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-17_01_59_46-12039656099128441901?project=apache-beam-testing
2021/09/17 08:59:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-17_01_59_46-12039656099128441901
2021/09/17 08:59:47 Job state: JOB_STATE_PENDING ...
2021/09/17 09:00:17 Job still running ...
2021/09/17 09:00:47 Job still running ...
2021/09/17 09:01:17 Job still running ...
2021/09/17 09:01:47 Job still running ...
2021/09/17 09:02:17 Job still running ...
2021/09/17 09:02:47 Job still running ...
2021/09/17 09:03:17 Failed to execute job: job 2021-09-17_01_59_46-12039656099128441901 failed
panic: Failed to execute job: job 2021-09-17_01_59_46-12039656099128441901 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112b108, 0xc000120000, 0x101d277, 0x19, 0xc000733e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 0s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/ragu6zl6ldjqe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#271
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/271/display/redirect?page=changes>
Changes:
[noreply] [BEAM-12153] revert "implement GroupByKey with CombinePerKey with
[noreply] [BEAM-12845] Add AWS services as a runtime dependency to Spark Job
[dpcollins] [BEAM-12882] - fix test that is flaky when jenkins is overloaded
[noreply] [BEAM-12885] Enable NeedsRunner Tests for Samza Portable Runner (#15512)
[noreply] [BEAM-12100][BEAM-10379][BEAM-9514][BEAM-12647][BEAM-12099]
[noreply] [BEAM-12543] Fix DataFrrame typo (#15509)
[noreply] [BEAM-12794] Remove obsolete uses of sys.exc_info. (#15507)
[noreply] [BEAM-11666] flake on RecordingManagerTest (#15118)
[kawaigin] [BEAM-10708] Introspect beam_sql output
[noreply] Minor: Restore "Bugfix" section in CHANGES.md (#15516)
[Kyle Weaver] [BEAM-10459] Unignore numeric aggregation tests.
[ajamato] [BEAM-12898] Disable Flink Load tests which are leading Dataproc
------------------------------------------
[...truncated 29.76 KB...]
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631782790601609387/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631782790601609387/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0916065625",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/16 08:59:51 Submitted job: 2021-09-16_01_59_51-16854525472703569792
2021/09/16 08:59:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-16_01_59_51-16854525472703569792?project=apache-beam-testing
2021/09/16 08:59:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-16_01_59_51-16854525472703569792
2021/09/16 08:59:52 Job state: JOB_STATE_PENDING ...
2021/09/16 09:00:22 Job still running ...
2021/09/16 09:00:52 Job still running ...
2021/09/16 09:01:22 Job still running ...
2021/09/16 09:01:52 Job still running ...
2021/09/16 09:02:23 Job still running ...
2021/09/16 09:02:53 Job still running ...
2021/09/16 09:03:23 Job still running ...
2021/09/16 09:03:53 Job still running ...
2021/09/16 09:04:23 Job still running ...
2021/09/16 09:04:53 Job still running ...
2021/09/16 09:05:23 Job still running ...
2021/09/16 09:05:53 Job still running ...
2021/09/16 09:06:23 Job still running ...
2021/09/16 09:06:54 Job still running ...
2021/09/16 09:07:24 Job still running ...
2021/09/16 09:07:54 Job still running ...
2021/09/16 09:08:24 Job still running ...
2021/09/16 09:08:54 Job still running ...
2021/09/16 09:09:24 Job still running ...
2021/09/16 09:09:55 Job still running ...
2021/09/16 09:10:25 Job still running ...
2021/09/16 09:10:55 Job still running ...
2021/09/16 09:11:25 Job still running ...
2021/09/16 09:11:55 Job still running ...
2021/09/16 09:12:25 Job still running ...
2021/09/16 09:12:55 Job still running ...
2021/09/16 09:13:25 Job still running ...
2021/09/16 09:13:55 Job still running ...
2021/09/16 09:14:25 Job still running ...
2021/09/16 09:14:55 Job still running ...
2021/09/16 09:15:26 Job still running ...
2021/09/16 09:15:56 Job still running ...
2021/09/16 09:16:26 Job still running ...
2021/09/16 09:16:56 Job still running ...
2021/09/16 09:17:26 Job still running ...
2021/09/16 09:17:56 Job still running ...
2021/09/16 09:18:26 Job still running ...
2021/09/16 09:18:57 Job still running ...
2021/09/16 09:19:27 Job still running ...
2021/09/16 09:19:57 Job still running ...
2021/09/16 09:20:27 Job still running ...
2021/09/16 09:20:57 Job still running ...
2021/09/16 09:21:27 Job still running ...
2021/09/16 09:21:57 Job still running ...
2021/09/16 09:22:27 Job still running ...
2021/09/16 09:22:57 Job still running ...
2021/09/16 09:23:27 Job still running ...
2021/09/16 09:23:57 Job still running ...
2021/09/16 09:24:28 Job still running ...
2021/09/16 09:24:58 Job still running ...
2021/09/16 09:25:28 Job still running ...
2021/09/16 09:25:58 Job still running ...
2021/09/16 09:26:28 Job still running ...
2021/09/16 09:26:58 Job still running ...
2021/09/16 09:27:28 Job still running ...
2021/09/16 09:27:58 Job still running ...
2021/09/16 09:28:29 Job still running ...
2021/09/16 09:28:59 Job still running ...
2021/09/16 09:29:29 Job still running ...
2021/09/16 09:29:59 Job still running ...
2021/09/16 09:30:29 Job still running ...
2021/09/16 09:30:59 Job still running ...
2021/09/16 09:31:29 Job still running ...
2021/09/16 09:31:59 Job still running ...
2021/09/16 09:32:29 Job still running ...
2021/09/16 09:32:59 Job still running ...
2021/09/16 09:33:29 Job still running ...
2021/09/16 09:33:59 Job still running ...
2021/09/16 09:34:29 Job still running ...
2021/09/16 09:34:59 Job still running ...
2021/09/16 09:35:29 Job still running ...
2021/09/16 09:35:59 Job still running ...
2021/09/16 09:36:30 Job still running ...
2021/09/16 09:37:00 Job still running ...
2021/09/16 09:37:30 Job still running ...
2021/09/16 09:38:00 Job still running ...
2021/09/16 09:38:30 Job still running ...
2021/09/16 09:39:00 Job still running ...
2021/09/16 09:39:30 Job still running ...
2021/09/16 09:40:00 Job still running ...
2021/09/16 09:40:30 Job still running ...
2021/09/16 09:41:00 Job still running ...
2021/09/16 09:41:30 Job still running ...
2021/09/16 09:42:00 Job still running ...
2021/09/16 09:42:30 Job still running ...
2021/09/16 09:43:00 Job still running ...
2021/09/16 09:43:30 Job still running ...
2021/09/16 09:44:00 Job still running ...
2021/09/16 09:44:30 Job still running ...
2021/09/16 09:45:00 Job still running ...
2021/09/16 09:45:30 Job still running ...
2021/09/16 09:46:00 Job still running ...
2021/09/16 09:46:30 Job still running ...
2021/09/16 09:47:00 Job still running ...
2021/09/16 09:47:31 Job still running ...
2021/09/16 09:48:01 Job still running ...
2021/09/16 09:48:31 Job still running ...
2021/09/16 09:49:01 Job still running ...
2021/09/16 09:49:31 Job still running ...
2021/09/16 09:50:01 Job still running ...
2021/09/16 09:50:31 Job still running ...
2021/09/16 09:51:01 Job still running ...
2021/09/16 09:51:31 Job still running ...
2021/09/16 09:52:01 Job still running ...
2021/09/16 09:52:31 Job still running ...
2021/09/16 09:53:01 Job still running ...
2021/09/16 09:53:31 Job still running ...
2021/09/16 09:54:01 Job still running ...
2021/09/16 09:54:31 Job still running ...
2021/09/16 09:55:01 Job still running ...
2021/09/16 09:55:31 Job still running ...
2021/09/16 09:56:01 Job still running ...
2021/09/16 09:56:31 Job still running ...
2021/09/16 09:57:01 Job still running ...
2021/09/16 09:57:31 Job still running ...
2021/09/16 09:58:02 Job still running ...
2021/09/16 09:58:32 Job still running ...
2021/09/16 09:59:02 Job still running ...
2021/09/16 09:59:32 Job still running ...
2021/09/16 10:00:02 Job still running ...
2021/09/16 10:00:32 Job still running ...
2021/09/16 10:01:02 Job still running ...
2021/09/16 10:01:32 Job still running ...
2021/09/16 10:02:02 Job still running ...
2021/09/16 10:02:32 Job still running ...
2021/09/16 10:03:02 Failed to execute job: job 2021-09-16_01_59_51-16854525472703569792 failed
panic: Failed to execute job: job 2021-09-16_01_59_51-16854525472703569792 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112b108, 0xc00003e0b0, 0x101d277, 0x19, 0xc0001f1e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 3m 41s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/7zp2a42xo2z5y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#270
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/270/display/redirect?page=changes>
Changes:
[dhuntsperger] updated Maven-to-Gradle conversion step in Java quickstart
[noreply] [BEAM-10913] - Updating Grafana from v6.7.3 to v8.1.2 (#15503)
[noreply] [BEAM-12876] Adding doc and glossary entry for resource hints (#15499)
------------------------------------------
[...truncated 29.91 KB...]
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631696392627403364/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631696392627403364/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0915065620",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/15 08:59:54 Submitted job: 2021-09-15_01_59_53-8532573564976290063
2021/09/15 08:59:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-15_01_59_53-8532573564976290063?project=apache-beam-testing
2021/09/15 08:59:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-15_01_59_53-8532573564976290063
2021/09/15 08:59:54 Job state: JOB_STATE_PENDING ...
2021/09/15 09:00:24 Job still running ...
2021/09/15 09:00:54 Job still running ...
2021/09/15 09:01:24 Job still running ...
2021/09/15 09:01:54 Job still running ...
2021/09/15 09:02:24 Job still running ...
2021/09/15 09:02:54 Job still running ...
2021/09/15 09:03:24 Job still running ...
2021/09/15 09:03:54 Job still running ...
2021/09/15 09:04:24 Job still running ...
2021/09/15 09:04:54 Job still running ...
2021/09/15 09:05:24 Job still running ...
2021/09/15 09:05:54 Job still running ...
2021/09/15 09:06:24 Job still running ...
2021/09/15 09:06:54 Job still running ...
2021/09/15 09:07:24 Job still running ...
2021/09/15 09:07:54 Job still running ...
2021/09/15 09:08:25 Job still running ...
2021/09/15 09:08:55 Job still running ...
2021/09/15 09:09:25 Job still running ...
2021/09/15 09:09:55 Job still running ...
2021/09/15 09:10:25 Job still running ...
2021/09/15 09:10:55 Job still running ...
2021/09/15 09:11:25 Job still running ...
2021/09/15 09:11:55 Job still running ...
2021/09/15 09:12:25 Job still running ...
2021/09/15 09:12:55 Job still running ...
2021/09/15 09:13:25 Job still running ...
2021/09/15 09:13:55 Job still running ...
2021/09/15 09:14:25 Job still running ...
2021/09/15 09:14:55 Job still running ...
2021/09/15 09:15:25 Job still running ...
2021/09/15 09:15:55 Job still running ...
2021/09/15 09:16:25 Job still running ...
2021/09/15 09:16:55 Job still running ...
2021/09/15 09:17:25 Job still running ...
2021/09/15 09:17:56 Job still running ...
2021/09/15 09:18:26 Job still running ...
2021/09/15 09:18:56 Job still running ...
2021/09/15 09:19:26 Job still running ...
2021/09/15 09:19:56 Job still running ...
2021/09/15 09:20:26 Job still running ...
2021/09/15 09:20:56 Job still running ...
2021/09/15 09:21:26 Job still running ...
2021/09/15 09:21:56 Job still running ...
2021/09/15 09:22:26 Job still running ...
2021/09/15 09:22:56 Job still running ...
2021/09/15 09:23:26 Job still running ...
2021/09/15 09:23:57 Job still running ...
2021/09/15 09:24:27 Job still running ...
2021/09/15 09:24:57 Job still running ...
2021/09/15 09:25:27 Job still running ...
2021/09/15 09:25:57 Job still running ...
2021/09/15 09:26:27 Job still running ...
2021/09/15 09:26:57 Job still running ...
2021/09/15 09:27:27 Job still running ...
2021/09/15 09:27:57 Job still running ...
2021/09/15 09:28:27 Job still running ...
2021/09/15 09:28:57 Job still running ...
2021/09/15 09:29:27 Job still running ...
2021/09/15 09:29:57 Job still running ...
2021/09/15 09:30:27 Job still running ...
2021/09/15 09:30:57 Job still running ...
2021/09/15 09:31:27 Job still running ...
2021/09/15 09:31:57 Job still running ...
2021/09/15 09:32:28 Job still running ...
2021/09/15 09:32:58 Job still running ...
2021/09/15 09:33:28 Job still running ...
2021/09/15 09:33:58 Job still running ...
2021/09/15 09:34:28 Job still running ...
2021/09/15 09:34:58 Job still running ...
2021/09/15 09:35:28 Job still running ...
2021/09/15 09:35:58 Job still running ...
2021/09/15 09:36:28 Job still running ...
2021/09/15 09:36:58 Job still running ...
2021/09/15 09:37:28 Job still running ...
2021/09/15 09:37:58 Job still running ...
2021/09/15 09:38:28 Job still running ...
2021/09/15 09:38:58 Job still running ...
2021/09/15 09:39:28 Job still running ...
2021/09/15 09:39:58 Job still running ...
2021/09/15 09:40:28 Job still running ...
2021/09/15 09:40:58 Job still running ...
2021/09/15 09:41:28 Job still running ...
2021/09/15 09:41:58 Job still running ...
2021/09/15 09:42:28 Job still running ...
2021/09/15 09:42:58 Job still running ...
2021/09/15 09:43:28 Job still running ...
2021/09/15 09:43:58 Job still running ...
2021/09/15 09:44:29 Job still running ...
2021/09/15 09:44:59 Job still running ...
2021/09/15 09:45:29 Job still running ...
2021/09/15 09:45:59 Job still running ...
2021/09/15 09:46:29 Job still running ...
2021/09/15 09:46:59 Job still running ...
2021/09/15 09:47:29 Job still running ...
2021/09/15 09:47:59 Job still running ...
2021/09/15 09:48:29 Job still running ...
2021/09/15 09:48:59 Job still running ...
2021/09/15 09:49:29 Job still running ...
2021/09/15 09:49:59 Job still running ...
2021/09/15 09:50:29 Job still running ...
2021/09/15 09:50:59 Job still running ...
2021/09/15 09:51:29 Job still running ...
2021/09/15 09:51:59 Job still running ...
2021/09/15 09:52:29 Job still running ...
2021/09/15 09:52:59 Job still running ...
2021/09/15 09:53:29 Job still running ...
2021/09/15 09:54:00 Job still running ...
2021/09/15 09:54:30 Job still running ...
2021/09/15 09:55:00 Job still running ...
2021/09/15 09:55:30 Job still running ...
2021/09/15 09:56:00 Job still running ...
2021/09/15 09:56:30 Job still running ...
2021/09/15 09:57:00 Job still running ...
2021/09/15 09:57:30 Job still running ...
2021/09/15 09:58:00 Job still running ...
2021/09/15 09:58:30 Job still running ...
2021/09/15 09:59:00 Job still running ...
2021/09/15 09:59:30 Job still running ...
2021/09/15 10:00:00 Job still running ...
2021/09/15 10:00:30 Job still running ...
2021/09/15 10:01:00 Job still running ...
2021/09/15 10:01:30 Job still running ...
2021/09/15 10:02:00 Job still running ...
2021/09/15 10:02:30 Job still running ...
2021/09/15 10:03:00 Job still running ...
2021/09/15 10:03:30 Failed to execute job: job 2021-09-15_01_59_53-8532573564976290063 failed
panic: Failed to execute job: job 2021-09-15_01_59_53-8532573564976290063 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112b108, 0xc000120000, 0x101d277, 0x19, 0xc0003ebe80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 4m 10s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/65kd7o77yvd62
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#269
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/269/display/redirect?page=changes>
Changes:
[rohde.samuel] [BEAM-12842] Add timestamp to test work item to deflake
[dhuntsperger] fixed broken Python tab on HCatalog IO page
[suztomo] [BEAM-12873] HL7v2IO: to leave schematizedData null, not empty
[noreply] Avoid apiary submission of job graph when it is not needed. (#15458)
[noreply] [BEAM-7261] Add support for BasicSessionCredentials for AWS credentials.
[noreply] Bump dataflow java container version to beam-master-20210913 (#15506)
[noreply] [BEAM-11980] Java GCS - Implement IO Request Count metrics (#15394)
------------------------------------------
[...truncated 29.67 KB...]
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631609995005231095/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631609995005231095/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0914065633",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/14 08:59:56 Submitted job: 2021-09-14_01_59_55-3735807704039188327
2021/09/14 08:59:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-14_01_59_55-3735807704039188327?project=apache-beam-testing
2021/09/14 08:59:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-14_01_59_55-3735807704039188327
2021/09/14 08:59:56 Job state: JOB_STATE_PENDING ...
2021/09/14 09:00:26 Job still running ...
2021/09/14 09:00:56 Job still running ...
2021/09/14 09:01:26 Job still running ...
2021/09/14 09:01:56 Job still running ...
2021/09/14 09:02:26 Job still running ...
2021/09/14 09:02:56 Job still running ...
2021/09/14 09:03:26 Job still running ...
2021/09/14 09:03:56 Job still running ...
2021/09/14 09:04:26 Job still running ...
2021/09/14 09:04:56 Job still running ...
2021/09/14 09:05:27 Job still running ...
2021/09/14 09:05:57 Job still running ...
2021/09/14 09:06:27 Job still running ...
2021/09/14 09:06:57 Job still running ...
2021/09/14 09:07:27 Job still running ...
2021/09/14 09:07:57 Job still running ...
2021/09/14 09:08:27 Job still running ...
2021/09/14 09:08:57 Job still running ...
2021/09/14 09:09:27 Job still running ...
2021/09/14 09:09:57 Job still running ...
2021/09/14 09:10:27 Job still running ...
2021/09/14 09:10:57 Job still running ...
2021/09/14 09:11:27 Job still running ...
2021/09/14 09:11:57 Job still running ...
2021/09/14 09:12:27 Job still running ...
2021/09/14 09:12:57 Job still running ...
2021/09/14 09:13:27 Job still running ...
2021/09/14 09:13:57 Job still running ...
2021/09/14 09:14:27 Job still running ...
2021/09/14 09:14:57 Job still running ...
2021/09/14 09:15:27 Job still running ...
2021/09/14 09:15:57 Job still running ...
2021/09/14 09:16:27 Job still running ...
2021/09/14 09:16:57 Job still running ...
2021/09/14 09:17:28 Job still running ...
2021/09/14 09:17:58 Job still running ...
2021/09/14 09:18:28 Job still running ...
2021/09/14 09:18:58 Job still running ...
2021/09/14 09:19:28 Job still running ...
2021/09/14 09:19:58 Job still running ...
2021/09/14 09:20:28 Job still running ...
2021/09/14 09:20:58 Job still running ...
2021/09/14 09:21:28 Job still running ...
2021/09/14 09:21:58 Job still running ...
2021/09/14 09:22:28 Job still running ...
2021/09/14 09:22:58 Job still running ...
2021/09/14 09:23:28 Job still running ...
2021/09/14 09:23:58 Job still running ...
2021/09/14 09:24:28 Job still running ...
2021/09/14 09:24:58 Job still running ...
2021/09/14 09:25:28 Job still running ...
2021/09/14 09:25:58 Job still running ...
2021/09/14 09:26:28 Job still running ...
2021/09/14 09:27:00 Job still running ...
2021/09/14 09:27:30 Job still running ...
2021/09/14 09:28:00 Job still running ...
2021/09/14 09:28:30 Job still running ...
2021/09/14 09:29:00 Job still running ...
2021/09/14 09:29:30 Job still running ...
2021/09/14 09:30:00 Job still running ...
2021/09/14 09:30:30 Job still running ...
2021/09/14 09:31:00 Job still running ...
2021/09/14 09:31:30 Job still running ...
2021/09/14 09:32:00 Job still running ...
2021/09/14 09:32:30 Job still running ...
2021/09/14 09:33:00 Job still running ...
2021/09/14 09:33:30 Job still running ...
2021/09/14 09:34:00 Job still running ...
2021/09/14 09:34:30 Job still running ...
2021/09/14 09:35:00 Job still running ...
2021/09/14 09:35:30 Job still running ...
2021/09/14 09:36:00 Job still running ...
2021/09/14 09:36:30 Job still running ...
2021/09/14 09:37:00 Job still running ...
2021/09/14 09:37:31 Job still running ...
2021/09/14 09:38:01 Job still running ...
2021/09/14 09:38:31 Job still running ...
2021/09/14 09:39:01 Job still running ...
2021/09/14 09:39:31 Job still running ...
2021/09/14 09:40:01 Job still running ...
2021/09/14 09:40:31 Job still running ...
2021/09/14 09:41:01 Job still running ...
2021/09/14 09:41:31 Job still running ...
2021/09/14 09:42:01 Job still running ...
2021/09/14 09:42:31 Job still running ...
2021/09/14 09:43:01 Job still running ...
2021/09/14 09:43:31 Job still running ...
2021/09/14 09:44:01 Job still running ...
2021/09/14 09:44:31 Job still running ...
2021/09/14 09:45:01 Job still running ...
2021/09/14 09:45:31 Job still running ...
2021/09/14 09:46:01 Job still running ...
2021/09/14 09:46:31 Job still running ...
2021/09/14 09:47:01 Job still running ...
2021/09/14 09:47:32 Job still running ...
2021/09/14 09:48:02 Job still running ...
2021/09/14 09:48:32 Job still running ...
2021/09/14 09:49:02 Job still running ...
2021/09/14 09:49:32 Job still running ...
2021/09/14 09:50:02 Job still running ...
2021/09/14 09:50:32 Job still running ...
2021/09/14 09:51:02 Job still running ...
2021/09/14 09:51:32 Job still running ...
2021/09/14 09:52:02 Job still running ...
2021/09/14 09:52:32 Job still running ...
2021/09/14 09:53:02 Job still running ...
2021/09/14 09:53:32 Job still running ...
2021/09/14 09:54:02 Job still running ...
2021/09/14 09:54:32 Job still running ...
2021/09/14 09:55:02 Job still running ...
2021/09/14 09:55:32 Job still running ...
2021/09/14 09:56:02 Job still running ...
2021/09/14 09:56:33 Job still running ...
2021/09/14 09:57:03 Job still running ...
2021/09/14 09:57:33 Job still running ...
2021/09/14 09:58:03 Job still running ...
2021/09/14 09:58:33 Job still running ...
2021/09/14 09:59:03 Job still running ...
2021/09/14 09:59:33 Job still running ...
2021/09/14 10:00:03 Job still running ...
2021/09/14 10:00:33 Job still running ...
2021/09/14 10:01:03 Job still running ...
2021/09/14 10:01:33 Job still running ...
2021/09/14 10:02:03 Job still running ...
2021/09/14 10:02:33 Job still running ...
2021/09/14 10:03:03 Failed to execute job: job 2021-09-14_01_59_55-3735807704039188327 failed
panic: Failed to execute job: job 2021-09-14_01_59_55-3735807704039188327 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112b108, 0xc000120000, 0x101d277, 0x19, 0xc0002c7e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 3m 43s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/tgsc72x3232rq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#268
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/268/display/redirect>
Changes:
------------------------------------------
[...truncated 26.14 KB...]
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:go:coder:cogbklist:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.34.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/09/13 08:59:56 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1631523595750863426/model
2021/09/13 08:59:56 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-cogbk-1-0913065621"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.34.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631523595750863426/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631523595750863426/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0913065621",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/13 08:59:57 Submitted job: 2021-09-13_01_59_56-6552627534421562676
2021/09/13 08:59:57 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-13_01_59_56-6552627534421562676?project=apache-beam-testing
2021/09/13 08:59:57 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-13_01_59_56-6552627534421562676
2021/09/13 08:59:57 Job state: JOB_STATE_PENDING ...
2021/09/13 09:00:27 Failed to execute job: job 2021-09-13_01_59_56-6552627534421562676 failed
panic: Failed to execute job: job 2021-09-13_01_59_56-6552627534421562676 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112b108, 0xc00003e0b0, 0x101d277, 0x19, 0xc0002bbe80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 6s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/ax2bpugic3ypk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#267
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/267/display/redirect>
Changes:
------------------------------------------
[...truncated 29.77 KB...]
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631437198558191551/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631437198558191551/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0912065631",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/12 09:00:00 Submitted job: 2021-09-12_01_59_59-2131278320696610478
2021/09/12 09:00:00 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-12_01_59_59-2131278320696610478?project=apache-beam-testing
2021/09/12 09:00:00 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-12_01_59_59-2131278320696610478
2021/09/12 09:00:00 Job state: JOB_STATE_PENDING ...
2021/09/12 09:00:30 Job still running ...
2021/09/12 09:01:00 Job still running ...
2021/09/12 09:01:30 Job still running ...
2021/09/12 09:02:00 Job still running ...
2021/09/12 09:02:30 Job still running ...
2021/09/12 09:03:00 Job still running ...
2021/09/12 09:03:30 Job still running ...
2021/09/12 09:04:00 Job still running ...
2021/09/12 09:04:30 Job still running ...
2021/09/12 09:05:01 Job still running ...
2021/09/12 09:05:31 Job still running ...
2021/09/12 09:06:01 Job still running ...
2021/09/12 09:06:31 Job still running ...
2021/09/12 09:07:01 Job still running ...
2021/09/12 09:07:31 Job still running ...
2021/09/12 09:08:01 Job still running ...
2021/09/12 09:08:31 Job still running ...
2021/09/12 09:09:01 Job still running ...
2021/09/12 09:09:31 Job still running ...
2021/09/12 09:10:01 Job still running ...
2021/09/12 09:10:31 Job still running ...
2021/09/12 09:11:01 Job still running ...
2021/09/12 09:11:31 Job still running ...
2021/09/12 09:12:01 Job still running ...
2021/09/12 09:12:31 Job still running ...
2021/09/12 09:13:01 Job still running ...
2021/09/12 09:13:31 Job still running ...
2021/09/12 09:14:02 Job still running ...
2021/09/12 09:14:32 Job still running ...
2021/09/12 09:15:02 Job still running ...
2021/09/12 09:15:32 Job still running ...
2021/09/12 09:16:02 Job still running ...
2021/09/12 09:16:32 Job still running ...
2021/09/12 09:17:02 Job still running ...
2021/09/12 09:17:32 Job still running ...
2021/09/12 09:18:02 Job still running ...
2021/09/12 09:18:32 Job still running ...
2021/09/12 09:19:02 Job still running ...
2021/09/12 09:19:32 Job still running ...
2021/09/12 09:20:02 Job still running ...
2021/09/12 09:20:32 Job still running ...
2021/09/12 09:21:02 Job still running ...
2021/09/12 09:21:32 Job still running ...
2021/09/12 09:22:02 Job still running ...
2021/09/12 09:22:32 Job still running ...
2021/09/12 09:23:03 Job still running ...
2021/09/12 09:23:33 Job still running ...
2021/09/12 09:24:03 Job still running ...
2021/09/12 09:24:33 Job still running ...
2021/09/12 09:25:03 Job still running ...
2021/09/12 09:25:33 Job still running ...
2021/09/12 09:26:03 Job still running ...
2021/09/12 09:26:33 Job still running ...
2021/09/12 09:27:03 Job still running ...
2021/09/12 09:27:33 Job still running ...
2021/09/12 09:28:03 Job still running ...
2021/09/12 09:28:33 Job still running ...
2021/09/12 09:29:04 Job still running ...
2021/09/12 09:29:34 Job still running ...
2021/09/12 09:30:04 Job still running ...
2021/09/12 09:30:34 Job still running ...
2021/09/12 09:31:04 Job still running ...
2021/09/12 09:31:34 Job still running ...
2021/09/12 09:32:04 Job still running ...
2021/09/12 09:32:34 Job still running ...
2021/09/12 09:33:04 Job still running ...
2021/09/12 09:33:34 Job still running ...
2021/09/12 09:34:04 Job still running ...
2021/09/12 09:34:34 Job still running ...
2021/09/12 09:35:04 Job still running ...
2021/09/12 09:35:34 Job still running ...
2021/09/12 09:36:04 Job still running ...
2021/09/12 09:36:34 Job still running ...
2021/09/12 09:37:04 Job still running ...
2021/09/12 09:37:34 Job still running ...
2021/09/12 09:38:05 Job still running ...
2021/09/12 09:38:35 Job still running ...
2021/09/12 09:39:05 Job still running ...
2021/09/12 09:39:35 Job still running ...
2021/09/12 09:40:05 Job still running ...
2021/09/12 09:40:35 Job still running ...
2021/09/12 09:41:05 Job still running ...
2021/09/12 09:41:35 Job still running ...
2021/09/12 09:42:05 Job still running ...
2021/09/12 09:42:35 Job still running ...
2021/09/12 09:43:05 Job still running ...
2021/09/12 09:43:35 Job still running ...
2021/09/12 09:44:05 Job still running ...
2021/09/12 09:44:35 Job still running ...
2021/09/12 09:45:05 Job still running ...
2021/09/12 09:45:35 Job still running ...
2021/09/12 09:46:05 Job still running ...
2021/09/12 09:46:36 Job still running ...
2021/09/12 09:47:06 Job still running ...
2021/09/12 09:47:36 Job still running ...
2021/09/12 09:48:06 Job still running ...
2021/09/12 09:48:36 Job still running ...
2021/09/12 09:49:06 Job still running ...
2021/09/12 09:49:36 Job still running ...
2021/09/12 09:50:06 Job still running ...
2021/09/12 09:50:36 Job still running ...
2021/09/12 09:51:06 Job still running ...
2021/09/12 09:51:36 Job still running ...
2021/09/12 09:52:06 Job still running ...
2021/09/12 09:52:36 Job still running ...
2021/09/12 09:53:06 Job still running ...
2021/09/12 09:53:36 Job still running ...
2021/09/12 09:54:06 Job still running ...
2021/09/12 09:54:36 Job still running ...
2021/09/12 09:55:07 Job still running ...
2021/09/12 09:55:37 Job still running ...
2021/09/12 09:56:07 Job still running ...
2021/09/12 09:56:37 Job still running ...
2021/09/12 09:57:07 Job still running ...
2021/09/12 09:57:37 Job still running ...
2021/09/12 09:58:07 Job still running ...
2021/09/12 09:58:37 Job still running ...
2021/09/12 09:59:07 Job still running ...
2021/09/12 09:59:37 Job still running ...
2021/09/12 10:00:07 Job still running ...
2021/09/12 10:00:37 Job still running ...
2021/09/12 10:01:07 Job still running ...
2021/09/12 10:01:37 Job still running ...
2021/09/12 10:02:07 Job still running ...
2021/09/12 10:02:37 Job still running ...
2021/09/12 10:03:07 Failed to execute job: job 2021-09-12_01_59_59-2131278320696610478 failed
panic: Failed to execute job: job 2021-09-12_01_59_59-2131278320696610478 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112b108, 0xc000120000, 0x101d277, 0x19, 0xc00033fe80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 3m 45s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/hcfpiyoa6pfh6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#266
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/266/display/redirect?page=changes>
Changes:
[noreply] Register MapCoder, some comments/cleanup. (#15471)
[noreply] [BEAM-12588] Multimap user state proto changes (#15473)
[noreply] Added type annotations to some combiners missing it. (#15414)
[noreply] [BEAM-12634] JmsIO auto scaling feature (#15464)
[noreply] [BEAM-12662] Get Flink version from cluster. (#15223)
[noreply] Port changes from Pub/Sub Lite to beam (#15418)
[heejong] [BEAM-12805] Fix XLang CombinePerKey test by explicitly assigning the
[BenWhitehead] [BEAM-8376] Google Cloud Firestore Connector - Add handling for
[noreply] Decreasing peak memory usage for beam.TupleCombineFn (#15494)
[noreply] [BEAM-12802] Add support for prefetch through data layers down through
[noreply] [BEAM-11097] Add implementation of side input cache (#15483)
------------------------------------------
[...truncated 29.77 KB...]
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631350795484281023/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631350795484281023/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0911065620",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/11 08:59:56 Submitted job: 2021-09-11_01_59_55-17419972550253681005
2021/09/11 08:59:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-11_01_59_55-17419972550253681005?project=apache-beam-testing
2021/09/11 08:59:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-11_01_59_55-17419972550253681005
2021/09/11 08:59:56 Job state: JOB_STATE_PENDING ...
2021/09/11 09:00:26 Job still running ...
2021/09/11 09:00:56 Job still running ...
2021/09/11 09:01:26 Job still running ...
2021/09/11 09:01:56 Job still running ...
2021/09/11 09:02:27 Job still running ...
2021/09/11 09:02:57 Job still running ...
2021/09/11 09:03:27 Job still running ...
2021/09/11 09:03:57 Job still running ...
2021/09/11 09:04:27 Job still running ...
2021/09/11 09:04:57 Job still running ...
2021/09/11 09:05:27 Job still running ...
2021/09/11 09:05:57 Job still running ...
2021/09/11 09:06:27 Job still running ...
2021/09/11 09:06:57 Job still running ...
2021/09/11 09:07:27 Job still running ...
2021/09/11 09:07:57 Job still running ...
2021/09/11 09:08:27 Job still running ...
2021/09/11 09:08:57 Job still running ...
2021/09/11 09:09:27 Job still running ...
2021/09/11 09:09:57 Job still running ...
2021/09/11 09:10:27 Job still running ...
2021/09/11 09:10:57 Job still running ...
2021/09/11 09:11:27 Job still running ...
2021/09/11 09:11:57 Job still running ...
2021/09/11 09:12:27 Job still running ...
2021/09/11 09:12:57 Job still running ...
2021/09/11 09:13:27 Job still running ...
2021/09/11 09:13:57 Job still running ...
2021/09/11 09:14:27 Job still running ...
2021/09/11 09:14:57 Job still running ...
2021/09/11 09:15:27 Job still running ...
2021/09/11 09:15:58 Job still running ...
2021/09/11 09:16:28 Job still running ...
2021/09/11 09:16:58 Job still running ...
2021/09/11 09:17:28 Job still running ...
2021/09/11 09:17:58 Job still running ...
2021/09/11 09:18:28 Job still running ...
2021/09/11 09:18:58 Job still running ...
2021/09/11 09:19:28 Job still running ...
2021/09/11 09:19:58 Job still running ...
2021/09/11 09:20:28 Job still running ...
2021/09/11 09:20:58 Job still running ...
2021/09/11 09:21:28 Job still running ...
2021/09/11 09:21:58 Job still running ...
2021/09/11 09:22:28 Job still running ...
2021/09/11 09:22:58 Job still running ...
2021/09/11 09:23:28 Job still running ...
2021/09/11 09:23:58 Job still running ...
2021/09/11 09:24:28 Job still running ...
2021/09/11 09:24:58 Job still running ...
2021/09/11 09:25:28 Job still running ...
2021/09/11 09:25:58 Job still running ...
2021/09/11 09:26:28 Job still running ...
2021/09/11 09:26:58 Job still running ...
2021/09/11 09:27:28 Job still running ...
2021/09/11 09:27:58 Job still running ...
2021/09/11 09:28:29 Job still running ...
2021/09/11 09:28:59 Job still running ...
2021/09/11 09:29:29 Job still running ...
2021/09/11 09:29:59 Job still running ...
2021/09/11 09:30:29 Job still running ...
2021/09/11 09:30:59 Job still running ...
2021/09/11 09:31:29 Job still running ...
2021/09/11 09:31:59 Job still running ...
2021/09/11 09:32:29 Job still running ...
2021/09/11 09:32:59 Job still running ...
2021/09/11 09:33:29 Job still running ...
2021/09/11 09:33:59 Job still running ...
2021/09/11 09:34:29 Job still running ...
2021/09/11 09:34:59 Job still running ...
2021/09/11 09:35:29 Job still running ...
2021/09/11 09:35:59 Job still running ...
2021/09/11 09:36:29 Job still running ...
2021/09/11 09:36:59 Job still running ...
2021/09/11 09:37:29 Job still running ...
2021/09/11 09:37:59 Job still running ...
2021/09/11 09:38:29 Job still running ...
2021/09/11 09:39:00 Job still running ...
2021/09/11 09:39:30 Job still running ...
2021/09/11 09:40:00 Job still running ...
2021/09/11 09:40:30 Job still running ...
2021/09/11 09:41:00 Job still running ...
2021/09/11 09:41:30 Job still running ...
2021/09/11 09:42:00 Job still running ...
2021/09/11 09:42:30 Job still running ...
2021/09/11 09:43:00 Job still running ...
2021/09/11 09:43:30 Job still running ...
2021/09/11 09:44:00 Job still running ...
2021/09/11 09:44:30 Job still running ...
2021/09/11 09:45:00 Job still running ...
2021/09/11 09:45:30 Job still running ...
2021/09/11 09:46:00 Job still running ...
2021/09/11 09:46:30 Job still running ...
2021/09/11 09:47:00 Job still running ...
2021/09/11 09:47:31 Job still running ...
2021/09/11 09:48:01 Job still running ...
2021/09/11 09:48:31 Job still running ...
2021/09/11 09:49:01 Job still running ...
2021/09/11 09:49:31 Job still running ...
2021/09/11 09:50:01 Job still running ...
2021/09/11 09:50:31 Job still running ...
2021/09/11 09:51:01 Job still running ...
2021/09/11 09:51:31 Job still running ...
2021/09/11 09:52:01 Job still running ...
2021/09/11 09:52:31 Job still running ...
2021/09/11 09:53:01 Job still running ...
2021/09/11 09:53:31 Job still running ...
2021/09/11 09:54:01 Job still running ...
2021/09/11 09:54:31 Job still running ...
2021/09/11 09:55:01 Job still running ...
2021/09/11 09:55:31 Job still running ...
2021/09/11 09:56:01 Job still running ...
2021/09/11 09:56:31 Job still running ...
2021/09/11 09:57:01 Job still running ...
2021/09/11 09:57:31 Job still running ...
2021/09/11 09:58:02 Job still running ...
2021/09/11 09:58:32 Job still running ...
2021/09/11 09:59:02 Job still running ...
2021/09/11 09:59:32 Job still running ...
2021/09/11 10:00:03 Job still running ...
2021/09/11 10:00:33 Job still running ...
2021/09/11 10:01:03 Job still running ...
2021/09/11 10:01:33 Job still running ...
2021/09/11 10:02:03 Job still running ...
2021/09/11 10:02:33 Job still running ...
2021/09/11 10:03:03 Failed to execute job: job 2021-09-11_01_59_55-17419972550253681005 failed
panic: Failed to execute job: job 2021-09-11_01_59_55-17419972550253681005 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112b108, 0xc000120000, 0x101d277, 0x19, 0xc0002f9e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 3m 42s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/3ynp4znr3w2x2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#265
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/265/display/redirect?page=changes>
Changes:
[ruwan.lambrichts] Clarify additional_bq_parameters argument
[kawaigin] [BEAM-10708] Support streaming cache in beam_sql magic
[noreply] Fix broken 'differences from pandas' link
[noreply] Added GroupBy row in Aggregation table.
[Luke Cwik] [BEAM-12769] Fix typo in test class name, CLass -> Class
[Etienne Chauchot] [BEAM-5172] Temporary ignore testSplit and testSizes tests waiting for a
[samuelw] [BEAM-12740] Remove matching to filter files when renaming gcs files in
[noreply] [BEAM-3304] Helper functions for triggers (#15430)
[esert] Bump a throttling counter on BigQueryRead retries due to
[noreply] [BEAM-5097] Increment counter for "small words" in go SDK example
------------------------------------------
[...truncated 29.81 KB...]
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631264520244777292/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631264520244777292/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0910065622",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/10 09:02:02 Submitted job: 2021-09-10_02_02_01-11738324404196107381
2021/09/10 09:02:02 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-10_02_02_01-11738324404196107381?project=apache-beam-testing
2021/09/10 09:02:02 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-10_02_02_01-11738324404196107381
2021/09/10 09:02:02 Job state: JOB_STATE_PENDING ...
2021/09/10 09:02:32 Job still running ...
2021/09/10 09:03:02 Job still running ...
2021/09/10 09:03:32 Job still running ...
2021/09/10 09:04:02 Job still running ...
2021/09/10 09:04:32 Job still running ...
2021/09/10 09:05:02 Job still running ...
2021/09/10 09:05:32 Job still running ...
2021/09/10 09:06:02 Job still running ...
2021/09/10 09:06:32 Job still running ...
2021/09/10 09:07:02 Job still running ...
2021/09/10 09:07:32 Job still running ...
2021/09/10 09:08:02 Job still running ...
2021/09/10 09:08:32 Job still running ...
2021/09/10 09:09:02 Job still running ...
2021/09/10 09:09:33 Job still running ...
2021/09/10 09:10:03 Job still running ...
2021/09/10 09:10:33 Job still running ...
2021/09/10 09:11:03 Job still running ...
2021/09/10 09:11:33 Job still running ...
2021/09/10 09:12:03 Job still running ...
2021/09/10 09:12:33 Job still running ...
2021/09/10 09:13:03 Job still running ...
2021/09/10 09:13:33 Job still running ...
2021/09/10 09:14:03 Job still running ...
2021/09/10 09:14:33 Job still running ...
2021/09/10 09:15:03 Job still running ...
2021/09/10 09:15:33 Job still running ...
2021/09/10 09:16:03 Job still running ...
2021/09/10 09:16:33 Job still running ...
2021/09/10 09:17:03 Job still running ...
2021/09/10 09:17:33 Job still running ...
2021/09/10 09:18:03 Job still running ...
2021/09/10 09:18:33 Job still running ...
2021/09/10 09:19:03 Job still running ...
2021/09/10 09:19:33 Job still running ...
2021/09/10 09:20:03 Job still running ...
2021/09/10 09:20:33 Job still running ...
2021/09/10 09:21:03 Job still running ...
2021/09/10 09:21:33 Job still running ...
2021/09/10 09:22:03 Job still running ...
2021/09/10 09:22:34 Job still running ...
2021/09/10 09:23:04 Job still running ...
2021/09/10 09:23:34 Job still running ...
2021/09/10 09:24:04 Job still running ...
2021/09/10 09:24:34 Job still running ...
2021/09/10 09:25:04 Job still running ...
2021/09/10 09:25:34 Job still running ...
2021/09/10 09:26:04 Job still running ...
2021/09/10 09:26:34 Job still running ...
2021/09/10 09:27:04 Job still running ...
2021/09/10 09:27:34 Job still running ...
2021/09/10 09:28:04 Job still running ...
2021/09/10 09:28:34 Job still running ...
2021/09/10 09:29:04 Job still running ...
2021/09/10 09:29:34 Job still running ...
2021/09/10 09:30:04 Job still running ...
2021/09/10 09:30:34 Job still running ...
2021/09/10 09:31:05 Job still running ...
2021/09/10 09:31:35 Job still running ...
2021/09/10 09:32:05 Job still running ...
2021/09/10 09:32:35 Job still running ...
2021/09/10 09:33:05 Job still running ...
2021/09/10 09:33:35 Job still running ...
2021/09/10 09:34:05 Job still running ...
2021/09/10 09:34:35 Job still running ...
2021/09/10 09:35:05 Job still running ...
2021/09/10 09:35:35 Job still running ...
2021/09/10 09:36:05 Job still running ...
2021/09/10 09:36:35 Job still running ...
2021/09/10 09:37:05 Job still running ...
2021/09/10 09:37:35 Job still running ...
2021/09/10 09:38:05 Job still running ...
2021/09/10 09:38:35 Job still running ...
2021/09/10 09:39:05 Job still running ...
2021/09/10 09:39:35 Job still running ...
2021/09/10 09:40:05 Job still running ...
2021/09/10 09:40:35 Job still running ...
2021/09/10 09:41:05 Job still running ...
2021/09/10 09:41:36 Job still running ...
2021/09/10 09:42:06 Job still running ...
2021/09/10 09:42:36 Job still running ...
2021/09/10 09:43:06 Job still running ...
2021/09/10 09:43:36 Job still running ...
2021/09/10 09:44:06 Job still running ...
2021/09/10 09:44:36 Job still running ...
2021/09/10 09:45:06 Job still running ...
2021/09/10 09:45:36 Job still running ...
2021/09/10 09:46:06 Job still running ...
2021/09/10 09:46:36 Job still running ...
2021/09/10 09:47:06 Job still running ...
2021/09/10 09:47:36 Job still running ...
2021/09/10 09:48:07 Job still running ...
2021/09/10 09:48:37 Job still running ...
2021/09/10 09:49:07 Job still running ...
2021/09/10 09:49:37 Job still running ...
2021/09/10 09:50:07 Job still running ...
2021/09/10 09:50:37 Job still running ...
2021/09/10 09:51:07 Job still running ...
2021/09/10 09:51:37 Job still running ...
2021/09/10 09:52:07 Job still running ...
2021/09/10 09:52:37 Job still running ...
2021/09/10 09:53:07 Job still running ...
2021/09/10 09:53:37 Job still running ...
2021/09/10 09:54:07 Job still running ...
2021/09/10 09:54:38 Job still running ...
2021/09/10 09:55:08 Job still running ...
2021/09/10 09:55:38 Job still running ...
2021/09/10 09:56:08 Job still running ...
2021/09/10 09:56:38 Job still running ...
2021/09/10 09:57:08 Job still running ...
2021/09/10 09:57:38 Job still running ...
2021/09/10 09:58:08 Job still running ...
2021/09/10 09:58:38 Job still running ...
2021/09/10 09:59:08 Job still running ...
2021/09/10 09:59:38 Job still running ...
2021/09/10 10:00:08 Job still running ...
2021/09/10 10:00:39 Job still running ...
2021/09/10 10:01:09 Job still running ...
2021/09/10 10:01:39 Job still running ...
2021/09/10 10:02:09 Job still running ...
2021/09/10 10:02:39 Job still running ...
2021/09/10 10:03:09 Job still running ...
2021/09/10 10:03:39 Job still running ...
2021/09/10 10:04:09 Job still running ...
2021/09/10 10:04:39 Job still running ...
2021/09/10 10:05:10 Failed to execute job: job 2021-09-10_02_02_01-11738324404196107381 failed
panic: Failed to execute job: job 2021-09-10_02_02_01-11738324404196107381 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x112b108, 0xc00003e0b0, 0x101d277, 0x19, 0xc000221e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 5m 19s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/z7pcodfiepxlo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#264
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/264/display/redirect?page=changes>
Changes:
[suztomo] [BEAM-11205] Upgrading the Libraries BOM to v22
[randomstep] [BEAM-12708] Bump arrow-memory-netty
[Etienne Chauchot] [BEAM-12153] implement GroupByKey with CombinePerKey with Concatenate
[Etienne Chauchot] [BEAM-11023] Increase memory in SS Validates runner tests to avoid OOM
[vincent.marquez] [BEAM-9008] adds CassandraIO.readAll
[Etienne Chauchot] [BEAM-12727] extract Concatenate CombineFn to runner-core module to
[noreply] Add display data for JdbcIO.write (#15460)
[noreply] Merge pull request #15480: [BEAM-12356] Make sure DatasetService is
[noreply] [BEAM-11981] Java Bigtable - Implement IO Request Count metrics (#15342)
[noreply] [BEAM-12834] Improve Go SDK cross-language documentation and API.
------------------------------------------
[...truncated 29.80 KB...]
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631178149005716091/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631178149005716091/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0909065615",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/09 09:02:30 Submitted job: 2021-09-09_02_02_29-13158530707299919580
2021/09/09 09:02:30 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-09_02_02_29-13158530707299919580?project=apache-beam-testing
2021/09/09 09:02:30 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-09_02_02_29-13158530707299919580
2021/09/09 09:02:30 Job state: JOB_STATE_PENDING ...
2021/09/09 09:03:00 Job still running ...
2021/09/09 09:03:30 Job still running ...
2021/09/09 09:04:00 Job still running ...
2021/09/09 09:04:30 Job still running ...
2021/09/09 09:05:01 Job still running ...
2021/09/09 09:05:31 Job still running ...
2021/09/09 09:06:01 Job still running ...
2021/09/09 09:06:31 Job still running ...
2021/09/09 09:07:01 Job still running ...
2021/09/09 09:07:31 Job still running ...
2021/09/09 09:08:01 Job still running ...
2021/09/09 09:08:31 Job still running ...
2021/09/09 09:09:01 Job still running ...
2021/09/09 09:09:31 Job still running ...
2021/09/09 09:10:01 Job still running ...
2021/09/09 09:10:31 Job still running ...
2021/09/09 09:11:01 Job still running ...
2021/09/09 09:11:31 Job still running ...
2021/09/09 09:12:01 Job still running ...
2021/09/09 09:12:31 Job still running ...
2021/09/09 09:13:01 Job still running ...
2021/09/09 09:13:32 Job still running ...
2021/09/09 09:14:02 Job still running ...
2021/09/09 09:14:32 Job still running ...
2021/09/09 09:15:02 Job still running ...
2021/09/09 09:15:32 Job still running ...
2021/09/09 09:16:02 Job still running ...
2021/09/09 09:16:32 Job still running ...
2021/09/09 09:17:02 Job still running ...
2021/09/09 09:17:32 Job still running ...
2021/09/09 09:18:02 Job still running ...
2021/09/09 09:18:32 Job still running ...
2021/09/09 09:19:02 Job still running ...
2021/09/09 09:19:32 Job still running ...
2021/09/09 09:20:02 Job still running ...
2021/09/09 09:20:32 Job still running ...
2021/09/09 09:21:02 Job still running ...
2021/09/09 09:21:32 Job still running ...
2021/09/09 09:22:02 Job still running ...
2021/09/09 09:22:32 Job still running ...
2021/09/09 09:23:02 Job still running ...
2021/09/09 09:23:32 Job still running ...
2021/09/09 09:24:03 Job still running ...
2021/09/09 09:24:33 Job still running ...
2021/09/09 09:25:03 Job still running ...
2021/09/09 09:25:33 Job still running ...
2021/09/09 09:26:03 Job still running ...
2021/09/09 09:26:33 Job still running ...
2021/09/09 09:27:03 Job still running ...
2021/09/09 09:27:33 Job still running ...
2021/09/09 09:28:03 Job still running ...
2021/09/09 09:28:33 Job still running ...
2021/09/09 09:29:03 Job still running ...
2021/09/09 09:29:33 Job still running ...
2021/09/09 09:30:03 Job still running ...
2021/09/09 09:30:33 Job still running ...
2021/09/09 09:31:03 Job still running ...
2021/09/09 09:31:33 Job still running ...
2021/09/09 09:32:03 Job still running ...
2021/09/09 09:32:33 Job still running ...
2021/09/09 09:33:04 Job still running ...
2021/09/09 09:33:34 Job still running ...
2021/09/09 09:34:04 Job still running ...
2021/09/09 09:34:34 Job still running ...
2021/09/09 09:35:04 Job still running ...
2021/09/09 09:35:34 Job still running ...
2021/09/09 09:36:04 Job still running ...
2021/09/09 09:36:34 Job still running ...
2021/09/09 09:37:04 Job still running ...
2021/09/09 09:37:34 Job still running ...
2021/09/09 09:38:04 Job still running ...
2021/09/09 09:38:34 Job still running ...
2021/09/09 09:39:04 Job still running ...
2021/09/09 09:39:34 Job still running ...
2021/09/09 09:40:04 Job still running ...
2021/09/09 09:40:34 Job still running ...
2021/09/09 09:41:04 Job still running ...
2021/09/09 09:41:34 Job still running ...
2021/09/09 09:42:04 Job still running ...
2021/09/09 09:42:34 Job still running ...
2021/09/09 09:43:04 Job still running ...
2021/09/09 09:43:34 Job still running ...
2021/09/09 09:44:05 Job still running ...
2021/09/09 09:44:35 Job still running ...
2021/09/09 09:45:05 Job still running ...
2021/09/09 09:45:35 Job still running ...
2021/09/09 09:46:05 Job still running ...
2021/09/09 09:46:35 Job still running ...
2021/09/09 09:47:05 Job still running ...
2021/09/09 09:47:35 Job still running ...
2021/09/09 09:48:05 Job still running ...
2021/09/09 09:48:35 Job still running ...
2021/09/09 09:49:05 Job still running ...
2021/09/09 09:49:35 Job still running ...
2021/09/09 09:50:05 Job still running ...
2021/09/09 09:50:35 Job still running ...
2021/09/09 09:51:05 Job still running ...
2021/09/09 09:51:35 Job still running ...
2021/09/09 09:52:06 Job still running ...
2021/09/09 09:52:36 Job still running ...
2021/09/09 09:53:06 Job still running ...
2021/09/09 09:53:36 Job still running ...
2021/09/09 09:54:06 Job still running ...
2021/09/09 09:54:36 Job still running ...
2021/09/09 09:55:06 Job still running ...
2021/09/09 09:55:36 Job still running ...
2021/09/09 09:56:06 Job still running ...
2021/09/09 09:56:36 Job still running ...
2021/09/09 09:57:06 Job still running ...
2021/09/09 09:57:36 Job still running ...
2021/09/09 09:58:06 Job still running ...
2021/09/09 09:58:36 Job still running ...
2021/09/09 09:59:06 Job still running ...
2021/09/09 09:59:36 Job still running ...
2021/09/09 10:00:07 Job still running ...
2021/09/09 10:00:37 Job still running ...
2021/09/09 10:01:07 Job still running ...
2021/09/09 10:01:37 Job still running ...
2021/09/09 10:02:07 Job still running ...
2021/09/09 10:02:37 Job still running ...
2021/09/09 10:03:07 Job still running ...
2021/09/09 10:03:37 Job still running ...
2021/09/09 10:04:07 Job still running ...
2021/09/09 10:04:37 Job still running ...
2021/09/09 10:05:07 Job still running ...
2021/09/09 10:05:37 Job still running ...
2021/09/09 10:06:07 Failed to execute job: job 2021-09-09_02_02_29-13158530707299919580 failed
panic: Failed to execute job: job 2021-09-09_02_02_29-13158530707299919580 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1129de8, 0xc00003e0b0, 0x101c117, 0x19, 0xc000389e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 5m 58s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/5kusq57xs4cpc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#263
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/263/display/redirect?page=changes>
Changes:
[heejong] [BEAM-12838] Update artifact local path for DataflowRunner Java
[kwu] [BEAM-12828] Convert UseTestStream tests to use Long instead of Integer
[kwu] Apply SpotlessJava
[kwu] Apply SpotlessJava
[aydar.zaynutdinov] [BEAM-3385] Add requires about `equals()` and `hashMethod()` to
[aydar.zaynutdinov] [BEAM-3385] Changes regarding spotlessApply task
[noreply] Update runners/flink/job-server/flink_job_server.gradle
[Valentyn Tymofieiev] Disable Kafka perf tests.
[heejong] separate into resolveArtifacts method
[heejong] add test
[aydar.zaynutdinov] [BEAM-3385] wrap up equals() and hashCode() methods into links
[Andrew Pilloud] [BEAM-12850] Calcite drops empty Calc now
[Andrew Pilloud] [BEAM-12853] VALUES produces a UNION, window can't be set afterwards
[Andrew Pilloud] [BEAM-12852] Revert BigTable changes, just cast to bigint
[heejong] update
[heejong] fix formatting
[Andrew Pilloud] [BEAM-12851] Map output table names
[Luke Cwik] [BEAM-12802] Define a prefetchable iterator and iterable and utility
------------------------------------------
[...truncated 29.79 KB...]
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631091596374511264/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631091596374511264/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0908065645",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/08 08:59:57 Submitted job: 2021-09-08_01_59_56-2811825100794416333
2021/09/08 08:59:57 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-08_01_59_56-2811825100794416333?project=apache-beam-testing
2021/09/08 08:59:57 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-08_01_59_56-2811825100794416333
2021/09/08 08:59:57 Job state: JOB_STATE_PENDING ...
2021/09/08 09:00:28 Job still running ...
2021/09/08 09:00:58 Job still running ...
2021/09/08 09:01:28 Job still running ...
2021/09/08 09:01:58 Job still running ...
2021/09/08 09:02:28 Job still running ...
2021/09/08 09:02:58 Job still running ...
2021/09/08 09:03:28 Job still running ...
2021/09/08 09:03:59 Job still running ...
2021/09/08 09:04:29 Job still running ...
2021/09/08 09:04:59 Job still running ...
2021/09/08 09:05:29 Job still running ...
2021/09/08 09:05:59 Job still running ...
2021/09/08 09:06:29 Job still running ...
2021/09/08 09:06:59 Job still running ...
2021/09/08 09:07:29 Job still running ...
2021/09/08 09:07:59 Job still running ...
2021/09/08 09:08:29 Job still running ...
2021/09/08 09:08:59 Job still running ...
2021/09/08 09:09:29 Job still running ...
2021/09/08 09:09:59 Job still running ...
2021/09/08 09:10:29 Job still running ...
2021/09/08 09:10:59 Job still running ...
2021/09/08 09:11:29 Job still running ...
2021/09/08 09:11:59 Job still running ...
2021/09/08 09:12:29 Job still running ...
2021/09/08 09:12:59 Job still running ...
2021/09/08 09:13:29 Job still running ...
2021/09/08 09:13:59 Job still running ...
2021/09/08 09:14:29 Job still running ...
2021/09/08 09:14:59 Job still running ...
2021/09/08 09:15:30 Job still running ...
2021/09/08 09:16:00 Job still running ...
2021/09/08 09:16:30 Job still running ...
2021/09/08 09:17:00 Job still running ...
2021/09/08 09:17:30 Job still running ...
2021/09/08 09:18:00 Job still running ...
2021/09/08 09:18:30 Job still running ...
2021/09/08 09:19:00 Job still running ...
2021/09/08 09:19:30 Job still running ...
2021/09/08 09:20:00 Job still running ...
2021/09/08 09:20:30 Job still running ...
2021/09/08 09:21:00 Job still running ...
2021/09/08 09:21:30 Job still running ...
2021/09/08 09:22:00 Job still running ...
2021/09/08 09:22:30 Job still running ...
2021/09/08 09:23:00 Job still running ...
2021/09/08 09:23:30 Job still running ...
2021/09/08 09:24:00 Job still running ...
2021/09/08 09:24:30 Job still running ...
2021/09/08 09:25:01 Job still running ...
2021/09/08 09:25:31 Job still running ...
2021/09/08 09:26:01 Job still running ...
2021/09/08 09:26:31 Job still running ...
2021/09/08 09:27:01 Job still running ...
2021/09/08 09:27:31 Job still running ...
2021/09/08 09:28:01 Job still running ...
2021/09/08 09:28:31 Job still running ...
2021/09/08 09:29:01 Job still running ...
2021/09/08 09:29:31 Job still running ...
2021/09/08 09:30:01 Job still running ...
2021/09/08 09:30:31 Job still running ...
2021/09/08 09:31:01 Job still running ...
2021/09/08 09:31:31 Job still running ...
2021/09/08 09:32:01 Job still running ...
2021/09/08 09:32:31 Job still running ...
2021/09/08 09:33:01 Job still running ...
2021/09/08 09:33:31 Job still running ...
2021/09/08 09:34:01 Job still running ...
2021/09/08 09:34:31 Job still running ...
2021/09/08 09:35:01 Job still running ...
2021/09/08 09:35:31 Job still running ...
2021/09/08 09:36:01 Job still running ...
2021/09/08 09:36:31 Job still running ...
2021/09/08 09:37:02 Job still running ...
2021/09/08 09:37:32 Job still running ...
2021/09/08 09:38:02 Job still running ...
2021/09/08 09:38:32 Job still running ...
2021/09/08 09:39:02 Job still running ...
2021/09/08 09:39:32 Job still running ...
2021/09/08 09:40:02 Job still running ...
2021/09/08 09:40:32 Job still running ...
2021/09/08 09:41:02 Job still running ...
2021/09/08 09:41:32 Job still running ...
2021/09/08 09:42:02 Job still running ...
2021/09/08 09:42:32 Job still running ...
2021/09/08 09:43:02 Job still running ...
2021/09/08 09:43:32 Job still running ...
2021/09/08 09:44:02 Job still running ...
2021/09/08 09:44:32 Job still running ...
2021/09/08 09:45:02 Job still running ...
2021/09/08 09:45:32 Job still running ...
2021/09/08 09:46:02 Job still running ...
2021/09/08 09:46:32 Job still running ...
2021/09/08 09:47:02 Job still running ...
2021/09/08 09:47:33 Job still running ...
2021/09/08 09:48:03 Job still running ...
2021/09/08 09:48:33 Job still running ...
2021/09/08 09:49:03 Job still running ...
2021/09/08 09:49:33 Job still running ...
2021/09/08 09:50:03 Job still running ...
2021/09/08 09:50:33 Job still running ...
2021/09/08 09:51:03 Job still running ...
2021/09/08 09:51:33 Job still running ...
2021/09/08 09:52:03 Job still running ...
2021/09/08 09:52:33 Job still running ...
2021/09/08 09:53:03 Job still running ...
2021/09/08 09:53:33 Job still running ...
2021/09/08 09:54:03 Job still running ...
2021/09/08 09:54:33 Job still running ...
2021/09/08 09:55:03 Job still running ...
2021/09/08 09:55:33 Job still running ...
2021/09/08 09:56:03 Job still running ...
2021/09/08 09:56:33 Job still running ...
2021/09/08 09:57:03 Job still running ...
2021/09/08 09:57:33 Job still running ...
2021/09/08 09:58:03 Job still running ...
2021/09/08 09:58:33 Job still running ...
2021/09/08 09:59:03 Job still running ...
2021/09/08 09:59:34 Job still running ...
2021/09/08 10:00:04 Job still running ...
2021/09/08 10:00:34 Job still running ...
2021/09/08 10:01:04 Job still running ...
2021/09/08 10:01:34 Job still running ...
2021/09/08 10:02:04 Job still running ...
2021/09/08 10:02:34 Job still running ...
2021/09/08 10:03:04 Job still running ...
2021/09/08 10:03:34 Failed to execute job: job 2021-09-08_01_59_56-2811825100794416333 failed
panic: Failed to execute job: job 2021-09-08_01_59_56-2811825100794416333 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1129de8, 0xc00003e0b0, 0x101c117, 0x19, 0xc000291e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 4m 13s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/4vvhqx4jdjmxq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#262
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/262/display/redirect>
Changes:
------------------------------------------
[...truncated 29.89 KB...]
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631005192444608284/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1631005192444608284/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0907065621",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/07 08:59:53 Submitted job: 2021-09-07_01_59_52-10940669528456358392
2021/09/07 08:59:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-07_01_59_52-10940669528456358392?project=apache-beam-testing
2021/09/07 08:59:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-07_01_59_52-10940669528456358392
2021/09/07 08:59:53 Job state: JOB_STATE_PENDING ...
2021/09/07 09:00:23 Job still running ...
2021/09/07 09:00:53 Job still running ...
2021/09/07 09:01:23 Job still running ...
2021/09/07 09:01:53 Job still running ...
2021/09/07 09:02:23 Job still running ...
2021/09/07 09:02:53 Job still running ...
2021/09/07 09:03:23 Job still running ...
2021/09/07 09:03:54 Job still running ...
2021/09/07 09:04:24 Job still running ...
2021/09/07 09:04:54 Job still running ...
2021/09/07 09:05:24 Job still running ...
2021/09/07 09:05:54 Job still running ...
2021/09/07 09:06:24 Job still running ...
2021/09/07 09:06:54 Job still running ...
2021/09/07 09:07:24 Job still running ...
2021/09/07 09:07:54 Job still running ...
2021/09/07 09:08:24 Job still running ...
2021/09/07 09:08:54 Job still running ...
2021/09/07 09:09:24 Job still running ...
2021/09/07 09:09:54 Job still running ...
2021/09/07 09:10:24 Job still running ...
2021/09/07 09:10:55 Job still running ...
2021/09/07 09:11:25 Job still running ...
2021/09/07 09:11:55 Job still running ...
2021/09/07 09:12:25 Job still running ...
2021/09/07 09:12:56 Job still running ...
2021/09/07 09:13:26 Job still running ...
2021/09/07 09:13:56 Job still running ...
2021/09/07 09:14:26 Job still running ...
2021/09/07 09:14:56 Job still running ...
2021/09/07 09:15:26 Job still running ...
2021/09/07 09:15:56 Job still running ...
2021/09/07 09:16:26 Job still running ...
2021/09/07 09:16:56 Job still running ...
2021/09/07 09:17:26 Job still running ...
2021/09/07 09:17:56 Job still running ...
2021/09/07 09:18:26 Job still running ...
2021/09/07 09:18:56 Job still running ...
2021/09/07 09:19:26 Job still running ...
2021/09/07 09:19:56 Job still running ...
2021/09/07 09:20:26 Job still running ...
2021/09/07 09:20:56 Job still running ...
2021/09/07 09:21:26 Job still running ...
2021/09/07 09:21:56 Job still running ...
2021/09/07 09:22:27 Job still running ...
2021/09/07 09:22:57 Job still running ...
2021/09/07 09:23:27 Job still running ...
2021/09/07 09:23:57 Job still running ...
2021/09/07 09:24:27 Job still running ...
2021/09/07 09:24:57 Job still running ...
2021/09/07 09:25:27 Job still running ...
2021/09/07 09:25:57 Job still running ...
2021/09/07 09:26:27 Job still running ...
2021/09/07 09:26:57 Job still running ...
2021/09/07 09:27:27 Job still running ...
2021/09/07 09:27:57 Job still running ...
2021/09/07 09:28:27 Job still running ...
2021/09/07 09:28:57 Job still running ...
2021/09/07 09:29:27 Job still running ...
2021/09/07 09:29:57 Job still running ...
2021/09/07 09:30:27 Job still running ...
2021/09/07 09:30:58 Job still running ...
2021/09/07 09:31:28 Job still running ...
2021/09/07 09:31:58 Job still running ...
2021/09/07 09:32:28 Job still running ...
2021/09/07 09:32:58 Job still running ...
2021/09/07 09:33:28 Job still running ...
2021/09/07 09:33:58 Job still running ...
2021/09/07 09:34:28 Job still running ...
2021/09/07 09:34:58 Job still running ...
2021/09/07 09:35:29 Job still running ...
2021/09/07 09:35:59 Job still running ...
2021/09/07 09:36:29 Job still running ...
2021/09/07 09:36:59 Job still running ...
2021/09/07 09:37:29 Job still running ...
2021/09/07 09:37:59 Job still running ...
2021/09/07 09:38:29 Job still running ...
2021/09/07 09:38:59 Job still running ...
2021/09/07 09:39:29 Job still running ...
2021/09/07 09:39:59 Job still running ...
2021/09/07 09:40:29 Job still running ...
2021/09/07 09:40:59 Job still running ...
2021/09/07 09:41:29 Job still running ...
2021/09/07 09:41:59 Job still running ...
2021/09/07 09:42:29 Job still running ...
2021/09/07 09:42:59 Job still running ...
2021/09/07 09:43:29 Job still running ...
2021/09/07 09:44:00 Job still running ...
2021/09/07 09:44:30 Job still running ...
2021/09/07 09:45:01 Job still running ...
2021/09/07 09:45:36 Job still running ...
2021/09/07 09:46:06 Job still running ...
2021/09/07 09:46:36 Job still running ...
2021/09/07 09:47:06 Job still running ...
2021/09/07 09:47:37 Job still running ...
2021/09/07 09:48:08 Job still running ...
2021/09/07 09:48:39 Job still running ...
2021/09/07 09:49:09 Job still running ...
2021/09/07 09:49:40 Job still running ...
2021/09/07 09:50:10 Job still running ...
2021/09/07 09:50:40 Job still running ...
2021/09/07 09:51:10 Job still running ...
2021/09/07 09:51:40 Job still running ...
2021/09/07 09:52:10 Job still running ...
2021/09/07 09:52:40 Job still running ...
2021/09/07 09:53:10 Job still running ...
2021/09/07 09:53:40 Job still running ...
2021/09/07 09:54:10 Job still running ...
2021/09/07 09:54:40 Job still running ...
2021/09/07 09:55:10 Job still running ...
2021/09/07 09:55:40 Job still running ...
2021/09/07 09:56:10 Job still running ...
2021/09/07 09:56:40 Job still running ...
2021/09/07 09:57:10 Job still running ...
2021/09/07 09:57:40 Job still running ...
2021/09/07 09:58:10 Job still running ...
2021/09/07 09:58:40 Job still running ...
2021/09/07 09:59:10 Job still running ...
2021/09/07 09:59:40 Job still running ...
2021/09/07 10:00:10 Job still running ...
2021/09/07 10:00:40 Job still running ...
2021/09/07 10:01:10 Job still running ...
2021/09/07 10:01:40 Job still running ...
2021/09/07 10:02:10 Job still running ...
2021/09/07 10:02:40 Job still running ...
2021/09/07 10:03:11 Failed to execute job: job 2021-09-07_01_59_52-10940669528456358392 failed
panic: Failed to execute job: job 2021-09-07_01_59_52-10940669528456358392 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1129de8, 0xc00003e0b0, 0x101c117, 0x19, 0xc000445e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 3m 50s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/y6id7ex2rusk6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#261
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/261/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #14927 from [BEAM-12400] MongoDBIO support for update
------------------------------------------
[...truncated 29.80 KB...]
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1630918791480544145/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1630918791480544145/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0906065616",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/06 08:59:52 Submitted job: 2021-09-06_01_59_52-18287719279172351758
2021/09/06 08:59:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-06_01_59_52-18287719279172351758?project=apache-beam-testing
2021/09/06 08:59:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-06_01_59_52-18287719279172351758
2021/09/06 08:59:52 Job state: JOB_STATE_PENDING ...
2021/09/06 09:00:22 Job still running ...
2021/09/06 09:00:52 Job still running ...
2021/09/06 09:01:22 Job still running ...
2021/09/06 09:01:52 Job still running ...
2021/09/06 09:02:22 Job still running ...
2021/09/06 09:02:53 Job still running ...
2021/09/06 09:03:23 Job still running ...
2021/09/06 09:03:53 Job still running ...
2021/09/06 09:04:23 Job still running ...
2021/09/06 09:04:53 Job still running ...
2021/09/06 09:05:23 Job still running ...
2021/09/06 09:05:53 Job still running ...
2021/09/06 09:06:23 Job still running ...
2021/09/06 09:06:53 Job still running ...
2021/09/06 09:07:23 Job still running ...
2021/09/06 09:07:53 Job still running ...
2021/09/06 09:08:23 Job still running ...
2021/09/06 09:08:53 Job still running ...
2021/09/06 09:09:23 Job still running ...
2021/09/06 09:09:53 Job still running ...
2021/09/06 09:10:23 Job still running ...
2021/09/06 09:10:53 Job still running ...
2021/09/06 09:11:23 Job still running ...
2021/09/06 09:11:53 Job still running ...
2021/09/06 09:12:23 Job still running ...
2021/09/06 09:12:53 Job still running ...
2021/09/06 09:13:24 Job still running ...
2021/09/06 09:13:54 Job still running ...
2021/09/06 09:14:24 Job still running ...
2021/09/06 09:14:54 Job still running ...
2021/09/06 09:15:24 Job still running ...
2021/09/06 09:15:54 Job still running ...
2021/09/06 09:16:24 Job still running ...
2021/09/06 09:16:54 Job still running ...
2021/09/06 09:17:24 Job still running ...
2021/09/06 09:17:54 Job still running ...
2021/09/06 09:18:24 Job still running ...
2021/09/06 09:18:54 Job still running ...
2021/09/06 09:19:24 Job still running ...
2021/09/06 09:19:54 Job still running ...
2021/09/06 09:20:24 Job still running ...
2021/09/06 09:20:54 Job still running ...
2021/09/06 09:21:24 Job still running ...
2021/09/06 09:21:54 Job still running ...
2021/09/06 09:22:24 Job still running ...
2021/09/06 09:22:54 Job still running ...
2021/09/06 09:23:24 Job still running ...
2021/09/06 09:23:54 Job still running ...
2021/09/06 09:24:24 Job still running ...
2021/09/06 09:24:54 Job still running ...
2021/09/06 09:25:24 Job still running ...
2021/09/06 09:25:54 Job still running ...
2021/09/06 09:26:24 Job still running ...
2021/09/06 09:26:55 Job still running ...
2021/09/06 09:27:25 Job still running ...
2021/09/06 09:27:55 Job still running ...
2021/09/06 09:28:25 Job still running ...
2021/09/06 09:28:55 Job still running ...
2021/09/06 09:29:25 Job still running ...
2021/09/06 09:29:55 Job still running ...
2021/09/06 09:30:25 Job still running ...
2021/09/06 09:30:55 Job still running ...
2021/09/06 09:31:25 Job still running ...
2021/09/06 09:31:55 Job still running ...
2021/09/06 09:32:25 Job still running ...
2021/09/06 09:32:55 Job still running ...
2021/09/06 09:33:25 Job still running ...
2021/09/06 09:33:55 Job still running ...
2021/09/06 09:34:25 Job still running ...
2021/09/06 09:34:55 Job still running ...
2021/09/06 09:35:25 Job still running ...
2021/09/06 09:35:55 Job still running ...
2021/09/06 09:36:25 Job still running ...
2021/09/06 09:36:55 Job still running ...
2021/09/06 09:37:25 Job still running ...
2021/09/06 09:37:55 Job still running ...
2021/09/06 09:38:25 Job still running ...
2021/09/06 09:38:55 Job still running ...
2021/09/06 09:39:26 Job still running ...
2021/09/06 09:39:56 Job still running ...
2021/09/06 09:40:26 Job still running ...
2021/09/06 09:40:56 Job still running ...
2021/09/06 09:41:26 Job still running ...
2021/09/06 09:41:56 Job still running ...
2021/09/06 09:42:26 Job still running ...
2021/09/06 09:42:56 Job still running ...
2021/09/06 09:43:26 Job still running ...
2021/09/06 09:43:56 Job still running ...
2021/09/06 09:44:26 Job still running ...
2021/09/06 09:44:56 Job still running ...
2021/09/06 09:45:26 Job still running ...
2021/09/06 09:45:56 Job still running ...
2021/09/06 09:46:26 Job still running ...
2021/09/06 09:46:56 Job still running ...
2021/09/06 09:47:26 Job still running ...
2021/09/06 09:47:56 Job still running ...
2021/09/06 09:48:26 Job still running ...
2021/09/06 09:48:56 Job still running ...
2021/09/06 09:49:26 Job still running ...
2021/09/06 09:49:56 Job still running ...
2021/09/06 09:50:26 Job still running ...
2021/09/06 09:50:56 Job still running ...
2021/09/06 09:51:26 Job still running ...
2021/09/06 09:51:57 Job still running ...
2021/09/06 09:52:27 Job still running ...
2021/09/06 09:52:57 Job still running ...
2021/09/06 09:53:27 Job still running ...
2021/09/06 09:53:57 Job still running ...
2021/09/06 09:54:27 Job still running ...
2021/09/06 09:54:57 Job still running ...
2021/09/06 09:55:27 Job still running ...
2021/09/06 09:55:57 Job still running ...
2021/09/06 09:56:27 Job still running ...
2021/09/06 09:56:57 Job still running ...
2021/09/06 09:57:27 Job still running ...
2021/09/06 09:57:57 Job still running ...
2021/09/06 09:58:27 Job still running ...
2021/09/06 09:58:57 Job still running ...
2021/09/06 09:59:27 Job still running ...
2021/09/06 09:59:57 Job still running ...
2021/09/06 10:00:27 Job still running ...
2021/09/06 10:00:57 Job still running ...
2021/09/06 10:01:27 Job still running ...
2021/09/06 10:01:57 Job still running ...
2021/09/06 10:02:27 Job still running ...
2021/09/06 10:02:58 Failed to execute job: job 2021-09-06_01_59_52-18287719279172351758 failed
panic: Failed to execute job: job 2021-09-06_01_59_52-18287719279172351758 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1129de8, 0xc000120000, 0x101c117, 0x19, 0xc0003f1e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 3m 38s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/d5tggx2jflqyg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#260
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/260/display/redirect?page=changes>
Changes:
[noreply] [BEAM-12769] Adds support for expanding a Java cross-language transform
------------------------------------------
[...truncated 29.88 KB...]
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1630851370935998503/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1630851370935998503/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0905141355",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/05 14:16:12 Submitted job: 2021-09-05_07_16_11-3999166459887814150
2021/09/05 14:16:12 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-05_07_16_11-3999166459887814150?project=apache-beam-testing
2021/09/05 14:16:12 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-05_07_16_11-3999166459887814150
2021/09/05 14:16:12 Job state: JOB_STATE_PENDING ...
2021/09/05 14:16:42 Job still running ...
2021/09/05 14:17:12 Job still running ...
2021/09/05 14:17:42 Job still running ...
2021/09/05 14:18:12 Job still running ...
2021/09/05 14:18:42 Job still running ...
2021/09/05 14:19:12 Job still running ...
2021/09/05 14:19:42 Job still running ...
2021/09/05 14:20:12 Job still running ...
2021/09/05 14:20:42 Job still running ...
2021/09/05 14:21:12 Job still running ...
2021/09/05 14:21:43 Job still running ...
2021/09/05 14:22:13 Job still running ...
2021/09/05 14:22:43 Job still running ...
2021/09/05 14:23:13 Job still running ...
2021/09/05 14:23:43 Job still running ...
2021/09/05 14:24:13 Job still running ...
2021/09/05 14:24:43 Job still running ...
2021/09/05 14:25:13 Job still running ...
2021/09/05 14:25:43 Job still running ...
2021/09/05 14:26:13 Job still running ...
2021/09/05 14:26:43 Job still running ...
2021/09/05 14:27:13 Job still running ...
2021/09/05 14:27:43 Job still running ...
2021/09/05 14:28:13 Job still running ...
2021/09/05 14:28:43 Job still running ...
2021/09/05 14:29:13 Job still running ...
2021/09/05 14:29:43 Job still running ...
2021/09/05 14:30:13 Job still running ...
2021/09/05 14:30:43 Job still running ...
2021/09/05 14:31:13 Job still running ...
2021/09/05 14:31:43 Job still running ...
2021/09/05 14:32:13 Job still running ...
2021/09/05 14:32:43 Job still running ...
2021/09/05 14:33:13 Job still running ...
2021/09/05 14:33:43 Job still running ...
2021/09/05 14:34:13 Job still running ...
2021/09/05 14:34:43 Job still running ...
2021/09/05 14:35:13 Job still running ...
2021/09/05 14:35:43 Job still running ...
2021/09/05 14:36:13 Job still running ...
2021/09/05 14:36:43 Job still running ...
2021/09/05 14:37:13 Job still running ...
2021/09/05 14:37:43 Job still running ...
2021/09/05 14:38:13 Job still running ...
2021/09/05 14:38:44 Job still running ...
2021/09/05 14:39:14 Job still running ...
2021/09/05 14:39:44 Job still running ...
2021/09/05 14:40:14 Job still running ...
2021/09/05 14:40:44 Job still running ...
2021/09/05 14:41:14 Job still running ...
2021/09/05 14:41:44 Job still running ...
2021/09/05 14:42:14 Job still running ...
2021/09/05 14:42:44 Job still running ...
2021/09/05 14:43:14 Job still running ...
2021/09/05 14:43:44 Job still running ...
2021/09/05 14:44:14 Job still running ...
2021/09/05 14:44:44 Job still running ...
2021/09/05 14:45:14 Job still running ...
2021/09/05 14:45:44 Job still running ...
2021/09/05 14:46:14 Job still running ...
2021/09/05 14:46:44 Job still running ...
2021/09/05 14:47:14 Job still running ...
2021/09/05 14:47:44 Job still running ...
2021/09/05 14:48:14 Job still running ...
2021/09/05 14:48:44 Job still running ...
2021/09/05 14:49:14 Job still running ...
2021/09/05 14:49:44 Job still running ...
2021/09/05 14:50:14 Job still running ...
2021/09/05 14:50:44 Job still running ...
2021/09/05 14:51:14 Job still running ...
2021/09/05 14:51:44 Job still running ...
2021/09/05 14:52:14 Job still running ...
2021/09/05 14:52:44 Job still running ...
2021/09/05 14:53:14 Job still running ...
2021/09/05 14:53:44 Job still running ...
2021/09/05 14:54:14 Job still running ...
2021/09/05 14:54:45 Job still running ...
2021/09/05 14:55:15 Job still running ...
2021/09/05 14:55:45 Job still running ...
2021/09/05 14:56:15 Job still running ...
2021/09/05 14:56:45 Job still running ...
2021/09/05 14:57:15 Job still running ...
2021/09/05 14:57:45 Job still running ...
2021/09/05 14:58:15 Job still running ...
2021/09/05 14:58:45 Job still running ...
2021/09/05 14:59:15 Job still running ...
2021/09/05 14:59:45 Job still running ...
2021/09/05 15:00:15 Job still running ...
2021/09/05 15:00:45 Job still running ...
2021/09/05 15:01:15 Job still running ...
2021/09/05 15:01:45 Job still running ...
2021/09/05 15:02:15 Job still running ...
2021/09/05 15:02:45 Job still running ...
2021/09/05 15:03:15 Job still running ...
2021/09/05 15:03:45 Job still running ...
2021/09/05 15:04:15 Job still running ...
2021/09/05 15:04:45 Job still running ...
2021/09/05 15:05:15 Job still running ...
2021/09/05 15:05:45 Job still running ...
2021/09/05 15:06:15 Job still running ...
2021/09/05 15:06:45 Job still running ...
2021/09/05 15:07:15 Job still running ...
2021/09/05 15:07:46 Job still running ...
2021/09/05 15:08:16 Job still running ...
2021/09/05 15:08:46 Job still running ...
2021/09/05 15:09:16 Job still running ...
2021/09/05 15:09:46 Job still running ...
2021/09/05 15:10:16 Job still running ...
2021/09/05 15:10:46 Job still running ...
2021/09/05 15:11:16 Job still running ...
2021/09/05 15:11:46 Job still running ...
2021/09/05 15:12:16 Job still running ...
2021/09/05 15:12:46 Job still running ...
2021/09/05 15:13:16 Job still running ...
2021/09/05 15:13:46 Job still running ...
2021/09/05 15:14:16 Job still running ...
2021/09/05 15:14:46 Job still running ...
2021/09/05 15:15:16 Job still running ...
2021/09/05 15:15:46 Job still running ...
2021/09/05 15:16:16 Job still running ...
2021/09/05 15:16:46 Job still running ...
2021/09/05 15:17:16 Job still running ...
2021/09/05 15:17:46 Job still running ...
2021/09/05 15:18:16 Job still running ...
2021/09/05 15:18:46 Job still running ...
2021/09/05 15:19:16 Failed to execute job: job 2021-09-05_07_16_11-3999166459887814150 failed
panic: Failed to execute job: job 2021-09-05_07_16_11-3999166459887814150 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1129de8, 0xc00003e0b0, 0x101c117, 0x19, 0xc000343e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 3m 40s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/zx5fg6eny3vi2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#259
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/259/display/redirect>
Changes:
------------------------------------------
[...truncated 29.78 KB...]
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1630745988996799998/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1630745988996799998/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0904065609",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/04 08:59:50 Submitted job: 2021-09-04_01_59_49-4020483358980558935
2021/09/04 08:59:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-04_01_59_49-4020483358980558935?project=apache-beam-testing
2021/09/04 08:59:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-04_01_59_49-4020483358980558935
2021/09/04 08:59:50 Job state: JOB_STATE_PENDING ...
2021/09/04 09:00:20 Job still running ...
2021/09/04 09:00:50 Job still running ...
2021/09/04 09:01:20 Job still running ...
2021/09/04 09:01:50 Job still running ...
2021/09/04 09:02:20 Job still running ...
2021/09/04 09:02:50 Job still running ...
2021/09/04 09:03:20 Job still running ...
2021/09/04 09:03:50 Job still running ...
2021/09/04 09:04:20 Job still running ...
2021/09/04 09:04:50 Job still running ...
2021/09/04 09:05:20 Job still running ...
2021/09/04 09:05:50 Job still running ...
2021/09/04 09:06:20 Job still running ...
2021/09/04 09:06:50 Job still running ...
2021/09/04 09:07:20 Job still running ...
2021/09/04 09:07:50 Job still running ...
2021/09/04 09:08:20 Job still running ...
2021/09/04 09:08:50 Job still running ...
2021/09/04 09:09:20 Job still running ...
2021/09/04 09:09:51 Job still running ...
2021/09/04 09:10:21 Job still running ...
2021/09/04 09:10:51 Job still running ...
2021/09/04 09:11:21 Job still running ...
2021/09/04 09:11:51 Job still running ...
2021/09/04 09:12:21 Job still running ...
2021/09/04 09:12:51 Job still running ...
2021/09/04 09:13:21 Job still running ...
2021/09/04 09:13:51 Job still running ...
2021/09/04 09:14:21 Job still running ...
2021/09/04 09:14:51 Job still running ...
2021/09/04 09:15:21 Job still running ...
2021/09/04 09:15:51 Job still running ...
2021/09/04 09:16:21 Job still running ...
2021/09/04 09:16:51 Job still running ...
2021/09/04 09:17:21 Job still running ...
2021/09/04 09:17:51 Job still running ...
2021/09/04 09:18:21 Job still running ...
2021/09/04 09:18:51 Job still running ...
2021/09/04 09:19:21 Job still running ...
2021/09/04 09:19:51 Job still running ...
2021/09/04 09:20:21 Job still running ...
2021/09/04 09:20:51 Job still running ...
2021/09/04 09:21:21 Job still running ...
2021/09/04 09:21:51 Job still running ...
2021/09/04 09:22:21 Job still running ...
2021/09/04 09:22:51 Job still running ...
2021/09/04 09:23:22 Job still running ...
2021/09/04 09:23:52 Job still running ...
2021/09/04 09:24:22 Job still running ...
2021/09/04 09:24:52 Job still running ...
2021/09/04 09:25:22 Job still running ...
2021/09/04 09:25:52 Job still running ...
2021/09/04 09:26:22 Job still running ...
2021/09/04 09:26:52 Job still running ...
2021/09/04 09:27:22 Job still running ...
2021/09/04 09:27:52 Job still running ...
2021/09/04 09:28:22 Job still running ...
2021/09/04 09:28:52 Job still running ...
2021/09/04 09:29:22 Job still running ...
2021/09/04 09:29:52 Job still running ...
2021/09/04 09:30:22 Job still running ...
2021/09/04 09:30:52 Job still running ...
2021/09/04 09:31:22 Job still running ...
2021/09/04 09:31:52 Job still running ...
2021/09/04 09:32:22 Job still running ...
2021/09/04 09:32:52 Job still running ...
2021/09/04 09:33:22 Job still running ...
2021/09/04 09:33:52 Job still running ...
2021/09/04 09:34:22 Job still running ...
2021/09/04 09:34:52 Job still running ...
2021/09/04 09:35:22 Job still running ...
2021/09/04 09:35:52 Job still running ...
2021/09/04 09:36:23 Job still running ...
2021/09/04 09:36:53 Job still running ...
2021/09/04 09:37:23 Job still running ...
2021/09/04 09:37:53 Job still running ...
2021/09/04 09:38:23 Job still running ...
2021/09/04 09:38:53 Job still running ...
2021/09/04 09:39:23 Job still running ...
2021/09/04 09:39:53 Job still running ...
2021/09/04 09:40:23 Job still running ...
2021/09/04 09:40:53 Job still running ...
2021/09/04 09:41:23 Job still running ...
2021/09/04 09:41:53 Job still running ...
2021/09/04 09:42:23 Job still running ...
2021/09/04 09:42:53 Job still running ...
2021/09/04 09:43:23 Job still running ...
2021/09/04 09:43:53 Job still running ...
2021/09/04 09:44:23 Job still running ...
2021/09/04 09:44:53 Job still running ...
2021/09/04 09:45:23 Job still running ...
2021/09/04 09:45:53 Job still running ...
2021/09/04 09:46:23 Job still running ...
2021/09/04 09:46:53 Job still running ...
2021/09/04 09:47:23 Job still running ...
2021/09/04 09:47:53 Job still running ...
2021/09/04 09:48:23 Job still running ...
2021/09/04 09:48:54 Job still running ...
2021/09/04 09:49:24 Job still running ...
2021/09/04 09:49:54 Job still running ...
2021/09/04 09:50:24 Job still running ...
2021/09/04 09:50:54 Job still running ...
2021/09/04 09:51:24 Job still running ...
2021/09/04 09:51:54 Job still running ...
2021/09/04 09:52:24 Job still running ...
2021/09/04 09:52:54 Job still running ...
2021/09/04 09:53:24 Job still running ...
2021/09/04 09:53:54 Job still running ...
2021/09/04 09:54:24 Job still running ...
2021/09/04 09:54:54 Job still running ...
2021/09/04 09:55:24 Job still running ...
2021/09/04 09:55:54 Job still running ...
2021/09/04 09:56:24 Job still running ...
2021/09/04 09:56:54 Job still running ...
2021/09/04 09:57:24 Job still running ...
2021/09/04 09:57:54 Job still running ...
2021/09/04 09:58:24 Job still running ...
2021/09/04 09:58:54 Job still running ...
2021/09/04 09:59:24 Job still running ...
2021/09/04 09:59:54 Job still running ...
2021/09/04 10:00:24 Job still running ...
2021/09/04 10:00:54 Job still running ...
2021/09/04 10:01:25 Job still running ...
2021/09/04 10:01:55 Job still running ...
2021/09/04 10:02:25 Job still running ...
2021/09/04 10:02:55 Job still running ...
2021/09/04 10:03:25 Failed to execute job: job 2021-09-04_01_59_49-4020483358980558935 failed
panic: Failed to execute job: job 2021-09-04_01_59_49-4020483358980558935 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1129de8, 0xc00003e0b0, 0x101c117, 0x19, 0xc000341e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 4m 4s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/izwmetzjzbhsg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#258
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/258/display/redirect?page=changes>
Changes:
[Steve Niemitz] [BEAM-12767] Add another unit test for PipelineOptions deserialization
[aydar.zaynutdinov] [BEAM-11873] Add support for writes with returning values in JdbcIO
[Andrew Pilloud] s/org.apache.beam.vendor.calcite.v1_20_0/org.apache.beam.vendor.calcite.v1_26_0/g
[Andrew Pilloud] [BEAM-9379] Update to vendored Calcite to 1.26.0
[Andrew Pilloud] Fix flattened rows
[Andrew Pilloud] Fix DDL
[Andrew Pilloud] Handle BeamRelNode in RelSubset
[Andrew Pilloud] Fix BeamIOPushDown
[Andrew Pilloud] [BEAM-9190] Update BeamBigQuerySqlDialect
[Andrew Pilloud] Remap IN to Search
[Andrew Pilloud] [BEAM-9379] Use byte[] instead of ByteString for (VAR)BINARY in UDFs.
[Andrew Pilloud] [BEAM-9379] Update UDF NULL type mismatch test since there is stricter
[Andrew Pilloud] Fix ZetaSQL window function mapping
[Andrew Pilloud] Fix Bigtable tests that depend on SQL types
[Andrew Pilloud] Workaround CALCITE-4759 in JoinPushThroughJoinRule
[Andrew Pilloud] Disable nested bytes tests, sorry!
[Andrew Pilloud] SqlLine is rotting, Just CAST types for now
[Andrew Pilloud] Update CHANGES.md
[Andrew Pilloud] Up spotbug stack size
[Andrew Pilloud] Fix BeamMatchRel copy
[Andrew Pilloud] partitionKey everywhere
[Andrew Pilloud] Make it functional
[Andrew Pilloud] Update CreateFunction
[Andrew Pilloud] No tpcds dependency
[Andrew Pilloud] Fix default time types
[Ankur Goenka] fixing release date
[Andrew Pilloud] [BEAM-12680] Calcite SqlTransform no longer experimental
[noreply] [BEAM-12823] TestStream Support in Samza Portable Runner (#15421)
------------------------------------------
[...truncated 29.94 KB...]
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1630659663431879858/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1630659663431879858/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0903065623",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/03 09:01:04 Submitted job: 2021-09-03_02_01_04-8281792050030488304
2021/09/03 09:01:04 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-03_02_01_04-8281792050030488304?project=apache-beam-testing
2021/09/03 09:01:04 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-03_02_01_04-8281792050030488304
2021/09/03 09:01:04 Job state: JOB_STATE_PENDING ...
2021/09/03 09:01:34 Job still running ...
2021/09/03 09:02:04 Job still running ...
2021/09/03 09:02:34 Job still running ...
2021/09/03 09:03:05 Job still running ...
2021/09/03 09:03:35 Job still running ...
2021/09/03 09:04:05 Job still running ...
2021/09/03 09:04:35 Job still running ...
2021/09/03 09:05:05 Job still running ...
2021/09/03 09:05:35 Job still running ...
2021/09/03 09:06:05 Job still running ...
2021/09/03 09:06:35 Job still running ...
2021/09/03 09:07:05 Job still running ...
2021/09/03 09:07:35 Job still running ...
2021/09/03 09:08:05 Job still running ...
2021/09/03 09:08:35 Job still running ...
2021/09/03 09:09:05 Job still running ...
2021/09/03 09:09:35 Job still running ...
2021/09/03 09:10:05 Job still running ...
2021/09/03 09:10:35 Job still running ...
2021/09/03 09:11:05 Job still running ...
2021/09/03 09:11:35 Job still running ...
2021/09/03 09:12:05 Job still running ...
2021/09/03 09:12:35 Job still running ...
2021/09/03 09:13:05 Job still running ...
2021/09/03 09:13:35 Job still running ...
2021/09/03 09:14:05 Job still running ...
2021/09/03 09:14:35 Job still running ...
2021/09/03 09:15:05 Job still running ...
2021/09/03 09:15:35 Job still running ...
2021/09/03 09:16:05 Job still running ...
2021/09/03 09:16:35 Job still running ...
2021/09/03 09:17:06 Job still running ...
2021/09/03 09:17:36 Job still running ...
2021/09/03 09:18:06 Job still running ...
2021/09/03 09:18:36 Job still running ...
2021/09/03 09:19:06 Job still running ...
2021/09/03 09:19:36 Job still running ...
2021/09/03 09:20:06 Job still running ...
2021/09/03 09:20:36 Job still running ...
2021/09/03 09:21:06 Job still running ...
2021/09/03 09:21:36 Job still running ...
2021/09/03 09:22:06 Job still running ...
2021/09/03 09:22:36 Job still running ...
2021/09/03 09:23:06 Job still running ...
2021/09/03 09:23:36 Job still running ...
2021/09/03 09:24:06 Job still running ...
2021/09/03 09:24:36 Job still running ...
2021/09/03 09:25:06 Job still running ...
2021/09/03 09:25:36 Job still running ...
2021/09/03 09:26:06 Job still running ...
2021/09/03 09:26:36 Job still running ...
2021/09/03 09:27:06 Job still running ...
2021/09/03 09:27:36 Job still running ...
2021/09/03 09:28:06 Job still running ...
2021/09/03 09:28:36 Job still running ...
2021/09/03 09:29:06 Job still running ...
2021/09/03 09:29:36 Job still running ...
2021/09/03 09:30:06 Job still running ...
2021/09/03 09:30:37 Job still running ...
2021/09/03 09:31:07 Job still running ...
2021/09/03 09:31:37 Job still running ...
2021/09/03 09:32:07 Job still running ...
2021/09/03 09:32:37 Job still running ...
2021/09/03 09:33:07 Job still running ...
2021/09/03 09:33:37 Job still running ...
2021/09/03 09:34:07 Job still running ...
2021/09/03 09:34:37 Job still running ...
2021/09/03 09:35:07 Job still running ...
2021/09/03 09:35:37 Job still running ...
2021/09/03 09:36:07 Job still running ...
2021/09/03 09:36:37 Job still running ...
2021/09/03 09:37:07 Job still running ...
2021/09/03 09:37:37 Job still running ...
2021/09/03 09:38:07 Job still running ...
2021/09/03 09:38:37 Job still running ...
2021/09/03 09:39:07 Job still running ...
2021/09/03 09:39:37 Job still running ...
2021/09/03 09:40:07 Job still running ...
2021/09/03 09:40:37 Job still running ...
2021/09/03 09:41:07 Job still running ...
2021/09/03 09:41:37 Job still running ...
2021/09/03 09:42:07 Job still running ...
2021/09/03 09:42:37 Job still running ...
2021/09/03 09:43:07 Job still running ...
2021/09/03 09:43:37 Job still running ...
2021/09/03 09:44:08 Job still running ...
2021/09/03 09:44:38 Job still running ...
2021/09/03 09:45:08 Job still running ...
2021/09/03 09:45:38 Job still running ...
2021/09/03 09:46:08 Job still running ...
2021/09/03 09:46:38 Job still running ...
2021/09/03 09:47:08 Job still running ...
2021/09/03 09:47:38 Job still running ...
2021/09/03 09:48:08 Job still running ...
2021/09/03 09:48:38 Job still running ...
2021/09/03 09:49:08 Job still running ...
2021/09/03 09:49:38 Job still running ...
2021/09/03 09:50:08 Job still running ...
2021/09/03 09:50:38 Job still running ...
2021/09/03 09:51:08 Job still running ...
2021/09/03 09:51:38 Job still running ...
2021/09/03 09:52:08 Job still running ...
2021/09/03 09:52:38 Job still running ...
2021/09/03 09:53:08 Job still running ...
2021/09/03 09:53:38 Job still running ...
2021/09/03 09:54:08 Job still running ...
2021/09/03 09:54:38 Job still running ...
2021/09/03 09:55:08 Job still running ...
2021/09/03 09:55:38 Job still running ...
2021/09/03 09:56:09 Job still running ...
2021/09/03 09:56:39 Job still running ...
2021/09/03 09:57:09 Job still running ...
2021/09/03 09:57:39 Job still running ...
2021/09/03 09:58:09 Job still running ...
2021/09/03 09:58:39 Job still running ...
2021/09/03 09:59:09 Job still running ...
2021/09/03 09:59:39 Job still running ...
2021/09/03 10:00:09 Job still running ...
2021/09/03 10:00:39 Job still running ...
2021/09/03 10:01:09 Job still running ...
2021/09/03 10:01:39 Job still running ...
2021/09/03 10:02:09 Job still running ...
2021/09/03 10:02:39 Job still running ...
2021/09/03 10:03:09 Job still running ...
2021/09/03 10:03:39 Job still running ...
2021/09/03 10:04:09 Failed to execute job: job 2021-09-03_02_01_04-8281792050030488304 failed
panic: Failed to execute job: job 2021-09-03_02_01_04-8281792050030488304 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1129de8, 0xc00003e0b0, 0x101c117, 0x19, 0xc0001e1e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 4m 25s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/7t2ryyyu3yzsw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#257
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/257/display/redirect?page=changes>
Changes:
[baeminbo] Fix apiclient_test unittest not to fail with no credentials
[noreply] [BEAM-10913] - Adding new Grafana dashboard to monitor GAs post-commit
[aromanenko.dev] Remove a template line
[Steve Niemitz] [BEAM-12767] Fix handling display data in pipeline serialization
[kawaigin] Updated Linux golden screenshots for notebook integration tests.
------------------------------------------
[...truncated 29.93 KB...]
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1630573312845270831/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1630573312845270831/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0902065621",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/02 09:01:54 Submitted job: 2021-09-02_02_01_53-4036779454353973790
2021/09/02 09:01:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-02_02_01_53-4036779454353973790?project=apache-beam-testing
2021/09/02 09:01:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-02_02_01_53-4036779454353973790
2021/09/02 09:01:54 Job state: JOB_STATE_PENDING ...
2021/09/02 09:02:24 Job still running ...
2021/09/02 09:02:54 Job still running ...
2021/09/02 09:03:24 Job still running ...
2021/09/02 09:03:54 Job still running ...
2021/09/02 09:04:24 Job still running ...
2021/09/02 09:04:54 Job still running ...
2021/09/02 09:05:24 Job still running ...
2021/09/02 09:05:54 Job still running ...
2021/09/02 09:06:24 Job still running ...
2021/09/02 09:06:54 Job still running ...
2021/09/02 09:07:24 Job still running ...
2021/09/02 09:07:54 Job still running ...
2021/09/02 09:08:24 Job still running ...
2021/09/02 09:08:54 Job still running ...
2021/09/02 09:09:24 Job still running ...
2021/09/02 09:09:55 Job still running ...
2021/09/02 09:10:25 Job still running ...
2021/09/02 09:10:55 Job still running ...
2021/09/02 09:11:25 Job still running ...
2021/09/02 09:11:55 Job still running ...
2021/09/02 09:12:25 Job still running ...
2021/09/02 09:12:55 Job still running ...
2021/09/02 09:13:25 Job still running ...
2021/09/02 09:13:55 Job still running ...
2021/09/02 09:14:25 Job still running ...
2021/09/02 09:14:55 Job still running ...
2021/09/02 09:15:25 Job still running ...
2021/09/02 09:15:55 Job still running ...
2021/09/02 09:16:25 Job still running ...
2021/09/02 09:16:55 Job still running ...
2021/09/02 09:17:25 Job still running ...
2021/09/02 09:17:55 Job still running ...
2021/09/02 09:18:25 Job still running ...
2021/09/02 09:18:55 Job still running ...
2021/09/02 09:19:25 Job still running ...
2021/09/02 09:19:55 Job still running ...
2021/09/02 09:20:25 Job still running ...
2021/09/02 09:20:55 Job still running ...
2021/09/02 09:21:26 Job still running ...
2021/09/02 09:21:56 Job still running ...
2021/09/02 09:22:26 Job still running ...
2021/09/02 09:22:56 Job still running ...
2021/09/02 09:23:26 Job still running ...
2021/09/02 09:23:56 Job still running ...
2021/09/02 09:24:26 Job still running ...
2021/09/02 09:24:56 Job still running ...
2021/09/02 09:25:26 Job still running ...
2021/09/02 09:25:56 Job still running ...
2021/09/02 09:26:26 Job still running ...
2021/09/02 09:26:56 Job still running ...
2021/09/02 09:27:26 Job still running ...
2021/09/02 09:27:56 Job still running ...
2021/09/02 09:28:26 Job still running ...
2021/09/02 09:28:56 Job still running ...
2021/09/02 09:29:26 Job still running ...
2021/09/02 09:29:56 Job still running ...
2021/09/02 09:30:26 Job still running ...
2021/09/02 09:30:57 Job still running ...
2021/09/02 09:31:27 Job still running ...
2021/09/02 09:31:57 Job still running ...
2021/09/02 09:32:27 Job still running ...
2021/09/02 09:32:57 Job still running ...
2021/09/02 09:33:27 Job still running ...
2021/09/02 09:33:57 Job still running ...
2021/09/02 09:34:27 Job still running ...
2021/09/02 09:34:57 Job still running ...
2021/09/02 09:35:27 Job still running ...
2021/09/02 09:35:57 Job still running ...
2021/09/02 09:36:27 Job still running ...
2021/09/02 09:36:57 Job still running ...
2021/09/02 09:37:27 Job still running ...
2021/09/02 09:37:57 Job still running ...
2021/09/02 09:38:27 Job still running ...
2021/09/02 09:38:57 Job still running ...
2021/09/02 09:39:27 Job still running ...
2021/09/02 09:39:57 Job still running ...
2021/09/02 09:40:28 Job still running ...
2021/09/02 09:40:58 Job still running ...
2021/09/02 09:41:28 Job still running ...
2021/09/02 09:41:58 Job still running ...
2021/09/02 09:42:28 Job still running ...
2021/09/02 09:42:58 Job still running ...
2021/09/02 09:43:28 Job still running ...
2021/09/02 09:43:58 Job still running ...
2021/09/02 09:44:28 Job still running ...
2021/09/02 09:44:58 Job still running ...
2021/09/02 09:45:28 Job still running ...
2021/09/02 09:45:58 Job still running ...
2021/09/02 09:46:28 Job still running ...
2021/09/02 09:46:58 Job still running ...
2021/09/02 09:47:28 Job still running ...
2021/09/02 09:47:58 Job still running ...
2021/09/02 09:48:28 Job still running ...
2021/09/02 09:48:58 Job still running ...
2021/09/02 09:49:28 Job still running ...
2021/09/02 09:49:58 Job still running ...
2021/09/02 09:50:29 Job still running ...
2021/09/02 09:50:59 Job still running ...
2021/09/02 09:51:29 Job still running ...
2021/09/02 09:51:59 Job still running ...
2021/09/02 09:52:29 Job still running ...
2021/09/02 09:52:59 Job still running ...
2021/09/02 09:53:29 Job still running ...
2021/09/02 09:53:59 Job still running ...
2021/09/02 09:54:29 Job still running ...
2021/09/02 09:54:59 Job still running ...
2021/09/02 09:55:29 Job still running ...
2021/09/02 09:55:59 Job still running ...
2021/09/02 09:56:29 Job still running ...
2021/09/02 09:56:59 Job still running ...
2021/09/02 09:57:29 Job still running ...
2021/09/02 09:57:59 Job still running ...
2021/09/02 09:58:29 Job still running ...
2021/09/02 09:58:59 Job still running ...
2021/09/02 09:59:29 Job still running ...
2021/09/02 09:59:59 Job still running ...
2021/09/02 10:00:29 Job still running ...
2021/09/02 10:00:59 Job still running ...
2021/09/02 10:01:30 Job still running ...
2021/09/02 10:02:00 Job still running ...
2021/09/02 10:02:30 Job still running ...
2021/09/02 10:03:00 Job still running ...
2021/09/02 10:03:30 Job still running ...
2021/09/02 10:04:00 Job still running ...
2021/09/02 10:04:30 Job still running ...
2021/09/02 10:05:00 Failed to execute job: job 2021-09-02_02_01_53-4036779454353973790 failed
panic: Failed to execute job: job 2021-09-02_02_01_53-4036779454353973790 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1129de8, 0xc00003e0b0, 0x101c117, 0x19, 0xc00041be80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 5m 0s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/mqo5zi3ctziym
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#256
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/256/display/redirect?page=changes>
Changes:
[emilyye] sync nltk, orjson for Python image
[noreply] Allow `google-auth < 3`
[samuelw] [BEAM-12776] Change closing to happen in background in parallel for
[Luke Cwik] [BEAM-12802] Refactor DataStreamsDecoder so that it becomes aware of the
[noreply] Fix typo in BigQuery documentation
[ajamato] [BEAM-11994] Instantiate a new ServiceCallMetric before each request to
[Ankur Goenka] Remove duplicate 2.33.0 section
[Steve Niemitz] [BEAM-12767] Improve PipelineOption parsing UX
[noreply] add python spark example in documentation (#15426)
[noreply] Add per-batch metrics to JdbcIO.write (#15429)
------------------------------------------
[...truncated 29.85 KB...]
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1630486802639259930/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1630486802639259930/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0901065618",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/01 09:00:04 Submitted job: 2021-09-01_02_00_03-7388379586487894575
2021/09/01 09:00:04 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-01_02_00_03-7388379586487894575?project=apache-beam-testing
2021/09/01 09:00:04 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-01_02_00_03-7388379586487894575
2021/09/01 09:00:04 Job state: JOB_STATE_PENDING ...
2021/09/01 09:00:34 Job still running ...
2021/09/01 09:01:04 Job still running ...
2021/09/01 09:01:34 Job still running ...
2021/09/01 09:02:04 Job still running ...
2021/09/01 09:02:34 Job still running ...
2021/09/01 09:03:04 Job still running ...
2021/09/01 09:03:34 Job still running ...
2021/09/01 09:04:04 Job still running ...
2021/09/01 09:04:34 Job still running ...
2021/09/01 09:05:04 Job still running ...
2021/09/01 09:05:34 Job still running ...
2021/09/01 09:06:04 Job still running ...
2021/09/01 09:06:34 Job still running ...
2021/09/01 09:07:04 Job still running ...
2021/09/01 09:07:34 Job still running ...
2021/09/01 09:08:05 Job still running ...
2021/09/01 09:08:35 Job still running ...
2021/09/01 09:09:05 Job still running ...
2021/09/01 09:09:35 Job still running ...
2021/09/01 09:10:05 Job still running ...
2021/09/01 09:10:35 Job still running ...
2021/09/01 09:11:05 Job still running ...
2021/09/01 09:11:35 Job still running ...
2021/09/01 09:12:05 Job still running ...
2021/09/01 09:12:35 Job still running ...
2021/09/01 09:13:05 Job still running ...
2021/09/01 09:13:36 Job still running ...
2021/09/01 09:14:06 Job still running ...
2021/09/01 09:14:36 Job still running ...
2021/09/01 09:15:06 Job still running ...
2021/09/01 09:15:36 Job still running ...
2021/09/01 09:16:06 Job still running ...
2021/09/01 09:16:36 Job still running ...
2021/09/01 09:17:06 Job still running ...
2021/09/01 09:17:36 Job still running ...
2021/09/01 09:18:06 Job still running ...
2021/09/01 09:18:36 Job still running ...
2021/09/01 09:19:06 Job still running ...
2021/09/01 09:19:37 Job still running ...
2021/09/01 09:20:07 Job still running ...
2021/09/01 09:20:37 Job still running ...
2021/09/01 09:21:07 Job still running ...
2021/09/01 09:21:37 Job still running ...
2021/09/01 09:22:07 Job still running ...
2021/09/01 09:22:37 Job still running ...
2021/09/01 09:23:07 Job still running ...
2021/09/01 09:23:37 Job still running ...
2021/09/01 09:24:07 Job still running ...
2021/09/01 09:24:37 Job still running ...
2021/09/01 09:25:07 Job still running ...
2021/09/01 09:25:37 Job still running ...
2021/09/01 09:26:07 Job still running ...
2021/09/01 09:26:37 Job still running ...
2021/09/01 09:27:07 Job still running ...
2021/09/01 09:27:37 Job still running ...
2021/09/01 09:28:07 Job still running ...
2021/09/01 09:28:37 Job still running ...
2021/09/01 09:29:07 Job still running ...
2021/09/01 09:29:38 Job still running ...
2021/09/01 09:30:08 Job still running ...
2021/09/01 09:30:38 Job still running ...
2021/09/01 09:31:08 Job still running ...
2021/09/01 09:31:38 Job still running ...
2021/09/01 09:32:08 Job still running ...
2021/09/01 09:32:38 Job still running ...
2021/09/01 09:33:08 Job still running ...
2021/09/01 09:33:38 Job still running ...
2021/09/01 09:34:08 Job still running ...
2021/09/01 09:34:38 Job still running ...
2021/09/01 09:35:08 Job still running ...
2021/09/01 09:35:38 Job still running ...
2021/09/01 09:36:08 Job still running ...
2021/09/01 09:36:38 Job still running ...
2021/09/01 09:37:08 Job still running ...
2021/09/01 09:37:39 Job still running ...
2021/09/01 09:38:09 Job still running ...
2021/09/01 09:38:39 Job still running ...
2021/09/01 09:39:09 Job still running ...
2021/09/01 09:39:39 Job still running ...
2021/09/01 09:40:09 Job still running ...
2021/09/01 09:40:39 Job still running ...
2021/09/01 09:41:09 Job still running ...
2021/09/01 09:41:39 Job still running ...
2021/09/01 09:42:09 Job still running ...
2021/09/01 09:42:39 Job still running ...
2021/09/01 09:43:09 Job still running ...
2021/09/01 09:43:39 Job still running ...
2021/09/01 09:44:09 Job still running ...
2021/09/01 09:44:39 Job still running ...
2021/09/01 09:45:09 Job still running ...
2021/09/01 09:45:39 Job still running ...
2021/09/01 09:46:09 Job still running ...
2021/09/01 09:46:39 Job still running ...
2021/09/01 09:47:10 Job still running ...
2021/09/01 09:47:40 Job still running ...
2021/09/01 09:48:10 Job still running ...
2021/09/01 09:48:40 Job still running ...
2021/09/01 09:49:10 Job still running ...
2021/09/01 09:49:40 Job still running ...
2021/09/01 09:50:10 Job still running ...
2021/09/01 09:50:40 Job still running ...
2021/09/01 09:51:10 Job still running ...
2021/09/01 09:51:40 Job still running ...
2021/09/01 09:52:10 Job still running ...
2021/09/01 09:52:40 Job still running ...
2021/09/01 09:53:10 Job still running ...
2021/09/01 09:53:40 Job still running ...
2021/09/01 09:54:10 Job still running ...
2021/09/01 09:54:40 Job still running ...
2021/09/01 09:55:10 Job still running ...
2021/09/01 09:55:40 Job still running ...
2021/09/01 09:56:10 Job still running ...
2021/09/01 09:56:40 Job still running ...
2021/09/01 09:57:10 Job still running ...
2021/09/01 09:57:40 Job still running ...
2021/09/01 09:58:10 Job still running ...
2021/09/01 09:58:40 Job still running ...
2021/09/01 09:59:11 Job still running ...
2021/09/01 09:59:41 Job still running ...
2021/09/01 10:00:11 Job still running ...
2021/09/01 10:00:41 Job still running ...
2021/09/01 10:01:11 Job still running ...
2021/09/01 10:01:41 Job still running ...
2021/09/01 10:02:11 Job still running ...
2021/09/01 10:02:42 Job still running ...
2021/09/01 10:03:12 Job still running ...
2021/09/01 10:03:42 Failed to execute job: job 2021-09-01_02_00_03-7388379586487894575 failed
panic: Failed to execute job: job 2021-09-01_02_00_03-7388379586487894575 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1129de8, 0xc000120000, 0x101c117, 0x19, 0xc0001d9e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 4m 19s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/6csti5iw2i4e6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#255
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/255/display/redirect?page=changes>
Changes:
[Andrew Pilloud] Docs are built in build_release_candidate.sh
[Andrew Pilloud] Add pypy to email
[Andrew Pilloud] Update CHANGES.md along with website
[Ankur Goenka] Fix Change log for Dataframe preview
[Kyle Weaver] Revert "Merge pull request #15271 Decreasing peak memory usage for
[noreply] [BEAM-11097] Refactor Side Input opening to abstract away from ParDo
[Kyle Weaver] [BEAM-12820] Fix null check error
[kawaigin] [BEAM-10708] Added beam_sql magics
[noreply] Merge pull request #15007 from [BEAM-12428] Implement
------------------------------------------
[...truncated 29.81 KB...]
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1630400398525364694/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1630400398525364694/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0831065639",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/08/31 09:00:00 Submitted job: 2021-08-31_01_59_59-9878464082233207872
2021/08/31 09:00:00 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-08-31_01_59_59-9878464082233207872?project=apache-beam-testing
2021/08/31 09:00:00 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-08-31_01_59_59-9878464082233207872
2021/08/31 09:00:00 Job state: JOB_STATE_PENDING ...
2021/08/31 09:00:30 Job still running ...
2021/08/31 09:01:00 Job still running ...
2021/08/31 09:01:30 Job still running ...
2021/08/31 09:02:00 Job still running ...
2021/08/31 09:02:30 Job still running ...
2021/08/31 09:03:00 Job still running ...
2021/08/31 09:03:30 Job still running ...
2021/08/31 09:04:00 Job still running ...
2021/08/31 09:04:30 Job still running ...
2021/08/31 09:05:00 Job still running ...
2021/08/31 09:05:30 Job still running ...
2021/08/31 09:06:00 Job still running ...
2021/08/31 09:06:31 Job still running ...
2021/08/31 09:07:01 Job still running ...
2021/08/31 09:07:31 Job still running ...
2021/08/31 09:08:01 Job still running ...
2021/08/31 09:08:31 Job still running ...
2021/08/31 09:09:01 Job still running ...
2021/08/31 09:09:31 Job still running ...
2021/08/31 09:10:01 Job still running ...
2021/08/31 09:10:31 Job still running ...
2021/08/31 09:11:01 Job still running ...
2021/08/31 09:11:31 Job still running ...
2021/08/31 09:12:01 Job still running ...
2021/08/31 09:12:31 Job still running ...
2021/08/31 09:13:01 Job still running ...
2021/08/31 09:13:31 Job still running ...
2021/08/31 09:14:01 Job still running ...
2021/08/31 09:14:31 Job still running ...
2021/08/31 09:15:01 Job still running ...
2021/08/31 09:15:31 Job still running ...
2021/08/31 09:16:01 Job still running ...
2021/08/31 09:16:31 Job still running ...
2021/08/31 09:17:02 Job still running ...
2021/08/31 09:17:32 Job still running ...
2021/08/31 09:18:02 Job still running ...
2021/08/31 09:18:32 Job still running ...
2021/08/31 09:19:02 Job still running ...
2021/08/31 09:19:32 Job still running ...
2021/08/31 09:20:02 Job still running ...
2021/08/31 09:20:32 Job still running ...
2021/08/31 09:21:02 Job still running ...
2021/08/31 09:21:32 Job still running ...
2021/08/31 09:22:02 Job still running ...
2021/08/31 09:22:32 Job still running ...
2021/08/31 09:23:02 Job still running ...
2021/08/31 09:23:32 Job still running ...
2021/08/31 09:24:02 Job still running ...
2021/08/31 09:24:32 Job still running ...
2021/08/31 09:25:03 Job still running ...
2021/08/31 09:25:33 Job still running ...
2021/08/31 09:26:03 Job still running ...
2021/08/31 09:26:33 Job still running ...
2021/08/31 09:27:03 Job still running ...
2021/08/31 09:27:33 Job still running ...
2021/08/31 09:28:03 Job still running ...
2021/08/31 09:28:33 Job still running ...
2021/08/31 09:29:03 Job still running ...
2021/08/31 09:29:33 Job still running ...
2021/08/31 09:30:03 Job still running ...
2021/08/31 09:30:33 Job still running ...
2021/08/31 09:31:03 Job still running ...
2021/08/31 09:31:33 Job still running ...
2021/08/31 09:32:03 Job still running ...
2021/08/31 09:32:33 Job still running ...
2021/08/31 09:33:03 Job still running ...
2021/08/31 09:33:33 Job still running ...
2021/08/31 09:34:03 Job still running ...
2021/08/31 09:34:34 Job still running ...
2021/08/31 09:35:04 Job still running ...
2021/08/31 09:35:34 Job still running ...
2021/08/31 09:36:04 Job still running ...
2021/08/31 09:36:35 Job still running ...
2021/08/31 09:37:05 Job still running ...
2021/08/31 09:37:35 Job still running ...
2021/08/31 09:38:05 Job still running ...
2021/08/31 09:38:35 Job still running ...
2021/08/31 09:39:06 Job still running ...
2021/08/31 09:39:36 Job still running ...
2021/08/31 09:40:06 Job still running ...
2021/08/31 09:40:36 Job still running ...
2021/08/31 09:41:06 Job still running ...
2021/08/31 09:41:37 Job still running ...
2021/08/31 09:42:07 Job still running ...
2021/08/31 09:42:37 Job still running ...
2021/08/31 09:43:07 Job still running ...
2021/08/31 09:43:37 Job still running ...
2021/08/31 09:44:07 Job still running ...
2021/08/31 09:44:37 Job still running ...
2021/08/31 09:45:07 Job still running ...
2021/08/31 09:45:37 Job still running ...
2021/08/31 09:46:07 Job still running ...
2021/08/31 09:46:38 Job still running ...
2021/08/31 09:47:08 Job still running ...
2021/08/31 09:47:38 Job still running ...
2021/08/31 09:48:08 Job still running ...
2021/08/31 09:48:38 Job still running ...
2021/08/31 09:49:08 Job still running ...
2021/08/31 09:49:38 Job still running ...
2021/08/31 09:50:08 Job still running ...
2021/08/31 09:50:39 Job still running ...
2021/08/31 09:51:09 Job still running ...
2021/08/31 09:51:39 Job still running ...
2021/08/31 09:52:09 Job still running ...
2021/08/31 09:52:39 Job still running ...
2021/08/31 09:53:09 Job still running ...
2021/08/31 09:53:39 Job still running ...
2021/08/31 09:54:09 Job still running ...
2021/08/31 09:54:39 Job still running ...
2021/08/31 09:55:09 Job still running ...
2021/08/31 09:55:39 Job still running ...
2021/08/31 09:56:09 Job still running ...
2021/08/31 09:56:39 Job still running ...
2021/08/31 09:57:09 Job still running ...
2021/08/31 09:57:39 Job still running ...
2021/08/31 09:58:09 Job still running ...
2021/08/31 09:58:39 Job still running ...
2021/08/31 09:59:09 Job still running ...
2021/08/31 09:59:39 Job still running ...
2021/08/31 10:00:09 Job still running ...
2021/08/31 10:00:39 Job still running ...
2021/08/31 10:01:09 Job still running ...
2021/08/31 10:01:39 Job still running ...
2021/08/31 10:02:09 Job still running ...
2021/08/31 10:02:40 Job still running ...
2021/08/31 10:03:10 Failed to execute job: job 2021-08-31_01_59_59-9878464082233207872 failed
panic: Failed to execute job: job 2021-08-31_01_59_59-9878464082233207872 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1129de8, 0xc00003e0b0, 0x101c117, 0x19, 0xc000323e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 3m 48s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/p4z5she3f77km
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#254
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/254/display/redirect>
Changes:
------------------------------------------
[...truncated 29.85 KB...]
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1630314002182772270/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1630314002182772270/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0830065629",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/08/30 09:00:03 Submitted job: 2021-08-30_02_00_03-1103660939194846101
2021/08/30 09:00:03 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-08-30_02_00_03-1103660939194846101?project=apache-beam-testing
2021/08/30 09:00:03 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-08-30_02_00_03-1103660939194846101
2021/08/30 09:00:03 Job state: JOB_STATE_PENDING ...
2021/08/30 09:00:34 Job still running ...
2021/08/30 09:01:04 Job still running ...
2021/08/30 09:01:34 Job still running ...
2021/08/30 09:02:04 Job still running ...
2021/08/30 09:02:34 Job still running ...
2021/08/30 09:03:04 Job still running ...
2021/08/30 09:03:34 Job still running ...
2021/08/30 09:04:04 Job still running ...
2021/08/30 09:04:34 Job still running ...
2021/08/30 09:05:04 Job still running ...
2021/08/30 09:05:34 Job still running ...
2021/08/30 09:06:04 Job still running ...
2021/08/30 09:06:34 Job still running ...
2021/08/30 09:07:04 Job still running ...
2021/08/30 09:07:34 Job still running ...
2021/08/30 09:08:04 Job still running ...
2021/08/30 09:08:34 Job still running ...
2021/08/30 09:09:04 Job still running ...
2021/08/30 09:09:34 Job still running ...
2021/08/30 09:10:05 Job still running ...
2021/08/30 09:10:35 Job still running ...
2021/08/30 09:11:05 Job still running ...
2021/08/30 09:11:35 Job still running ...
2021/08/30 09:12:05 Job still running ...
2021/08/30 09:12:35 Job still running ...
2021/08/30 09:13:05 Job still running ...
2021/08/30 09:13:35 Job still running ...
2021/08/30 09:14:05 Job still running ...
2021/08/30 09:14:35 Job still running ...
2021/08/30 09:15:05 Job still running ...
2021/08/30 09:15:35 Job still running ...
2021/08/30 09:16:05 Job still running ...
2021/08/30 09:16:35 Job still running ...
2021/08/30 09:17:05 Job still running ...
2021/08/30 09:17:35 Job still running ...
2021/08/30 09:18:05 Job still running ...
2021/08/30 09:18:35 Job still running ...
2021/08/30 09:19:05 Job still running ...
2021/08/30 09:19:35 Job still running ...
2021/08/30 09:20:05 Job still running ...
2021/08/30 09:20:35 Job still running ...
2021/08/30 09:21:05 Job still running ...
2021/08/30 09:21:35 Job still running ...
2021/08/30 09:22:05 Job still running ...
2021/08/30 09:22:35 Job still running ...
2021/08/30 09:23:05 Job still running ...
2021/08/30 09:23:35 Job still running ...
2021/08/30 09:24:06 Job still running ...
2021/08/30 09:24:36 Job still running ...
2021/08/30 09:25:06 Job still running ...
2021/08/30 09:25:36 Job still running ...
2021/08/30 09:26:06 Job still running ...
2021/08/30 09:26:36 Job still running ...
2021/08/30 09:27:06 Job still running ...
2021/08/30 09:27:36 Job still running ...
2021/08/30 09:28:06 Job still running ...
2021/08/30 09:28:36 Job still running ...
2021/08/30 09:29:06 Job still running ...
2021/08/30 09:29:36 Job still running ...
2021/08/30 09:30:06 Job still running ...
2021/08/30 09:30:36 Job still running ...
2021/08/30 09:31:06 Job still running ...
2021/08/30 09:31:36 Job still running ...
2021/08/30 09:32:06 Job still running ...
2021/08/30 09:32:36 Job still running ...
2021/08/30 09:33:06 Job still running ...
2021/08/30 09:33:36 Job still running ...
2021/08/30 09:34:06 Job still running ...
2021/08/30 09:34:36 Job still running ...
2021/08/30 09:35:06 Job still running ...
2021/08/30 09:35:36 Job still running ...
2021/08/30 09:36:06 Job still running ...
2021/08/30 09:36:36 Job still running ...
2021/08/30 09:37:06 Job still running ...
2021/08/30 09:37:36 Job still running ...
2021/08/30 09:38:06 Job still running ...
2021/08/30 09:38:36 Job still running ...
2021/08/30 09:39:07 Job still running ...
2021/08/30 09:39:37 Job still running ...
2021/08/30 09:40:07 Job still running ...
2021/08/30 09:40:37 Job still running ...
2021/08/30 09:41:07 Job still running ...
2021/08/30 09:41:37 Job still running ...
2021/08/30 09:42:07 Job still running ...
2021/08/30 09:42:37 Job still running ...
2021/08/30 09:43:07 Job still running ...
2021/08/30 09:43:37 Job still running ...
2021/08/30 09:44:07 Job still running ...
2021/08/30 09:44:37 Job still running ...
2021/08/30 09:45:07 Job still running ...
2021/08/30 09:45:37 Job still running ...
2021/08/30 09:46:07 Job still running ...
2021/08/30 09:46:38 Job still running ...
2021/08/30 09:47:08 Job still running ...
2021/08/30 09:47:38 Job still running ...
2021/08/30 09:48:08 Job still running ...
2021/08/30 09:48:38 Job still running ...
2021/08/30 09:49:08 Job still running ...
2021/08/30 09:49:38 Job still running ...
2021/08/30 09:50:08 Job still running ...
2021/08/30 09:50:38 Job still running ...
2021/08/30 09:51:08 Job still running ...
2021/08/30 09:51:38 Job still running ...
2021/08/30 09:52:08 Job still running ...
2021/08/30 09:52:38 Job still running ...
2021/08/30 09:53:08 Job still running ...
2021/08/30 09:53:38 Job still running ...
2021/08/30 09:54:08 Job still running ...
2021/08/30 09:54:38 Job still running ...
2021/08/30 09:55:08 Job still running ...
2021/08/30 09:55:38 Job still running ...
2021/08/30 09:56:08 Job still running ...
2021/08/30 09:56:38 Job still running ...
2021/08/30 09:57:08 Job still running ...
2021/08/30 09:57:38 Job still running ...
2021/08/30 09:58:08 Job still running ...
2021/08/30 09:58:38 Job still running ...
2021/08/30 09:59:08 Job still running ...
2021/08/30 09:59:38 Job still running ...
2021/08/30 10:00:08 Job still running ...
2021/08/30 10:00:38 Job still running ...
2021/08/30 10:01:09 Job still running ...
2021/08/30 10:01:39 Job still running ...
2021/08/30 10:02:09 Job still running ...
2021/08/30 10:02:39 Job still running ...
2021/08/30 10:03:09 Failed to execute job: job 2021-08-30_02_00_03-1103660939194846101 failed
panic: Failed to execute job: job 2021-08-30_02_00_03-1103660939194846101 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1129dc8, 0xc00003e0b0, 0x101c117, 0x19, 0xc000263e80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 3m 47s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/2jxvozdtp5ow2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#253
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/253/display/redirect>
Changes:
------------------------------------------
[...truncated 29.84 KB...]
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1630227592338586313/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1630227592338586313/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0829065619",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/08/29 08:59:53 Submitted job: 2021-08-29_01_59_52-10535764923046149258
2021/08/29 08:59:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-08-29_01_59_52-10535764923046149258?project=apache-beam-testing
2021/08/29 08:59:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-08-29_01_59_52-10535764923046149258
2021/08/29 08:59:53 Job state: JOB_STATE_PENDING ...
2021/08/29 09:00:23 Job still running ...
2021/08/29 09:00:53 Job still running ...
2021/08/29 09:01:24 Job still running ...
2021/08/29 09:01:54 Job still running ...
2021/08/29 09:02:24 Job still running ...
2021/08/29 09:02:54 Job still running ...
2021/08/29 09:03:24 Job still running ...
2021/08/29 09:03:54 Job still running ...
2021/08/29 09:04:24 Job still running ...
2021/08/29 09:04:54 Job still running ...
2021/08/29 09:05:24 Job still running ...
2021/08/29 09:05:54 Job still running ...
2021/08/29 09:06:24 Job still running ...
2021/08/29 09:06:54 Job still running ...
2021/08/29 09:07:24 Job still running ...
2021/08/29 09:07:54 Job still running ...
2021/08/29 09:08:24 Job still running ...
2021/08/29 09:08:54 Job still running ...
2021/08/29 09:09:24 Job still running ...
2021/08/29 09:09:54 Job still running ...
2021/08/29 09:10:24 Job still running ...
2021/08/29 09:10:54 Job still running ...
2021/08/29 09:11:24 Job still running ...
2021/08/29 09:11:54 Job still running ...
2021/08/29 09:12:24 Job still running ...
2021/08/29 09:12:54 Job still running ...
2021/08/29 09:13:24 Job still running ...
2021/08/29 09:13:54 Job still running ...
2021/08/29 09:14:24 Job still running ...
2021/08/29 09:14:54 Job still running ...
2021/08/29 09:15:24 Job still running ...
2021/08/29 09:15:54 Job still running ...
2021/08/29 09:16:25 Job still running ...
2021/08/29 09:16:55 Job still running ...
2021/08/29 09:17:25 Job still running ...
2021/08/29 09:17:55 Job still running ...
2021/08/29 09:18:25 Job still running ...
2021/08/29 09:18:55 Job still running ...
2021/08/29 09:19:25 Job still running ...
2021/08/29 09:19:55 Job still running ...
2021/08/29 09:20:25 Job still running ...
2021/08/29 09:20:55 Job still running ...
2021/08/29 09:21:25 Job still running ...
2021/08/29 09:21:55 Job still running ...
2021/08/29 09:22:25 Job still running ...
2021/08/29 09:22:55 Job still running ...
2021/08/29 09:23:25 Job still running ...
2021/08/29 09:23:55 Job still running ...
2021/08/29 09:24:25 Job still running ...
2021/08/29 09:24:55 Job still running ...
2021/08/29 09:25:25 Job still running ...
2021/08/29 09:25:55 Job still running ...
2021/08/29 09:26:25 Job still running ...
2021/08/29 09:26:55 Job still running ...
2021/08/29 09:27:25 Job still running ...
2021/08/29 09:27:55 Job still running ...
2021/08/29 09:28:26 Job still running ...
2021/08/29 09:28:56 Job still running ...
2021/08/29 09:29:26 Job still running ...
2021/08/29 09:29:56 Job still running ...
2021/08/29 09:30:26 Job still running ...
2021/08/29 09:30:56 Job still running ...
2021/08/29 09:31:26 Job still running ...
2021/08/29 09:31:56 Job still running ...
2021/08/29 09:32:26 Job still running ...
2021/08/29 09:32:56 Job still running ...
2021/08/29 09:33:26 Job still running ...
2021/08/29 09:33:56 Job still running ...
2021/08/29 09:34:26 Job still running ...
2021/08/29 09:34:56 Job still running ...
2021/08/29 09:35:26 Job still running ...
2021/08/29 09:35:56 Job still running ...
2021/08/29 09:36:26 Job still running ...
2021/08/29 09:36:56 Job still running ...
2021/08/29 09:37:26 Job still running ...
2021/08/29 09:37:56 Job still running ...
2021/08/29 09:38:26 Job still running ...
2021/08/29 09:38:56 Job still running ...
2021/08/29 09:39:26 Job still running ...
2021/08/29 09:39:56 Job still running ...
2021/08/29 09:40:26 Job still running ...
2021/08/29 09:40:56 Job still running ...
2021/08/29 09:41:26 Job still running ...
2021/08/29 09:41:56 Job still running ...
2021/08/29 09:42:26 Job still running ...
2021/08/29 09:42:57 Job still running ...
2021/08/29 09:43:27 Job still running ...
2021/08/29 09:43:57 Job still running ...
2021/08/29 09:44:27 Job still running ...
2021/08/29 09:44:57 Job still running ...
2021/08/29 09:45:27 Job still running ...
2021/08/29 09:45:57 Job still running ...
2021/08/29 09:46:27 Job still running ...
2021/08/29 09:46:57 Job still running ...
2021/08/29 09:47:27 Job still running ...
2021/08/29 09:47:57 Job still running ...
2021/08/29 09:48:27 Job still running ...
2021/08/29 09:48:57 Job still running ...
2021/08/29 09:49:27 Job still running ...
2021/08/29 09:49:57 Job still running ...
2021/08/29 09:50:27 Job still running ...
2021/08/29 09:50:57 Job still running ...
2021/08/29 09:51:27 Job still running ...
2021/08/29 09:51:57 Job still running ...
2021/08/29 09:52:27 Job still running ...
2021/08/29 09:52:57 Job still running ...
2021/08/29 09:53:27 Job still running ...
2021/08/29 09:53:57 Job still running ...
2021/08/29 09:54:27 Job still running ...
2021/08/29 09:54:58 Job still running ...
2021/08/29 09:55:28 Job still running ...
2021/08/29 09:55:58 Job still running ...
2021/08/29 09:56:28 Job still running ...
2021/08/29 09:56:58 Job still running ...
2021/08/29 09:57:28 Job still running ...
2021/08/29 09:57:58 Job still running ...
2021/08/29 09:58:28 Job still running ...
2021/08/29 09:58:58 Job still running ...
2021/08/29 09:59:28 Job still running ...
2021/08/29 09:59:58 Job still running ...
2021/08/29 10:00:28 Job still running ...
2021/08/29 10:00:58 Job still running ...
2021/08/29 10:01:28 Job still running ...
2021/08/29 10:01:58 Job still running ...
2021/08/29 10:02:28 Job still running ...
2021/08/29 10:02:58 Failed to execute job: job 2021-08-29_01_59_52-10535764923046149258 failed
panic: Failed to execute job: job 2021-08-29_01_59_52-10535764923046149258 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1129dc8, 0xc000120000, 0x101c117, 0x19, 0xc0003ffe80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 3m 38s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/xz4ltkinnxjse
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch
#252
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/252/display/redirect?page=changes>
Changes:
[randomstep] [BEAM-12706] Bump Apache Arrow to 5.0.0
[aromanenko.dev] [BEAM-12270] TPC-DS: Add schema projection for Parquet source
[randomstep] [BEAM-12706] Bump Apache Arrow to 5.0.0
[noreply] [BEAM-12810] Reverting PR-15185 (#15402)
------------------------------------------
[...truncated 29.72 KB...]
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_cogbk_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/cogbk"
},
{
"key": "co_input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1630141198091230099/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
"hooks": "{}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_cogbk_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
"iterations": "1",
"****_binary": "linux_amd64/cogbk"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1630141198091230099/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.34.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.34.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-cogbk-1-0828065627",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/08/28 08:59:59 Submitted job: 2021-08-28_01_59_58-3457262648311850143
2021/08/28 08:59:59 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-08-28_01_59_58-3457262648311850143?project=apache-beam-testing
2021/08/28 08:59:59 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-08-28_01_59_58-3457262648311850143
2021/08/28 08:59:59 Job state: JOB_STATE_PENDING ...
2021/08/28 09:00:29 Job still running ...
2021/08/28 09:00:59 Job still running ...
2021/08/28 09:01:29 Job still running ...
2021/08/28 09:01:59 Job still running ...
2021/08/28 09:02:29 Job still running ...
2021/08/28 09:02:59 Job still running ...
2021/08/28 09:03:29 Job still running ...
2021/08/28 09:03:59 Job still running ...
2021/08/28 09:04:29 Job still running ...
2021/08/28 09:04:59 Job still running ...
2021/08/28 09:05:30 Job still running ...
2021/08/28 09:06:00 Job still running ...
2021/08/28 09:06:30 Job still running ...
2021/08/28 09:07:00 Job still running ...
2021/08/28 09:07:30 Job still running ...
2021/08/28 09:08:00 Job still running ...
2021/08/28 09:08:30 Job still running ...
2021/08/28 09:09:00 Job still running ...
2021/08/28 09:09:30 Job still running ...
2021/08/28 09:10:00 Job still running ...
2021/08/28 09:10:30 Job still running ...
2021/08/28 09:11:00 Job still running ...
2021/08/28 09:11:30 Job still running ...
2021/08/28 09:12:00 Job still running ...
2021/08/28 09:12:30 Job still running ...
2021/08/28 09:13:00 Job still running ...
2021/08/28 09:13:30 Job still running ...
2021/08/28 09:14:00 Job still running ...
2021/08/28 09:14:30 Job still running ...
2021/08/28 09:15:00 Job still running ...
2021/08/28 09:15:30 Job still running ...
2021/08/28 09:16:00 Job still running ...
2021/08/28 09:16:31 Job still running ...
2021/08/28 09:17:01 Job still running ...
2021/08/28 09:17:31 Job still running ...
2021/08/28 09:18:01 Job still running ...
2021/08/28 09:18:31 Job still running ...
2021/08/28 09:19:01 Job still running ...
2021/08/28 09:19:31 Job still running ...
2021/08/28 09:20:01 Job still running ...
2021/08/28 09:20:31 Job still running ...
2021/08/28 09:21:01 Job still running ...
2021/08/28 09:21:31 Job still running ...
2021/08/28 09:22:01 Job still running ...
2021/08/28 09:22:31 Job still running ...
2021/08/28 09:23:01 Job still running ...
2021/08/28 09:23:31 Job still running ...
2021/08/28 09:24:01 Job still running ...
2021/08/28 09:24:31 Job still running ...
2021/08/28 09:25:01 Job still running ...
2021/08/28 09:25:31 Job still running ...
2021/08/28 09:26:01 Job still running ...
2021/08/28 09:26:32 Job still running ...
2021/08/28 09:27:02 Job still running ...
2021/08/28 09:27:32 Job still running ...
2021/08/28 09:28:02 Job still running ...
2021/08/28 09:28:32 Job still running ...
2021/08/28 09:29:02 Job still running ...
2021/08/28 09:29:32 Job still running ...
2021/08/28 09:30:02 Job still running ...
2021/08/28 09:30:32 Job still running ...
2021/08/28 09:31:02 Job still running ...
2021/08/28 09:31:32 Job still running ...
2021/08/28 09:32:02 Job still running ...
2021/08/28 09:32:32 Job still running ...
2021/08/28 09:33:02 Job still running ...
2021/08/28 09:33:32 Job still running ...
2021/08/28 09:34:02 Job still running ...
2021/08/28 09:34:32 Job still running ...
2021/08/28 09:35:02 Job still running ...
2021/08/28 09:35:32 Job still running ...
2021/08/28 09:36:02 Job still running ...
2021/08/28 09:36:32 Job still running ...
2021/08/28 09:37:02 Job still running ...
2021/08/28 09:37:32 Job still running ...
2021/08/28 09:38:03 Job still running ...
2021/08/28 09:38:33 Job still running ...
2021/08/28 09:39:03 Job still running ...
2021/08/28 09:39:33 Job still running ...
2021/08/28 09:40:03 Job still running ...
2021/08/28 09:40:33 Job still running ...
2021/08/28 09:41:03 Job still running ...
2021/08/28 09:41:33 Job still running ...
2021/08/28 09:42:03 Job still running ...
2021/08/28 09:42:33 Job still running ...
2021/08/28 09:43:03 Job still running ...
2021/08/28 09:43:33 Job still running ...
2021/08/28 09:44:03 Job still running ...
2021/08/28 09:44:33 Job still running ...
2021/08/28 09:45:03 Job still running ...
2021/08/28 09:45:33 Job still running ...
2021/08/28 09:46:03 Job still running ...
2021/08/28 09:46:33 Job still running ...
2021/08/28 09:47:04 Job still running ...
2021/08/28 09:47:34 Job still running ...
2021/08/28 09:48:04 Job still running ...
2021/08/28 09:48:34 Job still running ...
2021/08/28 09:49:04 Job still running ...
2021/08/28 09:49:34 Job still running ...
2021/08/28 09:50:04 Job still running ...
2021/08/28 09:50:34 Job still running ...
2021/08/28 09:51:04 Job still running ...
2021/08/28 09:51:34 Job still running ...
2021/08/28 09:52:04 Job still running ...
2021/08/28 09:52:34 Job still running ...
2021/08/28 09:53:04 Job still running ...
2021/08/28 09:53:34 Job still running ...
2021/08/28 09:54:04 Job still running ...
2021/08/28 09:54:34 Job still running ...
2021/08/28 09:55:04 Job still running ...
2021/08/28 09:55:34 Job still running ...
2021/08/28 09:56:04 Job still running ...
2021/08/28 09:56:34 Job still running ...
2021/08/28 09:57:04 Job still running ...
2021/08/28 09:57:34 Job still running ...
2021/08/28 09:58:04 Job still running ...
2021/08/28 09:58:34 Job still running ...
2021/08/28 09:59:04 Job still running ...
2021/08/28 09:59:35 Job still running ...
2021/08/28 10:00:05 Job still running ...
2021/08/28 10:00:35 Job still running ...
2021/08/28 10:01:05 Job still running ...
2021/08/28 10:01:35 Job still running ...
2021/08/28 10:02:05 Job still running ...
2021/08/28 10:02:35 Job still running ...
2021/08/28 10:03:05 Failed to execute job: job 2021-08-28_01_59_58-3457262648311850143 failed
panic: Failed to execute job: job 2021-08-28_01_59_58-3457262648311850143 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1129dc8, 0xc00018a000, 0x101c117, 0x19, 0xc0001afe80, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x50a
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 70
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 3m 44s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/nrgjk2kpsjkla
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org